- dovecot - dovecot.org

[Dovecot] Is dovecot the right choice for this problem?
by Darren McLaughlin 09 Dec '07

09 Dec '07

Is dovecot the right choice for this problem? I have a shared server with verio. I have one particular client that sends and receives numerous large emails, and those emails were causing me to run out of processes on my verio server, and basically slow things down a great deal due to the shared mail queue. Verio suggested Dovecot to reduce server load and allow this one client to have less problems with sending and receiving email. Does this sound logical to anyone in the know? Thanks! Darren

3 6

[Dovecot] Are these events normal?
by Jost Krieger 08 Dec '07

08 Dec '07

We have dropped dovecot in place of UW-IMAP for about 40000 users and have solved our immediate problem: disk I/O overload, mainly from people doing POP3 and "leave mail on server". Thank you! Now i got loads of dovecot error messages in the logs and don't know if there is any significance. Here are a few examples: The most common event is: 2007-12-06 16:00:17.837654500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1547 got too little data: 5176 vs 5184 2007-12-06 16:00:18.575403500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1548 got too little data: 4749 vs 4757 2007-12-06 16:00:19.276147500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1548 got too little data: 4749 vs 4757 2007-12-06 16:00:20.371238500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1540 got too little data: 5162 vs 5170 2007-12-06 16:00:20.996483500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1540 got too little data: 5162 vs 5170 2007-12-06 16:00:21.650218500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1541 got too little data: 4086 vs 4094 2007-12-06 16:00:22.273782500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1541 got too little data: 4086 vs 4094 2007-12-06 16:00:22.920507500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1542 got too little data: 3556 vs 3562 2007-12-06 16:00:23.490787500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1542 got too little data: 3556 vs 3562 2007-12-06 16:00:24.052849500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1543 got too little data: 4098 vs 4106 2007-12-06 16:00:24.741072500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1543 got too little data: 4098 vs 4106 2007-12-06 16:00:25.448977500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1544 got too little data: 4627 vs 4635 2007-12-06 16:00:26.130131500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1544 got too little data: 4627 vs 4635 2007-12-06 16:00:26.819376500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1545 got too little data: 7582 vs 7590 2007-12-06 16:00:27.445497500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1545 got too little data: 7582 vs 7590 Somewhat rarer are events like 2007-12-06 19:36:44.114294500 dovecot: Info: POP3(yyyyyyyy): Disconnected: Storage error during logout. top=1/1723, retr=1/4665462, del=27/61, size=17280696 and rarely we got 2007-11-24 12:10:01.086620500 dovecot: Error: IMAP(zzzzzzzz): file istream-header-filter.c: line 194 (read_header): assertion failed: (hdr == NULL) 2007-11-24 12:10:01.086718500 dovecot: Error: IMAP(zzzzzzzz): Raw backtrace: 2007-11-24 12:10:01.089552500 dovecot: Error: child 13083 (imap) killed with signal 6 2007-11-24 12:10:01.655875500 dovecot: Error: IMAP(zzzzzzzz): file istream-header-filter.c: line 194 (read_header): assertion failed: (hdr == NULL) 2007-11-24 12:10:01.656106500 dovecot: Error: IMAP(zzzzzzzz): Raw backtrace: 2007-11-24 12:10:01.659853500 dovecot: Error: child 13098 (imap) killed with signal 6 2007-11-24 12:10:02.022553500 dovecot: Error: IMAP(zzzzzzzz): file istream-header-filter.c: line 194 (read_header): assertion failed: (hdr == NULL) 2007-11-24 12:10:02.022761500 dovecot: Error: IMAP(zzzzzzzz): Raw backtrace: 2007-11-24 12:10:02.025866500 dovecot: Error: child 13121 (imap) killed with signal 6 Our dovecot is # 1.0.5: /usr/local/dovecot/etc/dovecot.conf log_path: /dev/stderr log_timestamp: protocols: pop3 imap listen(default): 134.147.64.16:143 listen(imap): 134.147.64.16:143 listen(pop3): 134.147.64.16:110 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_process_per_connection: no valid_chroot_dirs: /net/sunu007/disc3/home:/net/sunu007/disc4/home max_mail_processes: 4096 first_valid_uid: 50 mail_location: mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/ mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 mail_log_max_lines_per_sec: 0 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: shadow args: blocking=yes userdb: driver: passwd Is there anything we should do? The crashes have stopped in the meantime, it seems. Jost -- | Helft Spam ausrotten! HTML in Mail ist unhöflich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gefällig, gefällige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 |

3 3

[Dovecot] New Mailbox Format Plugin Help
by Sacha Bernstein 08 Dec '07

08 Dec '07

I would like to develop a new mailbox format for a very specialized application. Can anyone point me in the appropriate direction to get started writing a plugin? More detail for anyone interested: I need to store mail in a format that's quickly accessible and modifiable to an external process. This is for a very low-volume mail system (averaging less than 50 messages stored at any one time) that needs very good indexing. I need to create new mailboxes on the fly and perform fast searches across all the mailboxes. I intend to store all the messages in an SQL database. Any help getting started interfacing with dovecot (other than reading through _all_ the source code) would be greatly appreciated. Thanks, Sacha

2 1

[Dovecot] Questions about deliver log files
by frank.kintrup＠fkware.de 08 Dec '07

08 Dec '07

Hi, I upgraded from Courier to dovecot, and now I try to rebuild some of the features I used to have. One was a monthly per user log of maildrop's work. I used this code in maildroprc: DATE=`date +%m` logfile "$MAILDIR/maildrop-$DATE.log" This created a monthly log in the each user's Maildir. I find it easier to have a log per user than having to filter the log entries from a large log file for all users. I tried to recreate it with deliver by using the variables %h and %d/%n, but they are not interpreted when the log file is accessed ("Can't open log file /var/vmail/%d/%n/deliver.log: No such file or directory"). And there seems to be no way to include a date in the file name (but maybe I could use logrotate for that). Another problem: Currently deliver only logs the message id. A user would never ask for this (especially if he asks where certain mails were stored/discarded), he would ask for the sender's name/email or subject. Is the contents of the log file configurable? Frank

2 2

[Dovecot] Stale NFS file handle and duplicated messages
by Adrian Barker 08 Dec '07

08 Dec '07

We recently moved all our users from the Washington IMAP server to Dovecot. There has been a substantial improvement in performance, but some users are reporting duplicate messages, and we see 'Stale NFS file handle' errors in the syslog. Does anyone know what would cause this ? The errors relate to the index file, eg. Nov 29 00:49:47 imap-e.ucl.ac.uk dovecot: [ID 107833 mail.error] IMAP(ccaazzz): close() failed with index file /home/ccaazzz/imap-mail/.imap/mbox/dovecot.index: Stale NFS file handle Our IMAP servers (5 of them) are a mixture of Sparc Solaris 8 and Solaris 10 machines, using NFS to a central mailspool running on AIX. We are using a mixture of Dovecot 1.0.3 and 1.0.5. dovecot -n gives: # 1.0.3: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ listen: *:143 ssl_listen: *:993 ssl_ca_file: /usr/local/ssl/certs/sureserveredu.pem ssl_cert_file: /usr/local/ssl/certs/imap-server_ucl_ac_uk.crt ssl_key_file: /usr/local/ssl/certs/imap.key ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /usr/local/libexec/dovecot/imap-login login_user: pp login_process_per_connection: no login_processes_count: 30 max_mail_processes: 1500 first_valid_uid: 200 mail_location: mbox:%h/imap-mail:INBOX=/nfs/rcs/mail-spool/mail/%u mmap_disable: yes mbox_lock_timeout: 55 mbox_dotlock_change_timeout: 50 mail_drop_priv_before_exec: yes mail_executable: /usr/local/sbin/dovecot-login.csh mail_plugins: mbox_snarf mail_plugin_dir: /usr/local/lib/dovecot namespace: type: private separator: / inbox: yes auth default: passdb: driver: pam passdb: driver: passwd userdb: driver: passwd plugin: mbox_snarf: ~/imap-mail/mbox -- Adrian Barker, Internet Technology Section Information Systems University College London, Gower Street, London WC1E 6BT External phone: +44 20 7679 5140, Fax (+44) 20 7388 5406 Internal phone: x 25140 Email: A.Barker(a)ucl.ac.uk

2 3

[Dovecot] Sponsorship of Dovecot
by Ed W 08 Dec '07

08 Dec '07

Timo Sirainen wrote: > v1.1.0 is finally getting closer, so it's time to start planning what > happens after it. Below is a list of some of the larger features I'm > planning on implementing. I'm not yet sure in which order, so I think > it's time to ask again what features companies would be willing to pay > for? > OK, I would like to sponsor Dovecot for three months for $1,000/month I am just a small business and this is basically coming straight out of my own paycheck, but we use the product internally and I like it and would like to see it continue to develop at the rate it has done. Although this is just a small token of my appreciation, I hope that other businesses who are using dovecot will step up and at least match this contribution. It's less than the price of a small Exchange Server setup and has oh so much more potential I have some minimal requests for what I would like to be developed during that period, but largely the pledge is without strings and you can develop as you wish. I will add a note on the Roadmap thread with my thoughts Thanks for writing Dovecot. Please contact me offlist and let me know how you want the sponsorship delivered (Paypal is fine but sometimes expensive for the receiver). I hope others will step up and increase this substantially Regards Ed W http://www.mailasail.com

1 0

Re: [Dovecot] imap crash with fts squat enabled.
by Joe Wong 08 Dec '07

08 Dec '07

Hi Timo, Dovecot was running on FC7 while the file server is running on FC4. - Joe May the force be with you..

1 0

[Dovecot] "pipe" plugin - is anyone interested (or using it)?
by Nicolas Boullis 08 Dec '07

08 Dec '07

Hi, A few months ago, I sent a message to this list asking if people would be interested by a "pipe" plugin (see http://dovecot.org/pipermail/dovecot/2007-May/023005.html ). I received a few answers of people who told they were intersted. A few months later, I sent a new message announcing the availability of my work (see http://dovecot.org/pipermail/dovecot/2007-August/024805.html ). Since then, I have received no feedback... So, is anyone using this plugin? Is anyone using it? Timo, on my first message, you seemed to be interested to merge such a feature (see http://dovecot.org/pipermail/dovecot/2007-May/023055.html ). Are you still interested? All comments are welcome. I think the feature (or a more generic one) would be a worthy addition for dovecot, be it for ham/spam learning, to implement an "outbox" or anything else I can't think about. All comments about my work are welcome. (Please note that I have not (yet) tried to port it to dovecot 1.1...) Cheers, Nicolas Boullis Ecole Centrale Paris

7 13

[Dovecot] Corrupted Transaction Log File: v1.0.7
by Daniel Watts 07 Dec '07

07 Dec '07

Following errors have happened quite a bit: Dec 7 14:19:26 locallog@tg3/tg3 dovecot: IMAP(peter.day(a)mydomain.com): Transaction log file /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: marked corrupted Dec 7 14:19:26 locallog@tg3/tg3 dovecot: IMAP(peter.day(a)mydomain.com): Transaction log file /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log.2: marked corrupted Dec 7 14:19:26 locallog@tg3/tg3 dovecot: IMAP(peter.day(a)mydomain.com): Corrupted transaction log file /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: Append with UID 50, but next_uid = 15870 Causing Peter Day not to be able to delete emails. Seems mostly to happen in the Trash I think. Shouldn't Dovecot be able to recover from this? And then have some rule that if it cannot recover, delete the index file and rebuild? When I manually remove the file it works fine. Thanks, Daniel

3 4

[Dovecot] open files
by Steve Heaven 07 Dec '07

07 Dec '07

This morning dovecot stopped allowing pop3 logins. In the logs I found the messages below Is there a config value for the max open files ? Dec 7 10:00:22 frigga dovecot: execv(/usr/local/libexec/dovecot/pop3) failed: Too many open files Dec 7 10:01:14 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:43 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:45 frigga dovecot: pipe() failed: Too many open files Dec 7 10:04:39 frigga dovecot: pipe() failed: Too many open files Dec 7 10:04:41 frigga dovecot: pipe() failed: Too many open files Dec 7 10:04:50 frigga dovecot: pipe() failed: Too many open files Dec 7 10:05:00 frigga dovecot: pipe() failed: Too many open files Dec 7 10:05:02 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:05 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:05 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:05 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:06 frigga dovecot: pipe() failed: Too many open files Dec 7 10:07:48 frigga dovecot: pipe() failed: Too many open files Dec 7 10:08:05 frigga dovecot: pipe() failed: Too many open files

3 5