- dovecot - dovecot.org

[Dovecot] Dovecot 1.1.1 killed with SIGABRT
by Andreas M. Kirchwitz 08 Aug '08

08 Aug '08

Hi folks, with Dovecot 1.1.1, I've had two "crashes" (SIGABRT) recently. Dovecot 1.1.1 has been compiled from source and is running on Fedora 8 Linux 32 Bit (all patches) with custom OpenSSL 0.9.8h. [ output of "dovecot -n" ] # 1.1.1: /usr/local/dovecot/etc/dovecot.conf ssl_cert_file: /usr/local/dovecot/etc/dovecot.crt ssl_key_file: /usr/local/dovecot/etc/dovecot.key login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login mail_location: mbox:~/Mail:INBOX=/var/spool/mail/%u auth default: mechanisms: plain login digest-md5 cram-md5 passdb: driver: passwd-file args: /usr/local/dovecot/etc/dovecot.passwd userdb: driver: passwd-file args: /usr/local/dovecot/etc/dovecot.passwd First, the "small" problem with Pine 4.64: Jul 20 03:17:04 linux dovecot: imap-login: Login: user=<user1>, method=CRAM-MD5, rip=138.201.2.8, lip=138.201.2.2, TLS Jul 20 03:17:53 linux dovecot: IMAP(user1): UIDVALIDITY changed (1215137127 -> 1216072777) in mbox file /home/user1/Mail/Trash Jul 20 03:17:53 linux dovecot: Panic: IMAP(user1): file mail-index-transaction.c: line 548 (mail_index_transaction_get_next_uid): assertion failed: (recs[count-1].uid >= next_uid) Jul 20 03:17:53 linux dovecot: IMAP(user1): Raw backtrace: imap [0x80cf2f0] -> imap [0x80cf34a] -> imap [0x80cec5c] -> imap [0x80ad621] -> imap [0x80ae56b] -> imap(mail_cache_get_first_new_seq+0x12) [0x80a1d82] -> imap(mail_cache_field_want_add+0x8d) [0x80a555d] -> imap(index_mail_parse_header_init+0x1cc) [0x80964ac] -> imap(index_mail_cache_parse_init+0x4e) [0x809696e] -> imap(mbox_save_init+0x457) [0x807d4a7] -> imap(mailbox_save_init+0x51) [0x809fd71] -> imap(mail_storage_copy+0xc1) [0x809df31] -> imap(cmd_copy+0x1d2) [0x805b1f2] -> imap(cmd_uid+0x59) [0x805f489] -> imap [0x805fe2c] -> imap [0x805fed5] -> imap [0x8060695] -> imap(client_input+0x5e) [0x80608ae] -> imap(io_loop_handler_run+0x100) [0x80d6c30] -> imap(io_loop_run+0x28) [0x80d5dc8] -> imap(main+0x4a1) [0x80683d1] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x149390] -> imap [0x805a211] Jul 20 03:17:53 linux dovecot: child 19853 (imap) killed with signal 6 The user didn't configure his Pine properly. He used IMAP to access his INBOX, but he forgot to configure this for all other folders as well. Now, Pine modified /home/user1/Mail/Trash directly, and when Dovecot stumbled upon this file it killed itself with signal 6. The problem is not reproducible. After this single failure, Dovecot doesn't seem to have any problems with the folder. However, instead of this panic operation, Dovecot maybe could issue a warning or error response to the client so that the user (hopefully) gets a clue about what's going wrong. Second, the "big" problem with Thunderbird 2.0.0.14: Jul 12 01:04:06 linux dovecot: imap-login: Login: user=<user2>, method=CRAM-MD5, rip=138.201.2.4, lip=138.201.2.2, TLS Jul 12 01:04:45 linux dovecot: Panic: IMAP(user2): file index-sync.c: line 39 (index_mailbox_set_recent_uid): assertion failed: (seq_range_exists(&ibox->recent_flags, uid)) Jul 12 01:04:45 linux dovecot: IMAP(user2): Raw backtrace: imap [0x80cf2f0] -> imap [0x80cf34a] -> imap [0x80cec5c] -> imap [0x809ccba] -> imap [0x8080d10] -> imap(mbox_sync+0x522) [0x80817d2] -> imap [0x807a334] -> imap(index_transaction_commit+0x4e) [0x809d99e] -> imap(cmd_copy+0x35f) [0x805b37f] -> imap(cmd_uid+0x59) [0x805f489] -> imap [0x805fe2c] -> imap [0x805fed5] -> imap [0x8060695] -> imap(client_input+0x5e) [0x80608ae] -> imap(io_loop_handler_run+0x100) [0x80d6c30] -> imap(io_loop_run+0x28) [0x80d5dc8] -> imap(main+0x4a1) [0x80683d1] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x149390] -> imap [0x805a211] Jul 12 01:04:45 linux dovecot: child 25672 (imap) killed with signal 6 [happens over and over in an endless loop until Thunderbird is killed] This has been a nasty one. Different user, different mail client. INBOX with 350 messages in total, 3 of them new. Started Thunderbird, index page is displayed fine, then clicked on one of the 3 new messages to read it. For no apparent reason, Dovecot dies with signal 6. Thunderbird reconnected automatically, and then Dovecot dies again. Nice endless loop ... Stopping and restarting the complete Dovecot subsystem with the help of the init.d script didn't help. Finally the crashes stopped after removing the cache files in /home/fubar/Mail/.imap/INBOX. It's obvious that the cache files got corrupted somehow. There was plenty of disk space free. And the cache files have been freshly created from scratch with Dovecot 1.1.0. Other folders were not affected. Except Dovecot, nobody ever touches these cache files. Well, the good news is, it stopped crashing after removing the cache files. The bad news is, without the cache files (which I removed) the problem cannot be reproduced. So, there's nothing more to offer than these two backtraces. Both crashes are not related to each other and happened to different users with different clients. Maybe the backtraces and my descriptions help to find what's going wrong or how to make Dovecot behave more robustly. If there's any additional information needed, please let me know. Sorry that I didn't save the corrupted cache files. Greetings, Andreas

3 6

Re: [Dovecot] Auth message
by Pavel Shirov 08 Aug '08

08 Aug '08

Further testing show that such message could occur simply by providing random username/password and termination session afterwards (not sending QUIT).

1 0

[Dovecot] Dovecot auto vacation with sieve doesn't work
by CJ Keist 08 Aug '08

08 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Sorry if this comes in twice, I sent this first from my test account. - --------- Guys, I'm running out of hair to pull out ;). Can anyone out there say that this does work?? To me this is looking like a bug and I'm not sure whether it's the sieve plugin or the dovecot deliver program. I have also had no luck the the "reject" sending any reply back to the sender. My setup: OS: Solaris 10 sparc platform postfix: 2.5.2 dovecot: 1.1.2 sieve plugin: 1.1.5 I'm going back forth between procmail and sieve and having no luck. procmail will send the reply to the sender but doesn't deliver the message to the recipient. Sieve will deliver the message to the recipient but doesn't send the reply to the sender. Now if I can just combine the two, I'll be in business. Postfix mail command: mailbox_command = /userM/mail-services/dovecot/libexec/dovecot/deliver - -d $USER* * Dovecot -n (I've made some changes from my previous posting namely with the master_auth settings) # 1.1.2: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 3072). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /userM/mail-services/dovecot/var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /userM/mail-services/dovecot/var/run/dovecot/login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 1024 max_mail_processes: 1024 mail_location: mbox:~/:INBOX=/userM/mail/%u mail_debug: yes mmap_disable: yes mail_nfs_index: yes mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /userM/mail-services/postfix/var/private/auth mode: 432 user: postfix group: postfix master: path: /userM/mail-services/dovecot/var/run/dovecot/auth-master mode: 384 user: postfix group: postfix My .dovecot.sieve file: require ["vacation"]; if header :matches "subject" "*" { vacation :days 30 :addresses "cj.keist(a)colostate.edu" :subject "Automatic response to: ${1}" "I'm away -- send mail to foo in my absence"; } I made some modifications to the vacation reply base on the following URL: http://ietfreport.isoc.org/idref/draft-ietf-sieve-vacation/ In my testing I know the sieve plugin is reading my .dovecot.sieve script and creating the .dovecot.sievec, but that is as for as it goes. The .dovecot.lda-dupes file is not being created (or any .dovecot.sieve.err file) and no reply is even being attempted from the logs: Aug 6 11:30:51 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): new auth connection: pid=27187 Aug 6 11:30:51 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] connect from akron.colostate.edu[129.82.103.160] Aug 6 11:30:51 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] setting up TLS connection from akron.colostate.edu[129.82.103.160] Aug 6 11:30:51 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] Anonymous TLS connection established from akron.colostate.edu[129.82.103.16 0]: TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits) Aug 6 11:30:52 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] 16E2059984: client=akron.colostate.edu[129.82.103.160] Aug 6 11:30:52 mail2.engr.colostate.edu postfix/cleanup[27192]: [ID 197553 mail .info] 16E2059984: message-id=<3b676ae5f90fadad863930dcc61db3f8.squirrel@webmail .engr.colostate.edu> Aug 6 11:30:52 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] disconnect from akron.colostate.edu[129.82.103.160] Aug 6 11:30:52 mail2.engr.colostate.edu postfix/qmgr[18021]: [ID 197553 mail.in fo] 16E2059984: from=<joeblow(a)engr.colostate.edu>, size=1877, nrcpt=1 (queue act ive) Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 315030 mail.info] Lo ading modules from directory: /userM/mail-services/dovecot/lib/dovecot/lda Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 619685 mail.info] Mo dule loaded: /userM/mail-services/dovecot/lib/dovecot/lda/lib90_cmusieve_plugin. so Aug 6 11:30:52 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): master in: USER 1 cjay service=deliver Aug 6 11:30:52 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth-wor ker(default): passwd(cjay): lookup Aug 6 11:30:52 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): master out: USER 1 cjay system_user=cjay uid=10946 gid=32 home=/top/admin/ENS/people/cjay/home Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: system_user=cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: uid=10946 Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: gid=32 Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: home=/top/admin/ENS/people/cjay/home Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 848615 mail.info] mb ox: data=/top/admin/ENS/people/cjay/home/:INBOX=/userM/mail/cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 885103 mail.info] fs : root=/top/admin/ENS/people/cjay/home, index=, control=, inbox=/userM/mail/cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 223526 mail.info] cm usieve: Using sieve path: /top/admin/ENS/people/cjay/home/.dovecot.sieve Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 507699 mail.info] cm usieve: Executing script /top/admin/ENS/people/cjay/home/.dovecot.sievec Aug 6 11:30:53 mail2.engr.colostate.edu deliver(cjay): [ID 702911 mail.info] ms gid=<3b676ae5f90fadad863930dcc61db3f8.squirrel(a)webmail.engr.colostate.edu>: save d mail to INBOX Aug 6 11:30:53 mail2.engr.colostate.edu postfix/local[27193]: [ID 197553 mail.i nfo] 16E2059984: to=<cjay(a)engr2.colostate.edu>, relay=local, delay=1.2, delays=0 .32/0.08/0/0.82, dsn=2.0.0, status=sent (delivered to command: /userM/mail-servi ces/dovecot/libexec/dovecot/deliver -d $USER) Aug 6 11:30:53 mail2.engr.colostate.edu postfix/qmgr[18021]: [ID 197553 mail.in fo] 16E2059984: removed Aug 6 11:34:12 mail2.engr.colostate.edu postfix/anvil[27190]: [ID 197553 mail.i nfo] statistics: max connection rate 1/60s for (smtp:129.82.103.160) at Aug 6 1 1:30:51 Aug 6 11:34:12 mail2.engr.colostate.edu postfix/anvil[27190]: [ID 197553 mail.i nfo] statistics: max connection count 1 for (smtp:129.82.103.160) at Aug 6 11:3 0:51 Aug 6 11:34:12 mail2.engr.colostate.edu postfix/anvil[27190]: [ID 197553 mail.i nfo] statistics: max cache size 1 at Aug 6 11:30:51 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFImeYWA29OFr7C6jcRAkj+AJ0eKINCZmRDWh8gSjbW86Ga6DPWlgCeL/1M rVvbvn6al/3fLep60h2Lxg4= =veQm -----END PGP SIGNATURE-----

3 5

[Dovecot] Expire Plugin - LDA with Vpopmail errors
by Ron Culler 08 Aug '08

08 Aug '08

I am trying to setup Dovecot to use the expire plugin and wanted to use the LDA so I can ensure the messages are indexed as they are delivered to the mailboxes. This system is only accessed via a webmail interface Using dovecot-1.1.2 and Vpopmail with Qmail Dovecot.conf file base_dir = /usr/local/var/run/dovecot/ protocols = imap disable_plaintext_auth = no shutdown_clients = yes log_path = /var/log/dovecott info_log_path = /var/log/dovecott log_timestamp = "" ssl_disable = yes login_dir = /usr/local/var/run/dovecot/login login_user = dovecot login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 mail_location = maildir:~/Maildir namespace private { separator = . prefix = INBOX. inbox = yes } verbose_proctitle = yes first_valid_uid = 89 #last_valid_uid = 0 maildir_copy_with_hardlinks = yes maildir_copy_preserve_filename = no protocol imap { listen = 127.0.0.1:4143 imap_max_line_length = 65536 login_greeting_capability = yes mail_plugins = expire } protocol lda { mail_plugins = expire log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } plugin { # Trash and its children 7d, Spam 30d expire = Trash 7 expire_dict = proxy::expire } auth default { mechanisms = plain passdb vpopmail { args = } userdb vpopmail { } user = vpopmail count = 1 ssl_require_client_cert = no } I see errors in the /var/log/dovecot-deliver.log deliver (email@addrss) Error: Can't connect to auth server at /usr/local/var/run/dovecot//auth-master: no such file or directory. What do I need to do to create this? Ron Culler

2 1

[Dovecot] virtual domains and SSL certificates
by Kacper Wysocki 07 Aug '08

07 Aug '08

Hi all, I have dovecot 1.1.0 setup to access vpopmail accounts for several virtual domains. Dovecot IMAP is accessed through several virtual domains as well, ie mail.foo.com an d mail.bar.com The problem is that the configuration file specifies only one certificate file for dovecot, which means only one Common Name, which means one cannot provide one server cert that will match mail.foo.com AND mail.bar.com, and either mary(a)foo.com or bob(a)bar.com will get a "Security Error: Domain Name Mismatch" in their mail client when connecting through IMAPS. How can I avoid this domain name mismatch error? Regards, Kacper Wysocki

4 4

[Dovecot] RESOLVED: dovecot-imap displays empty domainalias mailboxen
by Kacper Wysocki 07 Aug '08

07 Aug '08

On Thu, Jul 31, 2008 at 5:21 PM, Kacper Wysocki <kacperw(a)online.no> wrote: > I'm using dovecot 1.0.13 as the IMAPS frontend for a vpopmail/qmail > virtual domain setup. Dovecot is set up as follows: > passdb vpopmail{ > } > userdb vpopmail{ > } > > I've added a domain alias for the main domain with vaddaliasdomain and > email to post@aliasdomain is delivered to post@maindomain and can be > checked with pop. > > However, when I try to check IMAP through the account post@aliasdomain > I am confronted with an empty mailbox. If I log in using > post@maindomain I get the expected contents. > > Why can't my users log in using user@aliasdomain to check their emails? Update: dovecot can't find the mail directory because of mail_location = maildir:/var/vpopmail/domains/%d/%n/Maildir and dovecot doesn't know anything about domain aliases. ln -s ~vpopmail/domains/maindomain ~vpopmail/domains/aliasdomain fixes the problem for dovecot. -K

1 0

Re: [Dovecot] Dovecot 1.1 Quota Plugin Configuration?
by David Reid 07 Aug '08

07 Aug '08

Charles Marcus wrote: > On 8/7/2008 8:39 AM, David Reid wrote: >> With 1.0 I had the quota plugin set to allow some accounts to have no >> quota by setting their size (in bytes) to 0 (via mysql). Following the >> upgrade to 1.1 this no longer seems to work and has resulted in a lot of >> annoyed people having messages bumped :-( >> >> The config I have is as follows... >> >> quota = maildir >> quota_rule = *:storage=15M >> quota_rule2 = Trash:ignore >> quota_rule3 = INBOX.Trash:ignore >> quota_rule4 = INBOX.SpamTrain:ignore >> quota_rule5 = SpamTrain:ignore >> >> In the sql.conf I get the quota for each mailbox using this line >> >> user_query = SELECT '/var/vmail/%d/%n' as home, >> 'maildir:/var/vmail/%d/%n' as mail, xxx AS uid, xxx AS gid, >> concat('maildir:storage=', mb_quota) AS quota FROM >> mailboxes WHERE mb_mbname = '%u' AND mb_active = '1' >> >> With this setup when I have a mb_quota set to 0 it simply bounces all >> messages for the mailboxes that should have no quota. >> >> Any ideas how I need to fix this? > > You could start by not posting the same question twice in a 24 hour > period, especially when your question has already been answered. Apologies, but as the problem affected the mailbox I posted from I missed the reply and hence the answer. > > You are trying to use the same mysql query from 1.0 for 1.1 and it won't > work. > > http://wiki.dovecot.org/Quota/1.1 > Knowing the sql needed to be adjusted I have made the changes. The wiki page says that the uid and guid can be set in the config file, but doesn't give any indication of the lines to use. Maybe the information could be added? Thanks for your (duplicate) reply. david

1 0

[Dovecot] Dovecot 1.1 Quota Plugin Configuration?
by David Reid 07 Aug '08

07 Aug '08

With 1.0 I had the quota plugin set to allow some accounts to have no quota by setting their size (in bytes) to 0 (via mysql). Following the upgrade to 1.1 this no longer seems to work and has resulted in a lot of annoyed people having messages bumped :-( The config I have is as follows... quota = maildir quota_rule = *:storage=15M quota_rule2 = Trash:ignore quota_rule3 = INBOX.Trash:ignore quota_rule4 = INBOX.SpamTrain:ignore quota_rule5 = SpamTrain:ignore In the sql.conf I get the quota for each mailbox using this line user_query = SELECT '/var/vmail/%d/%n' as home, 'maildir:/var/vmail/%d/%n' as mail, xxx AS uid, xxx AS gid, concat('maildir:storage=', mb_quota) AS quota FROM mailboxes WHERE mb_mbname = '%u' AND mb_active = '1' With this setup when I have a mb_quota set to 0 it simply bounces all messages for the mailboxes that should have no quota. Any ideas how I need to fix this? david

1 0

[Dovecot] Experience moving mailboxes from Dovecot 0.99.14 to Dovecot 1.07 => Improvement possible
by Benoît DESLOGES 07 Aug '08

07 Aug '08

Hi, This small mail to share my observation about a recent move of mailboxes between two servers and ask about explanation and/or improvement about UIDL in dovecot. SV1 : Dovecot 0.99.14 / Red Hat Fedore Core 4 SV2 : Dovecot 1.07 / CentOS 5.2 Mailboxes in /var/spool/mail on the twoo servers. Test will be done with outlook express with option "leave message on server" checked. Goal is simply to move users mailboxes from SV1 to SV2 without re-downloading all messages. Try 1: - Stop dovecot on SV2 - Clear all dovecot indexes on SV2 - Rsync of my mailbox - Start dovecot on SV2 - Update pop setting in outlook and send/receive Result : => starting to download 3000 mails... After some debug, I discovered that UIDL where not of the same format => put pop3_uidl_format = %v.%u in dovecot.conf of SV2. Try 2: Same operations as Try1 Result : => starting to download 3000 mails... UIDL's where of the same format but values where not corresponding... Teleting on SV1 and asking UIDL, last value is xxxxxxxxxx.85878. On SV2, xxxxxxxxxx.85879 was the FIRST value of the list. Conclusion for the moment, Dovecot has a problem with the detection of existing UID of the moved mailbox. Comparaison of first header found from the two mailboxes show ... differences ! SV1 give the following : (...) X-UID: 70570 Content-Length: 1561 X-IMAPbase: xxxxxxxxxx 85845 $MDNSent X-Keywords: (...) SV2 give the following (after first POP attempt) : (...) Content-Length: 1561 X-IMAPbase: xxxxxxxxxx 0000089204 $MDNSent X-Keywords: X-UID: 85846 (...) Observation : X-UID: 85846 is not at the same place in the header. Try 3: - Stop dovecot on SV2 - Clear all dovecot indexes on SV2 - Rsync of my mailbox - Edit mailbox and move X-UID header after the X-Keywords header - Start dovecot on SV2 - Update pop setting in outlook and send/receive Result : => OK. Is that normal that dovecot is impacted by the position of the headers ? Maybe some improvement possible ? Maybe theyre is another method to make my migration ? Any observation or comment is welcome... -- Benoît Desloges Network Engineer

7 8

[Dovecot] Fwd: Re: sasl parameters missing (in postfix)
by Daniel Black 07 Aug '08

07 Aug '08

In response to my request for postfix to support dovecot auth arguments I got the forwarded reply. If someone gets around to this before me I won't be offended. ------------ Story is I deployed a webmail with certificate based authentication that substitutes a global master password (http://wiki.dovecot.org/Authentication/MasterUsers) when the certificate matches. The webmail accesses the inbox by imap and reuses the password for smtp through postfix. I configured dovecot sasl authentication to allow a particular global password to be allowed from one IP address of the webmail server. Unfortuanately it seems as though postfix doesn't pass rip= (remote ip) or the other AUTH parameters of the protocol (http://dovecot.org/doc/auth-protocol.txt) Is adding these parameters to postfix's sasl authentication a useful feature request? ---------- Forwarded Message ---------- Subject: Re: sasl parameters missing Date: Thu, 7 Aug 2008 From: Wietse Venema <wietse(a)porcupine.org> To: Daniel Black <daniel.subs(a)internode.on.net> Daniel Black: > Thanks Wietse, > > On Tue, 5 Aug 2008 09:30:44 am Wietse Venema wrote: > > Postfix passes the information in the SMTP client's AUTH command. > > This is how I got the Dovecot extension from Timo. If someone is > > willing to monitor his docs for changes, > > it seems fairly stable. Going off the doc/auth-protocol.txt changelog > Nov 12 2006 lport/rport was added. > Aug 07 2005 changed valid-client-cert to ssl-valid-cert > Oct 22 2004 original documentation > > Current implementation of the authentication server in dovecot seems to ignore > parameters it doesn't understand. > > > then they are welcome to do so. I won't. > > On the basis of this apparent stability and compatibility would you consider > accepting a patch? Yes. No promise, though, that it will be adopted. One consideration is that Postfix does not talk directly to Dovecot, but instead talks to an abstraction layer that is used for both Cyrus SASL and for Dovecot. Obviously, that XSASL abstraction layer must not be made specific to the underlying Cyrus SASL or Dovecot implementation. The solution therefore is not to extend XSASL functions with one extra argument for each Dovecot feature. Apart from being Dovecot-specific, functions with many parameters are difficult to update correctly; compilers can't always tell that two arguments should be swapped. I solved the problem of many-parameter functions by using macros such as TLS_SERVER_START(). This gives more assurance that data is passed correctly, and it less likely to break due to human maintainer error. Wietse ------------------------------------------------------- -- Daniel Black -- Proudly a Gentoo Linux User. Gnu-PG/PGP signed and encrypted email preferred http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x76677097 GPG Signature D934 5397 A84A 6366 9687 9EB2 861A 4ABA 7667 7097

1 0

[Dovecot] Purpose of files under .imap
by Kenneth Porter 07 Aug '08

07 Aug '08

I've got a user with an unusable account. Tbird just sits in a loop endlessly logging in over and over when a particular folder is selected. What files under .imap associated with that folder can be safely deleted? What's stored in all of them? I see all of these: .customflags dovecot.index dovecot.index.cache dovecot.index.log .imap.index .imap.index.data .imap.index.log .imap.index.tree

2 2

[Dovecot] Next message unexpectedly lost
by Kenneth Porter 07 Aug '08

07 Aug '08

Using 1.1.2. I'm getting the above message over and over in the error log. Dovecot drops the connection and the client (Tbird) just keeps retrying in an endless loop. Using Wireshark to sniff the exchange, it looks like the command that fails looks like this: 5 UID fetch 1:9749,9751:9763,9765:9930,9932,9934:9942 (UID RFC822.SIZE FLAGS BODY.PEEK[HEADER.FIELDS (From To Cc Subject Date Message-ID Priority X-Priority References Newsgroups In-Reply-To Content-Type)]) Dovecot seems to be shutting down after receiving this. Mulberry doesn't seem to have the problem, presumably because it's sending a different command sequence that doesn't stroke this. Here's the failing code, in i_stream_raw_mbox_read : if (stream->istream.v_offset - rstream->hdr_offset + new_pos > rstream->mail_size) { /* istream_raw_mbox_set_next_offset() used invalid cached next_offset? */ i_error("Next message unexpectedly lost from %"PRIuUOFF_T, rstream->hdr_offset + rstream->mail_size); rstream->eof = TRUE; rstream->corrupted = TRUE; return -1; } I've tried deleting the associated .imap/folder contents but it must regenerate the same bad data as it happens again.

1 0

[Dovecot] Unlimited quota in 1.1?
by David Reid 07 Aug '08

07 Aug '08

How do I set an unlimited quota for a user in 1.1? Setting it to 0 bytes worked in 1.0, but doesn't seem to work in 1.1 :-( david

2 1

Re: [Dovecot] Dovecot PAM sessions with Maildir
by Sean Smitz 06 Aug '08

06 Aug '08

I able to connect to the mail server with a MUA (Thunderbird) via SSL prior to attempting to set up the session and Maildir options /var/log/audit/audit.log type=USER_AUTH msg=audit(1217992493.198:389): user pid=8022 uid=0 auid=10243 subj=user_u:system_r:dovecot_auth_t:s0 msg='PAM: authentication acct="[me]" : exe="/usr/libexec/dovecot/dovecot-auth" (hostname=::ffff:[client], addr=::ffff:[client], terminal=dovecot res=success)' type=USER_ACCT msg=audit(1217992493.199:390): user pid=8022 uid=0 auid=10243 subj=user_u:system_r:dovecot_auth_t:s0 msg='PAM: accounting acct="[me]" : exe="/usr/libexec/dovecot/dovecot-auth" (hostname=::ffff:[client], addr=::ffff:[client], terminal=dovecot res=success)' type=USER_START msg=audit(1217992493.199:391): user pid=8022 uid=0 auid=10243 subj=user_u:system_r:dovecot_auth_t:s0 msg='PAM: session open acct="[me]" : exe="/usr/libexec/dovecot/dovecot-auth" (hostname=::ffff:[client], addr=::ffff:[client], terminal=dovecot res=failed)' /var/log/maillog Aug 5 23:14:37 mailserv1 dovecot: Dovecot v1.0.7 starting up Aug 5 23:14:38 mailserv1 dovecot: auth(default): new auth connection: pid=8014 Aug 5 23:14:38 mailserv1 dovecot: auth(default): new auth connection: pid=8013 Aug 5 23:14:38 mailserv1 dovecot: auth(default): new auth connection: pid=8015 Aug 5 23:14:46 mailserv1 dovecot: auth(default): new auth connection: pid=8016 Aug 5 23:14:52 mailserv1 dovecot: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=::ffff:[server] rip=::ffff:[client] Aug 5 23:14:52 mailserv1 dovecot: auth(default): client out: CONT 1 Aug 5 23:14:52 mailserv1 dovecot: auth(default): client in: CONT<hidden> Aug 5 23:14:52 mailserv1 dovecot: auth(default): pam([me],::ffff:[client]): lookup service=dovecot Aug 5 23:14:52 mailserv1 dovecot: auth(default): pam([me],::ffff:[client]): pam_open_session() failed: Cannot make/remove an entry for the specified session Aug 5 23:14:53 mailserv1 dovecot: auth(default): client out: FAIL 1 user=[me] Aug 5 23:14:53 mailserv1 dovecot: auth(default): client in: AUTH 2 PLAIN service=IMAP secured lip=::ffff:[server] rip=::ffff:[client] resp=<hidden> Aug 5 23:14:53 mailserv1 dovecot: auth(default): pam([me],::ffff:[client]): lookup service=dovecot Aug 5 23:14:53 mailserv1 dovecot: auth(default): pam([me],::ffff:[client]): pam_open_session() failed: Cannot make/remove an entry for the specified session Aug 5 23:14:55 mailserv1 dovecot: auth(default): client out: FAIL 2 user=[me] Aug 5 23:14:58 mailserv1 dovecot: imap-login: Aborted login: user=<[me]>, method=PLAIN, rip=::ffff:[client], lip=::ffff:[server], TLS

2 1

[Dovecot] Maildir Index Question
by Ron Culler 06 Aug '08

06 Aug '08

We have several hundred mailboxes that have thousands of files in them (spam boxes) We currently run a find command and remove the files that are over 7 days old but still have boxes with upto 60k messages in them. I know that dovecot will update the index files for each mailbox when the boxes is accessed by an IMAP client(Webmail using Squirrel)but that can take quite a while to index. What I would like to do is via a cron job after the old file remove is to force dovecot to reindex these boxes. That way when the users login to the webmail interface it is quicker. Does anyone know if a script is available to do this? Thanks Ron Culler

2 1

[Dovecot] Dovecot PAM sessions with Maildir
by Sean Smitz 06 Aug '08

06 Aug '08

I am configuring a new mail server on RHEL 5 x64. I have configured dovecot as follows: ... protocols = imaps ... ssl_cert_file = /etc/pki/dovecot/certs/mailserver.cer ssl_key_file = /etc/pki/dovecot/private/mailserver.pem ... login_process_size = 64 ... mail_location = maildir:~/Maildir ... passdb pam { args = "session=yes cache_key=%u%s dovecot" } ... I'm getting the following error messages in /var/log/maillog: Aug 5 20:57:45 [hostname] dovecot: imap-login: Aborted login: rip=::ffff:128.8.244.15, lip=::ffff:[server], TLS Aug 5 21:01:34 [hostname] dovecot: imap-login: Aborted login: user=<[me]>, method=PLAIN, rip=::ffff:[server], lip=::ffff:[server], TLS I'm getting the following messages in /var/log/audit/audit.log: type=USER_AUTH msg=audit(1217984152.016:347): user pid=7669 uid=0 auid=10243 subj=user_u:system_r:dovecot_auth_t:s0 msg='PAM: authentication acct="[me]" : exe="/usr/libexec/dovecot/dovecot-auth" (hostname=::ffff:[client], addr=::ffff:[client], terminal=dovecot res=success)' type=USER_ACCT msg=audit(1217984152.017:348): user pid=7669 uid=0 auid=10243 subj=user_u:system_r:dovecot_auth_t:s0 msg='PAM: accounting acct="[me]" : exe="/usr/libexec/dovecot/dovecot-auth" (hostname=::ffff:[client], addr=::ffff:[client], terminal=dovecot res=success)' type=USER_START msg=audit(1217984152.017:349): user pid=7669 uid=0 auid=10243 subj=user_u:system_r:dovecot_auth_t:s0 msg='PAM: session open acct="[me]" : exe="/usr/libexec/dovecot/dovecot-auth" (hostname=::ffff:[client], addr=::ffff:[client], terminal=dovecot res=failed)' I find the message in the audit.log interesting because I configured the connection with SSL not TLS, but if I use TLS the result is the same.

2 1

[Dovecot] Dovecot proxying results in "too many open files"
by Gianpaolo Del Matto 06 Aug '08

06 Aug '08

Hi, Some words about my Dovecot setup: - 10 dovecot servers - each server has some local mailboxes - each server has proxying enabled to seamlessly connect to another host if the mailbox is not local Running Dovecot 1.1.1 on FreeBSD 6.3-RELEASE-p3. First of all, local mailbox access is fine. Proxying works also as expected. Now for the actual problem: Shortly after startup, Dovecot starts throwing errors concerning connection which should be proxied. Here are some examples from the logs: Aug 6 15:49:10 dovecot: imap-login: socket() failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: proxy(XYZ): connect(1.2.3.4, 143) failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: accept() failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: socket() failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: proxy(XYZ): connect(1.2.3.4, 143) failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: socket() failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: proxy(XYZ): connect(1.2.3.4, 143) failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: socket() failed: Too many open files Aug 6 15:49:10 dovecot: imap-login: proxy(XYZ): connect(1.2.3.4, 143) failed: Too many open files Aug 6 15:49:11 dovecot: imap-login: socket() failed: Too many open files [..] Aug 6 16:00:05 dovecot: imap-login: accept() failed: Too many open files Aug 6 16:00:08 dovecot: imap-login: accept() failed: Too many open files Aug 6 16:00:11 dovecot: imap-login: accept() failed: Too many open files Aug 6 16:00:13 dovecot: imap-login: accept() failed: Too many open files As from the context it seems to be a file descriptor issue, as such I have done the following: - added a 'limits -e -n 32768 -U dovecot' to dovecot startup file to ensure it has enough FD's - additionally, I've checked my kernel file limits, however I always set it through loader and sysctl to be as large as 64k # sysctl -a |grep files kern.maxfiles: 65535 kern.maxfilesperproc: 32768 kern.openfiles: 1632 - also checked the limits of the dovecot user like this: # su -c dovecot root -c 'ulimit -a' core file size (blocks, -c) unlimited data seg size (kbytes, -d) 1048576 file size (blocks, -f) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 32768 pipe size (512 bytes, -p) 1 stack size (kbytes, -s) 131072 cpu time (seconds, -t) unlimited max user processes (-u) 5547 virtual memory (kbytes, -v) unlimited - done some monitoring of file descriptor usage for the dovecot user, though somewhat inacurate, like this: while [ : ]; do date; fstat -u dovecot |wc -l; sleep 1; done this gave me these results while tailing the logfile: Wed Aug 6 15:44:12 CEST 2008 585 Wed Aug 6 15:44:13 CEST 2008 579 Wed Aug 6 15:44:14 CEST 2008 582 Wed Aug 6 15:44:15 CEST 2008 582 Wed Aug 6 15:44:16 CEST 2008 586 Wed Aug 6 15:44:17 CEST 2008 585 Wed Aug 6 15:44:18 CEST 2008 582 So it didn't seem to be anywhere near the theoretical upper limit I've set at 32k. On the other hand, when restarting Dovecot, it works for a few minutes for at least as long as the FD usage as reported above stays at around 500. I remember from the docs that dovecot-login would require the double amount of file descriptors to run. Assuming my report is somewhat inaccurate and lags behind, I could imagine that upon a proxy requests it would effectively peak our at some 500 x 2 FDs. Thus effectively reaching the 1024 FD barrier. I conclude this from the fact that I currently have some 350 - 450 logins in parallel, most of which can and shell be proxied. From the error message in the logs I got the impression, that only proxied connections are affected. I was not able to reproduce the issue with non-proxied logins to local mailboxes. Some further steps I've done from the configuration side to no avail: - disabled imaps/pop3s/ssl - changed between login_process_per_connection yes/no - played around with login_max_connections et all (raised/lowered) limits - tried with/without plugins enabled - tried with SQL-based and passwd-file based userdb/passdb, single and mixed Dovecot config: # dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap pop3 listen: *, [::] ssl_disable: yes ssl_cert_file: /usr/local/etc/postfix/tls/server.crt ssl_key_file: /usr/local/etc/postfix/tls/server.key disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_processes_count: 16 login_max_processes_count: 64 login_max_connections: 64 max_mail_processes: 256 mail_max_userip_connections: 3 verbose_proctitle: yes mail_privileged_group: mail mail_uid: 1000 mail_gid: 1000 mail_location: maildir:~/Maildir fsync_disable: yes maildir_copy_preserve_filename: yes mail_drop_priv_before_exec: yes mail_executable(default): /mailserver/scripts/dovecot/imap mail_executable(imap): /mailserver/scripts/dovecot/imap mail_executable(pop3): /mailserver/scripts/dovecot/pop3 mail_plugins: expire mail_log mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_log_max_lines_per_sec: 0 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra- mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra- mailbox-sep imap_client_workarounds(pop3): pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private inbox: yes list: yes subscriptions: yes namespace: type: private separator: . prefix: INBOX. hidden: yes auth default: mechanisms: plain login cram-md5 cache_size: 131072 username_translation: #@/@%@ username_format: %Lu verbose: yes debug: yes debug_passwords: yes worker_max_request_count: 16384 passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: passwd-file args: username_format=%n /usr/local/etc/postfix/tables/ deliver_passwd userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vpostfix group: vpostfix plugin: expire: Trash 14 Trash/* 14 Spam 14 Spam/* 14 VirusAlerts 14 VirusAlerts/* 14 Quarantine 14 Quarantine/* 14 expire_dict: proxy::expire dict: expire: mysql:/usr/local/etc/dovecot-expire.conf Maybe I am missing something here. I'd really, really appreciate some help on this to get it sorted out. Thank you. Regards, Gianpaolo

2 3

[Dovecot] Dovecot auto vacation with sieve doesn't work
by CJ Keist 06 Aug '08

06 Aug '08

Guys, I'm running out of hair to pull out ;). Can anyone out there say that this does work?? To me this is looking like a bug and I'm not sure whether it's the sieve plugin or the dovecot deliver program. I have also had no luck the the "reject" sending any reply back to the sender. My setup: OS: Solaris 10 sparc platform postfix: 2.5.2 dovecot: 1.1.2 sieve plugin: 1.1.5 I'm going back forth between procmail and sieve and having no luck. procmail will send the reply to the sender but doesn't deliver the message to the recipient. Sieve will deliver the message to the recipient but doesn't send the reply to the sender. Now if I can just combine the two, I'll be in business. Postfix mail command: mailbox_command = /userM/mail-services/dovecot/libexec/dovecot/deliver -d $USER* * Dovecot -n (I've made some changes from my previous posting namely with the master_auth settings) # 1.1.2: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 3072). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /userM/mail-services/dovecot/var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /userM/mail-services/dovecot/var/run/dovecot/login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 1024 max_mail_processes: 1024 mail_location: mbox:~/:INBOX=/userM/mail/%u mail_debug: yes mmap_disable: yes mail_nfs_index: yes mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /userM/mail-services/postfix/var/private/auth mode: 432 user: postfix group: postfix master: path: /userM/mail-services/dovecot/var/run/dovecot/auth-master mode: 384 user: postfix group: postfix My .dovecot.sieve file: require ["vacation"]; if header :matches "subject" "*" { vacation :days 30 :addresses "cj.keist(a)colostate.edu" :subject "Automatic response to: ${1}" "I'm away -- send mail to foo in my absence"; } I made some modifications to the vacation reply base on the following URL: http://ietfreport.isoc.org/idref/draft-ietf-sieve-vacation/ In my testing I know the sieve plugin is reading my .dovecot.sieve script and creating the .dovecot.sievec, but that is as for as it goes. The .dovecot.lda-dupes file is not being created (or any .dovecot.sieve.err file) and no reply is even being attempted from the logs: Aug 6 11:30:51 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): new auth connection: pid=27187 Aug 6 11:30:51 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] connect from akron.colostate.edu[129.82.103.160] Aug 6 11:30:51 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] setting up TLS connection from akron.colostate.edu[129.82.103.160] Aug 6 11:30:51 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] Anonymous TLS connection established from akron.colostate.edu[129.82.103.16 0]: TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits) Aug 6 11:30:52 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] 16E2059984: client=akron.colostate.edu[129.82.103.160] Aug 6 11:30:52 mail2.engr.colostate.edu postfix/cleanup[27192]: [ID 197553 mail .info] 16E2059984: message-id=<3b676ae5f90fadad863930dcc61db3f8.squirrel@webmail .engr.colostate.edu> Aug 6 11:30:52 mail2.engr.colostate.edu postfix/smtpd[27187]: [ID 197553 mail.i nfo] disconnect from akron.colostate.edu[129.82.103.160] Aug 6 11:30:52 mail2.engr.colostate.edu postfix/qmgr[18021]: [ID 197553 mail.in fo] 16E2059984: from=<joeblow(a)engr.colostate.edu>, size=1877, nrcpt=1 (queue act ive) Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 315030 mail.info] Lo ading modules from directory: /userM/mail-services/dovecot/lib/dovecot/lda Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 619685 mail.info] Mo dule loaded: /userM/mail-services/dovecot/lib/dovecot/lda/lib90_cmusieve_plugin. so Aug 6 11:30:52 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): master in: USER 1 cjay service=deliver Aug 6 11:30:52 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth-wor ker(default): passwd(cjay): lookup Aug 6 11:30:52 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): master out: USER 1 cjay system_user=cjay uid=10946 gid=32 home=/top/admin/ENS/people/cjay/home Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: system_user=cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: uid=10946 Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: gid=32 Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 868608 mail.info] au th input: home=/top/admin/ENS/people/cjay/home Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 848615 mail.info] mb ox: data=/top/admin/ENS/people/cjay/home/:INBOX=/userM/mail/cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 885103 mail.info] fs : root=/top/admin/ENS/people/cjay/home, index=, control=, inbox=/userM/mail/cjay Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 223526 mail.info] cm usieve: Using sieve path: /top/admin/ENS/people/cjay/home/.dovecot.sieve Aug 6 11:30:52 mail2.engr.colostate.edu deliver(cjay): [ID 507699 mail.info] cm usieve: Executing script /top/admin/ENS/people/cjay/home/.dovecot.sievec Aug 6 11:30:53 mail2.engr.colostate.edu deliver(cjay): [ID 702911 mail.info] ms gid=<3b676ae5f90fadad863930dcc61db3f8.squirrel(a)webmail.engr.colostate.edu>: save d mail to INBOX Aug 6 11:30:53 mail2.engr.colostate.edu postfix/local[27193]: [ID 197553 mail.i nfo] 16E2059984: to=<cjay(a)engr2.colostate.edu>, relay=local, delay=1.2, delays=0 .32/0.08/0/0.82, dsn=2.0.0, status=sent (delivered to command: /userM/mail-servi ces/dovecot/libexec/dovecot/deliver -d $USER) Aug 6 11:30:53 mail2.engr.colostate.edu postfix/qmgr[18021]: [ID 197553 mail.in fo] 16E2059984: removed Aug 6 11:34:12 mail2.engr.colostate.edu postfix/anvil[27190]: [ID 197553 mail.i nfo] statistics: max connection rate 1/60s for (smtp:129.82.103.160) at Aug 6 1 1:30:51 Aug 6 11:34:12 mail2.engr.colostate.edu postfix/anvil[27190]: [ID 197553 mail.i nfo] statistics: max connection count 1 for (smtp:129.82.103.160) at Aug 6 11:3 0:51 Aug 6 11:34:12 mail2.engr.colostate.edu postfix/anvil[27190]: [ID 197553 mail.i nfo] statistics: max cache size 1 at Aug 6 11:30:51

1 0

[Dovecot] expire-plugin: configuration dict-server
by Jens Meyer 06 Aug '08

06 Aug '08

Hello all! I tried to add the expire-plugin to my dovecot-installation (CentOS-RPM: dovecot-1.1.1-2_76.el5) and followed the plugin-page from the WIKI (http://wiki.dovecot.org/Plugins/Expire) Unfortunately I have problems with the dictionary: --> dovecot: Aug 05 13:30:25 Error: dict: Unknown dict module: db dovecot: Aug 05 13:30:25 Error: dict: Failed to initialize dictionary 'expire' <-- As far as I understand the hints from mailinglist-archive the db-support is not standard with dovecot and Timo suggested to use a mysql-connection. Are there any further tipps how to use the expire-plugin with mysql-connection (i.e. database-scheme, SQL-Select)? Kind regards, Jens

5 9

[Dovecot] 1.0(.14) vs 1.1.2 performance
by Thomas Hummel 06 Aug '08

06 Aug '08

Hello Timo, I just switched from dovecot-1.0.14 to dovecot-1.1.2 and noticed a significant drop in the server load average (which has become lower and above all doesn't seem to have unexplained peaks). Indexes are still locally stored and nfs attribute caching is still off). I searched the list archives for an explanation of what changed in the code that could explain such an improvement but mostly (except maybe some index code rewrite mentions) found differences in features. Where does that performance gap come from ? -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 4

[Dovecot] Can't connect to IMAP
by David Hall 06 Aug '08

06 Aug '08

Hi all, This is my first post here so i hope this will reach you :) My problem since a few days back is that IMAP doesn't seem to be started. The logfiles says's everything is in order, but port 143 isn't up and Squirrelmail can't connect, i have no clue what's causing this everything runned smoothly a couple of days ago. Im using postfix/amavis & spamassasin. Here's some information Dovecot v1.1.2 # 1.1.2: /etc/dovecot/dovecot.conf protocols = imap imaps log_timestamp: %Y-%m-%d %H:%M:%S listen: disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login first_valid_uid: 106 mail_access_groups: mail mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n auth default: mechanisms: digest-md5 plain passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf And once again. I don't get any errors in the logfiles. Mail.log last 5 lines after a restart :10024, delay=1414, delays=1402/0.01/0/12, dsn=2.0.0, status=sent (250 2.0.0 Ok, id=04139-03, from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as C4FD1406024) Aug 6 07:47:58 localhost postfix/qmgr[4630]: E956E40604A: removed Aug 6 07:47:58 localhost postfix/virtual[32190]: C4FD1406024: to=<sn0wman(a)strutn.nu>, orig_to=<root(a)strutn.nu>, relay=virtual, delay=0.07, delays=0.03/0.02/0/0.02, dsn=2.0.0, status=sent (delivered to maildir) Aug 6 07:47:58 localhost postfix/qmgr[4630]: C4FD1406024: removed Aug 6 10:55:56 localhost dovecot: Killed with signal 15 Aug 6 10:55:56 localhost dovecot: Dovecot v1.1.2 starting up Aug 6 10:55:57 localhost dovecot: auth-worker(default): mysql: Connected to localhost (postfix) syslog / mail.err / .warn & info doesn't say anything about errors eithers. Any clue?

3 3

Re: [Dovecot] how to store flags \Seen into read-only mailbox?
by seriv＠parkheights.dyndns.org 06 Aug '08

06 Aug '08

Thank you, Timo, running dovecot with this changeset, \Seen stored perfectly. Only problems I saw were like: --- deliver(listuser): Aug 04 16:06:38 Error: Corrupted transaction log file /home/vmail/listuser/Maildir/index/.INBOX/dovecot.index.log: hdr.size too large (75497472) ... dovecot: Aug 04 16:07:31 Error: IMAP(listuser): Corrupted transaction log file /home/vmail/listuser/Maildir/index/.INBOX/dovecot.index.log: duplicate transaction log sequence (2) --- and after deleting dovecot.index.log files they were rebuilt. And I can not see any other problem. -- Sergey Ivanov. ----- "Timo Sirainen" <tss(a)iki.fi> пишет: > On Jul 24, 2008, at 1:27 PM, seriv(a)parkheights.dyndns.org wrote: > > > This problem is apparently about changeset > http://hg.dovecot.org/dovecot-1.1/rev/eec74a6ad62e > > . > > OK, changed, see if this helps: > http://hg.dovecot.org/dovecot-1.1/rev/b5388b21c4c2

1 0

[Dovecot] 1.1.1 (maildir_uidlist_sync_update): assertion failed: (uidlist->initial_hdr_read)
by Adam McDougall 06 Aug '08

06 Aug '08

Version: 1.1.1 OS: FreeBSD 7.0-STABLE amd64 I have only seen this happen twice so far. I do not know what the two users were doing to cause it. Jun 26 17:23:26 hill dovecot: IMAP(userA): Invalid transaction log size (32812 vs 32920): /home/userA/Maildir/dovecot/private/indexes/.Deleted Messages/dovecot.index.log Jun 26 17:23:26 hill dovecot: IMAP(userA): Invalid transaction log size (32812 vs 32920): /home/userA/Maildir/dovecot/private/indexes/.Deleted Messages/dovecot.index.log Jun 26 17:23:26 hill dovecot: Panic: IMAP(userA): file maildir-uidlist.c: line 1207 (maildir_uidlist_sync_update): assertion failed: (uidlist->initial_hdr_read) Jun 26 17:23:26 hill dovecot: child 28120 (imap) killed with signal 6 Jul 11 13:41:46 hill dovecot: IMAP(userB): Invalid transaction log size (92984 vs 93076): /home/userB/Maildir/dovecot/private/indexes/.Old Backup.Personal/dovecot.index.log Jul 11 13:41:46 hill dovecot: IMAP(userB): Invalid transaction log size (92984 vs 93076): /home/userB/Maildir/dovecot/private/indexes/.Old Backup.Personal/dovecot.index.log Jul 11 13:41:46 hill dovecot: Panic: IMAP(userB): file maildir-uidlist.c: line 1207 (maildir_uidlist_sync_update): assertion failed: (uidlist->initial_hdr_read) Jul 11 13:41:46 hill kernel: pid 85434 (imap), uid 20128: exited on signal 6 (core dumped) hill# gdb /usr/local/libexec/dovecot/imap imap.core GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Core was generated by `imap'. Program terminated with signal 6, Aborted. Reading symbols from /usr/local/lib/libiconv.so.3...done. Loaded symbols for /usr/local/lib/libiconv.so.3 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/imap/lib01_acl_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib01_acl_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/lib/librpcsvc.so.4...done. Loaded symbols for /usr/lib/librpcsvc.so.4 Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_listescape_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_listescape_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x00000000409d7e7c in kill () from /lib/libc.so.7 (gdb) bt full #0 0x00000000409d7e7c in kill () from /lib/libc.so.7 No symbol table info available. #1 0x00000000409d6ceb in abort () from /lib/libc.so.7 No symbol table info available. #2 0x00000000004b5385 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x3 <Address 0x3 out of bounds> #3 0x00000000004b610e in i_internal_fatal_handler (type=Could not find the frame base for "i_internal_fatal_handler". ) at failures.c:418 No locals. #4 0x00000000004b564a in i_panic (format=Could not find the frame base for "i_panic". ) at failures.c:193 args = Could not find the frame base for "i_panic". (gdb) hill# file /usr/local/libexec/dovecot/imap /usr/local/libexec/dovecot/imap: ELF 64-bit LSB executable, x86-64, version 1 (FreeBSD), for FreeBSD 7.0 (700101), dynamically linked (uses shared libs), FreeBSD-style, not stripped

2 2

[Dovecot] Vacation reply with Procmail and dovecot deliver
by CJ Keist 06 Aug '08

06 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Giving up on the sieve plugin and switching to procmail. I found the following link: http://wiki.dovecot.org/procmail This site doesn't saying anything about needing to modify the procmail source code like here: http://dovecot.org/pipermail/dovecot/2006-July/014656.html Thos shows how to make procmail work with dovecot deliver program. So you create the following /etc/procmailrc file: # file: /etc/procmailrc # system-wide settings for procmail SHELL="/usr/bin/sh" SENDMAIL="/userM/mail-services/postfix/lib/sendmail" LOGFILE="/var/log/procmail.log" DELIVER="/userM/mail-services/dovecot/libexec/dovecot/deliver -d $USER" # fallback: DEFAULT="$HOME/mail" :0 w | $DELIVER So I modified postfix to call procmail (version 3.22): mailbox_command = /userM/mail-services/procmail/bin/procmail -Y -a $DOMAIN -d $USER So now I'm getting the vacation reply sent to the sender (Yea!!!), but the message is failing to get to the recipient. In the procmail log file I see: Fatal: Missing -d argument procmail: Program failure (64) of "/userM/mail-services/dovecot/libexec/dovecot/ deliver" - From someaccount(a)yahoo.com Tue Aug 5 15:21:09 2008 Subject: test 7 procmail Folder: /top/admin/ENS/people/cjay/home/mail/msg.qX_ 1878 Has anyone got this setup working?? - -- C. J. Keist Email: cj.keist(a)colostate.edu UNIX/Network Manager Phone: 970-491-0630 Engineering Network Services Fax: 970-491-5569 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFImNFqA29OFr7C6jcRAlNxAKCzazkpf6SFzitoZ83SS0bN5UdepwCff2oR SO4HPqKfdrhIVmnVeY1lFSM= =qANC -----END PGP SIGNATURE-----

1 0

[Dovecot] Dovecot sieve plugin reject not working
by CJ Keist 05 Aug '08

05 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I'm at a loss here. Details of my setup: OS: Solaris 10 gcc version: 3.4.3 postfix version 2.5.2 dovecot version 1.1.2 dovecot sieve version 1.1.5 How I installed: Postfix: make makefiles CCARGS='-DUSE_SASL_AUTH \-DDEF_SERVER_SASL_TYPE=\"dovecot\" -DUSE_TLS -I/opt/csw/include' \AUXLIBS="-R/opt/csw/lib -L/opt/csw/lib -lssl -lcrypto -ldb" make make upgrade Dovecot: ./configure --prefix=/userM/mail-services/dovecot make make install Sieve: ./configure --prefix=/userM/mail-services/dovecot - --with-dovecot=../dovecot-1.1.2 make make install dovecot -n # 1.1.2: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 3072). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /userM/mail-services/dovecot/var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /userM/mail-services/dovecot/var/run/dovecot/login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 1024 max_mail_processes: 1024 mail_location: mbox:~/:INBOX=/userM/mail/%u mail_debug: yes mmap_disable: yes mail_nfs_index: yes mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /userM/mail-services/postfix/var/private/auth mode: 432 user: postfix group: postfix .dovecot.sieve: require ["fileinto", "vacation", "reject"]; if address :is "from" "someaccount(a)yahoo.com" { reject "I don't like your email message"; } When I send message from yahoo.com to my cjay(a)engr2.colostate.edu account on this server no rejection notice is being sent back. It looks like at the end of the log file section below that it is sending something back, but nothing shows up. Also see how the "From" is empty? I don't think this is postfix problem as I can send and receive mail through it fine. SysLog: Aug 5 08:46:09 mail2.engr.colostate.edu dovecot: [ID 107833 mail.info] auth(def ault): new auth connection: pid=11000 Aug 5 08:46:09 mail2.engr.colostate.edu postfix/smtpd[11000]: [ID 197553 mail.i nfo] connect from pace.acns.colostate.edu[129.82.100.168] Aug 5 08:46:09 mail2.engr.colostate.edu postfix/smtpd[11000]: [ID 197553 mail.i nfo] setting up TLS connection from pace.acns.colostate.edu[129.82.100.168] Aug 5 08:46:09 mail2.engr.colostate.edu postfix/smtpd[11000]: [ID 197553 mail.i nfo] Anonymous TLS connection established from pace.acns.colostate.edu[129.82.10 0.168]: TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits) Aug 5 08:46:09 mail2.engr.colostate.edu postfix/smtpd[11000]: [ID 197553 mail.i nfo] CBD4059982: client=pace.acns.colostate.edu[129.82.100.168] Aug 5 08:46:09 mail2.engr.colostate.edu postfix/cleanup[11016]: [ID 197553 mail .info] CBD4059982: message-id=<609785.52970.qm(a)web52402.mail.re2.yahoo.com> Aug 5 08:46:09 mail2.engr.colostate.edu postfix/smtpd[11000]: [ID 197553 mail.i nfo] disconnect from pace.acns.colostate.edu[129.82.100.168] Aug 5 08:46:09 mail2.engr.colostate.edu postfix/qmgr[23653]: [ID 197553 mail.in fo] CBD4059982: from=<someaccount(a)yahoo.com>, size=1701, nrcpt=1 (queue active) Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 315030 mail.info] Lo ading modules from directory: /userM/mail-services/dovecot/lib/dovecot/lda Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 619685 mail.info] Mo dule loaded: /userM/mail-services/dovecot/lib/dovecot/lda/lib90_cmusieve_plugin. so Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 848615 mail.info] mb ox: data=/top/admin/ENS/people/cjay/home/:INBOX=/userM/mail/cjay Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 885103 mail.info] fs : root=/top/admin/ENS/people/cjay/home, index=, control=, inbox=/userM/mail/cjay Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 223526 mail.info] cm usieve: Using sieve path: /top/admin/ENS/people/cjay/home/.dovecot.sieve Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 507699 mail.info] cm usieve: Executing script /top/admin/ENS/people/cjay/home/.dovecot.sievec Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 122265 mail.info] Se nding a rejection to cjay: I don't like your email message Aug 5 08:46:10 mail2.engr.colostate.edu deliver(cjay): [ID 351585 mail.info] ms gid=<609785.52970.qm(a)web52402.mail.re2.yahoo.com>: rejected Aug 5 08:46:10 mail2.engr.colostate.edu postfix/local[11020]: [ID 197553 mail.i nfo] CBD4059982: to=<cjay(a)engr2.colostate.edu>, relay=local, delay=0.89, delays= 0.44/0.07/0/0.38, dsn=2.0.0, status=sent (delivered to command: /userM/mail-serv ices/dovecot/libexec/dovecot/deliver) Aug 5 08:46:10 mail2.engr.colostate.edu postfix/qmgr[23653]: [ID 197553 mail.in fo] CBD4059982: removed Aug 5 08:46:10 mail2.engr.colostate.edu postfix/pickup[25962]: [ID 197553 mail. info] 5040F59988: uid=10946 from=<> Aug 5 08:46:10 mail2.engr.colostate.edu postfix/cleanup[11016]: [ID 197553 mail .info] 5040F59988: message-id=<dovecot-1217947570-48198-0(a)mail2.engr.colostate.e du> Aug 5 08:46:10 mail2.engr.colostate.edu postfix/qmgr[23653]: [ID 197553 mail.in fo] 5040F59988: from=<>, size=2994, nrcpt=1 (queue active) Aug 5 08:46:10 mail2.engr.colostate.edu postfix/smtp[11026]: [ID 197553 mail.in fo] 5040F59988: to=<someaccount(a)yahoo.com>, relay=parker.colostate.edu[129.82.10 3.125]:25, delay=0.38, delays=0.03/0.22/0.03/0.1, dsn=2.0.0, status=sent (250 2. 0.0 m75EkCiq163926 Message accepted for delivery) Aug 5 08:46:10 mail2.engr.colostate.edu postfix/qmgr[23653]: [ID 197553 mail.in fo] 5040F59988: removed - -- C. J. Keist Email: cj.keist(a)colostate.edu UNIX/Network Manager Phone: 970-491-0630 Engineering Network Services Fax: 970-491-5569 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFImGtRA29OFr7C6jcRAhEtAJwJD1Ypkx6/UF2LLPsfSXK8zNKrHACfegnj I2uf/L+CGDfuVVky0QLDgkY= =cfym -----END PGP SIGNATURE-----

2 1