May 2009 - dovecot - dovecot.org

[Dovecot] Assertion failure in maildir-mail.c for gzipped maildir files in 1.1.15
by David S. Madole 01 Jun '09

01 Jun '09

I attempted an upgrade from 1.1.7 to 1.1.15 and encountered an apparent regression in handling gzipped maildir files. I have tried to narrow down the conditions under which it happens and reproduce it with as simple a case as possible. The actual mail application that exposed this problem is Squirrelmail. Starting off with the index files removed from the "Folder" maildir directory: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 3 (RFC822.SIZE INTERNALDATE) * 3 FETCH (UID 3 RFC822.SIZE 1085 INTERNALDATE "04-Jan-2004 09:23:45 -0500") 3 OK Fetch completed. 4 UID FETCH 4 (RFC822.SIZE INTERNALDATE) Connection closed by foreign host. The fetch of message 3, which is not gzipped succeeds, but the fetch of message 4, which is gzipped, fails with the following assertion in the log: Panic: imap: user=x, Status: file maildir-mail.c: line 85 (maildir_mail_stat): assertion failed: (fd != -1) Repeating, but first fetching only INTERNALDATE from the gzipped message succeeds, and once that value is cached in the index files, the same query that causes the failure before will now succeed, as it doesn't need to read the gzipped file any more to get INTERNALDATE: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 4 (INTERNALDATE) * 4 FETCH (UID 4 INTERNALDATE "02-Dec-2003 10:39:18 -0500") 3 OK Fetch completed. 4 UID FETCH 4 (RFC822.SIZE INTERNALDATE) * 4 FETCH (UID 4 RFC822.SIZE 6035 INTERNALDATE "02-Dec-2003 10:39:18 -0500") 4 OK Fetch completed. 5 logout * BYE Logging out 5 OK Logout completed. Connection closed by foreign host. Now that the value is cached, the same previously failing query will continue to execute fine, as long as the indexes remain in place: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 4 (RFC822.SIZE INTERNALDATE) * 4 FETCH (UID 4 RFC822.SIZE 6035 INTERNALDATE "02-Dec-2003 10:39:18 -0500") 3 OK Fetch completed. 4 logout * BYE Logging out 4 OK Logout completed. Connection closed by foreign host. Removing the indexes again, and this time first fetching just RFC822.SIZE first: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 4 (RFC822.SIZE) * 4 FETCH (UID 4 RFC822.SIZE 6035) 3 OK Fetch completed. 4 UID FETCH 4 (RFC822.SIZE INTERNALDATE) Connection closed by foreign host. In this case, the assertion fails again. Fetching RFC822.SIZE alone does not populate the indexes in a way that then allows RFC822.SIZE and INTERNALDATE to be fetched, as fetching INTERNALDATE alone does. It's all confusing to me, hopefully this make some sense to others. Let me know if there is other testing I can help with. I'm running on Slackware 12.1 and have reproduced the same issue with both kernel 2.6.24.4 and 2.6.27.7. The filesystem is XFS. The content of the gzipped message does not seem to matter. David

2 1

Re: [Dovecot] Missing IMAP folders after Server reboot
by punit_j 31 May '09

31 May '09

Did you try looking for the folders by connecting to IMAP using command line. telnet servername 143 a1 login username pass a2 list "" * Check if you could see anything.

1 0

[Dovecot] Missing IMAP folders after Server reboot
by Eoin Kennedy 31 May '09

31 May '09

Hi, Here is the situation, I hope somebody can help me. Our Email server running ubuntu 8.04.1 and dovecot 1.0.10 rebooted, and when it came back up the dovecot config had changed. Prior to the reboot, users stored their emails and folders in /var/mail/~username. Then the config became /var/mail/username for the main Inbox and /home/~username/mail for Folders. Now, none of the folders that users had created in their IMAP account are visible, and their contents are not in the main Inbox file. For example, the Drafts folder was there prior to the reboot, and now it had to be created in /home/username afterwards. These folders were not subfolders of the Inbox, but of the main IMAP root. All users were running Thunderbird as their client. Can they be recovered? Thanks, Eoin Kennedy ----------------------------------------------------------------------------- Sherling & Sons Ltd, Jamestown Road, Inchicore, Dublin 8, Ireland. Company Reg No. 9294 Website: www.sherlingsteel.com

2 2

[Dovecot] antispam plugin and MUA-Junk folders
by Steffen Kaiser 31 May '09

31 May '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I have a configuration problem, that I ignored till now. Many MUAs tag SPAM themselves and move SPAM to a junk folder (Thunderbird uses "Junk"). It is said to not automatically train these mails, but let have an human revise them. Currently, I have configured those folders as "trash" folders for antispam, which means that those messages are essentially lost, because a move into a spam folder will not train them. -> The current antispam plugin ignores moves in and out of trash folders completely. I wonder why the move trash -> SPAM is ignored? If I configure those junk folders as "unsure" in antispam, the situation can happen, that an user selects a spam folder, the MUA identifies junk and moves the messages into its Junk folder. Current implementation would train this move as HAM. How about the following: 1) copy from * into trash or unsure -> not train 2) copy from !spam into spam -> train as SPAM 4) copy from spam or unsure into !(trash or unsure or spam) -> train as HAM 6) else -> not train Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBSh0PdHWSIuGy1ktrAQKmaAf/ew1SixCkkWD2V12Jfw3mLcWnUrUSRq/J nsyMkW2//tX74wSJeMjbzlEkxN3dyfJg7f4WviGPdnUp5sqNGuS9lBfHh3ShQHtt 30+mRzVqizmcNEXBFoZXVy1K5hE8p9ssN9avahmUejBVPaSZHD0OjN5h8nFkNMDI XHU2347g03zr1MxejinWyRiKt1MFQyyJ6Y7gXNf6yascWKJA8W6b4Zu/eIH5uEW+ yiMuweaxJOwuGcwqh/qSKZTXnoCLa9rzvd8i/uZGvn7AXoT5u4P5coZkIHrh64U7 oswuYAZwxkmjGNLdGrovZadRJym16BlfVHH5g3Zo7k4nwX+kGRKyug== =9b+n -----END PGP SIGNATURE-----

2 1

[Dovecot] dovecot with MYSQL on Synology NAS
by heutekinderwirdswasgeben＠gmx.de 30 May '09

30 May '09

hello list, under my table I have a NAS station, the Synology DS-207+ there`s a linux with ipkg. the dovocot fromo ipkg didnt have mysql support. compiling seems to be also difficult, because of configure cant find libmysqlclient. experts, what to do for getting mysql support in dovecot? best regards hkwwg -- Nur bis 31.05.: GMX FreeDSL Komplettanschluss mit DSL 6.000 Flatrate und Telefonanschluss nur 17,95 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02

2 1

[Dovecot] offlineimap with dovecot and sieve
by Dieter Faulbaum 29 May '09

29 May '09

I have a dumb question, is it possible to use this combination: Synchronising a remote IMAP-server and a local dovecot-IMAP-server by offlineimap (with both types = IMAP), which works very well. But it seems, that my sieve-scripts on the local dovecot server are not recognised by this combination. Is there a good debugging way for this? -- Dieter Faulbaum Elektronenspeicherring BESSY II Albert-Einstein-Str. 15, 12489 Berlin phone +49 30 6392-4652 fax +49 30 6392-2939 mail Dieter.Faulbaum(a)bessy.de

5 5

[Dovecot] LDAP (AD) auth problem
by Misha Volodko 29 May '09

29 May '09

I'm trying to authenticate users using MS AD with auth_bind option. Here is my config file: # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps ssl_cert_file: /etc/dovecot/ssl/cert.pem ssl_key_file: /etc/dovecot/ssl/key.pem disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: acl auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf plugin: acl: vfile content of dovecot-ldap.conf hosts = myhost:389 auth_bind = yes auth_bind_userdn = cn=%n,ou=People,dc=company,dc=com base = ou=People,dc=company,dc=com user_attrs = mailNickname=home user_filter = (&(objectClass=user)(sAMAccountName=%n)) user_global_uid = vmail user_global_gid = vmail Using the same options I can fetch info with ldapsearch ldapsearch -h myhost -b 'dc=company,dc=com' -D 'cn=username,ou=People,dc=company,dc=com' -x -W '(&(objectClass=user)(sAMAccountName=username))' Dovecot doesn't work with this setting, shows in log: dovecot: auth(default): ldap(username,10.131.11.147): ldap_search() failed: Operations error Using tcpdump i found a cause of it, seems dovecot binds to AD server, then drop connection and trying to do search without bind. During sniff I see response to my ldap search - LdapErr: DSID-0C090627, comment: In order to perform this operation a successful bind must be completed on the connection Found similar problem in maillist - without solution. http://markmail.org/message/a6pui34ewb5bd55d Kindly asking what to do with it? :) -- Best Regards

2 6

[Dovecot] locking fails
by Oskar Eyb 29 May '09

29 May '09

hello! on one of my servers (freebsd 7.0-R , Jail) I have a very strange problem I guess its something about LOCKing. some programs have issued with locking: saslauthd[38127] :main : could not lock pid lock file: /var/run/saslauthd/saslauthd.pid.lock saslauthd[38127] :main : fcntl: Invalid argument dovecot: 2009-05-29 03:45:50 Info: dovecot v1.1.15 starting up dovecot: 2009-05-29 03:45:50 Info: Generating Diffie-Hellman parameters for the first time. This may take a while.. dovecot: 2009-05-29 03:45:50 Error: ssl-build-param: fcntl(write-lock) locking failed for file /var/db/dovecot/ssl-parameters.dat.tmp: Invalid argument dovecot: 2009-05-29 03:45:50 Fatal: ssl-build-param: file_try_lock(/var/db/dovecot/ssl-parameters.dat.tmp) failed: Invalid argument deliver(user(a)example.com): 2009-05-29 03:43:24 Error: fcntl(write-lock) locking failed for file /data/maildirs/example.com/user/dovecot.index.log: Invalid argument deliver(user(a)example.com): 2009-05-29 03:43:24 Error: mail_index_wait_lock_fd() failed with file /data/maildirs/example.com/user/dovecot.index.log: Invalid argument deliver(user(a)example.com): 2009-05-29 03:43:24 Info: msgid=<BLU129-W212F3C73CDDC4C399CE338FD510(a)phx.gbl>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-05-29 03:43:24] -rw------- 1 vmail vmail 24 May 29 03:43 /data/maildirs/example.com/user/dovecot.index.log all directorys are existent and wirtable I`m not sure if this only affects dovecot..maybe its a issue caused of the OS. anyone an idea? maybe its possible to run dovecot without these locking? thanks!! Oskar -- Nur bis 31.05.: GMX FreeDSL Komplettanschluss mit DSL 6.000 Flatrate und Telefonanschluss nur 17,95 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02

2 5

[Dovecot] (no subject)
by Patrick Hemmen 29 May '09

29 May '09

Hi, I use a OpenLDAP for authentication. To authenticate a full DN as the user name must be used, like "cn=jim,ou=users,dc=example,dc=com". There are several domains, like example2.com and example3.com. I want to use Dovecot with ldap and authentication binds. For testing I use "auth_bind_userdn = cn=%n,ou=users,dc=%d" and the user name must provide as "jim@example,dc=com". To allow the special chars ("=,") in user name, I extend "auth_username_chars". Now my questions. Exists a real chance to attack the ldap directory with the extended "auth_username_chars"? And it's possible to use authentication binds with the regular "auth_username_chars" and a provided user names like "jim(a)example.com" in my special ldap directory structure? Thanks in advance - Patrick

2 3

[Dovecot] Clustering dovecot?
by dovecot＠corwyn.net 29 May '09

29 May '09

Currently I have a mail server running postfix and dovecot with users in mysql. I have Outlook (blich) clients checking IMAP mail on the server. I'd like to build some fault-tolerance into that system in case I have hardware failure. I've read through: http://wiki.dovecot.org/MailLocation/SharedDisk but I feel I need more information. My basic understanding is that I'll need 2 clustered systems running with shared disk space and shared IP. Performance/load-balancing isn't an issue for me, it's just fault-tolerance that I'm worried about. I found a nice long doc for Cyrus IMAP (http://cyrusimap.web.cmu.edu//ag.html) anything similar for dovecot? Rick Rick Steeves http://www.sinister.net "The more I learn, it seems, the less I know." Frazz

7 15