March 2008 - dovecot - dovecot.org

[Dovecot] Security issue #5: mail_extra_groups setting is often used insecurely
by Timo Sirainen 05 Mar '08

05 Mar '08

mail_extra_groups=mail setting is often used insecurely to give Dovecot access to create dotlocks to /var/mail directory. If you don't use mboxes in /var/mail, make sure this setting is cleared. If you do use /var/mail mboxes and Dovecot gives permission errors without it, do one of the following (in the preferred order): a) Upgrade to v1.0.11 and use the new mail_privileged_group setting instead of mail_extra_groups. b) Make /var/mail sticky and world-writable (chmod 01777 /var/mail) and clear mail_extra_groups setting. c) Make /var/mail sticky (chmod +t /var/mail) and keep mail_extra_groups setting. This fixes the main problem but some may be left. The mail_privileged_group setting is also available as a patch: http://dovecot.org/patches/1.0/dovecot-1.0.10.mail_priv_groups.diff mail_extra_groups setting has existed since Dovecot v0.99.10.6. It's never been enabled by default in the distributed dovecot-example.conf, but some distributions enable it by default (at least Debian). A longer explanation: The main problem is that if users have filesystem access to the mail server, they can create symlinks. Dovecot doesn't try to prevent following symlinks (and I don't think it should) and normally it isn't a problem. But when mail_extra_groups=mail is set: 1a) Maildir: Any files readable by mail group can be read by the user by symlinking the file to their ~/Maildir/cur/. 1b) Any mbox files readable by mail group can be read by the user by symlinking the mbox file to their ~/mail/ directory. These are pretty obvious problems and I didn't think they were all that important. Why would anyone have secret files that are mail group-readable? But apparently those do exist in some systems (maybe accidentally). 2a) mbox: Any files/directories under mail group-writable directories can be created/deleted/renamed by symlinking the directory under ~/mail/. For example ln -s /var/mail ~/mail/var, DELETE var/root will happily delete root's mailbox. This I hadn't thought about before. 2b) Maildir: Pretty much the same thing can be done with maildir but with a little less control. mail_privileged_group setting works by keeping the group in process's saved GID while it's not in use and temporarily switching it to effective GID while dotlocks are created. Currently this is done only when: 1. It's only done for INBOX mbox which doesn't exist under the same location as other mailboxes (so typically under /var/mail). 2. It's used only after initial dotlock creation try failed with EACCES error.

7 15

[Dovecot] constant mailbox rebuilding with dovecot 1.0.10
by Philip J. Hollenback 04 Mar '08

04 Mar '08

I've recently upgraded to 1.0.10 in hopes that this problem would go away but no luck. I've got some users at my company with large inboxes on maildir (say 22,000 messages). Their mailboxes are hosted on nfs and dovecot is configured to do dotlocking. Still I see messages like this continually in the logs (sometimes every hour or so): server dovecot: IMAP(user): dotlock /home/user/Maildir/dovecot.index.log.lock was immediately recreated under us server dovecot: IMAP(user): file_dotlock_create() failed with file /home/user/Maildir/dovecot.index.log: No such file or directory server dovecot: IMAP(user): Our dotlock file /home/user/Maildir/dovecot-uidlist.lock was overridden (kept it 0 secs) server dovecot: IMAP(user): Duplicate file in uidlist file /home/user/Maildir/dovecot-uidlist: 1162416499.010493.mbox:2,Sa server dovecot: IMAP(user): Maildir /home/user/Maildir sync: UID inserted in the middle of mailbox (48573 > 1, file = 1162416499.010493.mbox:2,Sa) or this: server dovecot: IMAP(user): dotlock /home/user/Maildir/dovecot.index.log.lock was immediately recreated under us server dovecot: IMAP(user): file_dotlock_create() failed with file /home/user/Maildir/dovecot.index.log: No such file or directory server dovecot: IMAP(user): Duplicate file in uidlist file /home/user/Maildir/dovecot-uidlist: 1167674195.83666_2.tandoori.schrodinger.com:2,Sklwv server dovecot: IMAP(user): Maildir /home/user/Maildir sync: UID inserted in the middle of mailbox (34969 > 1, file = 1167674195.83666_2.server.com:2,Sklwv) server dovecot: IMAP(user): Corrupted transaction log file /home/user/Maildir/dovecot.index.log.2: invalid indexid (1204046496 != 1204055346) it seems that every time this sort of thing happens the mail client (thunderbird) sits and rebuilds it's mailbox info for as long as 20-30 minutes, during which time it is unusable. I suspect this happens with other users as well but since they have smaller inboxes they don't notice the long delays. Also this is not linked to version 1.0.10, I've been seeing on and off with the previous version (1.0rc17). Here's the 'dovecot -n' output. I should add that the default is for users to use mbox but some users (like the above one) use maildir via a separate dovecot.passwd file. Server is FreeBSD 4.7. # 1.0.10: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imaps ssl_cert_file: /usr/local/openssl/certs/server.crt ssl_key_file: /usr/local/openssl/private/server.key login_dir: /var/run/dovecot//login login_executable: /usr/local/libexec/dovecot/imap-login login_greeting_capability: yes verbose_proctitle: yes first_valid_uid: 700 last_valid_uid: 9999 first_valid_gid: 100 last_valid_gid: 200 mail_extra_groups: mail default_mail_env: mbox:%h/mail:INBOX=/var/mail/%u mail_location: mbox:%h/mail:INBOX=/var/mail/%u mmap_disable: yes lock_method: dotlock mbox_read_locks: dotlock mbox_write_locks: dotlock imap_client_workarounds: delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep auth default: passdb: driver: pam passdb: driver: passwd-file args: /usr/local/etc/dovecot.passwd passdb: driver: passwd userdb: driver: passwd-file args: /usr/local/etc/dovecot.passwd userdb: driver: passwd -- Phil Hollenback hollenba(a)schrodinger.com Schrodinger, Inc.

2 3

[Dovecot] v1.0.11 released
by Timo Sirainen 04 Mar '08

04 Mar '08

http://dovecot.org/releases/1.0/dovecot-1.0.11.tar.gz http://dovecot.org/releases/1.0/dovecot-1.0.11.tar.gz.sig * mail_extra_groups setting was commonly used insecurely. This setting is now deprecated. Most users should switch to using mail_privileged_group setting, but if you really need the old functionality use mail_access_groups instead. - mbox: Dropped some of the physical size fetch optimizations added in v1.0.8. This makes some commands slower, but should fix the rest of the problems. - IMAP: SEARCH BEFORE/ON/SINCE didn't handle timezones correctly. - ldap: auth_bind was doing lookups using subtree scope instead of the scope specified in config file. - zlib plugin crashfixes by Richard Platel - master passdbs: pass=yes setting was broken with blocking passdbs (e.g. MySQL)

3 2

[Dovecot] Missing IMAP folders
by Willem Jan Withagen 04 Mar '08

04 Mar '08

Hi, I'm fresh starting to use dovecot. Before this I used bincimap, mainly because it was very simple to config. I've tried to find the FAQ's and tried searching the archives, but little came up. My current config: server FreeBSD i386, postfix 2.4 dovecot 1.0.10 client: windows 2000 thunderbird 2.0.0.12 after some inital config this starts up, and I even have the advantage that I can save in the Sent folder on the server. However I have over 3500 folders and most of them are more than 3 levels deep. And I only get to see the first top level of directories. Searching and/or subscribing does not bring anything. Does somebody have pointers on how to fix this, other than manually trying to recreate al subscriptions. --WjW

2 3

[Dovecot] deliver dovecot 1.0.9 patched with quota-rewrite-1.0.9.diff
by Osvaldo Alvarez Pozo 04 Mar '08

04 Mar '08

Hi I downloaded dovecot 1.09 sources I patched it with quota-rewrite patch for v1.0. And now I have a problem with quota , I have quota dans mysql. When I send mail to a mailbox & I exeded the quota limit, I mean I have the impresion deliver does not obey the quota limit. then when I want to erase de mail via imap dovecot tells me there is no space for this operation. my logs: /var/log/dovecot-deliver.log deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: info(a)webmark.fr deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: home=/export/vmail/webmark.fr/info/Maildir deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: mail=maildir:/export/vmail/webmark.fr/info/Maildir deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: uid=5000 deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: gid=8 deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: quota_rule=*:bytes=10240000 deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: maildir: data=/export/vmail/webmark.fr/info/Maildir deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: maildir: root=/export/vmail/webmark.fr/info/Maildir, index=/export/vmail/webmark.fr/info/Maildir, control=, inb$ deliver(info(a)webmark.fr): Mar 03 12:46:17 Info: msgid=<5393f790988e70e84018e2510363bdfe@localhost>: saved mail to INBOX /var/log/mail.log: dovecot: imap-login: Login: user=<info(a)webmark.fr>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: IMAP(info(a)webmark.fr): Loading modules from directory: /usr/dovecot/lib/dovecot/imap dovecot: IMAP(info(a)webmark.fr): Module loaded: /usr/dovecot/lib/dovecot/imap/lib10_quota_plugin.so dovecot: IMAP(info(a)webmark.fr): Module loaded: /usr/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so dovecot: IMAP(info(a)webmark.fr): Effective uid=5000, gid=8, home=/export/vmail/webmark.fr/info/Maildir dovecot: IMAP(info(a)webmark.fr): Quota root: name= backend=maildir args= dovecot: IMAP(info(a)webmark.fr): Quota rule: root= mailbox= bytes=10240000 messages=0 dovecot: IMAP(info(a)webmark.fr): Quota rule: root= mailbox=Trash bytes=3072000 messages=0 dovecot: IMAP(info(a)webmark.fr): maildir: data=/export/vmail/webmark.fr/info/Maildir dovecot: IMAP(info(a)webmark.fr): maildir: root=/export/vmail/webmark.fr/info/Maildir, index=/export/vmail/webmark.fr/info/Maildir, control=, inbox= My file dovecot.conf is the following. ssl_cert_file = /etc/ssl/certs/ssl-cert-snakeoil.pem ssl_key_file = /etc/ssl/private/ssl-cert-snakeoil.key mail_location = maildir:/export/vmail/%d/%u/Maildir mail_extra_groups = mail first_valid_uid = 5000 last_valid_uid = 5000 maildir_copy_with_hardlinks = yes disable_plaintext_auth = no mail_debug = yes protocols = imap pop3 protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { postmaster_address = support(a)oc3.fr mail_plugins = quota log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } auth default { mechanisms = plain login passdb sql { args = /etc/dovecot/sql.conf } # userdb prefetch { # } userdb sql { args = /etc/dovecot/sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = mail } } } dict { } plugin { quota = maildir quota_rule2 = Trash:storage=30%% } my file sql.conf driver = mysql default_pass_scheme = MD5 connect = host=localhost dbname=postfix user=postfix password=password user_query = SELECT concat('/export/vmail/', maildir, 'Maildir') as home, concat('maildir:/export/vmail/', maildir, 'Maildir') as mail, 5000 AS uid, 8 AS gid, concat('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username as user, password, concat('/export/vmail/', maildir, 'Maildir') as userdb_home, concat('maildir:/export/vmail/', maildir, 'Maidir') as userdb_mail, 5000 as userdb_uid, 8 as userdb_gid, concat('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' Any Idea? Thanks

2 1

[Dovecot] dovecot 1.09 quota-rewrite patch for v1.0.
by Osvaldo Alvarez Pozo 04 Mar '08

04 Mar '08

I downloaded dovecot 1.09 sources I patched it with quota-rewrite patch for v1.0. And now I have a problem with quota , I have quota dans mysql. I send mail to a mailbox & i exeded the quota limit, then when I want to errase de mail via imap dovecot tells me there is no space for this operation. my logs: /var/log/dovecot-deliver.log deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: info(a)webmark.fr deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: home=/export/vmail/webmark.fr/info/Maildir deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: mail=maildir:/export/vmail/webmark.fr/info/Maildir deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: uid=5000 deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: gid=8 deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: auth input: quota_rule=*:bytes=10240000 deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: maildir: data=/export/vmail/webmark.fr/info/Maildir deliver(info(a)webmark.fr): Mar 03 12:46:15 Info: maildir: root=/export/vmail/webmark.fr/info/Maildir, index=/export/vmail/webmark.fr/info/Maildir, control=, inb$ deliver(info(a)webmark.fr): Mar 03 12:46:17 Info: msgid=<5393f790988e70e84018e2510363bdfe@localhost>: saved mail to INBOX /var/log/mail.log: dovecot: imap-login: Login: user=<info(a)webmark.fr>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: IMAP(info(a)webmark.fr): Loading modules from directory: /usr/dovecot/lib/dovecot/imap dovecot: IMAP(info(a)webmark.fr): Module loaded: /usr/dovecot/lib/dovecot/imap/lib10_quota_plugin.so dovecot: IMAP(info(a)webmark.fr): Module loaded: /usr/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so dovecot: IMAP(info(a)webmark.fr): Effective uid=5000, gid=8, home=/export/vmail/webmark.fr/info/Maildir dovecot: IMAP(info(a)webmark.fr): Quota root: name= backend=maildir args= dovecot: IMAP(info(a)webmark.fr): Quota rule: root= mailbox= bytes=10240000 messages=0 dovecot: IMAP(info(a)webmark.fr): Quota rule: root= mailbox=Trash bytes=3072000 messages=0 dovecot: IMAP(info(a)webmark.fr): maildir: data=/export/vmail/webmark.fr/info/Maildir dovecot: IMAP(info(a)webmark.fr): maildir: root=/export/vmail/webmark.fr/info/Maildir, index=/export/vmail/webmark.fr/info/Maildir, control=, inbox= My file dovecot.conf is the following. ssl_cert_file = /etc/ssl/certs/ssl-cert-snakeoil.pem ssl_key_file = /etc/ssl/private/ssl-cert-snakeoil.key mail_location = maildir:/export/vmail/%d/%u/Maildir mail_extra_groups = mail first_valid_uid = 5000 last_valid_uid = 5000 maildir_copy_with_hardlinks = yes disable_plaintext_auth = no mail_debug = yes protocols = imap pop3 protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { postmaster_address = support(a)oc3.fr mail_plugins = quota log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } auth default { mechanisms = plain login passdb sql { args = /etc/dovecot/sql.conf } # userdb prefetch { # } userdb sql { args = /etc/dovecot/sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = mail } } } dict { } plugin { quota = maildir quota_rule2 = Trash:storage=30%% } my file sql.conf driver = mysql default_pass_scheme = MD5 connect = host=localhost dbname=postfix user=postfix password=password user_query = SELECT concat('/export/vmail/', maildir, 'Maildir') as home, concat('maildir:/export/vmail/', maildir, 'Maildir') as mail, 5000 AS uid, 8 AS gid, concat('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username as user, password, concat('/export/vmail/', maildir, 'Maildir') as userdb_home, concat('maildir:/export/vmail/', maildir, 'Maidir') as userdb_mail, 5000 as userdb_uid, 8 as userdb_gid, concat('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' Any Idea Thanks

2 2

[Dovecot] odd password issue using ]...[
by Tom Shannon 03 Mar '08

03 Mar '08

Hello folks, I'm using 0.99.11 with sendmail and shadow passwords. I've discovered an odd bug with password characters. Password Result [dove] works ]dove[ fails You can substitute anything for the dove part so its the inverted ] [ that's causing some sort of problem. For the failed login I see this in the dovecot logs ... imap-login: Mar 03 15:54:10 Info: Login: test [xxx.xxx.xxx.xxx] dovecot-auth: Mar 03 15:54:11 Info: Login process 23 disconnected Any ideas? thanks, Tom

2 1

Re: [Dovecot] dnotify inotify
by Gunter Ohrner 03 Mar '08

03 Mar '08

Am Donnerstag, 28. Februar 2008 schrieb Osvaldo Alvarez Pozo: > > In case of 1.0.10, just take the prepared ready-to-install .deb from > > backports. > Does this backport package has quota available? Mh, sorry, I've no idea. Maybe someone on the mailing list can give a definitive answer. Greetings, Gunter -- *** Powered by AudioScrobbler --> http://www.last.fm/user/Interneci/ *** 23:10 | Lunatica - Words Unleashed 23:05 | Lunatica - The Power of Love 23:01 | Lunatica - Together 22:57 | Lunatica - Song for you *** PGP-Verschlüsselung bei eMails erwünscht :-) *** PGP: 0x1128F25F ***

5 6

[Dovecot] Index corruption with squirrelmail.
by "Fábio M. Catunda" 03 Mar '08

03 Mar '08

Hi. I don't know if the problem is related with squirrelmail or not, but I started to have index corruption when I started to try squirrelmail. Some informaton about my instalation: dovecot 1.0.5-1 debian package with maildir squirrelmail 1.4.9a-2 debian package Some log information: dovecot: 2008-02-27 08:39:39 Warning: IMAP(<please don't send spam to me>): fscking index file /var/virtual/contactnet.com.br/fcatunda/Maildir/dovecot.index dovecot: 2008-02-27 08:39:39 Error: IMAP(<please don't send spam to me>): Unexpected transaction log desync with index /var/virtual/contactnet.com.br/fcatunda/Maildir/dovecot.index I'm not pretty sure, but it looks like that if I keep my thunderbird open, receive a message and a rule move the message from INBOX to some other folder and then, finally, I try to login in squirrelmail I reveive a message like this: Query: EXPUNGE And in my log file the above message appears. I already deleted dovecot.* files, but the error ocurred again. Any suggestion? Thanks!

3 8

[Dovecot] Putscript Assertation failed in dovecot-1.0.10-MANAGESIEVE-v9.1.diff.gz
by Steffen Kaiser 03 Mar '08

03 Mar '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, during PUTSCRIPT with an user over quota: dovecot: Feb 29 13:44:17 Error: MANAGESIEVE(omuste2s) [5462]: o_stream_send_istream(/home/omuste2s/Maildir/sieve/tmp/test-1204289057.P5462Q0M951871.ux-2s11standby.sieve) failed: Disk quota exceeded dovecot: Feb 29 13:44:17 Error: MANAGESIEVE(omuste2s) [5462]: file sieve-save.c: line 306 (sieve_storage_save_abort): assertion failed: (ctx->output == NULL) dovecot: Feb 29 13:44:17 Error: MANAGESIEVE(omuste2s) [5462]: Raw backtrace: managesieve [0x8068a21] -> managesieve [0x806893c] -> managesieve [0x80548fd] -> managesieve [0x8050825] -> managesieve [0x80509f2] -> managesieve(cmd_putscript+0xec) [0x8050b9c] -> managesieve [0x80518a8] -> managesieve [0x805192c] -> managesieve(_client_input+0x6c) [0x8051f9c] -> managesieve(io_loop_handler_run+0x162) [0x806b632] -> managesieve(io_loop_run+0x28) [0x806a888] -> managesieve(main+0x428) [0x8052a18] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7e42ea8] -> managesieve [0x8050341] dovecot: Feb 29 13:44:17 Error: child 5462 (managesieve) killed with signal 6 Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHx/60VJMDrex4hCIRAtZaAJ9hsXAFPnFcO5MWO3/3iN1VcUWslQCcC/60 9pcZvRn13oucfaogdMJNptA= =4y71 -----END PGP SIGNATURE-----

2 2