December 2011 - dovecot

[Dovecot] Documentation clarifiction on mmap_disable
by Marcio Merlone 12 Dec '11

12 Dec '11

Greetings, On http://wiki.dovecot.org/MainConfig I read: "mmap_disable = no Don't use mmap() at all. This is required if you store indexes to shared filesystems (NFS or clustered filesystem). " Does that mean: 1. mmap is required when using NFS or 2. it is required to don't use mmap at all when using NFS? Sorry if this is obvious. Best regards. -- *Marcio Merlone*

2 1

[Dovecot] database failover
by Nick Edwards 12 Dec '11

12 Dec '11

Trying to get dovecot to _only_ use local copy of database, only querying another database server (same database, just replicated) if local copy is not responding, I have google fu'd a bit and found my only answer in so far as dovecot did this once upon as time, but it was only due to a dovecot bug, that has since been fixed, is that so? The wiki shows no information of failover, just load sharing, or is it an undocumented feature, or can dovecot not do failover, if not, can it be made so? Trying to cut down on network traffic, postfix does this nicely, I thought dovecot did too.

4 5

[Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts
by Mike Constabel 12 Dec '11

12 Dec '11

Hi, now the umlauts problem with sieve: # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["fileinto"]; # rule:[Test] if anyof (header :contains "Subject" "test") { fileinto "m&APY-"; } Error: DBBjDsXL5U7mIAAA/TNBsA: sieve: execution of script /mailspool1/in-preetz.de/test1/.dovecot.sieve failed, but implicit keep was successful (user logfile /mailspool1/in-preetz.de/test1/.dovecot.sieve.log may reveal additional details) # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve.log sieve: info: started log at Dec 12 10:40:04. error: msgid=<20111212094004.DB86918594(a)mx4.constabel-it.de>: failed to store into mailbox 'm&APY-': Mailbox doesn't exist: m&-APY-. Here the same: 'm&APY-' != "m&-APY-" Mike

3 5

[Dovecot] dovecot 2.1.rc1 and folders with umlauts
by Mike Constabel 12 Dec '11

12 Dec '11

Hi, if I try to crate a folder in Thunderbird 8 which contains umlauts this happens: - Create folder "Tür" - Thunderbird show T&APw-r in folder list In log: Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 # ll /mailspool1/in-preetz.de/test1/mdbox/mailboxes/ insgesamt 32K drwx------ 8 vmail vmail 4,0K 7. Dez 17:45 . drwx------ 4 vmail vmail 4,0K 7. Dez 17:45 .. drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Drafts drwx------ 3 vmail vmail 4,0K 29. Nov 11:04 INBOX drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Junk drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Sent drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r drwx------ 4 vmail vmail 4,0K 7. Dez 17:44 Trash If I click in TB on the folder, TB gives an empty message, the log shows: Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: quota: No quota setting - plugin disabled Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:43:02 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&ANY-de doesn't exist yet, using default permissions Dec 07 17:43:02 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:19 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:24 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 On another server with # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 an an server with # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 umlauts are working. Is there an problem with my config or with the rc1? thanks, Mike dovecot -n for not working 2.1.rc1: # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster@localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = </etc/postfix/psw-ssl/ssl.ca-bundle ssl_cert = </etc/postfix/psw-ssl/ssl.crt ssl_key = </etc/postfix/psw-ssl/ssl.key userdb { args = username_format=%Lu /etc/imap.userdb driver = passwd-file } protocol lda { mail_plugins = quota notify mail_log } protocol imap { imap_logout_format = bytes=%i/%o mail_plugins = quota notify mail_log imap_quota } protocol pop3 { mail_plugins = quota notify mail_log } dovecot -n for working 2.0.13: # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 auth_debug = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes debug_log_path = /var/log/dovecot/dovecot-debug.log lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot.log mail_location = mdbox:~/mdbox managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/imap.userdb driver = passwd-file } protocol imap { mail_plugins = " autocreate" }

2 7

[Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem
by Pascal Volk 12 Dec '11

12 Dec '11

I tried to apply the X modifier to the %{gid} variable: 'mail_attachment_dir = /srv/mail/.SiS/%X{gid}'. But the name of the created directory is '0', instead of '11172'. Regards, Pascal -- The trapper recommends today: c01dcofe.1134416(a)localdomain.org

2 3

Re: [Dovecot] using dsync to convert mailboxes looses caching options
by Mark Zealey 10 Dec '11

10 Dec '11

With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 09:35 To: Timo Sirainen Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark

3 5

[Dovecot] using dsync to convert mailboxes looses caching options
by Mark Zealey 10 Dec '11

10 Dec '11

Hi there, We're trying to convert users from Maildir to sdbox at present; I'm using dsync to achieve this (2.0.16) however when the user's have been converted we only get minimal information in the caching files. Is there some way to preserve all the caching decisions that were previously made so that when the user logs in to the new mailbox we don't have to cause an io storm rebuilding the cache that we know was good? Dovecot seems to be partially doing this - if i remove the logs/cache from the source mailbox no cache files are built in the conversion; if i put them back then we get a cache file built but it only contains a few bits of information (guid, date.save). Looking into this a bit further i find that when the caches are present at source the fields are preserved but the 'last used' date and caching decisions are not which I suspect means dsync doesn't bother caching on import - only fields with a yes decision in the source are copied (but their decision is only copied as a tmp with the date of import). For example: Source idxview cache: -- Cache fields -- # Name Type Size Dec Last used 0: flags bit 4 tmp 2011-11-25 16:09 1: date.received fix 4 yes 2011-11-26 16:17 2: size.virtual fix 8 tmp 2011-11-25 16:09 3: imap.bodystructure str - tmp 2011-11-25 16:09 4: mime.parts var - tmp 2011-11-25 16:09 5: hdr.IMPORTANCE hdr - tmp 2011-11-25 16:09 6: hdr.X-PRIORITY hdr - tmp 2011-11-25 16:09 7: hdr.CONTENT-TYPE hdr - tmp 2011-11-25 16:09 ... 18: date.sent fix 8 no 1970-01-01 01:00 19: date.save fix 4 yes 2011-11-26 16:17 20: size.physical fix 8 no 1970-01-01 01:00 21: imap.body str - no 1970-01-01 01:00 ... (24 total entries. stripped ones are just hdr. with a tmp decision) dst cache: # Name Type Size Dec Last used 0: flags bit 4 tmp 1970-01-01 01:00 1: date.sent fix 8 no 1970-01-01 01:00 2: date.received fix 4 tmp 1970-01-01 01:00 3: date.save fix 4 tmp 2011-11-26 16:19 4: size.virtual fix 8 tmp 1970-01-01 01:00 5: size.physical fix 8 no 1970-01-01 01:00 6: imap.body str - no 1970-01-01 01:00 7: imap.bodystructure str - tmp 1970-01-01 01:00 8: imap.envelope str - no! 1970-01-01 01:00 9: pop3.uidl str - no 1970-01-01 01:00 10: guid str - tmp 2011-11-26 16:19 11: mime.parts var - tmp 1970-01-01 01:00 12: hdr.IMPORTANCE hdr - tmp 1970-01-01 01:00 13: hdr.X-PRIORITY hdr - tmp 1970-01-01 01:00 ... and dst cached message for example: RECORD: seq=57, uid=12207, flags=0x09 (Seen Answered) - ext 1 modseq : 1 (0100000000000000) - ext 3 cache : 5516 (8c150000) - cache offset=5516 size=92, prev_offset = 0 - guid: 1321895282.XXXt,S=7399760,W=7496225 - date.save: 1322324286 (3e11d14e) src idx record for this message contains pretty much all fields. Thanks, Mark

3 9

[Dovecot] POP - preventing re-download with server move
by Trutwin, Joshua 10 Dec '11

10 Dec '11

Hi, Curious if anyone has any good suggestions to handle this. I try to get my hosting users to use IMAP but most use Outhouse and the IMAP support is somewhat annoying for many so I typically have them change their settings when using POP to leave copies on the server. That way when they get the inevitable virus or wanna use webmail they have a backup copy and webmail sees their saved mail. So now I have to move my sites to a new server and I'm trying to avoid having all these messages re-downloaded by POP clients. Some of the sites I've moved with low email usage have just dealt with the re-download and cleaned up afterwards. I have a few other accounts though that I'm more concerned about that have massive amounts of stored email. The mail is stored in Maildirs - a sample file: 1280409166.23580.foo:2,S If I move this to server "bar" would renaming the file to 1280409166.23580.bar:2,S prevent this somehow? Old server uses qmail-pop, new server uses dovecot 2.0. Thanks for any tips, Josh

3 2

[Dovecot] noaclright
by Knud Dombrowsky 10 Dec '11

10 Dec '11

Hi, I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. Because of mail-client-problems I am running one dovecot which requires authentication via a client-certificate and another one which can be used without a certificate. (Configurations can be found below.) Since the upgrade our shared mailbox is no longer visible. I tried to repair this by setting the ACLs once again (using imap-acl in Thunderbird) but every time I try to set a new ACL the tool says "noaclright" and dovecot logs the following messages: Dec 7 14:31:14 mailbox dovecot: imap(<sharing-user>): Error: fstat(/home/<sharing-user>/Maildir/.<shared-folder>/dovecot-acl.lock) failed: No such file or directory Dec 7 14:31:14 mailbox dovecot: imap(<sharing-user>): Error: file_dotlock_open(/home/<sharing-user>/Maildir/.<shared-folder>/dovecot-acl) failed: No such file or directory Needless to say the file exists and its contents looks like it should. (Every line is an ACL like "user=testuser ilrws") I took a look at the changelog from 2.0.14 onwards and since it says nothing about my problem I am not looking forward to compiling dovecot myself and installing it. Any ideas why this is happening? Is this a known problem? Any help is appreciated, Knud ------------Dovecot-on-port-992----------------------------------------- mailbox:~ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 992 ssl = yes } } ssl_ca = </etc/ssl/certs/graband-ca.pem ssl_cert = </etc/ssl/certs/mailbox5.crt ssl_key = </etc/ssl/private/mailbox.gpbs.net.key.pem userdb { driver = passwd } protocol imap { mail_plugins = acl imap_acl quota imap_quota } ------------Dovecot-on-port-993----------------------------------------- mailbox:~ # dovecot -c /etc/dovecot-cert/dovecot.conf -n # 2.0.14: /etc/dovecot-cert/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot-cert/auth-master auth_ssl_require_client_cert = yes base_dir = /var/run/dovecot-cert/ default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } ssl_ca = </etc/ssl/certs/graband-ca.pem ssl_cert = </etc/ssl/certs/mailbox5.crt ssl_key = </etc/ssl/private/mailbox.gpbs.net.key.pem ssl_verify_client_cert = yes userdb { driver = passwd } protocol imap { mail_plugins = acl imap_acl quota imap_quota } -----------------------------------------------------------------

2 1

[Dovecot] overriding userdb connection host for doveadm-user
by Micah Anderson 10 Dec '11

10 Dec '11

I've got my users in a replicated database setup and dovecot configured with two connect lines in dovecot-sql.conf: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass this works really well to help balance the load. However, when a new user is created, the replication information sometimes has not made it to the slave database before my user creation process tries to send that new user an email about their new email account. If it hasn't and the email gets sent, then it bounces because postfix thinks the user doesn't exist yet. Replication usually happens within seconds, but could be delayed due to problems. I would like a way to see if the new user's information has been replicated yet before sending the email. I was thinking I could use 'doveadm user' to lookup the user, but I am not sure that I can specify one of the specific 'connect' lines in my configuration to check. Is there a way to override that configuration variable to do this test? I tried various incarnations of passing '-o connect=host='... but doveadm user would just ignore them. thanks for any suggestions! micah ps - yes, I can make my user creation process just 'sleep' for an arbitrary amount of time and by that time the replication should have occured, but that is a bit of a shot in the dark, and doesn't handle longer replication delays that could potentially happen. --

3 3