December 2011 - dovecot

[Dovecot] Corrupted index cache file and high CPU usage
by hydra 24 Dec '11

24 Dec '11

I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the userdb and provides IMAP and LDA. Because each user has a quota, the doveadm's expunge functionality is used to get rid of old trashed mail. The mail log: Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size Doveadm is launched as: doveadm -D expunge -A mailbox Trash savedbefore 1w Mail is stored on ext4 and flush will use all of the CPU capacity like this: load average: 4.00, 4.01, 4.05 ps: root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 [flush-253:1] lsblk: vg_data-mail (dm-1) 253:1 0 500M 0 /var/data/mail dovecot -n: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 3.0.4-hardened-r5 x86_64 Gentoo Base System release 2.0.3 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes hostname = mail.domain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_debug = yes mail_gid = vmail mail_home = /var/data/mail/domain.tld/%n mail_location = maildir:~/mail mail_plugins = " mail_log notify zlib quota" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Sent autocreate2 = Trash autocreate3 = Spam autosubscribe = Sent autosubscribe2 = Trash autosubscribe3 = Spam fts = squat fts_squat = partial=4 full=10 quota = maildir:User quota quota_rule = *:storage=100M quota_rule2 = Trash:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_quota_max_scripts = 5 sieve_quota_max_storage = 5M } postmaster_address = postmaster(a)domain.tld protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/postfix/mail.domain.tld-cert.pem ssl_key = </etc/postfix/mail.domain.tld-key.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes verbose_ssl = yes protocol lda { info_log_path = log_path = mail_plugins = " mail_log notify zlib quota sieve" } protocol imap { mail_plugins = " mail_log notify zlib quota autocreate fts fts_squat imap_zlib imap_quota" } dovecot-ldap.conf.ext: hosts = localhost dn = user dnpass = pass base = base auth_bind = yes user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,mailboxQuota=quota_rule=*:bytes=%$ user_filter = (&(objectClass=inetOrgPerson)(uid=%u)) pass_attrs = uid=user pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)) iterate_attrs = uid=user iterate_filter = (objectClass=inetOrgPerson) I suspect, that this is something to do with Dovecot, because after deleting the dovecot.index.cache file, everything went back to normal. When this happens, I cannot unmount the drive nor a system reboot works. Thank you !

3 9

[Dovecot] Limit maximum connections for user/IP on proxy
by Martin Abrahamsson 23 Dec '11

23 Dec '11

Hi, Is it possible to limit the maximum number of IMAP connections allowed for a user from each IP address, on the proxy server instead of on the mail store server? mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. Thanks -- Martin Abrahamsson

2 2

[Dovecot] Dovolená
by pasek＠valbek.cz 23 Dec '11

23 Dec '11

Dobrý den, od 23.12. do 30.12. jsem na dovolené. V případě nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pašek vedoucí oddělení IT a vizualizace mobil: +420 776 140 489 e-mail: pasek(a)valbek.cz Valbek, s.r.o. Vaňurova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz

3 2

[Dovecot] OS/Distro wars
by Alan Brown 22 Dec '11

22 Dec '11

DO NOT FEED THE TROLLS

2 1

[Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ...
by LE NORCY Arnaud 22 Dec '11

22 Dec '11

Hello, i get this message every time that a user has enabled the vacation script (into Horde webmail) in my mail.err log file: Dec 22 10:18:16 mailserver dovecot: deliver(user324): file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory normally the reply is sent only once in the number of configured days.. but for all users the reply is sent every time... the day variable is "ignored.." because the file "dovecot.lda-dupes" is not wrotten i think.. ~# dpkg -l | grep dovecot ii dovecot-common 1:1.2.15-4 secure mail server that supports mbox and maildir mailboxes ii dovecot-imapd 1:1.2.15-4 secure IMAP server that supports mbox and maildir mailboxes ii dovecot-pop3d 1:1.2.15-4 secure POP3 server that supports mbox and maildir mailboxes dovecot.conf : protocols = imap imaps pop3s managesieve mail_location = maildir:/ext/spool/imap/%1Mu/%u mail_uid = vmail mail_gid = vmail protocol lda { mail_plugins = quota sieves.fr } .. plugin { .. sieve_dir = /ext/spool/sieve/%1Mu/%u sieve = /ext/spool/sieve/%1Mu/%u/dovecot.sieve } rights are OK for user "vmail" in /ext/spool/sieve/%1Mu/%u/ ....; for example : /ext/spool/sieve/d/user324# ls -la total 20 drwxr-x--- 3 vmail vmail 4096 20 déc. 19:15 . drwxr-x--- 43 vmail vmail 4096 17 nov. 10:14 .. lrwxrwxrwx 1 vmail vmail 10 20 déc. 18:38 dovecot.sieve -> ingo.sieve -rw-r----- 1 vmail vmail 65 20 déc. 19:15 dovecot.svbin -rw-r----- 1 vmail vmail 88 20 déc. 18:38 ingo.sieve drwxr-x--- 2 vmail vmail 4096 20 déc. 18:38 tmp any ideas?thanks Arnaud,

2 1

[Dovecot] Patch for dovecot 1.2.16 (and .17) for vpopmail module
by Alessio Cecchi 22 Dec '11

22 Dec '11

Hi Timo, I love dovecot but I love also vpopmail and its functions for manage user limits (via vmoduser). Unfortunately in dovecot 1.2.x auth default set to use "vpopmail" is unable to apply this limits. Only if used with checkpassword limits works fine but in the dovecot.log only user (without @domain) is logged. So, based on the code of dovecot 2.0, I have created this very simple patch that correct this bug. Thanks for consideration -- Alessio Cecchi is: on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi Linux -> http://www.cecchi.biz/ Hosting Linux -> http://www.hosting-linux.it @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

1 0

[Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef
by Thomas Leuxner 22 Dec '11

22 Dec '11

Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. ==> /var/log/dovecot/dovecot.log <== Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx(a)leuxner.net) Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx(a)leuxner.net) jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006(a)Media-Brokers.com>: saved mail to INBOX $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log sieve: info: started log at Dec 22 12:13:52. main_script: line 2: error: included global script 'global.sieve' does not exist. main_script: error: validation failed. [ Script Calling Global ] $ head /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve require ["include","copy","fileinto","vacation"]; include :global "global.sieve"; […] $ ls -al /var/vmail/conf.d/leuxner.net/sieve/ total 12 dr-x------ 2 vmail vmail 4096 Dec 7 15:09 . dr-x------ 4 vmail vmail 4096 Mar 17 2010 .. -r-------- 1 vmail vmail 3647 Dec 7 15:09 global.sieve $ doveconf -n # 2.1.rc1 (056934abd2ef): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { client_limit = 1224 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = </etc/ssl/certs/SSL123_CA_Bundle.pem ssl_cert = </etc/ssl/certs/host_domain_tld.crt ssl_key = </etc/ssl/private/host_domain_tld.key syslog_facility = local1 userdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = acl quota stats sieve } protocol imap { mail_plugins = acl quota stats imap_acl imap_quota mail_log notify imap_stats }

3 3

[Dovecot] Backing Up To Windows File Server
by Asai 22 Dec '11

22 Dec '11

Greetings, Working with dsync and setting up backups to a Windows file server. Problem seems to be that Windows is renaming the dovecot mail files (maildir) to Windows friendly filenames, and losing the Dovecot name. For example, 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S becomes 1AETPH~X. Does anyone have any ideas about how to tell Windows to not do this? Or is it not possible? -- --asai

5 7

[Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!)
by Gary Chodos 22 Dec '11

22 Dec '11

We created a new virtual domain and created a user in that domain in our pgsql database. Instead of creating any directory structure in /home/virtual/mail/<domain>/<user>, I just sent a test email to see if dovecot's lmtp would autocreate. And it did! And mail appears to be delivered to an inbox.. but, logging is weird and I'm not sure everything is working as it should because: Dec 20 23:01:28 mx dovecot: lmtp(21458, user(a)example.com) lUDFG8tZ8U7SUwAAO3tENA: msgid=<20111221040122.GP13367(a)hostname.example.org>: saved mail to . so why doesn't dovecot log where mail is stored/saved? thanks, Gary

2 2

[Dovecot] Problem listing SPECIAL-USE flags
by Patrick Ben Koetter 21 Dec '11

21 Dec '11

Timo, we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into problems. I believe you could help change that. Here's the problem: By default TB only lists subscribed (LSUB) folders when it accesses an IMAP server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which folders it should use and map to until someone tells it to list all folders (LIST) manually. Central part of the SPECIAL-USE idea was/is to require as little user interaction as possible to automatically setup a MUA to do the right thing. Speculating that probably most MUAs will do a LSUB by default and never will get to see SPECIAL-USE flags I think it is easier to have the server-side promote the flags. Do you think that would be possible? Just to verify I configured Dovecot as you would expect for SPECIAL-USE: I've set Dovecot 2.1 to autocreate and autosubscribe SPECIAL-USE mailboxes like this: namespace inbox { ... mailbox AltDrafts { special_use = \Drafts auto = subscribe } ... } This is what I get: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. t1 login alice(a)example.com secret t1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LSUB "" "%" * LSUB () "." "Trash" * LSUB () "." "AltDrafts" * LSUB () "." "AltSent" * LSUB () "." "Archives" * LSUB () "." "AltTrash" * LSUB () "." "AltJunk" * LSUB () "." "AltArchive" * LSUB () "." "Junk" t2 OK Lsub completed. t3 LIST "" "%" * LIST (\HasNoChildren \Sent) "." "AltSent" * LIST (\HasChildren) "." "Archives" * LIST (\HasNoChildren \Archive) "." "AltArchive" * LIST (\HasNoChildren \Junk) "." "AltJunk" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren \Trash) "." "AltTrash" * LIST (\HasNoChildren \Drafts) "." "AltDrafts" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "INBOX" t3 OK List completed. t4 logout * BYE Logging out t4 OK Logout completed. Connection closed by foreign host. Thanks, p@rick -- state of mind () http://www.state-of-mind.de Franziskanerstraße 15 Telefon +49 89 3090 4664 81669 München Telefax +49 89 3090 4666 Amtsgericht München Partnerschaftsregister PR 563

4 7