September 2013 - dovecot

[Dovecot] Dovecot extremely slow!
by Patricio Rojo 27 Sep '13

27 Sep '13

Please help, Dovecot is running extremely slow for the last couple of weeks and it seems to be getting worse (or my patience running short). I attach the 10-master configuration and the log file after running strace according to: http://wiki.dovecot.org/Debugging/ProcessTracing I can click on an email and wait for a minute or more before receiving a connection dropped or no error at all. I use many clients (thunderbird, windows 8 mail, maildroid for android, squirrelmail) and they all have similar behavior. It happens both in the inbox and on imap subfolders. Sometimes it helps changing subfolders back and forth. I have many imap folders organized in up to 3 levels of subfolders and use postfix for delivery. Let me know any other info you require. Thanks! Patricio

6 8

[Dovecot] Courier migration and vpopmail with dovecot-lda
by Charles Sprickman 26 Sep '13

26 Sep '13

I've been using Dovecot in some fresh installs lately and have found it fairly easy to configure. However I'm starting on a migration that involves moving from some very old software (ancient vpopmail, qmail and Courier). On the Courier front, I've reviewed the migration page in the wiki, and it looks like the main concerns are just matching the namespace and then using the migration script to create new subscription and uidlist files. Given that my Courier IMAP setup is so old (4.0.6), is there anything to be aware of that's not covered in the wiki due to the age of Courier here? Are there any other general issues to be aware of as far as interactions with MUAs are concerned? For example, if Courier has been presenting the user's MUA with a given set of IMAP capabilities and then the MUA sees a bunch of extra capabilities on a subsequent login, will that trigger any strange behavior? And lastly on this subject, I will obviously be doing some testing before cutting over to the other server. Is it valid in something like Thunderbird to have it pointed to "imap.domain.com" and then change the imap server to point to something like "testimap.domain.com" for testing whether subscriptions and the uidlists are working as expected or should I fully replicate the move as an end user would see it by making the change in my local hosts file? Now, assuming that portion of the move goes alright, I'm incredibly confused about getting Dovecot and Vpopmail working together. I assume that initially I can stick with the Maildir++ mailbox format and let vpopmail's vdelivermail continue working as my LDA - vdelivermail understands how to find the user's Maildir, it can check quotas, and it can update the maildirsize file (which I'm assuming dovecot can also read and then report quota/usage to an IMAP client). However it does look like the Dovecot-only mailbox format(s) will offer much better performance than Maildir as the two dbox formats are the only supported mailbox formats with separate index files, correct? Is there any guidance on how to use dovecot's LDA with a virtual mail system such as vpopmail? From what I've read so far, I probably don't want to use the vpopmail extension supplied with dovecot, but query the mysql vpopmail db directly. I'm finding a ton of info while searching for this, but most deals with older versions of dovecot, and there are also many "this works but I don't know why" tutorials on combining dovecot and vpopmail and dovecot's own LDA. I'm not even able to guess how one handles the per-user .qmail files in vpopmail if not using vdelivermail (this is where we enable/disable spam filtering by piping the message through spamc). Any input on the overall migration process is appreciated. It's a bit overwhelming as I have to deal with a big jump in the vpopmail version, rebuilding qmail with a ridiculous number of patches, and then on top of that a migration to new imap/pop server software. eek. Thanks, Charles -- Charles Sprickman NetEng/SysAdmin Bway.net - New York's Best Internet www.bway.net spork(a)bway.net - 212.982.9800

2 2

[Dovecot] sieve gone mad ---help
by Rob 26 Sep '13

26 Sep '13

managesieve has gone mad. One person went on holiday when he came back his out of office would not switch off, then it replicated it's self into two other users (the vacation noticE) and started to be sent out for them and those users had never set up an out of office or looted into round cube. even deleting the vacation notice did not stop it, but if we put another vacation notice in then the new one is sent out, if we disable the new one then the old one is sent out…. mad…. how can I refresh the whole thing and start again… ? I am running this on 10.8.4 mountain lion server and I can't stop sieve… I have looked in the /Library/Server/Mail/Data/rules/USERFOLDER and removed all sieve files I have looked in each users mailbox but no seve files there… I have restarted and still sieve will not stop sending out emails…. yesterday it went crazy sending a mail a second from one mailbox back to it's self…. help….. osx 10.8 server using latest roundcube with managesieve plugin.... bash-3.2# ps -aef|grep dovecot 0 27481 1 0 12:07am ?? 0:00.36 /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -F 214 27490 27481 0 12:07am ?? 0:00.58 dovecot/anvil [4 connections] 0 28237 27481 0 12:07am ?? 0:01.69 dovecot/log 0 28239 27481 0 12:07am ?? 0:00.20 dovecot/config 227 28309 27481 0 12:08am ?? 0:42.33 dovecot/imap-login [28 connections (28 TLS)] 214 28311 27481 0 12:08am ?? 0:08.65 dovecot/auth [0 wait, 0 passdb, 0 userdb] 214 40746 27481 0 6:54am ?? 0:06.33 dovecot/imap [3 connections] 214 40747 27481 0 6:54am ?? 0:01.89 dovecot/imap [reply 192.168.5.134 IDLE] 214 45378 27481 0 8:36am ?? 0:01.73 dovecot/imap [3 connections] 214 46125 27481 0 9:03am ?? 0:00.75 dovecot/imap [2 connections] 214 46127 27481 0 9:03am ?? 0:01.84 dovecot/imap [3 connections] 214 47385 27481 0 9:35am ?? 0:01.29 dovecot/imap [3 connections] 214 56274 27481 0 1:15pm ?? 0:00.25 dovecot/imap [3 connections] 214 56275 27481 0 1:15pm ?? 0:00.36 dovecot/imap [5 connections] 214 56276 27481 0 1:15pm ?? 0:00.45 dovecot/imap [4 connections] 214 56367 27481 0 1:18pm ?? 0:00.10 dovecot/imap [liam 192.168.5.130 IDLE] 0 62854 9637 0 4:37pm ttys000 0:00.00 grep dovecot bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -n # 2.0.19apple1: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 12.4.0 x86_64 hfs aps_topic = com.apple.mail.XServer.68f48c72-274a-48f9-beed-71096afe3fa6 auth_mechanisms = cram-md5 x-plain-submit plain login apop gssapi digest-md5 auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 mail_access_groups = mail mail_location = maildir:/Library/Server/Mail/Data/mail/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file pass = yes submit = yes } passdb { driver = od } plugin { fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/roundcube.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u } postmaster_address = postmaster(a)server.risk.gg protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } ssl = required ssl_ca = </etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.chain.pem ssl_cert = </etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.key.pem ssl_key_path = /etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.key.pem syslog_facility = local6 userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib fts fts_sk push_notify sieve } protocol lda { mail_plugins = quota zlib fts fts_sk push_notify sieve } protocol imap { imap_id_log = * imap_id_send = "name" * "version" * mail_max_userip_connections = 50 mail_plugins = quota zlib fts fts_sk imap_quota imap_zlib imap_fts urlauth } protocol pop3 { mail_max_userip_connections = 6 } bash-3.2#

1 0

[Dovecot] login_log_format_elements does not appear to be changing log format 2.2.5
by Chris 26 Sep '13

26 Sep '13

Hi, login_log_format_elements does not seem to change the login logs. I have it set to the below setting and the word "home" does not even appear. Is there something I have to do to for this? Also I use ldap for authentication. [user@MB1 logs]$ doveconf -n | grep -i log debug_log_path = /home/user/apps/logs/dovecot_debug.log info_log_path = /home/user/apps/logs/dovecot_info.log log_path = /home/user/apps/logs/dovecot.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c home=%h service imap-login { chroot = login executable = imap-login type = login user = $default_login_user [user@MB1 dovecot]$ tail -1 ~/apps/logs/dovecot_info.log Sep 04 18:19:55 imap-login: Info: Login: user=<test2(a)domain.local>, method=PLAIN, rip=10.100.5.6, lip=10.100.5.103, mpid=6571 [user@MB1 dovecot]$ dovecot --version 2.2.5

3 2

[Dovecot] Lot of connections IMAP
by Davide 26 Sep '13

26 Sep '13

Hi to all, i have dovecot 2.2.5 when i digit doveadm who i see a lot of connections IMAP for single user liker the example below xxxxx.yyyyyy(a)mail.cgilfe.it 9 imap (20572 20614 19120 20653 19136 20655 19138 20661 20471) (192.168.x.xxx) Why so many IMAP? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

3 3

[Dovecot] Grant access for Unix-User _and_ virtual Users
by marco 26 Sep '13

26 Sep '13

Hi group, I have installed a postfix as an MTA and configured two "main" domains as well as two virtual mailbox domains. Normal unix users have their maildir in their homes (/home/%u) and the virtual mailboxes are located in /var/mail/vhosts. It works well, I only have a problem configuring dovecot. I wondered if it's possible to configure it in a way that both, unix users and virtual users, can access their mailboxes. I found some tutorials but they either give access to the "normal" unix users or to virtual users who are defined in a text file. Here some system infos: - Ubuntu 12.04.2 LTS (Kernel Version: 3.2.0-23) - Dovecot Version: 2.0.19 Hope you understand my problem. Cheers, Marco PS: It's the very first time I use a mailing list, so I hope you can forgive me possible beginner's mistakes.

2 2

[Dovecot] Dsync: Mailbox changes caused a desync.
by Aleksey Tsvetkov 26 Sep '13

26 Sep '13

Hi! Here such synchronization error: dovecot: dsync-local(alex(a)aaa.com): Warning: Mailbox changes caused a desync. You may want to run dsync again. dovecot: dsync-remote(alex(a)aaa.com): Warning: /var/mail/virtual/aaa.com/alex/.INBOX.System/dovecot-uidlist: Duplicate file entry at line 2298: 1380157263.M585262P25253.mail1.aaa.com,S=2476,W=2553 (uid 3645 -> 3662) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3650, file=1380157264.M261919P17392.mail2.aaa.com,S=2476,W=2553) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3651, file=1380157263.M586977P17315.mail2.aaa.com,S=3119,W=3175) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3652, file=1380157264.M261920P17392.mail2.aaa.com,S=2476,W=2553) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3653, file=1380157264.M261921P17392.mail2.aaa.com,S=3119,W=3175) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3654, file=1380157263.M819006P25260.mail2.aaa.com,S=2476,W=2553:2,) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3655, file=1380157264.M261922P17392.mail2.aaa.com,S=3119,W=3175:2,) As a result, synchronization was, but there were duplicate emails. After this synchronization is working fine, no more errors. dovecot --version 2.2.5 dovecot --build-options Build options: ioloop=kqueue notify=kqueue ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword pam passwd passwd-file sql Userdb: checkpassword nss passwd prefetch passwd-file sql Thanks! -- Best regards, Aleksey Tsvetkov System Administrator Company Grand Vision tel. +7(495)933-39-79, ext. 184

1 0

[Dovecot] Passing info from mail process to mail_filter plugin script?
by Charles Cazabon 25 Sep '13

25 Sep '13

Hi, all, The mail_filter plugin allows you to pass messages through an external script/command on the way into and out of the Maildir/mbox/etc mail store. With the recent/new version of the plugin, this seems to work correctly. However, my mail-filter script (for filtering messages on the way from the mail store through the IMAP process to a remote client) needs some extra info from the IMAP mail process. I'm having difficulty figuring out how this can be accomplished. Ideally, I'd like to pass another open file descriptor (opened in the IMAP process) to the script, but I'm not sure if this is possible. Opening the file in the IMAP main.c fails, presumably due to file descriptor limits, but I don't see where restrict_fd_limit() is called there. My second choice for passing this info would be in an environment variable or argument to the mail filter script. Adding env_put() to the IMAP code doesn't seem to get the value passed to the script, presumably because the environment is getting cleared, but again I'm not certain where the list of env vars to keep is set here. There may be another way to accomplish this that I'm not thinking of? Any assistance would be appreciated. Charles -- ----------------------------------------------------------------------- Charles Cazabon GPL'ed software available at: http://pyropus.ca/software/ -----------------------------------------------------------------------

2 5

[Dovecot] "service_count = 0" for "service dict" (High-performance mode)
by Alessio Cecchi 25 Sep '13

25 Sep '13

Hi, I'm running dovecot 2.1.17 with "Login processes" in "High-performance mode" as explained here: service imap-login { service_count = 1 http://wiki2.dovecot.org/LoginProcess but i thinks I should also set "service dict" in high-performance mode since sometimes the number of dict processes reach the limit of 100 (from default_process_limit=100) and I find these errors in the logs: Sep 25 15:32:24 imap(info@xxxx), session=<z9N2SDXnIQCy71XC>: Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Connection reset by peer Sep 25 15:32:24 imap(service@xxxx), session=<xKxSSDXnwABb/1Ql>: Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Connection reset by peer or Sep 25 15:33:48 imap(info@xxxx), session=<M8FITTXnwABb/CM9>: Warning: read(/usr/local/dovecot-2.1/var/run/dovecot/dict): dict lookup took 5 seconds Sep 25 15:33:48 imap(editoria@xxxx), session=<3LpHZTTnDgBdJwmm>: Warning: read(/usr/local/dovecot-2.1/var/run/dovecot/dict): dict lookup took 5 seconds Do you think will be better set: service dict { service_count = 0 or default_process_limit=200 (instead of 100) Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

2 1

[Dovecot] proxy: get rid of redundant log-informations
by Reindl Harald 25 Sep '13

25 Sep '13

Hi login_log_format_elements = user=<%u> method=%m rip=%r %k is it possible to get rid of the "proxy(test(a)testserver.rhsoft.net): started proxying to 127.0.0.1:143: " part because on a proxy-only server i know that and it is explicitly not listed in "login_log_format_elements" as well as for the "TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA" it would be enough "TLSv1 DHE-RSA-CAMELLIA256-SHA" the reason is simple: * all needed informations are present * smaller logfiles * nicer "tail -f" on the syslog without breaks _____________________________________________ Aug 14 16:31:46 testserver dovecot: imap-login: proxy(test(a)testserver.rhsoft.net): started proxying to 127.0.0.1:143: user=<test(a)testserver.rhsoft.net>, method=CRAM-MD5, rip=91.118.73.99, TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)

2 9