- dovecot - dovecot.org

[Dovecot] Dovecot extremely slow!
by Patricio Rojo 27 Sep '13

27 Sep '13

Please help, Dovecot is running extremely slow for the last couple of weeks and it seems to be getting worse (or my patience running short). I attach the 10-master configuration and the log file after running strace according to: http://wiki.dovecot.org/Debugging/ProcessTracing I can click on an email and wait for a minute or more before receiving a connection dropped or no error at all. I use many clients (thunderbird, windows 8 mail, maildroid for android, squirrelmail) and they all have similar behavior. It happens both in the inbox and on imap subfolders. Sometimes it helps changing subfolders back and forth. I have many imap folders organized in up to 3 levels of subfolders and use postfix for delivery. Let me know any other info you require. Thanks! Patricio

6 8

[Dovecot] Courier migration and vpopmail with dovecot-lda
by Charles Sprickman 27 Sep '13

27 Sep '13

I've been using Dovecot in some fresh installs lately and have found it fairly easy to configure. However I'm starting on a migration that involves moving from some very old software (ancient vpopmail, qmail and Courier). On the Courier front, I've reviewed the migration page in the wiki, and it looks like the main concerns are just matching the namespace and then using the migration script to create new subscription and uidlist files. Given that my Courier IMAP setup is so old (4.0.6), is there anything to be aware of that's not covered in the wiki due to the age of Courier here? Are there any other general issues to be aware of as far as interactions with MUAs are concerned? For example, if Courier has been presenting the user's MUA with a given set of IMAP capabilities and then the MUA sees a bunch of extra capabilities on a subsequent login, will that trigger any strange behavior? And lastly on this subject, I will obviously be doing some testing before cutting over to the other server. Is it valid in something like Thunderbird to have it pointed to "imap.domain.com" and then change the imap server to point to something like "testimap.domain.com" for testing whether subscriptions and the uidlists are working as expected or should I fully replicate the move as an end user would see it by making the change in my local hosts file? Now, assuming that portion of the move goes alright, I'm incredibly confused about getting Dovecot and Vpopmail working together. I assume that initially I can stick with the Maildir++ mailbox format and let vpopmail's vdelivermail continue working as my LDA - vdelivermail understands how to find the user's Maildir, it can check quotas, and it can update the maildirsize file (which I'm assuming dovecot can also read and then report quota/usage to an IMAP client). However it does look like the Dovecot-only mailbox format(s) will offer much better performance than Maildir as the two dbox formats are the only supported mailbox formats with separate index files, correct? Is there any guidance on how to use dovecot's LDA with a virtual mail system such as vpopmail? From what I've read so far, I probably don't want to use the vpopmail extension supplied with dovecot, but query the mysql vpopmail db directly. I'm finding a ton of info while searching for this, but most deals with older versions of dovecot, and there are also many "this works but I don't know why" tutorials on combining dovecot and vpopmail and dovecot's own LDA. I'm not even able to guess how one handles the per-user .qmail files in vpopmail if not using vdelivermail (this is where we enable/disable spam filtering by piping the message through spamc). Any input on the overall migration process is appreciated. It's a bit overwhelming as I have to deal with a big jump in the vpopmail version, rebuilding qmail with a ridiculous number of patches, and then on top of that a migration to new imap/pop server software. eek. Thanks, Charles -- Charles Sprickman NetEng/SysAdmin Bway.net - New York's Best Internet www.bway.net spork(a)bway.net - 212.982.9800

2 2

[Dovecot] sieve gone mad ---help
by Rob 26 Sep '13

26 Sep '13

managesieve has gone mad. One person went on holiday when he came back his out of office would not switch off, then it replicated it's self into two other users (the vacation noticE) and started to be sent out for them and those users had never set up an out of office or looted into round cube. even deleting the vacation notice did not stop it, but if we put another vacation notice in then the new one is sent out, if we disable the new one then the old one is sent out…. mad…. how can I refresh the whole thing and start again… ? I am running this on 10.8.4 mountain lion server and I can't stop sieve… I have looked in the /Library/Server/Mail/Data/rules/USERFOLDER and removed all sieve files I have looked in each users mailbox but no seve files there… I have restarted and still sieve will not stop sending out emails…. yesterday it went crazy sending a mail a second from one mailbox back to it's self…. help….. osx 10.8 server using latest roundcube with managesieve plugin.... bash-3.2# ps -aef|grep dovecot 0 27481 1 0 12:07am ?? 0:00.36 /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -F 214 27490 27481 0 12:07am ?? 0:00.58 dovecot/anvil [4 connections] 0 28237 27481 0 12:07am ?? 0:01.69 dovecot/log 0 28239 27481 0 12:07am ?? 0:00.20 dovecot/config 227 28309 27481 0 12:08am ?? 0:42.33 dovecot/imap-login [28 connections (28 TLS)] 214 28311 27481 0 12:08am ?? 0:08.65 dovecot/auth [0 wait, 0 passdb, 0 userdb] 214 40746 27481 0 6:54am ?? 0:06.33 dovecot/imap [3 connections] 214 40747 27481 0 6:54am ?? 0:01.89 dovecot/imap [reply 192.168.5.134 IDLE] 214 45378 27481 0 8:36am ?? 0:01.73 dovecot/imap [3 connections] 214 46125 27481 0 9:03am ?? 0:00.75 dovecot/imap [2 connections] 214 46127 27481 0 9:03am ?? 0:01.84 dovecot/imap [3 connections] 214 47385 27481 0 9:35am ?? 0:01.29 dovecot/imap [3 connections] 214 56274 27481 0 1:15pm ?? 0:00.25 dovecot/imap [3 connections] 214 56275 27481 0 1:15pm ?? 0:00.36 dovecot/imap [5 connections] 214 56276 27481 0 1:15pm ?? 0:00.45 dovecot/imap [4 connections] 214 56367 27481 0 1:18pm ?? 0:00.10 dovecot/imap [liam 192.168.5.130 IDLE] 0 62854 9637 0 4:37pm ttys000 0:00.00 grep dovecot bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -n # 2.0.19apple1: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 12.4.0 x86_64 hfs aps_topic = com.apple.mail.XServer.68f48c72-274a-48f9-beed-71096afe3fa6 auth_mechanisms = cram-md5 x-plain-submit plain login apop gssapi digest-md5 auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 mail_access_groups = mail mail_location = maildir:/Library/Server/Mail/Data/mail/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file pass = yes submit = yes } passdb { driver = od } plugin { fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/roundcube.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u } postmaster_address = postmaster(a)server.risk.gg protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } ssl = required ssl_ca = </etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.chain.pem ssl_cert = </etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.key.pem ssl_key_path = /etc/certificates/server.risk.gg.B61EB46F8A86687EAD8CF9B3C24CBF09CF45E178.key.pem syslog_facility = local6 userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib fts fts_sk push_notify sieve } protocol lda { mail_plugins = quota zlib fts fts_sk push_notify sieve } protocol imap { imap_id_log = * imap_id_send = "name" * "version" * mail_max_userip_connections = 50 mail_plugins = quota zlib fts fts_sk imap_quota imap_zlib imap_fts urlauth } protocol pop3 { mail_max_userip_connections = 6 } bash-3.2#

1 0

[Dovecot] login_log_format_elements does not appear to be changing log format 2.2.5
by Chris 26 Sep '13

26 Sep '13

Hi, login_log_format_elements does not seem to change the login logs. I have it set to the below setting and the word "home" does not even appear. Is there something I have to do to for this? Also I use ldap for authentication. [user@MB1 logs]$ doveconf -n | grep -i log debug_log_path = /home/user/apps/logs/dovecot_debug.log info_log_path = /home/user/apps/logs/dovecot_info.log log_path = /home/user/apps/logs/dovecot.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c home=%h service imap-login { chroot = login executable = imap-login type = login user = $default_login_user [user@MB1 dovecot]$ tail -1 ~/apps/logs/dovecot_info.log Sep 04 18:19:55 imap-login: Info: Login: user=<test2(a)domain.local>, method=PLAIN, rip=10.100.5.6, lip=10.100.5.103, mpid=6571 [user@MB1 dovecot]$ dovecot --version 2.2.5

3 2

[Dovecot] Lot of connections IMAP
by Davide 26 Sep '13

26 Sep '13

Hi to all, i have dovecot 2.2.5 when i digit doveadm who i see a lot of connections IMAP for single user liker the example below xxxxx.yyyyyy(a)mail.cgilfe.it 9 imap (20572 20614 19120 20653 19136 20655 19138 20661 20471) (192.168.x.xxx) Why so many IMAP? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

3 3

[Dovecot] Grant access for Unix-User _and_ virtual Users
by marco 26 Sep '13

26 Sep '13

Hi group, I have installed a postfix as an MTA and configured two "main" domains as well as two virtual mailbox domains. Normal unix users have their maildir in their homes (/home/%u) and the virtual mailboxes are located in /var/mail/vhosts. It works well, I only have a problem configuring dovecot. I wondered if it's possible to configure it in a way that both, unix users and virtual users, can access their mailboxes. I found some tutorials but they either give access to the "normal" unix users or to virtual users who are defined in a text file. Here some system infos: - Ubuntu 12.04.2 LTS (Kernel Version: 3.2.0-23) - Dovecot Version: 2.0.19 Hope you understand my problem. Cheers, Marco PS: It's the very first time I use a mailing list, so I hope you can forgive me possible beginner's mistakes.

2 2

[Dovecot] Dsync: Mailbox changes caused a desync.
by Aleksey Tsvetkov 26 Sep '13

26 Sep '13

Hi! Here such synchronization error: dovecot: dsync-local(alex(a)aaa.com): Warning: Mailbox changes caused a desync. You may want to run dsync again. dovecot: dsync-remote(alex(a)aaa.com): Warning: /var/mail/virtual/aaa.com/alex/.INBOX.System/dovecot-uidlist: Duplicate file entry at line 2298: 1380157263.M585262P25253.mail1.aaa.com,S=2476,W=2553 (uid 3645 -> 3662) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3650, file=1380157264.M261919P17392.mail2.aaa.com,S=2476,W=2553) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3651, file=1380157263.M586977P17315.mail2.aaa.com,S=3119,W=3175) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3652, file=1380157264.M261920P17392.mail2.aaa.com,S=2476,W=2553) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3653, file=1380157264.M261921P17392.mail2.aaa.com,S=3119,W=3175) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3654, file=1380157263.M819006P25260.mail2.aaa.com,S=2476,W=2553:2,) dovecot: dsync-remote(alex(a)aaa.com): Warning: Maildir /var/mail/virtual/aaa.com/alex/.INBOX.System: Expunged message reappeared, giving a new UID (old uid=3655, file=1380157264.M261922P17392.mail2.aaa.com,S=3119,W=3175:2,) As a result, synchronization was, but there were duplicate emails. After this synchronization is working fine, no more errors. dovecot --version 2.2.5 dovecot --build-options Build options: ioloop=kqueue notify=kqueue ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword pam passwd passwd-file sql Userdb: checkpassword nss passwd prefetch passwd-file sql Thanks! -- Best regards, Aleksey Tsvetkov System Administrator Company Grand Vision tel. +7(495)933-39-79, ext. 184

1 0

[Dovecot] Passing info from mail process to mail_filter plugin script?
by Charles Cazabon 26 Sep '13

26 Sep '13

Hi, all, The mail_filter plugin allows you to pass messages through an external script/command on the way into and out of the Maildir/mbox/etc mail store. With the recent/new version of the plugin, this seems to work correctly. However, my mail-filter script (for filtering messages on the way from the mail store through the IMAP process to a remote client) needs some extra info from the IMAP mail process. I'm having difficulty figuring out how this can be accomplished. Ideally, I'd like to pass another open file descriptor (opened in the IMAP process) to the script, but I'm not sure if this is possible. Opening the file in the IMAP main.c fails, presumably due to file descriptor limits, but I don't see where restrict_fd_limit() is called there. My second choice for passing this info would be in an environment variable or argument to the mail filter script. Adding env_put() to the IMAP code doesn't seem to get the value passed to the script, presumably because the environment is getting cleared, but again I'm not certain where the list of env vars to keep is set here. There may be another way to accomplish this that I'm not thinking of? Any assistance would be appreciated. Charles -- ----------------------------------------------------------------------- Charles Cazabon GPL'ed software available at: http://pyropus.ca/software/ -----------------------------------------------------------------------

2 5

[Dovecot] "service_count = 0" for "service dict" (High-performance mode)
by Alessio Cecchi 25 Sep '13

25 Sep '13

Hi, I'm running dovecot 2.1.17 with "Login processes" in "High-performance mode" as explained here: service imap-login { service_count = 1 http://wiki2.dovecot.org/LoginProcess but i thinks I should also set "service dict" in high-performance mode since sometimes the number of dict processes reach the limit of 100 (from default_process_limit=100) and I find these errors in the logs: Sep 25 15:32:24 imap(info@xxxx), session=<z9N2SDXnIQCy71XC>: Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Connection reset by peer Sep 25 15:32:24 imap(service@xxxx), session=<xKxSSDXnwABb/1Ql>: Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Connection reset by peer or Sep 25 15:33:48 imap(info@xxxx), session=<M8FITTXnwABb/CM9>: Warning: read(/usr/local/dovecot-2.1/var/run/dovecot/dict): dict lookup took 5 seconds Sep 25 15:33:48 imap(editoria@xxxx), session=<3LpHZTTnDgBdJwmm>: Warning: read(/usr/local/dovecot-2.1/var/run/dovecot/dict): dict lookup took 5 seconds Do you think will be better set: service dict { service_count = 0 or default_process_limit=200 (instead of 100) Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

2 1

[Dovecot] proxy: get rid of redundant log-informations
by Reindl Harald 25 Sep '13

25 Sep '13

Hi login_log_format_elements = user=<%u> method=%m rip=%r %k is it possible to get rid of the "proxy(test(a)testserver.rhsoft.net): started proxying to 127.0.0.1:143: " part because on a proxy-only server i know that and it is explicitly not listed in "login_log_format_elements" as well as for the "TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA" it would be enough "TLSv1 DHE-RSA-CAMELLIA256-SHA" the reason is simple: * all needed informations are present * smaller logfiles * nicer "tail -f" on the syslog without breaks _____________________________________________ Aug 14 16:31:46 testserver dovecot: imap-login: proxy(test(a)testserver.rhsoft.net): started proxying to 127.0.0.1:143: user=<test(a)testserver.rhsoft.net>, method=CRAM-MD5, rip=91.118.73.99, TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)

2 9

[Dovecot] unable to lock for exclusive access: Resource temporarily unavailable
by Nikos Papadopoulos 25 Sep '13

25 Sep '13

Dears, We have a mail server (RHEL 6.0, Postfix and Dovecot 1.0.7). The output of dovecot -n is the following: # 1.0.7: /etc/dovecot.conf protocols: pop3 login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/pop3-login mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable: /usr/libexec/dovecot/pop3 mail_plugin_dir: /usr/lib/dovecot/pop3 pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam userdb: driver: passwd During the last days we face the following problem: There is great delay in the delivery of the emails. Some seem to not be delivered at all. Issuing the mailq command we get the following message for almost all the email accounts: (cannot update mailbox /var/mail/xyz for user xyz. unable to lock for exclusive access: Resource temporarily unavailable) Please send to me any suggestions, because I cannot resolve it and I receive a lot of pressure. Best Regards, Nikos

4 3

[Dovecot] (no subject)
by Greg Ryman 25 Sep '13

25 Sep '13

Hello, I've been out of the sysadmin game for some time and I've recently setup a mail server. Everything is working except for the quota, which I believe is likely an error in how I'm using my SQL queries. Any guidance, pointers, or advice would be greatly appreciated. root@mail:/etc/dovecot/conf.d# dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab079.6 x86_64 Ubuntu 12.04.3 LTS reiserfs auth_mechanisms = plain login dict { sqldomainquota = mysql:/etc/dovecot/dovecot-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } first_valid_uid = 150 last_valid_uid = 150 mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_allow_append_to_spam = YES antispam_backend = dspam antispam_dspam_args = --user;%u;--deliver=;--source=error antispam_dspam_binary = /usr/bin/dspam antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam;Junk antispam_trash = trash;Trash autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autocreate5 = Archive quota = dict:User Quota::proxy::sqluserquota quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_after = /etc/sieve/conf.d/after sieve_before = /etc/sieve/conf.d/before sieve_dir = ~/sieve } postmaster_address = admin(a)gryman.com protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve autocreate quota" } protocol lda { mail_plugins = sieve quota } protocol imap { mail_plugins = quota antispam autocreate quota imap_quota } root@mail:/etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = mysql connect = host=localhost dbname=mail user=mail password=mailpassword default_pass_scheme = MD5-CRYPT password_query = \ SELECT username as user, password, '/var/vmail/%d/%n' as userdb_home, \ 'maildir:/var/vmail/%d/%n' as userdb_mail, 150 as userdb_uid, 8 as userdb_gid \ FROM mailbox WHERE username = '%u' AND active = '1' user_query = \ SELECT '/var/vmail/%d/%n' as home, 'maildir:/var/vmail/%d/%n' as mail, \ 150 AS uid, 8 AS gid, concat('dirsize:storage=', quota) AS quota \ FROM mailbox WHERE username = '%u' AND active = '1' root@mail:/etc/dovecot# tail -n 8 /etc/postfix/master.cf # DSPAM dspam unix - n n - 10 pipe flags=Ru user=dspam argv=/usr/bin/dspam --deliver=innocent,spam --user $recipient -i -f $sender -- $recipient # Integration with Dovecot - hand mail over to it for local delivery, and # run the process under the vmail user and mail group. dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/dovecot-lda -d $(recipient) -- Greg Ryman

6 9

[Dovecot] 2048-bit Diffie-Hellman parameters
by Marios Titas 25 Sep '13

25 Sep '13

Currently, dovecot generates two primes for Diffie-Hellman key exchanges: a 512-bit one and a 1024-bit one. In light of recent events, I think it would be wise to add support for 2048-bit primes as well, or even better, add a configuration option that lets the user select a file (or files) containing the DH parameters In recent years, there has been increased interest in DH especially in its ephemeral version (DHE) because it provides perfect forward secrecy. In that context, the use of 1024-bit parameters might not seem such a terrible idea: if someone cracks the ephemeral key then they will only gain access to the data exchanged during that particular session. Therefore, it might not be worth the effort to crack such a key. But this is certainly not the case for IMAPS: it is quite likely that the session data will include the user's credentials.

9 11

[Dovecot] Delete to Archive?
by James E. Pace 25 Sep '13

25 Sep '13

Hi, I recently switched from being a Gmail user to running Dovecot [2.1.10] on my server. Thank you for an easy to use piece of software that solves problems! I am trying (unsuccessfully) to replicate something from GMail. When I delete a message on my iPhone (or other client), I would like to have it moved to an "All Mail" or Archive folder, instead of actually deleting it. Is this possible? Thanks, James

5 7

[Dovecot] Apple IOS 7 Mail APP uses multi body searches by default
by Urban Loesch 25 Sep '13

25 Sep '13

Hi, today we found this blogpost: http://blog.fastmail.fm/2013/09/17/ios-7-mail-app-uses-multi-folder-body-se… Have you any idea if this could impact performance of dovecot using mdbox format with 10MB per file size and zlib enabled? Thanks and regards Urban Loesch

2 1

[Dovecot] still having dsync issues after upgrading to latest
by Matthew Kaufman 25 Sep '13

25 Sep '13

Trying to migrate a bunch of users with mbox format to maildir format. dsync creates some directories, but otherwise does nothing. (Complained about the lack of "/" as separator until I added that to config, now is silent when running dsync except with the -D flag) I have tried dumping all the dovecot that came with my OS and built the latest sources, hoping I'd at least get a little better debug information out... but no luck. Lots of hopefully useful output below. What am I doing wrong? Matthew Kaufman # dovecot -n # 2.2.5: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 ext4 auth_mechanisms = plain login first_valid_uid = 4999 mail_gid = 5000 mail_location = maildir:/var/mail/%d/%n mail_privileged_group = mail mail_uid = 5000 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_allow_append_to_spam = YES antispam_backend = dspam antispam_dspam_args = --user;%u;--deliver=;--source=error antispam_dspam_binary = /usr/bin/dspam antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam;Junk antispam_trash = trash;Trash sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)eeph.com protocols = imap lmtp service auth-worker { user = mail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = mail } user = dovecot } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } user = mail } service pop3-login { inet_listener pop3 { port = 0 } } ssl_cert = </etc/ssl/local/....crt ssl_key = </etc/ssl/local/....key userdb { args = uid=5000 gid=5000 home=/var/mail/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol imap { mail_plugins = " antispam" } # rm -r /var/mail/matthew.at # /usr/local/bin/dsync -D -u matthew(a)matthew.at mirror mbox:./Mail:INBOX=./matthew doveadm(root): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(matthew(a)matthew.at): Debug: Effective uid=5000, gid=5000, home=/var/mail/matthew.at/matthew doveadm(matthew(a)matthew.at): Debug: Home dir not found: /var/mail/matthew.at/matthew doveadm(matthew(a)matthew.at): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/matthew.at/matthew doveadm(matthew(a)matthew.at): Debug: maildir++: root=/var/mail/matthew.at/matthew, index=, indexpvt=, control=, inbox=/var/mail/matthew.at/matthew, alt= doveadm(matthew(a)matthew.at): Debug: Namespace : /var/mail/matthew.at/matthew doesn't exist yet, using default permissions doveadm(matthew(a)matthew.at): Debug: Namespace : Using permissions from /var/mail/matthew.at/matthew: mode=0700 gid=default dsync(matthew(a)matthew.at): Debug: Effective uid=5000, gid=5000, home=/var/mail/matthew.at/matthew dsync(matthew(a)matthew.at): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:./Mail:INBOX=./matthew dsync(matthew(a)matthew.at): Debug: fs: root=./Mail, index=, indexpvt=, control=, inbox=./matthew, alt= dsync(matthew(a)matthew.at): Debug: Namespace : ./Mail doesn't exist yet, using default permissions dsync(matthew(a)matthew.at): Debug: Namespace : Using permissions from ./Mail: mode=0700 gid=default dsync(matthew(a)matthew.at): Debug: brain M: in state=master_recv_handshake dsync(matthew(a)matthew.at): Debug: brain M: out state=send_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain S: out state=send_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=send_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain M: out state=send_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=send_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain S: out state=send_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=send_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain M: out state=recv_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=send_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain S: out state=recv_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=recv_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain M: out state=recv_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=recv_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain S: out state=recv_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=recv_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain M: out state=master_send_mailbox changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=recv_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain S: out state=slave_recv_mailbox changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=master_send_mailbox dsync(matthew(a)matthew.at): Debug: brain M: out state=done changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=slave_recv_mailbox dsync(matthew(a)matthew.at): Debug: brain S: out state=done changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=done dsync(matthew(a)matthew.at): Debug: brain M: out state=done changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=done dsync(matthew(a)matthew.at): Debug: brain S: out state=done changed=1 # # ls -l /var/mail/matthew.at total 4 drwx--S--- 3 vmail vmail 4096 Sep 24 17:50 matthew # ls -l /var/mail/matthew.at/matthew total 4 drwx--S--- 2 vmail vmail 4096 Sep 24 17:50 Mail # ls -l /var/mail/matthew.at/matthew/Mail total 0

2 2

[Dovecot] imaptest-20130617 seems to be reporting spurious header changes
by Mark Weaver 25 Sep '13

25 Sep '13

I'm trying to use this to test an IMAP server I'm developing (I picked the nightly up from the link on the wiki page at http://www.imapwiki.org/ImapTest/Installation) With one client using the mailbox dovecot-crlf (http://www.dovecot.org/tmp/dovecot-crlf) I get messages like: Error: test(a)npsl.co.uk[67]: 1035253882.5041.34.camel@hurina: Header From changed 'Timo Sirainen <tss(a)iki.fi> Timo Sirainen <tss(a)iki.fi' (len 52) -> 'Timo Sirainen <tss(a)iki.fi>' (len 26): * 1 FETCH (UID 2093 FLAGS () BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 913 0) BODY[HEADER.FIELDS (From From Delivered-To) ] "From: Timo Sirainen <tss(a)iki.fi> From: Timo Sirainen <tss(a)iki.fi> Delivered-To: dovecot(a)procontrol.fi " ENVELOPE ("22 Oct 2002 05:31:22 +0300" "[dovecot] Re: Architectural questions" (("Timo Sirainen" NIL "tss" "iki.fi")) (("" NIL "dovecot-bounce" "procontrol.fi")) (("Timo Sirainen" NIL "tss" "iki.fi")) (("" NIL "dovecot" "procontrol.fi")) NIL NIL "<1035249894.5044.28.camel@hurina>" "<1035253882.5041.34.camel@hurina>") BODY[HEADER.FIELDS (Cc Cc From) ] "From: Timo Sirainen <tss(a)iki.fi> ") (I added the dump of the string length by modifying the code). As I am reading it the test program has got the wrong string rather than the server -- the From header in the mbox file is From: Timo Sirainen <tss(a)iki.fi> which is 26 characters long, not 52, and includes the closing angle bracket, and the code that prints the header out is in src/mailbox-state.c, line 377: client_state_error(client, "%s: Header %s changed '%.*s' (len %d) -> '%.*\ s' (len %d)", msg->message_id, fetch_headers[i].name, (int)orig_headers[j].value_len, (const char *)orig_headers[j].value, (int)orig_headers[j].value_len, (int)fetch_headers[i].value_len, (const char *)fetch_headers[i].value, (int)fetch_headers[i].value_len); Have I read this upside down or is there an issue with the tests? If it is an issue with the tests, any pointers as to where to start looking for the issue would be helpful. Thanks, Mark

2 1

Re: [Dovecot] Problem getting a dovecot proxy to connect to another dovecot machine via STARTTLS
by Arnoud van Heuvelen 24 Sep '13

24 Sep '13

I've solved the issue by setting ssl to 'any-cert' and starttls to NULL. This does a proper SSL request to the node. I still don't understand why Dovecot does a non-SSL request on an SSL port whenever I enable starttls, but I'm happy using normal SSL. Regards,

1 0

Re: [Dovecot] Bug report: "doveadm rename" encodes special characters wrongly in mUTF-7 (in fs)
by megodin＠inboxalias.com 24 Sep '13

24 Sep '13

> If doveadm says it's invalid UTF-8, it's invalid UTF-8. I guess your > terminal isn't actually using UTF-8 then, but something else. ("locale" > output should say something about UTF-8.) I guess doveadm could also > automatically translate parameters to UTF-8, but that's a bit annoying > to implement. You were absolutely right. After thorough testing I could make up the problem to the SSH-Client PuTTY I was using on a Windows machine while testing. The default "remote character setting" is "ISO-8859-1:1998 (Latin-1, West Europe)", when re-setting to "UTF-8", opening a new shell and testing the "doveadm mailbox rename ..." with german umlauts just works fine then. (Just for the sake of completeness, the "locale" settings were set to (LANG=de_DE.utf-8) globally in /etc/sysconfig/i18n per default.) > The problem here is that * is expanded by your shell, not doveadm. > And it expands into Tr&-AOQ-sh as it's in the filesystem, but that's > only the mUTF-7 encoding of it. The UTF-8 version of the name is > Tr&AOQ-sh. So doveadm only sees that you attempted to resync a > nonexistent mailbox. Using '*' with quotes would work, since doveadm > would do the expansion then. Thanks for pointing that * / '*' issue out. I now unterstand that the "doevadm mailbox rename" converts the input to UTF _before_ applying it in the filesystem. Now it makes sense that doveadm mailbox rename -u user 'Trash' 'Tr&AOQ-sh' must be expanded to Tr&-AOQ-sh. The "-" character directly after the "&"in Tr&-AOQ-sh comes from a special mUTF-Specification (as stated in RFC 3501, section 5.1.3): "In modified UTF-7, printable US-ASCII characters, except for "&", represent themselves; that is, characters with octet values 0x20-0x25 and 0x27-0x7e. The character "&" (0x26) is represented by the two-octet sequence "&-"." So e.g. if I wanted a german umlaut to be encoded in the filesystem, I must enter it directly into dovedm instead of the UTF encoded value. One small point left... > The UTF-8 version of the name is Tr&AOQ-sh Just for understanding - "Tr&AOQ-sh" is IMHO UTF-7, not UTF-8. Accordingly to what stated before, "Tr&-AOQ-sh" and "Tr&AOQ-sh" are encoded both the same (UTF-7), the first seen in clients as "Tr&AOQ-sh" and the second as "TrÃ¤sh". Thanks for all your help! Megodin --- Alle PostfÃ¤cher an einem Ort. Jetzt wechseln und E-Mail-Adresse mitnehmen! http://email.freenet.de/basic/Informationen _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com

1 0

[Dovecot] Linux SO_REUSEPORT
by Timo Sirainen 24 Sep '13

24 Sep '13

I just read about Linux v3.9's SO_REUSEPORT feature and decided to implement it for Dovecot. Would be interesting to know how it works for people :) It's going to be in v2.2.6, which I'm planning on releasing tomorrow. Note especially the warning about the bug: http://hg.dovecot.org/dovecot-2.2/rev/a991a0547daa So the idea is that you'd do something like: service imap-login { inet_listener imap { reuse_port = yes } process_min_avail = 4 # number of CPU cores } And the load should be distributed more evenly to the processes.

4 4

[Dovecot] Fwd: lmtp
by Lampa 24 Sep '13

24 Sep '13

Hello, using dovecot with postfix with mysql. Some domains have alias. Local delivery is realized over lmtp. When lmtp delivery to aliased domains, it takes bad mail_location - it takes aliased instead real domain, so lmtp is creating domain and user directory. Lmtp doesn't make sql lookup. I need lmtp delivery to real domain and i don't want to create symlinks. mail_location = maildir:/home/mail/%d/%n/Maildir real domain: domain1.com aliased domain: domain2.com rcpt: user(a)domain2.com lmtp deliver message to /home/mail/domain2.com/user/Maildir instead /home/mail/domain1.com/user/Maildir -- Lampa

3 9

[Dovecot] Permission error
by Koenraad Lelong 24 Sep '13

24 Sep '13

Hi, I'm migrating an existing dovecot (1. series) to new hardware. The new dovecot is a 2. series. I copied the old config and did a doveconf -n -c /etc/dovecot/dovecot.conf > dovecot-2.conf Then I moved the dovecot-2.conf to dovecot.conf and restarted dovecot. When Postfix tries to deliver a message I get this error : 2013-09-16 11:00:10 auth: Fatal: net_connect_unix(auth-worker) in directory /run/dovecot failed: Permission denied (euid=65534(nobody) egid=65534(nogroup) missing +r perm: /run/dovecot/auth-worker, dir owned by 0:0 mode=0755) 2013-09-16 11:00:10 master: Error: service(auth): command startup failed, throttling I tried different things with /run/dovecot/auth-worker, but the error remains. I tried to chmod 777 the socket, I chown-ed to dovecot:dovecot, vmail:vmail. What am I missing ? AFAIK the sql-tables are OK. Thanks. doveconf -n is this : # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-39-generic x86_64 Ubuntu 12.04.3 LTS auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 499 info_log_path = /var/log/dovecot.debug last_valid_uid = 499 log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_location = maildir:/var/vmail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = nobody } service imap-login { executable = /usr/lib/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } } service imap { executable = /usr/lib/dovecot/imap } service pop3-login { executable = /usr/lib/dovecot/pop3-login inet_listener pop3 { address = * port = 110 } } service pop3 { executable = /usr/lib/dovecot/pop3 } ssl_ca = </etc/postfix/certificate/cacert.org.pem ssl_cert = </etc/postfix/certificate/mailbox.pem ssl_key = </etc/postfix/certificate/mailboxkey.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_ssl = yes protocol imap { imap_max_line_length = 64 k } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol sieve { managesieve_logout_format = bytes ( in=%i : out=%o ) } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-err.log mail_plugins = sieve postmaster_address = some-one(a)ace-electronics.be sendmail_path = /usr/lib/sendmail }

2 4

[Dovecot] doveadm mailbox create error codes
by Micah Anderson 24 Sep '13

24 Sep '13

Hello, I'm trying to find out what the different 'doveadm mailbox create' error codes are. I've been looking through the source, but I can't seem to find them. I did determine that '65' happens when "Error: Can't create mailbox x: Mailbox already exists", but I've also received error 67, and the more mysterious error code 16640. Thanks for any pointers! micah

2 1

Re: [Dovecot] Bug report: "doveadm rename" encodes special characters wrongly in mUTF-7 (in fs)
by megodin＠inboxalias.com 24 Sep '13

24 Sep '13

Hi there Timo, first of all thank you for taking your time for support! > Forget about mUTF-7 with Dovecot. It's an IMAP-protocol relic, and > Dovecot is trying to get rid of it in as many places as possible. > Although by default the filesystem users mUTF-7, but that can also > be changed with a setting. Thanks for clarifying this. > I suspect your shell is breaking the 8bit chars into invalid UTF-8. I > just tried and it works fine with me. Sorry, we got confusion here... apparently my (lousy) freemail provider which I use to post on this mailinglist doesn't send some special characters etc. unaltered exactly as I typed - so I made a console screenshot of the doveadm rename problem to make things clear. Please have a look here, it will reveal the doveadm rename problem (and that my shell is working fine): http://i.imgur.com/08wKji4.png > > To get things worse, when renaming the mailfolder in Thunderbird to > > "geschÃÂ¤ftliches" it gets correctly written in the filesystem as > > "gesch&AOQ-ftliches"- but afterwards it's NOT found anymore in the > > dovecot index, e.g. when trying doveadm force-resync -u user it is > > not listed anymore (untilback-renaming in fs to the name it was > > indexed before). > Folders aren't indexed by default (mailbox_list_index=no) and > force-resync doesn't affect them. Are you saying > "doveadm mailbox list -u user" doesn't show some folder? I'm not > aware of any bugs related to this. No, the "doveadm mailbox list -u user" works just fine. BUT - I'm still wondering about the resync issue - As I understand the "doveadm force-resync -u user *" command rebuilds the index for the MAILS within the mailfolders? If so, how can the resync be done if the mailfolder itself is not found by doveadm anymore? > I'd need to get some more specifics. Show show exists in filesystems > and what commands don't produce expected results (and what they > produce instead). For clearing up my point, I made another console screenshot with red markings to point out the problem (bug). Please have another look here: http://i.imgur.com/icPfys9.png Thanks for your support, Megodin --- Alle PostfÃ¤cher an einem Ort. Jetzt wechseln und E-Mail-Adresse mitnehmen! http://email.freenet.de/basic/Informationen _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com

2 1

[Dovecot] can't dovecot tls/ssl to openldap
by 牧原 24 Sep '13

24 Sep '13

Hi, I want to dovecot connect to openldap with ssl/tls, and got error. When without tls/ssl, it works ok. from /var/log/maillog got: Sep 24 05:38:03 mail dovecot: auth: Error: LDAP: ldap_start_tls_s() failed: Connect error Sep 24 05:38:03 mail dovecot: auth: Error: LDAP: ldap_start_tls_s() failed: Can't contact LDAP server Sep 24 05:38:03 mail dovecot: auth: Error: LDAP: ldap_start_tls_s() failed: Can't contact LDAP server Sep 24 05:38:05 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts in 2 secs): user=<muyuan>, method=PLAIN, rip=192.168.100.99, lip=10.10.120.20, TLS: Disconnected, session=<wSvD1RPnWwDAqGRj> Sep 24 05:38:11 mail dovecot: auth: Error: LDAP: ldap_start_tls_s() failed: Can't contact LDAP server Sep 24 05:38:13 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts in 6 secs): user=<muyuan>, method=PLAIN, rip=192.168.100.99, lip=10.10.120.20, TLS: Disconnected, session=<2T761RPnXADAqGRj> But when I use ldapsearch, it seems also ok I use this from dovecot host ldapsearch -D "cn=dovecot,ou=bindusers,dc=smuy,dc=net" -W -H ldap://ldap.sv. hm -b "ou=accounts,dc=smuy,dc=net" �CZZ it works ok So I have no idea where to check? Or how can I got more detailed log from dovecot for that connection Sep 24 05:38:03 mail dovecot: auth: Error: LDAP: ldap_start_tls_s() failed: Connect error Because I use ldapsearch both tls/ssl works well, why dovecot connect error? What��s the detail happen in this connection? Here is my dovecot-ldap.conf.ext: # This file is commonly accessed via passdb {} or userdb {} section in # conf.d/auth-ldap.conf.ext # Space separated list of LDAP hosts to use. host:port is allowed too. #hosts = ldap.sv.hm #uris = ldaps://ldap.sv.hm:636/ uris = ldap://ldap.sv.hm:389/ dn = cn=dovecot,ou=bindusers,dc=smuy,dc=net dnpass = 1qaz2wsx #sasl_bind = no #sasl_mech = #sasl_realm = #sasl_authz_id = # Use TLS to connect to the LDAP server. tls = yes #tls = no tls_ca_cert_file = /etc/ssl/certs/ca/signing-ca.crt tls_ca_cert_dir = /etc/ssl/certs/ca #tls_cipher_suite = # TLS cert/key is used only if LDAP server requires a client certificate. #tls_cert_file = /etc/ssl/certs/mail.crt #tls_key_file = /etc/ssl/private/mail.key # Valid values: never, hard, demand, allow, try #tls_require_cert = never See some suggestions! Great thanks! muyuan

1 0

[Dovecot] dovecot 2.2.5 with plugin listescape and shared mailbox with dot in INBOX
by romain 23 Sep '13

23 Sep '13

Hi list, I have a problem with dovecot 2.2.5 and nightly (latest 20130923) with : * plugin listescape enabled * shared mailbox * and mail_shared_explicit_inbox = no Problem is I can't get list of mails in INBOX of my shared users. For example : ---------------------------------------------------------- 2013-09-23 22:20:06 imap-login: Info: Login: user=<roms>, method=PLAIN, rip=192.168.0.203, lip=192.168.20.200, mpid=6127, TLS, session=<R8D9vhLn3ADAqADL> 2013-09-23 22:20:06 imap: Debug: Loading modules from directory: /usr/local/lib/dovecot 2013-09-23 22:20:06 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so 2013-09-23 22:20:06 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so 2013-09-23 22:20:06 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib20_autocreate_plugin.so 2013-09-23 22:20:06 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib20_listescape_plugin.so 2013-09-23 22:20:06 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib20_zlib_plugin.so 2013-09-23 22:20:06 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib30_imap_zlib_plugin.so 2013-09-23 22:20:06 imap: Debug: Added userdb setting: plugin/acl_groups=Exchange Services,Exchange Domain Servers,Propriétaires créateurs de la stratégie de groupe,Administrateurs du schéma,Admins du domaine,Administrateurs de l'entreprise,Administrators,Users,roms 2013-09-23 22:20:06 imap(roms): Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead 2013-09-23 22:20:06 imap(roms): Debug: Effective uid=471, gid=471, home=/home/dovecot/dovecot//mail/roms 2013-09-23 22:20:06 imap(roms): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/dovecot/dovecot//mail/roms/Maildir 2013-09-23 22:20:06 imap(roms): Debug: maildir++: root=/home/dovecot/dovecot//mail/roms/Maildir, index=, indexpvt=, control=, inbox=/home/dovecot/dovecot//mail/roms/Maildir, alt= 2013-09-23 22:20:06 imap(roms): Debug: acl: initializing backend with data: vfile 2013-09-23 22:20:06 imap(roms): Debug: acl: acl username = roms 2013-09-23 22:20:06 imap(roms): Debug: acl: owner = 1 2013-09-23 22:20:06 imap(roms): Debug: acl vfile: Global ACL directory: (none) 2013-09-23 22:20:06 imap(roms): Debug: Namespace : type=shared, prefix=Other Users/%u/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:%h/Maildir:INDEX=~/Other Users/%u 2013-09-23 22:20:06 imap(roms): Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= 2013-09-23 22:20:06 imap(roms): Debug: acl: initializing backend with data: vfile 2013-09-23 22:20:06 imap(roms): Debug: acl: acl username = roms 2013-09-23 22:20:06 imap(roms): Debug: acl: owner = 0 2013-09-23 22:20:06 imap(roms): Debug: acl vfile: Global ACL directory: (none) 2013-09-23 22:20:06 imap(roms): Debug: Namespace : type=public, prefix=Shared Folders/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/dovecot/dovecot//public:INDEX=~//public 2013-09-23 22:20:06 imap(roms): Debug: maildir++: root=/home/dovecot/dovecot//public, index=/home/dovecot/dovecot//mail/roms//public, indexpvt=, control=, inbox=, alt= 2013-09-23 22:20:06 imap(roms): Debug: acl: initializing backend with data: vfile 2013-09-23 22:20:06 imap(roms): Debug: acl: acl username = roms 2013-09-23 22:20:06 imap(roms): Debug: acl: owner = 0 2013-09-23 22:20:06 imap(roms): Debug: acl vfile: Global ACL directory: (none) 2013-09-23 22:20:07 imap(roms): Debug: auth input: l.dupont system_groups_user=l.dupont uid=471 gid=471 home=/home/dovecot/dovecot//mail/l.dupont 2013-09-23 22:20:07 imap(roms): Debug: maildir++: root=/home/dovecot/dovecot//mail/l.dupont/Maildir, index=/home/dovecot/dovecot//mail/l.dupont/Other Users/l.dupont, indexpvt=, control=, inbox=/home/dovecot/dovecot//mail/l.dupont/Maildir, alt= 2013-09-23 22:20:07 imap(roms): Debug: acl: initializing backend with data: vfile 2013-09-23 22:20:07 imap(roms): Debug: acl: acl username = l.dupont 2013-09-23 22:20:07 imap(roms): Debug: acl: owner = 1 2013-09-23 22:20:07 imap(roms): Debug: acl vfile: Global ACL directory: (none) 2013-09-23 22:20:07 imap(roms): Debug: maildir++: root=/home/dovecot/dovecot//mail/l.dupont/Maildir, index=/home/dovecot/dovecot//mail/roms/Other Users/l.dupont, indexpvt=, control=, inbox=/home/dovecot/dovecot//mail/l.dupont/Maildir, alt= 2013-09-23 22:20:07 imap(roms): Debug: acl: initializing backend with data: vfile 2013-09-23 22:20:07 imap(roms): Debug: acl: acl username = roms 2013-09-23 22:20:07 imap(roms): Debug: acl: owner = 0 2013-09-23 22:20:07 imap(roms): Debug: acl vfile: Global ACL directory: (none) 2013-09-23 22:20:07 imap(roms): Debug: acl vfile: file /home/dovecot/dovecot//mail/l.dupont/Maildir/.Other Users.l\2edupont/dovecot-acl not found ---------------------------------------------------------- Last line see that the Shared Mailbox "Other Users/l.dupont" is converted to "Other Users.l\2edupont" Note, that this does not append when I trie to access a subfolder like "Other Users/l.dupont/Sent" If I set "mail_shared_explicit_inbox = yes" with plugin listescape, I can access "Other Users/l.dupont/INBOX" If I remove "listescape" from my plugin directive, I can access the INBOX of "Other Users/l.dupont" Thanks for any help :) Regards, Romain

1 0

[Dovecot] Vacation message and DMARC validation
by Gerson Moraes 23 Sep '13

23 Sep '13

Greetings, I have found an issue in the interaction between sieve vacation messages and the SPF, DKIM and DMARC email validation systems. For example, let's say we have a message coming from a(a)a.com to b(a)b.com at a server imap.mydomain.com. The account b(a)b.com has a vacation rule in sieve, and that generates an autoresponse to a(a)a.com. Our problem begins with the definition of section-5.1 in RFC5230 <https://tools.ietf.org/html/rfc5230#section-5.1>. It says that the envelope-from in vacation messages should be set to <>. This is the behavior currently implemented in Dovecot. We have recently added DMARC's authentication to our e-mail servers. DMARC needs one of the two authentication to pass, either SPF or DKIM. SPF works, but not the way DMARC needs it to. DMARC needs a valid SPF record that also matches the "From:" header. In this message, there are no envelope-from, so there are no domain to validate. This is the reason we use SRS to rewrite envelope-from (to do that we use the server address). The last option is to use DKIM authentication. We have clustered SMTP servers. So, in order to make a DKIM signature, the vacation message needs to be sent to the right server. That is, the server where the key to account b(a)b.com is available. To do that, we are implementing a modification to Dovecot source allowing the use of the envelope-from. The modified envelope-from will be used with the Postfix option "sender_dependent_relayhost_maps" in order to choose the right cluster. This does not break RFC5230, because the use of null sender is only a recommendation. I would like to know if a patch to the main project would be appreciated. Could you also please confirm if there are any future plans involving this feature, like an optional configuration for custom envelope-from? Thanks in advance, Gerson Moraes Digirati

3 5

[Dovecot] default client_limit
by Micah Anderson 23 Sep '13

23 Sep '13

I recently upgraded my dovecot from 2.1 to 2.2, and when I started, I received this message: doveconf: Warning: service auth { client_limit=1000 } is lower than required under max. load (1024) Searching through my configs, I do not have 1024 set anywhere. In order to stop this I set client_limit=1024 in my auth{} block... this seemed odd that the defaults disagreed with each other. However, it made me realize that my system could probably handle more, if it were properly tuned, and the different limit settings at their defaults are probably smaller than they could be for my server and the load it is under. So, I'm wondering how I can accurately set some of these values? The different possible things that can be set are: default_process_limit (for some reason I have this set to 256) default_client_limit (default) default_vsz_limit (I have this set to 512M) for the imap-login service, I have: service_count = 0 process_min_avail = 10 vsz_limit = 512M for service pop3-login, these are set: service_count = 0 process_min_avail = 10 vsz_limit = 512M for service imap, process_limit = 2048 service auth, I've just set the client_limit=1024 I've also got a ulimit -n set to 2048 and in my sysctl.conf, I have the following: fs.inotify.max_user_instances = 2048 because I was seeing this in the logs: Warning: Inotify instance limit for user 8 (UID mail) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances What I am looking for is a few things: . is there a formula for setting a proper value for some of these? . will dovecot warn me when I've reached a limit, so I can adjust these? thanks for any suggestions or improvements, I'm pretty sure this system can handle a lot more than it is doing right now, I just am unclear on how to tune it up to do that. micah

1 0

[Dovecot] Expunged message reappeared, giving a new UID
by Simon Fraser 23 Sep '13

23 Sep '13

I am running dovecot 2.2.2 with tcp based replication, and experiencing some duplicated emails. `doveconf -n` output is below. I have narrowed it down to the following scenario: An email arrives, and is successfully replicated to both nodes. It is in INBOX/new/ at this point on both servers. Connect with a mail client, and delete the message - without delayed expunge. So, for example, mutt (press 'd' then '$' to sync the mailbox), or Evolution set to immediately delete. The following log entry appears on the server the client is connected to: Jul 26 10:40:55 intmail3a dovecot: imap(srf): Warning: /mail/spool/s/srf/mail/INBOX/dovecot-uidlist: Duplicate file entry at line 5: 1374831638.M830754P11591.intmail3a,S=1289,W=1321 (uid 733481 -> 733482) - retrying by re-reading from beginning Jul 26 10:40:55 intmail3a dovecot: imap(srf): Warning: Maildir /mail/spool/s/srf/mail/INBOX: Expunged message reappeared, giving a new UID (old uid=733481, file=1374831638.M830754P11591.intmail3a,S=1289,W=1321) The email reappears in the mailbox, although this time it is in INBOX/new on one node and INBOX/cur on the other. As best I can tell it's always in 'new' on the server the client was connected to and in 'cur' on the other. If any other mailbox operation occurs before the delete (Marking the message in question as 'read', receiving a new message into the mailbox in a different lmtp session, marking as read or deleting & expunging some other message) then this prevents the duplication from happening. What can I do to prevent this happening? Is there a synchronisation interval I can adjust, perhaps? Although the message does get synchronised initially. Thanks in advance, Simon. # 2.2.2: /mail/etc/dovecot/dovecot.conf # OS: Linux 3.5.0-23-generic x86_64 Ubuntu 12.04.2 LTS disable_plaintext_auth = no doveadm_password = secret first_valid_uid = 100 lda_mailbox_autocreate = yes mail_gid = dovecot mail_home = /mail/spool/%1n/%n mail_location = maildir:~/mail:INBOX=~/mail/INBOX mail_plugins = notify replication mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { args = /mail/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcps:intmail3b:12345 sieve_dir = ~/sieve } protocols = imap lmtp sieve service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = dovecot } unix_listener replication-notify { mode = 0600 user = dovecot } } service config { unix_listener config { user = dovecot } } service doveadm { inet_listener { port = 12345 ssl = yes } user = dovecot } service replicator { process_min_avail = 1 } ssl_cert = </mail/etc/certs/mail-cert.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = </mail/etc/certs/mail-key.pem userdb { args = /mail/etc/dovecot/dovecot-ldap.userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = notify replication sieve } protocol lda { mail_plugins = notify replication sieve } protocol imap { mail_max_userip_connections = 30 } -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

8 30

[Dovecot] Dsync error: Failed to set attribute vendor/vendor.dovecot/pvt/sieve/default
by Aleksey Tsvetkov 23 Sep '13

23 Sep '13

Hi, Introduction: There are two domains, for example (aaa.com, bbb.com) In the aaa.com domain two users (bob(a)aaa.com, alex(a)aaa.com) In the bbb.com domain there are no users. In time full sync replication (replication_full_sync_interval) operations in logs appear errors: dovecot: dsync-local(bob(a)aaa.com): Error: Mailbox INBOX: Failed to set attribute vendor/vendor.dovecot/pvt/sieve/default: Invalid value for default sieve attribute dovecot: dsync-remote(bob(a)aaa.com): Error: Mailbox INBOX: Failed to set attribute vendor/vendor.dovecot/pvt/sieve/default: Invalid value for default sieve attribute One more error: dovecot: auth-worker(46263): sql(bob(a)bbb.com): unknown user dovecot: auth-worker(46263): sql(bob(a)bbb.com): Unknown user dovecot: auth-worker(46263): sql(bob): unknown user dovecot: auth-worker(46263): sql(bob): Unknown user dovecot: auth-worker(46263): sql(alex(a)aaa.com): unknown user dovecot: auth-worker(46263): sql(alex(a)aaa.com): Unknown user dovecot: auth-worker(46263): sql(alex): unknown user dovecot: auth-worker(46263): sql(alex): Unknown user Command: doveadm user '*' bob(a)aaa.com alex(a)aaa.com dovecot --build-options Build options: ioloop=kqueue notify=kqueue ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword pam passwd passwd-file sql Userdb: checkpassword nss passwd prefetch passwd-file sql dovecot --version 2.2.5 Somebody faced this problem? -- Best regards, Aleksey Tsvetkov System Administrator Company Grand Vision tel. +7(495)933-39-79, ext. 184

4 4

[Dovecot] mdbox index directories: bug?
by Holecz Endre 22 Sep '13

22 Sep '13

Hi, I'm using mdbox now (Dovecot 2.2.4), with indexes on a separate disk. Works fine, but the directories for indexes are also present in the storage folder, and are empty. Userdb (sql) returns this: home /var/vmail/domains/somedomain/someuser mail mdbox:~/mdbox:INDEX=/mnt/spool/dovecot/index/somedomain/s/someuser And the created directory structure is: /var/vmail/domains/somedomain/someuser /mdbox /mailboxes /INBOX /dbox-Mails /storage /mnt/spool/dovecot/index/somedomain/s/someuser /mailboxes /INBOX /storage /var/vmail/domains/somedomain/someuser/mdbox/mailboxes/* is always empty. Am I doing something wrong, or is this by design? :) Regards, Endre

3 3

[Dovecot] doveadm sync only creates directories, don't sync messages?
by Matthew Kaufman 22 Sep '13

22 Sep '13

Running Dovecot 2.1.7. I'm trying to migrate from an environment with mbox files to a maildir configuration. I remove all vestiges of my maildir over in /var/mail I put my old mailboxes in ./Mail and my old inbox in ./matthew. I issue this command: doveadm sync -u matthew(a)matthew.at mbox:./Mail:INBOX=./matthew Initially it gave me errors about separator, so I set the separator in the inbox namespace to "/" explicitly. Now that I've done that, and re-run it, over in the right place /var/mail, it creates "matthew" and a subdirectory "Mail". That's it. Doesn't take long to do it, either. But it doesn't copy any messages at all. I must be doing something wrong... but what? Matthew Kaufman matthew(a)eeph.com

1 0

[Dovecot] pop3c migration?
by Gedalya 22 Sep '13

22 Sep '13

Hi, I'm running dsync migrations using imapc and the source IMAP server is just too slow. It has taken 8 hours to migrate a mailbox with 47,000 messages. It seems most of the mailboxes are never accessed with IMAP, so it would be just as good to migrate them via POP3 which should work faster in my case. Is this actually meant to work? doveadm -D -o pop3c_user=xxxxxx(a)example.com -o 'pop3c_password=*******' -o pop3c_host=120.121.122.123 backup -u yyyyy(a)example.com -R pop3c: gives: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_init (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(yyyyy(a)example.com): Debug: Added userdb setting: mail=maildir:/stor/real/domains/example.com/yy/yyyyy/Maildir doveadm(yyyyy(a)example.com): Debug: Added userdb setting: plugin/quota_rule=*:storage=5120M doveadm(yyyyy(a)example.com): Debug: Effective uid=1001, gid=1001, home=/stor/real/domains/example.com/yy/yyyyy doveadm(yyyyy(a)example.com): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: doveadm(yyyyy(a)example.com): Debug: fs: root=, index=, control=, inbox=, alt= doveadm(yyyyy(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/stor/real/domains/example.com/yy/yyyyy/Maildir doveadm(yyyyy(a)example.com): Debug: maildir++: root=/stor/real/domains/example.com/yy/yyyyy/Maildir, index=, control=, inbox=/stor/real/domains/example.com/yy/yyyyy/Maildir, alt= dsync(yyyyy(a)example.com): Debug: Effective uid=1001, gid=1001, home=/stor/real/domains/example.com/yy/yyyyy dsync(yyyyy(a)example.com): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: dsync(yyyyy(a)example.com): Debug: fs: root=, index=, control=, inbox=, alt= dsync(yyyyy(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=pop3c: dsync(yyyyy(a)example.com): Debug: fs: root=, index=, control=, inbox=, alt= Segmentation fault remembering something about that... : # mkdir /tmp/pop3c # chown vmail:vmail /tmp/pop3c/ # doveadm -D -o pop3c_user=xxxxxx(a)example.com -o 'pop3c_password=*******' -o pop3c_host=120.121.122.123 backup -u yyyyy(a)example.com -R pop3c:/tmp/pop3c doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_init (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(yyyyy(a)example.com): Debug: Added userdb setting: mail=maildir:/stor/real/domains/example.com/yy/yyyyy/Maildir doveadm(yyyyy(a)example.com): Debug: Added userdb setting: plugin/quota_rule=*:storage=5120M doveadm(yyyyy(a)example.com): Debug: Effective uid=1001, gid=1001, home=/stor/real/domains/example.com/yy/yyyyy doveadm(yyyyy(a)example.com): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: doveadm(yyyyy(a)example.com): Debug: fs: root=, index=, control=, inbox=, alt= doveadm(yyyyy(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/stor/real/domains/example.com/yy/yyyyy/Maildir doveadm(yyyyy(a)example.com): Debug: maildir++: root=/stor/real/domains/example.com/yy/yyyyy/Maildir, index=, control=, inbox=/stor/real/domains/example.com/yy/yyyyy/Maildir, alt= dsync(yyyyy(a)example.com): Debug: Effective uid=1001, gid=1001, home=/stor/real/domains/example.com/yy/yyyyy dsync(yyyyy(a)example.com): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: dsync(yyyyy(a)example.com): Debug: fs: root=, index=, control=, inbox=, alt= dsync(yyyyy(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=pop3c:/tmp/pop3c dsync(yyyyy(a)example.com): Debug: fs: root=/tmp/pop3c/., index=/tmp/pop3c, control=, inbox=, alt= dsync(yyyyy(a)example.com): Debug: Namespace : Using permissions from /tmp/pop3c/.: mode=0755 gid=-1 dsync(yyyyy(a)example.com): Debug: Namespace : Using permissions from /stor/real/domains/example.com/yy/yyyyy/Maildir: mode=0700 gid=-1 dsync(yyyyy(a)example.com): Debug: Namespace : /tmp/pop3c/./INBOX doesn't exist yet, using default permissions dsync(yyyyy(a)example.com): Debug: Namespace : Using permissions from /tmp/pop3c/.: mode=0755 gid=-1 dsync(yyyyy(a)example.com): Debug: pop3c(120.121.122.123): Looking up IP address dsync(yyyyy(a)example.com): Debug: pop3c(120.121.122.123): Connecting to 120.121.122.123:110 dsync(yyyyy(a)example.com): Debug: pop3c(120.121.122.123): Authenticating as xxxxxx(a)example.com dsync(yyyyy(a)example.com): Panic: file mail-storage.c: line 1311 (mailbox_get_metadata): assertion failed: ((items & MAILBOX_METADATA_GUID) == 0 || !guid_128_is_empty(metadata_r->guid)) dsync(yyyyy(a)example.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x45caa) [0xb761ccaa] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0xb761cdc7] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb761d647] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x120) [0xb76f3040] -> doveadm() [0x80740bc] -> doveadm(dsync_worker_mailbox_iter_next+0x21) [0x8071c11] -> doveadm() [0x806c1f7] -> doveadm(dsync_brain_sync+0x6c0) [0x806b890] -> doveadm(dsync_brain_sync_all+0x18) [0x806c4f8] -> doveadm() [0x806961b] -> doveadm() [0x8069bbf] -> doveadm() [0x80541ec] -> doveadm(doveadm_mail_try_run+0x257) [0x8054ee7] -> doveadm(main+0x391) [0x805d0c1] -> /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6) [0xb748ae46] -> doveadm() [0x8054001] Aborted Now I'm lost... Am I in the right direction? Thanks, Gedalya # dovecot -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.1 auth_default_realm = example.com auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain default_client_limit = 8096 dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no imapc_host = mail01.example.com mail_gid = vmail mail_plugins = listescape mail_prefetch_count = 50 mail_uid = vmail namespace { hidden = yes list = no location = pop3c: prefix = POP3-MIGRATION-NS/ } namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash expire2 = Trash.* expire3 = Junk expire_dict = proxy::expire pop3_migration_mailbox = POP3-MIGRATION-NS/INBOX sieve = ~/.dovecot.sieve sieve_before = /var/local/lib/dovecot/sieve/global/fileinto-spam.sieve sieve_dir = ~/sieve } pop3c_host = 120.121.122.123 postmaster_address = postmaster(a)example.com service auth-worker { user = $default_internal_user } service auth { client_limit = 20480 } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 10240 } service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 7025 } } service pop3-login { process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 4096 } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol doveadm { mail_plugins = listescape pop3_migration } protocol lmtp { mail_plugins = listescape sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = listescape imap_quota ssl_cert = </etc/dovecot/imap.example.com.crt ssl_key = </etc/dovecot/imap.example.com.key } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = listescape pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_reuse_xuidl = no pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv ssl_cert = </etc/dovecot/pop.example.com.crt ssl_key = </etc/dovecot/pop.example.com.key } /etc/dovecot/dovecot-sql.conf.ext : driver = mysql connect = ..... default_pass_scheme = PLAIN password_query = SELECT password, \ '/stor/real/domains/%d/%2n/%n' AS userdb_home, \ 'maildir:/stor/real/domains/%d/%2n/%n/Maildir' as userdb_mail, \ concat('*:storage=', quota_mb, 'M') as userdb_quota_rule, \ 'vmail' AS userdb_uid, 'vmail' AS userdb_gid \ FROM email WHERE userid = '%n' AND domain = '%d' and deleted=0 user_query = SELECT '/stor/real/domains/%d/%2n/%n' AS home, \ 'maildir:/stor/real/domains/%d/%2n/%n/Maildir' as mail, \ concat('*:storage=', quota_mb, 'M') as quota_rule, \ 'vmail' AS uid, 'vmail' AS gid \ FROM email WHERE userid = '%n' AND domain = '%d' and deleted=0 iterate_query = SELECT userid as user, domain FROM email where deleted=0

2 2

[Dovecot] Attachment file larger than expected
by Angel L. Mateo 22 Sep '13

22 Sep '13

Hello, I'm using dovecot 2.1.16 with SiS configured as: mail_attachment_dir = <mypath> mail_attachment_min_size = 128 k mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} I'm having a few errors like: Sep 18 15:46:32 myotis51 dovecot: imap(igd): Error: Attachment file /mail/users/attachments/16/b0/16b0b2023a903db14d7f7bcdb1cc04c3f67a4fcb-b32c0a2aa6ae39527c870000a9061514 larger than expected (235866) They are really few and users haven't reported any problem, but the errors are there. In this case, actual file size of the attachment is: amateo_adm@myotis51:~$ sudo stat /mail/users/attachments/16/b0/16b0b2023a903db14d7f7bcdb1cc04c3f67a4fcb-b32c0a2aa6ae39527c870000a9061514 Fichero: «/mail/users/attachments/16/b0/16b0b2023a903db14d7f7bcdb1cc04c3f67a4fcb-b32c0a2aa6ae39527c870000a9061514» Tamaño: 174476 Bloques: 344 Bloque E/S: 4096 fichero regular Dispositivo: fc00h/64512d Nodo-i: 152334473 Enlaces: 2 Acceso: (0600/-rw-------) Uid: ( 2012/ vmail) Gid: ( 204/ vmail) Acceso: 2013-09-18 15:46:20.540728654 +0200 Modificación: 2013-09-18 15:46:20.556728948 +0200 Cambio: 2013-09-18 15:46:20.556728949 +0200 Creación: - and file is identified as: amateo_adm@myotis51:~$ sudo file /mail/users/attachments/16/b0/16b0b2023a903db14d7f7bcdb1cc04c3f67a4fcb-b32c0a2aa6ae39527c870000a9061514 /mail/users/attachments/16/b0/16b0b2023a903db14d7f7bcdb1cc04c3f67a4fcb-b32c0a2aa6ae39527c870000a9061514: MIME entity, UTF-8 Unicode text, with very long lines, with CRLF line terminators Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 1

[Dovecot] problem with dovecot replication over tcp
by nik600 22 Sep '13

22 Sep '13

Dear all i'm following the wiki at this page http://wiki2.dovecot.org/Replication but i'm getting this errors: #doveadm -v sync tcp:dst_hostname #doveadm(root): Fatal: Failed to start dsync-server command: 75 If i look at the dst dovecot.log file i get: Sep 16 12:42:18 auth: Error: passdb(root,xx): Auth client doesn't have permissions to do a PASS lookup: /var/run/dovecot/auth-userdb mode=0666, but not owned by UID 1002(vmail) Sep 16 12:42:18 doveadm(xx,root): Error: user root: Auth PASS lookup failed Sep 16 12:42:18 doveadm(xx,root): Debug: auth input: Sep 16 12:42:18 doveadm(xx,root): Error: dsync-server: /var/run/dovecot/auth-userdb: passdb lookup failed (to see if user is proxied, because doveadm_proxy_port is set) I've also tried to perform a #chown vmail /var/run/dovecot/auth-userdb But the error is the same. If i do the #doveadm user * I get a list of users loaded from the database i've added these line to my dovecot-sql.conf iterate_query = SELECT username from mailbox where active=1 Any idea? Thanks -- /*************/ nik600 http://www.kumbe.it

2 1

[Dovecot] DH Parameter
by Dimi - 22 Sep '13

22 Sep '13

Hi! Is there any possibility to let dovecot serve >1024 Bit DH Parameters at SSL/TLS-connections? Is it possible to replace /var/lib/dovecot/ssl-parameters.ssl with DH-parameter generated by openssl? If not: Are there any plans to implement that? Thank you!

2 1

[Dovecot] Error: BUG: Worker sent reply with id 393, expected 394
by 刘莹莹 22 Sep '13

22 Sep '13

hi dovecot: when i login 100 users with imap protocol ,Someusers appeared a BUG in maillog like : Sep 10 09:05:22 auth(default): Error: BUG: Worker sent reply with id 393, expected 394 Sep 10 09:05:22 auth(default): Error: worker-server(q82(a)t.com,10.12.80.3): Aborted: Worker is buggy Sep 10 09:05:22 auth(default): Error: BUG: Worker sent reply with id 31, expected 32 Sep 10 09:05:22 auth(default): Error: worker-server(q95(a)t.com,10.12.80.3): Aborted: Worker is buggy Sep 10 09:05:22 auth(default): Error: BUG: Worker sent reply with id 32, expected 33 Sep 10 09:05:22 auth(default): Error: worker-server(q99(a)t.com,10.12.80.3): Aborted: Worker is buggy Sep 10 09:05:22 auth(default): Error: BUG: Worker sent reply with id 29, expected 30 Sep 10 09:05:22 auth(default): Error: worker-server(q22(a)t.com,10.12.80.3): Aborted: Worker is buggy Sep 10 09:05:22 imap-login: Info: Internal login failure (auth failed, 1 attempts): user=<q3(a)t.com>, method=PLAIN, rip=10.12.80.3, lip=10.12.80.6

2 1

[Dovecot] Dovecot 2.0, 2.1 and 2.2.5 core dump when Quota Plugin (FS) is enabled
by Harald Strack 22 Sep '13

22 Sep '13

Hi, we are actually deploying a new IMAP-Server, targeting dovecot 2.1.17. Unfortunately, our tests with imaptest did not succeed, were ending in core dumps. We did this test: ./imaptest host=example.com port=143 user=strack pass=secret disconnect_quit no_pipelining mbox=dovecot-crlf That's what we get in dovecot's log: Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22810, session=<EurP9wPmVgCBu/Qf> Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22811, session=<mSXT9wPmWgCBu/Qf> Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22812, session=<1GbR9wPmWACBu/Qf> Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22813, session=<JKbQ9wPmVwCBu/Qf> Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22814, session=<USLS9wPmWQCBu/Qf> Sep 10 11:17:04 imap(strack): Panic: file mbox-storage.c: line 712 (mbox_transaction_unlock): assertion failed: (mbox->box.transaction_count > 0 || mbox->mbox_lock_type == F_UNLCK) Sep 10 11:17:04 imap(strack): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x3c7824660a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3c78246656] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3c78219eaa] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3c786600c0] -> /usr/lib/dovecot/lib10_quota_plugin.so(+0xb7e7) [0x7f113b5427e7] -> /usr/lib/dovecot/lib10_quota_plugin.so(+0xb218) [0x7f113b542218] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mbox_sync+0x88) [0x3c7865fea8] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mbox_transaction_save_commit_post+0x27) [0x3c78657c07] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3c786a5313] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9f) [0x3c786b3cdf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x8a) [0x3c786a4f5a] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3c78660121] -> /usr/lib/dovecot/lib10_quota_plugin.so(+0xb8af) [0x7f113b5428af] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3e) [0x3c7867aa9e] -> dovecot/imap() [0x408b3a] -> dovecot/imap() [0x4088e4] -> dovecot/imap() [0x408d3c] -> dovecot/imap(cmd_append+0x139) [0x408f99] -> dovecot/imap(command_exec+0x3d) [0x41155d] -> dovecot/imap() [0x41046e] -> dovecot/imap() [0x41055a] -> dovecot/imap(client_handle_input+0x135) [0x410785] -> dovecot/imap(client_input+0x5f) [0x4110af] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x3c78252c16] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x3c78253c9f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3c78252bb8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3c7823e083] -> dovecot/imap(main+0x29d) [0x4195bd] Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22826, session=<KyHU9wPmWwCBu/Qf> Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22827, session=<kxTY9wPmXACBu/Qf> Sep 10 11:17:04 imap-login: Info: Login: user=<strack>, method=PLAIN, rip=10.10.10.31, lip=10.10.10.21, mpid=22828, session=<CXXg9wPmXQCBu/Qf> Sep 10 11:17:05 imap(strack): Fatal: master: service(imap): child 22806 killed with signal 6 (core dumped) Sep 10 11:17:05 imap(strack): Info: Connection closed in=49 out=3832 Sep 10 11:17:05 imap(strack): Info: Connection closed in=49 out=3832 That's the backtrace of the coredump: Loaded symbols for /lib64/libnss_files.so.2 Reading symbols from /lib64/libnss_sss.so.2...Reading symbols from /usr/lib/debug/lib64/libnss_sss.so.2.debug...done. done. Loaded symbols for /lib64/libnss_sss.so.2 Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libgcc_s.so.1 Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x0000003bc02328a5 in raise () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.107.el6_4.2.x86_64 keyutils-libs-1.4-4.el6.x86_64 krb5-libs-1.10.3-10.el6_4.4.x86_64 libcom_err-1.41.12-14.el6_4.2.x86_64 libgcc-4.4.7-3.el6.x86_64 libselinux-2.0.94-5.3.el6_4.1.x86_64 openssl-1.0.0-27.el6_4.2.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt #0 0x0000003bc02328a5 in raise () from /lib64/libc.so.6 #1 0x0000003bc0234085 in abort () from /lib64/libc.so.6 #2 0x0000003c78246618 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:191 #3 0x0000003c78246656 in i_internal_fatal_handler (ctx=0x7fff1c87efa0, format=<value optimized out>, args=<value optimized out>) at failures.c:649 #4 0x0000003c78219eaa in i_panic (format=0x2c1e <Address 0x2c1e out of bounds>) at failures.c:263 #5 0x0000003c786600c0 in mbox_transaction_unlock (box=0x1a51270, lock_id=<value optimized out>) at mbox-storage.c:711 #6 0x00007f95c08c77e7 in quota_mailbox_transaction_rollback (ctx=0x1a589e0) at quota-storage.c:142 #7 0x00007f95c08c7218 in quota_mailbox_sync_notify (box=0x1a51270, uid=0, sync_type=0) at quota-storage.c:301 #8 0x0000003c7865fea8 in mbox_sync (mbox=0x1a51270, flags=<value optimized out>) at mbox-sync.c:2006 #9 0x0000003c78657c07 in mbox_transaction_save_commit_post (_ctx=0x1a53e20, result=<value optimized out>) at mbox-save.c:807 #10 0x0000003c786a5313 in index_transaction_index_commit (index_trans=0x1a5a530, result_r=0x7fff1c87f190) at index-transaction.c:50 #11 0x0000003c786b3cdf in mail_index_transaction_commit_full (_t=0x7fff1c87f1b8, result_r=0x7fff1c87f190) at mail-index-transaction.c:251 #12 0x0000003c786a4f5a in index_transaction_commit (t=<value optimized out>, changes_r=<value optimized out>) at index-transaction.c:132 #13 0x0000003c78660121 in mbox_transaction_commit (t=<value optimized out>, changes_r=<value optimized out>) at mbox-storage.c:729 #14 0x00007f95c08c78af in quota_mailbox_transaction_commit (ctx=0x1a5a390, changes_r=0x7fff1c87f260) at quota-storage.c:124 #15 0x0000003c7867aa9e in mailbox_transaction_commit_get_changes (_t=<value optimized out>, changes_r=0x7fff1c87f260) at mail-storage.c:1515 #16 0x0000000000408b3a in cmd_append_continue_parsing (cmd=0x1a4ea50) at cmd-append.c:284 #17 0x00000000004088e4 in cmd_append_continue_message (cmd=0x1a4ea50) at cmd-append.c:466 #18 0x0000000000408d3c in cmd_append_continue_parsing (cmd=0x1a4ea50) at cmd-append.c:399 #19 0x0000000000408f99 in cmd_append (cmd=0x1a4ea50) at cmd-append.c:519 #20 0x000000000041155d in command_exec (cmd=0x1a4ea50) at imap-commands.c:148 #21 0x000000000041046e in client_command_input (cmd=0x1a4ea50) at imap-client.c:684 #22 0x000000000041055a in client_command_input (cmd=0x1a4ea50) at imap-client.c:735 #23 0x0000000000410785 in client_handle_next_command (client=0x1a4e240) at imap-client.c:776 #24 client_handle_input (client=0x1a4e240) at imap-client.c:788 #25 0x00000000004110af in client_input (client=0x1a4e240) at imap-client.c:827 #26 0x0000003c78252c16 in io_loop_call_io (io=0x1a4cb70) at ioloop.c:379 #27 0x0000003c78253c9f in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:213 #28 0x0000003c78252bb8 in io_loop_run (ioloop=0x1a35670) at ioloop.c:398 #29 0x0000003c7823e083 in master_service_run (service=0x1a35520, callback=<value optimized out>) at master-service.c:544 #30 0x00000000004195bd in main (argc=1, argv=0x1a35370) at main.c:389 That's the full backtrace of the coredump: #0 0x0000003bc02328a5 in raise () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.107.el6_4.2.x86_64 keyutils-libs-1.4-4.el6.x86_64 krb5-libs-1.10.3-10.el6_4.4.x86_64 libcom_err-1.41.12-14.el6_4.2.x86_64 libgcc-4.4.7-3.el6.x86_64 libselinux-2.0.94-5.3.el6_4.1.x86_64 openssl-1.0.0-27.el6_4.2.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt full #0 0x0000003bc02328a5 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x0000003bc0234085 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x0000003c78246618 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:191 backtrace = 0x1a2d3a8 "/usr/lib64/dovecot/libdovecot.so.0() [0x3c7824660a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3c78246656] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3c78219eaa] -> /usr/lib64/dovecot/libdovecot-stora"... #3 0x0000003c78246656 in i_internal_fatal_handler (ctx=0x7fff1c87efa0, format=<value optimized out>, args=<value optimized out>) at failures.c:649 status = 0 #4 0x0000003c78219eaa in i_panic (format=0x2c1e <Address 0x2c1e out of bounds>) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff1c87f070, reg_save_area = 0x7fff1c87efb0}} #5 0x0000003c786600c0 in mbox_transaction_unlock (box=0x1a51270, lock_id=<value optimized out>) at mbox-storage.c:711 mbox = 0x1a51270 __FUNCTION__ = "mbox_transaction_unlock" #6 0x00007f95c08c77e7 in quota_mailbox_transaction_rollback (ctx=0x1a589e0) at quota-storage.c:142 qbox = 0x1a51858 qt = 0x1a66a90 #7 0x00007f95c08c7218 in quota_mailbox_sync_notify (box=0x1a51270, uid=0, sync_type=0) at quota-storage.c:301 qbox = 0x1a51858 uids = <value optimized out> sizep = <value optimized out> i = <value optimized out> count = <value optimized out> size = <value optimized out> #8 0x0000003c7865fea8 in mbox_sync (mbox=0x1a51270, flags=<value optimized out>) at mbox-sync.c:2006 lock_id = 11 ---Type <return> to continue, or q <return> to quit--- ret = 0 __FUNCTION__ = "mbox_sync" #9 0x0000003c78657c07 in mbox_transaction_save_commit_post (_ctx=0x1a53e20, result=<value optimized out>) at mbox-save.c:807 ctx = 0x1a53e20 __FUNCTION__ = "mbox_transaction_save_commit_post" #10 0x0000003c786a5313 in index_transaction_index_commit (index_trans=0x1a5a530, result_r=0x7fff1c87f190) at index-transaction.c:50 t = 0x1a5a390 ret = 0 __FUNCTION__ = "index_transaction_index_commit" #11 0x0000003c786b3cdf in mail_index_transaction_commit_full (_t=0x7fff1c87f1b8, result_r=0x7fff1c87f190) at mail-index-transaction.c:251 t = 0x1a5a530 index = 0x1a4ccc0 index_undeleted = <value optimized out> #12 0x0000003c786a4f5a in index_transaction_commit (t=<value optimized out>, changes_r=<value optimized out>) at index-transaction.c:132 box = 0x1a51270 itrans = 0x0 result = {log_file_seq = 17, log_file_offset = 6032, commit_size = 196, ignored_modseq_changes = 0} ret = <value optimized out> #13 0x0000003c78660121 in mbox_transaction_commit (t=<value optimized out>, changes_r=<value optimized out>) at mbox-storage.c:729 mt = <value optimized out> box = 0x1a51270 lock_id = 11 ret = <value optimized out> #14 0x00007f95c08c78af in quota_mailbox_transaction_commit (ctx=0x1a5a390, changes_r=0x7fff1c87f260) ---Type <return> to continue, or q <return> to quit--- at quota-storage.c:124 qbox = 0x1a51858 qt = 0x1a5a1e0 #15 0x0000003c7867aa9e in mailbox_transaction_commit_get_changes (_t=<value optimized out>, changes_r=0x7fff1c87f260) at mail-storage.c:1515 _data_stack_cur_id = 4 t = 0x1a5a390 ret = <value optimized out> #16 0x0000000000408b3a in cmd_append_continue_parsing (cmd=0x1a4ea50) at cmd-append.c:284 sync_flags = <value optimized out> imap_flags = <value optimized out> changes = {pool = 0x1a61fe0, uid_validity = 1268835246, saved_uids = {arr = {buffer = 0x1a62000, element_size = 8}, v = 0x1a62000, v_modifiable = 0x1a62000}, ignored_modseq_changes = 0, changed = true, no_read_perm = false} msg = <value optimized out> client = 0x1a4e240 ctx = 0x1a4eb48 args = 0x1a59a98 flags_list = <value optimized out> flags = <value optimized out> keywords_list = <value optimized out> keywords = <value optimized out> internal_date_str = <value optimized out> msg = <value optimized out> internal_date = <value optimized out> ret = <value optimized out> timezone_offset = <value optimized out> save_count = <value optimized out> nonsync = <value optimized out> ---Type <return> to continue, or q <return> to quit--- fatal = <value optimized out> __FUNCTION__ = "cmd_append_continue_parsing" #17 0x00000000004088e4 in cmd_append_continue_message (cmd=0x1a4ea50) at cmd-append.c:466 all_written = true client = 0x1a4e240 ctx = 0x1a4eb48 size = 0 ret = <value optimized out> #18 0x0000000000408d3c in cmd_append_continue_parsing (cmd=0x1a4ea50) at cmd-append.c:399 client = 0x1a4e240 ctx = 0x1a4eb48 args = 0x1a59a98 flags_list = 0x0 flags = 0 keywords_list = 0x3c782426aa keywords = 0x0 internal_date_str = <value optimized out> msg = <value optimized out> internal_date = -1 ret = 0 timezone_offset = 0 save_count = <value optimized out> nonsync = true fatal = <value optimized out> __FUNCTION__ = "cmd_append_continue_parsing" #19 0x0000000000408f99 in cmd_append (cmd=0x1a4ea50) at cmd-append.c:519 client = 0x1a4e240 ctx = 0x1a4eb48 mailbox = 0x1a38910 "INBOX" ---Type <return> to continue, or q <return> to quit--- #20 0x000000000041155d in command_exec (cmd=0x1a4ea50) at imap-commands.c:148 hook = 0x1a36cd0 ret = <value optimized out> #21 0x000000000041046e in client_command_input (cmd=0x1a4ea50) at imap-client.c:684 client = 0x1a4e240 command = <value optimized out> __FUNCTION__ = "client_command_input" #22 0x000000000041055a in client_command_input (cmd=0x1a4ea50) at imap-client.c:735 client = 0x1a4e240 command = <value optimized out> __FUNCTION__ = "client_command_input" #23 0x0000000000410785 in client_handle_next_command (client=0x1a4e240) at imap-client.c:776 size = 1320 #24 client_handle_input (client=0x1a4e240) at imap-client.c:788 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #25 0x00000000004110af in client_input (client=0x1a4e240) at imap-client.c:827 cmd = <value optimized out> output = 0x1a4ca88 bytes = 1320 __FUNCTION__ = "client_input" #26 0x0000003c78252c16 in io_loop_call_io (io=0x1a4cb70) at ioloop.c:379 ioloop = 0x1a35670 t_id = 2 #27 0x0000003c78253c9f in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:213 ctx = 0x1a359e0 ---Type <return> to continue, or q <return> to quit--- events = <value optimized out> event = 0x1a35a50 list = 0x1a4cbc0 io = <value optimized out> tv = {tv_sec = 1799, tv_usec = 999319} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> #28 0x0000003c78252bb8 in io_loop_run (ioloop=0x1a35670) at ioloop.c:398 No locals. #29 0x0000003c7823e083 in master_service_run (service=0x1a35520, callback=<value optimized out>) at master-service.c:544 No locals. #30 0x00000000004195bd in main (argc=1, argv=0x1a35370) at main.c:389 set_roots = {0x41c460, 0x0} login_set = {auth_socket_path = 0x1a2d078 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x419710 <login_client_connected>, failure_callback = 0x418f30 <login_client_failed>} service_flags = <value optimized out> storage_service_flags = <value optimized out> username = <value optimized out> c = <value optimized out> That's our configuration: # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.18.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.4 (Santiago) xfs auth_debug = yes auth_verbose = yes debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 3000 default_process_limit = 8192 disable_plaintext_auth = no log_path = /var/log/dovecot/dovecot.log login_greeting = Server ready. mail_debug = yes mail_location = mbox:/var/spool/fhmrz_imap/% u/dovecot-home:LAYOUT=maildir++:INBOX=/var/spool/mail/% u:INDEX=/var/opt/index/%u/dovecot-indexes:CONTROL=/var/opt/index/% u/dovecot-control mail_plugin_dir = /usr/lib/dovecot mail_plugins = listescape quota mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size flags quota = fs:User quota:user:noenforcing quota_exceeded_message = Quota exceeded, please go to http://www.timbuktu.edu/over_quota_help for instructions on how to fix this. } protocols = imap pop3 service anvil { client_limit = 16744 } service auth { client_limit = 16800 } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 8192 process_min_avail = 8 } service imap { process_limit = 16084 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 16084 } ssl_cert = </etc/pki/tls/certs/example.pem ssl_key = </etc/pki/tls/private/example-key.pem userdb { driver = passwd } protocol imap { mail_max_userip_connections = 30 mail_plugins = listescape quota imap_quota } protocol pop3 { mail_max_userip_connections = 10 pop3_uidl_format = %08Xu%08Xv } The problem occurs with dovecot-2.0.9 and dovecot-2.1.17 and also dovecot-2.2.5! From the stacktrace I could see that the problem origins from the quota plugin. Thus, when I disabled the quota plugin the problem went away. The problem did only occur on a high concurrency level on one mbox/folder, running imaptest with only one user and 10 clients. When we run imaptest in a more real-world fashion with several thousand of users and clients=100, the error did not occur. Because of this I am not sure how problematic this bug will be in a production environment? What do you think? Any help is greatly appreciated! br Harald Strack -- Harald Strack, Dipl.Inf.(FH) IT Development ssystems c/o berliner gazette Danziger Str. 31 10435 Berlin Tel: +49 30 2023 6071 - 1 http://www.ssystems.de

2 1

[Dovecot] Read-only account through INDEX=MEMORY:CONTROL=MEMORY and non-writable Unix-permissions
by Steffen Kaiser 22 Sep '13

22 Sep '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, my goal is to provide a special mailbox for some mail accounts. The user should get the information, to look somewhere else. The user must not change anything at all. I also don't want to provide a mailbox for each user. I got the setup below, which seems to run with Dovecot v2.2; however, "CONTROL=MEMORY" is not documented. Is the setup stable for next versions of Dovecot or is CONTROL=MEMORY not a feature, but a bug? ====== user settings: home=/home/nomailbox mail=maildir:/home/nomailbox/Maildir:INDEX=MEMORY:CONTROL=MEMORY uid=vmail gid=vmail The structure of the directory: /home/nomailbox/: total 12 drwxr-xr-x 3 root root 4096 Oct 24 2007 ./ drwxr-xr-x 18 root root 4096 Sep 9 10:36 ../ dr-xr-xr-x 5 root root 4096 Oct 24 2007 Maildir/ /home/nomailbox/Maildir: total 20 dr-xr-xr-x 5 root root 4096 Oct 24 2007 ./ drwxr-xr-x 3 root root 4096 Oct 24 2007 ../ dr-xr-xr-x 2 root root 4096 Oct 24 2007 cur/ dr-xr-xr-x 2 root root 4096 Sep 9 08:23 new/ dr-xr-xr-- 2 root root 4096 Oct 24 2007 tmp/ /home/nomailbox/Maildir/cur: total 8 dr-xr-xr-x 2 root root 4096 Oct 24 2007 ./ dr-xr-xr-x 5 root root 4096 Oct 24 2007 ../ - -rw-r--r-- 1 root root 0 Oct 24 2007 .placeholder /home/nomailbox/Maildir/new: total 12 dr-xr-xr-x 2 root root 4096 Sep 9 08:23 ./ dr-xr-xr-x 5 root root 4096 Oct 24 2007 ../ - -r--r--r-- 1 root root 804 Sep 9 08:24 no-mailbox-for-you /home/nomailbox/Maildir/tmp: total 8 dr-xr-xr-- 2 root root 4096 Oct 24 2007 ./ dr-xr-xr-x 5 root root 4096 Oct 24 2007 ../ - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUi22kF3r2wJMiz2NAQLJEAf/WM0jXqVmZ6HtEvoKTB4grE2xFfN4Ylig imhPVf/yufYLzQw+w98fhrozEcm7UK0mUWpiJQzMowYyLNdF8tVwhgTdAfFa6fhK +L0+GxVcCuvRq/YjIivhgQ7gwZlhjLWa43Fo65HAqude4nnuyb5/RuVb0aPBlB73 1V5nMB5f9PSrlAjtK4kLOq1VRNp2SCVfBem/ESqhYSZ+O51gGZ8JRm7skWr82GmZ tdeYDa52h8CWm67S1lzNK42yNoElkLrH5MZJLCBmjg/hLjD99aMCAdgWRL5zyg/h bZzoOZNztQq0CwBHTB+KY9YBkfMmXzFtse3C0a2Eg9m5bmJmNblPGw== =iYWU -----END PGP SIGNATURE-----

2 1

[Dovecot] fdatasync -- Error -- bad file descriptor
by Vijay Rajah 22 Sep '13

22 Sep '13

Hello list, I have a dovecot 2.2.5 instance configured to use mdbox as mailbox format. I configured to use separate storage attachments and use SIS.. (doveconf -n below) I get this error Sep 6 12:29:52 vrajah.mydomain.tld dovecot: lmtp(14258, email(a)mydomain.tld) Error: fdatasync(/apps/mail/mailbox/attachments/23/12/2312039008db057a1c75-2efc2d00687d2952b2370000f89409f1) failed: Bad file descriptor I'm using centos 6.4 on a KVM with ext4 as fs. Can someone tell me why i'm getting this error? and how to fix this? -Thanks in advance Vijay ##########doveconf -n # 2.2.5: /apps/mail/dovecot/2.2.5/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.14.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) ext4 auth_mechanisms = plain login digest-md5 cram-md5 auth_socket_path = /apps/mail/var/dovecot/run/auth-userdb base_dir = /apps/mail/var/dovecot/run/ debug_log_path = /var/log/dovecot-debug.log dict { sqlquota = mysql:/apps/mail/dovecot/2.2.5/etc/dovecot/conf.d/sqlquota.dict.ext } hostname = mail1(a)mydomain.tldmydomain.tld mail_attachment_dir = /apps/mail/mailbox/attachments mail_attachment_hash = %{sha256:80} mail_debug = yes mail_location = mdbox:/apps/mail/mailbox/%d/%n/mdbox mail_plugin_dir = /apps/mail/dovecot/2.2.5/lib/dovecot/ mail_plugins = " virtual quota zlib" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl dotlock mdbox_rotate_size = 1 M namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /apps/mail/dovecot/2.2.5/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% quota_rule3 = Spam:storage=+20%% quota_status_nouser = DUNNO quota_status_overquota = 450 4.2.2 Mailbox is full. Try again later quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = ~/.dovecot.sieve sieve_before = /apps/mail/var/dovecot/sieve/ sieve_dir = ~/sieve sieve_global_dir = /apps/mail/var/dovecot/sieve zlib_save = bz2 zlib_save_level = 9 } protocols = imap lmtp sieve service auth { unix_listener /apps/mail/var/postfix/dovecot-auth { group = postfix mode = 0660 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /apps/mail/var/postfix/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 10 vsz_limit = 64 M } service managesieve { process_limit = 1024 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /apps/mail/dovecot/2.2.5/etc/dovecot/conf.d/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } shutdown_clients = no ssl_ca = </apps/mail/dovecot/2.2.5/etc/dovecot/ssl/mayca.crt.pem ssl_cert = </apps/mail/dovecot/2.2.5/etc/dovecot/ssl/mail1.mydomain.tld.pem ssl_key = </apps/mail/dovecot/2.2.5/etc/dovecot/ssl/mail1.mydomain.tld.key ssl_parameters_regenerate = 30 hours submission_host = 127.0.0.1:587 userdb { driver = prefetch } userdb { args = /apps/mail/dovecot/2.2.5/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " virtual quota zlib sieve zlib" } protocol imap { mail_plugins = " virtual quota zlib imap_quota imap_zlib" } protocol lmtp { debug_log_path = /var/log/dovecot-lmtp-debg.log mail_plugins = " virtual quota zlib sieve zlib" }

2 2

[Dovecot] permission problem when using public namespace and "subscription = yes"
by Lars Uhlmann 22 Sep '13

22 Sep '13

I have configured an public namespace "Test" for a group of users: | namespace public { | separator = . | prefix = Test. | location = maildir:/mailroot/public/Test | hidden = no | list = yes | subscriptions = yes | } Using each users own subscription file for a public mailbox doesn't make sense when the mailbox is heavily used. Every directory operation (create/rename) needs to be synced between all subscribers automatically and immediately. So I set "subscriptions = yes". My ACLS look like this: | user=mark lrwstiekx | user=tim lrwstiekx | user=max lr | user=jenny lrwstiekx | user=louis lr Nevertheless _all_ my mail users still have access to the namespace's directory tree. It is my understanding that when a user doesn't has 'lookup' access, he should not be able to subscribe to this mailbox. In my opinion this is a security problem. ACLs must be processed _before_ a shared subscrition file is parsed. regards Lars

2 1

Re: [Dovecot] Logging passwords on auth failure/dealing with botnets
by Joseph Tam 22 Sep '13

22 Sep '13

"Michael Smith (DF)" writes: > Or another option, is there any good DNS based RBLs for botnet IPs, and > is there any way to tie that in to the dovecot auth system? I've been > looking for botnet rbls, but what I've found so far doesn't seem to > work very well. Most of the IPs that I've had to firewall don't exist > in them. /dev/rob0 writes: > The problem with using XBL, anyway, is that you might have legitimate > logins from listed hosts. Example: a traveler using hotel wifi. We > (TINW) really would need a new DNSBL type (or a special result) for > this sort of abuse. > > It's a nice idea, worth building upon, if someone can fund it (or > find the time to develop it, which really amounts to the same thing.) > Imagine also a Dovecot network of reporters, where brute force > attempts worldwide are reported from Dovecots to the DNSBL, not > merely a one-way tie in. > > I'd also suggest listing SSH brute force attacks in the same DNSBL, > possibly with a different result (127.0.0.$port, so IMAP attackers > list as 127.0.0.143, SSH attackers as 127.0.0.22. Yes, we'd have to > incorporate the third quad for ports > 255, but the general idea is > for result codes to be both machine and human readable as much as > possible.) I use bl.blocklist.de as a DNSRBL for ssh BFD, but I think it also detects BFD for other protocols: http://www.blocklist.de/en/index.html The nice thing about this RBL is that you can also contribute by configuring your Fail2Ban/DenyHost to forward logs to the maintainers, to widen the detection network. I get about a 60% hit on ssh BFD attacks. I also found http://openbl.org but they distribute it as a downloadable file rather than as a DNSRBL. Maybe I can introduce the latter to the former. Joseph Tam <jtam.home(a)gmail.com>

3 2

[Dovecot] Solved: startup failures "net_listen_unix(...) failed: Invalid argument"
by C. Mills 22 Sep '13

22 Sep '13

I ran into this and had a bit of trouble tracking a diagnosis down, so here it is for the archives in case anyone else runs into this. A new installation of dovecot was failing to start, with these messages: $ ./sbin/dovecot Error: service(imap-urlauth): net_listen_unix(.../var/run/dovecot/token-login/imap-urlauth) failed: Invalid argument Error: service(auth): net_listen_unix(.../var/run/dovecot/token-login/tokenlogin) failed: Invalid argument Fatal: Failed to start listeners Some of the other processes seemed to be starting up fine, and they created sockets in the expected dir, but the above two wouldn't. stracing the processes didn't show a lot, but eventually I checked the length of the installation path, and found the above two socket paths were exceeding the maximum path length limit for Unix sockets -- 108 chars on my Linux boxen. I haven't checked SuS or Posix to see what the standards say the actual minimum required size for the maximum path length is -- it might be shorter yet on other systems. Moving the installation to a less deeply nested hierarchy fixed the problem. I hope this saves someone else a headache someday. C. C. -- ----------------------------------------------------------------------- C. Mills -----------------------------------------------------------------------

2 1

[Dovecot] dovecot and PFS
by Emmanuel Dreyfus 22 Sep '13

22 Sep '13

Hi Is there known advices on how to favor PFS with dovecot? In Apache, I use the following directives, with cause all modern browsers to adopt 256 bit PFS ciphers, while keeping backward compatibility with older browsers and avoiding BEAST attack: SSLProtocol all -SSLv2 SSLHonorCipherOrder On SSLCipherSuite ECDHE@STRENGTH:ECDH@STRENGTH:DH@STRENGTH:HIGH:-SSLv3-SHA1:-TLSv10 -SHA1:RC4:!MD5:!DES:!aNULL:!eNULL dovecot does not care about BEAST, since attacker cannot inject trafic. Therefore the cipher list get simplier in dovecot.conf: ssl_cipher_list = ECDHE@STRENGTH:ECDH@STRENGTH:DH@STRENGTH:HIGH:!MD5:!DES:!aNULL :!eNULL But that list is good for browsers. I am not aware of documentation about what ciphers are advertised by various mail client. How can I know if that setting has some success pushing PFS? How can I discover which clients fail to negociate PFS ciphers? -- Emmanuel Dreyfus manu(a)netbsd.org

4 4

[Dovecot] mailbox_list_index, stops showing new mails in mailboxes
by Anton Lundin 22 Sep '13

22 Sep '13

Hello. I'm having some weird problem with (probably) mailbox_list_index, that it doesn't see new mail in mailboxes. I'm using 2.2.4 over imap and ssh/imap, and after a while dovecot stops noticing new mail in some folders. Its always the same 2-3 folders of about 30. I read something about list-index corruption in 2.2.2, and i thought it was that i was running into earlier, but this problem still occurs. This is dovecot 2.2.4, running on Solaris 10 x86_64 to homedirs on zfs, where procmail is used to deliver mail to mailboxes in mbox-format. I've tried to purge all indexes and let dovecot rebuild them, but the problem reoccurs after a couple of days. How can i help to debug this issue? Should i grab dovecot.list.index when its out-of-sync for debugging? //Anton -- Anton Lundin +46702-161604

2 1

[Dovecot] verbose_proctitle cuts dsync to proctitle to "dsyn"
by Sven Hartge 22 Sep '13

22 Sep '13

Hi Timo, little cosmetic bug report: using "verbose_proctitle = yes" shortens the proctitle of dsync to just "dsyn". Example: Note the whitespace instead of the 'c' in the proctitle: root@m-st-01:~# ps auwwwx | grep [d]syn virtmail 18141 13.0 0.1 49916 7952 pts/6 R+ 00:49 0:00 dsyn -v -u xxyyzz7 -R backup maildir:/staging/xxyyzz7/Maildir With "verbose_proctitle = no" the output looks like this: root@m-st-01:~# ps auwwwx | grep [d]syn virtmail 18347 78.6 1.6 127356 68884 pts/6 D+ 00:53 0:02 dsync -v -u aabbcc7 -R backup maildir:/staging/aabbcc7/Maildir Version of dovecot is 2.2.5 from the autobuilder (but rebuild locally): root@m-st-01:~# doveadm config -n # 2.2.5 (ec62ea3c940e): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 [...] Grüße, Sven. -- Sigmentation fault. Core dumped.

2 1

[Dovecot] Problem with MySQL virtual users and dsync
by Jordan Cook 22 Sep '13

22 Sep '13

Hello, I am using dovecot 2.2.5 on FreeBSD and I am having trouble using dsync with SSH. Everything on the server seems to be working fine (I can login, receive and send emails etc). I am using SQL for both passdb, and userdb and this seems to work fine. The 'doveadm user' command returns all the correct information for the user. I am getting the following errors in my log file: Aug 27 21:34:17 server dovecot: replicator: Error: userdb lookup: Connecting timed out Aug 27 21:34:17 server dovecot: replicator: Error: userdb lookup: Disconnected unexpectedly Aug 27 21:34:20 server last message repeated 173381 times It did seem to do an initial sync, but after that nothing is being synchronised. Has anyone else solved this problem previously or is able to help? Regards, Jordan Cook -- Packet House Limited is a company registered in England and Wales. Registered number: 07602377. Registered office: 40 Preston Avenue, Alfreton, Derbyshire, DE55 7JY This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Packet House Limited. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error.

2 1

[Dovecot] Error: file_dotlock_open() failed with file + Too many open files
by Kavish Karkera 22 Sep '13

22 Sep '13

Hi All, We are getting these below error on our IMAP server. is this because of open file limits.?? We have set it to 4096. [root@vish conf.d]# ulimit -n 4096 Aug 27 16:08:26 imap(kavish.karkera(a)example.com-24685): Error: file_dotlock_open() failed with file /data/quarantine/index//data/quarantine/mailstore/24685/.INBOX.kavish.karkera/dovecot.index.cache: Too many open files Aug 27 16:08:26 imap(kavish.karkera(a)example.com-24685): Error: open(/data/quarantine/index//data/quarantine/mailstore/24685/.INBOX.kavish.karkera/dovecot.index.cache.lock) failed: Too many open files Below is our dovecot conf file. ====================================================================== # 2.2.5: /usr/local/dovecot-2.2.5/etc/dovecot-imap/dovecot.conf # OS: Linux 2.6.18-194.26.1.el5 x86_64 CentOS release 5.5 (Final) auth_socket_path = /usr/local/var/run/dovecot2.2-imap/auth-userdb base_dir = /usr/local/var/run/dovecot2.2-imap/ default_vsz_limit = 1 G first_valid_gid = 99 first_valid_uid = 99 hostname = log_path = /var/log/dovecot2.2-imap.log mail_location = maildir:~:INDEX=/data/quarantine/index/%h:CONTROL=/data/quarantine/index/%h mail_plugins = " virtual notify" namespace { inbox = no location = prefix = separator = . type = private } namespace { hidden = yes inbox = yes list = yes location = virtual:~/virtual:LAYOUT=maildir++:INDEX=~/virtual:CONTROL=~/virtual prefix = virtual. separator = . subscriptions = no type = private } namespace { hidden = yes inbox = no list = no location = maildir:~:INDEX=/data/quarantine/index/%h:CONTROL=/data/quarantine/index/%h:LAYOUT=maildir++ prefix = boxvirtual. separator = . subscriptions = no type = private } passdb { args = /usr/local/dovecot-2.2.5/etc/dovecot-imap/dovecot-sql.conf.ext driver = sql } protocols = imap service auth { unix_listener auth-userdb { group = nobody mode = 0666 user = nobody } } service imap-login { inet_listener imap { port = 20143 } vsz_limit = 1 G } service imap-postlogin { executable = script-login -d /usr/local/bin/dovecot.virtual.sh unix_listener imap-postlogin { mode = 0666 } } service imap { executable = /usr/local/dovecot-2.2.5/libexec/dovecot/imap imap-postlogin vsz_limit = 1 G } ssl = no userdb { args = /usr/local/dovecot-2.2.5/etc/dovecot-imap/dovecot-sql.conf.ext driver = sql } protocol imap { mail_max_userip_connections = 1000 mail_plugins = " virtual notify" } Regards, Kavish Karkera

2 1

[Dovecot] Logging pre-rewrite user ID for application-specific passwords
by Steven Murdoch 22 Sep '13

22 Sep '13

I have set up Dovecot v2.2.5 with application-specific passwords, along the lines of this blog post (http://www.dgsiegel.net/news/2013_05_21-application_specific_passwords_for_…) My users file looks like: user-foo:{BLF-CRYPT}$2...:42:42::/home/user::allow_nets=127.0.0.1/32 user=user user-bar:{BLF-CRYPT}$2...:42:42::/home/user::user=user user:{BLF-CRYPT}$2...:42:42::/home/user::nologin In this way, user-foo can log in with one password (but only from localhost), user-bar can log in from any host with a different password, but both actually being treated as the same user. When these users log in through, the log entries look like: Aug 26 23:03:01 hostname dovecot: imap-login: Login: user=<user>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=12345, TLS Whereas I would like to see the original user name (prior to the re-write), i.e. user-foo and user-bar so I can keep track of which user names are in use and from where. Is there some way to do this? I couldn't see any of the variables being suitable. There is some information in the debug logs, but I would prefer not to need to leave this on when I don't need them. Thanks in advance. Steven

2 1

[Dovecot] Dovecot never release preallocated space in mdbox
by Stéphane BERTHELOT 22 Sep '13

22 Sep '13

Hello everyone, I am currently evaluating dovecot for our new email production servers (20k+ mailboxes) and found out something strange. I'm using those settings on Dovecot 2.2.4 (x86_64 / Slackware / compiled from sources) mdbox_rotate_size = 128M mdbox_rotate_interval = 1d mdbox_preallocate_space = yes with virtual users and location like : mail_location = mdbox:~/mdbox I don't think the remaining config is relevant but ask me if you need some other parts. Using test accounts for 2 weeks now I've figured that the 128M preallocated space is never 'hole punched" (to use a similar term than "man fallocate" on Linux), even when rotating m.* files. From what I understand those files will never be appended again because of the mdbox_rotate_interval. Then doveadm purge creates new files so old ones would never grow again. Here is an example of a mdbox storage using ls -ls (which shows allocated VS used space) total 4065176 1884 -rw------- 1 mail mail 1926656 Jul 29 10:55 dovecot.map.index 4 -rw------- 1 mail mail 460 Jul 29 11:26 dovecot.map.index.log 48 -rw------- 1 mail mail 44304 Jul 29 10:55 dovecot.map.index.log.2 131072 -rw------- 1 mail mail 133165066 Jul 19 15:31 m.10 131072 -rw------- 1 mail mail 133507393 Jul 19 15:32 m.13 131072 -rw------- 1 mail mail 134155182 Jul 19 15:33 m.14 131072 -rw------- 1 mail mail 134213403 Jul 19 15:30 m.2 131072 -rw------- 1 mail mail 46464 Jul 21 04:30 m.21 131072 -rw------- 1 mail mail 134215030 Jul 19 15:30 m.3 131072 -rw------- 1 mail mail 25852 Jul 25 01:54 m.32 131072 -rw------- 1 mail mail 2360 Jul 26 00:05 m.34 131072 -rw------- 1 mail mail 169073 Jul 27 23:18 m.35 131072 -rw------- 1 mail mail 31624 Jul 27 01:55 m.36 131072 -rw------- 1 mail mail 134216982 Jul 28 04:30 m.37 131076 -rw------- 1 mail mail 134217804 Jul 28 04:30 m.38 131072 -rw------- 1 mail mail 134217341 Jul 28 04:30 m.39 131072 -rw------- 1 mail mail 134213719 Jul 19 15:30 m.4 131072 -rw------- 1 mail mail 29740970 Jul 28 04:30 m.40 131072 -rw------- 1 mail mail 129175917 Jul 28 04:30 m.41 131072 -rw------- 1 mail mail 133174937 Jul 28 04:30 m.42 131072 -rw------- 1 mail mail 633436 Jul 28 04:30 m.43 131072 -rw------- 1 mail mail 3154623 Jul 28 04:30 m.44 131072 -rw------- 1 mail mail 3676879 Jul 28 04:30 m.45 131072 -rw------- 1 mail mail 468158 Jul 28 04:30 m.46 131072 -rw------- 1 mail mail 26964 Jul 28 04:30 m.47 131072 -rw------- 1 mail mail 3574599 Jul 28 04:30 m.48 131072 -rw------- 1 mail mail 3789133 Jul 28 04:30 m.49 131072 -rw------- 1 mail mail 134215016 Jul 19 15:30 m.5 131072 -rw------- 1 mail mail 1280074 Jul 28 04:30 m.50 131076 -rw------- 1 mail mail 635459 Jul 28 22:47 m.51 131072 -rw------- 1 mail mail 1459418 Jul 29 10:55 m.52 131072 -rw------- 1 mail mail 132941013 Jul 29 11:26 m.53 131072 -rw------- 1 mail mail 134213475 Jul 19 15:30 m.7 131072 -rw------- 1 mail mail 132240074 Jul 19 15:31 m.9 There's a lot of "lost" space since preallocated space would only be reclaimed when *all* emails in m.X file have refcount=0 and after a doveadm purge call, if I read well the dovecot docs. On mailboxes patterns with low incoming mail (< 100kb / day) this would waste much space. Of course I can decrease rotate size a lot but it would then produce a lot of files and would certainly become similar performance-wise to sdbox/maildir/... There would certainly be smart to use something similar to "FALLOC_FL_PUNCH_HOLE" on rotation (when doing close() ?) so that when we're sure there won't be anymore data appended to file that the allocated space == used space. I will disable space preallocation for our next tests since it wastes much storage for us ; did you have any feedback on how much it may affect performance ? I found in this ML archives some messages about the implementation but didn't see anyone clearly stating how much better preallocation is. Thanks, best regards, Stephane Berthelot.

4 5