September 2013 - dovecot

[Dovecot] unable to lock for exclusive access: Resource temporarily unavailable
by Nikos Papadopoulos 25 Sep '13

25 Sep '13

Dears, We have a mail server (RHEL 6.0, Postfix and Dovecot 1.0.7). The output of dovecot -n is the following: # 1.0.7: /etc/dovecot.conf protocols: pop3 login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/pop3-login mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable: /usr/libexec/dovecot/pop3 mail_plugin_dir: /usr/lib/dovecot/pop3 pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam userdb: driver: passwd During the last days we face the following problem: There is great delay in the delivery of the emails. Some seem to not be delivered at all. Issuing the mailq command we get the following message for almost all the email accounts: (cannot update mailbox /var/mail/xyz for user xyz. unable to lock for exclusive access: Resource temporarily unavailable) Please send to me any suggestions, because I cannot resolve it and I receive a lot of pressure. Best Regards, Nikos

4 3

[Dovecot] (no subject)
by Greg Ryman 25 Sep '13

25 Sep '13

Hello, I've been out of the sysadmin game for some time and I've recently setup a mail server. Everything is working except for the quota, which I believe is likely an error in how I'm using my SQL queries. Any guidance, pointers, or advice would be greatly appreciated. root@mail:/etc/dovecot/conf.d# dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab079.6 x86_64 Ubuntu 12.04.3 LTS reiserfs auth_mechanisms = plain login dict { sqldomainquota = mysql:/etc/dovecot/dovecot-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } first_valid_uid = 150 last_valid_uid = 150 mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_allow_append_to_spam = YES antispam_backend = dspam antispam_dspam_args = --user;%u;--deliver=;--source=error antispam_dspam_binary = /usr/bin/dspam antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam;Junk antispam_trash = trash;Trash autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autocreate5 = Archive quota = dict:User Quota::proxy::sqluserquota quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_after = /etc/sieve/conf.d/after sieve_before = /etc/sieve/conf.d/before sieve_dir = ~/sieve } postmaster_address = admin(a)gryman.com protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve autocreate quota" } protocol lda { mail_plugins = sieve quota } protocol imap { mail_plugins = quota antispam autocreate quota imap_quota } root@mail:/etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = mysql connect = host=localhost dbname=mail user=mail password=mailpassword default_pass_scheme = MD5-CRYPT password_query = \ SELECT username as user, password, '/var/vmail/%d/%n' as userdb_home, \ 'maildir:/var/vmail/%d/%n' as userdb_mail, 150 as userdb_uid, 8 as userdb_gid \ FROM mailbox WHERE username = '%u' AND active = '1' user_query = \ SELECT '/var/vmail/%d/%n' as home, 'maildir:/var/vmail/%d/%n' as mail, \ 150 AS uid, 8 AS gid, concat('dirsize:storage=', quota) AS quota \ FROM mailbox WHERE username = '%u' AND active = '1' root@mail:/etc/dovecot# tail -n 8 /etc/postfix/master.cf # DSPAM dspam unix - n n - 10 pipe flags=Ru user=dspam argv=/usr/bin/dspam --deliver=innocent,spam --user $recipient -i -f $sender -- $recipient # Integration with Dovecot - hand mail over to it for local delivery, and # run the process under the vmail user and mail group. dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/dovecot-lda -d $(recipient) -- Greg Ryman

6 9

[Dovecot] 2048-bit Diffie-Hellman parameters
by Marios Titas 25 Sep '13

25 Sep '13

Currently, dovecot generates two primes for Diffie-Hellman key exchanges: a 512-bit one and a 1024-bit one. In light of recent events, I think it would be wise to add support for 2048-bit primes as well, or even better, add a configuration option that lets the user select a file (or files) containing the DH parameters In recent years, there has been increased interest in DH especially in its ephemeral version (DHE) because it provides perfect forward secrecy. In that context, the use of 1024-bit parameters might not seem such a terrible idea: if someone cracks the ephemeral key then they will only gain access to the data exchanged during that particular session. Therefore, it might not be worth the effort to crack such a key. But this is certainly not the case for IMAPS: it is quite likely that the session data will include the user's credentials.

9 11

[Dovecot] Delete to Archive?
by James E. Pace 24 Sep '13

24 Sep '13

Hi, I recently switched from being a Gmail user to running Dovecot [2.1.10] on my server. Thank you for an easy to use piece of software that solves problems! I am trying (unsuccessfully) to replicate something from GMail. When I delete a message on my iPhone (or other client), I would like to have it moved to an "All Mail" or Archive folder, instead of actually deleting it. Is this possible? Thanks, James

5 7

[Dovecot] Apple IOS 7 Mail APP uses multi body searches by default
by Urban Loesch 24 Sep '13

24 Sep '13

Hi, today we found this blogpost: http://blog.fastmail.fm/2013/09/17/ios-7-mail-app-uses-multi-folder-body-se… Have you any idea if this could impact performance of dovecot using mdbox format with 10MB per file size and zlib enabled? Thanks and regards Urban Loesch

2 1

[Dovecot] still having dsync issues after upgrading to latest
by Matthew Kaufman 24 Sep '13

24 Sep '13

Trying to migrate a bunch of users with mbox format to maildir format. dsync creates some directories, but otherwise does nothing. (Complained about the lack of "/" as separator until I added that to config, now is silent when running dsync except with the -D flag) I have tried dumping all the dovecot that came with my OS and built the latest sources, hoping I'd at least get a little better debug information out... but no luck. Lots of hopefully useful output below. What am I doing wrong? Matthew Kaufman # dovecot -n # 2.2.5: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 ext4 auth_mechanisms = plain login first_valid_uid = 4999 mail_gid = 5000 mail_location = maildir:/var/mail/%d/%n mail_privileged_group = mail mail_uid = 5000 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_allow_append_to_spam = YES antispam_backend = dspam antispam_dspam_args = --user;%u;--deliver=;--source=error antispam_dspam_binary = /usr/bin/dspam antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam;Junk antispam_trash = trash;Trash sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)eeph.com protocols = imap lmtp service auth-worker { user = mail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = mail } user = dovecot } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } user = mail } service pop3-login { inet_listener pop3 { port = 0 } } ssl_cert = </etc/ssl/local/....crt ssl_key = </etc/ssl/local/....key userdb { args = uid=5000 gid=5000 home=/var/mail/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol imap { mail_plugins = " antispam" } # rm -r /var/mail/matthew.at # /usr/local/bin/dsync -D -u matthew(a)matthew.at mirror mbox:./Mail:INBOX=./matthew doveadm(root): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(matthew(a)matthew.at): Debug: Effective uid=5000, gid=5000, home=/var/mail/matthew.at/matthew doveadm(matthew(a)matthew.at): Debug: Home dir not found: /var/mail/matthew.at/matthew doveadm(matthew(a)matthew.at): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/matthew.at/matthew doveadm(matthew(a)matthew.at): Debug: maildir++: root=/var/mail/matthew.at/matthew, index=, indexpvt=, control=, inbox=/var/mail/matthew.at/matthew, alt= doveadm(matthew(a)matthew.at): Debug: Namespace : /var/mail/matthew.at/matthew doesn't exist yet, using default permissions doveadm(matthew(a)matthew.at): Debug: Namespace : Using permissions from /var/mail/matthew.at/matthew: mode=0700 gid=default dsync(matthew(a)matthew.at): Debug: Effective uid=5000, gid=5000, home=/var/mail/matthew.at/matthew dsync(matthew(a)matthew.at): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:./Mail:INBOX=./matthew dsync(matthew(a)matthew.at): Debug: fs: root=./Mail, index=, indexpvt=, control=, inbox=./matthew, alt= dsync(matthew(a)matthew.at): Debug: Namespace : ./Mail doesn't exist yet, using default permissions dsync(matthew(a)matthew.at): Debug: Namespace : Using permissions from ./Mail: mode=0700 gid=default dsync(matthew(a)matthew.at): Debug: brain M: in state=master_recv_handshake dsync(matthew(a)matthew.at): Debug: brain M: out state=send_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain S: out state=send_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=send_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain M: out state=send_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=send_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain S: out state=send_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=send_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain M: out state=recv_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=send_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain S: out state=recv_mailbox_tree changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=recv_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain M: out state=recv_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=recv_mailbox_tree dsync(matthew(a)matthew.at): Debug: brain S: out state=recv_mailbox_tree_deletes changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=recv_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain M: out state=master_send_mailbox changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=recv_mailbox_tree_deletes dsync(matthew(a)matthew.at): Debug: brain S: out state=slave_recv_mailbox changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=master_send_mailbox dsync(matthew(a)matthew.at): Debug: brain M: out state=done changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=slave_recv_mailbox dsync(matthew(a)matthew.at): Debug: brain S: out state=done changed=1 dsync(matthew(a)matthew.at): Debug: brain M: in state=done dsync(matthew(a)matthew.at): Debug: brain M: out state=done changed=1 dsync(matthew(a)matthew.at): Debug: brain S: in state=done dsync(matthew(a)matthew.at): Debug: brain S: out state=done changed=1 # # ls -l /var/mail/matthew.at total 4 drwx--S--- 3 vmail vmail 4096 Sep 24 17:50 matthew # ls -l /var/mail/matthew.at/matthew total 4 drwx--S--- 2 vmail vmail 4096 Sep 24 17:50 Mail # ls -l /var/mail/matthew.at/matthew/Mail total 0

2 2

[Dovecot] imaptest-20130617 seems to be reporting spurious header changes
by Mark Weaver 24 Sep '13

24 Sep '13

I'm trying to use this to test an IMAP server I'm developing (I picked the nightly up from the link on the wiki page at http://www.imapwiki.org/ImapTest/Installation) With one client using the mailbox dovecot-crlf (http://www.dovecot.org/tmp/dovecot-crlf) I get messages like: Error: test(a)npsl.co.uk[67]: 1035253882.5041.34.camel@hurina: Header From changed 'Timo Sirainen <tss(a)iki.fi> Timo Sirainen <tss(a)iki.fi' (len 52) -> 'Timo Sirainen <tss(a)iki.fi>' (len 26): * 1 FETCH (UID 2093 FLAGS () BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 913 0) BODY[HEADER.FIELDS (From From Delivered-To) ] "From: Timo Sirainen <tss(a)iki.fi> From: Timo Sirainen <tss(a)iki.fi> Delivered-To: dovecot(a)procontrol.fi " ENVELOPE ("22 Oct 2002 05:31:22 +0300" "[dovecot] Re: Architectural questions" (("Timo Sirainen" NIL "tss" "iki.fi")) (("" NIL "dovecot-bounce" "procontrol.fi")) (("Timo Sirainen" NIL "tss" "iki.fi")) (("" NIL "dovecot" "procontrol.fi")) NIL NIL "<1035249894.5044.28.camel@hurina>" "<1035253882.5041.34.camel@hurina>") BODY[HEADER.FIELDS (Cc Cc From) ] "From: Timo Sirainen <tss(a)iki.fi> ") (I added the dump of the string length by modifying the code). As I am reading it the test program has got the wrong string rather than the server -- the From header in the mbox file is From: Timo Sirainen <tss(a)iki.fi> which is 26 characters long, not 52, and includes the closing angle bracket, and the code that prints the header out is in src/mailbox-state.c, line 377: client_state_error(client, "%s: Header %s changed '%.*s' (len %d) -> '%.*\ s' (len %d)", msg->message_id, fetch_headers[i].name, (int)orig_headers[j].value_len, (const char *)orig_headers[j].value, (int)orig_headers[j].value_len, (int)fetch_headers[i].value_len, (const char *)fetch_headers[i].value, (int)fetch_headers[i].value_len); Have I read this upside down or is there an issue with the tests? If it is an issue with the tests, any pointers as to where to start looking for the issue would be helpful. Thanks, Mark

2 1

Re: [Dovecot] Problem getting a dovecot proxy to connect to another dovecot machine via STARTTLS
by Arnoud van Heuvelen 24 Sep '13

24 Sep '13

I've solved the issue by setting ssl to 'any-cert' and starttls to NULL. This does a proper SSL request to the node. I still don't understand why Dovecot does a non-SSL request on an SSL port whenever I enable starttls, but I'm happy using normal SSL. Regards,

1 0

Re: [Dovecot] Bug report: "doveadm rename" encodes special characters wrongly in mUTF-7 (in fs)
by megodin＠inboxalias.com 24 Sep '13

24 Sep '13

> If doveadm says it's invalid UTF-8, it's invalid UTF-8. I guess your > terminal isn't actually using UTF-8 then, but something else. ("locale" > output should say something about UTF-8.) I guess doveadm could also > automatically translate parameters to UTF-8, but that's a bit annoying > to implement. You were absolutely right. After thorough testing I could make up the problem to the SSH-Client PuTTY I was using on a Windows machine while testing. The default "remote character setting" is "ISO-8859-1:1998 (Latin-1, West Europe)", when re-setting to "UTF-8", opening a new shell and testing the "doveadm mailbox rename ..." with german umlauts just works fine then. (Just for the sake of completeness, the "locale" settings were set to (LANG=de_DE.utf-8) globally in /etc/sysconfig/i18n per default.) > The problem here is that * is expanded by your shell, not doveadm. > And it expands into Tr&-AOQ-sh as it's in the filesystem, but that's > only the mUTF-7 encoding of it. The UTF-8 version of the name is > Tr&AOQ-sh. So doveadm only sees that you attempted to resync a > nonexistent mailbox. Using '*' with quotes would work, since doveadm > would do the expansion then. Thanks for pointing that * / '*' issue out. I now unterstand that the "doevadm mailbox rename" converts the input to UTF _before_ applying it in the filesystem. Now it makes sense that doveadm mailbox rename -u user 'Trash' 'Tr&AOQ-sh' must be expanded to Tr&-AOQ-sh. The "-" character directly after the "&"in Tr&-AOQ-sh comes from a special mUTF-Specification (as stated in RFC 3501, section 5.1.3): "In modified UTF-7, printable US-ASCII characters, except for "&", represent themselves; that is, characters with octet values 0x20-0x25 and 0x27-0x7e. The character "&" (0x26) is represented by the two-octet sequence "&-"." So e.g. if I wanted a german umlaut to be encoded in the filesystem, I must enter it directly into dovedm instead of the UTF encoded value. One small point left... > The UTF-8 version of the name is Tr&AOQ-sh Just for understanding - "Tr&AOQ-sh" is IMHO UTF-7, not UTF-8. Accordingly to what stated before, "Tr&-AOQ-sh" and "Tr&AOQ-sh" are encoded both the same (UTF-7), the first seen in clients as "Tr&AOQ-sh" and the second as "TrÃ¤sh". Thanks for all your help! Megodin --- Alle PostfÃ¤cher an einem Ort. Jetzt wechseln und E-Mail-Adresse mitnehmen! http://email.freenet.de/basic/Informationen _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com

1 0

[Dovecot] Linux SO_REUSEPORT
by Timo Sirainen 24 Sep '13

24 Sep '13

I just read about Linux v3.9's SO_REUSEPORT feature and decided to implement it for Dovecot. Would be interesting to know how it works for people :) It's going to be in v2.2.6, which I'm planning on releasing tomorrow. Note especially the warning about the bug: http://hg.dovecot.org/dovecot-2.2/rev/a991a0547daa So the idea is that you'd do something like: service imap-login { inet_listener imap { reuse_port = yes } process_min_avail = 4 # number of CPU cores } And the load should be distributed more evenly to the processes.

4 4