August 2014 - dovecot

Moving from one Dovecot server to another Dovecot server
by Michael 28 Aug '14

28 Aug '14

Hi, I'm planning to move all mailboxes from a Dovecot 2.2.10 server to a Dovecot 2.2.9 server. Dovecot is serving virtual users only. I'm not sure if I can use dsync for that. According to the Wiki [1] the command to mirror my own mailbox should look like dsync -u mine(a)michi.su mirror ssh -i my_ssh_key vmail(a)my-mailserver.com dsync -u mine(a)michi.su Where vmail is the user that is used by Dovecot to access mail_location. I assume the above command will only mirror the mailbox of user mine(a)michi.su, right? Is it possible to sync all mailboxes with just one single command? Is it possible to sync also all ACL lists and sieve scripts? Is using dsync the right way for my purpose? Thanks, Michael [1] http://wiki2.dovecot.org/Tools/Dsync

4 10

Dovecot Replication of Maildirs: Couldn't create lock file ... no such file or directory
by Asai 28 Aug '14

28 Aug '14

Greetings, I'm setting up replication and am getting this error from the server where the replicated mails are being initially created: Aug 27 11:03:53 molecular dovecot: dsync-server(user(a)domain.org): Error: Couldn't create lock /vmail/domain.org/user/home/.dovecot-sync.lock: No such file or directory Can anyone shed some light on this? Here's the Replicator config of the server which is being replicated to (initially), and it is identical basically with the "master" server: mail_plugins = notify replication service doveadm { inet_listener { port = 1234 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } service aggregator { fifo_listener replication-notify-fifo { user = vmail mode = 0600 } unix_listener replication-notify { user = vmail mode = 0600 } } plugin { mail_replica = tcp:sub.domain.org:1234 } And doveconf -n: [root@molecular dovecot]# doveconf -n # 2.2.13.16 (94835dd63163): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) ext4 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain deliver_log_format = msgid=%m: from=%f: %$ doveadm_password = secret doveadm_port = 1234 mail_debug = yes mail_home = /vmail/%d/%n/home mail_location = maildir:/vmail/%d/%n mail_plugins = notify replication managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { mail_log_fields = box msgid from flags mail_replica = tcp:sub.domain.org:1234 sieve = /vmail/%d/%n/home/.dovecot.sieve sieve_dir = /vmail/%d/%n/home/sieve } protocols = imap pop3 lmtp sieve service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0660 user = vmail } user = root } service doveadm { inet_listener { port = 1234 } } service imap-login { process_min_avail = 3 service_count = 0 vsz_limit = 0 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/postfix/ssl/sub.domain.org.pem ssl_key = </etc/postfix/ssl/domain.key userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { hostname = sub.domain2.org mail_plugin_dir = /usr/lib64/dovecot/ mail_plugins = sieve postmaster_address = postmaster(a)domain2.org } protocol imap { imap_idle_notify_interval = 24 mins mail_max_userip_connections = 60 } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 } Not sure if this helps but here's the ls -la output of /var/run/dovecot: [root@molecular dovecot]# ls /var/run/dovecot/ -la total 32 drwxr-xr-x. 5 root dovecot 4096 Aug 27 11:42 . drwxr-xr-x. 11 root root 4096 Aug 27 10:12 .. srw------- 1 root root 0 Aug 26 16:50 anvil srw------- 1 root root 0 Aug 26 16:50 anvil-auth-penalty srw------- 1 dovecot root 0 Aug 27 11:42 auth-client srw------- 1 dovecot root 0 Aug 27 11:42 auth-login srw-rw---- 1 vmail vmail 0 Aug 27 11:42 auth-master -rw------- 1 root root 32 Aug 26 16:50 auth-token-secret.dat srw-rw---- 1 vmail root 0 Aug 27 11:42 auth-userdb srw------- 1 dovecot root 0 Aug 27 11:42 auth-worker srw------- 1 root root 0 Aug 27 11:42 config srw------- 1 root root 0 Aug 27 11:42 dict srw------- 1 root root 0 Aug 27 11:42 director-admin srw-rw-rw- 1 root root 0 Aug 27 11:42 dns-client srw------- 1 root root 0 Aug 27 11:42 doveadm-server lrwxrwxrwx 1 root root 25 Aug 26 16:50 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x. 2 root root 4096 Aug 22 09:39 empty srw-rw-rw- 1 root root 0 Aug 27 11:42 imap-urlauth srw------- 1 dovecot root 0 Aug 27 11:42 imap-urlauth-worker srw-rw-rw- 1 root root 0 Aug 27 11:42 indexer srw------- 1 dovecot root 0 Aug 27 11:42 indexer-worker srw------- 1 root root 0 Aug 27 11:42 ipc srw-rw-rw- 1 root root 0 Aug 27 11:42 lmtp srw------- 1 root root 0 Aug 27 11:42 log-errors drwxr-x---. 2 root dovenull 4096 Aug 27 11:42 login -rw------- 1 root root 5 Aug 26 16:50 master.pid -rw-r--r-- 1 root root 22 Aug 26 16:50 mounts srw------- 1 vmail root 0 Aug 27 11:42 replication-notify prw------- 1 vmail root 0 Aug 27 11:42 replication-notify-fifo srw------- 1 dovecot root 0 Aug 27 11:42 replicator srw------- 1 dovecot root 0 Aug 27 11:42 replicator-doveadm srw-rw-rw- 1 root root 0 Aug 27 11:42 ssl-params srw------- 1 root root 0 Aug 27 11:42 stats prw------- 1 root root 0 Aug 27 11:42 stats-mail drwxr-x---. 2 root dovenull 4096 Aug 27 11:42 token-login -- --Asai

1 2

Panic at virtual folder fts-search-serialize.c
by Janette Kelm 27 Aug '14

27 Aug '14

Hi all, I'm using dovecot 2.2.13 with virtual folders and fts-solr (see attached dovecot-n.conf). At using virtual folder with fts, the dovecot crashes with following panic: Aug 20 10:49:43 imap(...): Panic: file fts-search-serialize.c: line 63 (fts_search_deserialize_add_idx): assertion failed: (*idx < buf->used) Aug 20 10:49:43 imap(test4(a)india.com): Error: Raw backtrace: /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x6c6ca) [0x7f93de51c6ca] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x6c746) [0x7f93de51c746] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x2542a) [0x7f93de4d542a] -> /opt/dovecot2/modules/lib20_fts_plugin.so(+0xc757) [0x7f93dd4e1757] -> /opt/dovecot2/modules/lib20_fts_plugin.so(fts_search_deserialize_add_nonmatches+0x1c) [0x7f93dd4e177c] -> /opt/dovecot2/modules/lib20_fts_plugin.so(+0xdafe) [0x7f93dd4e2afe] -> /opt/dovecot2/modules/lib20_fts_plugin.so(+0xdcd2) [0x7f93dd4e2cd2] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(+0xa96da) [0x7f93de82b6da] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x48) [0x7f93de82bd28] -> /opt/dovecot2/modules/lib20_virtual_plugin.so(virtual_search_next_nonblock+0x13e) [0x7f93dd2cd73e] -> /opt/dovecot2/modules/lib20_virtual_plugin.so(virtual_search_next_nonblock+0x7e) [0x7f93dd2cd67e] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f93de803f17] -> dovecot/imap() [0x41dddf] -> dovecot/imap() [0x41e462] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xbb) [0x7f93de52d23b] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x61) [0x7f93de52df81] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f93de52ce89] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f93de52cf18] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f93de4d9f33] -> dovecot/imap(main+0x2a8) [0x421278] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f93de145cad] -> dovecot/imap() [0x40bda9] Aug 20 10:49:43 imap(...): Fatal: master: service(imap): child 7254 killed with signal 6 (core dumps disabled) imap-commands: telnet localhost imap ... 3 select virtual/all 4 search text searchtext - > panic crash (see above) So I do nothing special, I just do fts in the virtual folder. At google I found the patch http://hg.dovecot.org/dovecot-2.2/rev/d63b209737be, but this is already included in dovecot2.2.13, so it is not the reason. Regards, Janette

1 1

LMTP and passdb deny=yes not working
by Jogi Hofmüller 27 Aug '14

27 Aug '14

Hi all, I start this on in a new thread. I setup the deny-user setting to temporarily prevent users from logging in and (that would be great) also stop mail delivery for said user. All this is because of our upcoming migration. Now it seems that lmtp is ignoring this setting. This is from the logfile: Aug 21 13:01:00 klee dovecot: lmtp(pid): Connect from IP Aug 21 13:01:00 klee dovecot: auth: passwd-file(fischer,IP): User found from deny passdb Aug 21 13:01:00 klee dovecot: lmtp(pid, fischer): 2UErAGzR9VMBPQAAGyzfLQ: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Aug 21 13:01:00 klee dovecot: lmtp(pid): Disconnect from 172.16.16.205: Successful quit So lmtp seems to find the user and correctly states the fact but then stores the email anyhow. Is this intended or did I hit a bug? Or do I have an error in my config? Cheers, -- j.hofmüller mur.sat -- a space art project http://sat.mur.at/

3 6

multiple IMAP sessions when connecting from one client
by Martin Vegter 27 Aug '14

27 Aug '14

Hello, I am using Postfix/Dovecot/IMAP. Everything is working fine, but I have noticed that every time I connect with Thunderbird to my server via IMAP, not one but 4 connections are being logged into /var/log/mail/mail.log: 2014-08-27 09:17:46 dovecot: imap-login: Login: user=<martin>, method=PLAIN, rip=11.22.33.44, lip=55.66.77.88, mpid=12519, TLS, session=<uyb/N5cB+gBUDFRB> 2014-08-27 09:17:53 dovecot: imap-login: Login: user=<martin>, method=PLAIN, rip=11.22.33.44, lip=55.66.77.88, mpid=12521, TLS, session=<jioqN5cB/ABUDFRB> 2014-08-27 09:17:53 dovecot: imap-login: Login: user=<martin>, method=PLAIN, rip=11.22.33.44, lip=55.66.77.88, mpid=12523, TLS, session=<pqwwN5cB/QBUDFRB> 2014-08-27 09:17:54 dovecot: imap-login: Login: user=<martin>, method=PLAIN, rip=11.22.33.44, lip=55.66.77.88, mpid=12525, TLS, session=<cffremmc/gBUDFRB> This looks like 4 separate sessions are created when I log in from one client. Is this normal behavior? Can somebody please explain why this is so? My Dovecot version is 2.1.7 regards, Martin

5 5

Help with transaction log and index file corruption.
by CLMDRIVE 27 Aug '14

27 Aug '14

I am using dovecot 2.2.13 on a VPS. One (only one!) of the users is experiencing IMAP disconnections. The maillog file is full of errors about corrupted transaction log and index files. The configurations follows: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-028stab107.1 x86_64 CentOS release 6.4 (Final) auth_cache_size = 1 k auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } plugin { acl = vfile quota = maildir quota_rule = INBOX.Trash:ignore } protocols = imap service auth { unix_listener auth-client { mode = 0666 } } service imap-login { client_limit = 500 inet_listener imap { address = * } inet_listener imaps { address = * } process_limit = 50 process_min_avail = 5 service_count = 0 vsz_limit = 64 M } service imap { process_limit = 512 vsz_limit = 256 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 5 service_count = 0 vsz_limit = 64 M } service managesieve { process_limit = 512 vsz_limit = 256 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = * } inet_listener pop3s { address = * } process_limit = 50 process_min_avail = 5 service_count = 0 vsz_limit = 64 M } service pop3 { process_limit = 512 vsz_limit = 256 M } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ALL:!ADH:RC4+RSA:+HIGH:+MEDIUM:-LOW:-SSLv2:-EXP ssl_key = </etc/dovecot/ssl/dovecot.key userdb { driver = prefetch } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 30 mail_plugins = acl quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lda { postmaster_address = postmaster(a)example.com } Can anyone help me on this??? I am about to cry! thank you! Claudio

3 2

Problem with BINARY extension (Invalid data in MIME part)
by Pavel M. 27 Aug '14

27 Aug '14

1 0

crash with "The specified message set is invalid."
by Ralf Hildebrandt 27 Aug '14

27 Aug '14

We're using dovecot as a proxy between the user and an exchange server. All over a sudden we're getting: Aug 27 13:16:07 mproxy dovecot: imap(username): Fatal: master: service(imap): child 18376 killed with signal 6 (core dumps disabled) Aug 27 13:16:09 mproxy dovecot: imap(username): Error: imapc(email.charite.de:993): Command '12 UID FETCH 0 (BODY.PEEK[])' failed with BAD: 12 The specified message set is invalid. Aug 27 13:16:09 mproxy dovecot: imap(username): Error: imapc: Mail FETCH failed: The specified message set is invalid. Aug 27 13:16:09 mproxy dovecot: imap(username): Panic: file mail-index-map.c: line 547 (mail_index_map_lookup_seq_range): assertion failed: (first_uid > 0) Aug 27 13:16:09 mproxy dovecot: imap(username): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5f770) [0x7f76ad2d9770] -> /usr/lib/dovecot/libdovecot.so.0(+0x5f84e) [0x7f76ad2d984e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f76ad293f2e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xac44e) [0x7f76ad5f044e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq+0x12) [0x7f76ad601372] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5ad94) [0x7f76ad59ed94] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5af02) [0x7f76ad59ef02] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_hdr_stream+0x34) [0x7f76ad5adb44] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_header_stream+0x107) [0x7f76ad5d7247] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5ab09) [0x7f76ad59eb09] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5ab95) [0x7f76ad59eb95] -> /usr/lib/dovecot/modules/lib20_mail_log_plugin.so(+0x1a0c) [0x7f76ac8a9a0c] -> /usr/lib/dovecot/modules/lib20_mail_log_plugin.so(+0x2159) [0x7f76ac8aa159] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(notify_contexts_mail_copy+0x5c) [0x7f76acaad18c] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x22c6) [0x7f76acaae2c6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6d) [0x7f76ad5b5fdd] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7f76ad5b60b5] -> dovecot/imap [username 91.22.142.109 UID move]() [0x40ca95] -> dovecot/imap [username 91.22.142.109 UID move](command_exec+0x3c) [0x416cfc] -> dovecot/imap [username 91.22.142.109 UID move]() [0x415d5f] -> dovecot/imap [username 91.22.142.109 UID move]() [0x415e15] -> dovecot/imap [username 91.22.142.109 UID move](client_handle_input+0x115) [0x416115] -> dovecot/imap [username 91.22.142.109 UID move](client_input+0x72) [0x4164a2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x3f) [0x7f76ad2e9e6f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7f76ad2ead77] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f76ad2e9ed9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f76ad2e9f58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f76ad299133] -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

LMTP during dsync migration
by Jogi Hofmüller 27 Aug '14

27 Aug '14

Hi all, Another question regarding migration. While migrating a mailbox with dsync is it safe to deliver mail via LMTP to the new (target) mailbox or is it wiser to deactivate LMTP delivery to this mailbox until it's fully migrated? And what methods could I use to stop delivery to a mailbox during migration? Our user data is stored on an LDAP server. Cheers, -- j.hofmüller http://thesix.mur.at/

8 18

Special-Use Mailboxes ?
by Per Jessen 27 Aug '14

27 Aug '14

Lots of people must have had this issue before me - users using different devices&software (pc, smartphone, tablet, thunderbird, outlook, webmail) and languages (e.g. English on the PC, German on the iPhone), some folders end of with different names - e.g. "Sent" and "Gesendete Elemente" - meaning the same thing, namely "sent mails". How do you map these to just one folder such that it shows up correctly independently of what the user happens to be using? It sounds like something for the mailbox "Sent" { special_use = \Drafts } config directive? Is that what it might be used for? mailbox "Sent" { special_use = \Sent } mailbox "Gesendete Elemente" { special_use = \Sent } -- Per Jessen, Zürich (12.9°C) http://www.dns24.ch/ - free dynamic DNS, made in Switzerland.

5 15