- dovecot - dovecot.org

Migrating from 2.0.x to 2.2
by Jens Dueholm Christensen 05 Sep '14

05 Sep '14

Hi I'm about to migrate a setup with <20 IMAP (but with a few million mails in all) accounts that belong to the same system-user on an older machine running Dovecot 2.0.13 to a new machine running Dovecot 2.2.13 (or possibly newer..). Mails are stored in Maildirs with no special or advanced features (like alternate storage etc etc). Filesystems are prepared for the expected amount of inodes required, and for the time beeing a change to mdbox is seen as an added complexity. One requirement of the migration is that messageID is not changed - mails are referenced by other systems that expect to find individual mails by the ID. Since dsync is incompatible between 2.0<->2.1<->2.2 what is the best way to perform this migration? I was hoping of rsync'ing all Maildirs from the old machine to the new one (including indexes etc etc) and power up Dovecot 2.2.x and see what happens, but is that possible or is there another (and better) way short of installing 2.0.x on the new machine, rsync everything and then upgrade to 2.2.x? Regards, Jens Dueholm Christensen

3 4

how to profiling imap process with valgrind
by morrison 04 Sep '14

04 Sep '14

Hi, I want to profile runtime performance of imap and pop3 processes. There processes are forked by dovecot master process. I am wondering if there is a way I can profile these processes with valgrind. I tried "service = /bin/valgrind /bin/imap" but this did not work. Thanks,

2 1

SASL LOGIN : connection to server lost with more than 10 simulatneaous postfix smtps
by Ve (HOME) 04 Sep '14

04 Sep '14

Hi All, I have a problem with SASL authentification from postfix when more than 10 mails is sent from the same user simultaneously Postfix abort connection ( Connection lost to authentication server ). Dovecot log after the postfix error an error about connection lost also ( read EOF ) I don't seem to find a parameter for a maximum of connection for the auth process ( ther's one for imap, pop, .. ) but none for auth. Do you have an idea of a way to solve this problem or to have better information ? result of Docecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.15.6-gentoo-xxxx-std-ipv6-64 x86_64 Gentoo Base System release 2.2 auth_default_realm = aprogsys.com auth_mechanisms = plain login auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u first_valid_uid = 1001 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = dovecot mail_location = mdbox:~/mdbox mail_plugins = " acl notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = * driver = pam } plugin { acl = vfile acl_anyone = allow acl_shared_dict = proxy::acl antispam_backend = DSPAM antispam_debug_target = syslog antispam_dspam_args = --source=error;--signature=%%s;--user;%n antispam_dspam_binary = /usr/bin/dspam antispam_signature = X-DSPAM-Signature antispam_spam = SPAM antispam_trash = Trash antispam_verbose_debug = 1 mail_replica = remote:root@192.168.1.7 replication_dsync_parameters = -d -U sieve = ~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve sieve_default = /var/lib/dovecot/sieve/spam.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve replication_max_conns = 2 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0777 } user = root } service dict { unix_listener dict { mode = 0666 } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/ssl/dovecot/server.pem ssl_key = </etc/ssl/dovecot/server.pem userdb { driver = passwd } protocol lda { mail_plugins = " acl notify replication sieve" } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 40 mail_plugins = " acl notify replication antispam imap_acl" }

3 2

Trying Dovecot Replication with dsync
by Listas＠Adminlinux 04 Sep '14

04 Sep '14

Hi, I have a failover cluster for mail server with: Ubuntu12.04 + DRBD (for block replication) + Ext4 filesystem + Dovecot-2.0.19-2 with Mdbox It works fine with ~50k accounts. My cluster design: http://adminlinux.com.br/cluster_design.txt I plan to test Dovecot Replication with dsync to build an active/active cluster with load balancing. Can anyone direct me to some literature? A tutorial for example. I'm installing a cluster (for tests) with Ubuntu 14.04 + Ext4 filesystem (without Drbd) + Dovecot-2.2.9-1ubuntu2.1. My conf is in: http://adminlinux.com.br/replication-doveconf.txt I'm following this doc http://wiki2.dovecot.org/Replication but I'm getting some errors: 1) Aug 14 15:39:34 ceph1 dovecot: imap(account=domaintest.com): Error: open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied What is the correct perms for /var/run/dovecot/replication-notify-fifo ? Currently: # ll /var/run/dovecot/replication-notify-fifo prw------- 1 root root 0 Aug 14 15:57 /var/run/dovecot/replication-notify-fifo| 2) Aug 14 16:02:34 ceph1 dovecot: dsync-server(account=domaintest.com): Error: Couldn't create lock /var/lib/imap/account=domaintest.com/.dovecot-sync.lock: No such file or directory Aug 14 16:02:34 ceph1 dovecot: dsync-local(account=domaintest.com): Error: Couldn't create lock /var/lib/imap/account=domaintest.com/.dovecot-sync.lock: No such file or directory In my production cluster, it is automatically created by dovecot when the user performs the first login: /var/lib/imap/<account> for INDEX /var/spool/imap/<account> for Mdbox Thanks! -- Thiago Henrique

2 2

Some Dsync Replication Errors
by Asai 03 Sep '14

03 Sep '14

Greetings, Working on setting up replication and ran into some errors I have questions about and wondering if there's something I need to change. This one is fairly common: Sep 3 12:58:25 molecular dovecot: dsync-server(user(a)domain.org): Warning: Failed to do incremental sync for mailbox INBOX, retry with a full sync (Modseq 100298 no longer in transaction log) These two I ran into yesterday and today: Sep 2 11:13:32 molecular dovecot: dsync-server(user2(a)domain2.org): Error: Timeout during state=slave_recv_last_common Sep 3 12:52:08 molecular dovecot: dsync-server(user3(a)domain3.org): Error: read(remote.mailserver.net) failed: EOF Configs: mail_plugins = notify replication service doveadm { inet_listener { port = 1234 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } service aggregator { fifo_listener replication-notify-fifo { user = vmail mode = 0600 } unix_listener replication-notify { user = vmail mode = 0600 } } plugin { mail_replica = tcp:sub.domain.org:1234 } And doveconf -n: [root@molecular dovecot]# doveconf -n # 2.2.13.16 (94835dd63163): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) ext4 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain deliver_log_format = msgid=%m: from=%f: %$ doveadm_password = secret doveadm_port = 1234 mail_debug = yes mail_home = /vmail/%d/%n/home mail_location = maildir:/vmail/%d/%n mail_plugins = notify replication managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { mail_log_fields = box msgid from flags mail_replica = tcp:sub.domain.org:1234 sieve = /vmail/%d/%n/home/.dovecot.sieve sieve_dir = /vmail/%d/%n/home/sieve } protocols = imap pop3 lmtp sieve service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0660 user = vmail } user = root } service doveadm { inet_listener { port = 1234 } } service imap-login { process_min_avail = 3 service_count = 0 vsz_limit = 0 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/postfix/ssl/sub.domain.org.pem ssl_key = </etc/postfix/ssl/domain.key userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { hostname = sub.domain2.org mail_plugin_dir = /usr/lib64/dovecot/ mail_plugins = sieve postmaster_address = postmaster(a)domain2.org } protocol imap { imap_idle_notify_interval = 24 mins mail_max_userip_connections = 60 } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 } -- --Asai

1 0

Insert custom header in Mail logger plugin
by Bruno Galindro da Costa 03 Sep '14

03 Sep '14

Is it possible to log a message custom header through Mail logger plugin or other method? It seems that there are a fixed number of info that is configurable via mail_log_fields (http://wiki2.dovecot.org/Plugins/MailLog) .. My custom header is X-VERTICAL-IP-Quarantine-ID and I want a log event like this one: Aug 27 09:48:13 imap dovecot: imap(user@domain): copy from INBOX: box=SPAM, uid=213, *X-VERTICAL-IP-Quarantine-ID=u7cnUqYDPA9a*, msgid=< 0.0.D7.290.1CFC155CE887302.0(a)etm2.com>, size=26481, vsize=26949, from==?UTF-8?Q?Dafiti=20-=20Parceiros?= <aaa@domain>, subject==?UTF-8?Q?Sapatos=20com=2040%OFF?==?UTF-8?Q?!=20Apro?=? =?UTF-8?Q?veite!?= -- Att. Bruno Galindro da Costa

2 3

Setup sieve failed
by Christian Vielhauer 03 Sep '14

03 Sep '14

Hi, I try to setup sieve but I have some trouble. Using dovecot 2.2.9 on Ubuntu 14.04.1 LTS. I replaced my correct domain with „domain.tld“. I am able to create sieve scripts using SOGo. The scripts are created in my mailbox. For example in /var/www/kunden/mail/domain.tld/testuser/sieve/sogo.sieve I have the following script and in same ~/sieve folder is a subdirectory available that’s called "tmp“: ~/sieve ~/sieve/tmp require ["vacation"]; if allof ( not exists ["list-help", "list-unsubscribe", "list-subscribe", "list-owner", "list-post", "list-archive", "list-id", "Mailing-List"], not header :comparator "i;ascii-casemap" :is "Precedence" ["list", "bulk", "junk"], not header :comparator "i;ascii-casemap" :matches "To" "Multiple recipients of*" ) {vacation :days 1 :addresses [„testuser(a)domain.tld"] text: This is a vacation test message. Please ignore. . ; } Now I open /var/log/mail.err and I can see the following: Sep 3 17:50:09 mail dovecot: imap(testuser(a)domain.tld): Error: stat(/var/www/kunden/mail/domain.tld/testuser/.dovecot.sieve/tmp) failed: Not a directory I try to create ~/.dovecot.sieve folder, but this file exists and is a symlink. 0 lrwxrwxrwx 1 vmail vmail 16 Sep 3 18:14 .dovecot.sieve -> sieve/sogo.sieve I think I have some miss configuration because i don’t receive any vacation reply when I send mail to my testuser. In log files i cannot see any entries according to my sieve script. Here is my dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-35-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_default_realm = domain.tld auth_mechanisms = plain login default_vsz_limit = 512 M hostname = mail.domain.tld mail_location = maildir:/var/www/kunden/mail/%d/%n mail_plugins = quota zlib fts managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = nopassword=y allow_nets=10.27.1.20/32 driver = static } plugin { quota = maildir:User quota quota_exceeded_message = Quota exceeded, please go to http://www.example.com/over_quota_help for instructions on how to fix this. quota_rule2 = Trash:storage=+100M quota_rule3 = Archive:storage=+100%% quota_rule4 = Archive.2012:storage=+100%% quota_rule5 = Archive.Gesendet:storage=+100%% quota_warning = storage=99%% quota-exceeded 100 %u quota_warning1 = storage=99%% quota-exceeded 99 %u quota_warning10 = storage=80%% quota-warning 90 %u quota_warning11 = storage=80%% quota-warning 80 %u quota_warning12 = storage=50%% quota-warning 50 %u quota_warning2 = storage=95%% quota-warning 98 %u quota_warning3 = storage=95%% quota-warning 97 %u quota_warning4 = storage=95%% quota-warning 96 %u quota_warning5 = storage=95%% quota-warning 95 %u quota_warning6 = storage=80%% quota-warning 94 %u quota_warning7 = storage=80%% quota-warning 93 %u quota_warning8 = storage=80%% quota-warning 92 %u quota_warning9 = storage=80%% quota-warning 91 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)domain.tld protocols = " imap lmtp sieve pop3" quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 vsz_limit = 2 G } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /usr/local/bin/quota-exceeded.sh unix_listener quota-exceeded { user = vmail } user = root } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = root } ssl = required ssl_ca = </certificate/domain_tld.ca-bundle ssl_cert = </certificate/domain_tld.crt ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </certificate/domain_tld.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=5000 gid=5000 home=/var/www/kunden/mail/%d/%Ln driver = static } protocol lmtp { mail_plugins = quota zlib fts sieve } protocol lda { mail_plugins = quota zlib fts sieve } protocol imap { mail_plugins = quota zlib fts imap_quota imap_zlib quota zlib } Please help me to fix my problems and get sieve running.

1 0

quota for subfolder with prefix=INBOX.
by Jogi Hofmüller 03 Sep '14

03 Sep '14

Hi all, We use prefix=INBOX. in order to keep things as they were on the old server. Now I started playing with quota and have trouble getting the additional quota for Trash and/or Junk working. My expectation was that once a user is over quota and moves email to trash sh/e should be able to receive new email again. That's what I cannot get to work with our setup. Attached you find the config that I thought should be working. The numbers are ridiculously low but that's just for testing. Here is some output from doveadm doveadm quota get -u user Quota name Type Value Limit % User quota STORAGE 5422 5120 105 User quota MESSAGE 18 - 0 doveadm mailbox status -u user "messages vsize" "*" INBOX messages=13 vsize=3147033 doveadm mailbox status -u user "messages vsize" "INBOX.*" INBOX.Drafts messages=0 vsize=0 INBOX.Sent messages=0 vsize=0 INBOX.Trash messages=5 vsize=2475790 INBOX.Junk messages=0 vsize=0 Regards, -- j.hofmüller We are all idiots with deadlines. - Mike West

2 5

Assertion failed in sql_transaction_commit with pgsql driver
by Potapov Sergey 03 Sep '14

03 Sep '14

Hi! Next code from driver_pgsql_transaction_commit cause assertion failed in do_query function - i_assert(SQL_DB_IS_READY(&db->api)) } else { /* multiple queries, use a transaction */ ctx->refcount++; sql_query(_ctx->db, "BEGIN", transaction_begin_callback, ctx); <- first sql_query changes db state to SQL_DB_STATE_BUSY while (_ctx->head != NULL) { ctx->refcount++; sql_query(_ctx->db, _ctx->head->query, <- second query cause assertion failed due to SQL_DB_IS_READY returns false transaction_update_callback, _ctx->head); _ctx->head = _ctx->head->next; } sql_query(_ctx->db, "COMMIT", transaction_commit_callback, ctx); } Next transaction query should be called after previous is finished and driver state changed to SQL_DB_STATE_IDLE

1 0

Dovecot is looking for .dovecot.lda-dupes in the wrong place
by Michael 03 Sep '14

03 Sep '14

Hi, I just moved the dovecot maildir location for all virtual users to another location. I moved everything from /var/mail/vhosts/%d/%n to /var/vmail/%d/%n/maildir Everything seem to be fine except of one recurring error: Sep 2 10:16:09 mx0 dovecot: lmtp(13226, sv_bogies(a)neurohr.at) Error: file_dotlock_open(/var/mail/vhosts/domain.at/michael/.dovecot.lda-dupes) failed: No such file or directory Sep 2 13:31:27 mx0 dovecot: lmtp(16248, sv_bogies(a)neurohr.at) Error: file_dotlock_open(/var/mail/vhosts/domain.at/michael/.dovecot.lda-dupes) failed: No such file or directory So Dovecot is looking in the old path. How can I fix that? Thanks, Michael doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-35-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_mechanisms = plain login mail_location = maildir:/var/vmail/%d/%n/maildir mail_plugins = notify acl quota mail_privileged_group = vmail mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:/var/vmail/%%d/%%n/maildir:INDEX=/var/vmail/%d/%n/maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_pipe_program = /usr/sbin/sendmail antispam_pipe_program_args = -i;-f;%u antispam_pipe_program_notspam_arg = sh antispam_pipe_program_spam_arg = sm antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items;Deleted Messages fts_autoindex = yes quota = maildir:User quota quota_rule = *:storage=9G quota_rule2 = Trash:storage=+100M sieve = /var/vmail/%d/%n/sieve-scripts/.dovecot.sieve sieve_before = /var/vmail/sieve-scripts/before sieve_dir = /var/vmail/%d/%n/sieve-scripts/sieve sieve_extensions = +imapflags } postmaster_address = postmaster(a)neurohr.at protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 user = vmail } } service dict { unix_listener dict { user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = notify acl quota imap_acl imap_quota antispam }

2 2