January 2013 - dovecot

[Dovecot] Benchmarking: Dovecot vs Courier. Courier wins as POP3 server
by Alexandr Sabitov 17 Jan '13

17 Jan '13

Hi All, I have compared Dovecot performance to Courier and it appears that as a POP3 server Dovecot is slower in 2 times but as an IMAP server it is faster in 1.5 times. The same node (16CPUs), testing time is 30 min, please see results and dovecot configs attached. Benchmark software is MStone used by Sendmail Inc so is is quite reliable. I do not see anything else to tweak in Dovecot to increase POP3 performance. Can we all have some tips to improve it please ? This is how my Dovecot set up: (LDAP user) -> Dovecot Director -> (Master user) -> Dovecot Dovecot Director: dovecot-shared-4:~# /usr/local/dovecot/bin/doveconf -n -c /usr/local/dovecot/etc/dovecot/dovecot-proxy.conf # 2.1.12: /usr/local/dovecot/etc/dovecot/dovecot-proxy.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_debug = yes auth_mechanisms = plain login cram-md5 ntlm auth_verbose = yes base_dir = /var/run/dovecot-proxy default_internal_user = webmail director_mail_servers = 192.168.100.102 director_servers = 192.168.100.101 disable_plaintext_auth = no doveadm_password = blah doveadm_proxy_port = 9292 instance_name = dovecot-proxy listen = 192.168.100.101 log_path = /var/log/dovecot-proxy.log login_greeting = Dovecot Proxy ready. mail_location = maildir:~/ passdb { args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } service auth-worker { user = webmail } service auth { client_limit = 2400 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9191 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 9292 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap { service_count = 0 } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { service_count = 0 } ssl_cert = </usr/local/dovecot/ssl/dovecot.pem ssl_key = </usr/local/dovecot/ssl/dovecot.pem userdb { args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 100 } protocol doveadm { auth_socket_path = director-userdb } Dovecot (back-end): dovecot-shared-4:~# /usr/local/dovecot/bin/doveconf -n # 2.1.12: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ default_internal_user = webmail disable_plaintext_auth = no doveadm_password = blah listen = 192.168.100.102 log_path = /var/log/dovecot.log mail_fsync = always mail_location = maildir:~/ mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota fts fts_lucene" mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /usr/local/dovecot/etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { driver = static } plugin { fts = lucene fts_lucene = whitespace_chars=@. quota = maildir:User quota } service director { unix_listener director-admin { mode = 00 } } service doveadm { inet_listener { port = 9292 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 20 process_min_avail = 8 } service imap-postlogin { executable = script-login /usr/local/dovecot/bin/imap-postlogin.sh user = webmail } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 20 process_min_avail = 8 } service pop3-postlogin { executable = script-login /usr/local/dovecot/bin/pop3-postlogin.sh user = webmail } service pop3 { executable = pop3 pop3-postlogin } ssl_cert = </usr/local/dovecot/ssl/dovecot.pem ssl_key = </usr/local/dovecot/ssl/dovecot.pem userdb { args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_plugins = " quota fts fts_lucene imap_quota" } Best Regards, Alexandr Sabitov Netregistry

4 4

[Dovecot] failure trying to autocreate an Inbox that already exists
by Kurt Snyder 17 Jan '13

17 Jan '13

I have a new installation of Dovecot 2.1.12 and cannot select the Inbox without getting this error: c select inbox c NO [SERVERBUG] Internal error occurred. Refer to server log for more information. [2013-01-16 18:22:13] Here's the server log: dovecot[15643]: imap(u1): Error: Failed to autocreate mailbox INBOX: Mailbox already exists Auto create settings are currently set to 'no' -- when they were set to create, the problem was the same. Passwords are currently plaintext for testing purposes -- Imap authentication works. It's running on OS/X 10.7.3 Our config is below. Thanks for any suggestions... # 2.1.12: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 11.3.0 x86_64 auth_debug_passwords = yes auth_username_chars = disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox INBOX { auto = no } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=plain /etc/passwd-imap driver = passwd-file } protocols = imap ssl = no userdb { args = username_format=%n /etc/passwd-imap driver = passwd-file }

1 0

[Dovecot] dovecot-2.2.beta1: do not removes e-mail with enabled replication
by Евгений Басов 16 Jan '13

16 Jan '13

Hello. I'm created two installations of dovecot-2.2.beta1 with identical config. Without replication each server works good. With replication enabled every changes are replicated between these ones. When I probe remove or move some email in another folder it is disappears and reappears again and again in source folder and appears in destination folder. Thus increasing number of letters like with copy. Possible reasons cause of the problem: - bug - configuration settings of dovecot - users with wich dovecot works and users rights. Which version is true? If this not a bug, what should be corrected in the configuration? Configuration: auth_debug = yes auth_mechanisms = plain login auth_verbose = yes import_environment = TZ lock_method = flock mail_debug = yes mail_location = mdbox:/var/vmail/%d/%n:INDEX=/var/vmail_indexes/%d/%n/ mail_plugins = " quota notify replication" mail_temp_dir = /var/spool/lmtp-dovecot mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days mdbox_rotate_size = 50 M namespace inbox { inbox = yes location = mailbox Шаблоны { auto = create } mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = create special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_replica = remote:vmail@mailsys.office.megagroup.ru quota = dict:Domain quota:%d:redis:host=127.0.0.1:prefix=domain/ quota2 = dict:User quota::redis:host=127.0.0.1:prefix=user/ quota2_rule = *:storage=0 quota2_rule2 = Trash:storage=+5%% quota_rule = *:storage=0 quota_rule2 = Trash:storage=+5%% } service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = $default_internal_user mode = 0666 user = $default_internal_user } } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = $default_internal_user } } service doveadm { user = vmail } service imap-login { process_min_avail = 5 service_count = 1 } service imap-postlogin { executable = script-login /usr/local/bin/imaptrackLastLogin.sh user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 1024 } service lmtp { inet_listener lmtp { address = *, :: port = 24 } process_min_avail = 5 } service pop3-login { process_min_avail = 5 service_count = 1 } service pop3-postlogin { executable = script-login /usr/local/bin/pop3trackLastLogin.sh user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 } service replicator { process_limit = 1024 process_min_avail = 3 } ssl_cert = </etc/ssl/dovecot/server.pem ssl_key = </etc/ssl/dovecot/server.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { mail_plugins = " quota notify replication imap_quota" } Filesystem permissions: # ls -l /var/ drwxr-xr-x 3 vmail vmail 24 Jan 16 16:14 vmail drwxr-xr-x 3 vmail vmail 24 Jan 16 16:14 vmail_indexes # ls -l /var/spool/ drwxrwx--- 2 dovecot dovecot 6 Jan 16 15:11 lmtp-dovecot Users: dovecot:x:97:97:added by portage for dovecot:/dev/null:/sbin/nologin uid=97(dovecot) gid=97(dovecot) groups=97(dovecot) dovenull:x:102:102:added by portage for dovecot:/dev/null:/sbin/nologin uid=102(dovenull) gid=102(dovenull) groups=102(dovenull) vmail:x:999:999:User for work with local mail storage:/home/vmail:/bin/bash uid=999(vmail) gid=999(vmail) groups=999(vmail),97(dovecot) Selects from user database are rights because isolated installations are works and not get errors.

2 1

[Dovecot] FTS what to use ?
by Erik Colson 16 Jan '13

16 Jan '13

Hi I'm currently using dovecot 2.0 with squat fts which does a nice job. However I'm thinking about upgrading to dovecot 2.1 and the wiki isn't clear about which fts can or should be used with it. Is squat support dead ? As the wiki mentions that the config syntax is obsolete, I'm not sure if squat is obsolete also ? If not, what is the new syntax ? But in the case squat is dead.. what is the recommended alternative nowadays ? I don't really need substring search, but it is a nice thing to have. PS : I will be using dovecot 2.1 with maildir thanks -- erik

3 4

[Dovecot] Dovecot subtree problem in ldap/ad search
by Marcus Jüttner 15 Jan '13

15 Jan '13

Hallo Im trying to set up an Postfix and Dovecot mailserver with ActiveDirectory interation. Postfix is doing well and even Dovecot does ... but I have one big problem! My AD Accounts ar stored in two Subfolders ou=Bischoff Benutzer LTT, dc=bischoff-ltt, dc=local ou=Bischoff Benutzer Nbg, dc=bischoff-ltt, dc=local If i use "base = ou=Bischoff Benutzer LTT, dc=bischoff-ltt, dc=local" everything is fine but users from "ou=Bischoff Benutzer Nbg" will not work. Thats ok so far. But when i use "base = dc=bischoff-ltt, dc=local" none user will be found even if i use "scope = subtree". Postfix has no problem with the base set to "dc=bischoff-ltt, dc=local". Ldapsearch has no problem too. I use Version 2.1.12 on Gentoo Linux with a 2003R2 AD Is scope=subtree broken in Dovecot? Must I set some special parameters for Windows AD? My Config: hosts = 192.168.1.98 dn = bischoff-ltt\ldapsearch dnpass = xxxxx auth_bind = yes ldap_version = 3 scope = subtree base = dc=bischoff-ltt, dc=local #base = ou=Bischoff Benutzer LTT, dc=bischoff-ltt, dc=local #base = ou=Bischoff Benutzer Nbg, dc=bischoff-ltt, dc=local user_attrs = =home=/var/dovecot/%Ln/,=mail=maildir:/var/dovecot/%Ln/ user_filter = (&(ObjectClass=person)(sAMAccountName=%u)) pass_filter = (&(ObjectClass=person)(sAMAccountName=%u)) Thanks for Help Marcus

1 0

[Dovecot] Help with virtual plugin
by Joy 15 Jan '13

15 Jan '13

Hi, Is there any way to show all messages with attachment using virtual plugin. I am successfully using the plugin but didn't find way to show the same. Thanks

2 1

[Dovecot] Define custom ldap libraries when building Dovecot
by Nikolaos Milas 15 Jan '13

15 Jan '13

Hello, I would like to compile Dovecot using custom ldap libraries, located at a particular custom system location. How should I alter the config process to specify that the include dir is "/usr/local/openldap/include" and the lib dir is "/usr/local/openldap/lib64" and not the standard ones (/usr/include/ and /usr/lib64/ respectively) on RHEL/CentOS 5 (x86_64). Note that all of the above files/folders exist on the file system at the same time. The idea is to build dovecot against current openldap v2.4.x libraries and not against the available (by the OS) ancient openldap v.2.3.x libs. Please, advise. Thanks, Nick

3 5

[Dovecot] Zlib maildir reindex bug?
by Richard Platel 14 Jan '13

14 Jan '13

Hi Running dovecot 2.1.7 (from debian repo). We have some old compressed maildir messages with the wrong S= size in the filename (our fault). If I delete index files, log in to the mailbox and try to FETCH the bad message, dovecot complains about the incorrect message size, attempts to fix the filename and disconnects the client. However, it changes the filesize to the size of the message on disk, not the message's uncompressed size. For subsequent clients, the FETCH works, but dovecot logs an error (and maybe re-indexes the mailbox?) and the message UID changes. Jan 14 18:40:56 imap01 dovecot: imap(bub(a)confidence.com): Error: Cached message size larger than expected (1612 > 1556) Jan 14 18:40:56 imap01 dovecot: imap(bub(a)confidence.com): Error: Maildir filename has wrong S value, renamed the file from /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=1612:2,Sab to /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab Jan 14 18:40:56 imap01 dovecot: imap(bub(a)confidence.com): Error: Corrupted index cache file /mail/index01/505/236/bub(a)confidence.com/.Sent Items/dovecot.index.cache: Broken physical size for mail UID 1 Jan 14 18:40:56 imap01 dovecot: imap(bub(a)confidence.com): Error: read(/mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=1612:2,Sab) failed: Input/output error (uid=1) Jan 14 18:41:25 imap01 dovecot: imap(bub(a)confidence.com): Error: Cached message size smaller than expected (931 < 1556) Jan 14 18:41:25 imap01 dovecot: imap(bub(a)confidence.com): Error: Maildir filename has wrong S value, renamed the file from /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab to /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab Jan 14 18:41:25 imap01 dovecot: imap(bub(a)confidence.com): Error: Corrupted index cache file /mail/index01/505/236/bub(a)confidence.com/.Sent Items/dovecot.index.cache: Broken physical size for mail UID 2 Jan 14 18:41:25 imap01 dovecot: imap(bub(a)confidence.com): Error: Cached message size smaller than expected (931 < 1556) Jan 14 18:41:25 imap01 dovecot: imap(bub(a)confidence.com): Error: Maildir filename has wrong S value, renamed the file from /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab to /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab Jan 14 18:41:25 imap01 dovecot: imap(bub(a)confidence.com): Error: Corrupted index cache file /mail/index01/505/236/bub(a)confidence.com/.Sent Items/dovecot.index.cache: Broken physical size for mail UID 2 Jan 14 18:41:53 imap01 dovecot: imap(bub(a)confidence.com): Error: Cached message size smaller than expected (931 < 1556) Jan 14 18:41:53 imap01 dovecot: imap(bub(a)confidence.com): Error: Maildir filename has wrong S value, renamed the file from /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab to /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab Jan 14 18:41:53 imap01 dovecot: imap(bub(a)confidence.com): Error: Corrupted index cache file /mail/index01/505/236/bub(a)confidence.com/.Sent Items/dovecot.index.cache: Broken physical size for mail UID 2 Jan 14 18:41:53 imap01 dovecot: imap(bub(a)confidence.com): Error: Cached message size smaller than expected (931 < 1556) Jan 14 18:41:53 imap01 dovecot: imap(bub(a)confidence.com): Error: Maildir filename has wrong S value, renamed the file from /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab to /mail/mailstore01/505/236/bub(a)confidence.com/.Sent Items/cur/1168058702.93517743273399070372.fetchmail01,S=931:2,Sab Jan 14 18:41:53 imap01 dovecot: imap(bub(a)confidence.com): Error: Corrupted index cache file /mail/index01/505/236/bub(a)confidence.com/.Sent Items/dovecot.index.cache: Broken physical size for mail UID 2

2 1

Re: [Dovecot] deleting duplicate mail?
by Joseph Tam 14 Jan '13

14 Jan '13

On Mon, 14 Jan 2013, joakim(a)verona.se writes: > Due to a misstake I got many duplicate emails in my inbox folder. Ironic mispeling. > They are stored in maildir format, so my initial thought was do simply > md5sum the mail files and remove the duplicates. This doesnt work > because the mails has differinf uids. Any other hints? If the UIDs are just headers, why don't you simply checksum without them: sed -e '/^Whatever-header:/d' < $file | md5sum grep -Ev '^Whatever-header:' < $file | md5sum Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] sieve reject to wrong address?
by Felix Rubio Dalmau 14 Jan '13

14 Jan '13

Hi all, I have succeed in setting up postfix (to send/receive emails), dovecot to access the folders via IMAP, all using TLS and sieve under dovecot to manage filters. I have also set up a sieve rule to reject those mails whose size exceeds 2 MB... and I'm really proud of everything, because it is my first time!! However, when rejecting the mail, instead of sending a mail saying "I'm sorry blah, blah, blah" to the originary sender, it is sent to the final recipient (that is, me). Do you know how to solve it? Is it a problem from sieve or dovecot? I think is some misconfiguration of my dovecot installation, because the sieve rule is: ################ if size :over 2M { reject text: Ho sento, no accepto cap correu de mes de 2MB de tamany. Sisplau, puja els fitxers mes grans a un servidor i envia'm un link. Gracies. I'm sorry, I do not accept mail over 2 MB in size. Please upload larger files to a server and send me a link. Thanks. . ; } ################ dovecot log looks like: Jan 14 17:34:16 server dovecot: lda(felix@server): sieve: msgid=<201301141734.16203.felix@server>: rejected message from <felix@server> (reject) Jan 14 17:34:16 server postfix/cleanup[2011]: 2B59CB59: message- id=<dovecot-1358181256-51155-0@server> Jan 14 17:34:16 server postfix/pipe[2012]: 311AF4E0: to=<felix@server>, relay=dovecot, delay=1, delays=0.81/0.02/0/0.19, dsn=2.0.0, status=sent (delivered via dovecot service) Thank you! -- Felix Rubio Dalmau

2 1