June 2014 - dovecot - dovecot.org

Re: [Dovecot] Outlook 2007 & 2010 hangs in v2.2?
by Joseph Tam 06 Jun '14

06 Jun '14

Timo Sirainen <tss(a)iki.fi> writes: > Has anybody noticed Outlook 2007 & 2010 (but apparently not 2013) > hanging IMAP connections with Dovecot v2.2 (but not v2.1) when they're > FETCHing large mails? I can't think of any reasonable explanation for > this. It's a shot in the dark, but I had a problem with a different client, where semi-large attachments was problematic. It turned out to be a TCP scaling problem. If a router/firewall drops packets with a TCP scaling option set, the endpoints disagree on how many outstanding non-ACK packets are allowed, resulting in timeouts. http://support.microsoft.com/kb/935400 http://en.wikipedia.org/wiki/TCP_window_scale_option The Microsoft KB does hint those versions of Outlook may be affected, but I can't figure out why there would be a difference between Dovecot 2.1 and 2.2. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Sharing folder with others
by Claudinei Santos 05 Jun '14

05 Jun '14

Hello, The sharing folders with dovecot works, but when the user that i shared the folder reads any e-mails in the folder, all my subcribed folder (the folders that i do not shared with this user) is unsubcribed from my account. The only folders that remains is the default ones ( inbox, trash, spam and sent) and the folder that i shared with that user. my configurations: # separator for master-users, example: "login_user*master_user -> user(a)domain.tld*masteruser auth_master_user_separator = * passdb passwd-file { driver = passwd-file args = /etc/dovecot-masterusers master = yes } namespace private { type = private separator = / prefix = #location defaults to mail_location. inbox = yes } namespace shared { type = shared separator = / prefix = Share Folders/%%u/ location = maildir:/var/spool/mail/vmail/%d/%%n:INDEX=/var/spool/mail/vmail/%d/%n/shared/%%u subscriptions = yes list = children } # cat /etc/dovecot-postlogin #!/bin/bash export MASTER_USER="$USER" exec /usr/lib64/dovecot/imap "$@" Can someone help me out with this? Thanks in advance.

1 0

[Dovecot] director with multiple instances
by Will Yardley 05 Jun '14

05 Jun '14

I'm experiencing some problems similar to those described in http://dovecot.org/list/dovecot/2012-July/137250.html except with 2.0.9. Adding http://dovecot.org/list/dovecot/2012-July/084906.html to the main config didn't seem to help, nor did setting the list of director and backend servers to just the system itself. I get a banner connecting to port 143: [root@retr01 log]# telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK Waiting for authentication process to respond.. Log messages are: Jun 3 16:22:03 retr01 dovecot: pop3-login: Error: Timeout waiting for handshake from auth server. my pid=32152, input bytes=0 Jun 3 16:22:33 retr01 dovecot: pop3-login: Error: Timeout waiting for handshake from auth server. my pid=32152, input bytes=0 Jun 3 16:22:33 retr01 dovecot: director: Fatal: No inet_listeners defined for director service (for standalone keep director_servers empty) Jun 3 16:22:33 retr01 dovecot: master: Error: service(director): command startup failed, throttling Jun 3 16:23:08 retr01 dovecot: pop3-login: Error: Timeout waiting for handshake from auth server. my pid=32152, input bytes=0 Jun 3 16:23:33 retr01 dovecot: pop3-login: Disconnected: Inactivity (no auth attempts): rip=127.0.0.1, lip=127.0.0.1, secured running dovecot procs are: root 32137 1 0 16:20 ? 00:00:00 /usr/sbin/dovecot -c /etc/dovecot-main.conf root 32145 1 0 16:20 ? 00:00:00 /usr/sbin/dovecot -c /etc/dovecot-director.conf doveconf -n for the two configs (dovecot-main.conf, dovecot-director.conf) are included below. dovecot-sql.conf has: driver = sqlite connect = /etc/dovecot/empty.db password_query = select 'y' as proxy, \ NULL as password, \ 'y' as nopassword, \ case '%a' \ when '110' then '10110' \ when '995' then '10110' \ when '143' then '10143' \ when '993' then '10143' end \ as port; (where empty.db is completely empty; this is just used since there's no other way to handle the port mapping, as described elsewhere on the list). A static proxy setup does work, with the normal imap / pop3 listeners. # 2.0.9: /etc/dovecot-main.conf # OS: Linux 2.6.32-431.11.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.5 (Santiago) ext4 auth_username_format = %Ln auth_worker_max_count = 60 base_dir = /var/run/dovecot-main default_client_limit = 4096 default_process_limit = 200 dotlock_use_excl = yes mail_fsync = always mail_location = maildir:/var/spool/maildir/%1Ln/%Ln:INDEX=/mnt/post/cache/%1Ln/%Ln mail_plugins = fts fts_squat quota maildir_very_dirty_syncs = yes mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = prefix = Mail. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:User Quota quota_rule = *:storage=40960M:messages=3000000 } service auth-worker { user = $default_internal_user } service imap-login { inet_listener imap { port = 10143 } inet_listener imaps { port = 10993 } service_count = 0 vsz_limit = 128 M } service pop3-login { inet_listener pop3 { port = 10110 } inet_listener pop3s { port = 10995 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3 ssl_key = </etc/pki/dovecot/private/dovecot.pem syslog_facility = local4 userdb { args = uid=vmail gid=mail home=/var/spool/maildir/%1Ln/%Ln driver = static } protocol imap { mail_max_userip_connections = 24 mail_plugins = fts fts_squat quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 pop3_uidl_format = %f } # 2.0.9: /etc/dovecot-director.conf # OS: Linux 2.6.32-431.11.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.5 (Santiago) ext4 auth_username_format = %Ln auth_worker_max_count = 60 base_dir = /var/run/dovecot-director default_client_limit = 4096 default_process_limit = 200 director_doveadm_port = 2888 director_mail_servers = 192.168.1.71 192.168.1.72 192.168.1.73 director_servers = 192.168.1.71 192.168.1.72 192.168.1.73 dotlock_use_excl = yes mail_fsync = always mail_location = maildir:/var/spool/maildir/%1Ln/%Ln:INDEX=/mnt/post/cache/%1Ln/%Ln mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = fts fts_squat quota maildir_very_dirty_syncs = yes mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = prefix = Mail. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } service auth-worker { user = $default_internal_user } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 2888 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service pop3-login { executable = pop3-login director } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3 ssl_key = </etc/pki/dovecot/private/dovecot.pem syslog_facility = local4 w

1 3

[Dovecot] What are the options for HA and\or replication and\or storage?
by Eliezer Croitoru 05 Jun '14

05 Jun '14

I am considering couple options of converting a current service into a HA using multi servers or any other solutions. The point is that I am thinking about the options and which I am looking for. NFS can be a storage which has it's own pros and cons. There is the option of DRBD but as of now it's limited for two hosts. What options do exist out-there as a solution? The main issues are that the current service is based on Maildir and is on one server with resierfs. The service is composed of one host with 50k users couple disks in raid6. On the same machine we have postfix as mailer. I would like to hear about HA environment that I can use to replicate the boxes. My basic research leaded me to smtp on one host or more and using lmtp to send the messages to dovecot o another host which will have a replicated host and will be used with storage system based on ISCSI or NFS. Any other idea to enhance the current one or to replace it is more then just welcome. Thanks, Eliezer

3 2

[Dovecot] General questions about TCP replication with dsync
by Patrick De Zordo 05 Jun '14

05 Jun '14

Hi Guys, I would like to question why I see this errors in my logs. Let explain me! Dovecot version: 2.2.9 (on Ubuntu 14.04 LTS) Ive configured our dovecot servers (2 servers) to do the TCP replication with dsync. This is working flawless. 1. Question: In logs I can see this errors on every sync (on the slave server / server without changes which should be updated): ---8<----------------------------------------------------------------------- ---------------------------------------------------------------------------- ---- dsync-server(email(a)example.com): Error: net_connect_unix(/var/run/dovecot/replicator-doveadm) failed: Permission denied ---8<----------------------------------------------------------------------- ---------------------------------------------------------------------------- ---- Googling a bit gave me the information This should be normal..? Well ok, errors in logs are not nice to see, but can someone confirm this is really ok? Timo? 2. Question (much more important): We are using sieve scripts for our users, they are replicated to the replica-host but this errors appears in logs on every synchronized message: ---8<----------------------------------------------------------------------- ---------------------------------------------------------------------------- ---- dsync-server(email(a)example.com): Error: Failed to access mailbox dovecot/sieve: Internal error occurred. Refer to server log for more information. dsync-server(email(a)example.com): Error: stat(/var/vmail/example.com/email/.dovecot.sieve/tmp) failed: Not a directory ---8<----------------------------------------------------------------------- ---------------------------------------------------------------------------- ---- So whats going on there? This is strange and should not be, right? Any hints? Thank you very much! --------------------------------------------------------------------- Mit freundlichen Grüßen / Distinti saluti / Kind regards De Zordo Patrick patrick(a)spamreducer.eu

4 9

[Dovecot] Error with dsync in TCP replication
by Patrick De Zordo 05 Jun '14

05 Jun '14

Hey guys, again this question.. We are trying to get dsync replication over TCP working.. But we are having a bit of troubles.. Our configuration (just most important parts): ---8<--------------------------------------------------------------- # 2.2.13 (304d545927d2): /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-24-generic x86_64 Ubuntu 14.04 LTS ext4 doveadm_password = secret first_valid_uid = 150 last_valid_uid = 150 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_plugins = " quota listescape zlib notify replication" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Archiv { auto = subscribe special_use = \Archive } mailbox Archive { auto = no special_use = \Archive } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = no special_use = \Trash } prefix = separator = / } plugin { mail_replica = tcp:mx2.example.com:999 quota = dict:user::proxy::quota quota_rule = *:storage=10MB quota_rule2 = Trash:storage=+10%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = bz2 zlib_save_level = 9 } protocols = " imap sieve pop3" replication_max_conns = 1 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service doveadm { inet_listener { port = 999 } } service replicator { unix_listener replicator-doveadm { mode = 0600 } } protocol lda { mail_plugins = " quota listescape zlib notify replication quota sieve listescape zlib" } protocol imap { mail_plugins = " quota listescape zlib notify replication imap_quota listescape zlib" } protocol sieve { managesieve_max_line_length = 65536 } ---8<--------------------------------------------------------------- The problem: After a user adds a sieve script with his mail application (in this case Thunderbird with plugin): 1. the script is saved in /var/vmail/%d/%n/sieve/script_name == OK 2. this file (/var/vmail/%d/%n/sieve/script_name) is then symlinked to /var/vmail/%d/%n/.dovecot.sieve == OK Now the problem kicks in: 1. On the secondary server (mail_replica server) the script is created + the same symlink == OK 2. In logs (on secondary) there is shown this error every time a sync is done: ---8<--------------------------------------------------------------- dsync-server( <mailto:user@example.com> user(a)example.com) Error: Failed to access mailbox dovecot/sieve: Internal error occurred. Refer to server log for more information. dsync-server( <mailto:user@example.com> user(a)example.com) Error: stat(/var/vmail/example.com/user/.dovecot.sieve/tmp) failed: Not a directory ---8<--------------------------------------------------------------- Issuing doveadm replicator status '*' on first server gives back: username priority fast sync full sync failed user(a)example.com none 00:03:36 23:11:51 y Sync from master->secondary is interrupted but sync from secondary->master is working.. Thanks for any hint! --------------------------------------------------------------------- Mit freundlichen Grüßen / Distinti saluti / Kind regards De Zordo Patrick patrick(a)spamreducer.eu

1 0

[Dovecot] IMAP copy fails because the mailbox size of user1 is exceeding the quota limit of user2??
by Katja Wegner 05 Jun '14

05 Jun '14

Hi all, I do have a mailbox-quota problem in dovecot 2.0.19 that is beond my understanding. Could someone pls. give me a hint. - user1 max. mailbox quota is set to 1GB, the current mailbox size of user1 is 15MB - user2 max. mailbox quota is set to 10MB, the current mailbox size of user1 is 10kB - user1 shares the folder 'shared_folder' to user2 with all rights (read, write ...) - user2 has subscribed to 'shared_folder' the problem: - user2 tries to move a mail (20kB) to the shared folder via telnet: ". copy 1:1 shared/user1/shared_folder" - it fails with: "NO [OVERQUOTA] Quota exceeded (mailbox for user is full)" - copying the same mail to a local folder of user2 works without problems. - After I raised the max. mailbox quota of user2 from 10MB to 16MB it was possible to move the mail to the 'shared_folder' of user1. It looks like the copy operation fails because the mailbox size of user1 is exceeding the quota limit of user2! Is this possible? Is this a bug? Do I have a configuration problem? dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-51-generic x86_64 Ubuntu 12.04.4 LTS ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes dict { sqldomainquota = mysql:/etc/dovecot/dovecot-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } first_valid_uid = 150 last_valid_uid = 150 mail_debug = yes mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_plugins = " quota quota acl" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacati on subaddress comparator-i;ascii-numeric relational regex imap4flags copy includ e variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/var/vmail/mydomain.de/%%n:CONTROL=/var/vmail/mydomain.de/%n/ shared/%%n:INDEX=/var/vmail/mydomain.de/%n/shared/%%n prefix = shared/%%n/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db quota = dict:User quota::proxy::sqluserquota quota_rule2 = shared:ignore sieve = ~/_dovecot_sieve sieve_dir = ~/sieve } postmaster_address = kontakt(a)mydomain.de protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MED IUM ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 mail_plugins = " quota imap_quota imap_quota acl imap_acl" } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = acl postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r }

2 3

[Dovecot] attachment sis + EMLINK (too many links) = segfault bug (2.2.12)
by Pavel Stano 05 Jun '14

05 Jun '14

Hi, we use attachment dedup with lots of emails (still migrating to it from maildir). We use netapp storage with wafl filesystem over nfs. Problem is that netapp has hard limit of 100k hardlinks to one file. And we encountered it. Problem is that dovecot start do segfault (lmtp,dsync,pop3 etc) when it happend when tried to deliver new emails with that attachment. Here is strace of dsync: 6740 link("/nfsmnt/mailatch1/f9/10/hashes/f9108ddaa156ac15738e41ed3bedec1eda50175d", "/nfsmnt/mailatch1/f9/10/f9108ddaa156ac15738e41ed3bedec1eda50175d-7bb7a20ddb598853541a000028db4a9f") = -1 EMLINK (Too many links) 6740 --- SIGSEGV (Segmentation fault) @ 0 (0) --- ls -lh: -rw------- 100000 vmail vmail 4.7K Apr 28 16:54 /nfsmnt/mailatch1/f9/10/hashes/f9108ddaa156ac15738e41ed3bedec1eda50175d We were using mail_attachment_min_size=4kb, we solve it by increasing it to 8kb. It would be nice to somehow fix this problem. Like not crash when EMLINK happend and maybe do not deduplicate attachments but deliver email without dedup. Or create second file in hashes/ and start hardlinking it instead of original. AFAIK ext4 has also hard-link limit 64k (http://en.wikipedia.org/wiki/Hard_link#Limitations_of_hard_links) So this can happen to anyone with lots of emails. Thanks -- [ Ohodnotte kvalitu mailu: http://nicereply.com/websupport/Stano/ ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE ***

1 1

[Dovecot] Plugin mail-filter tangles
by Stanislas SABATIER 05 Jun '14

05 Jun '14

System installed : Dovecot 2.2.12 as IMAP server and Postfix as MTA. Dovecot and Postfix connected via LMTP + Dovecot mail plugin 'mail-filter' to encrypt/decrypt emails on the fly with public/private users' RSA keys. Case study : You have 3 (virtuals) users belonging to 3 different domains, all managed by your Dovecot server. One of these users is connected to Dovecot with MUA Thunderbird, and he's writing an email to someone outside of yours domains, but he puts the two others users' email addresses in CC : mail from user1(a)domain1.dovecot --> to: someone@outside, CC: user2(a)domain2.dovecot, user3(a)domaine3.dovecot What happens (as far as I can understand) : The email is submitted to Postfix : one copy is delivered outside, the other is passed to Dovecot via LMTP for user2 & user3 @dovecot Dovecot is handling the final delivery, through mail-filter plugin as follow : 1. both users contexts are created from user_db queries 2. mail-filter plugin is init for user2 3. /mail_user_created/ for user2 4. mai-filter plugin arguments are parsed for user2 5. â¦/mail_allocated/ then /mail_save_begin/ for user2 (at this stage, the email is encrypted with users2 params) 6. Dovecot tells to LMTP that mail for user2 is delivered 7. then, â we are still in user2 context â, an other /mail_allocated/ is run, followed by a /istream_opened/ 8. mail user context is swithed to user3 --> /mail_user_created/ --> plugin's args parsed --> â¦ /mail_allocated/ 9. andâ¦ Dovecot tells to LMTP that mail for user3 is delivered So, it appears that Dovecot is re-using user2's email to pass it to user3 by opening an istream in user2's context. In my configuration, Dovecot can't do that because it has not the user2's private rsa key to reopen the email it has just encrypted, so it passes the email to user3 with user2 encryption params. Final result : user3 is receiving the email encrypted with user2's rsa key ! Problem : how to force Dovecot to deinit then reinit mail-filter plugin for each user to be sure that each email is encrypted with the right key before it is saved to users' mailboxes ? Thank you in advance for your help. Stan.

5 16

[Dovecot] SQL passdb, LDAP userdb
by Kristof Bajnok 05 Jun '14

05 Jun '14

Hi, in my current setup, LDAP authentication + userdb works fine. I'd like to integrate Dovecot with Shibboleth. I have a custom module at the IdP (*) that inserts short-time tokens to an SQL table at user authentication, and I want Dovecot to use the token table for passdb but keep LDAP for storing the userdb (uid, quota, etc) I thought it was simple as omitting the sql user_query, but I got: Warning: mysql: Query failed, retrying: Table 'webmail.users' doesn't exist Error: sql(user@domain,ipaddr): User query failed: Table 'webmail.users' doesn't exist (using built-in default user_query: SELECT home, uid, gid FROM users WHERE username = '%n' AND domain = '%d') Do you have any hints how to do this? Thanks, Kristof (*): in SAML there is an Identity Provider that does user authentication, which is separated from the services

2 2