August 2014 - dovecot

Re: TCP Cluster replication headache
by FUSTE Emmanuel 26 Aug '14

26 Aug '14

Le 07/05/2014 17:38, Emmanuel Fusté a écrit : > Hello, > > After going crazy building a dovecot cluster, I finally see the light ;-)) > But some things are "strange" and could probably be fixed/enhanced. > > First : > I follow the wiki doc, setting global doveadm_port. > Things did not work, I've got: > > dovecot: doveadm(X1234567): Error: sync: /var/run/dovecot/auth-userdb: Configured passdbs don't support crentials lookups (to see if user is proxied, because doveadm_port is set) > > Same kind of error too when trying to use doveadm on the command line to > get the replica status. > My user/auth db is LDAP with "auth_bind = yes", but I don't understand > the message in these context and did'nt know how to fix this. > I tried to hardcode proxy/proxy_maybe property in the passdb declaration > etc... > Finally, I remove the global "doveadm_port 12345" and add ":12345" at > the end of my "mail_replica =" line and all began to work ! > Is it a wanted and expected error/fix ? Ok, this first point should be fixed by http://hg.dovecot.org/dovecot-2.2/rev/a2e0e89bc27d Need to test it. Thank you. Emmanuel. > > Secondly: > Now all is working and "doveadm replicator status '*' " correctly list > all my users and the status, but after a few seconds (after replication > kick in), I see all user listed twice. > One time, as declared in the userdb with letters in uppercase : "X1234567" > One time, in lowercase : "x1234567" > On disk, all is OK, with only one replica in an uppercase directory. > I initially think that it was a mismatch between userdb and passdb users > return, but it was in fact the default value of auth_username_format > that was the culprit. After going from the default %Lu to %u doveadm > replicator status show only one entry per user as expected. > Is it wanted and expected too? why auth_username_format is used/interact > with/in the replication process and/or the replicator status command ? > > Not all is functionally tested, I go back to work. > My is conf at the end of this message. > > Thanks Simo for this great piece of software. > > Emmanuel > > # 2.2.12.7 (f7731356530e+): /etc/dovecot/dovecot.conf > # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS > auth_master_user_separator = * > auth_username_format = %u > doveadm_password = xxxxxxxxxxx > lda_mailbox_autocreate = yes > listen = * > mail_gid = vmail > mail_location = maildir:~/Maildir > mail_plugins = quota notify replication > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > hidden = no > inbox = no > list = children > location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u > prefix = shared/%%u/ > separator = / > subscriptions = no > type = shared > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > acl = vfile > acl_anyone = allow > > acl_shared_dict =file:/appli/vmail/shared-mailboxes > mail_replica = tcp:thsmytmbx02p.online.corp.thales:12345 > quota = dict:userquota::file:/appli/vmail/local_userquota/%%h/dovecot-quota > quota_rule = *:storage=100M > quota_rule2 = INBOX:storage=+20%% > quota_rule3 = Trash:storage=+10%% > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap sieve > service aggregator { > fifo_listener replication-notify-fifo { > user = vmail > } > unix_listener replication-notify { > user = vmail > } > } > service auth { > unix_listener auth-userdb { > group = vmail > mode = 0660 > } > } > service doveadm { > inet_listener { > port = 12345 > } > user = vmail > } > service replicator { > process_min_avail = 1 > unix_listener replicator-doveadm { > mode = 0666 > } > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-users-ldap.conf.ext > driver = ldap > } > protocol lda { > mail_plugins = quota sieve > } > protocol imap { > mail_plugins = quota imap_quota > } > > > > dovecot-users-ldap.conf.ext: > dovecot-ldap.conf.ext: > > uris = ldapi:/// > dn = uid=dovecot,dc=mydomain,dc=com > dnpass = xxxxxxxxxxxx > auth_bind = yes > ldap_version = 3 > base = ou=users,dc=mydomain,dc=com > user_attrs = =home=/appli/vmail/%{ldap:uid} > user_filter = (&(objectClass=inetOrgPerson)(|(uid=%u)(mail=%u))) > pass_attrs = =user=%{ldap:uid} > pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)(!(pwdReset=TRUE))) > iterate_attrs = uid=user > iterate_filter = (objectClass=inetOrgPerson) >

1 0

centos 6.x/7.x repos ?
by Spyros Tsiolis 25 Aug '14

25 Aug '14

Hello all, I believe someone has rpms for centos v6.x/7.x ? I remember a link to a site somewhere ? Are packages available for both i386 and 64-bit os's ?? tia, s.

2 1

OS X 10.6 Server - Dovecot Issue
by Ian Baker 25 Aug '14

25 Aug '14

I've just taken over support for an OS X Server (v10.6.8) box, and am a bit new at Postfix & Dovecot. We're having an problem where, intermittently, dovecot seems to be bouncing messages inbound for some of my existing users. Here is the mail.log entry for a successful delivery: Aug 21 16:58:45 mail postfix/pipe[64094]: D68783AE0F75: to=<sblondin(a)eem.ca>, relay=dovecot, delay=0.08, delays=0/0.01/0/0.07, dsn=2.0.0, status=sent (delivered via dovecot service) And here is what a bounce looks like Aug 22 07:29:28 mail postfix/local[93916]: error: od[getpwnam_ext]: No record for user sblondin Aug 22 07:29:28 mail postfix/pipe[93944]: 852C43AE7ACC: to=<sblondin(a)eem.ca>, relay=dovecot, delay=15, delays=0.14/0.05/0/15, dsn=5.1.1, status=bounced (user unknown) And a bit later another succcessful delivery. Aug 22 07:56:37 mail postfix/pipe[95021]: 14AF73AE82F0: to=<sblondin(a)eem.ca>, relay=dovecot, delay=0.5, delays=0.08/0.02/0/0.4, dsn=2.0.0, status=sent (delivered via dovecot service) No changes to this user's account were made during this time period. I'm flummoxed. Anythoughts as to what might be going on here, and/or how to debug this further? Thanks in advance... Ian /usr/sbin/dovecotd --version 1.1.20apple0.5 sh-3.2# /usr/sbin/dovecotd -n # 1.1.20apple0.5: /private/etc/dovecot/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 456). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Darwin 10.8.0 x86_64 hfs base_dir: /var/run/dovecot syslog_facility: local6 protocols: managesieve imaps imap listen(default): * listen(imap): * listen(managesieve): *:2000 ssl_ca_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.chain.pem ssl_cert_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.cert.pem ssl_key_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.key.pem ssl_cipher_list: ALL:!LOW:!SSLv2:!aNULL:!ADH:!eNULL disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_user: _dovecot login_process_per_connection: no max_mail_processes: 200 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_uid: 6 first_valid_gid: 6 mail_access_groups: mail mail_location: maildir:/var/spool/imap/dovecot/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_process_sharing(default): full mail_process_sharing(imap): full mail_process_sharing(managesieve): none mail_max_connections(default): 5 mail_max_connections(imap): 5 mail_max_connections(managesieve): 20 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/managesieve sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): /var/spool/imap/dovecot/sieve-scripts/%u sieve(default): sieve(imap): sieve(managesieve): /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve lda: postmaster_address: postmaster(a)example.com hostname: mail.eem.ca mail_plugins: push_notify cmusieve quota quota_full_tempfail: yes sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/mailaccess.log info_log_path: /var/log/mailaccess.log auth default: mechanisms: plain login gssapi cram-md5 verbose: yes passdb: driver: od userdb: driver: od args: partition=/etc/dovecot/partition_map.conf enforce_quotas=no socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: _dovecot group: mail plugin: quota_warning: storage=100%% /usr/libexec/dovecot/quota-exceeded.sh quota: maildir:User quota sieve: /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve

2 1

IMAP Proxying to an Exchange Server
by Ralf Hildebrandt 25 Aug '14

25 Aug '14

We're proxying IMAP to an Exchange server. One of my colleagues is getting this when trying to save a message as "Draft" OR as "Sent items": Aug 25 13:45:41 mproxy dovecot: imap(froemmel): Error: imapc(exchange-imap.charite.de:993): Command '7 APPEND "Entw&APw-rfe" (\Draft) {232572}' timed out, disconnecting Aug 25 13:45:41 mproxy dovecot: imap(froemmel): Debug: imapc(exchange-imap.charite.de:993): Disconnected Aug 25 13:45:42 mproxy dovecot: imap(froemmel): Error: imapc: COPY failed: Disconnected from server Aug 25 13:45:42 mproxy dovecot: imap(froemmel): Disconnected: IMAP session state is inconsistent, please relogin. in=232719 out=826 Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Error: imapc(exchange-imap.charite.de:993): Command '7 APPEND "Entw&APw-rfe" (\Draft) {232572}' timed out, disconnecting Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Debug: imapc(exchange-imap.charite.de:993): Disconnected Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Error: imapc: COPY failed: Disconnected from server Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Disconnected: IMAP session state is inconsistent, please relogin. in=232719 out=826 How can I debug this further? I cannot see which commands are sent by Thunderbird... -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

Problem overriding default quota limit for LDAP users
by Rasim Kalimullin 25 Aug '14

25 Aug '14

Hi! I install dovecot from debian-backports: dovecot --version 2.2.9 Dovecot is configured to multiple authorization: /etc/dovecot# cat conf.d/10-auth.conf |grep include #!include auth-deny.conf.ext !include auth-master.conf.ext #include auth-system.conf.ext !include auth-sql.conf.ext !include auth-ldap.conf.ext #!include auth-passwdfile.conf.ext #!include auth-checkpassword.conf.ext #!include auth-vpopmail.conf.ext #!include auth-static.conf.ext /etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.1 dbname=postfixadmin user=postfixadmin password=***** default_pass_scheme = MD5-CRYPT password_query = \ SELECT username, domain, password \ FROM mailbox WHERE username = '%u' AND domain = '%d' user_query = \ SELECT CONCAT('/var/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule \ FROM mailbox WHERE username = '%u' AND domain = '%d' iterate_query = SELECT username AS user FROM mailbox /etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-ldap.conf.ext hosts = ***.***.local ***.***.local dn = dovecot(a)***.local dnpass = ****** auth_bind = yes ldap_version = 3 base = ou=XXX,dc=***,dc=local deref = never scope = subtree user_attrs = \ =uid=5000, \ =gid=5000, \ =mail=maildir:/var/mail/%d/%{ldap:mail}, \ =home=/var/mail/%d/%u/, \ =quota_rule=*:bytes=%{ldap:quotaMail} user_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_attrs = mail=user,userPassword=password pass_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) iterate_attrs = mail=user iterate_filter = (&(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) default_pass_scheme = CRYPT quotamail attribute was added to Active Directory. Enable quota: /etc/dovecot# grep -v '^ *$#.*$\?$' conf.d/90-quota.conf plugin { quota_rule = *:storage=2G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } ... plugin { quota = maildir:User quota } Per-user quota from SQL works fine: doveadm quota get -u i.ivanov(a)***.ru Quota name Type Value Limit % User quota STORAGE 8 1000000 0 User quota MESSAGE 14 - 0 Per-user quota from LDAP works too: doveadm quota get -u testmail(a)***.ru Quota name Type Value Limit % User quota STORAGE 962 2000 48 User quota MESSAGE 6 - 0 But if you do not set the attribute quotaMail: doveadm quota get -u e.etc(a)***.ru Quota name Type Value Limit % User quota STORAGE 0 - 0 User quota MESSAGE 0 - 0 And quota is unlimited. For comparison: doveadm user e.etc(a)***.ru field value uid 5000 gid 5000 home /var/mail/***.ru/e.etc(a)***.ru/ mail maildir:/var/mail/***.ru/e.etc@***.ru quota_rule *:bytes= doveadm user testmail(a)***.ru field value uid 5000 gid 5000 home /var/mail/***.ru/testmail(a)***.ru/ mail maildir:/var/mail/****.ru/testmail@***.ru quota_rule *:bytes=2048576 Logs: Aug 25 16:15:40 mail dovecot: auth: Debug: master in: USER#0111#011e.etc@ ***.ru#011service=doveadm Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: sql(e.etc(a)***.ru): SELECT CONCAT('/var/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = 'e.etc(a)***.ru' AND domain = '***.ru' Aug 25 16:15:40 mail dovecot: auth-worker(15295): sql(e.etc(a)***.ru): unknown user Aug 25 16:15:40 mail dovecot: auth: Debug: ldap(e.etc(a)***.ru): user search: base=ou=XXX,dc=***,dc=local scope=subtree filter=(&(mail=e.etc@***.ru)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) fields=mail,quotaMail Aug 25 16:15:40 mail dovecot: auth: Debug: ldap(e.etc(a)***.ru): result: mail=e.etc(a)***.ru; mail unused Aug 25 16:15:40 mail dovecot: auth: Debug: ldap(e.etc(a)***.ru): result: mail=e.etc(a)***.ru; quotaMail missing Aug 25 16:15:40 mail dovecot: auth: Debug: userdb out: USER#0111#011e.etc@ ***.ru#011uid=5000#011gid=5000#011mail=maildir:/var/mail/***.ru/e.etc@ ***.ru#011home=/var/mail/***.ru/e.etc@***.ru/#011quota_rule=*:bytes= Aug 25 16:15:42 mail dovecot: auth: Debug: master in: USER#0111#011testmail@ ***.ru#011service=doveadm Aug 25 16:15:42 mail dovecot: auth-worker(15295): Debug: sql(testmail(a)***.ru): SELECT CONCAT('/var/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = 'testmail(a)***.ru' AND domain = '***.ru' Aug 25 16:15:42 mail dovecot: auth-worker(15295): sql(testmail(a)***.ru): unknown user Aug 25 16:15:42 mail dovecot: auth: Debug: ldap(testmail(a)***.ru): user search: base=ou=XXX,dc=***,dc=local scope=subtree filter=(&(mail=testmail@***.ru)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) fields=mail,quotaMail Aug 25 16:15:42 mail dovecot: auth: Debug: ldap(testmail(a)***.ru): result: mail=testmail(a)***.ru quotaMail=2048576; mail,quotaMail unused Aug 25 16:15:42 mail dovecot: auth: Debug: ldap(testmail(a)***.ru): result: mail=testmail(a)***.ru quotaMail=2048576 Aug 25 16:15:42 mail dovecot: auth: Debug: userdb out: USER#0111#011testmail@ ***.ru#011uid=5000#011gid=5000#011mail=maildir:/var/mail/***.ru/testmail@ ***.ru#011home=/var/mail/***.ru/testmail@ ***.ru/#011quota_rule=*:bytes=2048576 Information from: http://dovecot.org/list/dovecot/2012-July/084859.html v2.1.7 2012-05-29 Timo Sirainen * LDAP: Compatibility fix for v2.0: ldap: If attributes contain ldapAttr=key=template%$ and ldapAttr *doesn't exist, skip the key* instead of using "template" value with empty %$ part for the key. OK, if quotaMail not set, shall apply root quota. Check LDAP: ldapsearch -x -h ***.***.local -D 'dovecot' -W -b 'OU=XXX,dc=***,dc=local' -s sub '(&(objectCategory=user)(objectClass=user)(mail=testmail(a)***.ru*))'|grep quotaMail Enter LDAP Password: quotaMail: 2048576 ldapsearch -x -h ***.***.local -D 'dovecot' -W -b 'OU=XXX,dc=***,dc=local' -s sub '(&(objectCategory=user)(objectClass=user)(mail=e.etc(a)***.ru*))'|grep quotaMail Enter LDAP Password: root@mail:/etc/dovecot# LDAP attribute *doesn't exist. * But Dovecot thinks that the quota is 0 and disables the quota. I can to set all the users quotaMail attribute, but a lot of them. Can I use root quota when the per-user quota is not set? Аnd change a per-user quota specific users only, if necessary? I apologize for my English. Thank you! -- Rasim Kalimullin

1 0

dict SQL : HA / RR load-balancing ?
by Florent Bautista 25 Aug '14

25 Aug '14

Hi everyone, I am using Dovecot 2.2 with dict SQL. My config is using : connect = host=10.111.5.1X host=10.111.5.1Y host=10.111.5.1Z dbname=mail user=quota_updater password=xxxxxxxx But when an SQL server is down, I have these messages in logs : dict: Error: mysql(10.111.5.1Y): Connect failed to database (mail): Can't connect to MySQL server on '10.111.5.1Y' (111) - waiting for 125 seconds before retry Does Dovecot support HA / RR load-balancing in dict SQL, as in passdb/userdb ? Thank you.

2 1

Director health checker
by Eduardo Ramos 24 Aug '14

24 Aug '14

Hi all. I'm writing a director health checker and ask you for suggestions. My project repository: https://github.com/duderamos/dovesitter Thanks.

2 1

does dovecot assume ~ = /home/userid ?
by Per Jessen 22 Aug '14

22 Aug '14

See $SUBJ - or is there a setting somewhere to control this? I have a userid = user(a)example.com with homedir (from /etc/shadow) = /home/example.com/user, but when dovecot wants to find e.g. ~/.dovecot.sieve , it looks in /home/user(a)example.com .... Doing "su - user(a)example.com" puts me in the correct directory. -- Per Jessen, Zürich (22.3°C) http://www.dns24.ch/ - your free DNS host, made in Switzerland.

2 2

Dovecot authentication LDAP SSL-TLS againts SAMBA4
by Lista de Dovecot 22 Aug '14

22 Aug '14

Hi, i would like to know if anybody have implemented the authentication of dovecot against samba4 via secure ldap (SSL/TLS). I made it but in plain text through dovecot´s offical page: http://wiki2.dovecot.org/AuthDatabase/LDAP/AuthBinds http://wiki2.dovecot.org/AuthDatabase/LDAP But when i try to do it in a secure way i can´t make it work. Samba4 is listening by port 636 and dovecot is speaking by 389 or 636, but they can´t comunicate themself. I´m wondering if any of you have done this before or have any clue that might help me. Thanks.

1 0

Avoid "451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply)"
by Florent Bautista 22 Aug '14

22 Aug '14

Hi all, I have a Dovecot setup (2.1, I will switch to 2.2 soon) with one Director and 2 backend servers. When my MX server (Postfix) tries to deliver mail to Dovecot via LMTP, it often gets an error "451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply)" from the Director. Service LMTP is configured with "client_limit = 1" on Director en backends (others limits are default ones). Postfix is using "lmtp_destination_recipient_limit = 1" and "lmtp_destination_concurrency_limit = 1". I want that incoming messages are stored one after one per recipient (have a queue per recipient). I does not seem to be done actually. I think Postfix is sending too many messages at a time to Director. How do you do to handle that ? I already applied the 3 patches available on the list for 2.1, but it does not seem to solve my problem... Thank you a lot. Florent

1 0