August 2012 - dovecot

[Dovecot] dovecot+LDAP/AD encoding issue
by Wiethoff, Helge 09 Aug '12

09 Aug '12

Hello everybody, i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (äöüß (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) Thanks and greetings from Germany, Helge ---- dovecot --version 2.0.16 ---- D-AS01:/etc/dovecot # grep -v '^ *$#.*$\?$' dovecot-ldap.conf.ext uris = ldap://10.37.5.90 dn = CN=ldap-d-as01,CN=Users,DC=tfh-bochum,DC=de dnpass = xxxx auth_bind = yes ldap_version = 3 base = ou=Benutzer, ou=Lehre, dc=tfh-bochum, dc=de user_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln user_filter = mail=%u pass_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln pass_filter = (&(mail=%u)(!(extensionAttribute3=*))) ---- dovecot -n # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.37.6-0.11-default x86_64 openSUSE 11.4 (x86_64) auth_debug = yes auth_mechanisms = plain login auth_username_translation = %Lu auth_verbose = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 1000 mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir:INDEX=%h/Maildir/shared/%%u:CONTROL=%h/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/srv/mail/shared-mailboxes quota = maildir:Quota quota_rule = *:storage=1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 10 } protocols = imap pop3 sieve lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0770 user = root } } service imap-login { process_min_avail = 4 service_count = 0 } service managesieve-login { inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 2000 } process_min_avail = 2 service_count = 0 } ssl_ca = </etc/ssl/certs/tfh_dfn_dtag_cacert.pem ssl_cert = </etc/ssl/certs/imap.stud.tfh-bochum.de-20110530-cert-302177588.pem ssl_key = </etc/ssl/private/imap.stud.tfh-bochum.de-20110530.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota } protocol imap { mail_plugins = quota acl imap_acl imap_quota } protocol pop3 { mail_plugins = quota } ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff(a)tfh-bochum.de Technische Fachhochschule Georg Agricola für Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft für Lehre und Bildung mbH Herner Straße 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Träger: DMT-Gesellschaft für Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Geschäftsführung: Prof. Dr. Jürgen Kretschmann (Vorsitzender) Manfred Freitag

3 4

Re: [Dovecot] some mdbox mails get lost each day
by Timo Sirainen 09 Aug '12

09 Aug '12

On 9.8.2012, at 11.24, Christian Rößner wrote: > I had enabled mail_log and search for any kind of errors. None. Only expunge messages from a imap process. Which I thought was Outlook. But isn't. So there is an imap expunge entry for all of the mails that get lost? You should be able to match that with the IMAP client's IP address by using session IDs, for example: mail_log_prefix = "%s(%u) <%{session}>: " Also you may be able to find out what client is doing it by setting: imap_id_log = *

1 0

[Dovecot] Mail deletion and Solr index update
by Matthias Rieber 09 Aug '12

09 Aug '12

Hi, I've deleted 10000s emails and it seems that every mail is removed with a single request from Solrs index. This works, but it's quite slow. Is it possible/plans to improve that? Matthias

2 4

[Dovecot] Quota dict configuration
by Uros 08 Aug '12

08 Aug '12

Hi, I have enabled quota dict with mysql following wiki http://wiki2.dovecot.org/Quota/Dict Everything work as expected. I just have a question about query used for updating quota usage. I already check the source file dict-sql.c but i still can't figure it out. I store user info in a mysql table where only left (user) part of an email address is stored with foreign id for domain conected to domain table. The problem is administration because quota table have primary key whole email. Is there even possible to configure quota dict settings to use separate variables %n and %d like in user and password query? -- lp Uroš

1 0

[Dovecot] Statistics scripts
by Timo Sirainen 08 Aug '12

08 Aug '12

I wrote two scripts, which you can use with the stats plugin enabled to get a better "doveadm stats top" than it currently is: http://dovecot.org/tools/stats-top.pl http://dovecot.org/tools/stats.pl

2 1

[Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout
by Nikolai Schupbach 08 Aug '12

08 Aug '12

Timo, There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): dsync(first.last(a)test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 14: Disconnected dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 15: Disconnected dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 16: Disconnected ... dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 14492: Disconnected dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 14493: Disconnected dsync(first.last(a)test.co.nz): Error: pop3_migration: Failed to get header for msg 14494: Disconnected Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, or it should simply reconnect if sees the connection is lost. At the moment the only work around is to increase the POP3 server's idle timeout to a multi hour value, which isn't a good work around as it causes a lot of inactive POP sessions to bank up. Regards, Nikolai.

2 3

Re: [Dovecot] sieve vacation messages trouble
by asier.cidon＠externo.uam.es 08 Aug '12

08 Aug '12

The problem is solved!!!! In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the package "dovecot-sieve" or "dovecot-pigeonhole" modify: smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); You can check the correct operation in your logs. /var/log/maillog postfix/smtpd[27112]: connect from smtp.mydomain.com postfix/smtpd[27112]: A95D2168456: client=smtp.mydomain.com postfix/cleanup[27114]: A95D2168456: message-id=<A5BBC98AAF65424CADBFB6ACF0003E8B03FB4B74(a)example.com> postfix/smtpd[27112]: disconnect from smtp.mydomain.com postfix/qmgr[17010]: A95D2168456: from=<asier.cidon(a)example.com>, size=7274, nrcpt=1 (queue active) postfix/pipe[27115]: A95D2168456: to=<asier.cidon(a)mydomain.com>, relay=dovecot, delay=0.09, delays=0.01/0/0/0.08, dsn=2.0.0, status=sent (delivered via dovecot service) postfix/qmgr[17010]: A95D2168456: removed /var/log/dovecot.log dovecot: auth(default): master out: USER 1 asier.cidon(a)mydomain.com uid=xxx gid=xxx quota_rule=*:bytes=524288000 home=/buzon/asier.cidon dovecot: deliver(asier.cidon(a)mydomain.com): sieve: msgid=<A5BBC98AAF65424CADBFB6ACF0003E8B03FB4B74(a)example.com>: sent vacation response to <asier.cidon(a)example.com> dovecot: deliver(asier.cidon(a)mydomain.com): sieve: msgid=<A5BBC98AAF65424CADBFB6ACF0003E8B03FB4B74(a)example.com>: stored mail into mailbox 'INBOX' /var/log/maillog postfix/pickup[17009]: B221D168458: uid=xxx from=<asier.cidon(a)mydomain.com> postfix/cleanup[27114]: B221D168458: message-id=<dovecot-sieve-1344420404-703760-0(a)mda.mydomain.com> postfix/qmgr[17010]: B221D168458: from=<asier.cidon(a)mydomain.com>, size=661, nrcpt=1 (queue active) postfix/smtp[27195]: B221D168458: to=<asier.cidon(a)example.com>, relay=smtpinterno.mydomain.com, delay=0.04, delays=0.01/0/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as A3A092280B3) postfix/qmgr[17010]: B221D168458: removed

2 1

[Dovecot] doveadm import is always verbose
by Jürgen Obermann 08 Aug '12

08 Aug '12

Hello, with dovecot versions up to 2.1.9, when I use: doveadm import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all it always sends out info messages for every mail copied like that: doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Greetings, Jürgen -- Jürgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universität Gießen Heinrich-Buff-Ring 44 Tel. 0641-9913054

2 1

[Dovecot] Dovecot with Company - level Quota
by Kavish Karkera 08 Aug '12

08 Aug '12

Hi Timo, We are using maildir as quota-backend , and performing user level quota, which is working fine. (using dovecot 2.x ). Now the requirement is to , restrict the quota to client / company level along with user level quota. For. eg. We have a mailbox path like /mail/mailstore/10001/kavish.karkera(a)linoquery.com/Maildir/ where 10001 is Client code (unique number given to very client) instead of domain name. So there would be two quota's one at company level and other user level. Such as 10001(linoquery.com) = 5GB ---> Company Quota kavish.karkera(a)linoquery.com = 0 ? ---> User Quota If the sum of the user quota under 10001/* exceeds the 5GB limit then the mails for that particular domain should get bounced. Please Help , if this is possible. Regards, Kavish Karkera

2 1

[Dovecot] replication chain
by Костырев Александр Алексеевич 08 Aug '12

08 Aug '12

good day! I wonder if it is possible to make a chain of replication in dovecot 2.1.9. Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but is it possible to setup replication like this: serverA ---> serverB --> server C <--- I've added additional mail_replica2 on serverB and after restart dovecot didn't complain about errors, with doveconf -n I am able to see two replica's settings but user's mails aren't replicating to server C. no errors in logs. I want to use server C as backup server with lvm snapshots.

2 1