- dovecot - dovecot.org

Re: [Dovecot] Dovecot readable compressed mail archive
by Dave Hall 06 Dec '13

06 Dec '13

Alan, My goal is to reduce the file count in my backups. Based on the information at the link you sent it looks like for a Maildir setup the file count remains the same. Do you know if it's possible to have a mixed config with Dovecot where for a given user the Inbox is a maildir, but the archives are compressed mbox files? Thanks. -Dave On 12/04/2013 02:06 PM, Alan McGinlay wrote: > http://wiki2.dovecot.org/Plugins/Zlib try this.. Excuse the lack of quoted text, im on my phone

1 0

[Dovecot] Authentification Dovecot + Samba4
by dago＠quantentunnel.de 06 Dec '13

06 Dec '13

Hello list, I am struggling with setting up dovecot 2.1.7 with samba 4.1.2 on debian wheezy. Dovecot should authenticate via LDAP, but I cannot get it to work reliably. Sometimes auth works, sometimes not. Referals are already activated in ldap.conf … LDAP-authentication works fine with other clients (Apache Directory Studio, …) Has somebody got a similar setup running? I would love some hints on how to debug this issue … Thank you! Regards dovecot-ldap.conf hosts = 192.168.188.156:389 dn = CN=Administrator,CN=Users,DC=DOMAIN,DC=LOCAL dnpass = Test123 auth_bind = yes ldap_version = 3 base = DC=DOMAIN,DC=LOCAL tls = no debug_level = -1 ldap_version = 3 scope = subtree user_attrs = uidNumber=uid,gidNumber=gid user_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) pass_attrs = sAMAccountName=user,userPassword=password pass_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) logs: srv1 dovecot: auth: Debug: auth client connected (pid=0) srv1 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=doveadm#011resp=<hidden> srv1 dovecot: auth: Debug: ldap(john): bind search: base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john))) srv1 dovecot: auth: Error: ldap_search srv1 dovecot: auth: Error: put_filter: "(&(&(objectClass=Person)(sAMAccountName=john)))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(objectClass=Person)(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: "(objectClass=Person)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "objectClass=Person" srv1 dovecot: auth: Error: put_filter: "(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "sAMAccountName=john" srv1 dovecot: auth: Error: ldap_build_search_req ATTRS: sAMAccountName srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 1 status: Connected srv1 dovecot: auth: Error: last used: Fri Dec 6 19:08:49 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 35, origid 33, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 1 srv1 dovecot: auth: Error: * msgid 33, origid 33, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 1 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 3 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 35 message type search-result srv1 dovecot: auth: Error: ldap_chase_referrals srv1 dovecot: auth: Error: read1msg: V2 referral chased, mark request completed, id = 35 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 35 srv1 dovecot: auth: Error: merged parent (id 33) error info: result errno 1, error <00002020: Operation unavailable without authentication>, matched <> srv1 dovecot: auth: Error: request done: ld 0x7fef48794580 msgid 33 srv1 dovecot: auth: Error: res_errno: 1, res_error: <00002020: Operation unavailable without authentication>, res_matched: <> srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 33) srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 35) srv1 dovecot: auth: Error: ldap_free_connection 0 1 srv1 dovecot: auth: Error: ldap_send_unbind srv1 dovecot: auth: Error: ldap_free_connection: actually freed srv1 dovecot: auth: Error: ldap_parse_result srv1 dovecot: auth: Error: ldap_err2string srv1 dovecot: auth: Error: ldap(john): ldap_search(base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john)))) failed: Operations error srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-entry srv1 dovecot: auth: Error: ldap_first_attribute srv1 dovecot: auth: Error: ldap_get_values srv1 dovecot: auth: Error: ldap_next_attribute srv1 dovecot: auth: Debug: auth(john): username changed john -> john srv1 dovecot: auth: Debug: ldap(john): result: sAMAccountName=john srv1 dovecot: auth: Error: ldap_get_dn srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-reference srv1 dovecot: auth: Error: ldap_chase_v3referrals srv1 dovecot: auth: Error: ldap_url_parse_ext(ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local) srv1 dovecot: auth: Error: re_encode_request: new msgid 39, new dn <CN=Configuration,DC=DOMAIN,DC=local> srv1 dovecot: auth: Error: re_encode_request new request is: srv1 dovecot: auth: Error: ber_dump: buf=0x7fef4879d8d0 ptr=0x7fef4879d956 end=0x7fef4879e8ac len=134 srv1 dovecot: auth: Error: 0000: 61 6d 65 4e 61 6d 65 00 00 00 00 00 00 00 00 00 ameName......... srv1 dovecot: auth: Error: 0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0080: 00 00 00 00 00 00 ...... srv1 dovecot: auth: Error: ldap_chase_v3referral: msgid 37, url "ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local" srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_new_connection 0 1 1 srv1 dovecot: auth: Error: ldap_int_open_connection srv1 dovecot: auth: Error: ldap_connect_to_host: TCP DOMAIN.local:389 srv1 dovecot: auth: Error: ldap_new_socket: 19 srv1 dovecot: auth: Error: ldap_prepare_socket: 19 srv1 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.188.156:389 srv1 dovecot: auth: Error: ldap_pvt_connect: fd: 19 tm: -1 async: 0 srv1 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") srv1 dovecot: auth: Error: ldap_sasl_bind srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid 40 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid 40 (timeout 100000 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 3 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-result srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 37 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 0 s 99976 us to go srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL dovecot -n: # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } ssl = no userdb { driver = passwd }

2 1

[Dovecot] SQL as a storage backend
by Zachary Sturgeon 06 Dec '13

06 Dec '13

Hello, I am researching using dovecot with an SQL database as the storage backend. From what I've read, dovecot only supports mbox style file storage, but I'd like to investigate the possibility of using a database instead. According to http://dovecot.org/pipermail/dovecot/2006-June/013818.html, this possibility has been explored before and has generally been accepted that Dovecot is not optimized to handle this. Any suggestions? - Zachary Sturgeon

4 3

[Dovecot] UIDL and namespaces after qmail-pop3d and BincIMAP
by Adrian C. 06 Dec '13

06 Dec '13

Hello, I migrated qmail-pop3d and BincIMAP to Dovecot in the past, and I could always tweak the settings a little to match what old services used to provide, namely namespaces (separator /, prefix INBOX/) and pop3_uidl_format (%f). This time I'm migrating to a large mail system which has its configuration set differently and there's no changing it. pop3_uidl_format = %08Xu%08Xv namespace private {prefix = INBOX. separator = . inbox = yes} Am I corrent in thinking dsync plugin is the only chance I have of getting this mail migrated right? Unfortunately Debian's Dovecot is much much older than required v2.1.4... so I could use some advice from Dovecot experts. Thanks. -- Adrian C. (anrxc) | anrxc..sysphere.org | PGP ID: D20A0618 PGP FP: 02A5 628A D8EE 2A93 996E 929F D5CB 31B7 D20A 0618

1 0

[Dovecot] Design details of high performance dovecot cluster
by JEHERUL 06 Dec '13

06 Dec '13

Dear All, Currently we are running a mail system for 10000 users each 2GB mailbox. At present we have 5 mail servers where users mailboxes are distributed almost uniformly. We have a HP SAN Storage (HP EVA 6400) where mailboxes are stored. We partition the storage into five vg and each is mounted on the 5 servers. We are using postfix and dovecot. The system was running fine but currently we notices high IO load due to IMAP connection. So we are planning to build a dovecot cluster. Please suggest some design for the dovecot cluster keeping in mind to our scenario. (If needed we can buy additional hardware like load balancer). With Thanks and Regards -- Jeherul Islam India

2 3

[Dovecot] SOLR quick and dirty how to - needs review/testing
by Christian Rößner 06 Dec '13

06 Dec '13

Hi, I just wrote a quick and dirty how to. But not sure, if that is done the way it should. So any kind of feedback is welcome. http://www.roessner-network-solutions.com/?p=1127 At least the stuff does not break things here :-) Kind regards -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

[Dovecot] Active Directory LDAP userdb and dovecot
by Simone Ferretti 06 Dec '13

06 Dec '13

Hello everybody, I have a problem with LDAP userdb and dovecot. Let me first explain my LDAP configuration: I got three Active Directory LDAP servers (a.galliera.it, b.galliera.it, c.galliera.it) responding round robin to the name galliera.it. I want to use LDAP for the userdb lookup, so I configured dovecot-ldap-userdb.conf.ext as follow: hosts = galliera.it # round robin base = dc=galliera,dc=it ldap_version = 3 auth_bind=yes auth_bind_userdn = %n(a)galliera.it dn=CN=stampa,CN=Users,DC=galliera,DC=it dnpass=stampa base = DC=galliera,DC=it scope = subtree deref = always user_attrs = sAMAccountName=home=/home/dovecot.galliera.it/%$,=uid=8,=gid=8 user_filter = (&(objectClass=person)(sAMAccountName=%n)) default_pass_scheme=CRYPT With this configuration everything go fine, I can authenticate and lookup my users in the expected way. What follows is the conversation between (one of) the LDAP server(s) and dovecot after a issue of the command $ doveadm user -u <user>@galliera.it : 62.785686 10.0.31.235 -> 10.0.5.0 TCP 74 43053 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=536265719 TSecr=0 WS=32 62.786216 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43053 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 62.786279 10.0.31.235 -> 10.0.5.0 TCP 66 43053 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=536265719 TSecr=0 62.786394 10.0.31.235 -> 10.0.5.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 62.786583 10.0.31.235 -> 10.0.5.0 TCP 74 43054 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=536265719 TSecr=0 WS=32 62.786953 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43054 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 62.787008 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=536265719 TSecr=0 62.787039 10.0.31.235 -> 10.0.5.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 62.788484 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 62.788528 10.0.31.235 -> 10.0.5.0 TCP 66 43053 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=536265719 TSecr=36040952 62.789334 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 62.789365 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=536265720 TSecr=36040952 62.789462 10.0.31.235 -> 10.0.5.0 LDAP 174 searchRequest(2) "DC=galliera,DC=it" wholeSubtree 62.790396 10.0.5.0 -> 10.0.31.235 LDAP 392 searchResEntry(2) "CN=Marco De benedetto,OU=S.S.C. Area sistemistica,OU=S.C. S.I.e.T. - Servizi informatici e telecomunicazioni,OU=Dipartimento di Staff,OU=Direzione generale,DC=galliera,DC=it" | searchResRef(2) | searchResDone(2) success 62.790508 10.0.31.235 -> 10.0.5.0 LDAP 191 searchRequest(3) "CN=Configuration,DC=galliera,DC=it" wholeSubtree 62.791077 10.0.5.0 -> 10.0.31.235 LDAP 168 searchResRef(3) | searchResDone(3) success 62.791172 10.0.31.235 -> 10.0.5.0 LDAP 203 searchRequest(4) "CN=Schema,CN=Configuration,DC=galliera,DC=it" wholeSubtree 62.791838 10.0.5.0 -> 10.0.31.235 LDAP 88 searchResDone(4) success 62.828752 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=427 Ack=473 Win=15680 Len=0 TSval=536265730 TSecr=36040952 Strange things happen instead if I change the 'hosts' configuration variable to one (no matter what) of the domain controllers e.g.: hosts = a.galliera.it base = dc=galliera,dc=it ldap_version = 3 auth_bind=yes auth_bind_userdn = %n(a)galliera.it dn=CN=stampa,CN=Users,DC=galliera,DC=it dnpass=stampa base = DC=galliera,DC=it scope = subtree deref = always user_attrs = sAMAccountName=home=/home/dovecot.galliera.it/%$,=uid=8,=gid=8 user_filter = (&(objectClass=person)(sAMAccountName=%n)) default_pass_scheme=CRYPT Changing this variable to only one of the domain controllers make the doveadm request (issued as above) hang for some seconds and then exit with a Request time out message. This is the conversation record, you can note that there is *more the one* LDAP server involved in the conversation despite the fact that in the conf file only one is specified: 3427.019635 10.0.31.235 -> 10.0.10.0 TCP 74 33963 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106777 TSecr=0 WS=32 3427.020428 10.0.10.0 -> 10.0.31.235 TCP 78 ldap > 33963 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.020489 10.0.31.235 -> 10.0.10.0 TCP 66 33963 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106777 TSecr=0 3427.020562 10.0.31.235 -> 10.0.10.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 3427.021894 10.0.31.235 -> 10.0.10.0 TCP 74 33964 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106778 TSecr=0 WS=32 3427.022474 10.0.10.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 3427.022498 10.0.31.235 -> 10.0.10.0 TCP 66 33963 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=537106778 TSecr=33551087 3427.022805 10.0.10.0 -> 10.0.31.235 TCP 78 ldap > 33964 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.022868 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106778 TSecr=0 3427.022996 10.0.31.235 -> 10.0.10.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 3427.024537 10.0.10.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 3427.024574 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=537106778 TSecr=33551087 3427.024884 10.0.31.235 -> 10.0.10.0 LDAP 176 searchRequest(2) "DC=galliera,DC=it" wholeSubtree 3427.028078 10.0.10.0 -> 10.0.31.235 LDAP 391 searchResEntry(2) "CN=Simone Ferretti,OU=S.S.C. Area sistemistica,OU=S.C. S.I.e.T. - Servizi informatici e telecomunicazioni,OU=Dipartimento di Staff,OU=Direzione generale,DC=galliera,DC=it" | searchResRef(2) | searchResDone(2) success 3427.028426 10.0.31.235 -> 10.0.5.0 TCP 74 43077 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106779 TSecr=0 WS=32 3427.028882 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43077 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.028932 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106780 TSecr=0 3427.029091 10.0.31.235 -> 10.0.5.0 LDAP 80 bindRequest(4) "<ROOT>" simple 3427.029816 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(4) success 3427.029832 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=15 Ack=23 Win=14624 Len=0 TSval=537106780 TSecr=36074586 3427.030001 10.0.31.235 -> 10.0.5.0 LDAP 193 searchRequest(3) "CN=Configuration,DC=galliera,DC=it" wholeSubtree 3427.030980 10.0.5.0 -> 10.0.31.235 LDAP 168 searchResRef(3) | searchResDone(3) success 3427.064639 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=167 Ack=348 Win=15680 Len=0 TSval=537106789 TSecr=33551087 3427.068791 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=142 Ack=125 Win=14624 Len=0 TSval=537106790 TSecr=36074586 Is there anyone that have some ideas of what is going on? My dovecot version is 2.2.9 (5c170e0786f3) running on a debian wheezy 3.2.0-4-amd64. My Active Directory server is a windows server 2003 R2. Follows my doveconf -n: # 2.2.9 (5c170e0786f3): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext4 auth_cache_size = 8 k auth_debug = yes auth_master_user_separator = * auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 5 hostname = dovecot.galliera.it last_valid_uid = 100000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_debug = yes mail_gid = mail mail_location = maildir:/home/%d/%n/Maildir mail_privileged_group = mail mail_uid = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/var/mail/shared/istituzionali:INDEX=/var/mail/shared/istituzionali/INDEX/%n prefix = Avvisi al personale. subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile fts = squat fts_squat = partial=4 full=10 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = from subject uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)galliera.it protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = mail } unix_listener auth-userdb { mode = 0777 user = mail } user = root } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 30 mail_plugins = fts fts_squat mail_log zlib acl imap_acl notify } protocol pop3 { pop3_uidl_format = %v.%u } Thanks in advance and ciao! Simone

1 0

[Dovecot] Expire plugin and databases
by Mauricio Tavares 06 Dec '13

06 Dec '13

Dumb question: do I need to have a database to run the expire plugin?

2 1

[Dovecot] zlib config questions
by Terry Barnum 05 Dec '13

05 Dec '13

After nearly running out of space I swapped in larger disks and then saw the recent threads about zlib compression. Unfortunately I'm still confused after reading <http://wiki2.dovecot.org/Plugins/Zlib>. In order to compress new email being stored do I only need to change 10-mail.conf to this: mail_plugins = $mail_plugins zlib and 90-plugin.conf to this: plugin { zlib_save_level = 6 zlib_save = gz ... Or do I need to instead (or also?) add it to the list of plugins in 20-imap.conf? A simple 'sudo doveadm reload' to enable? Once enabled, is there an indication in the logs that compression is taking place? Do new mail files have a suffix like .Z to indicate they've been compressed? Any gotchas to be aware of? I'm running macports dovecot 2.2.5. Thanks for any help. -Terry Terry Barnum digital OutPost http://www.dop.com

1 0

[Dovecot] Syslog debug messages
by Bruno Galindro da Costa 05 Dec '13

05 Dec '13

Is there a way to configure dovecot to register in syslog the debug messages enabled by mail_debug=yes as a debug not as information? I need this because I want to send this kind of information only to a remote server. I've configured rsyslog to do this, but dovecot is registering those debug messages as information not as debug (as I expected). This is my rsyslog config: mail.info;\ mail.warning;\ mail.err;\ mail.crit -/var/log/mail.log mail.* :omrelp:192.168.2.162:2514 root@imap:~# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 4748). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.32-44-server x86_64 Ubuntu 10.04.4 LTS xfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve pop3s listen(default): *:143,[::]:143 listen(imap): *:143,[::]:143 listen(pop3): * listen(managesieve): * ssl_listen(default): *:993,[::]:993 ssl_listen(imap): *:993,[::]:993 ssl_listen(pop3): *:2221,[::]:2221 ssl_listen(managesieve): ssl_ca_file(default): /etc/dovecot/ca.crt ssl_ca_file(imap): /etc/dovecot/ca.crt ssl_ca_file(pop3): /etc/dovecot/ca.crt ssl_ca_file(managesieve): ssl_cert_file(default): /etc/dovecot/ufsc.br.crt ssl_cert_file(imap): /etc/dovecot/ufsc.br.crt ssl_cert_file(pop3): /etc/dovecot/ufsc.br.crt ssl_cert_file(managesieve): /etc/ssl/certs/dovecot.pem ssl_key_file(default): /etc/dovecot/ufsc.br.key ssl_key_file(imap): /etc/dovecot/ufsc.br.key ssl_key_file(pop3): /etc/dovecot/ufsc.br.key ssl_key_file(managesieve): /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_process_size: 256 login_max_processes_count: 900 login_max_connections: 1024 max_mail_processes: 2048 mail_max_userip_connections(default): 2048 mail_max_userip_connections(imap): 2048 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_privileged_group: mail mail_uid: vmail mail_gid: mail mail_location: maildir:/var/mail/mailboxes/%d/%n:INDEX=/var/mail/indexes/%d/%n mail_debug: yes fsync_disable(default): yes fsync_disable(imap): yes fsync_disable(pop3): yes fsync_disable(managesieve): no mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota autocreate trash zlib mail_plugins(imap): quota imap_quota autocreate trash zlib mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve managesieve_implementation_string(default): dovecot managesieve_implementation_string(imap): dovecot managesieve_implementation_string(pop3): dovecot managesieve_implementation_string(managesieve): Cyrus timsieved v2.2.13 lda: fsync_disable: no postmaster_address: xxx(a)xxx.xxx.xx mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@~ username_format: %Lu passdb: driver: checkpassword args: /etc/dovecot/passdb.v3.1.sh userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap-userdb.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: quota_exceeded_message: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx. quota: maildir:DefaultQuota quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 %u quota_warning2: storage=90%% /usr/local/bin/quota-warning.sh 90 %u trash: /etc/dovecot/dovecot-trash.conf sieve: /var/mail/sieve_scripts/%d/%n/.dovecot.sieve sieve_dir: /var/mail/sieve_scripts/%d/%n/sieve mail_log_events: delete expunge copy mailbox_delete mail_log_fields: uid box msgid from subject size vsize autocreate: Spam autosubscribe: Spam -- Att. Bruno Galindro da Costa

2 1

[Dovecot] FTS solr issue with second private namespace
by Andreas Oster 05 Dec '13

05 Dec '13

Hi all, I have just stumbled over an issue with the FTS plugin of dovecot. For our primary namespace, INBOX and its subfolders, searching works without any problems but in a second namespace, which I have created for old/archived mails, searching of the mail text/body does not work. I can see the search request in the tomcat log but no result is created and the mail client (Thunderbird) keeps displaying the serach message without returning any results. Tomcat6 catalina.out: Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/select params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} hits=0 status=0 QTime=1 I am currently using Dovecot 2.2.9 and do not have any special FTS config: mail_plugins = quota mailbox_alias fts fts_solr plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8080/solr/ fts_autoindex = yes } Thank you for your kind help best regards Andreas

1 2

[Dovecot] Full text search improvements
by Timo Sirainen 05 Dec '13

05 Dec '13

FTS indexing is something I hear quite often nowadays. I’ve added some hacks to make it work better for some installations, but it’s about time to think about the whole design and how it could be improved for everyone in future. Here are some of my initial thoughts. Currently Dovecot supports 3 full text search engines: Solr, CLucene and Dovecot Squat. CLucene plugin has various features built in, which should have been built in a generic way to work with all the engines (although Solr has most of those already built-in). Squat was abandoned a few years ago in favor of Solr/CLucene, but perhaps it could be brought back to life, since it looks like its index sizes could be smaller than Lucene's. Here's a list of things that should be added to generic Dovecot FTS code to improve all the backends: 1. Support for multiple languages. Use textcat while indexing to guess the language of the indexed data. (Perhaps run it separately for each paragraph to handle multi-language mails? Or at least many emails begin/end with different language than the text in the middle, e.g. "Foo Bar wrote:" is often in various languages.) Index the data using the detected language's stemming and other features. Keep track of which languages have been used in the index, and when searching stem the search words to all the used languages. Since each added language requires additional searches and there's the possibility of wrong detection, the list of allowed languages could be configurable. See also http://ntextcat.codeplex.com/ or at least change textcat to use UTF8. 2. Word stemming. This can be done for many languages with Snowball library. Solr has also implemented several other languages, perhaps its code can be somehow automatically translated to C(++) for use with Dovecot? 3. Don't index language-specific stopwords. We can get the word lists from e.g. Solr. 4. Try to detect compound words and index each part separately for languages that use them. http://wiki.apache.org/solr/LanguageAnalysis#Decompounding suggests two possible ways to do it. 5. Normalize words (e.g. drop diacritics). libicu can be used for this. 6. Drop (Unicode) characters that don't belong to the language? Or especially don't index most of the weird Unicode characters. This would avoid filling the index with unnecessary garbage. 7. Don't index non-text data? For example if there is large block of base64 data or something else that definitely doesn't look like text, it's pretty useless to index it. Then again, we do want to index all kinds of IDs that someone might want to search. This could be a bit difficult to implement well. 8. Index attachments separately, so it would be possible to search only attachments. (Should "SEARCH BODY word1 BODY word2" return matches if word1 and word2 are in different attachments?) 9. Attachments can be translated to indexable UTF-8 text already with fts_decoder setting by doing it via a conversion script. This could also support Apache Tika server directly. 10. It should be configurable which fields are indexed. Body and header would always be separately indexed. Optionally there could be also at least: attachments, From, To, Cc, Bcc and Subject. The From/To/Cc/Bcc could also be indexed together in one "addresses" field. The more fields there are, the larger the index, but better/faster search results. 11. Each indexed mail should have metadata: Mailbox GUID, mail UID and the language the mail was indexed with. For attachments there should also be the MIME part number. When matching results, drop results if returned language doesn't match the query language. Squat ----- Currently Squat index consists of a trie containing all the words and pointer to a file listing all the message UIDs that contain them. Each node in the trie has a pointer to the UIDs, so e.g. with "abc" the "a" node will contain UIDs of all mails that contain the "a" letter (e.g. 1,3-5,10). "ab" node will contain mails that have the "ab" substring. Since the "ab" is a subset of "a", the "ab" won't contain UIDs directly but instead it contains indexes to the "a" list to get a better compression (e.g. UID 3-5,10 -> 2-4 indexes in the "1,3-5,10" list). The "abc" node then similarly refers to the "ab" node's indexes. It's configurable how long words Squat will index. Also substring matching is configurable. By default both are 4 letters, so words longer than 4 letters will be split to 4 letter pieces which are indexed (e.g. "dovecot" -> "dove", "ovec", "veco", "ecot"). When searching these pieces are looked up and the results are merged. It's pretty pointless to do a search for 1-2 letter substrings. Most likely the user wants to find 1-2 letter word instead. Perhaps this is true also for 3 letters? The Squat index could be changed to only add results for the first 1-2 (or 1-3?) letters only for full words, not to word prefixes. This of course would mean that the "ab" referring to "a" UID list would no longer work for the first nodes. Substring searching likely wouldn't work very nicely for stemmed words. So Squat should probably index the full stemmed word and then also index the unstemmed word in the small 4 letter pieces. It should be possible to also disable substring searching entirely. Squat already attempts to reduce disk space by encoding the common characters with less bits than other characters. This is hardcoded for English language though. Each index compression could analyze the most common letters and dynamically use those. Perhaps different languages could even use separate Squat index files to get the most advantage of this? Although if there are a lot of languages it's a bit annoying to have many different index files. Squat currently indexes each Unicode character as one letter, so there can be quite a huge number of different 4 letter words. This substring indexing should probably be disabled for words that contain letters not used by the current language. The UID lists are not compressed very efficiently. See http://www2009.eprints.org/41/1/p401.pdf for alternatives. There is currently one Squat index per mailbox. There should be one per user. This requires adding a separate ID -> { mailbox GUID, UID, language, mime part } mapping file. Squat indexes should be updated in two parts. For old mails there are the large trie+uidlist base files in optimized format. For new mails there are small trie+uidlist files in a format where they are just appended to. When the trie or uidlist becomes large enough, it's first internally sorted/optimized, and then merged with the base files by recreating new optimized base files. This fixes the scalability problem with current large Squat indexes where with large unsorted indexes the sorting could have taken forever. Since substring searches in Squat produce only "maybe matches" UID lists, the mails still need to be opened and searched through. This step could probably also do the same language detection + stemming as is done during indexing to improve the search results. (And this feature could be enabled even if no FTS index is enabled.)

6 9

[Dovecot] Postfix & Dovecot Sieve Advice
by craig.dovecot＠noboost.org 05 Dec '13

05 Dec '13

Hi, I've configured up Dovecot Pigeonhole with Postfix for delivery (all working perfectly). Seeing as I'm about to use this in production, I'm just after any advice or tips people might have to safeguard email delivery from Postfix to Dovecot via LMTP? Spec: postfix-2.6.6-2.2.el6_1.x86_64 dovecot-2.0.9-5.el6.x86_64 dovecot-pigeonhole-2.0.9-5.el6.x86_64 Postfix: virtual_transport = lmtp:unix:private/dovecot-lmtp Dovecot (key settings): vim /etc/dovecot/conf.d/10-auth.conf auth_username_format = %Ln vim /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } vim /etc/dovecot/conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } vim /etc/dovecot/conf.d/90-sieve.conf plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_min_period = 1h sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d } Regards, Craig

1 0

[Dovecot] BUG: Authentication client sent unknown handshake command
by Emmanuel Dreyfus 04 Dec '13

04 Dec '13

Hi After upgrading the kernel, everything is fine, except dovecot authentication. I get this trange thing (data after REQUEST? changed just in case it contains anything sensitive): Nov 29 16:56:01 volanges dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: REQUEST?6970356762?616?6?235264ef69dbd1665538af54d12fdaea?session_pid=453?req... Nov 29 16:56:01 volanges dovecot: imap: Error: Authentication server didn't send valid SPID as expected: MECH PLAIN plaintext Nov 29 16:56:01 volanges dovecot: imap: Error: Disconnected from auth server, aborting (client-pid=161 client-id=1) Nov 29 16:56:01 volanges dovecot: imap-login: Internal login failure (pid=161 id=1) (internal failure, 1 successful auths): user=<jdoe>, method=PLAIN, rip=192.0.2.251, lip=192.0.2.10, mpid=453, TLS, TLSv1 with cipher AES128-SHA (128/128 bits) Reverting to the previous kernel fixed the problem, but I have not been able to spot what the problem was. Any idea? -- Emmanuel Dreyfus manu(a)netbsd.org

3 5

[Dovecot] Ubuntu packages and broken link in docs
by Alan McGinlay - SICS 04 Dec '13

04 Dec '13

Hi, Two things: 1. Does anyone know of a good PPA with updated packages of Dovecot for Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka APT Repository. (Outdated. Could someone provide a ppa for latest stable Dovecot, please?)" 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page there is a link to a supposedly outdated PPA, the ppa page now redirects to an ad for the guys services so should probably be removed. /Alan

2 1

[Dovecot] Different settings for SSL/non-SSL protocols
by Алексей Прокопчук 04 Dec '13

04 Dec '13

Good time of the day! It is possible to setup dovecot with different requirements for SSL and non-SSL protocols? What would I like to do: pop3/imap non-SSL = allowed plain text authentication. pop3/imap with SSL = allowed plain text authentication with required valid SSL certificates. I need to allow access from any IP address for first group of users, which have valid SSL certificates. And allow access from only local IP addresses for second group of users which doesn't have SSL certificates at all. I tried to setup dovecot for such task. SSL and non-SSL pop3/imap works together fine, but without require valid SSL certificates. If I set auth_ssl_require_client_cert = yes, non-SSL pop3/imap refuses authentication without valid SSL certificate. I tried to use different sections for protocol pop3 {} and protocol pop3s {} (and imap/imaps) but this seems doesn't work. Is there any way to solve this? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE)

1 2

[Dovecot] Complete migration from Cyrus on remote server
by Alan McGinlay - SICS 04 Dec '13

04 Dec '13

Hi All! I am working on a complete migration from an old solaris machine running Cyrus IMAP v2.3.14 and wish to migrate all users to a new ubuntu vm running Dovecot 2.0.19. What I have so far is a fully functional dovecot installation with LDAP / Dovecot SASL auth using Maildir++. My plan is to use Perdition IMAP proxy on a third host and migrate users a few at a time (see attached picture of my whiteboard). The proxy is in place and already used by webmail clients to connect to the old server, shortly I will change the dns to point smtp.domain.com and imap.domain.com etc to the proxy instead of the old server but I haven't finished testing yet. Once that is done it is a simple matter of changing the proxy configuration per user to make them hit the new server instead. The problem I am having with this is that I am using Imapsync (http://imapsync.lamiral.info) to perform the initial synchronization (i have scripted it to maintain sync every 10 minutes with the addtion of "--maxage 1" option) using the following command line options: /usr/local/bin/imapsync --noreleasecheck --useheader ALL --delete2 --expunge2 --tmpdir /var/vmail/cache --subscribe --subscribed --tls1 --tls2 --usecache --nofoldersizes --nocheckmessageexists --host1 oldserver.domain.com --authuser1 adminuser --user1 testuser(a)domain.com --authmech1 PLAIN --password1 <HIDDEN> --host2 newserver.domain.com --authuser2 adminuser --user2 testuser(a)domain.com --authmech2 PLAIN --password2 <HIDDEN> All email is copied over and stored in dovecot as you would expect. Then I switch the user to the new server on the imapproxy and restart the client (thunderbird or whatever). This is where all email headers are downloaded again as if they were new! There are *Many* users here who would complain intensely if this happened and I was really wanting the migration to be as invisible as possible. Is there a way to do what I have described without the clients redownloading headers / full messages? I have been working on this for some time now but have hit a roadblock and don't know where to turn, any help would be really appreciated! Notes: * The proxy is not used during imapsync. * Some users have 20 years worth of mail running into 10's of GB * I have looked at dsync but the docs state that the mailbox should not be accessed during sync, this is not possible for me (it doesn't say why this is the case however)

4 7

[Dovecot] file descriptor errors
by Christian Rößner 04 Dec '13

04 Dec '13

Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/mx_deltaweb_de.crt ssl_key = </etc/ssl/private/mx_deltaweb_de.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl zlib mail_log notify sieve } protocol lda { mail_plugins = quota acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib } Thanks in advance -Christian Rößner -- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com

1 0

[Dovecot] Possible managesieve bug.
by Pedro R. Benito da Rocha 04 Dec '13

04 Dec '13

Hi, I'm migrating from from 1.1 to 2.2. Currently I am doing test to ensure I'm doing it right. On the old server the managesieve config says: sieve = /correo/%d/%u/dovecot.sieve sieve_dir = /correo/%d/%u/Sieve and is working fine. But the same config on the new server is not working. I have activated verbose logging and this is the result: Dec 3 09:59:41 imap-01 dovecot: managesieve-login: Login: user=<xxxx(a)ubu.es>, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29855, session=<T7hfhJ3s+QAKkQRB> Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Failed to stat active sieve script symlink (/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve) Permission denied. Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Disconnected: Logged out bytes=120/331 Dec 3 09:59:51 imap-01 dovecot: managesieve-login: Login: user=<pedro(a)ubu.es>, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29858, session=<6bDthJ3s+wAKkQRB> Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Disconnected: Logged out bytes=44/199 Permissions are ok. I modified the permissions using 0777 but the error message is the same. I have made other tests to see if I can find the problem, and I made it work if I delete "%d" from config, this way: sieve = /correo/%u/dovecot.sieve sieve_dir = /correo/%u/Sieve I have copied all filters preserving permissions, and with the same file permissions is working. If I add the '%d' to the path error comes again. Can anyone tell me if this is the normal behavior or is a bug? Thanks, Pedro -- ------------------------------------------------------------------------ Pedro R. Benito da Rocha - Servicio de Informatica - Area de Sistemas Universidad de Burgos (España) E-mail: pedro(a)ubu.es Tel: +34 947258845 ------------------------------------------------------------------------

2 2

[Dovecot] disconnecting (disconnected by server)
by Patrick Westenberg 03 Dec '13

03 Dec '13

Hi all, I just recognized a lot of log entries like this on my proxy: Dec 03 13:50:54 imap-login: Info: proxy(mail(a)example.com): disconnecting 1.2.3.4 (Disconnected by server): user=<mail(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=2.4.6.8, TLS, session=<qk02v6DsJwBTlUQX> There are no similar entries on the backends. What does this mean? Something I have to worry about? Regards Patrick # 2.2.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_mechanisms = plain login default_process_limit = 150 director_mail_servers = 172.17.1.2 172.17.1.1 director_servers = 172.17.1.3 172.17.1.4 director_user_expire = 5 mins lmtp_proxy = yes log_path = /var/log/dovecot.log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 172.17.1.3 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = 172.17.1.3 port = 24 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } service pop3-login { executable = pop3-login director } ssl_cert = </etc/ssl/certs/wildcard.example.com.crt ssl_key = </etc/ssl/private/wildcard.example.com.key protocol !smtp { passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } } protocol smtp { passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } } protocol lmtp { auth_socket_path = director-userdb } # 2.2.2: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_mechanisms = plain login disable_plaintext_auth = no dotlock_use_excl = no hostname = mb01.example.com listen = 172.17.1.1 log_path = /var/log/dovecot.log login_trusted_networks = 172.17.1.3 172.17.1.4 mail_fsync = always mail_gid = vmail mail_home = /var/mail/%d/%n mail_location = maildir:~/Maildir mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spamverdacht { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::file:%h/Maildir/dovecot-quota quota_rule2 = INBOX.Trash:ignore quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve/sieve_after.sieve sieve_default = /usr/local/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { mode = 0666 user = vmail } } service lmtp { inet_listener lmtp { address = 172.17.1.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/etc/dovecot/quota_warning.sh unix_listener quota-warning { user = vmail } user = root } ssl_cert = </etc/ssl/certs/mb01.example.com.crt ssl_key = </etc/ssl/private/mb01.example.com.key submission_host = mf01.wk-serv.net userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = quota imap_quota }

2 5

[Dovecot] Error in imap_address_arg_append
by Potapov Sergey 03 Dec '13

03 Dec '13

Hi Function imap_envelope_parse return incorrect result for addresses with groups due to error in imap_address_arg_append because of with ", " is added after group name and before first mailbox. Patch for dovecot v2.1 in attach.

2 1

[Dovecot] Gettings mails recently moved to a folder
by Florian Lindner 03 Dec '13

03 Dec '13

Hello, some spam training tools learn the same message over and over again. Since I want to use a daily cronjob to train messages and I do not want to have the same messages trained multiple times, I need to way to get new messages in a folder. Is there a (consolish) way to get a list of messages that were recently moved to a folder? dovecot does not modify mtime, according to RFC 3501. Thanks, Florian

5 9

[Dovecot] imap-login hangs after receiving revoked SSL certificate
by Алексей Прокопчук 03 Dec '13

03 Dec '13

Good time of the day! My English is not very good, excuse me if I said something wrong. I use dovecot-2.1.16 on Gentoo Linux amd64. I need to setup dovecot (imap and pop3) for SSL and non-SSL connection simultaneously. For SSL connections client must submit a valid SSL certificate. Now SSL part of dovecot.conf looks like this: ----------------- ssl = yes ssl_cert = </etc/ssl/dovecot/dovecot.pem ssl_key = </etc/ssl/dovecot/dovecot.pem ssl_ca = </etc/ssl/ca/ca.pem ssl_verify_client_cert = yes auth_ssl_require_client_cert = yes protocol !smtp { auth_ssl_require_client_cert = yes } ----------------- All works fine with valid certificates. But if I submit revoked certificate, dovecot doesn't send error or success messages to mail client, process 'imap-login' eats 100% CPU and completely hangs. Only SIGKILL can terminate it. When dovecot receives revoked certificate, following messages appears in the log: ------------------ Dec 2 13:50:26 mail dovecot: imap-login: Invalid certificate: certificate revoked: /O=AP inc./OU=Admins/CN=Alexey Prokopchuk/UID=alexpro Dec 2 13:50:26 mail dovecot: imap-login: Invalid certificate: Different CRL scope: /CN=AP inc. root certification authority/O=AP inc./C=UA Dec 2 13:50:39 mail last message repeated 17950 times ------------------- If I'm not mistaken, in case of revoked certificate submission, dovecot must simply answer "SSL error" or "permission denied" to client and close connection, but according to log, it tries to check certificate again and again and do it in infinite loop. I can't understand for now - I misconfigured something or it's a bug? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE)

2 3

[Dovecot] proxy, userdb and passdb
by Jogi Hofmüller 03 Dec '13

03 Dec '13

Dear all, We are getting closer to the migration of our mailsystem. Now I have a special question. We are successfully using passdb { driver = pam } and that is good. Now, how would I tell dovecot to proxy certain users (the ones not yet migrated) to the old server? My attempts to configure an additional userdb failed since this seems to override the passdb setting. Grateful for any hints! Cheers, -- j.hofmüller Optimism doesn't alter the laws of physics. - Subcommander T'Pol

4 5

[Dovecot] Dove LDA vs Exim LDA
by Kumar Shantanu 02 Dec '13

02 Dec '13

Hello All, I have built up my email server with exim + dovecot + clamv/spamassasin. I am using exim as LDA(local delivery agent). I was reading about using dovecot as LDA but I couldn't find why should I use it? Now, I am looking expert advice on "Why should I use dovecot LDA" ? Is there any benefit in terms of functionality or performance ? Any advice/suggestion/feedbacks welcome. Thanks Shantanu

5 5