- dovecot - dovecot.org

[Dovecot] Per-user Sieve script location question
by Selcuk Yazar 21 May '14

21 May '14

Hi, after some problems, i successfuly ran my dovecot delivery and pigeonhole service in redhat EL 6. our users stored OpenLdap and users home folder like below: /home/vmail/domains/domainname.edu.tr/username/... now when i used default settings for dovecot sieve sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve script write and work globaly and stored, /home/vmail/domains/sieve i looked up Dovecot docs for per user but i don't understand clearly can i replace sieve parameters like sieve = /home/vmail/domains/..................edu.tr/%n/.dovecot.sieve sieve_dir = /home/vmail/domains/.........................edu.tr/%n/.sieve for per user scirpt. thanks in advance. -- Selçuk YAZAR

2 1

[Dovecot] Setting mail location in SQL?
by Marc Perkel 21 May '14

21 May '14

Trying to figure out the syntax to set a mail_location for SQL. This doesn't work: userdb { driver = sql args = /etc/dovecot/master-combined-sql.conf override_fields = mail_location=maildir:/fakedir/%d/%n:INBOX=/fakedir:LAYOUT=fs } Does anyone know the proper syntax? Thanks in advance

2 3

[Dovecot] Dict SQL lookups without username_field
by Andrew Beverley 20 May '14

20 May '14

Dear all, Is it possible to perform dict lookups with a SQL backend, without specifying the username_field in the SQL query? I am using the dict to retrieve a Sieve script. My dict configuration looks like this: map { pattern = priv/sieve/data/$id table = sieve_scripts username_field = email value_field = data fields { id = $id } } I don't want to specify the username though, as the sieve scripts are valid for all users. However, when I remove "username_field" I get the error "data with id `1' for script `main script' not found at path priv/sieve/data/1" Thanks, Andy

1 0

[Dovecot] Performing an action on mail receipt
by Andrew Beverley 20 May '14

20 May '14

Dear all, I would like to perform an action for certain users each time a mail arrives via LMTP. I would like to send an email notification to an external email address when new mail has arrived for certain users (note: not a forward). I am assuming that creating my own plugin using the existing "notify" plugin is the way to go. However, before I go down that route, I'd like to check that is the best approach? Or would it be better to perform this sort of thing before the mail reaches Dovecot? Assuming writing a plugin is answer, do they have to be written in C? Dovecot version: 2.1.7 Thanks, Andy

4 6

[Dovecot] Solr/Tika
by Alex Crow 20 May '14

20 May '14

|Hi list, If I've added the tika stuff to my tomcat/solr setup, ie copied: | ||solr-4.7.2/dist/solr-cell-*| solr-4.7.2/contrib/extraction/lib/* to ||/var/lib/tomcat6/webapps/solr/WEB-INF/lib/ how do I get dovecot to index attachments? Do I just need to add| fts-solr =/index-attachments url=http://localhost:8080/solr-4.7.2/ /to the 90-plugin.conf? Or do I need to so something like fts_tika =/http://localhost:8080/solr-4.7.2// IE the same uri I have for the solr? Thanks Alex

1 0

[Dovecot] Notifications from dovecot
by Joakim Seeberg 20 May '14

20 May '14

Hi list, im trying to build a web based system for secure communication build with standard linux software, instead of using CMS based systems. One of the requirements is to send notifications to users when receiving mail. Can a script find information about the mail address of received mails in dovecot logs or is there a better way. -seeberg

4 4

[Dovecot] Dovecot 2.2.13+ and master user db
by Juan C. Blanco 20 May '14

20 May '14

Hello, I'm upgrading one of our servers to the last HG 2.2.13 versión and I've found some problems with our configuration which has been working fine with previous versions. We have a LDAP userdb for the users and a master userdb for user assistance, Until now the definition of usersdb in 10-auth.conf was: !include auth-master.conf.ext !include auth-system.conf.ext !include auth-ldap.conf.ext With the 2.2.12 version this worked fine but with 2.2.13+ version the LDAP users can't login in dovecot (IMAP), however the master users can login fine. However, if I comment out the master userdb or change the order, i.e. !include auth-system.conf.ext !include auth-ldap.conf.ext !include auth-master.conf.ext In this case LDAP and master users can login normally. Is this configuration change required for the new version or it's a bug? Follows the log sections for both configurations Regards Juan C. Blanco There is the log for the first case (master before ldap) with debugging activated: May 20 08:57:43 master: Info: Dovecot v2.2.13 starting up for imap, pop3, lmtp, sieve (core dumps disabled) May 20 08:57:51 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth May 20 08:57:51 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so May 20 08:57:51 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth May 20 08:57:51 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so May 20 08:57:51 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat May 20 08:57:51 auth: Debug: passwd-file /nas/mail/etc/passwd.master: Read 1 users in 0 secs May 20 08:57:51 auth: Debug: auth client connected (pid=22482) May 20 08:57:56 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=T/5QZs/54gB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=56290 resp=<hidden> May 20 08:57:56 auth: Debug: ldap(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): cache miss May 20 08:57:56 auth: Debug: ldap(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): bind search: base=dc=some,dc=domain,dc=es filter=(uid=user1) May 20 08:57:56 auth: Debug: ldap(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): result: Mailbox=/mail/user1 MailQuotaSize=10240; Mailbox,MailQuotaSize unused May 20 08:57:56 auth: Debug: ldap(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): result: Mailbox=/mail/user1 MailQuotaSize=10240 May 20 08:57:56 auth: Debug: client passdb out: OK 1 user=user1 May 20 08:57:56 auth: Debug: master in: REQUEST 4005167105 22482 1 f14d67dfcbfd5fdffe206fba32ef320b session_pid=22485 request_auth_token May 20 08:57:56 auth: Debug: passwd-file(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): userdb cache miss May 20 08:57:56 auth: Debug: passwd-file(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): lookup: user=user1 file=/nas/mail/etc/passwd.master May 20 08:57:56 auth: Info: passwd-file(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): unknown user May 20 08:57:56 auth: Debug: prefetch(user1,127.0.0.1,<T/5QZs/54gB/AAAB>): success May 20 08:57:56 auth: Debug: master userdb out: USER 4005167105 user1 auth_token=51719362e64e34996d44dfbde00993c989be6580 May 20 08:57:56 imap-login: Info: Login: user=<user1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=22485, secured, session=<T/5QZs/54gB/AAAB> May 20 08:57:56 imap: Debug: Loading modules from directory: /usr/lib64/dovecot May 20 08:57:56 imap: Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so May 20 08:57:56 imap: Debug: Module loaded: /usr/lib64/dovecot/lib02_imap_acl_plugin.so May 20 08:57:56 imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so May 20 08:57:56 imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so May 20 08:57:56 imap: Debug: Added userdb setting: plugin/=yes May 20 08:57:56 imap(user1): Debug: Effective uid=98, gid=12, home= May 20 08:57:56 imap(user1): Debug: Quota root: name=User quota backend=maildir args= May 20 08:57:56 imap(user1): Debug: Quota rule: root=User quota mailbox=* bytes=10485760 messages=0 May 20 08:57:56 imap(user1): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576 (10%) messages=0 May 20 08:57:56 imap(user1): Debug: Quota warning: bytes=9961472 (95%) messages=0 reverse=no command=quota-warning 95 user1 May 20 08:57:56 imap(user1): Debug: Quota warning: bytes=8388608 (80%) messages=0 reverse=no command=quota-warning 80 user1 May 20 08:57:56 imap(user1): Debug: Quota grace: root=User quota bytes=1048576 (10%) May 20 08:57:56 imap(user1): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir May 20 08:57:56 imap(user1): Error: user user1: Initialization failed: Namespace '': Home directory not set for user. Can't expand ~/ for mail root dir in: ~/Maildir May 20 08:57:56 imap(user1): Error: Invalid user settings. Refer to server log for more information. Log for second case (master after LDAP) May 20 09:06:38 master: Info: Dovecot v2.2.13 starting up for imap, pop3, lmtp, sieve (core dumps disabled) May 20 09:06:43 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth May 20 09:06:43 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so May 20 09:06:43 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth May 20 09:06:43 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so May 20 09:06:43 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat May 20 09:06:43 auth: Debug: passwd-file /nas/mail/etc/passwd.master: Read 1 users in 0 secs May 20 09:06:43 auth: Debug: auth client connected (pid=22533) May 20 09:06:50 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=RRYchs/55AB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=56292 resp=<hidden> May 20 09:06:50 auth: Debug: ldap(user1,127.0.0.1,<RRYchs/55AB/AAAB>): cache miss May 20 09:06:50 auth: Debug: ldap(user1,127.0.0.1,<RRYchs/55AB/AAAB>): bind search: base=dc=some,dc=domain,dc=es filter=(uid=user1) May 20 09:06:50 auth: Debug: ldap(user1,127.0.0.1,<RRYchs/55AB/AAAB>): result: Mailbox=/mail/user1 MailQuotaSize=10240; Mailbox,MailQuotaSize unused May 20 09:06:50 auth: Debug: ldap(user1,127.0.0.1,<RRYchs/55AB/AAAB>): result: Mailbox=/mail/user1 MailQuotaSize=10240 May 20 09:06:50 auth: Debug: client passdb out: OK 1 user=user1 May 20 09:06:50 auth: Debug: master in: REQUEST 899284993 22533 1 5497b866fa520f52f65b72b700b3e460 session_pid=22535 request_auth_token May 20 09:06:50 auth: Debug: prefetch(user1,127.0.0.1,<RRYchs/55AB/AAAB>): success May 20 09:06:50 auth: Debug: master userdb out: USER 899284993 user1 home=/mail/user1 quota_rule=*:storage=10240 acl_groups=ccmail auth_token=672454c1a2671c22f334923aa11916aab58ed954 May 20 09:06:50 imap-login: Info: Login: user=<user1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=22535, secured, session=<RRYchs/55AB/AAAB> May 20 09:06:50 imap: Debug: Loading modules from directory: /usr/lib64/dovecot May 20 09:06:50 imap: Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so May 20 09:06:50 imap: Debug: Module loaded: /usr/lib64/dovecot/lib02_imap_acl_plugin.so May 20 09:06:50 imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so May 20 09:06:50 imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so May 20 09:06:50 imap: Debug: Added userdb setting: plugin/acl_groups=ccmail May 20 09:06:50 imap: Debug: Added userdb setting: plugin/quota_rule=*:storage=10240 May 20 09:06:50 imap(user1): Debug: Effective uid=98, gid=12, home=/mail/user1 May 20 09:06:50 imap(user1): Debug: Quota root: name=User quota backend=maildir args= May 20 09:06:50 imap(user1): Debug: Quota rule: root=User quota mailbox=* bytes=10485760 messages=0 May 20 09:06:50 imap(user1): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576 (10%) messages=0 May 20 09:06:50 imap(user1): Debug: Quota warning: bytes=9961472 (95%) messages=0 reverse=no command=quota-warning 95 user1 May 20 09:06:50 imap(user1): Debug: Quota warning: bytes=8388608 (80%) messages=0 reverse=no command=quota-warning 80 user1 May 20 09:06:50 imap(user1): Debug: Quota grace: root=User quota bytes=1048576 (10%) May 20 09:06:50 imap(user1): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir May 20 09:06:50 imap(user1): Debug: maildir++: root=/mail/user1/Maildir, index=, indexpvt=, control=, inbox=/mail/user1/Maildir, alt= May 20 09:06:50 imap(user1): Debug: acl: initializing backend with data: vfile May 20 09:06:50 imap(user1): Debug: acl: acl username = user1 May 20 09:06:50 imap(user1): Debug: acl: owner = 1 May 20 09:06:50 imap(user1): Debug: acl vfile: Global ACLs disabled May 20 09:06:50 imap(user1): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/Maildir:INDEX=~/Maildir/shared/%u May 20 09:06:50 imap(user1): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= May 20 09:06:50 imap(user1): Debug: acl: initializing backend with data: vfile May 20 09:06:50 imap(user1): Debug: acl: acl username = user1 May 20 09:06:50 imap(user1): Debug: acl: owner = 0 May 20 09:06:50 imap(user1): Debug: acl vfile: Global ACLs disabled May 20 09:06:53 imap(user1): Info: Disconnected: Logged out in=8 out=417 -- +----------------------------------------------------------------+ | Juan C. Blanco | | | | Centro de Calculo | | | Facultad de Informatica U.P.M. | E-mail: jcblanco(a)fi.upm.es | | Campus de Montegancedo | | | Boadilla del Monte | Tel.: (+34) 91 336 7466 | | 28660 MADRID (Spain) | Fax : (+34) 91 336 6913 | +----------------------------------------------------------------+

1 0

[Dovecot] / vs. </
by Boris 19 May '14

19 May '14

The default configuration file for Dovecot in Debian uses: ssl_cert = </path/to/cert I checked my current configuration and I use: ssl_cert =/path/to/cert What is the difference? (pipe?) And is the former better somehow?

3 6

[Dovecot] imapc Proxy to IMAPS Exchangeserver?
by Ralf Hildebrandt 19 May '14

19 May '14

I'm trying to adapt http://wiki2.dovecot.org/HowTo/ImapcProxy to our Exchange Server, which has LOGINDISABLED on Port 143, and I offering LOGIN on Port 993. How do I go about this? Simply changing imapc_port to: imapc_port = 993 doesnt work: Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot (Ubuntu) ready. . LOGIN hildeb password . NO [UNAVAILABLE] Temporary authentication failure. [mproxy:2014-05-16 09:33:23] . LOGOUT * BYE Logging out . OK Logout completed. Connection closed by foreign host. Logs: May 16 11:33:04 mproxy dovecot: master: Dovecot v2.2.9 starting up (core dumps disabled) May 16 11:33:21 mproxy dovecot: auth: Error: imapc(exchange-imap.charite.de:143): Command '2 LOGIN "hildeb" "password"' failed with BAD: 2 Command received in Invalid state. May 16 11:33:21 mproxy dovecot: auth: Error: imap(hildeb,::1,<bjeUGoH53AAAAAAAAAAAAAAAAAAAAAAB>): Disconnected from server May 16 11:33:21 mproxy dovecot: auth: Error: imapc(exchange-imap.charite.de:143): Authentication failed: Command received in Invalid state. May 16 11:33:26 mproxy dovecot: imap-login: Aborted login (auth failed, 1 attempts in 8 secs): user=<hildeb>, method=PLAIN, rip=::1, lip=::1, secured, session=<bjeUGoH53AAAAAAAAAAAAAAAAAAAAAAB> But why is it still using port 143? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

3 5

[Dovecot] logging of failed SASL usernames
by Reindl Harald 19 May '14

19 May '14

as far as i understand postfix has no way to know the username of such failed logins like below, IMHO dovecot internally does because it verifies against the sql-userdatabase is there a way that dovecot logs the username? after ask the users to change their passwords for safety caused by Heartbleed it was easy to write a tool find forgotten devices in case of IMAP/POP3 but especially Apple clients force to enter the new password seperated for incoming and outgoing server and don't tell the user if things don't work so there is really a need support them and fuzzy logic based on the last successful IMAP/POP3 login from a IP and failed send attempts from the same IP shortly after receive mail leaves a bad taste of only a guess May 18 11:19:09 mail postfix/smtpd[5173]: warning: unknown[177.139.182.86]: SASL LOGIN authentication failed: UGFzc3dvcmQ6 May 18 11:19:15 mail postfix/smtpd[5173]: warning: unknown[177.139.182.86]: SASL LOGIN authentication failed: UGFzc3dvcmQ6

2 2

[Dovecot] Configuration of dovecot 2.0.19 to authenticate users via LDAP
by Danylo Esterman 19 May '14

19 May '14

I am trying to get dovecot 2.0.19 authenticate users via LDAP (OpenLDAP 2.4.28) and using Wireshark to debug the process. It looks like the basic configuration of dovecot is fine, but it doesn't pull it off to send the right request to the LDAP server. First of all, this is how my LDAP-entries look: # ht dn: dc=ht objectClass: top objectClass: dcObject objectClass: organization o: ip dc: ht # admin, ht dn: cn=admin,dc=ht objectClass: simpleSecurityObject objectClass: organizationalRole cn: admin description: LDAP administrator userPassword:: e1NTSEF9cFY1b0ZZVUhack1aRTVvaUg1T3c2cytVWHV4aUNvaHI= # people, ht dn: ou=people,dc=ht objectClass: organizationalUnit objectClass: top ou: people # groups, ht dn: ou=groups,dc=ht objectClass: organizationalUnit objectClass: top ou: groups # ipusers, groups, ht dn: cn=ipusers,ou=groups,dc=ht gidNumber: 500 cn: ipusers objectClass: posixGroup objectClass: top # Max Mustermann, people, ht dn: cn=Max Mustermann,ou=people,dc=ht cn: Max Mustermann givenName: Max gidNumber: 500 homeDirectory: /home/users/mmustormann sn: Mustermann objectClass: inetOrgPerson objectClass: posixAccount objectClass: top uidNumber: 1000 uid: mmustermann userPassword:: e01ENX1ETUYxdWNEeHRxZ3h3NW5pYVhjbVlRPT0= loginShell: /bin/bash mail: mustorm(a)test.com Now, I use the following configuration for dovecot (/etc/dovecot/dovecot-ldap.conf.ext) hosts = 10.1.2.1 dn = cn=admin,dc=ht dnpass = a auth_bind = yes auth_bind_userdn = uid=%u,ou=people,dc=ht ldap_version = 3 scope = subtree base = ou=people,dc=ht user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(objectClass=posixAccount)(uid=%u)) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=posixAccount)(uid=%u)) This is what I see in Wireshark: http://i.stack.imgur.com/ICzDe.png Dovecot cannot authenticate itself for some reason... If i change the configuration as follows: auth_bind = no #auth_bind_userdn = uid=%u,ou=people,dc=ht Then I get following picture: http://i.stack.imgur.com/tb5vo.png It doesn't pick up the setting base = ou=people,dc=ht. But what is more crucial is that even looking at the whole tree "<ROOT>" wholeSubTree it can't find the required entry. I am really desperate and don't know how to make it work. Can somebody please give me a clue how to solve this problem?

2 1

[Dovecot] Signal 11 with dovecot-lda
by Jim Dishaw 19 May '14

19 May '14

dovecot version: 2.2.13 NetBSD 5.1 on an amd64 architecture Based on the log file, I think this problem first manifested itself when I upgrade from 2.2.9 to 2.2.12. I tried to go back to 2.2.9, but I would have had to rollback some of the other dependencies. I built 2.2.13 and the problem still exists. Mail gets successfully delivered, but the sender get a non-delivery message. I've hacked a temporary workaround to prevent the non-delivery from being sent by having the bounce service run discard instead of bounce. Logfile excerpt: May 18 04:37:07 chaos postfix/smtp[27935]: 39F8B2134F: to=<XXXX(a)YYYY.ZZZ>, relay=127.0.0.1[127.0.0.1]:10024, delay=21, delays=1.9/0.13/0.69/18, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 0538621350) May 18 04:37:07 chaos postfix/qmgr[19537]: 39F8B2134F: removed May 18 04:37:07 chaos dovecot: lda(XXXX(a)YYYY.ZZZ): msgid=<MAILSM200e8021240fd744d9d8094cd0c3e82dfc2@MAILSM200>: saved mail to INBOX May 18 04:37:07 chaos postfix/pipe[12775]: 0538621350: to=<XXXX(a)YYYY.ZZZ>, relay=dovecot, delay=0.54, delays=0.07/0.3/0/0.18, dsn=5.3.0, status=bounced (Command died with signal 11: "/usr/pkg/libexec/dovecot/dovecot-lda") May 18 04:37:07 chaos postfix/cleanup[2233]: 88C0221353: message-id=<20140518043707.88C0221353(a)chaos.dishaw.org> May 18 04:37:07 chaos postfix/bounce[18857]: 0538621350: sender non-delivery notification: 88C0221353 May 18 04:37:07 chaos postfix/qmgr[19537]: 88C0221353: from=<>, size=14448, nrcpt=1 (queue active) May 18 04:37:07 chaos postfix/qmgr[19537]: 0538621350: removed May 18 04:37:08 chaos postfix/smtp[20299]: 88C0221353: to=<AAAA(a)BBBB.CCC>,relay=site.careerbuilder.com[208.82.4.130]:25, delay=0.89, delays=0.03/0.03/0.25/0.58, dsn=2.6.0, status=sent (250 2.6.0 message received) May 18 04:37:08 chaos postfix/qmgr[19537]: 88C0221353: removed Backtrace: #0 0x00007f7ffc907270 in ?? () #1 0x00007f7ffd778498 in lib_signals_deinit () from /usr/pkg/lib/dovecot/libdovecot.so.0 #2 0x00007f7ffd725739 in master_service_deinit () from /usr/pkg/lib/dovecot/libdovecot.so.0 #3 0x0000000000403021 in main ()

1 0

[Dovecot] RFE: please add Return-Path: to sieve sent mail headers
by Maciej Uhlig 18 May '14

18 May '14

May I ask to add Return-Path: some meaningful header line to sieve sent mail headers in vacation message? Now the header line isn't generated at all and the effect is as follows: on receiving MTA: 2014-05-09T15:04:32+02:00 host/ip postfix/qmgr[2408]: 41F2F6024E: from=<>, size=900, nrcpt=1 (queue active) in received mail body: Return-Path: <> Would be nice to get: Return-Path: <user@domain> Copy of From: header line could be sufficient. Thanks. MU

11 28

[Dovecot] antispam plugin doesn't recognize spam folder
by Paul DiSciascio 18 May '14

18 May '14

After a recent upgrade to dovecot 2.2.9 (caused by an ubuntu upgrade to 14.04), the antispam plugin has stopped recognizing my spam folders as spam. I see the plugin initializes properly, but when moving a message, the mailbox_is_spam() function always returns 0. The version of dovecot-antispam that ships with ubuntu is 2.0+20130822-2build1. I also compiled the latest version in the git repository (last update 9/12/2013) and had the same results. This worked fine prior to the upgrade, with dovecot version 2.0.19 and dovecot-antispam version 2.0+20120225-2. Here are the logs from initialization: May 18 07:48:45 lebeau imap: antispam: plugin initialising (2.0-7-gabdad24) May 18 07:48:45 lebeau imap: antispam: verbose debug enabled May 18 07:48:45 lebeau imap: antispam: "SPAM" is exact match spam folder May 18 07:48:45 lebeau imap: antispam: "Spam" is exact match spam folder May 18 07:48:45 lebeau imap: antispam: "Junk" is exact match spam folder May 18 07:48:45 lebeau imap: antispam: no unsure folders May 18 07:48:45 lebeau imap: antispam: "trash" is exact match trash folder May 18 07:48:45 lebeau imap: antispam: "Trash" is exact match trash folder May 18 07:48:45 lebeau imap: antispam: "Deleted Items" is exact match trash folder May 18 07:48:45 lebeau imap: antispam: "Deleted Messages" is exact match trash folder May 18 07:48:45 lebeau imap: antispam: dspam binary set to /usr/bin/dspam May 18 07:48:45 lebeau imap: antispam: dspam extra arg --user May 18 07:48:45 lebeau imap: antispam: dspam extra arg thenut(a)bytemonkey.net May 18 07:48:45 lebeau imap: antispam: signature header line is "X-DSPAM-Signature" And then from the message move: May 18 07:50:06 lebeau imap: antispam: mailbox_is_unsure(SPAM): 0 May 18 07:50:06 lebeau imap: antispam: mailbox_is_trash(INBOX): 0 May 18 07:50:06 lebeau imap: antispam: mailbox_is_trash(SPAM): 0 May 18 07:50:06 lebeau imap: antispam: mail copy: from trash: 0, to trash: 0 May 18 07:50:06 lebeau imap: antispam: mailbox_is_spam(INBOX): 0 May 18 07:50:06 lebeau imap: antispam: mailbox_is_spam(SPAM): 0 May 18 07:50:06 lebeau imap: antispam: mailbox_is_unsure(INBOX): 0 May 18 07:50:06 lebeau imap: antispam: mail copy: src spam: 0, dst spam: 0, src unsure: 0 Clearly mailbox_is_spam(SPAM) should return 1. The other folders I have designated as spam (Junk and Spam) produce the same results. ~Paul

1 0

[Dovecot] Feature Request doveadm acl command
by Thomas Leuxner 18 May '14

18 May '14

I have switched to global ACLs for public namespaces which eases their administration greately. Now while running housekeeping scripts (e.g. expunge old mails/archive mails etc.) this requires temporary overriding the global ACLs with mailbox specifix ACLs to expunge mails. The scripts would then revoke the temporary changes (delete flags) and the global ACL would take precedence again. Ideally I would want to get rid of the 'dovecot-acl' file after the scripts ran so the global ACL kicks in. There seems to be no interface command to purge 'dovecot-acl' files so this is handled by the scripts for now: [...] # Get actual path of dovecot-acl file and remove it as it is handled by global ACL acl_path=$(doveadm acl debug -u $mailbox_owner "$source_mailbox_base/$1" 2>&1 | sed -n "s/$.*$$debug_acl_mailbox_path//p") [ -f $acl_path/dovecot-acl ] && rm $acl_path/dovecot-acl It would be nice if purging a specific dovecot-acl would be handled by doveadm to avoid custom-scripting. Regards Thomas

1 0

[Dovecot] User not found when using shadow for passdb
by John J. Stimson III 17 May '14

17 May '14

I am getting "user unknown" when trying to connect to the dovecot server using IMAP. The client gets an authentication failed message and does not download mail. The host system uses shadow passwords in /etc/shadow. I would like to use the same passwords for IMAP sessions, so I have set the passdb driver to shadow. The system is Slackware, which does not use PAM. Here is the dovecot version and configuration output: # dovecot -n # 2.1.17: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.6.5 i686 Slackware 13.1.0 auth_debug_passwords = yes auth_verbose = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = blocking=no driver = shadow } service auth { unix_listener auth-userdb { user = root } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = blocking=no driver = passwd } Here are the dovecot auth_passwd_debug level log messages when the client tries to connect: May 2 09:05:07 harlie dovecot: auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth May 2 09:05:07 harlie dovecot: auth: Debug: auth client connected (pid=22181) May 2 09:05:07 harlie dovecot: auth: Debug: client in: AUTH^I1^IPLAIN^Iservice=imap^Isecured^Isession=ABCDEFGHIJKLMNOP^Ilip=96.229.223.7^Irip=10.0.0.181^Ilport=993^Irport=51898^Iresp=zxywvutsrqponmlkji== May 2 09:05:07 harlie dovecot: auth: Debug: shadow(john,10.0.0.181,<ABCDEFGHIJKLMNOP>): lookup May 2 09:05:07 harlie dovecot: auth: shadow(john,10.0.0.181,<ABCDEFGHIJKLMNOP>): unknown user May 2 09:05:09 harlie dovecot: auth: Debug: client passdb out: FAIL^I1^Iuser=john May 2 09:05:09 harlie dovecot: imap-login: Disconnected (auth failed, 1 attempts in 2 secs): user=<john>, method=PLAIN, rip=10.0.0.181, lip=96.229.223.7, TLS, session=<ABCDEFGHIJKLMNOP> The user john is a real account on the host machine and has entries in both /etc/passwd and /etc/shadow. Help? -- john(a)idsfa.net John Stimson http://www.idsfa.net/~john/ HMC Physics '94

1 1

[Dovecot] RFE: please add mail queue id to 'sent vacation response' log line
by Maciej Uhlig 17 May '14

17 May '14

May I ask to add receiving smtp server mail queue id to sieve 'sent vacation response' log line? Now: 2014-05-09T15:04:32+02:00 name/ip dovecot: lmtp(8164, user1@domain): YvJFLVbSbFPkHwAASpgOhg: sieve: msgid=<000301cf6b87$36be4570$a43ad050$(a)us.edu.pl> size=46850: sent vacation response to <user2@domain> Asked for something like this: 2014-05-09T15:04:32+02:00 name/ip dovecot: lmtp(8164, user1@domain): YvJFLVbSbFPkHwAASpgOhg: sieve: msgid=<000301cf6b87$36be4570$a43ad050$(a)us.edu.pl> size=46850: sent vacation response to <user2@domain> (smtp:[ip]:port): 250 2.0.0 Ok: queued as mailqueueid) <<< In case there are more than one vacation response recipients there is no way to identify who had received the response and who hadn't. Thanks. MU

5 7

[Dovecot] pigeonhole installation postfix+dovecot+openldap
by Selcuk Yazar 17 May '14

17 May '14

Hi, we have running system postfix+dovecot+openldap. i have installed pigeon hole, and afterlogic webmail php my test system. when i try to connect with telnet [root@....mail postfix]# telnet 0 4190 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "VERSION" "1.0" OK "Dovecot ready." my dovecot configuration lijke this [root@trakyamail ~]# dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-131.6.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.0 (Santiago) ext4 auth_debug = yes auth_debug_passwords = yes auth_default_realm = ..................edu.tr auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.debug disable_plaintext_auth = no first_valid_uid = 97 info_log_path = /var/log/dovecot.info last_valid_uid = 5000 mail_debug = yes mail_gid = 1001 mail_location = mbox:/home/vmail/domains/%d/%u mail_uid = 1001 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mbox_write_locks = fcntl passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = /home/vmail/domains/.......edu.tr/%n/.dovecot.sieve sieve_dir = /home/vmail/domains/................edu.tr/%n/sieve sieve_extensions = +notify +imapflags sieve_user_log = /home/vmail/domains/................... edu.tr/%n/.dovecot.sieve.log } protocols = imap pop3 lmtp sieve service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } also my postfix main.cf mailbox_command = /usr/bin/procmail but my sieve scripts doesnt work, also, how can i enable sieve debug/logging ? thanks in advance -- Selçuk YAZAR

5 5

[Dovecot] dovecot.map.index corrupted: missing map extension
by Francisco Wagner C. Freire 16 May '14

16 May '14

Hello, I have a dovecot setup on top of NFS server, and i get this error on some accounts: Warning: fscking index file ..../cache/storage/dovecot.map.index Warning: mdbox .../mdbox/storage: rebuilding indexes Error: mdbox map.../cache/storage/dovecot.map.index corrupted: missing map extension I tried force-resync, index and cant rebuild the indexes, any idea how to repair then? Thanks Dovecot version: 2.1.17

1 0

[Dovecot] Problems setting up extprograms in combination with crm114
by Patrick Winnertz 16 May '14

16 May '14

Hello, I've troubles to configure sieve correctly to call the mailreaver script in order to parse mails for spam. I've the task to migrate a existing procmail setup to a sieve setup, and to keep the mail filtering step within sieve. I've added in /usr/lib/dovecot/sieve-filters/ a script called "mailreaver", which contains basically only one line - calling the right mailreaver.crm script: exec /usr/share/crm114/mailreaver.crm -u ~/.crm114 This script is then called in the sieve file using "filter "mailreaver". Indeed the script is invoked for every mail, however the signature is appended at the very end of the mail, not at the end of the header. Invoking the /usr/lib/dovecot/sieve-filters/mailreaver manually this way: cat test-email | /usr/lib/dovecot/sieve-filters/mailreaver or this way: /usr/lib/dovecot/sieve-filters/mailreaver < test-email results in both cases in a correct formatted way, so I don't know what is going wrong here. Adding a | tee /tmp/test-output resulted in the complete mail in /tmp/test-output, as I first thought that maybe the headers are not piped into the script - but this seems to be not the case obviously. Does anybody has a clue, as this seems not to be related to crm114 (as it obviously works on cmd), but to the way sieve calls this script. Or it would help to understand how the external filtering program is called - maybe my assumptions are wrong here (or I've simply missunderstood the documentation available online). Greetings Winnie

1 0

[Dovecot] Static Passdb
by Marc Perkel 16 May '14

16 May '14

Tried this but it doesn't work. Says Unknown setting: password passdb { driver = static pass word = secret } The real file doesn't have a space in pass word. What am I doing wrong? Thanks in advance.

2 2

Re: [Dovecot] Pigeonhole and Dovecot deliver
by Selcuk Yazar 16 May '14

16 May '14

Hi, i've read LDA/Postfix Virtual users section , and i added dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/dovecot-lda -f ${sender} -d ${recipient} my master.cf, also I added dovecot_destination_recipient_limit = 1 virtual_transport = dovecot but I didnt find anything mailbox_command for virtual users then i removed it. also when i set sieve and sieve dir for per user i added 20-managesieve and 90-sieve sieve = /home/vmail/domains/........................edu.tr/%n/.dovecot.sieve sieve_dir = /home/vmail/domains/....................edu.tr/%n/.sieve values. unfortunately in maillog just see postfix hold information. thanks in advance. On Fri, May 16, 2014 at 12:12 PM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 16 May 2014, Selcuk Yazar wrote: > > yes i try to change deliver to dovecot. >> > > Please don't top post. > > What about the logs (last sentences in my previous mail)? > > >> On Fri, May 16, 2014 at 11:49 AM, Steffen Kaiser < >> skdovecot(a)smail.inf.fh-brs.de> wrote: >> >>> On Fri, 16 May 2014, Selcuk Yazar wrote: >>> >>> ok first our deliver command procmail. >>> >>>> >>>> >>> you mean that your current MDA is procmail, which you want to replace by >>> Dovecot deliver? >>> >>> in master.cf i added >>> >>>> dovecot unix - n n - - pipe >>>> flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f >>>> ${sender} -a ${recipient} -d ${user}@${nexthop} >>>> >>>> in main.cf >>>> mailbox_command = /usr/libexec/dovecot/dovecot-lda -a "$RECIPIENT" >>>> dovecot_destination_recipient_limit = 1 >>>> virtual_transport = dovecot >>>> virtual_mailbox_domains = ldap:domains >>>> >>>> >>> but mail don't deliver, waitin hold queue >>> >>>> >>>> 77CBB22736! 2667 Fri May 16 11:15:54 selcuk.yazar(a)gmail.com >>>> selcukyazar@................... >>>> edu.tr >>>> >>>> 76228227F9! 3028 Fri May 16 10:19:12 selcuk.yazar(a)gmail.com >>>> selcukyazar@.................. >>>> .. >>>> edu.tr >>>> >>>> any advice or solution >>>> >>>> >>> postfix and/or Dovecot are to log something, post the log lines of >>> Dovecot >>> and postfix. Did you've read http://wiki2.dovecot.org/LDA/Postfix ? >>> >> > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBU3XWe3z1H7kL/d9rAQI/bwf+P4tSirb7b1KpGFuDPJkHwnlKdYp/x1+z > /4Ea5FmuXZDr2qcodOaV0u6Vk416d6T6uNwEsN0bUjVQegxb6LdIemtIsh14TGpN > dAtYToSrlZPK0OTMR0OxjXYRq/1dyM+jGntmDI3gzMPgBNf/paUENAZs4fsn27hs > bqwJDt1T1kmcC5FguNSSGIBJ6YSXpYbu1h63dv7OtBftF46Syi4WSUyjTHuA1NxE > SkpcgYTt+sPKLty8vg1wfvn2EVgETctd+GpfDnEbrxFje/PKmnRp13dr93rJzLMB > 8xWJ2+dtFmSjRnF0gYCHmku1zS5+vsl1Jmeap3EchS1ZSOlVKYfcXA== > =r4AG > -----END PGP SIGNATURE----- > -- Selçuk YAZAR http://www.selcukyazar.blogspot.com

1 0

Re: [Dovecot] Pigeonhole and Dovecot deliver
by Selcuk Yazar 16 May '14

16 May '14

Hi, stefan, yes i try to change deliver to dovecot. thanks. On Fri, May 16, 2014 at 11:49 AM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > On Fri, 16 May 2014, Selcuk Yazar wrote: > > ok first our deliver command procmail. >> > > you mean that your current MDA is procmail, which you want to replace by > Dovecot deliver? > > > in master.cf i added >> dovecot unix - n n - - pipe >> flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f >> ${sender} -a ${recipient} -d ${user}@${nexthop} >> >> in main.cf >> mailbox_command = /usr/libexec/dovecot/dovecot-lda -a "$RECIPIENT" >> dovecot_destination_recipient_limit = 1 >> virtual_transport = dovecot >> virtual_mailbox_domains = ldap:domains >> > > but mail don't deliver, waitin hold queue >> >> 77CBB22736! 2667 Fri May 16 11:15:54 selcuk.yazar(a)gmail.com >> selcukyazar@................... >> edu.tr >> >> 76228227F9! 3028 Fri May 16 10:19:12 selcuk.yazar(a)gmail.com >> selcukyazar@.................... >> edu.tr >> >> any advice or solution >> > > postfix and/or Dovecot are to log something, post the log lines of Dovecot > and postfix. Did you've read http://wiki2.dovecot.org/LDA/Postfix ? > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBU3XRNXz1H7kL/d9rAQKuUwgAk1bBYiPAgH+dXe70KXSnYZoSCkgQdI73 > AjUCj7zCs3L5BF09QGD7oamjvzSAltEvFBvN2HTsh4k7+9tiDz1//5QfPtgc9yVy > ditUUf2Tppa+ls3cZKxJ5IehKJxlSrTIDssqThR3Q4Wp5b1o1y/cEZXGT2mq93ge > Rhjnm5fo2LdysqtDMtY4Wbt4UeoZr/ICi73yxzvB6OrT6OqY3pvpWrU4LlVTRnES > 5GyQkAQjN65BxggEAYKbGiY/5scuNu03YkQBAzBMeDnqtXL3ApjwK4P+c/OyTW/r > 9udykdk93s6zMtV1bbNJ8qEgTcGxaCwxcvNzfwvXkwX86Fue02WX6g== > =wiMy > -----END PGP SIGNATURE----- > -- Selçuk YAZAR http://www.selcukyazar.blogspot.com

2 1

[Dovecot] Pigeonhole and Dovecot deliver
by Selcuk Yazar 16 May '14

16 May '14

Hi, i still try to sieve system. ok first our deliver command procmail. our user accounts stored in openldap, mail files are in Maildir folders in 15-lda.conf recommented protocol lda { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve log_path = info_log_path = } after that, in master.cf i added dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f ${sender} -a ${recipient} -d ${user}@${nexthop} in main.cf mailbox_command = /usr/libexec/dovecot/dovecot-lda -a "$RECIPIENT" dovecot_destination_recipient_limit = 1 virtual_transport = dovecot virtual_mailbox_domains = ldap:domains İN 90-sieve.conf sieve = /home/vmail/domains/..................edu.tr/%n/.dovecot.sieve sieve_dir = /home/vmail/domains/.........................edu.tr/%n/.sieve and also i successfuly add my filters, shown in attachment. but mail don't deliver, waitin hold queue 77CBB22736! 2667 Fri May 16 11:15:54 selcuk.yazar(a)gmail.com selcukyazar@................... edu.tr 76228227F9! 3028 Fri May 16 10:19:12 selcuk.yazar(a)gmail.com selcukyazar@.................... edu.tr any advice or solution thanks in advance -- Selçuk YAZAR http://www.selcukyazar.blogspot.com

2 1

[Dovecot] syncing problems Dovecot 2.2.13
by Götz Reinicke - IT Koordinator 16 May '14

16 May '14

Hi, we still migrate a couple of users from mbox to maildir. Most of them are fine without any problem. Some crash and dont get all mails synced. first I sync backup the mbox to a maildir-NEW, than copy mbox to a new name, mv maildir-NEW to maildir. Now some problematic mailusers miss some mails from the old mbox, so I start a dsync mirror and BAM crash. e.g.: dsync(s108019): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) dsync(s108019): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x333fe67f2a] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x35) [0x333fe68025] -> /usr/lib64/dovecot/libdovecot.so.0 [0x333fe67073] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mbox_lock+0x11c) [0x334025826c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mbox_save_begin+0x98d) [0x334025a5ad] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2b5b619183c2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x51) [0x334027b3f1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x66) [0x3340275716] -> /usr/lib64/dovecot/lib15_notify_plugin.so [0x2b5b61b1f215] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2b5b6191852d] -> /usr/lib64/dovecot/lib01_acl_plugin.so [0x2b5b61707b37] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_copy+0x72) [0x334027b282] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_move+0x1d) [0x334027b36d] -> dsyn [0x42f7a5] -> dsyn [0x43351a] -> dsyn(dsync_mailbox_import_changes_finish+0x165) [0x4339b5] -> dsyn(dsync_brain_sync_mails+0x58c) [0x42ed6c] -> dsyn(dsync_brain_run+0x594) [0x42af94] -> dsyn [0x429550] -> dsyn [0x411eef] -> dsyn(doveadm_mail_try_run+0x25c) [0x41231c] -> dsyn(main+0x32e) [0x41a92e] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x3d3161d9c4] -> dsyn [0x411699] ANY help and suggestion is very welcome on how to procede. Regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

1 0

[Dovecot] Disconnected from database, retrying commit?
by Ralf Hildebrandt 15 May '14

15 May '14

In my log I have a lot of log entries like this one (covering one hour of logs here): May 15 09:00:49 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:17:10 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:22:30 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:31:07 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:37:15 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:39:36 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:50:49 dict: Info: maildatabase: Disconnected from database, retrying commit 7 times per hour, that's quite a bit. Dovecot 2.1.17 Related logs look like: ======================= May 15 00:16:44 imap(username): Info: save: box=Sent, uid=1196, msgid=<5373EB4A.90306(a)sys4.de>, size=11152 May 15 00:16:44 dict: Info: maildatabase: Disconnected from database, retrying commit or: May 14 16:10:34 lmtp(7225, username@domain): Info: NTuhEvF1c1M5HAAAcnFQ7Q: msgid=<20090714161800.121200(a)gmx.net>: saved mail to INBOX May 14 16:10:34 dict: Info: maildatabase: Disconnected from database, retrying commit May 14 16:10:34 dict: Info: mysql(sql.sys4.de): Connected to database maildatabase So it's reconnecting, but why is it disconnecting/being disconnected in the first place? Does it matter? should I worry? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

[Dovecot] v2.2.13 released
by Timo Sirainen 15 May '14

15 May '14

http://dovecot.org/releases/2.2/dovecot-2.2.13.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.13.tar.gz.sig A few minor changes since v2.2.13.rc1, mainly making the Pigeonhole tests pass. * Fixed a DoS attack against imap/pop3-login processes. If SSL/TLS handshake was started but wasn't finished, the login process attempted to eventually forcibly disconnect the client, but failed to do it correctly. This could have left the connections hanging arond for a long time. (Affected Dovecot v1.1+) + mdbox: Added mdbox_purge_preserve_alt setting to keep the file within alt storage during purge. (Should become enforced in v2.3.0?) + fts: Added support for parsing attachments via Apache Tika. Enable with: plugin { fts_tika = http://tikahost:9998/tika/ } + virtual plugin: Delay opening backend mailboxes until it's necessary. This requires mailbox_list_index=yes to work. (Currently IMAP IDLE command still causes all backend mailboxes to be opened.) + mail_never_cache_fields=* means now to disable all caching. This may be a useful optimization as doveadm/dsync parameter for some admin tasks which shouldn't really update the cache file. + IMAP: Return SPECIAL-USE flags always for LSUB command. - pop3 server was still crashing in v2.2.12 with some settings - maildir: Various fixes and improvements to handling compressed mails, especially when they have broken/missing S=sizes in filenames. - fts-lucene, fts-solr: Fixed crash on search when the index contained duplicate entries. - Many fixes and performance improvements to dsync and replication - director was somewhat broken when there were exactly two directors in the ring. It caused errors about "weak users" getting stuck. - mail_attachment_dir: Attachments with the last base64-encoded line longer than the rest wasn't handled correctly. - IMAP: SEARCH/SORT PARTIAL was handled completely wrong in v2.2.11+ - acl: Global ACL file handling was broken when multiple entries matched the mailbox name. (Only the first entry was used.)

8 14

[Dovecot] v2.2.13.rc1 released
by Timo Sirainen 15 May '14

15 May '14

http://dovecot.org/releases/2.2/rc/dovecot-2.2.13.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.13.rc1.tar.gz.sig There have been a ton of smaller and some larger changes since v2.2.12, so I thought I'd first make a RC release and the final v2.2.13 tomorrow. Please try it out! BTW. I've read most of the mails again in Dovecot mailing list, but there are still a few reported bugs I decided to leave until later. Anyway feel free to re-send any bug reports for things that haven't been fixed in v2.2.13 yet. * Fixed a DoS attack against imap/pop3-login processes. If SSL/TLS handshake was started but wasn't finished, the login process attempted to eventually forcibly disconnect the client, but failed to do it correctly. This could have left the connections hanging arond for a long time. (Affected Dovecot v1.1+) + mdbox: Added mdbox_purge_preserve_alt setting to keep the file within alt storage during purge. (Should become enforced in v2.3.0?) + fts: Added support for parsing attachments via Apache Tika. Enable with: plugin { fts_tika = http://tikahost:9998/tika/ } + virtual plugin: Delay opening backend mailboxes until it's necessary. This requires mailbox_list_index=yes to work. (Currently IMAP IDLE command still causes all backend mailboxes to be opened.) + mail_never_cache_fields=* means now to disable all caching. This may be a useful optimization as doveadm/dsync parameter for some admin tasks which shouldn't really update the cache file. + IMAP: Return SPECIAL-USE flags always for LSUB command. - pop3 server was still crashing in v2.2.12 with some settings - maildir: Various fixes and improvements to handling compressed mails, especially when they have broken/missing S=sizes in filenames. - fts-lucene, fts-solr: Fixed crash on search when the index contained duplicate entries. - Many fixes and performance improvements to dsync and replication - director was somewhat broken when there were exactly two directors in the ring. It caused errors about "weak users" getting stuck. - mail_attachment_dir: Attachments with the last base64-encoded line longer than the rest wasn't handled correctly. - IMAP: SEARCH/SORT PARTIAL was handled completely wrong in v2.2.11+ - acl: Global ACL file handling was broken when multiple entries matched the mailbox name. (Only the first entry was used.)

4 8

[Dovecot] 2.2.12 RPM Needed
by Asai 15 May '14

15 May '14

Greetings, I'm not very experienced in building Source RPMs and we're in need of a Dovecot RPM for version 2.2.12 for CentOS 5. It seems that the ATRPMs repo maintained by Axel Thimm hasn't seen much activity lately and the task of updating a source RPM is more than I have time for as a busy developer who does systems admin on the side. Could anybody recommend another repo where there would be the latest Dovecot binaries? Or perhaps tell me of any gotchas and catches which might arise if I go ahead and build 2.2.12 from source over the RPM I currently have installed (2.2.10)? Thanks. -- --Asai

4 6

[Dovecot] LMTP SSL?
by Ralf Hildebrandt 15 May '14

15 May '14

Can I enable STARTTLS/SSL on the LMTP listener in Dovecot 2.1.x? service lmtp { unix_listener lmtp { } inet_listener lmtp { address = * port = 24 --> ssl=yes } } -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

4 4

[Dovecot] Enterprise repository for free now? ;-) (Bug?)
by Daniel Thielemann 14 May '14

14 May '14

Hi, I bought repo access for 0,00$ one minute ago. If its free now then I wanna say thank you very much, otherwise somebody should fix it :) Take a look here: http://shop.dovecot.fi/home/8-dovecot-ee-repository-access.html Screen: http://www.directupload.net/file/d/3622/oxyo89zm_png.htm Regards

3 3

[Dovecot] Pigeonhole Sieve: Vacation Extension answer to every E-Mail
by Götz Reinicke - IT Koordinator 14 May '14

14 May '14

Hi, dont ask :) but I have two accounts for which I have to configure an auto reply for any e-mail send to it. As far as I understand Sieve yet, I do have to set sieve_vacation_min_period = 0 in the dovecot config and set the days value in the sieve rule. But as there is a limit of 1 day, I think this is not working. Right? Is there any other way to accomplish that? regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 4

[Dovecot] Broken IMAPS Connects Create Lingering imap-login Processes
by Jochen Bern 14 May '14

14 May '14

Hello everyone, we are running a central server (CentOS 6.5, dovecot-2.0.9-7.el6 with a small patch to disable the IMAP CREATE command, and openssl-1.0.1e-16.el6_5.7) and distribute standard client software to customer( site)s. The clients do IMAPS connects in regular intervals (no IDLE, no lingering logins) and authenticate with certs issued by a dedicated PKI ("auth_ssl_username_from_cert = yes" and a static global password). One of the customers has a major networking problem that hasn't been fully analyzed yet. Sniffing his IMAPS connects on the server side, I see no (necessarily fragmented) TLSv1 Client Cert + Key Exchange happen; instead, after ~60s, we receive a single packet with "TLSv1 Certificate Verify, Change Cipher Spec, Encrypted Handshake Message" *and* the TCP FIN+PSH+ACK flags set. The problem I'ld like to ask for help with here is that dovecot's imap-login process doesn't terminate when the FIN is received, or when the IMAP protocol's inactivity timeout is reached, it takes *more than two hours* for it to go away. Because of that, this single client racks up 1100+ processes (counting against dovecot's configured limits), TCP connections, and the associated RAM usage. (Since the client cert is obviously never received, the default mail_max_userip_connections of 10 doesn't come into play, either.) Is there any way - short of hexing a negative feedback loop straight into the iptables - to prevent this kind of buildup? Kind regards, J. Bern > [root ~]# date ; ps auwwwx --forest | grep -A 12 '/dove[c]ot' > Mo 5. Mai 21:45:39 CEST 2014 > root 25297 0.8 0.0 19568 824 ? Ss Apr30 64:44 /usr/sbin/dovecot > dovecot 25299 0.1 0.1 17996 5828 ? S Apr30 11:52 \_ dovecot/anvil [1147 connections] > root 25300 0.1 0.0 13388 1220 ? S Apr30 8:07 \_ dovecot/log > root 25301 0.0 0.0 39596 1564 ? S Apr30 2:21 \_ dovecot/ssl-params > dovecot 25304 0.3 0.0 78384 3552 ? S Apr30 22:13 \_ dovecot/auth [0 wait, 0 passdb, 0 userdb] > root 13161 0.3 0.3 25236 13352 ? S May04 7:11 \_ dovecot/config > root 18384 0.2 0.2 20080 8200 ? S 08:20 1:37 \_ dovecot/config [... long-running IMAP login by the operators ...] > dovenull 12064 0.0 0.0 42440 3656 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > dovenull 12441 0.0 0.0 42440 3656 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > dovenull 12495 0.0 0.0 42440 3656 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > dovenull 12496 0.0 0.0 42440 3652 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > [root ~]# doveconf -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.3.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) > auth_ssl_require_client_cert = yes > auth_ssl_username_from_cert = yes > listen = [...] > login_greeting = [...] > mail_location = maildir:~ > mail_log_prefix = "%s(%u)[%p]: " > mbox_write_locks = fcntl > passdb { > args = password=[...] > driver = static > } > plugin { > mail_log_events = delete undelete expunge > mail_log_fields = uid msgid size vsize flags > } > protocols = imap > service anvil { > client_limit = 3605 > } > service auth { > client_limit = 7000 > } > service imap-login { > process_limit = 3500 > } > service imap { > process_limit = 3500 > } > ssl = required > ssl_ca = </etc/pki/dovecot/certs/[...].pem > ssl_cert = </etc/pki/dovecot/certs/[...].pem > ssl_key = </etc/pki/dovecot/private/[...].pem > ssl_verify_client_cert = yes > userdb { > args = uid=mandanten gid=mandanten home=/[...]/%Ld_[...]/%Ln > driver = static > } > verbose_proctitle = yes > protocol imap { > mail_plugins = " mail_log notify" > } -- *NEU* - NEC IT-Infrastruktur-Produkte im <http://www.linworks-shop.de/>: Server--Storage--Virtualisierung--Management SW--Passion for Performance Jochen Bern, Systemingenieur --- LINworks GmbH <http://www.LINworks.de/> Postfach 100121, 64201 Darmstadt | Robert-Koch-Str. 9, 64331 Weiterstadt PGP (1024D/4096g) FP = D18B 41B1 16C0 11BA 7F8C DCF7 E1D5 FAF4 444E 1C27 Tel. +49 6151 9067-231, Zentr. -0, Fax -299 - Amtsg. Darmstadt HRB 85202 Unternehmenssitz Weiterstadt, Geschäftsführer Metin Dogan, Oliver Michel

3 5

[Dovecot] imapc problem
by FUSTE Emmanuel 14 May '14

14 May '14

hello, I have some trouble when trying to migrate from another imap server to dovecot with imapc/dsync/doveadm. when running "doveadm -o imapc_user=foo -o imapc_password=bar backup -R -u localuser imapc:" all is ok. But when running "doveadm -o imapc_user=foo -o imapc_password=bar sync -R -u localuser imapc:", all local mods are overwritten. For example deleting a message or moving it to trash and it reappear in INBOX (and disappear from trash if moved there). If I try without the reverse flag "-R", local delete reappear two times after two or more sync. If I try without the reverse flag "-R", a message moved to trash is propagated to trash too, but reappear as many times as you "sync" on the two sides in the INBOX. With other users, first "backup -R" is ok but on next sync or backup try, I get : dsync(other_user): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. Other IMAP server is CriticalPath 8.5.137. Any clue ?? Emmanuel. Dovecot conf : 2.2.12.12 (03196f188677+): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS auth_master_user_separator = * auth_username_format = %u disable_plaintext_auth = no doveadm_password = **************** imapc_features = rfc822.size fetch-headers imapc_host = my_old_imap_server imapc_user = %u lda_mailbox_autocreate = yes listen = * mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = quota notify replication mail_prefetch_count = 20 mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-master-ldap.conf.ext driver = ldap master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_anyone = allow acl_shared_dict =file:/appli/vmail/shared-mailboxes quota = dict:userquota::file:/appli/vmail/local_userquota/%u/dovecot-quota quota_rule = *:storage=100M quota_rule2 = INBOX:storage=+20%% quota_rule3 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener auth-userdb { group = vmail mode = 0660 } } service doveadm { inet_listener { port = 12345 } user = vmail } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = no userdb { args = /etc/dovecot/dovecot-users-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota }

1 1

[Dovecot] Error open(/var/lib/dovecot/db/shared-mailboxes) after update 2.2.10 -> 2.2.13
by Götz Reinicke - IT Koordinator 14 May '14

14 May '14

Hi, I did an update from dovecot 2.2.10 -> 2.2.13 and now I'm getting errors: May 14 10:40:00 imap(hansdampf): Error: open(/var/lib/dovecot/db/shared-mailboxes) failed: Permission denied Currently the permissions on shared-mailboxes rw-rw-rw but teh error still exists. Any hints? Thansk and Regards. Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 4

[Dovecot] Dovecot repo for CentOS
by Eric Kom 14 May '14

14 May '14

Hi all, Please am looking for a repo for dovecot on CentOS where I can installed the latest never. Thanks

3 2

[Dovecot] Dovecot 2.2.13 core dumped with shared folder/acl
by Alessio Cecchi 14 May '14

14 May '14

Hi, after the upgrade to dovecot 2.2.13 (on Deb 6) for users that have enabled shared folder I found "core dumped" error in the log: imap(webmaster(a)pippo.com): Fatal: master: service(imap): child 26828 killed with signal 11 (core dumped) [...] imap[26828]: segfault at 160 ip 00007f76a18bca32 sp 00007fff5ecc13b0 error 4 in lib01_acl_plugin.so[7f76a18af000+13000] These error happens "random", when users configure subscription for shared folders or browse shared folders. Here "bt full": #0 0x00007f76a18bca32 in acl_mailbox_get_aclobj (box=<value optimized out>) at acl-mailbox.c:29 No locals. #1 0x00007f76a16ad1e3 in cmd_myrights (cmd=0x1211cd0) at imap-acl-plugin.c:331 ns = <value optimized out> box = 0x12051f0 mailbox = 0x11732a8 "shared" orig_mailbox = 0x1214690 "shared" rights = <value optimized out> str = <value optimized out> #2 0x000000000041813d in command_exec (cmd=0x1211cd0) at imap-commands.c:158 hook = 0x117c0e0 ret = <value optimized out> #3 0x0000000000417240 in client_command_input (cmd=0x1211cd0) at imap-client.c:778 client = 0x12110d0 command = <value optimized out> __FUNCTION__ = "client_command_input" #4 0x000000000041732d in client_command_input (cmd=0x1211cd0) at imap-client.c:839 client = 0x12110d0 command = 0x0 __FUNCTION__ = "client_command_input" #5 0x00000000004175ad in client_handle_next_command (client=0x12110d0) at imap-client.c:877 No locals. #6 client_handle_input (client=0x12110d0) at imap-client.c:889 _data_stack_cur_id = 3 ret = 96 remove_io = <value optimized out> handled_commands = false __FUNCTION__ = "client_handle_input" #7 0x000000000041792f in client_input (client=0x12110d0) at imap-client.c:931 cmd = <value optimized out> output = 0x1211b10 bytes = <value optimized out> __FUNCTION__ = "client_input" #8 0x00007f76a24c98ce in io_loop_call_io (io=0x1211be0) at ioloop.c:441 ioloop = 0x117b730 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f76a24caa4f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x117c3c0 event = 0x117d230 list = 0x1197a60 io = 0x10 ---Type <return> to continue, or q <return> to quit--- tv = {tv_sec = 59, tv_usec = 999046} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f76a24c9959 in io_loop_handler_run (ioloop=0x10) at ioloop.c:488 No locals. #11 0x00007f76a24c99e8 in io_loop_run (ioloop=0x117b730) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #12 0x00007f76a2476ef3 in master_service_run (service=0x117b5c0, callback=0x28) at master-service.c:566 No locals. #13 0x0000000000420eb7 in main (argc=1, argv=0x117b390) at main.c:400 set_roots = {0x428e20, 0x0} login_set = {auth_socket_path = 0x1173050 "\210\060\027\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x4210b0 <login_client_connected>, failure_callback = 0x421050 <login_client_failed>, request_auth_token = 1} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> Here is my configuration: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.9 auth_cache_negative_ttl = 10 mins auth_cache_size = 8 M auth_cache_ttl = 20 mins deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = in=%i out=%o session=<%{session}> last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt deny = yes driver = passwd-file } passdb { args = cache_key=%s%u webmail=192.168.3.15 driver = vpopmail } plugin { acl = vfile acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_grace = 10M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o, session=<%{session}> protocols = imap pop3 sieve service auth { client_limit = 5500 unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { process_limit = 500 unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap { process_limit = 4000 service_count = 100 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service pop3 { process_limit = 1023 service_count = 100 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </etc/dovecot/ssl/wildcard.pem ssl_key = </etc/dovecot/ssl/wildcard.key submission_host = localhost userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { mail_location = maildir:~/Maildir:INDEX=MEMORY mail_plugins = quota acl expire sieve } protocol imap { mail_max_userip_connections = 15 mail_plugins = quota acl expire imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 2 } protocol pop3 { mail_max_userip_connections = 5 }

1 0

[Dovecot] dovecot shared folder
by Mihai Badici 13 May '14

13 May '14

I try to create a shared directory in dovecot. When accessing ( from roundcube) i can't subscribe or list the namespace. It looks like I don't have rights. This is an extract from debug log: When I try to create a new folder in "Public" (i don't have rights, but i can try) loooks like the process crash: May 12 23:10:07 imap: Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so May 12 23:10:07 imap: Debug: Module loaded: /usr/lib/dovecot/lib02_imap_acl_plugin.so May 12 23:10:07 imap: Debug: Added userdb setting: plugin/ mail=Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: Effective uid=10000, gid=10000, home=/home/dovecot/private/Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/MAILDIR May 12 23:10:07 imap(Mihai.Badici): Debug: maildir++: root=/home/dovecot/private/Mihai.Badici/MAILDIR, index=, indexpvt=, control=, inbox=/home/dovecot/private/Mihai.Badici/MAILDIR, alt= May 12 23:10:07 imap(Mihai.Badici): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl: acl username = Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: acl: owner = 1 May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: Namespace : type=shared, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/dovecot/public May 12 23:10:07 imap(Mihai.Badici): Debug: maildir++: root=/home/dovecot/public, index=, indexpvt=, control=, inbox=, alt= May 12 23:10:07 imap(Mihai.Badici): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl: acl username = Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: acl: owner = 0 May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: file /etc/dovecot/dovecot- acl//.DEFAULT not found May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: file /etc/dovecot/dovecot- acl//.DEFAULT not found May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: reading file /home/dovecot/public/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Fatal: master: service(imap): child 5013 killed with signal 11 (core dumps disabled) doveconf -n 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-smp i686 Slackware 14.1 auth_debug = yes default_login_user = dovecot disable_plaintext_auth = no imap_metadata = yes log_path = /var/log/dovecot mail_attribute_dict = file:~/shared_metadata mail_debug = yes mail_gid = 10000 mail_location = maildir:~/MAILDIR mail_plugins = acl mail_uid = 10000 namespace { location = maildir:/home/dovecot/public prefix = Public/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/dovecot-acl acl_anyone = allow acl_shared_dict = file:/home/dovecot/shared-mailboxes.db } postmaster_address = root(a)mail.olm.ro protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postdrop mode = 0666 user = postfix } unix_listener auth-userdb { group = mailbox mode = 0666 user = mailbox } user = dovecot } service dict { unix_listener dict { group = mailbox mode = 0600 user = mailbox } } service lmtp { unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix mode = 0600 user = postfix } } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } imap_metadata = yes protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_plugins = acl acl imap_acl } -- Mihai Bădici http://mihai.badici.ro

2 1

[Dovecot] Quota dict with redis
by Davide 13 May '14

13 May '14

I have installed redis backend for quota and my dovecot.conf is as follow: quota = dict:User quota:ignoreunlimited:redis:host=127.0.0.1:prefix=%u/ but for all of my users doveadm quota get return always same quota (of the last user) Someone could help me in the right direction? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

1 0

[Dovecot] Dovecot Special_Use and K9 (and other Clients)
by sumsumag＠gmx.de 13 May '14

13 May '14

4 4

[Dovecot] İnstall dovecot-piegonhone
by Selcuk Yazar 13 May '14

13 May '14

Hi, We have Postfix-Dovecot MTA at Redhat EL 5 system. Also we are using this system activelly. Now i wantto install pigeonhole managesive server on this sys. Do i have any risk or anything ? thanks in advance -- Selçuk YAZAR

2 2

[Dovecot] Error on doveadm director map
by mtrainer＠cloud-free.com 13 May '14

13 May '14

Hi All, I am running Dovecot 1:2.2.9-1~bpo70+1 on Debian Wheezy. I have just started getting the error below when I do a do a list of proxied users. The list of users appears OK afterwards. # doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time . . . My director config is below. Thanks Murray # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 auth_cache_size = 32 M auth_cache_ttl = 2 hours auth_debug = yes auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" auth_username_translation = +@ auth_verbose = yes base_dir = /var/run/dovecot/ director_mail_servers = 27.54.95.41 27.54.95.42 27.54.95.43 27.54.95.44 27.54.95.45 27.54.95.46 director_servers = 27.54.95.37 27.54.95.38 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes mail_debug = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = nopassword=y proxy=y driver = static } protocols = " imap lmtp pop3" service auth-worker { user = dovecot } service auth { client_limit = 4096 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 27.54.95.37 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { chroot = login executable = imap-login director inet_listener imap { address = *, [::] port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service imap { process_limit = 4096 vsz_limit = 256 M } service ipc { unix_listener ipc { mode = 0666 user = dovecot } } service lmtp { inet_listener lmtp { address = 27.54.95.37 port = 24 } process_limit = 2048 process_min_avail = 32 } service pop3-login { chroot = login executable = pop3-login director inet_listener pop3 { address = *, [::] port = 110 } inet_listener pop3s { address = *, [::] port = 995 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 4096 vsz_limit = 256 M } ssl_cert =

1 0

[Dovecot] dsync - Panic: file mail-index-transaction-update.c: line 19
by Götz Reinicke - IT Koordinator 12 May '14

12 May '14

Hi, we have started to switch our users mails from mbox to maildir and see for some users panics. May be someone has a hint on whats causing that and how to fix it? It's dovecot 2.2.10 on Redhat. dsync(s109487): Error: Corrupted index cache file /srv/vmail/s109487/mail/.imap/GS Drehbuch 1/dovecot.index.cache: Broken physical size for mail UID 42 dsync(s109487): Error: mail parser: read(/srv/vmail/s109487/mail/GS Drehbuch 1, box=GS Drehbuch 1) failed: Invalid argument dsync(s109487): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(s109487): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x332ea6722a] -> /usr/lib64/dovecot/ Thanks and regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

1 0

[Dovecot] Released Pigeonhole v0.4.3 for Dovecot v2.2.13.
by Stephan Bosch 12 May '14

12 May '14

Hello Dovecot users, Now that Dovecot v2.2.13 is released, I can release a new Pigeonhole. Due to changes in Dovecot, this Pigeonhole release will not compile cleanly against older Dovecot releases. This release is mainly about bugfixes. One notable addition is that I have updated the "vnd.dovecot.duplicate" extension to the new IETF draft "duplicate" extension. Changelog v0.4.3: * Editheader extension: Made control characters allowed for editheader, except NUL. Before, this would cause a runtime error. + Upgraded Dovecot-specific Sieve "vnd.dovecot.duplicate" extension to match the new draft "duplicate" extension. - Fixed sieve_result_global_log_error to log only as i_info in administrator log (syslog) if executed from multiscript context. - Sieve redirect extension: Adjusted loop detection to show leniency to resent messages. - Sieve include extension: Fixed problem with handling of duplicate includes with different parameters :once or :optional. - Sieve spamtest/virustest extensions: Tests were erroneously performed against the original message. When used together with extprograms filter to add the spam headers, the changes were not being used by the spamtest and virustest extensions. - Deprecated Sieve notify extension: Fixed segfault problems in message string substitution. - ManageSieve: Fixed active link verification to handle redundant path slashes correctly. - Sieve vacation extension: - Fixed interaction of sieve_vacation_dont_check_recipient with sieve_vacation_send_from_recipient setting. - Fixed log message for discarded response. - Sieve extprograms plugin: - Forgot to disable the alarm() timeouts set for script execution. - Fixed fd leak and handling of output shutdown. - Fixed 'Bad filedescriptor' error occurring when disconnecting script client. - Made sure that programs are never forked with root privileges. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.3.tar… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.3.tar… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] 2.2.12: Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0)
by Leho Kraav 12 May '14

12 May '14

I upgraded 2.1 -> 2.2 something like a week ago because I needed INDEXPVT. Not sure if this crash started immediately or not, noticed it today looking at journalctl. Backtrace http://bpaste.net/raw/181944/ and pasted below. This seems to crash on every IMAP connection made, so any ideas for a possible client-level workaround are quite welcome until dovecot code improves here. root@server ~ $ dovecot -n # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.4.54-vs2.3.3.5+pf64 x86_64 Gentoo Base System release 2.2 ext4 hostname = *hidden* listen = 192.168.1.2 log_path = /dev/stderr log_timestamp = mail_gid = mail mail_home = /secure/Maildir/%n mail_location = Maildir:/secure/Maildir/%n mail_plugins = acl mail_privileged_group = mail mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/secure/Maildir/%%n:INDEXPVT=/secure/Maildir/%n/shared/%%n prefix = Shared.%%n. separator = . subscriptions = no type = shared } namespace { location = maildir:/secure/Maildir/projekt:INDEX=/secure/Maildir/%n/projekt prefix = Projekt. separator = . subscriptions = no type = public } namespace { location = maildir:/secure/Maildir/rss:INDEX=/secure/Maildir/%n/rss prefix = RSS. separator = . subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/secure/Maildir/shared-mailboxes.db mail_log_events = mailbox_delete sieve = /secure/Maildir/%n/dovecot-sieve sieve_dir = /secure/Maildir/%n/sieve sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = postmaster protocols = imap lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = mail } user = mail } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/server.crt ssl_key = </etc/ssl/server.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = acl sieve acl } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

3 2

[Dovecot] IMAP disconnect before greeting / banner
by Benoit Panizzon 12 May '14

12 May '14

Hello We have a server on which we run multiple instances of dovecot. Each instance serving a domain and binding to a specific IP. The whole thing on three servers using the proxy ability and replication of dovecot. Now one domain has more users and we start seeing very strange behaviour. As soon as about 45 users have connected to the imap service ip of that instance, the server accepts the connections and then disconnects without showing the IMAP banner. This happens on all of our three servers and only for that specific domain (which has most connections). While this occurs, there is no problem with the other instances for other domains on the same physical machine. So the database backend etc. are not the issue. While this occurs, there is no hint of what goes wrong in the logfiles. I did even set mail_debug=yes but that still does not produce any output of why clients get disconnected prior to the server displaying the banner. Any hints on where I could start looking for the error, or get more debug output as with mail_debug=yes ? -Benoit-

1 0

[Dovecot] ManageSieve OOM with Huge Folders
by Fabian Peter 12 May '14

12 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi all, we're experiencing "Out of Memory" Problems caused by Sieve-Filters delivering mail to huge IMAP folders. From the logs, I'm beginning to think the problem is that the sieve/lmtp process loads the "dovecot.index.cache" file apparently twice into memory to do something with it. We've set our memory limit per process to 256MB - the cache file of the folders we're having issues with is exactly 128MB. Mails coming in that should be filtered to these folders are being denied, an error is being logged. Apparently, there would be two easy solutions to this: increasing memory OR decreasing folder size. Both are not possible. Increasing memory just means we will have this issue again in some weeks. Deacreasing mailbox size isn't possible since the folders contain archived system mails from our backend software which need to be kept for a while. Currently, we're creating a new folder each time we reach this limit, but that isn't exactly the best way to go for the future. In the end, the folders are for archiving purposes and therefore should not be managed at all since all this is automated. I hope there's some obvious switch I've just not seen in the config. I actually can't imagine that this is default or wanted behaviour since there must be people with large inboxes and sieve filters that either also have this problem or don't have it since they fixed it. The problem clearly is reproducable. Each time the cache file hits 128MB - which happens at around 200k mails in the folder - (with our current setting of 256MB memory limit per process), things go down and our mailqueues reach 10k undelivered mails within a few hours. I hope you can help me Sincerly Fabian OS - -- Linux 2.6.32-16-pve #1 SMP Mon Oct 22 08:38:13 CEST 2012 i686 GNU/Linux (The IMAP server is running within a debian squeeze openVZ container on the Proxmox Virtual Environment Kernel; filesystem for the containers is ext3) VERSION - ------- 2.1.14 (bf80034a547d) CONFIG - ------ # 2.1.14 (bf80034a547d): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-16-pve i686 Debian 6.0.7 simfs auth_cache_size = 10 M mail_debug = yes mail_location = maildir:/var/mail/%u:LAYOUT=fs mail_max_userip_connections = 10000 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/mail/%u/.dovecot.sieve sieve_dir = /var/mail/%u/sieve } protocols = imap lmtp sieve service imap-login { client_limit = 5 process_limit = 0 process_min_avail = 4 service_count = 0 } service imap { client_limit = 10 process_limit = 1024 process_min_avail = 4 } service lmtp { client_limit = 20 inet_listener lmtp { address = *, [::] port = 24 } process_limit = 0 process_min_avail = 10 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { client_limit = 10 process_limit = 0 process_min_avail = 4 } ssl = required ssl_ca = </etc/ssl/certs/wildcard.hexonet.net.ca ssl_cert = </etc/ssl/certs/wildcard.hexonet.net.crt ssl_key = </etc/ssl/certs/wildcard.hexonet.net.key userdb { args = uid=vmail gid=vmail home=/var/mail/%u driver = static } protocol lmtp { mail_plugins = sieve } LOG - --- May 12 06:36:36: Debug: none: root=, index=, control=, inbox=, alt= May 12 06:36:36: Debug: auth input: USERNAME(a)hexonet.net uid=5000 gid=5000 home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:36: Debug: Effective uid=5000, gid=5000, home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:36: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/USERNAME@hexonet.net:LAYOUT=fs May 12 06:36:36: Debug: fs: root=/var/mail/USERNAME(a)hexonet.net, index=, control=, inbox=/var/mail/USERNAME(a)hexonet.net, alt= May 12 06:36:36: Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: using the following location for user's Sieve script: /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: opening script /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: script binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin successfully loaded May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: binary save: not saving binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin, because it is already stored May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: executing script from /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin May 12 06:36:36: PJyQMOZrcFN7awAA9jyUPQ: sieve: msgid=unspecified: stored mail into mailbox 'IMAP-FOLDER' May 12 06:36:41 Debug: none: root=, index=, control=, inbox=, alt= May 12 06:36:41 Debug: auth input: USERNAME(a)hexonet.net uid=5000 gid=5000 home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:41: Debug: Effective uid=5000, gid=5000, home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:41: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/USERNAME@hexonet.net:LAYOUT=fs May 12 06:36:41: Debug: fs: root=/var/mail/USERNAME(a)hexonet.net, index=, control=, inbox=/var/mail/USERNAME(a)hexonet.net, alt= May 12 06:36:41: Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: using the following location for user's Sieve script: /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: opening script /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: script binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin successfully loaded May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: binary save: not saving binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin, because it is already stored May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: executing script from /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin May 12 06:36:41: Fatal: pool_system_realloc(268435456): Out of memory May 12 06:36:41: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x45951) [0x219951] -> /usr/lib/dovecot/libdovecot.so.0(+0x459bf) [0x2199bf] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1e8dc5] -> /usr/lib/dovecot/libdovecot.so.0(+0x5806e) [0x22c06e] -> /usr/lib/dovecot/libdovecot.so.0(+0x40ec8) [0x214ec8] -> /usr/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x85) [0x2153b5] -> /usr/lib/dovecot/libdovecot.so.0(buffer_append_space_unsafe+0x2b) [0x2154cb] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_map+0x219) [0x506cf9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_open_and_verify+0x75) [0x507245] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_register_get_list+0x50) [0x5092a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header_init+0x15f) [0x4f6def] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_cache_parse_init+0x7c) [0x4f73fc] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_add+0x1d7) [0x4a0a87] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_begin+0x1d3) [0x4a0dd3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x58) [0x4d7988] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xba) [0x4d163a] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x4b) [0x49bacb] - -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x54) [0x4d78b4] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x35f5f) [0xc52f5f] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x16b) [0xc49efb] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x69) [0xc5b139] - -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x2892) [0x75e892] - -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x4f) [0x19641f] - -> dovecot/lmtp() [0x804c812] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0x227822] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd3) [0x2289e3] - -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x2277b0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2d) [0x21050d] May 12 06:36:41: Fatal: master: service(lmtp): child 27515 returned error 83 (Out of memory (service lmtp { vsz_limit=256 MB }, you may need to increase it)) - -- Fabian Peter Systemadministrator HEXONET GmbH T: +49 6841 69 84 308 F: +49 6841 69 84 199 E: fpeter(a)hexonet.net W: http://www.hexonet.net HEXONET GmbH, Talstrasse 27, 66424 Homburg, Germany. CEO & General Manager: Jens Wagner, HRB 2839 (HOM), Amtsgericht Saarbrücken, VAT-ID: DE-138316882 HEXONET Services Inc., 104 - 7455 132nd Street, Surrey, B.C., V3W 1J8, Canada. CSO & General Manager: Robert Birkner This email and any files transmitted are confidential and intended only or the person(s) directly addressed. If you are not the intended recipient, any use, copying, transmission, distribution, or other forms of dissemination is strictly prohibited. If you have received this email in error, please notify the sender immediately and permanently delete this email with any files that may be attached. -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.22 (Darwin) Comment: GPGTools - https://gpgtools.org Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBCgAGBQJTcHVYAAoJEPIZChNlZ+or5VQIAKegO6HwORlpEmP3YBkJnHXY sYsR1sP89Vm1Uzv4cVL30KF1P37NI9sZwHrO5H2aC5sqNSadaZ0lOUFncwlZwphh JsSS2Jye+56UW7XR92rUuwC8FPYRk6nOxTA0hHtAGW1IxCROz8P32V24cRlDE32k rcq2GT0V4laFlD5YNcqFWAClTqAholnHZCm/7VpBCevUTx0F+KVZxEth/xOf0ajY EmWoXat4Fihnly1YtdPqN5FqIyFdzBF8tyuWaUZN3BfO8QDso+tci/NRbe2yYkIK lhulr4PAvccsIqJ+u/9j+XN7SL9ZXDtU0w4xWQe+5SrGfFXJlXsuJoRgBdThn9I= =YP4k -----END PGP SIGNATURE-----

2 1

[Dovecot] v2.2.13.rc1 vs. Pigeonhole
by Tamsy 12 May '14

12 May '14

Server: Ubuntu 10.04 LTS 32bit There seems to be an incompatibility when compiling Pigeonhole against Dovecot v2.2.13.rc1. # make check with Pigeonhole throws up the following error message: <snip> Test case: ./tests/extensions/editheader/addheader.svtest: 1: Test 'Addheader - first' SUCCEEDED 2: Test 'Addheader - last' SUCCEEDED 3: Test 'Addheader - framed' SUCCEEDED 4: Test 'Addheader - folded' SUCCEEDED 5: Test 'Addheader - newlines' FAILED: wrong first header content in redirected mail 6: Test 'Addheader - implicit keep' SUCCEEDED 7: Test 'Addheader - UTF 8' SUCCEEDED 8: Test 'Addheader - devious characters' SUCCEEDED FAIL: 1 of 8 tests failed. I tried this with the latest Pigeonhole from Mercurial: - dovecot-2-2-pigeonhole-3b6917a4807c and also with the older: - dovecot-2-2-pigeonhole-e111a2393a92 Both versions are quitting during "make check" with the same error when compiling against dovecot-2.2.13.rc1. Compiling those versions against dovecot-2.2.12 is going without errors though. Cheers, Tamsy

3 4

[Dovecot] message-decoder bug for attachments with charset=binary attribute in content-type?
by Robert Wolf 12 May '14

12 May '14

Hello, I have configure dovecot with solr and I wanted to let solr index content of attachments. For testing I have used biabam command line tool to generate emails with attachments. I have found that dovecot with fts_decoder incorrectly decodes these attachments from biabam and therefore pdftotext has reported corrupted PDF. The problem is that biabam generates header with charset=binary and dovecot message decoder tries to process it as UTF8 or non-UTF8 data. ============================================================ --biabam.ZxWVLybiabam.ZxWVLy Content-Type: application/pdf; charset=binary Content-Disposition: attachment; filename="bacula-jobs.pdf" Content-Transfer-Encoding: base64 JVBERi0xLjQKJcfsj6IKNSAwIG9iago8PC9MZW5ndGggNiAwIFIvRmlsdGVy IC9GbGF0ZURlY29kZT4+CnN0cmVhbQp4nF2PT0+EMBDF7/0U7yYYWdqFXdbe 1vgnMXpQezMeClSoQNltweh+egvLyczhN3kz703mCLpioFMtLDoSv2aoHKGo ..... ============================================================ This PDF begins orginal with ============================================================ 0000000: 2550 4446 2d31 2e34 0a25 c7ec 8fa2 0a35 %PDF-1.4.%.....5 0000010: 2030 206f 626a 0a3c 3c2f 4c65 6e67 7468 0 obj.<</Length 0000020: 2036 2030 2052 2f46 696c 7465 7220 2f46 6 0 R/Filter /F 0000030: 6c61 7465 4465 636f 6465 3e3e 0a73 7472 lateDecode>>.str ============================================================ But the dovecot pass following data to fts_decoder script: ============================================================ 0000000: 2550 4446 2d31 2e34 0a25 c3a4 c3bc c3b6 %PDF-1.4.%...... 0000010: c39f 0a32 2030 206f 626a 0a3c 3c2f 4c65 ...2 0 obj.<</Le 0000020: 6e67 7468 2033 2030 2052 2f46 696c 7465 ngth 3 0 R/Filte 0000030: 722f 466c 6174 6544 6563 6f64 653e 3e0a r/FlateDecode>>. ============================================================ As you can see binary data are mangled. Alpine and Thunderbird do not write charset=binary to content-type header and searching works perfect. I have searched in source code and I have found one place. If I replace the following code in file dovecot-2.1.7/src/lib-mail/message-decoder.c on line 241 with new one, the dovecots message decoder decodes message correctly and pdftotext can convert attached PDF. Original code: ============================================================ 241: ctx->binary_input = ctx->content_charset == NULL && 242: (ctx->flags & MESSAGE_DECODER_FLAG_RETURN_BINARY) != 0 && 243: (part->flags & (MESSAGE_PART_FLAG_TEXT | 244: MESSAGE_PART_FLAG_MESSAGE_RFC822)) == 0; ============================================================ My update: ============================================================ 241 ctx->binary_input = ((ctx->content_charset != NULL) && (strcasecmp(ctx->content_charset, "binary") == 0)) || (ctx->content_charset == NULL && 242 (ctx->flags & MESSAGE_DECODER_FLAG_RETURN_BINARY) != 0 && 243 (part->flags & (MESSAGE_PART_FLAG_TEXT | 244 MESSAGE_PART_FLAG_MESSAGE_RFC822)) == 0); ============================================================ This will set ctx->binary_input for the attachment with charset set to "binary". I don't know if this is correct update, but the searching works with this update for biabam binary attachments too. Could you please verify this problem and maybe update the code? Thank you very much. # dovecot --version 2.1.7 Config: plugin { fts = solr fts_solr = url=http://localhost:8080/solr/ fts_decoder = decode2text } service decode2text { executable = script /etc/dovecot/scripts/decode2text.sh user = dovecot unix_listener decode2text { mode = 0666 } } Regards, Robert Wolf.

1 0

[Dovecot] questions about process_limit
by Andreas Meyer 12 May '14

12 May '14

Hello all! # dovecot --version 2.1.17 Sometimes I have this in the logfile: May 11 16:55:52 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped May 11 17:35:03 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped May 11 17:36:27 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped I then put this in the dovecot.conf service imap-login { service_count = 1 process_min_avail = 50 #process_limit = $default_process_limit process_limit = 10000 vsz_limit = 64M } and get this: May 11 18:19:36 master: Info: Dovecot v2.1.17 starting up (core dumps disabled) May 11 18:19:36 config: Warning: service auth { client_limit=1000 } is lower than required under max. load (10300) May 11 18:19:36 config: Warning: service anvil { client_limit=1000 } is lower than required under max. load (10203) Puting this in: service auth { client_limit = 10300 unix_listener auth-userdb { mode = 0666 user = vmail group = vmail } } service anvil { client_limit = 10300 } I get this: May 11 18:27:37 delta.bitcorner.eu dovecot[3989]: Warning: fd limit (ulimit -n) is lower than required under max. load (1024 < 10300), because of service auth { client_limit } I have also seen this today: May 11 13:14:05 log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) May 11 13:14:05 auth: Error: read(anvil-auth-penalty) failed: EOF May 11 13:14:05 auth: Error: net_connect_unix(anvil-auth-penalty) failed: Permission denied What is the best way to avoid this process_limit errors and configure dovecot the best way? Greetings Andreas

3 2