October 2014 - dovecot

Bug in fts (solr?, Maildir?) incorrect last_indexed_uid
by Karl O. Pinc 30 Oct '14

30 Oct '14

Hi, I thought I should document this. (Dovecot 2.2.9, see config at bottom.) I installed dovecot and then converted a number of mbox mailboxes to Maildir, and had a number of pre-existing Maildir mailboxes. I then installed the debian (wheezy) fts-solar and jetty packages, and tested my inbox using the "telnet localhost imap ... 3 SEARCH text "test" method as described on the dovecot wiki. Everything seemed to work. But when I used balsa to search a mailbox other than my inbox, I got no results. "doveadm dump" on the searched mailbox showed that "last_indexed_uid" to be the last uid of my inbox. Stopping dovecot, deleting out the dovecot-index* files, starting dovecot, and re-running "doveadm dump" showed a non-existant last_indexed_uid -- that is, last_indexed_uid did not show up in the dump output. Using the telnet method above to attempt to search again yielded no results, but this time (I think, I also tried various times with balsa) the last_indexed_uid value was that of the last uid in my trash mailbox. I don't believe I'd yet tried fts on my trash. Using balsa as an imap client the results were very consistent; every Maildir where "doveadm dump" returned no last_indexed_uid value had the last_indexed_uid set to that of the inbox's largest uid. Running "doveadm fts rescan -u foo" fixed the problem. (FWIW, now all the Maildirs seem to have a last_indexed_uid=0.) Regards, Karl <kop(a)meme.com> Free Software: "You don't pay back, you pay forward." -- Robert A. Heinlein # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-486 i686 Debian 7.7 default_vsz_limit = 1 G disable_plaintext_auth = no mail_location = maildir:~/Maildir:INBOX=~/Maildir/.inbox mail_plugins = fts fts_solr namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } namespace unconverted { hidden = no list = yes location = mbox:~/mail prefix = unconverted/ separator = / subscriptions = yes type = private } passdb { driver = pam } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl = required ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd }

1 1

Quota reporting
by Hanns Mattes 30 Oct '14

30 Oct '14

Hi, my main server will be upgraded from Dovecot 1.2something to 2.2. For testing I've installed a setup with postfix, handing malis as a relay via lmtp. So far it's up and running - really nice. AFAICS there's one issue left: Thunderbird and Kmail don't show the quota status. Using doveadm quota the information is shown correctly, even the user-specific values (coming from openldap) are set correctly. I think, I miss something obvious ... (and besides quota - any configuration hint is very welcome) linux:/etc/dovecot # doveconf -n # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 3.7.10-1.40-desktop x86_64 openSUSE 12.3 (x86_64) auth_master_user_separator = * auth_mechanisms = plain login digest-md5 cram-md5 apop auth_verbose = yes mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota zlib fts fts_lucene trash" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts_autoindex = yes fts_lucene = whitespace_chars=@. quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 100M quota_rule = *:storage=1000M quota_rule2 = Trash:storage=+10%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 32 trash = /etc/dovecot/dovecot-trash.conf.ext zlib_save = gz zlib_save_level = 6 } postmaster_address = admin(a)93er.net protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = </etc/dovecot/brueckokomplett2014.crt ssl_key = </etc/dovecot/brueckofrei2014.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota zlib fts fts_lucene trash quota sieve" } protocol lda { mail_plugins = " quota zlib fts fts_lucene trash" } protocol imap { mail_plugins = " quota zlib fts fts_lucene trash quota imap_quota imap_zlib" } here is dovecot-ldap.conf.ext: hosts = 127.0.0.1 192.168.0.1 dn = cn=Manager,dc=dies,dc=jenes dnpass = ganzgeheim auth_bind = no base = ou=virtualmail,dc=dies,dc=jenes scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,quota=quota_rule=*:\ storage=%$M user_filter = (&(objectClass=CourierMailAccount)(uid=%u)) pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,uidNumber\ =userdb_uid,gidNumber=userdb_gid,quota=userdb_quota_rule=*:storage=%M pass_filter = (&(disableimap=FALSE)(objectClass=CourierMailAccount)(uid=%u)) iterate_attrs = uid=user iterate_filter = (objectClass=CourierMailAccount) default_pass_scheme = PLAIN Any ideas? Thanks in advance regards Hanns

2 4

Renaming not supported across conflicting directory - why?
by Arkadiusz Miśkiewicz 30 Oct '14

30 Oct '14

I wonder what is point of checkign file/dir create mode like this? Here it makes problems since some folders have different permissions than others but both are accessible/writable by user. So renaming is possible (as renaming according to unix permissions). Yet dovecot artificially prevents this. /* if we're renaming under another mailbox, require its permissions to be same as ours. */ if (strchr(newname, mailbox_list_get_hierarchy_sep(newlist)) != NULL) { struct mailbox_permissions old_perm, new_perm; mailbox_list_get_permissions(oldlist, oldname, &old_perm); mailbox_list_get_permissions(newlist, newname, &new_perm); if ((new_perm.file_create_mode != old_perm.file_create_mode || new_perm.dir_create_mode != old_perm.dir_create_mode || new_perm.file_create_gid != old_perm.file_create_gid)) { mailbox_list_set_error(oldlist, MAIL_ERROR_NOTPOSSIBLE, "Renaming not supported across conflicting " "directory permissions"); return -1; } } -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

1 0

Sieve plus addressed mail filtering
by Peter Chiochetti 30 Oct '14

30 Oct '14

Today I learned, that to filter incoming plus addressed mail (user+tag@…) I had to deviate from the documentation. There it reads: if envelope :detail "to" "spam"{ fileinto "Spam"; } Instead I had to write: if address :is :detail "To" "tag"{ fileinto "Tagged"; } Dovecot version is 2.2.13-1+bigmichi1~precise+1 -- peter

2 3

Released Pigeonhole v0.4.4 for Dovecot v2.2.15.
by Stephan Bosch 30 Oct '14

30 Oct '14

Hello Dovecot users, It's been about 5 months since the last Pigeonhole release, so it is high time for a new one. However, the main reason to make a release now is the fact that Dovecot v2.2.15 has one change that causes problems with the previous release of Pigeonhole. Unlike recent earlier releases, this release has a few big new features. Most notably, I implemented a generic Sieve script storage framework. This means that it is now relatively easy to implement a storage driver to retrieve Sieve scripts from a location other than the file system. An important effect of this new implementation is that these alternative storage locations can also be used with sieve_before/sieve_after. Also, storing Sieve scripts there using ManageSieve is also possible, provided that the driver provides an implementation. I used the new framework to implement an LDAP storage driver. However, it is read-only, which means that it doesn't currently provide ManageSieve support. Several bugs were fixed. The most nasty ones were related to the doveadm-sieve plugin (which is one of the reasons why this release took so long). The new script storage driver framework entailed large changes in this plugin, so many of these problems were addressed implicitly. Hopefully, all problems are solved now. Changelog v0.4.4: * Added support for Japanese mail addresses with dots at non-standard places in localpart. * Changed handling of ENOSPACE into a normal temporary failure and added handling of ENOQUOTA as a user error. * Restructured result execution, so that all actions which involve mail storage are always committed before all others. + Implemented support for generic Sieve storages. Using alternative storages now also possible for sieve_before/sieve_after. + Implemented storage driver for retrieving Sieve scripts from LDAP. This currently cannot be used with ManageSieve. + Implemented sieve_redirect_envelope_from setting, which allows configuring the envelope sender of redirected messages. - Fixed handling of mail storage errors occurring while evaluating the input message. - managesieve-login: - Removed bogus ALERT response code returned for AUTHENTICATE command. - Fixed handling of invalid initial response argument to AUTHENTICATE command. - Fixed handling of stream errors in lexical scanner. - Fixed handling of SMTP errors. Permanent and temporary errors were mixed up. - Fixed several problems reported by CLang 3.4. - duplicate extension: Fixed erroneous compile error about conflicting tags when `:handle' argument was used last. - relational extension: Fixed error handling of `:value' match. - editheader extension: Fixed header unfolding and header iteration. - mailbox extension: Fixed the `:create' tag, which erroneously subscribed an existing folder. - extprograms plugin: Fixed handling of error codes. - doveadm-sieve plugin: Fixed several bugs. Synchronization of symbolic link in the file storage should now also work properly. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.4.tar… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.4.tar… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

2 5

v2.2.15 released
by Timo Sirainen 30 Oct '14

30 Oct '14

http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz.sig Some small fixes and changes to v2.2.14. This release is mainly in the hope that it could still make it into the next Debian stable instead of v2.2.14 - mainly because of a couple of new assert crashes that started happening in v2.2.14 and should be fixed now. * Plugins can now print a banner comment in doveconf output (typically the plugin version) * Replication plugin now triggers low (instead of high) priority for mail copying operations. * IMAP/POP3/ManageSieve proxy: If destination server can't be connected to, retry connecting once per second up to the value of proxy_timeout. This allows quick restarts/upgrades on the backend server without returning login failures. * Internal passdb lookups (e.g. done by lmtp/doveadm proxy) wasn't returning failure in some situations where it should have (e.g. allow_nets mismatch) * LMTP uses mail_log_prefix now for logging mail deliveries instead of a hardcoded prefix. The non-delivery log prefix is still hardcoded though. + passdb allow_nets=local matches lookups that don't contain an IP address (internally done by Dovecot services) + Various debug logging and error logging improvements - Various race condition fixes to LAYOUT=index - v2.2.14 virtual plugin crashed in some situations

8 13

smtp lastlogin
by Eduardo Ramos 30 Oct '14

30 Oct '14

Hey guys! I've been googling without success. Do anyone know if there is a way to track last login of a smtp authentication? I've tried without success using: service auth { executable = auth lastlogin unix_listener auth-userdb { } unix_listener /var/spool/postfix/private/auth { mode = 0660 group = postfix } } service lastlogin { executable = script-login -d /usr/local/bin/lastlogin.sh unix_listener lastlogin { user = $default_internal_user mode = 0666 } }

3 2

[Pigeonhole] Problem compiling latest snapshot
by Bernd Kuhls 29 Oct '14

29 Oct '14

Hi, http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/a1e57385b267 added the use of update-version.sh, but this file and is-tagged.py are not included in Pigeonhole, only in Dovecot sourcecode. Therefore pigeonhole- version.h is not generated during compilation leading to a compile error: ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole- version.h: No such file or directory #include "pigeonhole-version.h" Regards, Bernd

2 1

Pigeonhole 0.4.4 error with no sieve rules
by James 29 Oct '14

29 Oct '14

I have built and installed Pigeonhole 0.4.4 with Dovecot 2.2.15. For users with no sieve at all I am getting an error on delivery. Delivery is from exim via lmtp. Syslog: Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): Fatal: master: service(lmtp): child 18915 killed with signal 11 (core not dumped - set service lmtp { drop_priv_before_exec=yes }) There is no global sieve script because there is no global sieve rule. Where an account has sieve rules delivery works as expected. To make it work again I've gone back to 2.2.15 with 0.4.3. James.

3 10

Dovecot 2.2.14 and per user \Seen flags
by Thomas Robers 29 Oct '14

29 Oct '14

Hello, I have a Dovecot Installation Version 2.2.14 on CentOS 6.5 with shared folder. UserA shares his INBOX to user UserB. I activated "per user \Seen flags" with location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u:INDEXPVT=%h/shared I think the INDEXPVT setting activates this setting, right? I activated this setting when there were already several accounts in use. Before we used shared \Seen flags. But this setting doesn't work on my system. For example UserB marks several Messages as read in a shared INBOX from UserA and erverything seems alright but then suddenly all seen Messages are marked as unread again and I see the following error message in the log file: Oct 27 14:40:48 mail dovecot: imap(UserB(a)tutech.de): Error: /export/home/imap/UserB(a)tutech.de /shared/.INBOX/dovecot.index.pvt reset, view is now inconsistent Oct 27 14:40:48 mail dovecot: imap(UserB(a)tutech.de): Disconnected: BUG: Unknown internal error in=1020 out=2757 My Dovecot configuration is: root@mail:~# doveconf -n # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no mail_debug = yes mail_location = maildir:/export/home/imap/%Lu/Maildir mail_plugins = acl zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u:INDEXPVT=%h/shared prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/export/home/shared-db/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 process_min_avail = 20 } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.tutech.de.crt_chain ssl_key = </etc/pki/dovecot/private/mail.tutech.de.key ssl_protocols = !SSLv3 !SSLv2 syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl zlib sieve } protocol imap { mail_plugins = acl zlib imap_zlib imap_acl } I don't know, is there something wrong with my configuration, am I missing sonething? Any hint would be helpful. Thank you Best regards Thomas

2 2