- dovecot - dovecot.org

Re: v2.2.32 release candidate released
by Joseph Tam 17 Aug '17

17 Aug '17

Timo Sirainen wrote: > There are various changes in this release that can be used to significantly reduce disk IO with: > 1) NFS storage especially, but I guess also other remote filesystems and even some with local disks > 2) When mail storage and INDEX storage are separated Thanks for these changes! Big win for my setup. My servers are not overly stressed, but how much performance gain (using any metric you choose) can one expect from these changes? > + mail_location can now include VOLATILEDIR=<path> parameter. This > is used for creating lock files and in future potentially other > files that don't need to exist permanently. The path could point to > tmpfs for example. This is especially useful to avoid creating lock > files to NFS or other remote filesystems. For example: > mail_location=sdbox:~/sdbox:VOLATILEDIR=/tmp/volatile/%2.256Nu/%u Is "/tmp/volatile" auto-created, or must be pre-created? > + mail_location's LISTINDEX=<path> can now contain a full path. > This allows storing mailbox list index to a different storage > than the rest of the indexes, for example to tmpfs. Is this in any way related to VOLATILEDIR? Can they be set to the same value without problems? > + mail_location can now include NO-NOSELECT parameter. This > automatically deletes any \NoSelect mailboxes that have no children. > These mailboxes are sometimes confusing to users. Sorry for my IMAP ignorance, but how can this situation come about? > + mail_location can now include ITERINDEX parameter. This tells Dovecot > to perform mailbox listing from the INDEX path instead of from the > mail root path. It's mainly useful when the INDEX storage is on a > faster storage. > + If mailbox_list_index_very_dirty_syncs=yes, the list index is no > longer refreshed against filesystem when listing mailboxes. This > allows the mailbox listing to be done entirely by only reading the > mailbox list index. > + Added mailbox_list_index_include_inbox setting to control whether > INBOX's STATUS information should be cached in the mailbox list > index. The default is "no", but it may be useful to change it to > "yes", especially if LISTINDEX points to tmpfs. So as I understand it, the optimzation comes about from segregating mail data information into 3 parts: raw mail, indices, and volatile components, putting them into increasingly better performing storage media. How do these I/O optimizations affect the client's view of a mailbox if their mailbox is subject to modification outside the dovecot system (e.g. procmail, mail readers directly modifies mailbox files)? Is there a trade-off between metadata consistency and performance, or it's a win-win all around? (I just saw your previous response to someone else, which I'll read more closely.) Joseph Tam <jtam.home(a)gmail.com>

2 1

v2.2.32 release candidate released
by Timo Sirainen 17 Aug '17

17 Aug '17

https://dovecot.org/releases/2.2/rc/dovecot-2.2.32.rc1.tar.gz https://dovecot.org/releases/2.2/rc/dovecot-2.2.32.rc1.tar.gz.sig There are various changes in this release that can be used to significantly reduce disk IO with: 1) NFS storage especially, but I guess also other remote filesystems and even some with local disks 2) When mail storage and INDEX storage are separated * imapc: Info-level line is logged every time when successfully connected to the remote server. This includes local/remote IP/port, which can be useful for matching against external logs. * config: Log a warning if plugin { key=no } is used explicitly. v2.3 will support "no" properly in plugin settings, but for now any value at all for a boolean plugin setting is treated as "yes", even if it's written as explicit "no". This change will now warn that it most likely won't work as intended. + Various optimizations to avoid accessing files/directories when it's not necessary. Especially avoid accessing mail root directories when INDEX directories point to a different filesystem. + mail_location can now include ITERINDEX parameter. This tells Dovecot to perform mailbox listing from the INDEX path instead of from the mail root path. It's mainly useful when the INDEX storage is on a faster storage. + mail_location can now include VOLATILEDIR=<path> parameter. This is used for creating lock files and in future potentially other files that don't need to exist permanently. The path could point to tmpfs for example. This is especially useful to avoid creating lock files to NFS or other remote filesystems. For example: mail_location=sdbox:~/sdbox:VOLATILEDIR=/tmp/volatile/%2.256Nu/%u + mail_location's LISTINDEX=<path> can now contain a full path. This allows storing mailbox list index to a different storage than the rest of the indexes, for example to tmpfs. + mail_location can now include NO-NOSELECT parameter. This automatically deletes any \NoSelect mailboxes that have no children. These mailboxes are sometimes confusing to users. + mail_location can now include BROKENCHAR=<char> parameter. This can be useful with imapc to access mailbox names that aren't valid mUTF-7 charset from remote servers. + If mailbox_list_index_very_dirty_syncs=yes, the list index is no longer refreshed against filesystem when listing mailboxes. This allows the mailbox listing to be done entirely by only reading the mailbox list index. + Added mailbox_list_index_include_inbox setting to control whether INBOX's STATUS information should be cached in the mailbox list index. The default is "no", but it may be useful to change it to "yes", especially if LISTINDEX points to tmpfs. + userdb can return chdir=<path>, which override mail_home for the chdir location. This can be useful to avoid accessing home directory on login. + userdb can return postlogin=<socket> to specify per-user imap/pop3 postlogin socket path. + cassandra: Add support for result paging by adding page_size=<n> parameter to the connect setting. + dsync/imapc, pop3-migration plugin: Strip also trailing tabs from headers when matching mails. This helps with migrations from Zimbra. + imap_logout_format supports now %{appended} and %{autoexpunged} + virtual plugin: Optimize IDLE to use mailbox list index for finding out when something has changed. - virtual plugin: A lot of fixes. In many cases it was also working very inefficiently or even incorrectly. - imap: NOTIFY parameter parsing was incorrectly "fixed" in v2.2.31. It was actually (mostly) working in previous versions, but broken in v2.2.31. - Modseq tracking didn't always work correctly. This could have caused imap unhibernation to fail or IMAP QRESYNC/CONDSTORE extensions to not work perfectly. - mdbox: "Inconsistency in map index" wasn't fixed automatically - dict-ldap: %variable values used in the LDAP filter weren't escaped. - quota=count: quota_warning = -storage=.. was never executed (try #2). v2.2.31 fixed it for -messages, but not for -storage. - imapc: >= 32 kB mail bodies were supposed to be cached for subsequent FETCHes, but weren't. - quota-status service didn't support recipient_delimiter - acl: Don't access dovecot-acl-list files with acl_globals_only=yes - mail_location: If INDEX dir is set, mailbox deletion deletes its childrens' indexes. For example if "box" is deleted, "box/child" index directory was deleted as well (but mails were preserved).

4 5

autocreate deprecated q
by voytek＠sbt.net.au 17 Aug '17

17 Aug '17

I'm getting "autocreate plugin is deprecated" I've removed 1) but still see error am I correct I don't need default IMAP folders in dovecot.conf as they come from 15-mailboxes.conf ? # grep autocreate dovecot.conf lda_mailbox_autocreate = yes mail_plugins = quota sieve autocreate mail_plugins = quota imap_quota autocreate do I just remove BOTH 'mail_plugin ... autocreate' ? 1) removed autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk

2 3

Cannot login with method=GSSAPI
by Erik Haller 16 Aug '17

16 Aug '17

I am migrating an existing dovecot server to a new server. The existing server uses pam_krb5 and works with the plain and gssapi methods. The new server plain/pam_krb5 normal password authentication works. However, the gssapi (tickets) authentication is producing the following error: === Begin Error ==== imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=192.168.7.61, lip=192.168.7.97, TLS, session=<SPnD7NhWWtrAqAc9> === End Error === What is causing the "user=<>"? It should be "user=<erik>". I have been using Thunderbird SSL GSSAPI from a Debian Linux testing/buster XFCE desktop to connect to the existing server for years. When I point it to the new server, I receive the above error. ssh kerberos gssapi authentication is working fine on the new server. Most of the doveconf setting between the existing and new servers are the same. The existing server is 32 bit. The new server is 64 bit running in an LXC container. The existing server dovecot version is the same as the new server. Notes: dovecot version: 2.2.31 (65cde28) OS: Debian Linux testing/buster Arch: amd64 Client: Mozilla Thunderbird 52.2.1 (latest)

2 2

correct permissions /etc/dovecot ?
by voytek＠sbt.net.au 16 Aug '17

16 Aug '17

what permissions/ownership should /etc/dovecot/files have? keep seeing this error below, I can correct as per log, BUT, wanted first to check what it should be, rather than me 'fiddling' thanks, V SQL user is vmail first_valid_uid = 2000 last_valid_uid = 2000 # ls -al total 60 drwxr-xr-x 5 root root 4096 Aug 16 14:45 . drwxr-xr-x 82 root root 4096 Aug 16 08:34 .. drwxr-xr-x 2 root root 4096 Aug 12 21:22 conf.d -rw------- 1 vmail dovecot 0 Nov 5 2013 dovecot-master-users-password -rw------- 1 vmail dovecot 735 Aug 16 14:45 dovecot-mysql.conf -rw------- 1 vmail dovecot 491 Aug 15 23:09 dovecot-share-folder.conf -rw------- 1 vmail dovecot 320 Aug 15 23:09 dovecot-used-quota.conf -rw-r--r-- 1 root root 3414 Aug 16 14:43 dovecot.conf Aug 16 16:28:01 auth: Error: passwd-file: open(/etc/dovecot/dovecot-master-users-password) failed: Permission denied (euid=97(dovecot) egid=97(dovecot) missing +r perm: /etc/dovecot/dovecot-master-users-password, dir owned by 0:0 mode=0755) Aug 16 16:29:16 auth: Error: passwd-file: open(/etc/dovecot/dovecot-master-users-password) failed: Permission denied (euid=97(dovecot) egid=97(dovecot) missing +r perm: /etc/dovecot/dovecot-master-users-password, dir owned by 0:0 mode=0755)

3 2

Question (haven't tried yet)
by Ivan Warren 16 Aug '17

16 Aug '17

Hello, I have a question : if I have multiple servers sharing a single disk space (NFS... cluster), and a message is delivered via say LMTP or LDA to a mailbox, and an IMAP client is in IDLE mode on another server, Will it get notified of the arrival of the new message (and if yes, how ?) Thanks, --Ivan

1 0

FTS Lucene Search by Word Parts
by Webert de Souza Lima 16 Aug '17

16 Aug '17

Hello, as the dovecot documentation is only trivial for FTS Search options, I can't find information on advanced options. I have enabled it but it seems I can only search for entire words, i.e. the word Dovecot can be found by searching "dovecot", but not "dove". Is it possible to achieve this using FTS Lucene? I know that using Solr that achievable setting n-gram. Regards, Webert Lima DevOps Engineer at MAV Tecnologia *Belo Horizonte - Brasil*

1 0

Compiling problem on Debian Jessie with dovecot-2-2-32.rc1
by Ralf Zimmermann 16 Aug '17

16 Aug '17

I cant' do ./configure && make && make install on a Debian Jessie. How can I fix this? #make CDPATH="${ZSH_VERSION+.}:" && cd . && /bin/bash /usr/local/src/dovecot-2.2.32.rc1/missing aclocal-1.15 -I . -I m4 /usr/local/src/dovecot-2.2.32.rc1/missing: line 81: aclocal-1.15: command not found WARNING: 'aclocal-1.15' is missing on your system. You should only need it if you modified 'acinclude.m4' or 'configure.ac' or m4 files included by 'configure.ac'. The 'aclocal' program is part of the GNU Automake package: <http://www.gnu.org/software/automake> It also requires GNU Autoconf, GNU m4 and Perl in order to run: <http://www.gnu.org/software/autoconf> <http://www.gnu.org/software/m4/> <http://www.perl.org/> Makefile:497: recipe for target 'aclocal.m4' failed make: *** [aclocal.m4] Error 127 # aclocal --version aclocal (GNU automake) 1.14.1 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv2+: GNU GPL version 2 or later <http://gnu.org/licenses/gpl-2.0.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Written by Tom Tromey <tromey(a)redhat.com> and Alexandre Duret-Lutz <adl(a)gnu.org>. # aclocal configure.ac:319: warning: macro 'AM_ICONV' not found in library # autoconf configure.ac:319: error: possibly undefined macro: AM_ICONV If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. # autoreconf -i -f aclocal: error: couldn't open directory 'm4': No such file or directory autoreconf: aclocal failed with exit status: 1 Greets Ralf Zimmermann

1 0

Failback mailboxes?
by Dag Nygren 16 Aug '17

16 Aug '17

Hi! Have been using Fedora as my dovecot server for some time and am struggling with systemd at every update. Fedora insists on setting ProtectSystem=full in both dovecot.service and postfix.service at every update of the packages. This makes my mailstore which is in /usr/local/var/mail Read-only. And this makes the incoming emails delivered through dovecot-lda disappear into /dev/null until I notice the problem and we lose incoming emails. My question is: Is there any way to set up a failback mailstore for these occasions? PS! I really hate systemd - Destroys the UNIX way of doing things with a heavy axe.... Best Dag

5 10

Question about mail_location
by Laura Steynes 16 Aug '17

16 Aug '17

In using mysql, in the configuration file we need to specify, in the user query, '/path/ as home, yet but in dovecot.conf, we also are setting mail_location, the same thing is it not, so unless I've missed something, do we still need to use the path as home in the user query? Do we only need set that if it differs from mail_location? Thanks

3 2