May 2016 - dovecot - dovecot.org

indexer-worker out of memory with vsz_limit=750 MB?!
by Peer Heinlein 18 May '16

18 May '16

We're running 2.2.24 with fts_lucene and I wonder why indexer-working can be out-of-memory even with vsz_limit=750 MB ?! Peer May 15 12:14:51 dobby4 dovecot: indexer-worker(user(a)example.com): Fatal: pool_system_realloc(134217728): Out of memory May 15 12:14:51 dobby4 dovecot: indexer-worker(user(a)example.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xaa4b7) [0x7f37027b84b7] -> /usr/lib/dovecot/libdovecot.so.0(+0xab851) [0x7f37027b9851] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f37027b89a6] -> /usr/lib/dovecot/libdovecot.so.0(+0xd0405) [0x7f37027de405] -> /usr/lib/dovecot/libdovecot.so.0(+0xa56e2) [0x7f37027b36e2] -> /usr/lib/dovecot/libdovecot.so.0(+0xa5813) [0x7f37027b3813] -> /usr/lib/dovecot/libdovecot.so.0(+0xa59e3) [0x7f37027b39e3] -> /usr/lib/dovecot/libdovecot.so.0(buffer_write+0x37) [0x7f37027b3cf5] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x10b7a6) [0x7f3702b617a6] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x10c0c3) [0x7f3702b620c3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_ext_intro+0x34d) [0x7f3702b625e5] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x10fb49) [0x7f3702b65b49] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0x38) [0x7f3702b66262] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x5ba) [0x7f3702b669b2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0xbf) [0x7f3702b59eb7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_refresh+0x1d) [0x7f3702b79e97] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x11cc33) [0x7f3702b72c33] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x127) [0x7f3702b72dba] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit+0x1f) [0x7f3702b72c91] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_index_set_header+0x68) [0x7f37014ebfd0] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_index_set_last_uid+0x3b) [0x7f37014ec00d] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4093) [0x7f3700686093] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_get_last_uid+0x81) [0x7f37014eb3e5] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x11b66) [0x7f37014f3b66] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x11c40) [0x7f37014f3c40] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0xea0d) [0x7f3701936a0d] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0x11f19) [0x7f3701b50f19] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x75) [0x7f3702aa2db4] May 15 12:14:51 dobby4 dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user(a)example.com May 15 12:14:51 dobby4 dovecot: indexer-worker(user(a)example.com): Fatal: master: service(indexer-worker): child 179030 returned error 83 (Out of memory (service indexer-worker { vsz_limit=750 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

3 2

Reloading dovecot and postfix after updates
by ＠lbutlr 17 May '16

17 May '16

Recently someone used webmin to update dovecot, which went fine. However, after the update no one could login to the mail server because of the mismatch in the versions between what was installed and what postfix was expecting. Other that bapping the person on the head and saying “don’t do that” is there anyway to force a reload of postfix after dovecot reloads? Like adding a postfix reload to the dovecot rc.d script or someway of linking them so that if either version changes they both get reloaded? (I don’t even use webmin myself, so maybe it’s even possible through it?) I mean, it’s unlikely to happen again at this point, but still… -- "...and Digby considered how much he liked salt..."

2 1

Errors on Cross-Protocol Locking nbmand (ZFS Solaris)
by Andrew Watkins 17 May '16

17 May '16

Hello, I get the following errors when I move large e-mails (i.e. about 15MB) into mail files. May 17 13:26:48 mailer3 dovecot: [ID 583609 mail.error] imap(andrew): Error: fdatasync() failed with mbox file /home/andrew/Mail/nbmandON/mbox: Permission denied May 17 13:26:48 mailer3 dovecot: [ID 583609 mail.error] imap(andrew): Error: ftruncate() failed with mbox file /home/andrew/Mail/nbmandON/mbox: Permission denied May 17 13:26:48 mailer3 dovecot: [ID 583609 mail.error] imap(andrew): Error: close() failed with mbox file /home/andrew/Mail/nbmandON/mbox: Permission denied Background I am using Solaris 11 ZFS & SMB for my users home files with Solaris SMB protocol mandatory locking (nbmand=on) If I turn nbmand=off then I do not get any errors, so it is to do with SMB locking. I know this may not be a dovecot error, but any pointers why it is doing this so that I can report it to Oracle. I tried creating a small C program to mimic the same problem but no luck, since I know it would make it easier to get Oracle to fix it. # /usr/local/dovecot/sbin/dovecot --version 2.2.24 (a82c823) Thanks for now, Andrew -- Andrew Watkins * Birkbeck, University of London * Computer Science * * http://notallmicrosoft.blogspot.com * * UKOUG Systems SIG Chair * * UKOUG Tech committee * * tel: 020 7631 6720 *

2 2

Unknown setting: mail_plugins
by Graf 17 May '16

17 May '16

Hello! At the start dovecot complains all occurrences |mail_plugins settings |in all configs. For example 20-lmtp.conf contents: |protocol lmtp { mail_plugins = $mail_plugins quota } # doveconf | grep '$mail_plugin_dir\|mail_plugins$' doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/20-lmtp.conf line 2: Unknown setting: mail_plugins || ||| If I insert directly those strings in dovecot.conf and comment the !include conf.d/*.conf , I have no errors: # doveconf | grep '$mail_plugin_dir\|mail_plugins$' mail_plugin_dir = /usr/lib64/dovecot mail_plugins = mail_plugins = " quota" My settings: |# dovecot --version 2.2.24 (a82c823) # dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql sqlite Passdb: checkpassword ldap passwd passwd-file shadow sql Userdb: checkpassword ldap nss passwd prefetch passwd-file sql| |# ls -l /usr/lib64/dovecot/ | grep quota -rwxr-xr-x 1 root root 990 may 12 18:52 lib10_quota_plugin.la -rwxr-xr-x 1 root root 78696 may 12 18:52 lib10_quota_plugin.so -rwxr-xr-x 1 root root 1061 may 12 18:52 lib11_imap_quota_plugin.la -rwxr-xr-x 1 root root 11584 may 12 18:52 lib11_imap_quota_plugin.so -rwxr-xr-x 1 root root 1026 may 12 18:52 lib20_quota_clone_plugin.la -rwxr-xr-x 1 root root 8992 may 12 18:52 lib20_quota_clone_plugin.so| Thank you in advance.

1 1

Dovecot configuration: Home dir not found
by Divakar BM 17 May '16

17 May '16

Hi, I've my mail solution configured on Server-A with webmail, Dovecot and Postfix. I'm trying to deploy only Dovecot and postfix on Server-B to reduce IMAP/POP3/SMTP load on server-A. Please note server-B does not mailboxes. It should be mapped to mailboxes on server-A. While the LDAP query from Server-B to Server-A is going successfully, the imap service on Server-B is throwing the below error. imap(user(a)example.com): Debug: Home dir not found: /mail/vmail/**/ I guess imap is looking for *home dir* in server-B. How do I tel the imap that home dir is on server-A and not server-B. Please let me know if there exists a configuration parameter for the above.. Thanks Divakar

3 4

Sieve extension for testing for mailbox
by Jon Kristensen 16 May '16

16 May '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi! Which Pigeonhole Sieve extension should I use to process/test a message depending on whether the message is in a particular mailbox? (Is it the mboxmetadata extension by any chance? If so, I would appreciate if someone could tell me what the reason is for it not being enabled by default.) The reason I want to perform this test is that I have configured my MTA to deliver "outgoing" e-mails to my "Sent" IMAP folder, and these messages arrive unread. I would like to mark them as read using Sieve. Thanks in advance! - -- Jon Kristensen (jonkri) PGP fingerprint: 0377 F488 8908 0237 A2AE C484 387E C31D DA60 1350 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJXMjBWAAoJEDh+wx3aYBNQfnIP/19D90MOwN1h/AXEuC2eSlXx MFHVuVgnXlc4mTXINkybBRxyjeaQlry7Lcbl2UR74rX5MLet6hEqu6l2tbBtbaKX 7VKDydOr55NsKUKvEDLg6DRhRRgHWYS1TxhENuRbhAriNZx4GbPnbAJAx8VL9wQ9 5W8PhTr8VMJUXiYZSCQ3LxXLHXrDAcIflh2vkJubiL5S0WQzbm1wyCplCAcUCTw4 Uk9StP0Zb9aMuwm+IsRDB9T0/2U90vCpz2b9UUJzg8yUwaTRIxSkoPNqaukSepsq tBNWKmQ8efKYq0AtISzQK5SSRQp7c4MudQUuNqU9oR85qMC5F/i/c//To7HBUuRd bkNr4gpvDXKKIYCAmcE8I1jU36M+E7Y5RE/gYkvA23/xC9cd7GpsaOAspWjVhm4l sp7DXnFkfGyM8/l3m5CVhfsFewFjrq8K9L5gVnCrEBRnfHqm/BeE7+rrQ4+LmPMl dZ45fwy8lFD2HIUE97p0E3n2xX4JvhMDhR/gilnSl/ssmVVpnbpVAgXrmqWJ9cr4 dfue7unhvrM5DTQ0hM9WoWXzCi/tSOHvYido1rjhtEYzCHIdTtJKAUVg69CZHLHu zDodyGn70kxxS5YOYMYuIahUFaZknbiuCV3MGh4p2sTGOY69kFANQlB00m0ZaiPZ D6cjf2Yz0Ny2RsAUgyPw =g2F3 -----END PGP SIGNATURE-----

3 5

fts-lucene crashes on dovecot-2.2.24
by Dmitry Nezhevenko 16 May '16

16 May '16

Hi, I've tried to upgrade to dovecot 2.2.24. It seems that lucene reindex issue should be fixed. But instead of this dovecot indexer-worker crashes very often for me. I'm attaching backtrace. Please let me know if you need backtrace from binary without optimizations. -- WBR, Dmitry

1 0

SSL on doveadm port
by Patrick Domack 15 May '16

15 May '16

I have been attempting to setup ssl on the doveadm port. So far this works fine, as long as the global certificate is used. I wanted to use a different certificate, one that machines the machine name, instead of the generic mail certificate, but I have not been able to figure out how to do this. Attempts to add the certificate in the services section with the ssl = yes option, cause syntax error, and dovecot doesn't start. Creating a protocol doveadm section with it, is ignored, and setting up a local section with it in it, is ignored also.

2 1

FTS and autoindex in a cluster?
by Peer Heinlein 15 May '16

15 May '16

In a dovecot replication cluster where both sides have fts_autoindex=yes we have a indexer-worker(user(a)example.com): Indexed 1 messages in INBOX on BOTH sides. a) Is that okay because the duplicated message will be skipped or doesn't harm? b) Or should "autoindex" only be activated on one side? Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

1 0

2.2.24 ldap-client.c compile failing on Solaris 10
by Tomi Vainio 13 May '16

13 May '16

Hi, I'm trying to compile 2.2.24 on Solaris 10 with SolarisStudio 12.4 compiler. Looks like BerVarray is totallly missing from Solaris ldap. BR, Tomppa Making all in lib-ldap source='ldap-client.c' object='ldap-client.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -std=c11 -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-settings -I../../src/lib-master -I../../src/lib-ssl-iostream -I/usr/local/include -I/usr/sfw/include -xO4 -xtarget=ultra4 -xcache=64/32/4:8192/128/2 -I/usr/local/include -c -o ldap-client.lo ldap-client.c libtool: compile: cc -std=c11 -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-settings -I../../src/lib-master -I../../src/lib-ssl-iostream -I/usr/local/include -I/usr/sfw/include -xO4 -xtarget=ultra4 -xcache=64/32/4:8192/128/2 -I/usr/local/include -c ldap-client.c -KPIC -DPIC -o .libs/ldap-client.o "ldap-private.h", line 63: syntax error before or at: BerVarray "ldap-client.c", line 46: void function cannot return value "ldap-client.c", line 54: void function cannot return value cc: acomp failed for ldap-client.c *** Error code 1 make: Fatal error: Command failed for target `ldap-client.lo' Current working directory /v/tomppa/src/dovecot-2.2.24/src/lib-ldap *** Error code 1 CC='cc -std=c11' CXX='CC -std=c++11' CFLAGS=-xO4 CFLAGS="${CFLAGS} -`fpversion -foption`" CPPFLAGS="-I/usr/local/include" CPPFLAGS="${CPPFLAGS} -I/usr/sfw/include" LDFLAGS="-R/usr/local/lib:/usr/sfw/lib:/usr/lib/sasl:/usr/lib/mps" LDFLAGS="${LDFLAGS} -L/usr/local/lib -L/usr/sfw/lib" LDFLAGS="${LDFLAGS} -L/usr/lib/sasl -L/usr/lib/mps" export CC CXX CFLAGS CPPFLAGS LDFLAGS ./configure \ --with-gssapi \ --with-ldap \ --with-mysql \ --with-pgsql \ --with-sqlite \ --with-solr \ --with-libwrap \ --with-ssl=openssl \ --with-ssldir=/usr/local/openssl

2 3