- dovecot - dovecot.org

Accidentally deleted .imap folder, how can I reindex?
by Les 17 Jan '19

17 Jan '19

Hello, I have several users with Maildir format. After upgrading from 2.2 to 2.3, some directories could not be opened from thunderbird. The server log shows all kinds of errors including these: Corrupted record in index cache file /home/user01/Maildir/.Elk&APw-ld&APY-tt/dovecot.index.cache: UID 2802: Broken physical size in mailbox Cached message size larger than expected (18 > 17, box=Sent, UID=2802) While trying to fix the problem, I have accidentally deleted some of the index/cache directories. In particular, Maildir/.Sent/.imap and Maildir/.Sent/cur/.imap folders were deleted, but all of the mail message files are there. When I try to open the "Sent" folder from thunderbird, it does not show all of the messages. It only shows messages until 2019.01.12. If I send out an email from thunderbird, then a new message is copied into the Maildir/.Sent/ folder, but it is not visible from thunderbird. I have already tried to unsubscribe + subscribe to the Sent folder, but it did not work - it re-downloads all messages until 2019.01.12, but not after that. Can I somehow regenerate the index files, force dovecot to recreated .imap foder, and force thunderbird to re-download and show all of the files somehow? Thank you, Laszlo

2 2

Authentication lost within session
by Marc Roos 17 Jan '19

17 Jan '19

When I open the mail client (thunderbird), I can access the mailboxes and all of a sudden, I am loosing the authenticated session. Any idea's where to look? Jan 17 12:42:04 mail04 dovecot: imap-login: Login: user=<usertest>, method=PLAIN, rip=192.168.10.219, lip=192.168.10.44, mpid=13403, TLS, session=<NsYo4qV/CNfAqArb> Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Loading modules from directory: /usr/lib64/dovecot Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Module loaded: /usr/lib64/dovecot/lib20_listescape_plugin.so Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Effective uid=8267, gid=231, home=/home/popusers/usertest Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/usertest:CONTROL=~/mail/contr ol:INDEX=/var/dovecot/usertest/index:LAYOUT=maildir++ Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: maildir++: root=/home/popusers/usertest/mail, index=/var/dovecot/usertest/index, indexpvt=, control=/home/popusers/usertest/mail/control, inbox=/var/spool/mail/usertest, alt= Jan 17 12:42:04 mail04 dovecot: imap-login: Login: user=<usertest>, method=PLAIN, rip=192.168.10.219, lip=192.168.10.44, mpid=13404, TLS, session=<yRkp4qV/CtfAqArb> Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Loading modules from directory: /usr/lib64/dovecot Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Module loaded: /usr/lib64/dovecot/lib20_listescape_plugin.so Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: INBOX: Mailbox opened because: SELECT Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Effective uid=8267, gid=231, home=/home/popusers/usertest Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/usertest:CONTROL=~/mail/contr ol:INDEX=/var/dovecot/usertest/index:LAYOUT=maildir++ Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: maildir++: root=/home/popusers/usertest/mail, index=/var/dovecot/usertest/index, indexpvt=, control=/home/popusers/usertest/mail/control, inbox=/var/spool/mail/usertest, alt= Jan 17 12:42:04 mail04 dovecot: imap(usertest): Debug: INBOX/test: Mailbox opened because: SELECT Jan 17 12:42:12 mail04 dovecot: imap-login: Login: user=<usertest>, method=PLAIN, rip=192.168.10.219, lip=192.168.10.44, mpid=13405, TLS, session=<MOKk4qV/C9fAqArb> Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: Loading modules from directory: /usr/lib64/dovecot Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: Module loaded: /usr/lib64/dovecot/lib20_listescape_plugin.so Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: Effective uid=8267, gid=231, home=/home/popusers/usertest Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/usertest:CONTROL=~/mail/contr ol:INDEX=/var/dovecot/usertest/index:LAYOUT=maildir++ Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: maildir++: root=/home/popusers/usertest/mail, index=/var/dovecot/usertest/index, indexpvt=, control=/home/popusers/usertest/mail/control, inbox=/var/spool/mail/usertest, alt= Jan 17 12:42:12 mail04 dovecot: imap(usertest): Debug: Drafts: Mailbox opened because: SELECT Jan 17 12:42:14 mail04 dovecot: auth-worker(13400): pam(usertest,192.168.10.219,<fLyv4qV/DNfAqArb>): pam_authenticate() failed: Authentication failure (password mismatch?) Jan 17 12:42:22 mail04 dovecot: auth-worker(13400): pam(usertest,192.168.10.219,<fLyv4qV/DNfAqArb>): pam_authenticate() failed: Authentication failure (password mismatch?) Jan 17 12:42:25 mail04 dovecot: auth-worker(13400): pam(usertest,192.168.10.219,<slYR46V/DdfAqArb>): pam_authenticate() failed: Authentication failure (password mismatch?)

2 1

Dovecot + Weakforced Policy server
by alberto bersol 16 Jan '19

16 Jan '19

Hi, I'm trying to set Weakforced with Dovecot and I cannot log in policy server. This is the config: /root/weakforced/wforce/wforce.conf ----------------------------------- ... webserver("0.0.0.0:8084", "super") ... /etc/dovecot/conf.d/95-policy.conf ---------------------------------- auth_policy_server_url = http://localhost:8084/ #auth_policy_hash_nonce = wforce:super auth_policy_hash_nonce = {SHA256-CRYPT}$5$Ue5UrToV.Bam02bQ$Bi9OJ62Mkgc20L2HnLVmD2OCHyXaKje6Hh7qNjnOkB9 I'm following the instructions of Dovecot's wiki: https://wiki.dovecot.org/Authentication/Policy ... "To generate the hash, you concatenate nonce, login name, nil byte, password and run it through the hash algorithm once. The hash is truncated when truncation is set to non-zero. The hash is truncated by first choosing bits from MSB to byte boundary (rounding up), then right-shifting the remainding bits. hash = H(nonce||user||'\x00'||password) bytes = round8(bits*8) hash = HEX(hash[0:bytes] >> (bytes-bits*8)) And I set hash with password (super) in this way: vm-weakforced:~# doveadm pw -p noncewforce\x00super -s SHA256-CRYPT {SHA256-CRYPT}$5$ZWIX2dnU7NJvGHgC$hYFbeCCaHYZv0yPP80GHygxQMPmI5BjMx2ttRe9zti2 But if I log in Dovecot Server: vm-weakforced:~# doveadm auth login usuario Password: passdb: usuario auth succeeded extra fields: user=usuario userdb extra fields: usuario system_groups_user=usuario uid=1000 gid=1000 home=/home/usuario Answer of Weakforced is always "...authentication failed": WforceWebserver: HTTP Request "/" from 127.0.0.1:39720: Web Authentication failed And Dovecot logs don't show anything else: ... Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: auth client connected (pid=967) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=doveadm#011resp=dXN1YXJpbwB1c3VhcmlvAHVzdWFyaW8= (previous base64 data may contain sensitive data) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: policy(usuario): Policy request http://localhost:8084/?command=allow Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: policy(usuario): Policy server request JSON: {"device_id":"","login":"usuario","protocol":"doveadm","pwhash":"0a00","remote":"","tls":false} Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: queue http://localhost:8084: Set request timeout to 2019-01-15 16:50:52.236 (now: 2019-01-15 16:50:50.236) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client: peer 127.0.0.1:8084 (shared): Peer created Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client: peer 127.0.0.1:8084: Peer pool created Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: Peer created Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: queue http://localhost:8084: Setting up connection to 127.0.0.1:8084 (1 requests pending) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: Linked queue http://localhost:8084 (1 queues linked) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: queue http://localhost:8084: Started new connection to 127.0.0.1:8084 Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: request [Req4: POST http://localhost:8084/?command=allow] Submitted (requests left=1) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: Creating 1 new connections to handle requests (already 0 usable, connecting to 0, closing 0) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: Making new connection 1 of 1 (0 connections exist, 0 pending) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: (127.0.0.1:8084): Connecting Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: (127.0.0.1:8084): Waiting for connect (fd=20) to finish for max 0 msecs Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: HTTP connection created (1 parallel connections exist) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: (127.0.0.1:8084): Client connected (fd=20) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: Connected Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: Ready for requests Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: Successfully connected (1 connections exist, 0 pending) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client: peer 127.0.0.1:8084: Successfully connected (1 connections exist, 0 pending) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: Using 1 idle connections to handle 1 requests (1 total connections ready) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: queue http://localhost:8084: Connection to peer 127.0.0.1:8084 claimed request [Req4: POST http://localhost:8084/?command=allow] Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: Claimed request [Req4: POST http://localhost:8084/?command=allow] Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: request [Req4: POST http://localhost:8084/?command=allow] Sent header Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: request [Req4: POST http://localhost:8084/?command=allow] Send more (sent 95, buffered=303) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: request [Req4: POST http://localhost:8084/?command=allow] Finished sending payload Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: No more requests to service for this peer (1 connections exist, 0 pending) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: Got 401 response for request [Req4: POST http://localhost:8084/?command=allow] (took 4 ms + 3 ms in queue) Jan 15 16:50:50 vm-weakforced dovecot: auth: Error: policy(usuario): Policy server HTTP error: 401 Unauthorized Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: Response payload stream destroyed (0 ms after initial response) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: request [Req4: POST http://localhost:8084/?command=allow] Finished Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: queue http://localhost:8084: Dropping request [Req4: POST http://localhost:8084/?command=allow] Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: request [Req4: POST http://localhost:8084/?command=allow] Free (requests left=1) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: peer 127.0.0.1:8084: No requests to service for this peer (1 connections exist, 0 pending) Jan 15 16:50:50 vm-weakforced dovecot: auth: Debug: http-client[1]: conn 127.0.0.1:8084 [2]: No more requests queued; going idle (timeout = 10000 msecs) ... Any idea? Thank you so much Regards,

2 4

doveadm neglecting to exit in failure?
by Felipe Gasper 16 Jan '19

16 Jan '19

----- cpssltest(a)cpanelssltest.org [/usr/local/cpanel]# doveadm -v expunge -u cpssltest -- mailbox-guid b8a359119e771b58484a0000a841250d savedbefore 365days; echo $? doveadm(cpssltest): Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied 0 ----- ^^ In the above, shouldn’t the “doveadm” command have exited nonzero to indicate a failure to connect? Thanks! -Felipe Gasper Mississauga, Ontario

3 2

MySQL 8.0: Supported?
by Larry Rosenman 16 Jan '19

16 Jan '19

I got a complaint from a FreeBSD user that they couldn't compile dovecot against MySQL 8.0. Is MySQL 8.0 support with 2.3.4? they receive: checking for mysql_init in -lmysqlclient... no configure: error: Can't build with MySQL support: libmysqlclient not found ===> Script "configure" failed unexpectedly. Please report the problem to ler(a)FreeBSD.org [maintainer] and attach the "/wrkdirs/usr/ports/mail/dovecot/work/dovecot-2.3.4/config.log" including the output of the failure of your make command. Also, it might be a good idea to provide an overview of all packages installed on your system (e.g. a /usr/local/sbin/pkg-static info -g -Ea). *** Error code 1 thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

3 11

Import mailbox from different domain
by Sergio Belkin 15 Jan '19

15 Jan '19

Hi folks, Let's say that I have on dovecot the domain example.net and on MS Exchange example.com. I've tried to import a mailbox from MS Exchange to Dovecot but it fails, I've run: dsync -Dv backup -R -u joe.doe imapc: dsync(joe.doe(a)example.net): Error: imapc(192.168.0.2:993): Authentication failed: AUTHENTICATE failed. Is there a way to submit different domains both on MS Exchange and Dovecot and to make everyone be happy :) ? Thanks in advance -- -- Sergio Belkin LPIC-2 Certified - http://www.lpi.org

2 1

mdbox + zlib performing less than just mdbox
by Marc Roos 14 Jan '19

14 Jan '19

I have test environment to determine what would be best settings. I have been told that enabling zlib compression would be good to save iops on storage. But doing the test now, I get worse results. [@test2 ~]# pr -m -t mail04-mdbox-vdb-append-64kb-6.log mail04-mdbox-vdb-append-64kb-8.log |less Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 1 1 6 1/ 1 1 1 6 1/ 1 0 0 9 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 6 1/ 1 0 0 8 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 11 1/ 1 0 0 7 1/ 1 29 3 1093 ms/cmd avg 43 2 1232 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 10 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 7 1/ 1 0 0 9 1/ 1 0 0 6 1/ 1 0 0 11 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 6 1/ 1 0 0 11 1/ 1 0 0 7 1/ 1 0 0 9 1/ 1 0 0 5 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 1063 ms/cmd avg 0 0 1413 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 8 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 6 1/ 1 0 0 10 1/ 1 0 0 7 1/ 1 0 0 11 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 11 1/ 1 0 0 6 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 8 1/ 1 0 0 1077 ms/cmd avg 0 0 1382 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 7 1/ 1 0 0 6 1/ 1 0 0 9 1/ 1 0 0 4 1/ 1 0 0 6 1/ 1 0 0 7 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 5 1/ 1 0 0 9 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 6 1/ 1 0 0 9 1/ 1 0 0 6 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 1246 ms/cmd avg 0 0 1524 ms/cmd avg ... ... ... Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 8 1/ 1 0 0 5 1/ 1 0 0 6 1/ 1 0 0 4 1/ 1 0 0 6 1/ 1 0 0 4 1/ 1 0 0 7 1/ 1 0 0 4 1/ 1 0 0 5 1/ 1 0 0 5 1/ 1 0 0 5 1/ 1 0 0 4 1/ 1 0 0 6 1/ 1 0 0 4 1/ 1 0 0 7 1/ 1 0 0 5 1/ 1 0 0 6 1/ 1 0 0 4 1/ 1 0 0 7 1/ 1 0 0 5 1/ 1 0 0 1596 ms/cmd avg 0 0 2308 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 7 1/ 1 0 0 4 1/ 1 0 0 1583 ms/cmd avg 0 0 4 1/ 1 0 0 2331 ms/cmd avg Totals: Logi Sele Appe Totals: 100% 100% 100% Logi Sele Appe 1 1 1978 100% 100% 100% 1 1 1145

2 2

Re: [FTS Xapian] Beta release
by Tuomi, Aki 14 Jan '19

14 Jan '19

You copied your Makefile.am there. Stephan made you a working version, can you try that? (sorry for dup) Aki -------- Original message --------From: Joan Moreau <jom(a)grosjo.net> Date: 13/01/2019 21:39 (GMT+02:00) To: Stephan Bosch <stephan(a)rename-it.nl> Cc: Aki Tuomi <aki.tuomi(a)open-xchange.com> Subject: Re: [FTS Xapian] Beta release I used the skeleton from Aki : https://github.com/grosjo/fts-xapian However, when I try to act as a visitor, I reach teh follwoing error: # autoreconf -vi autoreconf: Entering directory `.' autoreconf: configure.ac: not using Gettext autoreconf: running: aclocal -I m4 autoreconf: configure.ac: tracing autoreconf: running: libtoolize --copy libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. libtoolize: copying file './ltmain.sh' libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. libtoolize: copying file 'm4/libtool.m4' libtoolize: copying file 'm4/ltoptions.m4' libtoolize: copying file 'm4/ltsugar.m4' libtoolize: copying file 'm4/ltversion.m4' libtoolize: copying file 'm4/lt~obsolete.m4' autoreconf: running: /usr/bin/autoconf autoreconf: running: /usr/bin/autoheader autoreconf: running: automake --add-missing --copy --no-force configure.ac:9: installing './compile' configure.ac:11: installing './config.guess' configure.ac:11: installing './config.sub' configure.ac:7: installing './install-sh' configure.ac:7: installing './missing' src/Makefile.am: installing './depcomp' /usr/share/automake-1.16/am/depend2.am: error: am__fastdepCXX does not appear in AM_CONDITIONAL /usr/share/automake-1.16/am/depend2.am: The usual way to define 'am__fastdepCXX' is to add 'AC_PROG_CXX' /usr/share/automake-1.16/am/depend2.am: to 'configure.ac' and run 'aclocal' and 'autoconf' again src/Makefile.am: error: C++ source seen but 'CXX' is undefined src/Makefile.am: The usual way to define 'CXX' is to add 'AC_PROG_CXX' src/Makefile.am: to 'configure.ac' and run 'autoconf' again. src/Makefile.am:11: warning: variable 'NOPLUGIN_LDFLAGS' is defined but no program or src/Makefile.am:11: library has 'NOPLUGIN' as canonical name (possible typo) autoreconf: automake failed with exit status: 1 On 2019-01-13 20:24, Stephan Bosch wrote: Oh, right, a distribution tarball doesn't include some of the necessary files for your repository like autogen.sh and .gitignore. The attached tarball includes all those and is ready for `git init`. The previous tarball was made with `make distcheck` from this one. Regards, Stephan. Op 13/01/2019 om 20:14 schreef Stephan Bosch: Hi Joan, Op 13/01/2019 om 19:03 schreef Aki Tuomi: Yes, from compiling point of view it is done. Unfortunately what is not done is all the other work involved, such as fixing all the inevitable bugs it has and maintaining it. We do not want, at this moment, take up maintaining and developing yet another FTS plugin as we have plenty of things to do already. I invite you to setup your own repository and provide this plugin from there, being the maintainer of this plugin. We can add a link to your plugin on our FTS page so people can also find it. There are other plugins like this, e.g. https://github.com/st3fan/dovecot-xaps-plugin I turned the code you provided into a separate plugin package. The distribution tarball is attached. Notable changes: - Added example copyright headers and COPYING and AUTHORS files. You should modify those to your preference. - Added README and INSTALL files (in markdown using Pandoc). Those need to be amended with details. - Amended the plugin code to display a debug message with the plugin name and version upon plugin load. I advise you to turn this into a git repository and continue from there. I do not recommend releasing this plugin with the -fpermissive flag and the resulting warning as it is now. But I'm assuming this is still a work in progress, so that is OK. Regards, Stephan. On 13 January 2019 at 19:52 Joan Moreau <jom(a)grosjo.net> wrote: The only point here of this fts-xapian is to get rid of solr (because it is just a nightmare to setup) and squat (because it is considere obsolete). I already sent the changed in configure.ac, makefile.am, etc.. in order to include it in the dovecot, and it compiles properly The only remaining point is to push it in hte git (yes, everything is already done) On 2019-01-13 18:45, Aki Tuomi wrote: On 13 January 2019 at 17:05 Joan Moreau via dovecot <dovecot(a)dovecot.org> wrote: Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated. Configuration is exactly the same as for fts_squat: plugin { plugin = fts fts_xapian (...) fts = xapian fts_autoindex = yes fts_enforced = yes fts_xapian = partial=2 full=20 This is installed on my production server (>120Gb of mailboxes), and I will observe it during the coming days. I will definitely appreciate that this is added in the core git of docevot, in order to have a versionning of it, to remove squat and let basic users able to avoid Solr alternative as much as possible. Thanks JM Hi! I still recommend you setup a, say, github repository for your plugin. We are not able to currently include your work in dovecot core as it is more work than just pushing the code into the repo. Maybe it can be included in the future. If you want, I can help you in setting up the required configuration scripts and such to make it possible to compile it as plugin. Then anyone can download it and install it for their dovecot, even if dovecot itself has been installed from packages, and also makes it possible for package maintainers to consider including it in distributions. Aki

6 22

What does the mdbox_rotate_size influence?
by Marc Roos 14 Jan '19

14 Jan '19

I wondered why mdbox_rotate_size is 2MB by default. I thought if I increased it to 16MB, maybe there would be less disk io, but I dont see any difference. Furthermore I read in some thread that increasing it from 2MB, could give problems when deleting messages, can someone explain this? Does anyone have this on a cephfs mount, does it make sense to set this to 4MB? [@test2 ~]# pr -m -t mail04-mdbox-vdb-append-64kb-4MB-6.log mail04-mdbox-vdb-append-64kb-16MB-7.log |less Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 1 1 6 1/ 1 1 1 8 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 8 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 11 1/ 1 0 0 8 1/ 1 29 3 1093 ms/cmd avg 37 1 1110 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 10 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 9 1/ 1 0 0 10 1/ 1 0 0 11 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 8 1/ 1 0 0 6 1/ 1 0 0 11 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 1063 ms/cmd avg 0 0 1202 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 8 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 7 1/ 1 0 0 11 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 11 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 11 1/ 1 0 0 9 1/ 1 0 0 8 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 7 1/ 1 0 0 1077 ms/cmd avg 0 0 1060 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 7 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 10 1/ 1 0 0 6 1/ 1 0 0 6 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 9 1/ 1 0 0 10 1/ 1 0 0 10 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 9 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 9 1/ 1 0 0 1246 ms/cmd avg 0 0 1138 ms/cmd avg ... ... ... ... 0 0 8 1/ 1 0 0 9 1/ 1 0 0 6 1/ 1 0 0 8 1/ 1 0 0 6 1/ 1 0 0 7 1/ 1 0 0 7 1/ 1 0 0 8 1/ 1 0 0 5 1/ 1 0 0 9 1/ 1 0 0 5 1/ 1 0 0 10 1/ 1 0 0 6 1/ 1 0 0 11 1/ 1 0 0 7 1/ 1 0 0 9 1/ 1 0 0 6 1/ 1 0 0 9 1/ 1 0 0 7 1/ 1 0 0 10 1/ 1 0 0 1596 ms/cmd avg 0 0 1126 ms/cmd avg Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 0 0 7 1/ 1 0 0 8 1/ 1 0 0 1583 ms/cmd avg 0 0 1140 ms/cmd avg Totals: Totals: Logi Sele Appe Logi Sele Appe 100% 100% 100% 100% 100% 100% 1 1 1978 1 1 2021

1 0

mdbox import error from read-only filesystem
by hby 14 Jan '19

14 Jan '19

Dovecot version: 2.2.34 doveadm import tries to call open() on the source indexes/logs of mdbox data, but even if it should work as it is just a read-related call, it fails on read-only filesystems. The main use case for read-only filesystem is restoring from backup: the massive deduplicated backup data is exposed using FUSE. For deduplication to work efficiently, we have to backup the whole mail storage and thus the only way to handle the restore to mount the whole data. I would like to ask for some proper solution for this problem. Suggestions: first, the doveadm import should never modify the indexes, and second: the open() calls should respect the read-only filesystem and should fall back to "r" flag when using open. The problem goes further when using SIS (which goes beyond multiple terrabytes). The only workaround currently is to export the whole mdbox data to a writeable storage, and parametrize the import command to use that and the mounted SIS data separately for import...which is just problematic, ugly and error prune. Thank you for the continous work on dovecot, I hope you get this feedback in a good way.

2 2

Freebsd: Fatal error - Support not compiled in for passdb driver 'sql'
by Graham S. Jarvis 14 Jan '19

14 Jan '19

Hello, I have the following fatal error when I uncomment #!include auth-sql.conf.ext in .../conf.d/10-auth.conf dovecot: auth: Fatal: Support not compiled in for passdb driver 'sql' I have installed via 'pkg'. Do I have to install the ports tree to get sql support ? Thanks, -Graham-

4 9

managesieve configuration
by Dominik Menke 14 Jan '19

14 Jan '19

Hello list, I'm trying to get pidgeonhole/managesieve running, and I'm stuck connecting clients to the server (Dovecot 2.2.33.2-1ubuntu4.1 on an Ubnutu 18.04 machine). So far, my config looks like this: protocols = imap lmtp sieve disable_plaintext_auth = yes auth_mechanisms = plain login scram-sha-1 service managesieve-login { inet_listener sieve { port = 4190 ssl = yes } service_count = 1 } service managesieve { process_limit = 256 } protocol sieve { managesieve_max_line_length = 65536 } (please let me know if you need more details). When I connect via openssl s_client -connect $myserver:4190 I get the following prompt (after the usual certificate prompt): "IMPLEMENTATION" "Dovecot (Ubuntu) Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN SCRAM-SHA-1" "VERSION" "1.0" OK "Dovecot (Ubuntu) ready." and I can login successfully: AUTHENTICATE "PLAIN" "base64(0x00 $user 0x00 $password)" OK "Logged In." Note how this is different from the troubleshooting guide [1], which suggests gnutls-bin and waiting for the STARTTLS capability before hitting Ctrl-D. This is what I get with gnutls-bin: $ gnutls-cli --starttls --insecure -p 4190 $myserver Processed 0 CA certificate(s). Resolving '$myserver:4190'... Connecting to '$myserverip:4190'... - Simple Client Mode: _ where "_" denotes the waiting prompt. When I hit Ctrl-D here, I get an output similar that of s_client. Now, my problem are the clients: neither Thunderbird's sieve extenstion [2], nor the Ruby ManageSieve class [3], nor Roundcube's managesieve plugin [4] (via Net_Sieve module [5]) are able to communicate with my server. They all wait for a "STARTTLS" line, before they attempt to perform a TLS handshake. This leads me to my question: How do I force Dovecot to print at least a STARTTLS line after a client connects to port 4190? Looking Kind regards, Dominik [1]: https://wiki.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting#Manual_TLS_… [2]: https://github.com/thsmi/sieve [3]: https://www.rubydoc.info/gems/ruby-managesieve/0.4.3/ManageSieve [4]: https://github.com/roundcube/roundcubemail/tree/1.3.8/plugins/managesieve [5]: http://pear.php.net/package/Net_Sieve/docs/1.3.4/Net_Sieve/Net_Sieve.html

4 11

degfault imaptest
by Marc Roos 14 Jan '19

14 Jan '19

imaptest host=mail04.local port=143 user=xxx pass=xxx mbox=test.mbox [Fri Jan 11 15:09:14 2019] imaptest[7634]: segfault at 1354ff0 ip 0000000001354ff0 sp 00007ffed5d8f558 error 15 [Fri Jan 11 15:09:22 2019] imaptest[7635]: segfault at 2267ff0 ip 0000000002267ff0 sp 00007ffee5890308 error 15 [Fri Jan 11 15:10:47 2019] imaptest[7648]: segfault at 10e6ff0 ip 00000000010e6ff0 sp 00007ffedbb19f98 error 15 CentOS Linux release 7.6.1810 (Core) imaptest-20151005-1.el7.x86_64 Linux test2 3.10.0-957.1.3.el7.x86_64 #1 SMP Thu Nov 29 14:49:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

3 4

Indexing paralelism
by Joan Moreau 14 Jan '19

14 Jan '19

Hi Observing the processes of FTS, I observe the following: 1 - For one user, indexer-wroker does not start several threads for each request. On teh contrary, it waits for the first request to finish before starting the second. How to make sure all requests (or a limited number of it, for instance linked to the CPU number on the machine) are started asap ? 2 - If a IMAP query is received, the dovecot checks the last UID from FTS and launch a request of indexing to finish the index *before* running the search query . THis creates timeouts (and can take a while if many request are pending - see point 1) How to prevent that (i.e. the serach request is launched (read only) no matter what ? THe completeion of missing UIDs is launched in a separate thread ? Thank you

2 1

[FTS Xapian] Beta release
by Joan Moreau 13 Jan '19

13 Jan '19

Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated. Configuration is exactly the same as for fts_squat: plugin { plugin = fts fts_xapian (...) fts = xapian fts_autoindex = yes fts_enforced = yes fts_xapian = partial=2 full=20 This is installed on my production server (>120Gb of mailboxes), and I will observe it during the coming days. I will definitely appreciate that this is added in the core git of docevot, in order to have a versionning of it, to remove squat and let basic users able to avoid Solr alternative as much as possible. Thanks JM

2 9

[FTS Xapian] Beta release
by Joan Moreau 13 Jan '19

13 Jan '19

Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated. Configuration is exactly the same as for fts_squat: plugin { plugin = fts fts_xapian (...) fts = xapian fts_autoindex = yes fts_enforced = yes fts_xapian = partial=2 full=20 This is installed on my production server, and I will observe it during the coming days. I will definitely appreciate that this is added in the core git of docevot, in order to have a versionning of it, to remove squat and let basic users able to avoid Solr alternative as much as possible. THanks JM

1 0

Issue with LMTP proxying and port number
by Laz C. Peterson 13 Jan '19

13 Jan '19

Hello there, Everything was working fine on Dovecot 2.2.10 (on CentOS 7), but after updating to version 2.2.36, our director servers are not able to proxy LMTP. We are sending mail from exim to the local Dovecot LMTP socket, which then used to send it to our internal mail servers on port 24. Besides the update, nothing has changed in the config files. The configuration has been working great for months … Then we had a great idea of doing holiday maintenance. (Currently, we are working around this issue by having exim send mail to the IP and port, instead of the socket.) Doing a tcpdump capture shows no TCP traffic either. The logs seem to say that it is trying to go to port 0, so my guess is that it’s not getting the port directive from either static or sql — since the docs state that if these settings aren't specified, it will always use the same connection type for the proxy that it received the connection on. Any thoughts? I can share config if necessary. ~ Laz Peterson Paravis, LLC

3 5

Dovecot Submission Proxy Auth
by Paul Hecker 12 Jan '19

12 Jan '19

Hi, Dovecot 2.3.1 (8e2f634). Could not get Dovecot to forward the (plain) authentication to the SMTP server using submission. Reason why I need it is sender spoofing (do not want my employees to send messages in behalf of me). In exim I can disable sender spoofing with the authenticated user. When sending through dovecot, exim either does not accept the email (need auth) or relay every sender address (because relaying from localhost). Am I missing a setting or do I need any additional field in the (MySQL) user_query/password_query to forward the password? You can find my config here: https://gist.github.com/lluuaapp/7daddf761131da47237b0f45e6bab5a8 Thanks, Paul

5 12

Fatal: master: service(indexer-worker): child 493 killed with signal 11 (core dumped)
by Tim Mohlmann 12 Jan '19

12 Jan '19

Dear list, We been having some issues where the indexer-worker is crashing. This happens on production servers which are handling a slight amount of mail, but is also reproducible by moving messages. Also, users on my server are complaining about "Trashed" items coming back etc. Some details: - Dovecot 2.3.2.1 in alpine:3.8 based Docker container. As part of the Mailu distribution. (https://github.com/Mailu/Mailu) - I've first seen this issues on my production server, which stores mail on GlusterFS - I've been able to reproduce running the Docker container on a Virtual machine, using local storage. - There is another Mailu user reporting the same problem on a different VM provider / disk infrastructure: https://github.com/Mailu/Mailu/issues/751 - Libc: musl-1.1.19-r10 Output of dovecot -n: # dovecot -n # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) # OS: Linux 4.16.3-301.fc28.x86_64 x86_64 ext4 # Hostname: 98a2726271d3 auth_mechanisms = plain login disable_plaintext_auth = no first_valid_gid = 8 first_valid_uid = 8 hostname = mail.usrpro.io log_path = /dev/stderr mail_access_groups = mail mail_gid = mail mail_home = /mail/%u mail_location = maildir:/mail/%u mail_plugins = " fts fts_lucene quota quota_clone zlib" mail_privileged_group = mail mail_uid = mail mail_vsize_bg_after_count = 100 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus editheader imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/auth.conf driver = dict } plugin { fts = lucene fts_autoindex = yes fts_autoindex_exclude = \Junk fts_lucene = whitespace_chars=@. imapsieve_mailbox1_before = file:/conf/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/conf/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * quota = count:User quota quota_clone_dict = proxy:/tmp/podop.socket:quota quota_vsizes = yes sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = dict:proxy:/tmp/podop.socket:sieve sieve_execute_bin_dir = /conf/bin sieve_extensions = +spamtest +spamtestplus +editheader sieve_global_extensions = +vnd.dovecot.execute sieve_plugins = sieve_imapsieve sieve_extprograms sieve_spamtest_max_value = 15 sieve_spamtest_status_header = X-Spam-Level sieve_spamtest_status_type = strlen sieve_vacation_dont_check_recipient = yes sieve_vacation_send_from_recipient = yes } postmaster_address = admin(a)usrpro.io protocols = imap pop3 lmtp sieve service auth-worker { unix_listener auth-worker { group = mail mode = 0660 user = dovecot } user = mail } service auth { user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { inet_listener lmtp { port = 2525 } } service managesieve-login { inet_listener sieve { port = 4190 } } submission_host = 192.168.203.6 userdb { args = /etc/dovecot/auth.conf driver = dict } protocol imap { mail_plugins = " fts fts_lucene quota quota_clone zlib imap_quota imap_sieve" } protocol lmtp { mail_plugins = " fts fts_lucene quota quota_clone zlib sieve" recipient_delimiter = + } And the actual error log: imap_1 | Dec 19 16:31:08 indexer-worker(admin(a)usrpro.io)<490><m+t5VmJ93K7AqMsG:grc9HUxyGlzqAQAANEhNiw>: Fatal: master: service(indexer-worker): child 490 killed with signal 11 (core dumped) imap_1 | Dec 19 16:31:09 indexer-worker(admin(a)usrpro.io)<493><m+t5VmJ93K7AqMsG:HRLEK0xyGlztAQAANEhNiw>: Error: lucene index /mail/admin(a)usrpro.io/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out imap_1 | Dec 19 16:31:09 indexer-worker(admin(a)usrpro.io)<493><m+t5VmJ93K7AqMsG:HRLEK0xyGlztAQAANEhNiw>: Error: Mailbox INBOX: Mail search failed: Internal error occurred. Refer to server log for more information. [2018-12-19 16:31:08] imap_1 | Dec 19 16:31:09 indexer-worker(admin(a)usrpro.io)<493><m+t5VmJ93K7AqMsG:HRLEK0xyGlztAQAANEhNiw>: Error: Mailbox INBOX: Transaction commit failed: FTS transaction commit failed: backend deinit (attempted to index 1 messages (UIDs 1299..1299)) imap_1 | Dec 19 16:31:10 indexer-worker(admin(a)usrpro.io)<493><m+t5VmJ93K7AqMsG:GKWdMU1yGlztAQAANEhNiw>: Fatal: master: service(indexer-worker): child 493 killed with signal 11 (core dumped) imap_1 | Dec 19 16:31:10 indexer: Error: Indexer worker disconnected, discarding 1 requests for admin(a)usrpro.io imap_1 | Dec 19 16:31:11 indexer-worker(admin(a)usrpro.io)<494><m+t5VmJ93K7AqMsG:MRCzBE5yGlzuAQAANEhNiw>: Error: lucene index /mail/admin(a)usrpro.io/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out imap_1 | Dec 19 16:31:11 indexer-worker(admin(a)usrpro.io)<494><m+t5VmJ93K7AqMsG:MRCzBE5yGlzuAQAANEhNiw>: Error: Mailbox INBOX: Mail search failed: Internal error occurred. Refer to server log for more information. [2018-12-19 16:31:10] imap_1 | Dec 19 16:31:11 indexer-worker(admin(a)usrpro.io)<494><m+t5VmJ93K7AqMsG:MRCzBE5yGlzuAQAANEhNiw>: Error: Mailbox INBOX: Transaction commit failed: FTS transaction commit failed: backend deinit (attempted to index 1 messages (UIDs 1310..1310)) imap_1 | Dec 19 16:31:11 indexer: Error: Indexer worker disconnected, discarding 1 requests for admin(a)usrpro.io I managed to find a core dump file, which appeared outside of the container. So I copied it back in, installed and ran gdb: GNU gdb (GDB) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-alpine-linux-musl". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/indexer-worker...(no debugging symbols found)...done. [New LWP 1075] warning: Can't read pathname for load map: No error information. Core was generated by `dovecot/indexer-worker'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007fbd9a31c11a in free () from /lib/ld-musl-x86_64.so.1 So this seems musl related. I installed musl-dbg and ran again: GNU gdb (GDB) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-alpine-linux-musl". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/indexer-worker...(no debugging symbols found)...done. [New LWP 1075] warning: Can't read pathname for load map: No error information. Core was generated by `dovecot/indexer-worker'. Program terminated with signal SIGSEGV, Segmentation fault. #0 a_crash () at ./arch/x86_64/atomic_arch.h:108 108 ./arch/x86_64/atomic_arch.h: No such file or directory. Now I'm kinda lost in space. I don't know where that header file is. Tried running "find" on the filesystem and a google search. But nothing specific showed up. I am starting to feel this bug is more musl related than Dovecot. Since this has bitten our project more in the past, I'm considering to move the project to Debian based images. But I want to be 100% sure this is not a dovecot bug. Note, earlier I created an image with Alpine:edge with musl 1.1.20-r2 and Dovecot 2.3.3. Running that image I saw the same error symptoms (Was just a hopeful trail and error). I did not do any debugging on that one. Thanks in advance! Tim

5 11

Enable compression only for namespace with mdbox storage
by Marc Roos 11 Jan '19

11 Jan '19

I have a namespace with mbox and a namespace with mdbox mailboxes. How do I only enable the compression for the mdbox mailboxes?

2 3

repo.dovecot.org expired certificate
by Filipe Carvalho 10 Jan '19

10 Jan '19

Hello, Not sure if this is the right place to post this, but the ssl certificate of the repo.dovecot.org server expired on the 9th of January. It's giving an error via the browser and via the apt command in Debian: W: Failed to fetch https://repo.dovecot.org/ce-2.3-latest/debian/jessie/dists/jessie/main/bina… server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none Cheers! Filipe Carvalho -- UP Digital Filipe Carvalho Infraestruturas Tecnológicas / IT infrastructures filipec(a)uporto.pt <mailto:filipec@uporto.pt>

4 5

BUG: cannot move messages to root mailfolder in namespace "There can be only one namespace with inbox=yes"
by Marc Roos 09 Jan '19

09 Jan '19

I can only move messages to a root namespace folder when specifying inbox=yes. That is strange because it is not even the inbox. I don't even get why it is not by default possible, maybe bug there? You have made the mistake of overloading the use of a parameter inbox=yes (or not creating a parameter to tell folder can be used to move messages to), there is indeed only one folder that gets incoming messages delivered to, and that is the inbox=yes. You should have created a 2nd parameter specifying if a folder should be allowed to store mail. (I have been running this dovecot server for 20 years or so, and I am really surprised about still running into issues on such basic things as trying to put folders onto different storage. Not to mention the lack of help you can get here. Is there some roadmap, features implementation overview available? Can you make public issues on github?)

3 8

File permissions
by Rupert Gallagher 09 Jan '19

09 Jan '19

Hello, I am mosty done with the upgrade, but there is a problem that keeps me awake at night: file ownership and permissions. It would be most helpful to have the following from Aki's live system: ls -halFR /var/run/dovecot

2 2

RE: Dovecot (doveadm, ssl, sync) - SSL error
by Arkadiusz Majewski 08 Jan '19

08 Jan '19

Hello! dsync SSL still doesn't work for replication, so I've disabled it and tried to sync without. But I have a problem with temp directory. Is it possible to change path to temp folder? I don't want to set permissions but change temporary folder for replication. Thanks in advance. dovecot: doveadm: Error: safe_mkstemp(/tmp/dovecot.doveadm.) failed: Permission denied Arkadiusz Majewski From: Arkadiusz Majewski <majewsa(a)gmail.com> Sent: Sunday, December 3, 2017 7:38 PM To: 'dovecot(a)dovecot.org' <dovecot(a)dovecot.org> Subject: Dovecot (doveadm, ssl, sync) - SSL error Hello! I've got a problem to run syncing between both dovecot services on the separate servers. The error indicates to the problem with SSL. Directly using openssl command to connect from one server to other and vice versa is passed without any errors. OS: FreeBSD 11.1-RELEASE-p4 Dovecot: 2.2.33.2_2 and the older one dovecot-2.2.32.1_1 (or similar) - build by ports. OpenSSL: 1.0.2k-freebsd 26 Jan 2017 dovecot: doveadm(10.18.1.15): Error: doveadm client disconnected before handshake: SSL_accept() failed: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol dovecot.conf (on both servers): mail_plugins = $mail_plugins notify replication service replicator { process_min_avail = 1 } service aggregator { fifo_listener replication-notify-fifo { user = dovecot } unix_listener replication-notify { user = dovecot } } service replicator { unix_listener replicator-doveadm { mode = 0600 } } replication_max_conns = 10 service doveadm { inet_listener { port = 12130 ssl = yes } } ssl = required ssl_protocols = SSLv3 TLSv1 TLSv1.1 TLSv1.2 ssl_cert = </usr/local/etc/dovecot/ssl/cert.crt ssl_key = </usr/local/etc/dovecot/ssl/cert.key ssl_client_ca_file = </usr/local/etc/dovecot/ssl/ca.pem ssl_client_ca_dir = /usr/local/etc/dovecot/ssl Thank you in advance for any help. Kind Regards, Arkadiusz Majewski

2 1

Permission error on stats writer
by Matt Simpson 08 Jan '19

08 Jan '19

I’m running Dovecot 2.3.4 on FreeBSD 11.2 with qmail. In my mail log, I see messages like this on every delivery Jan 8 10:30:02 v1 qmail: 1546961402.314222 delivery 533: success: lda(matt,)Error:_net_connect_unix(/var/run/dovecot/stats-writer)_failed:_Permission_denied/did_0+0+1/ Searching for this error, I found a message on a support forum for a different server that suggested adding this to dovecot.conf: service stats { unix_listener stats-reader { user = vmail group = vmail mode = 0660 } unix_listener stats-writer { user = vmail group = vmail mode = 0660 } } The person reporting the error said that this corrected it. But since I’m running qmail, I have no vmail user/group. I’m guessing that I need to replace user/group with the values that some mail delivery process is running with. I’ve tried a couple of things with no success. Any ideas? $ doveconf -n # 2.3.4 (0ecbaf23d): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 (60b0f48d) # OS: FreeBSD 11.2-RELEASE-p7 amd64 # Hostname: v1.redhorse.me auth_stats = yes auth_verbose = yes default_vsz_limit = 128 M lock_method = flock mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.pipe vnd.dovecot.execute namespace inbox { inbox = yes location = prefix = } passdb { args = imap driver = pam } plugin { recipient_delimiter = - sieve = file:~/sieve;active=~/.dovecot.sieve sieve_execute_bin_dir = /usr/local/lib/dovecot/sieve-pipe sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve-pipe sieve_pipe_exec_timeout = 10s sieve_plugins = sieve_extprograms } postmaster_address = postmaster(a)redhorse.me protocols = imap service auth { unix_listener auth-master { group = qnofiles mode = 0660 user = alias } user = root } service imap-login { process_min_avail = 3 vsz_limit = 94 M } ssl_cert = </usr/local/etc/letsencrypt/live/bitchpack.us-0001/fullchain.pem ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes syslog_facility = local0 userdb { driver = passwd } verbose_proctitle = yes protocol lda { mail_plugins = " sieve" } ls -l /var/run/dovecot total 20 srw------- 1 root wheel 0 Jan 8 10:29 anvil srw------- 1 root wheel 0 Jan 8 10:29 anvil-auth-penalty srw------- 1 dovecot wheel 0 Jan 8 10:29 auth-client srw------- 1 dovecot wheel 0 Jan 8 10:29 auth-login srw-rw---- 1 alias qnofiles 0 Jan 8 10:29 auth-master -rw------- 1 root wheel 32 Jan 8 10:29 auth-token-secret.dat srw-rw-rw- 1 dovecot wheel 0 Jan 8 10:29 auth-userdb srw------- 1 dovecot wheel 0 Jan 8 10:29 auth-worker srw------- 1 root wheel 0 Jan 8 10:29 config srw-rw---- 1 root dovecot 0 Jan 8 10:29 dict srw-rw---- 1 root dovecot 0 Jan 8 10:29 dict-async srw------- 1 root wheel 0 Jan 8 10:29 director-admin srw-rw-rw- 1 root wheel 0 Jan 8 10:29 dns-client srw------- 1 root wheel 0 Jan 8 10:29 doveadm-server lrwx------ 1 root wheel 35 Jan 8 10:29 dovecot.conf -> /usr/local/etc/dovecot/dovecot.conf drwxr-xr-x 2 root wheel 512 Jan 8 10:29 empty srw-rw---- 1 root dovecot 0 Jan 8 10:29 imap-hibernate srw------- 1 root wheel 0 Jan 8 10:29 imap-master srw-rw-rw- 1 root wheel 0 Jan 8 10:29 imap-urlauth srw------- 1 dovecot wheel 0 Jan 8 10:29 imap-urlauth-worker srw-rw-rw- 1 root wheel 0 Jan 8 10:29 indexer srw------- 1 dovecot wheel 0 Jan 8 10:29 indexer-worker srw------- 1 dovecot wheel 0 Jan 8 10:29 ipc srw------- 1 root wheel 0 Jan 8 10:29 log-errors drwxr-x--- 2 root dovenull 512 Jan 8 10:29 login srw------- 1 root wheel 0 Jan 8 10:29 master -rw------- 1 root wheel 6 Jan 8 10:29 master.pid srw------- 1 root wheel 0 Jan 8 10:29 old-stats prw------- 1 root wheel 0 Jan 8 10:29 old-stats-mail prw------- 1 root wheel 0 Jan 8 10:29 old-stats-user srw------- 1 root wheel 0 Jan 8 10:29 replication-notify prw------- 1 root wheel 0 Jan 8 10:29 replication-notify-fifo srw------- 1 dovecot wheel 0 Jan 8 10:29 replicator srw------- 1 root wheel 0 Jan 8 10:29 stats-reader srw-rw---- 1 root dovecot 0 Jan 8 10:29 stats-writer drwxr-x--- 2 root dovenull 512 Jan 8 10:29 token-login

2 1