December 2018 - dovecot

auth: Error - Request timed out
by Hajo Locke 01 Feb '19

01 Feb '19

Hello List, i use dovecot 2.2.22 and have the same problem described here: https://dovecot.org/pipermail/dovecot/2017-November/110020.html I can confirm that sometimes there is a problem with connection to mysql-db, but sometimes not. Reasons for failing are still under investigation by my mates. My current main problem is, that this fail seems to be a one way ticket for dovecot. Even if mysql is verifyable working again and waiting for connection dovecot stucks furthermore with errors like this: May 29 07:00:49 hostname dovecot: auth: Error: plain(mail(a)example.com,xxx.xxx.xx.xxx,<HGI4FVFt2Oy80j3P>): Request 999.7 timed out after 150 secs, state=1 When restarting dovecot all is immediately working again. Is there a way to tell dovecot to restart auth services or reinitialize mysql-connection after these hard fails? I could insert "idle_kill = 1 mins" into service auth and service auth-worker, but i dont know if this would work. Unfortunately i am not able to reproduce this error and there are always a couple of days between errors. Thanks, Hajo

4 6

v2.3.4 released
by Timo Sirainen 30 Jan '19

30 Jan '19

https://dovecot.org/releases/2.3/dovecot-2.3.4.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.4.tar.gz.sig Binary packages in https://repo.dovecot.org/ * The default postmaster_address is now "postmaster@<user domain or server hostname>". If username contains the @domain part, that's used. If not, then the server's hostname is used. * "doveadm stats dump" now returns two decimals for the "avg" field. + Added push notification driver that uses a Lua script + Added new SQL, DNS and connection events. See https://wiki2.dovecot.org/Events + Added "doveadm mailbox cache purge" command. + Added events API support for Lua scripts + doveadm force-resync -f parameter performs "index fsck" while opening the index. This may be useful to fix some types of broken index files. This may become the default behavior in a later version. - director: Kicking a user crashes if login process is very slow - pop3_no_flag_updates=no: Don't expunge DELEted and RETRed messages unless QUIT is sent. - auth: Fix crypt() segfault with glibc-2.28+ - imap: Running UID FILTER script with errors assert-crashes - dsync, pop3-migration: POP3 UIDLs weren't added to dovecot.index.cache while mails were saved. - dict clients may have been using 100% CPU while waiting for dict server to finish commands. - doveadm user: Fixed user listing via HTTP API - All levels of Cassandra log messages were logged as Dovecot errors. - http/smtp client may have crashed after SSL handshake - Lua auth converted strings that looked like numbers into numbers.

18 145

doveadm proxy list repeats header line
by Michael Goth 20 Jan '19

20 Jan '19

Hi all, just a minor thing: Why does `doveadm proxy list` repeat the header line after each entry? Too me, that just makes the output harder to read. So instead of this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 I'd prefer this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 The repeated header lines also happen with other formatters. Regards, Michael

3 3

Panic…
by SH Development 20 Jan '19

20 Jan '19

I have started getting these in my log. What does this mean and what do I need to do? Panic: file mail-index-util.c: line 37 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) Dec 12 23:29:44 mail dovecot: imap(jeff(a)stariontech.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x3cafa) [0x7f38c5a2cafa] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3cb46) [0x7f38c5a2cb46] -> /usr/lib64/dovecot/libdovecot.so.0(+0x16e2a) [0x7f38c5a06e2a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x74) [0x7f38c5d0d3f4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x81abd) [0x7f38c5cf3abd] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_cache_compress+0x77) [0x7f38c5cf4247] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x1d2) [0x7f38c5d08012] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5fd88) [0x7f38c5cd1d88] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x570a0) [0x7f38c5cc90a0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_force+0x52) [0x7f38c5cc94c2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_file_do+0x99) [0x7f38c5cc9f49] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x59b7f) [0x7f38c5ccbb7f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_set_seq+0x112) [0x7f38c5cb64f2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x16b) [0x7f38c5cbae9b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x20) [0x7f38c5ca2240] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x26) [0x7f38c5ca2296] -> dovecot/imap(imap_fetch_more+0x2bf) [0x41221f] -> dovecot/imap(cmd_fetch+0x42c) [0x40a33c] -> dovecot/imap() [0x40f90d] -> dovecot/imap() [0x40f9fa] -> dovecot/imap(client_handle_input+0x135) [0x40fc25] -> dovecot/imap(client_input+0x5f) [0x41054f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f38c5a37e98] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f38c5a38e0f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f38c5a37e28] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f38c5a26293] -> dovecot/imap(main+0x2f9) [0x418849] -> /lib64/libc.so.6(__libc_start_main+0x10 Dec 12 23:29:44 mail dovecot: master: Error: service(imap): child 11157 killed with signal 6 (core dumps disabled)

6 5

I never touched nuthin'
by mick crane 20 Jan '19

20 Jan '19

hello, do you mind if I ask before I start poking about ? suddenly I notice that gmail is ignoring or because there is an error getmail is not sending the delete request. Mails are sent and received but not deleted gmail so I keep getting them. mick@rapunzel:~/.getmail$ getmail --rcfile getmailrc1 Delivery error (command deliver 1363 wrote to stderr: lda(mick,)Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: Permission denied) I think is apt install dovecot on debian buster probably I updated yesterday but was working OK since so I dunno what happened. is log full or something ? advices appreciated mick -- Key ID C7D6E24C

4 6

2.3.4 doesnt compile on FreeBSD 11.2 using clang
by Chris 20 Jan '19

20 Jan '19

extract below, this has already been reported a while back but still no new patch, so this email is to serve as a reminder, if someone manually fixes it for the ports tree, I dont consider that a fix, ideally we need this fixed in the source code, as not everyone will install it from ports. Chris "clang40 -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-test -I../../src/lib-settings -I../../src/lib-ssl-iostream -DPKG_RUNDIR=\""/var/run/dovecot"\" -DPKG_STATEDIR=\""/var/lib/dovecot"\" -DSYSCONFDIR=\""/etc/dovecot"\" -DBINDIR=\""/usr/bin"\" -I/usr/local/include -std=gnu99 -fdiagnostics-color -Wl,-rpath=/usr/local/llvm40/lib -O2 -pipe -march=native -fno-strict-aliasing -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -I/usr/local/include -MT test-event-stats.o -MD -MP -MF .deps/test-event-stats.Tpo -c -o test-event-stats.o test-event-stats.c clang-4.0: warning: -Wl,-rpath=/usr/local/llvm40/lib: 'linker' input unused [-Wunused-command-line-argument] test-event-stats.c:101:8: warning: implicit declaration of function 'kill' is invalid in C99 [-Wimplicit-function-declaration] (void)kill(stats_pid, SIGKILL); ^ test-event-stats.c:101:24: error: use of undeclared identifier 'SIGKILL' (void)kill(stats_pid, SIGKILL); ^ 1 warning and 1 error generated. gmake[2]: *** [Makefile:656: test-event-stats.o] Error 1 gmake[2]: Leaving directory '/usr/local/directadmin/custombuild/dovecot-2.3.4/src/lib-master' gmake[1]: *** [Makefile:565: install-recursive] Error 1 gmake[1]: Leaving directory '/usr/local/directadmin/custombuild/dovecot-2.3.4/src' gmake: *** [Makefile:683: install-recursive] Error 1"

7 7

Re: Localhost imap server fails after upgrade from 2.2.33.2-1 to 1:2.3.2.1 (fwd)
by Chris BL 20 Jan '19

20 Jan '19

Hi Aki, Oops; I did not think carefully enough about your instructions. Here is the output from $ dovecot -n -c /home/meuser/dotfiles/auto-stanford-dovecot.conf # 2.3.2.1 (0719df592): /home/meuser/dotfiles/auto-stanford-dovecot.conf # Pigeonhole version 0.5.2 () # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 ext4 # Hostname: cpbl-t450s doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX service stats { unix_listener stats-writer { mode = 0666 } } ssl_dh = # hidden, use -P to show it verbose_proctitle = yes I then followed the instructions in the Warning lines above and now I get: dovecot -n -c /home/meuser/dotfiles/auto-stanford-dovecot.conf # 2.3.2.1 (0719df592): /home/meuser/dotfiles/auto-stanford-dovecot.conf # Pigeonhole version 0.5.2 () # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 ext4 # Hostname: cpbl-t450s mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX service stats { unix_listener stats-writer { mode = 0666 } } ssl_dh = # hidden, use -P to show it verbose_proctitle = yes However, this does not help my primary symptom: $ /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-stanford-dovecot.conf imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] Logged in as meuser Thanks! Chris On Mon, Dec 31, 2018 at 10:27 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: Did you remove the service section before taking doveconf -n? 'cos I can't see it here.. Also, did you restart dovecot after config change? Aki > On 31 December 2018 at 16:54 Chris BL <cpblpublic+dovecot(a)gmail.com> wrote: > > > Hi Aki, > > Yes, the same connect error: imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied > > The mail location in "doveconf -n" (belo) does not reflect my preferences. > > In Alpine, if I acknowledge the error I get, which tells me to add > novalidate-cert in my pinerc file, it prompts me for my POSIX username and > password. After that, I get my /var/spool/mail inbox, which is not what I > want. > > > doveconf -n > # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.2 () > # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 > # Hostname: myhost-t450s > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > protocols = " imap" > ssl_cert = </etc/dovecot/private/dovecot.pem > ssl_client_ca_dir = /etc/ssl/certs > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > userdb { > driver = passwd > } > > > > On Mon, 31 Dec 2018, Aki Tuomi wrote: > > > You are still getting the connect error? > > > > Can you share your doveconf -n? > > > > Aki > > > > > On 31 December 2018 at 16:42 cpblpublic+dovecot(a)gmail.com wrote: > > > > > > > > > Hi Aki, > > > > > > Thanks. I put that in the .conf file I mentioned, and it made no > > > difference. > > > > > > Chris > > > > > > > Hi! > > > > > > > > In your case it's probably easiest to change > > > > > > > > service stats { > > > > unix_listener stats-writer { > > > > mode = 0666 > > > > } > > > > } > > > > > > > > Aki > > > > > > > > > On 31 December 2018 at 16:05 cpblpublic+dovecot(a)gmail.com wrote: > > > > > > > > > > > > > > > > > > > > I use a localhost dovecot imap server in order to access maildir folders from Alpine (see 2009 instructions for my set up here > > > > > https://cpbl.wordpress.com/2009/11/07/alpine-offlineimap-and-gmail-under-ub… ) > > > > > > > > > > My configuration has worked nicely since 2009, but failed after a recent upgrade of dovecot (during basic upgrade from Ubuntu 18.04 to 18.10). > > > > > > > > > > The version of Alpine did not change. Uninstalling dovecot-core and dovecot-imapd, and reinstalling the older versions, fully fixes the problem. > > > > > > > > > > I would like to know how to get my configuration working with the new version of dovecot. > > > > > > > > > > Here's what the problem looks like: > > > > > > > > > > I have a file auto-dovecot.conf with only the following two lines. > > > > > > > > > > verbose_proctitle = yes > > > > > mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX > > > > > > > > > > Other /etc/ files are unchanged from installation defaults. > > > > > > > > > > Alpine calls imapd when it starts, with the following command: > > > > > > > > > > /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-dovecot.conf > > > > > > > > > > > > > > > When I run that command, I get: > > > > > > > > > > imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied > > > > > * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > > > > > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > > > > > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > > > > > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > > > > > CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] > > > > > Logged in as meuser > > > > > > > > > > > > > > > > > > > > > > > > > so I am guessing that the first line is the issue, since when the older version I get instead: > > > > > > > > > > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > > > > > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > > > > > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > > > > > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > > > > > CONTEXT=SEARCH LIST-STATUS BINARY MOVE] Logged in as meuser > > > > > > > > > > > > > > > Can anyone help me? I cannot find documentation for using a localhost server for Alpine, except my own from 2009. > > > > > > > > > > Many thanks! > > > > > > > > > > Chris > > > > > >

3 6

Request: Pigeonhole - strip CWFS from message-id logs
by Lee Maguire 20 Jan '19

20 Jan '19

Normally for a log line containing the contents of a Message-Id, it is logged like the following Nov 29 11:41:27 xxx dovecot[211]: lmtp(lee)<30167><XXXXX>: sieve: msgid=<xxxx(a)example.net>: stored mail into mailbox 'Notifications' However, if there is CFWS other than a space, it changes the format of the log line (potentially making the logs harder to process - eg via “logcheck" rules) Nov 29 11:50:09 xxx dovecot[401]: lmtp(lee)<55724><XXXXX>: sieve: msgid=? <xxxx(a)example.com>: stored mail into mailbox ‘Notifications' A message-id line broken up is valid per RFC 5322 and header whitespace shouldn’t be significant for logging purposes https://tools.ietf.org/html/rfc5322#section-3.6.4 https://tools.ietf.org/html/rfc5322#section-3.2.2

2 2

Re: Dovecot 2.3.4 crash
by Timo Sirainen 20 Jan '19

20 Jan '19

On 2 Dec 2018, at 22.22, Guillaume via dovecot <dovecot(a)dovecot.org> wrote: > > I also have this kind of segfault since the update : > > Dec 2 21:12:11 xxxxxxx dovecot: auth-worker: Error: *** Error in `dovecot/auth': double free or corruption (fasttop): 0x000055573bb99f70 Is this easy to reproduce? Can you try with valgrind? It will slow down the logins a bit though. service auth-worker { executable = /usr/bin/valgrind -q --vgdb=no /usr/lib/dovecot/auth -w } At least one good thing about this crash is that it seems to happen only at deinit, so it's not impacting users.

4 6

Localhost imap server fails after upgrade from 2.2.33.2-1 to 1:2.3.2.1
by cpblpublic+dovecot＠gmail.com 20 Jan '19

20 Jan '19

I use a localhost dovecot imap server in order to access maildir folders from Alpine (see 2009 instructions for my set up here https://cpbl.wordpress.com/2009/11/07/alpine-offlineimap-and-gmail-under-ub… ) My configuration has worked nicely since 2009, but failed after a recent upgrade of dovecot (during basic upgrade from Ubuntu 18.04 to 18.10). The version of Alpine did not change. Uninstalling dovecot-core and dovecot-imapd, and reinstalling the older versions, fully fixes the problem. I would like to know how to get my configuration working with the new version of dovecot. Here's what the problem looks like: I have a file auto-dovecot.conf with only the following two lines. verbose_proctitle = yes mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX Other /etc/ files are unchanged from installation defaults. Alpine calls imapd when it starts, with the following command: /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-dovecot.conf When I run that command, I get: imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] Logged in as meuser so I am guessing that the first line is the issue, since when the older version I get instead: * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE] Logged in as meuser Can anyone help me? I cannot find documentation for using a localhost server for Alpine, except my own from 2009. Many thanks! Chris

5 9