- dovecot - dovecot.org

Garbled mails in Maildir storage
by Florian Lohoff 25 Jan '19

25 Jan '19

Hi, from time to time i am having mails delivered to my anon maildrop which completely break mailbox listing. I ignored it mostly as this is an anon maildrop for one time emails so loosing spam wasnt an issue. Today i had a mailbox which wouldnt list at all which was caused by 50 consecutive mails beeing broken. (I am showing the last 20 in the web interface) After some debugging i found a bunch of mails like this: Return-Path: <*************************> X-Original-To: test(a)wasteland.rfc822.org Delivered-To: inbox(a)wasteland.rfc822.org Received: from node11.tmdvps.com (unknown [184.154.211.109]) by pax.zz.de (Postfix) with SMTP id 3B73DD00B5 for <test(a)wasteland.rfc822.org>; Thu, 8 Jun 2017 17:09:25 +0200 (CEST) <U+FEFF>Date: Thu, 8 Jun 2017 10:09:24 +0000 (GMT) From: Apple Support <*************************> REPLY-TO: do_not_reply(a)apple.com To: test(a)wasteland.rfc822.org [ ... ] Yes - there is an UTF-8 BOM in the middle of the mail header. Breaks parsing of the mail header of dovecot. No From and To in the listing. And i found even more: Return-Path: <**********************> X-Original-To: test(a)wasteland.rfc822.org Delivered-To: inbox(a)wasteland.rfc822.org Received: from 36.248.164.233 (unknown [36.248.164.233]) by pax.zz.de (Postfix) with SMTP id B2B0F1000FF; Tue, 22 Jan 2019 10:37:35 +0100 (CET) Received: from 6.51.138.64 by ; Tue, 22 Jan 2019 04:36:35 -0500 Message-ID: <B[20 Mails that end with garbage in them middle of the mail header. This is a standard Maildir storage using the dovecot transport via postfix. Does anyone have an explanation for these kind of mailstorage breakage? How could broken mails like this even be processed by postfix, dovecot deliver etc. As the last mail is pretty current i quickly grepped the postfix logs: Jan 22 10:37:35 pax postfix/smtpd[20269]: B2B0F1000FF: client=unknown[36.248.164.233] Jan 22 10:37:37 pax postfix/cleanup[20371]: B2B0F1000FF: message-id=<B[20 Jan 22 10:37:37 pax postfix/qmgr[9371]: B2B0F1000FF: from=<**********************>, size=233, nrcpt=2 (queue active) Jan 22 10:37:37 pax postfix/pipe[19192]: B2B0F1000FF: to=<inbox(a)wasteland.rfc822.org>, orig_to=<test108(a)wasteland.rfc822.org>, relay=wasteland, delay=2.2, delays=1.7/0/0/0.41, dsn=2.0.0, status=sent (delivered via wasteland service) Jan 22 10:37:37 pax postfix/pipe[21064]: B2B0F1000FF: to=<inbox(a)wasteland.rfc822.org>, orig_to=<test(a)wasteland.rfc822.org>, relay=wasteland, delay=2.2, delays=1.7/0.01/0/0.48, dsn=2.0.0, status=sent (delivered via wasteland service) Jan 22 10:37:37 pax postfix/qmgr[9371]: B2B0F1000FF: removed So even postfix found the message id to be truncated. Does dovecot have a "broken maildir mail storage mail dictionary" for automated tests? Flo -- Florian Lohoff f(a)zz.de UTF-8 Test: The 🐈 ran after a 🐁, but the 🐁 ran away

1 0

Discard mail with from date older than xxxx
by Trever L. Adams 25 Jan '19

25 Jan '19

I know that sieve doesn't do math. The file would be created externally. Based on examples in section 4.4 of https://tools.ietf.org/html/rfc5260#section-4 I figured something like this would work. if date :value "le" :originalzone "date" "date" "2018-10-25" { fileinto "SPAM"; stop; } However, I get the following. spam: line 41: error: unknown tagged argument ':value' for the date test (reported only once at first occurrence). spam: error: validation failed. sievec(root): Fatal: failed to compile sieve script 'spam.sieve' Does anyone have any advice on how to get this working? Thank you. Trever

4 7

Shared instance
by Stepan Khlebalov 25 Jan '19

25 Jan '19

Hello. I have inbox instance for incoming messages and second private instance for archiving mails with different maildir location. Sharing for folders in inbox instance works perfectly. But it does not work for folders in archiving instance. I can't create two shared instances, dovecot fails. Can I have two locations in one shared instance?

3 7

jmap
by Maciej Milaszewski IQ PL 25 Jan '19

25 Jan '19

Hi Is there any chance that Dovecot-2.2.36 supports "jmap" ? -- Maciej Miłaszewski IQ PL Sp. z o.o. Starszy Administrator Systemowy Biuro Obsługi Klienta: e-mail: bok(a)iq.pl tel.: +48 58 326 09 90 - 94 fax: +48 58 326 09 99 Dział pomocy: https://www.iq.pl/pomoc Informacja dotycząca przetwarzania danych osobowych: https://www.iq.pl/kontakt Jakość gwarantuje: ISO 9001:2000 IQ PL Sp. z o.o. z siedzibą w Gdańsku (80-298), ul. Geodetów 16, KRS 0000007725, Sąd rejestrowy: Sąd Rejonowy w Gdańsku VII Wydział KRS, kapitał zakładowy: 140.000 PLN, NIP 5832736211, REGON 192478853

2 1

debian10+dovecot-2.2.33.2
by Maciej Milaszewski IQ PL 24 Jan '19

24 Jan '19

Hi I have little problem with debian10 and dovecot 2.2.33.2 ps -ax 21815 ? S 0:00 dovecot/pop3-login director 21816 ? S 0:00 dovecot/pop3-login director 21817 ? S 0:00 dovecot/pop3-login director 21818 ? S 0:00 dovecot/pop3-login director 21819 ? S 0:00 dovecot/pop3-login director 21821 ? S 0:00 dovecot/pop3-login director 21822 ? S 0:00 dovecot/pop3-login director But if I testes via telnet like this: telnet 46.xxx.xxx.113 143 Trying 46.xxx.xxx.113... Connected to 46.xxx.xxx.113. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Imap ready. ^] telnet> q Connection closed. and ps: 21808 ? S 0:00 dovecot/imap-login ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? 21826 ? S 0:00 dovecot/imap-login ????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? strace: strace -p 21808 strace: Process 21808 attached gettimeofday({tv_sec=1548168193, tv_usec=419420}, NULL) = 0 epoll_wait(14, doveconf: doveconf -n |head -n 4 # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.19.0-1-amd64 x86_64 Debian buster/sid auth_cache_negative_ttl = 5 mins Probably dovecot not closed correctly imap-login and this same for imap-pop3. Any idea ? -- Maciej Miłaszewski IQ PL Sp. z o.o. Starszy Administrator Systemowy Biuro Obsługi Klienta: e-mail: bok(a)iq.pl tel.: +48 58 326 09 90 - 94 fax: +48 58 326 09 99 Dział pomocy: https://www.iq.pl/pomoc Informacja dotycząca przetwarzania danych osobowych: https://www.iq.pl/kontakt Jakość gwarantuje: ISO 9001:2000 IQ PL Sp. z o.o. z siedzibą w Gdańsku (80-298), ul. Geodetów 16, KRS 0000007725, Sąd rejestrowy: Sąd Rejonowy w Gdańsku VII Wydział KRS, kapitał zakładowy: 140.000 PLN, NIP 5832736211, REGON 192478853

2 13

[FTS Xapian] RC release
by Joan Moreau 24 Jan '19

24 Jan '19

Hi, FTS Xapian matches my targets for the plugins (replacing deprecated fts-squat in a production environment) https://github.com/grosjo/fts-xapian Please do not hesitate to add "issues" on github, if the case happen Hope it helps JM

3 2

Moving messages between servers with different configurations
by Marc Roos 22 Jan '19

22 Jan '19

I wanted to move messages from a mbox mailbox on server A to mdbox on server B. I thought I could do this by connecting to the remote server with "doveadm move -S x.x.x.x:x -u testuser Archive/2017 mailbox INBOX/test" but I guess this will only allow and move messages internally on server B? Should I use dsync, or is there another way to move the messages?

3 5

Having temp mdbox files, what to do with them?
by Marc Roos 22 Jan '19

22 Jan '19

Can I delete these because doveadm is only purging from source, when it is confirmed they are correctly at the destination? [@ storage]# ls -ac1rt m.554 m.569 m.564 m.559 m.561 .temp.1548002572.P1969Q0M313023.mail03 .temp.1548002572.P1969Q1M313023.mail03 .temp.1548002572.P1969Q2M313023.mail03 . .temp.1548002572.P1969Q3M313023.mail03

1 1

Encoding input
by Joan Moreau 22 Jan '19

22 Jan '19

Hi Are data inputs of fts_backend_update_build_more(struct fts_backend_update_context *_ctx, const unsigned char *data, size_t size) already converted to UTF8 ? Thanks

1 0

Changing the imaps port #
by Patrick Mahan 22 Jan '19

22 Jan '19

Dovecot 2.3.4, FreeBSD 11.2 Due to comcast buisness ISP intercepting imaps I need to have my clients connect to non-standard port (9999). Previously I had been using stunnel to receive the imaps connection and forward it to the imap port over 127.0.0.1. But I would like to retire stunnel and have my imap clients connect remotely. I have configured the imap-login service - service imap-login { inet_listener imap { address = 127.0.0.1, ::1 port = 143 } inet_listener imaps { port = 9999 } process_min_avail = 3 service_count = 0 vsz_limit = 1 G } But I am not seeing any listeners on port 9999 - root@ns(1001)# netstat -an | grep 9999 Using sockstat on FreeBSD: root@ns(1002)# sockstat | grep dovecot | grep tcp root dovecot 34800 15 tcp4 *:4190 *:* root dovecot 34800 37 tcp4 127.0.0.1:143 *:* root dovecot 34800 38 tcp6 ::1:143 *:* I have mail_debug = yes, but I don't see any failures. What is the best way to debug why I am not seeing this port number? Thanks, Patrick

4 6

RE: How to connect to a remote server and execute eg a search
by Marc Roos 22 Jan '19

22 Jan '19

Thanks Sami, And I should allow access on the remote server via login_access_sockets? And the authenticated user via this connection is then testuser I presume? > > > Is there a page that explains how to connect to a remote server? What > is the syntax of socket_path? > > > doveadm search -S XXXXXXX -u testuser mailbox INBOX ALL -S <ip>:<port> Sami

2 1

How to connect to a remote server and execute eg a search
by Marc Roos 21 Jan '19

21 Jan '19

Is there a page that explains how to connect to a remote server? What is the syntax of socket_path? doveadm search -S XXXXXXX -u testuser mailbox INBOX ALL

2 1

FOSDEM
by Michael Slusarz 21 Jan '19

21 Jan '19

Hello all, Several Open-Xchange/Dovecot folks will be attending FOSDEM in Brussels on 2-3 February 2019. For those of you planning to attend: we would love to meet and chat with members of the Dovecot community! Come find us wandering around the talks, or look for us in the evening. Rumor is Brussels has some good beer... Also, we'd love to invite everyone to a talk we are giving on the Chat Over IMAP initiative we have been working on. It takes place Sunday at 1105 in the Real-Time Communications room: https://fosdem.org/2019/schedule/event/chat_over_imap/ Hope to see some of you there! michael

1 0

Dovecot can't access mailbox that exists (nested)
by Edgaras Lukoševičius 21 Jan '19

21 Jan '19

Hello, I have this strange situation on nested mailboxes (directories) # dovecot --version 2.2.36 (1f10bfa63) # doveconf -n # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: Linux 3.10.0-693.21.1.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) mail_access_groups = vmail mail_location = maildir:%h mail_plugins = quota stats quota_clone mailbox_list_index = yes managesieve_sieve_capability = fileinto envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } protocols = imap lmtp pop3 sieve service imap-login { inet_listener imap-dsync { port = 1143 } inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 300 process_min_avail = 1 } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 ssl = yes } process_min_avail = 5 } service pop3-login { inet_listener pop3-dsync { port = 1110 } inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 300 process_min_avail = 1 } service stats { fifo_listener stats-mail { group = vmail mode = 0600 user = vmail } fifo_listener stats-user { group = vmail mode = 0600 user = vmail } } protocol lmtp { mail_plugins = quota stats quota_clone sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 50 mail_plugins = quota stats quota_clone imap_quota imap_stats } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_plugins = quota stats quota_clone pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes } # ls -1a (Mailbox structure) cur dovecot.index dovecot.index.cache dovecot.index.log dovecot.list.index dovecot.list.index.log dovecot.mailbox.log dovecot-uidlist dovecot-uidvalidity .Drafts .Junk maildirfolder maildirsize new .Received 1.1522486 - Subdirname.Received .Received 1.1522486 - Subdirname.Sent .Sent sieve subscriptions tmp .Trash .Trash.Sent (2) # doveadm mailbox list -u name(a)domain.com INBOX INBOX.Trash INBOX.Trash.Sent (2) INBOX.Sent INBOX.Received 1 INBOX.Received 1.1522486 - Subdirname INBOX.Received 1.1522486 - Subdirname.Sent INBOX.Received 1.1522486 - Subdirname.Received INBOX.Junk INBOX.Drafts # doveadm mailbox status -u name(a)domain.com -t all INBOX.* doveadm(name(a)domain.com): Error: Mailbox INBOX.Received 1: Failed to lookup mailbox status: Mailbox doesn't exist: INBOX.Received 1 doveadm(name(a)domain.com): Error: Mailbox INBOX.Received 1.1522486 - Subdirname: Failed to lookup mailbox status: Mailbox doesn't exist: INBOX.Received 1.1522486 - Subdirname messages=16 recent=0 unseen=1 vsize=3432379 The problem is that it's not possible to move this mailbox between servers using dovecot dsync/imapc. But I can see the messages inside these mailboxes using external IMAP/POP clients.

3 2

Unexpected accounts showing up in replication status (doveadm replicator status '*')
by Daniel Schütze 21 Jan '19

21 Jan '19

I have a replication set up with two dovecot 2.3.4 servers. Messages appear to be replicating fine between them, however there is an oddity when I run doveadm replicator status '*' and I'm worried work is being carried out needlessly. Both machines have identical configs and have a mysql backend for username/passwords. Both machines point to the same mysql server and same tables. When I run doveadm user '*' On either machine I am presented with the same correct list of users. The users are presented in the form: username and not username@domain. When I run doveadm replicator status '*' On either machine I receive a list of usernames which includes not only username but also username@domain. Both of these "accounts" have fast sync, full sync and success sync entries and these are not the same times between username and username@domain (hence I'm worried unnecessary work is being carried out). My ee dovecot-sql.conf.ext Has these entires re usernames user_query = SELECT home, uid, gid FROM users WHERE username = '%n' password_query = SELECT username AS user, domain, password, home AS userdb_home, uid AS userdb_uid, gid AS userdb_gid FROM users WHERE username = '%u' [Having copied these in I do see the different usage of %u and %n] iterate_query = SELECT username AS user,domain FROM users The users table is as follows +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(128) | NO | | NULL | | | domain | varchar(128) | NO | | NULL | | | password | varchar(64) | NO | | NULL | | | home | varchar(255) | NO | | NULL | | | uid | int(11) | NO | | NULL | | | gid | int(11) | NO | | NULL | | | active | char(1) | NO | | Y | | | mail_replica | varchar(255) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ I assume that the duplication of username with and without domains isn't as intended, any suggestions where I am going wrong? I did previously have the servers running with the iterate query commented out and when that was the case doveadm user '*' returned the correct number of accounts but in the format username@domain and the replicator status again 'double listed' accounts as described above. Thank you for any tips! -- Daniel Schütze Director ------------------ CWA International Balmoral House 9 John Street London WC1N 2ES (t) + 44 (0)20 7242 8444 (e) dms(a)cwa.uk.com (w) http://www.cwa.uk.com/

1 1

doveadm proxy list repeats header line
by Michael Goth 20 Jan '19

20 Jan '19

Hi all, just a minor thing: Why does `doveadm proxy list` repeat the header line after each entry? Too me, that just makes the output harder to read. So instead of this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 I'd prefer this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 The repeated header lines also happen with other formatters. Regards, Michael

3 3

Panic…
by SH Development 20 Jan '19

20 Jan '19

I have started getting these in my log. What does this mean and what do I need to do? Panic: file mail-index-util.c: line 37 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) Dec 12 23:29:44 mail dovecot: imap(jeff(a)stariontech.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x3cafa) [0x7f38c5a2cafa] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3cb46) [0x7f38c5a2cb46] -> /usr/lib64/dovecot/libdovecot.so.0(+0x16e2a) [0x7f38c5a06e2a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x74) [0x7f38c5d0d3f4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x81abd) [0x7f38c5cf3abd] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_cache_compress+0x77) [0x7f38c5cf4247] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x1d2) [0x7f38c5d08012] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5fd88) [0x7f38c5cd1d88] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x570a0) [0x7f38c5cc90a0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_force+0x52) [0x7f38c5cc94c2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_file_do+0x99) [0x7f38c5cc9f49] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x59b7f) [0x7f38c5ccbb7f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_set_seq+0x112) [0x7f38c5cb64f2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x16b) [0x7f38c5cbae9b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x20) [0x7f38c5ca2240] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x26) [0x7f38c5ca2296] -> dovecot/imap(imap_fetch_more+0x2bf) [0x41221f] -> dovecot/imap(cmd_fetch+0x42c) [0x40a33c] -> dovecot/imap() [0x40f90d] -> dovecot/imap() [0x40f9fa] -> dovecot/imap(client_handle_input+0x135) [0x40fc25] -> dovecot/imap(client_input+0x5f) [0x41054f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f38c5a37e98] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f38c5a38e0f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f38c5a37e28] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f38c5a26293] -> dovecot/imap(main+0x2f9) [0x418849] -> /lib64/libc.so.6(__libc_start_main+0x10 Dec 12 23:29:44 mail dovecot: master: Error: service(imap): child 11157 killed with signal 6 (core dumps disabled)

6 5

I never touched nuthin'
by mick crane 20 Jan '19

20 Jan '19

hello, do you mind if I ask before I start poking about ? suddenly I notice that gmail is ignoring or because there is an error getmail is not sending the delete request. Mails are sent and received but not deleted gmail so I keep getting them. mick@rapunzel:~/.getmail$ getmail --rcfile getmailrc1 Delivery error (command deliver 1363 wrote to stderr: lda(mick,)Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: Permission denied) I think is apt install dovecot on debian buster probably I updated yesterday but was working OK since so I dunno what happened. is log full or something ? advices appreciated mick -- Key ID C7D6E24C

4 6

2.3.4 doesnt compile on FreeBSD 11.2 using clang
by Chris 20 Jan '19

20 Jan '19

extract below, this has already been reported a while back but still no new patch, so this email is to serve as a reminder, if someone manually fixes it for the ports tree, I dont consider that a fix, ideally we need this fixed in the source code, as not everyone will install it from ports. Chris "clang40 -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-test -I../../src/lib-settings -I../../src/lib-ssl-iostream -DPKG_RUNDIR=\""/var/run/dovecot"\" -DPKG_STATEDIR=\""/var/lib/dovecot"\" -DSYSCONFDIR=\""/etc/dovecot"\" -DBINDIR=\""/usr/bin"\" -I/usr/local/include -std=gnu99 -fdiagnostics-color -Wl,-rpath=/usr/local/llvm40/lib -O2 -pipe -march=native -fno-strict-aliasing -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -I/usr/local/include -MT test-event-stats.o -MD -MP -MF .deps/test-event-stats.Tpo -c -o test-event-stats.o test-event-stats.c clang-4.0: warning: -Wl,-rpath=/usr/local/llvm40/lib: 'linker' input unused [-Wunused-command-line-argument] test-event-stats.c:101:8: warning: implicit declaration of function 'kill' is invalid in C99 [-Wimplicit-function-declaration] (void)kill(stats_pid, SIGKILL); ^ test-event-stats.c:101:24: error: use of undeclared identifier 'SIGKILL' (void)kill(stats_pid, SIGKILL); ^ 1 warning and 1 error generated. gmake[2]: *** [Makefile:656: test-event-stats.o] Error 1 gmake[2]: Leaving directory '/usr/local/directadmin/custombuild/dovecot-2.3.4/src/lib-master' gmake[1]: *** [Makefile:565: install-recursive] Error 1 gmake[1]: Leaving directory '/usr/local/directadmin/custombuild/dovecot-2.3.4/src' gmake: *** [Makefile:683: install-recursive] Error 1"

7 7

Re: Localhost imap server fails after upgrade from 2.2.33.2-1 to 1:2.3.2.1 (fwd)
by Chris BL 20 Jan '19

20 Jan '19

Hi Aki, Oops; I did not think carefully enough about your instructions. Here is the output from $ dovecot -n -c /home/meuser/dotfiles/auto-stanford-dovecot.conf # 2.3.2.1 (0719df592): /home/meuser/dotfiles/auto-stanford-dovecot.conf # Pigeonhole version 0.5.2 () # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 ext4 # Hostname: cpbl-t450s doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX service stats { unix_listener stats-writer { mode = 0666 } } ssl_dh = # hidden, use -P to show it verbose_proctitle = yes I then followed the instructions in the Warning lines above and now I get: dovecot -n -c /home/meuser/dotfiles/auto-stanford-dovecot.conf # 2.3.2.1 (0719df592): /home/meuser/dotfiles/auto-stanford-dovecot.conf # Pigeonhole version 0.5.2 () # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 ext4 # Hostname: cpbl-t450s mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX service stats { unix_listener stats-writer { mode = 0666 } } ssl_dh = # hidden, use -P to show it verbose_proctitle = yes However, this does not help my primary symptom: $ /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-stanford-dovecot.conf imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] Logged in as meuser Thanks! Chris On Mon, Dec 31, 2018 at 10:27 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: Did you remove the service section before taking doveconf -n? 'cos I can't see it here.. Also, did you restart dovecot after config change? Aki > On 31 December 2018 at 16:54 Chris BL <cpblpublic+dovecot(a)gmail.com> wrote: > > > Hi Aki, > > Yes, the same connect error: imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied > > The mail location in "doveconf -n" (belo) does not reflect my preferences. > > In Alpine, if I acknowledge the error I get, which tells me to add > novalidate-cert in my pinerc file, it prompts me for my POSIX username and > password. After that, I get my /var/spool/mail inbox, which is not what I > want. > > > doveconf -n > # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.2 () > # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 > # Hostname: myhost-t450s > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > protocols = " imap" > ssl_cert = </etc/dovecot/private/dovecot.pem > ssl_client_ca_dir = /etc/ssl/certs > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > userdb { > driver = passwd > } > > > > On Mon, 31 Dec 2018, Aki Tuomi wrote: > > > You are still getting the connect error? > > > > Can you share your doveconf -n? > > > > Aki > > > > > On 31 December 2018 at 16:42 cpblpublic+dovecot(a)gmail.com wrote: > > > > > > > > > Hi Aki, > > > > > > Thanks. I put that in the .conf file I mentioned, and it made no > > > difference. > > > > > > Chris > > > > > > > Hi! > > > > > > > > In your case it's probably easiest to change > > > > > > > > service stats { > > > > unix_listener stats-writer { > > > > mode = 0666 > > > > } > > > > } > > > > > > > > Aki > > > > > > > > > On 31 December 2018 at 16:05 cpblpublic+dovecot(a)gmail.com wrote: > > > > > > > > > > > > > > > > > > > > I use a localhost dovecot imap server in order to access maildir folders from Alpine (see 2009 instructions for my set up here > > > > > https://cpbl.wordpress.com/2009/11/07/alpine-offlineimap-and-gmail-under-ub… ) > > > > > > > > > > My configuration has worked nicely since 2009, but failed after a recent upgrade of dovecot (during basic upgrade from Ubuntu 18.04 to 18.10). > > > > > > > > > > The version of Alpine did not change. Uninstalling dovecot-core and dovecot-imapd, and reinstalling the older versions, fully fixes the problem. > > > > > > > > > > I would like to know how to get my configuration working with the new version of dovecot. > > > > > > > > > > Here's what the problem looks like: > > > > > > > > > > I have a file auto-dovecot.conf with only the following two lines. > > > > > > > > > > verbose_proctitle = yes > > > > > mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX > > > > > > > > > > Other /etc/ files are unchanged from installation defaults. > > > > > > > > > > Alpine calls imapd when it starts, with the following command: > > > > > > > > > > /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-dovecot.conf > > > > > > > > > > > > > > > When I run that command, I get: > > > > > > > > > > imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied > > > > > * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > > > > > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > > > > > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > > > > > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > > > > > CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] > > > > > Logged in as meuser > > > > > > > > > > > > > > > > > > > > > > > > > so I am guessing that the first line is the issue, since when the older version I get instead: > > > > > > > > > > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > > > > > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > > > > > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > > > > > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > > > > > CONTEXT=SEARCH LIST-STATUS BINARY MOVE] Logged in as meuser > > > > > > > > > > > > > > > Can anyone help me? I cannot find documentation for using a localhost server for Alpine, except my own from 2009. > > > > > > > > > > Many thanks! > > > > > > > > > > Chris > > > > > >

3 6

doveadm index crash/assert
by Larry Rosenman 20 Jan '19

20 Jan '19

I got the following crash whilst looking at my logs and seeing some indexer-worker crashes. doveadm(ler): Panic: file http-client-request.c: line 1108 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Abort trap (core dumped) bt full at: https://www.lerctr.org/~ler/doveadm.index.crash.txt doveconf -n: https://www.lerctr.org/~ler/doveconf.n.txt 2.3.4 from FreeBSD ports. What else do you need? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

2 9

Request: Pigeonhole - strip CWFS from message-id logs
by Lee Maguire 20 Jan '19

20 Jan '19

Normally for a log line containing the contents of a Message-Id, it is logged like the following Nov 29 11:41:27 xxx dovecot[211]: lmtp(lee)<30167><XXXXX>: sieve: msgid=<xxxx(a)example.net>: stored mail into mailbox 'Notifications' However, if there is CFWS other than a space, it changes the format of the log line (potentially making the logs harder to process - eg via “logcheck" rules) Nov 29 11:50:09 xxx dovecot[401]: lmtp(lee)<55724><XXXXX>: sieve: msgid=? <xxxx(a)example.com>: stored mail into mailbox ‘Notifications' A message-id line broken up is valid per RFC 5322 and header whitespace shouldn’t be significant for logging purposes https://tools.ietf.org/html/rfc5322#section-3.6.4 https://tools.ietf.org/html/rfc5322#section-3.2.2

2 2

Feature request: client bind address for replication
by John Fawcett 20 Jan '19

20 Jan '19

Hi would it be possible to consider a new parameter for replication: doveadm_local_ip which allows the source ip address to be set when connection to a remote dovecot for replication? It could be useful when the network interface has multiple ips and a specific one is used for mail services. See attached proposal. I tested against 2.2.36 only. It applies correctly against 2.3.4 with a warning,. John

2 1

auth-worker service failed since recent MariaDB upgrade
by Bogomil Vasilev 20 Jan '19

20 Jan '19

Hello, I have started having issues with auth-worker. Dovecot version: 0 « root » ~ # dovecot --version 2.3.4 (0ecbaf23d) 0 « root » ~ # pacman -Q dovecot dovecot 2.3.4-2 OS: Arch Linux From /var/log/mail.log: Jan 20 11:31:29 archy dovecot[23070]: auth-worker: Fatal: master: service(auth-worker): child 9885 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set /proc/sys/fs/suid_dum pable to 2) From dmesg: [42113.729398] auth[8134]: segfault at 5579d8e1c8e0 ip 00005579d8e1c8e0 sp 00007ffd44ab0df8 error 15 [42113.729406] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 7a af 07 e3 7f 00 00 <40> f4 b5 07 e3 7f 00 00 31 a0 00 00 00 00 00 00 e0 9f df d8 79 55 This started happening on January 18th, after I upgraded Dovecot from "2.3.4-1" to "2.3.4-2". The package was rebuilt from our package maintainer due to bumping MariaDB from 10.1.x to 10.3.x. Before that, I did not have any issues at all. However, I don't see any impact from this error too, at least not for now. I made a coredump as the error suggests and I'm pasting it here, as per the bugreport rules: 0 « root » ~ # gdb /usr/lib/dovecot/auth /home/smirky/dovecot.dump GNU gdb (GDB) 8.2.1 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/lib/dovecot/auth...(no debugging symbols found)...done. [New LWP 9549] [Thread debugging using libthread_db enabled] Using host libthread_db library "/usr/lib/libthread_db.so.1". Core was generated by `dovecot/auth -w'. Program terminated with signal SIGABRT, Aborted. #0 0x00007fe1bb8ead7f in raise () from /usr/lib/libc.so.6 (gdb) bt full #0 0x00007fe1bb8ead7f in raise () from /usr/lib/libc.so.6 No symbol table info available. #1 0x00007fe1bb8d5672 in abort () from /usr/lib/libc.so.6 No symbol table info available. #2 0x00007fe1bb92d878 in __libc_message () from /usr/lib/libc.so.6 No symbol table info available. #3 0x00007fe1bb93418a in malloc_printerr () from /usr/lib/libc.so.6 No symbol table info available. #4 0x00007fe1bb935b27 in _int_free () from /usr/lib/libc.so.6 No symbol table info available. #5 0x00007fe1bbc2bb89 in mysql_close () from /usr/lib/libmariadb.so.3 No symbol table info available. #6 0x0000563481946dac in ?? () No symbol table info available. #7 0x000056348193b8fc in db_sql_unref () No symbol table info available. #8 0x000056348193389c in userdb_deinit () No symbol table info available. #9 0x0000563481913bb9 in auths_deinit () No symbol table info available. #10 0x0000563481912664 in main () No symbol table info available. (gdb) The way I see it, indeed it is highly-likely to be related to the MariaDB version bump, but I cannot be entirely sure if it's not a bug in Dovecot, discovered by this bump. Please let me know if you need any other info, related to my setup. Best regards, -- BOGOMIL VASILEV For contacts, use this e-mail. My GPG key is 646F3ABF6E457336 Website: HTTPS://WWW.SMIRKY.NET/

3 6

Re: Dovecot 2.3.4 crash
by Timo Sirainen 20 Jan '19

20 Jan '19

On 2 Dec 2018, at 22.22, Guillaume via dovecot <dovecot(a)dovecot.org> wrote: > > I also have this kind of segfault since the update : > > Dec 2 21:12:11 xxxxxxx dovecot: auth-worker: Error: *** Error in `dovecot/auth': double free or corruption (fasttop): 0x000055573bb99f70 Is this easy to reproduce? Can you try with valgrind? It will slow down the logins a bit though. service auth-worker { executable = /usr/bin/valgrind -q --vgdb=no /usr/lib/dovecot/auth -w } At least one good thing about this crash is that it seems to happen only at deinit, so it's not impacting users.

4 6