- dovecot - dovecot.org

Dovecot can't access mailbox that exists (nested)
by Edgaras Lukoševičius 21 Jan '19

21 Jan '19

Hello, I have this strange situation on nested mailboxes (directories) # dovecot --version 2.2.36 (1f10bfa63) # doveconf -n # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: Linux 3.10.0-693.21.1.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) mail_access_groups = vmail mail_location = maildir:%h mail_plugins = quota stats quota_clone mailbox_list_index = yes managesieve_sieve_capability = fileinto envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } protocols = imap lmtp pop3 sieve service imap-login { inet_listener imap-dsync { port = 1143 } inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 300 process_min_avail = 1 } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 ssl = yes } process_min_avail = 5 } service pop3-login { inet_listener pop3-dsync { port = 1110 } inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 300 process_min_avail = 1 } service stats { fifo_listener stats-mail { group = vmail mode = 0600 user = vmail } fifo_listener stats-user { group = vmail mode = 0600 user = vmail } } protocol lmtp { mail_plugins = quota stats quota_clone sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 50 mail_plugins = quota stats quota_clone imap_quota imap_stats } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_plugins = quota stats quota_clone pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes } # ls -1a (Mailbox structure) cur dovecot.index dovecot.index.cache dovecot.index.log dovecot.list.index dovecot.list.index.log dovecot.mailbox.log dovecot-uidlist dovecot-uidvalidity .Drafts .Junk maildirfolder maildirsize new .Received 1.1522486 - Subdirname.Received .Received 1.1522486 - Subdirname.Sent .Sent sieve subscriptions tmp .Trash .Trash.Sent (2) # doveadm mailbox list -u name(a)domain.com INBOX INBOX.Trash INBOX.Trash.Sent (2) INBOX.Sent INBOX.Received 1 INBOX.Received 1.1522486 - Subdirname INBOX.Received 1.1522486 - Subdirname.Sent INBOX.Received 1.1522486 - Subdirname.Received INBOX.Junk INBOX.Drafts # doveadm mailbox status -u name(a)domain.com -t all INBOX.* doveadm(name(a)domain.com): Error: Mailbox INBOX.Received 1: Failed to lookup mailbox status: Mailbox doesn't exist: INBOX.Received 1 doveadm(name(a)domain.com): Error: Mailbox INBOX.Received 1.1522486 - Subdirname: Failed to lookup mailbox status: Mailbox doesn't exist: INBOX.Received 1.1522486 - Subdirname messages=16 recent=0 unseen=1 vsize=3432379 The problem is that it's not possible to move this mailbox between servers using dovecot dsync/imapc. But I can see the messages inside these mailboxes using external IMAP/POP clients.

3 2

Unexpected accounts showing up in replication status (doveadm replicator status '*')
by Daniel Schütze 21 Jan '19

21 Jan '19

I have a replication set up with two dovecot 2.3.4 servers. Messages appear to be replicating fine between them, however there is an oddity when I run doveadm replicator status '*' and I'm worried work is being carried out needlessly. Both machines have identical configs and have a mysql backend for username/passwords. Both machines point to the same mysql server and same tables. When I run doveadm user '*' On either machine I am presented with the same correct list of users. The users are presented in the form: username and not username@domain. When I run doveadm replicator status '*' On either machine I receive a list of usernames which includes not only username but also username@domain. Both of these "accounts" have fast sync, full sync and success sync entries and these are not the same times between username and username@domain (hence I'm worried unnecessary work is being carried out). My ee dovecot-sql.conf.ext Has these entires re usernames user_query = SELECT home, uid, gid FROM users WHERE username = '%n' password_query = SELECT username AS user, domain, password, home AS userdb_home, uid AS userdb_uid, gid AS userdb_gid FROM users WHERE username = '%u' [Having copied these in I do see the different usage of %u and %n] iterate_query = SELECT username AS user,domain FROM users The users table is as follows +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(128) | NO | | NULL | | | domain | varchar(128) | NO | | NULL | | | password | varchar(64) | NO | | NULL | | | home | varchar(255) | NO | | NULL | | | uid | int(11) | NO | | NULL | | | gid | int(11) | NO | | NULL | | | active | char(1) | NO | | Y | | | mail_replica | varchar(255) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ I assume that the duplication of username with and without domains isn't as intended, any suggestions where I am going wrong? I did previously have the servers running with the iterate query commented out and when that was the case doveadm user '*' returned the correct number of accounts but in the format username@domain and the replicator status again 'double listed' accounts as described above. Thank you for any tips! -- Daniel Schütze Director ------------------ CWA International Balmoral House 9 John Street London WC1N 2ES (t) + 44 (0)20 7242 8444 (e) dms(a)cwa.uk.com (w) http://www.cwa.uk.com/

1 1

doveadm proxy list repeats header line
by Michael Goth 21 Jan '19

21 Jan '19

Hi all, just a minor thing: Why does `doveadm proxy list` repeat the header line after each entry? Too me, that just makes the output harder to read. So instead of this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 I'd prefer this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 The repeated header lines also happen with other formatters. Regards, Michael

3 3

Panic…
by SH Development 21 Jan '19

21 Jan '19

I have started getting these in my log. What does this mean and what do I need to do? Panic: file mail-index-util.c: line 37 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) Dec 12 23:29:44 mail dovecot: imap(jeff(a)stariontech.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x3cafa) [0x7f38c5a2cafa] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3cb46) [0x7f38c5a2cb46] -> /usr/lib64/dovecot/libdovecot.so.0(+0x16e2a) [0x7f38c5a06e2a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x74) [0x7f38c5d0d3f4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x81abd) [0x7f38c5cf3abd] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_cache_compress+0x77) [0x7f38c5cf4247] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x1d2) [0x7f38c5d08012] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5fd88) [0x7f38c5cd1d88] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x570a0) [0x7f38c5cc90a0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_force+0x52) [0x7f38c5cc94c2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_file_do+0x99) [0x7f38c5cc9f49] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x59b7f) [0x7f38c5ccbb7f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_set_seq+0x112) [0x7f38c5cb64f2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x16b) [0x7f38c5cbae9b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x20) [0x7f38c5ca2240] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x26) [0x7f38c5ca2296] -> dovecot/imap(imap_fetch_more+0x2bf) [0x41221f] -> dovecot/imap(cmd_fetch+0x42c) [0x40a33c] -> dovecot/imap() [0x40f90d] -> dovecot/imap() [0x40f9fa] -> dovecot/imap(client_handle_input+0x135) [0x40fc25] -> dovecot/imap(client_input+0x5f) [0x41054f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f38c5a37e98] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f38c5a38e0f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f38c5a37e28] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f38c5a26293] -> dovecot/imap(main+0x2f9) [0x418849] -> /lib64/libc.so.6(__libc_start_main+0x10 Dec 12 23:29:44 mail dovecot: master: Error: service(imap): child 11157 killed with signal 6 (core dumps disabled)

6 5

I never touched nuthin'
by mick crane 21 Jan '19

21 Jan '19

hello, do you mind if I ask before I start poking about ? suddenly I notice that gmail is ignoring or because there is an error getmail is not sending the delete request. Mails are sent and received but not deleted gmail so I keep getting them. mick@rapunzel:~/.getmail$ getmail --rcfile getmailrc1 Delivery error (command deliver 1363 wrote to stderr: lda(mick,)Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: Permission denied) I think is apt install dovecot on debian buster probably I updated yesterday but was working OK since so I dunno what happened. is log full or something ? advices appreciated mick -- Key ID C7D6E24C

4 6

2.3.4 doesnt compile on FreeBSD 11.2 using clang
by Chris 21 Jan '19

21 Jan '19

extract below, this has already been reported a while back but still no new patch, so this email is to serve as a reminder, if someone manually fixes it for the ports tree, I dont consider that a fix, ideally we need this fixed in the source code, as not everyone will install it from ports. Chris "clang40 -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-test -I../../src/lib-settings -I../../src/lib-ssl-iostream -DPKG_RUNDIR=\""/var/run/dovecot"\" -DPKG_STATEDIR=\""/var/lib/dovecot"\" -DSYSCONFDIR=\""/etc/dovecot"\" -DBINDIR=\""/usr/bin"\" -I/usr/local/include -std=gnu99 -fdiagnostics-color -Wl,-rpath=/usr/local/llvm40/lib -O2 -pipe -march=native -fno-strict-aliasing -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -I/usr/local/include -MT test-event-stats.o -MD -MP -MF .deps/test-event-stats.Tpo -c -o test-event-stats.o test-event-stats.c clang-4.0: warning: -Wl,-rpath=/usr/local/llvm40/lib: 'linker' input unused [-Wunused-command-line-argument] test-event-stats.c:101:8: warning: implicit declaration of function 'kill' is invalid in C99 [-Wimplicit-function-declaration] (void)kill(stats_pid, SIGKILL); ^ test-event-stats.c:101:24: error: use of undeclared identifier 'SIGKILL' (void)kill(stats_pid, SIGKILL); ^ 1 warning and 1 error generated. gmake[2]: *** [Makefile:656: test-event-stats.o] Error 1 gmake[2]: Leaving directory '/usr/local/directadmin/custombuild/dovecot-2.3.4/src/lib-master' gmake[1]: *** [Makefile:565: install-recursive] Error 1 gmake[1]: Leaving directory '/usr/local/directadmin/custombuild/dovecot-2.3.4/src' gmake: *** [Makefile:683: install-recursive] Error 1"

7 7

Re: Localhost imap server fails after upgrade from 2.2.33.2-1 to 1:2.3.2.1 (fwd)
by Chris BL 21 Jan '19

21 Jan '19

Hi Aki, Oops; I did not think carefully enough about your instructions. Here is the output from $ dovecot -n -c /home/meuser/dotfiles/auto-stanford-dovecot.conf # 2.3.2.1 (0719df592): /home/meuser/dotfiles/auto-stanford-dovecot.conf # Pigeonhole version 0.5.2 () # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 ext4 # Hostname: cpbl-t450s doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX service stats { unix_listener stats-writer { mode = 0666 } } ssl_dh = # hidden, use -P to show it verbose_proctitle = yes I then followed the instructions in the Warning lines above and now I get: dovecot -n -c /home/meuser/dotfiles/auto-stanford-dovecot.conf # 2.3.2.1 (0719df592): /home/meuser/dotfiles/auto-stanford-dovecot.conf # Pigeonhole version 0.5.2 () # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 ext4 # Hostname: cpbl-t450s mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX service stats { unix_listener stats-writer { mode = 0666 } } ssl_dh = # hidden, use -P to show it verbose_proctitle = yes However, this does not help my primary symptom: $ /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-stanford-dovecot.conf imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] Logged in as meuser Thanks! Chris On Mon, Dec 31, 2018 at 10:27 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: Did you remove the service section before taking doveconf -n? 'cos I can't see it here.. Also, did you restart dovecot after config change? Aki > On 31 December 2018 at 16:54 Chris BL <cpblpublic+dovecot(a)gmail.com> wrote: > > > Hi Aki, > > Yes, the same connect error: imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied > > The mail location in "doveconf -n" (belo) does not reflect my preferences. > > In Alpine, if I acknowledge the error I get, which tells me to add > novalidate-cert in my pinerc file, it prompts me for my POSIX username and > password. After that, I get my /var/spool/mail inbox, which is not what I > want. > > > doveconf -n > # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.2 () > # OS: Linux 4.18.0-13-generic x86_64 Ubuntu 18.10 > # Hostname: myhost-t450s > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > protocols = " imap" > ssl_cert = </etc/dovecot/private/dovecot.pem > ssl_client_ca_dir = /etc/ssl/certs > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > userdb { > driver = passwd > } > > > > On Mon, 31 Dec 2018, Aki Tuomi wrote: > > > You are still getting the connect error? > > > > Can you share your doveconf -n? > > > > Aki > > > > > On 31 December 2018 at 16:42 cpblpublic+dovecot(a)gmail.com wrote: > > > > > > > > > Hi Aki, > > > > > > Thanks. I put that in the .conf file I mentioned, and it made no > > > difference. > > > > > > Chris > > > > > > > Hi! > > > > > > > > In your case it's probably easiest to change > > > > > > > > service stats { > > > > unix_listener stats-writer { > > > > mode = 0666 > > > > } > > > > } > > > > > > > > Aki > > > > > > > > > On 31 December 2018 at 16:05 cpblpublic+dovecot(a)gmail.com wrote: > > > > > > > > > > > > > > > > > > > > I use a localhost dovecot imap server in order to access maildir folders from Alpine (see 2009 instructions for my set up here > > > > > https://cpbl.wordpress.com/2009/11/07/alpine-offlineimap-and-gmail-under-ub… ) > > > > > > > > > > My configuration has worked nicely since 2009, but failed after a recent upgrade of dovecot (during basic upgrade from Ubuntu 18.04 to 18.10). > > > > > > > > > > The version of Alpine did not change. Uninstalling dovecot-core and dovecot-imapd, and reinstalling the older versions, fully fixes the problem. > > > > > > > > > > I would like to know how to get my configuration working with the new version of dovecot. > > > > > > > > > > Here's what the problem looks like: > > > > > > > > > > I have a file auto-dovecot.conf with only the following two lines. > > > > > > > > > > verbose_proctitle = yes > > > > > mail_location = maildir:/home/meuser/imap/gmailStanford:LAYOUT=fs:INBOX=/home/meuser/imap/gmailStanford/INBOX > > > > > > > > > > Other /etc/ files are unchanged from installation defaults. > > > > > > > > > > Alpine calls imapd when it starts, with the following command: > > > > > > > > > > /usr/lib/dovecot/imap -c /home/meuser/dotfiles/auto-dovecot.conf > > > > > > > > > > > > > > > When I run that command, I get: > > > > > > > > > > imap(meuser,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission denied > > > > > * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > > > > > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > > > > > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > > > > > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > > > > > CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY] > > > > > Logged in as meuser > > > > > > > > > > > > > > > > > > > > > > > > > so I am guessing that the first line is the issue, since when the older version I get instead: > > > > > > > > > > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > > > > > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > > > > > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > > > > > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > > > > > CONTEXT=SEARCH LIST-STATUS BINARY MOVE] Logged in as meuser > > > > > > > > > > > > > > > Can anyone help me? I cannot find documentation for using a localhost server for Alpine, except my own from 2009. > > > > > > > > > > Many thanks! > > > > > > > > > > Chris > > > > > >

3 6

doveadm index crash/assert
by Larry Rosenman 21 Jan '19

21 Jan '19

I got the following crash whilst looking at my logs and seeing some indexer-worker crashes. doveadm(ler): Panic: file http-client-request.c: line 1108 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Abort trap (core dumped) bt full at: https://www.lerctr.org/~ler/doveadm.index.crash.txt doveconf -n: https://www.lerctr.org/~ler/doveconf.n.txt 2.3.4 from FreeBSD ports. What else do you need? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

2 9

Request: Pigeonhole - strip CWFS from message-id logs
by Lee Maguire 21 Jan '19

21 Jan '19

Normally for a log line containing the contents of a Message-Id, it is logged like the following Nov 29 11:41:27 xxx dovecot[211]: lmtp(lee)<30167><XXXXX>: sieve: msgid=<xxxx(a)example.net>: stored mail into mailbox 'Notifications' However, if there is CFWS other than a space, it changes the format of the log line (potentially making the logs harder to process - eg via “logcheck" rules) Nov 29 11:50:09 xxx dovecot[401]: lmtp(lee)<55724><XXXXX>: sieve: msgid=? <xxxx(a)example.com>: stored mail into mailbox ‘Notifications' A message-id line broken up is valid per RFC 5322 and header whitespace shouldn’t be significant for logging purposes https://tools.ietf.org/html/rfc5322#section-3.6.4 https://tools.ietf.org/html/rfc5322#section-3.2.2

2 2

Feature request: client bind address for replication
by John Fawcett 21 Jan '19

21 Jan '19

Hi would it be possible to consider a new parameter for replication: doveadm_local_ip which allows the source ip address to be set when connection to a remote dovecot for replication? It could be useful when the network interface has multiple ips and a specific one is used for mail services. See attached proposal. I tested against 2.2.36 only. It applies correctly against 2.3.4 with a warning,. John

2 1