- dovecot - dovecot.org

2.3.11.3: dsync failure
by Alexander Tsoy 16 Aug '20

16 Aug '20

Hello! dovecot 2.3.11.3 fails to backup/sync my mailbox. The mailbox is currently in mdbox format and is (mostly) lz4-compressed. See the trace below (I've added newlines to the output): # doveadm -v backup -u username mdbox:/var/vmail/username_new/mdbox dsync(username): Panic: file istream.c: line 332 (i_stream_read_memarea): assertion failed: (!stream->blocking) dsync(username): Error: Raw backtrace: #0 default_fatal_finish[0x7f1179173b29] -> #1 fatal_handler_real[0x7f1179173be0] -> #2 default_fatal_handler[0x7f1179173c3d] -> #3 i_panic[0x7f1179173e27] -> #4 i_stream_read_memarea[0x7f1179187b29] -> #5 read_more[0x7f117919519b] -> #6 read_from_buffer[0x7f117919535a] -> #7 i_stream_seekable_read[0x7f117919582e] -> #8 i_stream_seekable_stat[0x7f1179195cdf] -> #9 i_stream_stat[0x7f1179188764] -> #10 i_stream_limit_stat[0x7f1179192380] -> #11 i_stream_stat[0x7f1179188764] -> #12 i_stream_default_stat[0x7f117918a0a3] -> #13 i_stream_default_get_size[0x7f117918a282] -> #14 i_stream_get_size[0x7f1179188811] -> #15 mdbox_save_begin[0x7f11792edb85] -> #16 zlib_mail_save_compress_begin[0x7f117891b2ad] -> #17 mailbox_save_begin[0x7f11792c8f22] -> #18 mail_storage_try_copy[0x7f11792b2443] -> #19 mail_storage_copy[0x7f11792b2604] -> #20 mdbox_copy[0x7f11792ee96f] -> #21 mailbox_copy_int[0x7f11792c9611] -> #22 mailbox_copy[0x7f11792c98c2] -> #23 dsync_mailbox_save_body[0x5629fd7936a5] -> #24 dsync_mailbox_save_newmails[0x5629fd793dc3] -> #25 dsync_mailbox_import_mail[0x5629fd793eb0] -> #26 dsync_brain_recv_mail[0x5629fd78b982] -> #27 dsync_brain_sync_mails[0x5629fd78bd79] -> #28 dsync_brain_run_real[0x5629fd78576c] -> #29 dsync_brain_run[0x5629fd7859a5] -> #30 cmd_dsync_run_local[0x5629fd75e8d3] -> #31 cmd_dsync_run[0x5629fd75f3a8] -> #32 doveadm_mail_next_user[0x5629fd762f81] -> #33 doveadm_mail_single_user[0x5629fd763311] -> #34 doveadm_mail_cmd_exec[0x5629fd763963] -> #35 doveadm_mail_cmd[0x5629fd763c22] -> #36 doveadm_mail_try_run[0x5629fd7641e1] -> #37 main[0x5629fd78051d] -> #38 __libc_start_main[0x7f1178d56c00] -> #39 _start[0x5629fd74cb20] Aborted Tried different output compression types: gz, xz, zstd. dovecot 2.3.10.1 doesn't seem to have such problem. But since I already have some messages compressed with zstd, I would like to do migration using 2.3.11.x. Please let me know if I can provide any further information. I'm not on the list, so please CC me on reply. $ sudo dovecot -n # 2.3.11.3 (502c39af9): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.11 (d71e0372) # OS: Linux 5.4.58-gentoo x86_64 Gentoo Base System release 2.6 # Hostname: xxxxxxxx.xx auth_mechanisms = plain login default_client_limit = 50 default_process_limit = 10 imap_idle_notify_interval = 29 mins mail_fsync = always mail_location = mdbox:~/mdbox mail_plugins = " zlib" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_preallocate_space = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes } passdb { args = scheme=CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve zlib_save = xz zlib_save_level = 9 } protocols = imap lmtp service auth-worker { user = $default_internal_user } service auth { unix_listener auth-client { mode = 0660 user = mail } user = $default_internal_user } service imap-login { inet_listener imaps { port = 0 } } ssl = required ssl_cert = </etc/ssl/dovecot/server.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = username_format=%n /etc/dovecot/users driver = passwd-file } protocol lmtp { mail_plugins = " zlib sieve" } protocol lda { mail_plugins = " zlib sieve" } local_name imap.xxxx.xx { ssl_cert = </etc/ssl/dovecot/imap.xxxx.xx.crt ssl_key = # hidden, use -P to show it } local_name imap.xxxxxxxx.xx { ssl_cert = </etc/ssl/dovecot/imap.xxxxxxxx.xx.crt ssl_key = # hidden, use -P to show it }

1 0

Doveadm error since 2.3.11.3 when run as unprivileged user
by Arjen de Korte 15 Aug '20

15 Aug '20

I allow users to run 'doveadm' for mailbox maintenance (to expunge mail for instance). Since the upgrade to 2.3.11.3, this no longer works and results in the following error message: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-ssl.conf line 13: ssl_key: Can't open file /etc/ssl/private/de-korte.org.key: Permission denied This is no surprise, as non-privileged users are not allowed to read the private keys of the server. Question is, why is doveadm trying to read this key in the first place (it is not needed for mailbox maintenance) and why is it failing now? Regards, Arjen

4 6

User doesn't exist
by Bruno Kiste 15 Aug '20

15 Aug '20

I try to use dovecot as a MTA with postfix. But it does not accept incoming mails. Why does it not work? [root@localhost bruno]# dovecot --version 2.3.8 (9df20d2db) /var/log/maillog Aug 14 11:03:32 localhost dovecot[566097]: lmtp(566373): Connect from local Aug 14 11:03:32 localhost dovecot[566097]: lmtp(bruno(a)2c2axxx.online-server.cloud)<566373><0O+4HWRTNl9lpAgA0J78UA>: Debug: auth-master: userdb lookup(bruno(a)2c2axxx.online-server.cloud): Started userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: lmtp(bruno(a)2c2axxx.online-server.cloud)<566373><0O+4HWRTNl9lpAgA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting Aug 14 11:03:32 localhost dovecot[566097]: lmtp(bruno(a)2c2axxx.online-server.cloud)<566373><0O+4HWRTNl9lpAgA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=16) Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: master in: USER#0111#011bruno(a)2c2axxx.online-server.cloud#011service=lmtp Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: passwd(bruno(a)2c2axxx.online-server.cloud): Performing userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.so Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: passwd-file /etc/dovecot/users: Read 4 users in 0 secs Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: conn unix:auth-worker (pid=566367,uid=97): Server accepted connection (fd=14) Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: conn unix:auth-worker (pid=566367,uid=97): Sending version handshake Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: conn unix:auth-worker (pid=566367,uid=97): auth-worker<1>: Handling USER request Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: passwd(bruno(a)2c2axxx.online-server.cloud): Performing userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: passwd(bruno(a)2c2axxx.online-server.cloud): lookup Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): passwd(bruno(a)2c2axxx.online-server.cloud): unknown user - trying the next userdb Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: passwd(bruno(a)2c2axxx.online-server.cloud): Finished userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: auth-worker(566374): Debug: conn unix:auth-worker (pid=566367,uid=97): auth-worker<1>: Finished Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: passwd(bruno(a)2c2axxx.online-server.cloud): Finished userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: passwd-file(bruno(a)2c2axxx.online-server.cloud): Performing userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: passwd-file(bruno(a)2c2axxx.online-server.cloud): lookup: user=bruno(a)2c2axxx.online-server.cloud file=/etc/dovecot/users Aug 14 11:03:32 localhost dovecot[566097]: auth: passwd-file(bruno(a)2c2axxx.online-server.cloud): unknown user Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: passwd-file(bruno(a)2c2axxx.online-server.cloud): Finished userdb lookup Aug 14 11:03:32 localhost dovecot[566097]: auth: Debug: userdb out: NOTFOUND#0111 Aug 14 11:03:32 localhost dovecot[566097]: lmtp(bruno(a)2c2axxx.online-server.cloud)<566373><0O+4HWRTNl9lpAgA0J78UA>: Debug: auth-master: userdb lookup(bruno(a)2c2axxx.online-server.cloud): auth USER input: Aug 14 11:03:32 localhost dovecot[566097]: lmtp(bruno(a)2c2axxx.online-server.cloud)<566373><0O+4HWRTNl9lpAgA0J78UA>: Debug: auth-master: userdb lookup(bruno(a)2c2axxx.online-server.cloud): Userdb lookup failed Aug 14 11:03:32 localhost postfix/lmtp[566372]: 4E2127802973: to=<bruno(a)2c2axxx.online-server.cloud>, relay=2c2axxx.online-server.cloud[private/dovecot-lmtp], delay=0.26, delays=0.19/0.02/0.02/0.02, dsn=5.1.1, status=bounced (host 2c2axxx.online-server.cloud[private/dovecot-lmtp] said: 550 5.1.1 <bruno(a)2c2axxx.online-server.cloud> User doesn't exist: bruno(a)2c2axxx.online-server.cloud (in reply to RCPT TO command)) [root@localhost bruno]# cat /etc/dovecot/users #user:password:uid:gid:(gecos):home:(shell):extra_fields bruno:{CRAM-MD5}88XXXee:5001:5001::/home/bruno:: mail:{CRAM-MD5}88XXXee:5001:5001::/home/mail:: nas:{CRAM-MD5}8eXXX40:5001:5001::/home/nas asys:{CRAM-MD5}99XXX09:5001:5001::/home/asys

3 3

CentOS 8 packages available
by Aki Tuomi 14 Aug '20

14 Aug '20

We are happy to announce that we have CentOS 8 packages available starting from v2.3.11.3. You can find these packages at https://repo.dovecot.org/ Regards, Aki Tuomi Open-Xchange oy

2 1

2.3.11.3 on 32bit platforms
by Christian Göttsche 14 Aug '20

14 Aug '20

See also the 32bit build failures on Debian: https://buildd.debian.org/status/package.php?p=dovecot There are some compiler warnings on 32bit architectures in test-mech.c test-mech.c: In function ‘test_mechs’: test-mech.c:326:61: warning: format ‘%lu’ expects argument of type ‘long unsigned int’, but argument 4 has type ‘unsigned int’ [-Wformat=] 326 | const char *testname = t_strdup_printf("auth mech %s %d/%lu", | ~~^ | | | long unsigned int | %u test-mech.c:338:12: warning: passing argument 2 of ‘test_mech_construct_apop_challenge’ from incompatible pointer type [-Wincompatible-pointer-types] 338 | &test_case->len); | ^~~~~~~~~~~~~~~ | | | size_t * {aka unsigned int *} test-mech.c:195:77: note: expected ‘long unsigned int *’ but argument is of type ‘size_t *’ {aka ‘unsigned int *’} 195 | test_mech_construct_apop_challenge(unsigned int connect_uid, unsigned long *len_r) | ~~~~~~~~~~~~~~~^~~~~ But the unit test still fails after a commit like: diff --git a/src/auth/test-mech.c b/src/auth/test-mech.c index cf05370..90c2215 100644 --- a/src/auth/test-mech.c +++ b/src/auth/test-mech.c @@ -192,7 +192,7 @@ static void test_mech_handle_challenge(struct auth_request *request, } static inline const unsigned char * -test_mech_construct_apop_challenge(unsigned int connect_uid, unsigned long *len_r) +test_mech_construct_apop_challenge(unsigned int connect_uid, size_t *len_r) { string_t *apop_challenge = t_str_new(128); @@ -323,7 +323,7 @@ static void test_mechs(void) struct test_case *test_case = &tests[running_test]; const struct mech_module *mech = test_case->mech; struct auth_request *request; - const char *testname = t_strdup_printf("auth mech %s %d/%lu", + const char *testname = t_strdup_printf("auth mech %s %d/%zu", mech->mech_name, running_test+1, N_ELEMENTS(tests));

1 0

About the changing namespace handling from v2.0 to v2.1 or later
by mizuta.takeshi＠fujitsu.com 14 Aug '20

14 Aug '20

Hi, all, Please tell me about the patch and description below. https://github.com/dovecot/core/commit/5f46b863383fc94afcd2693ecae8788cb5fd… example-config: Use a default uncommented "namespace inbox". https://doc.dovecot.org/configuration_manual/namespace/ There's a default inbox namespace added in 10-mail.conf. If the configuration doesn't explicitly specify a namespace (as was in v2.0 and older) a default namespace is created automatically. Since v2.1, namespace is enabled by default in 10-mail.conf, and "inbox" is added as a sectionname of namespace. I checked the dovecot's mail archive, but I didn't understand the reason for the change. Please tell me about followings. - Why "inbox" was added as a sectionname? - Why was namespace changed to be enabled by default? Best regards, MIZUTA Takeshi

1 0

2.3.11.3 mail_cache_open_or_create_path called with null path
by Stuart Henderson 13 Aug '20

13 Aug '20

Originally reported here - https://marc.info/?l=openbsd-ports&m=159731598419071&w=2 OpenBSD's printf functions have a (mostly annoying but occasionally useful) feature where they generate a syslog entry if printf %s format is called with a null pointer. It is tripped in lmtp/lda deliveries with 2.3.11.3: lmtp: vfprintf %s NULL in "Cache %s: " dovecot-lda: vfprintf %s NULL in "Cache %s: " src/lib-index/mail-cache.c: .. 557 struct mail_cache * 558 mail_cache_open_or_create_path(struct mail_index *index, const char *path) 559 { .. 565 cache->filepath = i_strdup(path); .. 572 event_set_append_log_prefix(cache->event, 573 t_strdup_printf("Cache %s: ", cache->filepath); .. Seems something is wrong to have this function called with no cache path?

2 1

Fix for pigeonhole 0.5.11
by Aki Tuomi 13 Aug '20

13 Aug '20

Hi! We have made a small fix to the Pigeonhole 0.5.11 tarball, please find the new tarball at https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.11.t… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.11.t… The original released tarball is still available. The only change here is that the configure.ac file has correctly formatted version number. Regards, Aki Tuomi Open-Xchange oy

1 0

CentOS 6 packages dropped
by Aki Tuomi 13 Aug '20

13 Aug '20

Hi! We are dropping CentOS 6 packages now that we have CentOS 8 packages available. 2.3.11.3 will be last version for which CentOS 6 packages are built for https://repo.dovecot.org. Regards, Aki Tuomi Open-Xchange oy

1 0

Correcting Mail Home, Maildir and Sieve folder locations
by David White 13 Aug '20

13 Aug '20

I have Dovecot 2.3.7.2 on Ubuntu 20.04. I just migrated the server from CentOS 8, and only migrated to the CentOS 8 machine a few months ago off of CentOS 7. I am pasting `doveconf -n` at the bottom of this email. Everything is working. However, I'm trying to clean up warnings in the logs, and just discovered that I'm not managing home directories properly. (c/f https://wiki.dovecot.org/VirtualUsers/Home) This is in the logs: > Jun 28 06:09:50 mail.example.com dovecot: imap(email(a)example.com)<3786><fICEJCKpbfatQHg1>: Error: stat(/var/vmail/example.com/email@example.com/.dovecot.sieve/tmp) failed: Not a directory Can I please get a sanity check? To resolve, I've come up with a bash loop to create a home folder, and fix the existing structure for each mailbox on the system. I ran this for 1 of the domains on the system. > for i in */ ; do mv "$i" mail; mkdir "$i"; mv mail "$i"; mv "$i"/.dovecot* "$i"; done Then, I would simply edit /etc/dovecot/conf.d/10-mail.conf so that it looks like this: > mail_home = /var/vmail/%d/%u > mail_location = maildir:/var/vmail/%d/%u/mail To confirm, should all of the 'hidden' dovecot files be moved to the user's new home folder like I'm trying to do in the above script? Or are there other files that I will need to move? After running that loop above on a test server (don't worry, I would never do this in production without testing), one of the mailbox's home folder on the server looks like this: > total 56 > drwxr-xr-x 4 vmail vmail 4096 Jun 28 06:19 . > drwx------ 6 vmail vmail 4096 Jun 28 06:09 .. > -rw------- 1 vmail vmail 54 Jul 4 2019 .dovecot.lda-dupes > lrwxrwxrwx 1 vmail vmail 21 May 26 2016 .dovecot.sieve -> sieve/roundcube.sieve > -rw------- 1 vmail vmail 0 Oct 17 2016 .dovecot.sieve.log > -rw------- 1 vmail vmail 218 Jul 6 2019 .dovecot.svbin > drwx------ 277 vmail vmail 32768 Jun 28 06:19 mail > drwx------ 3 vmail vmail 4096 Feb 2 17:31 sieve ... and connecting to that mailbox over Thunderbird seems to be working fine. But I want to make sure I'm not missing anything. Here is my doveconf -n, with identifying information snipped out: > root@mail:# doveconf -n > # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.7.2 () > # OS: Linux 5.4.0-39-generic x86_64 Ubuntu 20.04 LTS ext4 > # Hostname: {snip} > auth_mechanisms = plain login > mail_location = maildir:/var/vmail/%d/%u > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Spam { > auto = create > special_use = \Junk > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > sieve = file:~/sieve;active=~/.dovecot.sieve > } > protocols = imap pop3 lmtp sieve > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = postfix > mode = 0666 > user = vmail > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0666 > user = postfix > } > } > ssl = required > ssl_ca = </etc/ssl/certs/snip.ca-bundle > ssl_cert = </etc/ssl/certs/snip.crt > ssl_cipher_list = ALL:!LOW:!SSLv3:!EXP:!aNULL:!MD5 > ssl_key = # hidden, use -P to show it > userdb { > args = uid=vmail gid=vmail home=/var/vmail/%d/%u > driver = static > } Sent with ProtonMail Secure Email.

1 1