- dovecot - dovecot.org

Segfault when using doveadm batch -A : kick
by Apollon Oikonomopoulos 08 Dec '18

08 Dec '18

Hi, Apparently the "kick" doveadm_cmd_ver2 struct lacks a .mail_cmd member pointing to an appropriate allocation function, causing a NULL pointer dereference when used via `doveadm batch`. (gdb) bt #0 0x0000000000000000 in ?? () #1 0x0000555555585882 in doveadm_mail_cmd_init (cmd=cmd@entry=0x7fffffffe680, set=0x5555555f2440) at doveadm-mail.c:596 #2 0x0000555555586f68 in cmd_batch_add (argv=<optimized out>, argc=<optimized out>, batchctx=0x555555606538) at doveadm-mail-batch.c:78 #3 cmd_batch_preinit () at doveadm-mail-batch.c:126 #4 0x00005555555854ce in doveadm_mail_cmd_exec () at doveadm-mail.c:632 #5 0x0000555555585e66 in doveadm_mail_cmd (argv=<optimized out>, argc=4, cmd=0x555555602a00) at doveadm-mail.c:748 #6 doveadm_mail_try_run () at doveadm-mail.c:821 #7 0x0000555555575e7f in main () at doveadm.c:404 #8 0x00007ffff74acb17 in __libc_start_main (main=0x555555575990 <main>, argc=5, argv=0x7fffffffea18, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fffffffea08) at ../csu/libc-start.c:310 #9 0x0000555555575fca in _start () at doveadm-mail.c:1127 (gdb) p *cmd $5 = {alloc = 0x0, name = 0x5555555bdd0c "kick", usage_args = 0x5555555be738 "[-a <anvil socket path>] <user mask>[|]<ip/bits>"} (This is Debian bug #915411[1]) Regards, Apollon [1] https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=915411

2 2

Different listeners with different config
by Peter Mogensen 07 Dec '18

07 Dec '18

Hi, I was wondering about the status on being able to create a dedicated listener in Dovecot with - say - extra features enabled. As an example... If I wanted to have Dovecot listening on port 144 with a slightly different set of auth mechanisms enabled. /Peter

1 0

argonid and dovecote
by Jerry 06 Dec '18

06 Dec '18

on a FreeBSD 11.2 amd64 machine, I am trying to get Dovecot 2.3.4 to play nice with "argonid" encryption. In the "10-auth.conf" file, I tried: auth_mechanisms = plain argon2id Upon restarting dovecot, I received an error message when attempting to actually it: auth: FATAL: Unknown authentication mechanism "ARGON2ID" Output from doveadm pw -l doveadm pw -l SHA1 SSHA512 BLF-CRYPT PLAIN HMAC-MD5 OTP SHA512 SHA RPA DES-CRYPT CRYPT SSHA MD5-CRYPT SKEY PLAIN-MD4 PLAIN-MD5 SCRAM-SHA-1 LANMAN SHA512-CRYPT CLEAR CLEARTEXT ARGON2I ARGON2ID SSHA256 NTLM MD5 PBKDF2 SHA256 CRAM-MD5 PLAIN-TRUNC SHA256-CRYPT SMD5 DIGEST-MD5 LDAP-MD5 I assume I am making a stupid mistake, but I do not know what it is. -- Jerry

3 8

Dovecot 2.3.4 crashing on Solaris 10 - "Panic: output stream is missing error handling"
by Fabian Fritz 06 Dec '18

06 Dec '18

Hi, I just compiled Dovecot for Solaris 10 and try to run it now. Other than setting a custom port, I did not add custom settings. When I tried running doveconf for the first time, it crashed immediately: doveconf -n # 2.3.4 (): /export/dovecot/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4u~~ # Hostname: merlin service pop3-login { inet_listener pop3 { port = 1110 } } submission_max_mail_size = 0 doveconf: Panic: output stream is missing error handling doveconf: Error: Raw backtrace: 0xff01b3a8 -> 0xff063b04 -> 0x1673c -> 0x1797c -> 0x14478 Abort (core dumped) The same error appears when I run dovecot -F. Unfortunately I currently don't have access to the core dumps (I might do later), but I could run it with the Debugger with user process debugging enabled: (This is the part when it crashes. I can provide the full output if requested) truss -u "libdovecot" /export/dovecot/bin/doveconf -n service pop3-login { inet_listener pop3 { port = 1110 } } submission_max_mail_size = 0 /1: write(1, " s e r v i c e p o p 3".., 95) = 95 /1@1: <- libdovecot:o_stream_uncork() = 0xa1918 /1@1: -> libdovecot:buffer_free(0xa1a10, 0x0, 0x0, 0x0) /1@1: -> libdovecot:pool_system_free(0xff0fb050, 0x4af10, 0xff0fb030, 0xff059470) /1@1: <- libdovecot:buffer_free() = 0 /1@1: -> libdovecot:buffer_free(0xa1a18, 0x1c00, 0xfec47940, 0x0) /1@1: -> libdovecot:pool_system_free(0xff0fb050, 0x4af60, 0xff0fb030, 0xff059470) /1@1: <- libdovecot:buffer_free() = 0 /1@1: -> libdovecot:pool_datastack_create(0xc3ed8, 0xc4200, 0x328, 0x0) /1@1: <- libdovecot:pool_datastack_create() = 0x42a58 /1@1: -> libdovecot:buffer_create_dynamic(0x42a58, 0x20, 0x8000, 0xff0f44f4) /1@1: <- libdovecot:buffer_create_dynamic() = 0x42a68 /1@1: -> libdovecot:buffer_append(0x42a68, 0x525c8, 0x4, 0x42a68) /1@1: -> libdovecot:buffer_write(0x42a68, 0x0, 0x525c8, 0x4) /1@1: <- libdovecot:buffer_append() = 0x42a88 /1@1: -> libdovecot:array_sort_i(0xffbfec38, 0x1cd70, 0x0, 0x52830) /1@1: <- libdovecot:array_sort_i() = 0x42a88 /1@1: -> libdovecot:buffer_append_space_unsafe(0x42a68, 0x4, 0x4, 0x1cd70) /1@1: -> libdovecot:buffer_get_space_unsafe(0x42a68, 0x4, 0x4, 0x1cd70) /1@1: <- libdovecot:buffer_append_space_unsafe() = 0x42a8c /1@1: -> libdovecot:o_stream_uncork(0xa1968, 0xffbfedb0, 0x0, 0x1) /1@1: <- libdovecot:o_stream_uncork() = 0xa1918 /1@1: -> libdovecot:o_stream_destroy(0xffbfed3c, 0x0, 0x0, 0x1) /1@1: -> libdovecot:o_stream_unref(0xffbfed3c, 0x0, 0x0, 0x1) doveconf: Panic: output stream is missing error handling /1: write(2, " d o v e c o n f : P a".., 58) = 58 /1: getcontext(0xFFBFE988) /1: open("/proc/self/as", O_RDONLY) = 8 /1: fstat64(8, 0xFFBFE7B8) = 0 /1: pread(8, "FFBFEB H", 4, 0xFFBFE958) = 4 /1: pread(8, "FF\0CBD0", 4, 0xFFBFE95C) = 4 /1: pread(8, "FFBFEBA8", 4, 0xFFBFEB80) = 4 /1: pread(8, "FF01B11C", 4, 0xFFBFEB84) = 4 /1: pread(8, "FFBFEC\b", 4, 0xFFBFEBE0) = 4 /1: pread(8, "FF01B3A8", 4, 0xFFBFEBE4) = 4 /1: pread(8, "FFBFEC80", 4, 0xFFBFEC40) = 4 /1: pread(8, "FF06 ;04", 4, 0xFFBFEC44) = 4 /1: pread(8, "FFBFECE0", 4, 0xFFBFECB8) = 4 /1: pread(8, "\001 g <", 4, 0xFFBFECBC) = 4 /1: pread(8, "FFBFED @", 4, 0xFFBFED18) = 4 /1: pread(8, "\001 y |", 4, 0xFFBFED1C) = 4 /1: pread(8, "FFBFEDF0", 4, 0xFFBFED78) = 4 /1: pread(8, "\001 D x", 4, 0xFFBFED7C) = 4 /1: pread(8, "\0\0\0\0", 4, 0xFFBFEE28) = 4 /1: pread(8, "\0\0\0\0", 4, 0xFFBFEE2C) = 4 /1: close(8) = 0 doveconf: Error: Raw backtrace: 0xff01b3a8 -> 0xff063b04 -> 0x1673c -> 0x1797c -> 0x14478 /1: write(2, " d o v e c o n f : E r".., 90) = 90 /1: sigaction(SIGABRT, 0x00000000, 0xFFBFEB88) = 0 /1: sigaction(SIGABRT, 0xFFBFEA38, 0xFFBFEAD8) = 0 /1: lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000) = 0xFFBFFEFF [0x0000FFFF] /1: lwp_kill(1, SIGABRT) = 0 /1: Received signal #6, SIGABRT [default] /1: siginfo: SIGABRT pid=25172 uid=0 code=-1 I have no idea about what that error means. Thanks, Fabian

1 0

Restricting sending mail to domain or group
by admin 06 Dec '18

06 Dec '18

Hi folks, has anybody a simple solution for the following request? I have a group alias (all(a)company.com) (1) Only company.com accounts should be able to send an email to everybody in that company via all(a)company.com. (2) - rather optional: refine the restrictions, e.g. two groups, grp1(a)company.com and grp2(a)company.com. Grp1 members should be able to send mails to grp2 but not vice versa. What else than sieve would keep dealing with that demands as simple as possible? Thanks in advance and sorry for abusing this list for this kind of „problem“ which is not a bug. Regards, -M

5 7

Error: Corrupted record in index cache file
by Orion Poplawski 05 Dec '18

05 Dec '18

With dovecot-2.2.36-3.el7.x86_64 we had a couple hours where mail_plugins did not properly include zlib for all of the needed services. This seems to have led to some corruption in our mdbox mailboxes. I've run doveadm force-resync on a number of users, but I'm still seeing messages like this: dovecot[13563]: imap(USER): Error: Corrupted record in index cache file /var/spool/imap/USER/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 67976: Broken physical size in mailbox INBOX: read(zlib(/var/spool/mail/USER/storage/m.1203)) failed: Cached message size smaller than expected (2978 < 8192, box=INBOX, UID=67976) Is there anything that can be done about this? Can I safely delete the dovecot.index.cache file? I'm hesitant to do so since I understand that the mdbox format uses the index to store mailbox information and deleting at least some index files is a destructive operation. Thanks! -- Orion Poplawski Manager of NWRA Technical Systems 720-772-5637 NWRA, Boulder/CoRA Office FAX: 303-415-9702 3380 Mitchell Lane orion(a)nwra.com Boulder, CO 80301 https://www.nwra.com/

2 2

vacation script issue
by fins 05 Dec '18

05 Dec '18

Hello, I have a complete Postfix + Dovecot + openLDAP setup almost working, the only issue I have is the vacation script auto-reply that doesn't work properly. If I send an email to a user with the vacation filter enabled, the auto-reply is send to a local recipient with the same account name. So for example if I send a mail from test(a)xyz.com to test(a)example.com, the auto-reply is received on the test(a)example.com address instead of the test(a)xyz.com who's the original sender. Here's a log file: Dec 3 13:52:48 imap dovecot: lda(test(a)example.com): Debug: sieve: executing script from /var/mail/example.com/test/.dovecot.svbin Dec 3 13:52:48 imap dovecot: lda(test(a)example.com): sieve: msgid=< dovecot-sieve-1543841568-836314-0(a)imap.example.com>: discarding vacation response to auto-submitted message from <MAILER-DAEMON> Dec 3 13:52:48 imap dovecot: lda(test(a)example.com): sieve: msgid=< dovecot-sieve-1543841568-836314-0(a)imap.example.com>: stored mail into mailbox 'INBOX' Dec 3 13:52:48 imap postfix/pipe[6663]: D835A300E05: to=<test(a)example.com>, orig_to=<test(a)xyz.com>, relay=dovecot, delay=0.1, delays=0.03/0.01/0/0.06, dsn=2.0.0, status=sent (delivered via dovecot service) Can somebody help with this issue and/or point where to go for debugging? Please find my dovecot configuration bellow: dovecot -n > # 2.2.10: /etc/dovecot/dovecot.conf > # OS: Linux 3.10.0-862.11.6.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) xfs > auth_debug = yes > auth_mechanisms = plain login > auth_verbose = yes > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_debug = yes > mail_gid = mail > mail_home = /var/mail/%d/%n > mail_location = maildir:/var/mail/%d/%n/Maildir > mail_plugins = " quota" > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > mbox_write_locks = fcntl > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > quota = maildir:User quota > quota_grace = 10%% > quota_rule2 = Trash:storage=+100M > quota_status_nouser = DUNNO > quota_status_overquota = 552 5.2.2 Mailbox is full > quota_status_success = DUNNO > quota_warning = storage=95%% quota-warning 95 %u it > quota_warning2 = storage=80%% quota-warning 80 %u it > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap pop3 lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0600 > user = vmail > } > } > service imap-login { > inet_listener imap { > port = 0 > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 0 > } > } > service quota-status { > client_limit = 1 > executable = quota-status -p postfix > inet_listener { > port = 12340 > } > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = vmail > } > ssl = required > ssl_cert = </etc/pki/tls/certs/imap.example.com.crt > ssl_key = </etc/pki/tls/private/imap.example.com.key > userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lda { > mail_plugins = " quota sieve" > } > protocol imap { > mail_plugins = " quota imap_quota" > } > > dovecot-ldap.conf.ext hosts = example.com > base = ou=People,dc=example,dc=com > ldap_version = 3 > auth_bind = yes > user_filter = (&(objectClass=posixAccount)(uid=%n)) > pass_filter = (&(objectClass=posixAccount)(uid=%n)) > > user_attrs = \ > mailRoutingAddress=user, \ > =uid=vmail, \ > =gid=mail, \ > =home=/var/mail/%d/%n, \ > =quota_rule=*:bytes=%{ldap:departmentNumber} > > > pass_attrs= mailRoutingAddress=user > > tls = yes > My vacation script: require ["date","relational","vacation"]; > # rule:[Vacation] > if allof (currentdate :zone "+0100" :value "ge" "iso8601" > "2018-12-02T02:00:00+01:00", currentdate :zone "+0100" :value "le" > "iso8601" "2018-12-24T04:00:00+01:00") > { > vacation :addresses "test(a)example.com" :subject "Away" "I'm away"; > } >

1 2

Random issue on mailbox "assertion failed"
by Thomas Durand 05 Dec '18

05 Dec '18

Hi, Since few weeks, I have regularly the issue below with some mailboxes - This is happening randomly. Users are complaining emails are not visible. The situation is recovered by removing indexes but I would like to have it fix permanently. Ruuning dovecot 2.2.10 - Anyone to advise me what is wrong ? Thanks. Dec 05 08:03:37 justyna.rezoo.org dovecot[18684]: imap(XXX): Panic: file mail-index-sync-keywords.c: line 227 (keywords_update_records): assertion failed: (data_offset >= sizeof(struct mail_index_record)) Dec 05 08:03:37 justyna.rezoo.org dovecot[18684]: imap(xxx: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x6a06e) [0x7fb890be706e] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6a14e) [0x7fb890be714e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb890b9f52c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_keywords+0x808) [0x7fb890f205c8] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xfd) [0x7fb890f20eed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x21e) [0x7fb890f21e8e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x3e7) [0x7fb890f12b77] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb937d) [0x7fb890f0e37d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb9990) [0x7fb890f0e990] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x8c) [0x7fb890f0ea7c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x87) [0x7fb890eff9c7] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d882) [0x7fb890ea2882] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d963) [0x7fb890ea2963] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x2a4c) [0x7fb89018fa4c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x802b4) [0x7fb890ed52b4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7fb890ed5430] -> dovecot/imap(cmd_select_full+0x172) [0x7fb8913b0432] -> dovecot/imap(command_exec+0x3c) [0x7fb8913b601c] -> dovecot/imap(+0x17f1f) [0x7fb8913b4f1f] -> dovecot/imap(+0x18005) [0x7fb8913b5005] -> dovecot/imap(client_handle_input+0x14d) [0x7fb8913b52fd] -> dovecot/imap(client_input+0x85) [0x7fb8913b56c5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fb890bf7a87] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xff) [0x7fb890bf890f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb890bf75d8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb890ba49e3] -> dovecot/imap(main+0x2c4) [0x7fb8913a9324] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7fb8907cf3d5] Thomas Durand +336 12 07 31 87 thomas.durand(a)rezoo.org

1 0

Re: Re[2]: BUG: sieve does not set seen-Flag
by Tuomi, Aki 05 Dec '18

05 Dec '18

please send mail to dovecot-unsubscribe(a)dovecot.org Sent from my Samsung Galaxy smartphone. -------- Original message --------From: "Сергей . via dovecot" <dovecot(a)dovecot.org> Date: 05/12/2018 08:26 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Re[2]: BUG: sieve does not set seen-Flag Unsubscribe me please. I've been seeing these messages for several days and don't want anymore. Please. Среда, 5 декабря 2018, 3:22 +03:00 от Ralph Seichter <m16+dovecot(a)monksofcool.net>: * Jakobus Schürz: > 1543935543.M447415P13997.mymail,S=726,W=748:2,Sa > > Then i move this email to another IMAP-Folder, and then there is the > filename > > 1543935543.M447415P13997.mymail,S=726,W=748:2, > > As expected, the seen-flag disappeared... the same as thunderbird > shows. And what about the "dovecot-keywords" files in both folders? Do they match? The letter "a" seems to indicates that there is at least one non-standard flag defined in the source folder's keywords. By the way, can I assume you move messages only by using Thunderbird/IMAP and not by manipulating the file system? Here's how things look on my server: # On arrival (UNSEEN) 1543968031.M941319P5841.foo,S=1390,W=1422:2, # After reading (SEEN) 1543968031.M941319P5841.foo,S=1390,W=1422:2,S # After being moved to another folder (SEEN) 1543968031.M941319P5841.foo,S=1390,W=1422:2,S I can use IMAP search terms SEEN and UNSEEN as indicated above, and I see the same message state displayed in Notmuch mail (my default, it accesses Dovecot's Maildir storage directly) and various IMAP clients connecting to Dovecot. Things are working just fine here. -Ralph -- Сергей .

2 1

Lda fatal: setgid (102 from userdb lookup) failed
by James Brown 05 Dec '18

05 Dec '18

Sorry if this is a nubbie question, but I’m getting: lda(jlbrown(a)bordo.com.au)<4444><QFg5KRHVBBxcEQAAYBwt+A>: Fatal: setgid(102 from userdb lookup) failed with euid=501(jlbrown), gid=20(staff), egid=20(staff): Operation not permitted (This binary should probably be called with process group set to 102 instead of 20(staff)) How can I fix this? (macOS Mojave, Dovecot 2.3.4) Thanks, James.

2 2