- dovecot - dovecot.org

Regression ACL & namespace prefix
by Michal Hlavinka 28 Mar '19

28 Mar '19

Hi tl;dr: Seems that for Global ACL directory, namespace prefix is not part of the path, when looking for acl file. Long version: We're planning to update dovecot in next os update to 2.2.36 and while going through regression testing, we found a problem with ACL configuration combined with namespace. Test uses "Global ACL directory" configuration. Relevant configuration part: mail_location = maildir:~/Maildir namespace inbox { hidden = no inbox = yes list = yes location = prefix = separator = / } namespace { hidden = no list = yes location = maildir:/var/mail/pub prefix = pub/ separator = / type = public } mail_plugins = acl protocol imap { mail_plugins = $mail_plugins acl imap_acl } plugin { acl = vfile:/etc/dovecot/global-acls } ACL config file is stored at: /etc/dovecot/global-acls/pub/.DEFAULT when trying to examine "pub", it is denied: fetchmail: IMAP> A0005 EXAMINE "pub" fetchmail: IMAP< A0005 NO Mailbox doesn't exist: pub (0.001 + 0.000 secs). # doveadm acl debug -u d2 pub doveadm(d2): Info: Mailbox '' is in namespace 'pub/' doveadm(d2): Info: Mailbox path: /var/mail/pub doveadm(d2): Info: All message flags are shared across users in mailbox doveadm(d2): Info: User d2 has no rights for mailbox doveadm(d2): Error: User d2 is missing 'lookup' right doveadm(d2): Info: Mailbox pub is NOT visible in LIST because it did not find acl file: imap(d2): Debug: Namespace : type=public, prefix=pub/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/pub imap(d2): Debug: maildir++: root=/var/mail/pub, index=, indexpvt=, control=, inbox=, alt= imap(d2): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls imap(d2): Debug: acl: acl username = d2 imap(d2): Debug: acl: owner = 0 imap(d2): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/global-acls imap(d2): Debug: pub: Mailbox opened because: EXAMINE imap(d2): Debug: acl vfile: file /etc/dovecot/global-acls//.DEFAULT not found imap(d2): Debug: acl vfile: file /var/mail/pub/dovecot-acl not found see it's looking for: /etc/dovecot/global-acls//.DEFAULT instead of /etc/dovecot/global-acls/pub/.DEFAULT Checking with documentation https://wiki.dovecot.org/ACL it seems that prefix should still be part of the path, as it was before: """The filenames must start with namespace prefix (if it has one). For example with namespace prefix=INBOX/ containing mailbox "foo" use /etc/dovecot/acls/INBOX/foo.""" Just for comparison, previous version (2.2.10) would work fine: imap(d2): Debug: Namespace : type=public, prefix=pub/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/pub imap(d2): Debug: maildir++: root=/var/mail/pub, index=, indexpvt=, control=, inbox=, alt= imap(d2): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls imap(d2): Debug: acl: acl username = d2 imap(d2): Debug: acl: owner = 0 imap(d2): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls imap(d2): Debug: acl vfile: reading file /etc/dovecot/global-acls/pub/.DEFAULT imap(d2): Debug: acl vfile: file /var/mail/pub/dovecot-acl not found I've localized problem to: src/plugins/acl/acl-backend-vfile.c: acl_backend_vfile_object_init(...) and change from: vname = mailbox_list_get_vname(_backend->list, name); to: vname = *name == '\0' ? "" : mailbox_list_get_vname(_backend->list, name); that happened quite time ago during bigger acl changes and I don't know why exactly this line was changed previously. Anyway, reverting this line alone fixes the problem and while testing both per-mailbox ACL vfile and Global ACL file, reverting this did not affect them.

3 7

CVE-2019-7524 backport patch for 2.2.33.2
by Gerald Galster 28 Mar '19

28 Mar '19

Hello Aki, I'm currently stuck with 2.2.33.2 as 2.2.36 still duplicates mails after pop3 deletion on a two node dsync cluster. Therefore I've created a small patch and it seems only these two files are affected: dovecot-2.2.36.3/src/lib-storage/index/index-pop3-uidl.c dovecot-2.2.36.3/src/plugins/fts/fts-api.c Please correct me if I have missed something. Best regards Gerald

2 1

CVE-2019-7524: Buffer overflow when reading extension header from dovecot index files
by Aki Tuomi 28 Mar '19

28 Mar '19

Product: Dovecot Vendor: OX Software GmbH Internal reference: DOV-2964 (Bug ID) Vulnerability type: CWE-120 Vulnerable version: 2.0.14 - 2.3.5 Vulnerable component: fts, pop3-uidl-plugin Report confidence: Confirmed Researcher credits: Found in internal testing Solution status: Fixed by Vendor Fixed version: 2.3.5.1, 2.2.36.3 Vendor notification: 2019-02-05 Solution date: 2019-03-21 Public disclosure: 2019-03-28 CVE reference: CVE-2019-7524 CVSS: 3.0/AV:L/AC:L/PR:L/UI:N/S:C/C:H/I:H/A:H/E:P/RL:O/RC:C (8.8) Vulnerability Details: When reading FTS or POP3-UIDL header from dovecot index, the input buffer size is not bound, and data is copied to target structure causing stack overflow. Risk: This can be used for local root privilege escalation or executing arbitrary code in dovecot process context. This requires ability to directly modify dovecot indexes. Steps to reproduce: Produce dovecot.index.log entry that creates an FTS header which has more than 12 bytes of data. Trigger dovecot indexer-worker or run doveadm index. Dovecot will crash. Mitigations: Since 2.3.0 dovecot has been compiled with stack smash protection, ASLR, read-only GOT tables and other techniques that make exploiting this bug much harder. Solution: Operators should update to the latest Patch Release. The only workaround is to disable FTS and pop3-uidl plugin. -- Aki Tuomi Open-Xchange Oy

2 4

v2.2.36.3 released
by Aki Tuomi 28 Mar '19

28 Mar '19

https://dovecot.org/releases/2.3/dovecot-2.2.36.3.tar.gz https://dovecot.org/releases/2.3/dovecot-2.2.36.3.tar.gz.sig * CVE-2019-7524: Missing input buffer size validation leads into arbitrary buffer overflow when reading fts or pop3 uidl header from Dovecot index. Exploiting this requires direct write access to the index files. --- Aki Tuomi Open-Xchange oy

1 1

dovecot mailing list stopped delivering mail
by Christian Anthon 28 Mar '19

28 Mar '19

Strangest thing. Since some time Marts 25. I'm no longer receiving mails from the dovecot mailing list server. Mails from other sources are behaving fine. Instead I'm just seing Mar 26 08:27:54 dna01 postfix/smtpd[107746]: Anonymous TLS connection established from talvi.dovecot.org[94.237.25.159]: TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits) Mar 26 08:27:54 dna01 postfix/smtpd[107746]: disconnect from talvi.dovecot.org[94.237.25.159] ehlo=1 starttls=1 quit=1 commands=3 And then no more. I tried turning up the postfix verbosity, but I'm none the wiser. I realize that this is probably not a dovecot issue, but anybody with any ideas? Cheers, Christian (and please send an off-list reply also) Verbose log: Mar 28 10:57:42 dna01 postfix/smtpd[66648]: connection established Mar 28 10:57:42 dna01 postfix/smtpd[66648]: master_notify: status 0 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: name_mask: resource Mar 28 10:57:42 dna01 postfix/smtpd[66648]: name_mask: software Mar 28 10:57:42 dna01 postfix/smtpd[66648]: connect from talvi.dovecot.org[94.237.25.159] Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: smtp_stream_setup: maxtime=300 enable_deadline=0 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 192.168.3.0/24 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 192.168.3.0/24 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 127.0.0.0/8 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 127.0.0.0/8 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr request = connect Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr ident = smtp:94.237.25.159 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: count Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: count Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 1 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: rate Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: rate Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 1 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: (list terminator) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: report connect to all milters Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "j" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "genome.ku.dk" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{daemon_name}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "genome.ku.dk" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{daemon_addr}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "192.168.3.112" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "v" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "Postfix 3.3.3" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: non-protocol events for protocol version 6: Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: transport=inet endpoint=localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: trying... [127.0.0.1] Mar 28 10:57:42 dna01 postfix/smtpd[66648]: vstream_tweak_tcp: TCP_MAXSEG 32741 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: fd=11: stream buffer size old=0 new=65482 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: my_version=0x6 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: my_actions=0x1ff SMFIF_ADDHDRS SMFIF_CHGBODY SMFIF_ADDRCPT SMFIF_DELRCPT SMFIF_CHGHDRS SMFIF_QUARANTINE SMFIF_CHGFROM SMFIF_ADDRCPT_PAR SMFIF_SETSYMLIST Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: my_events=0x1fffff SMFIP_NOCONNECT SMFIP_NOHELO SMFIP_NOMAIL SMFIP_NORCPT SMFIP_NOBODY SMFIP_NOHDRS SMFIP_NOEOH SMFIP_NR_HDR SMFIP_NOUNKNOWN SMFIP_NODATA SMFIP_SKIP SMFIP_RCPT_REJ SMFIP_NR_CONN SMFIP_NR_HELO SMFIP_NR_MAIL SMFIP_NR_RCPT SMFIP_NR_DATA SMFIP_NR_UNKN SMFIP_NR_EOH SMFIP_NR_BODY SMFIP_HDR_LEADSPC Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: milter inet:localhost:11332 version 6 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: events SMFIP_NR_HDR SMFIP_NR_CONN SMFIP_NR_HELO SMFIP_NR_MAIL SMFIP_NR_RCPT SMFIP_NR_DATA SMFIP_NR_UNKN SMFIP_NR_EOH SMFIP_NR_BODY Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_connect: requests SMFIF_ADDHDRS SMFIF_CHGBODY SMFIF_ADDRCPT SMFIF_DELRCPT SMFIF_CHGHDRS SMFIF_QUARANTINE SMFIF_CHGFROM SMFIF_ADDRCPT_PAR SMFIF_SETSYMLIST Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_conn_event: milter inet:localhost:11332: connect talvi.dovecot.org/94.237.25.159 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: event: SMFIC_CONNECT; macros: j=genome.ku.dk {daemon_name}=genome.ku.dk {daemon_addr}=192.168.3.112 v=Postfix 3.3.3 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: skipping reply for event SMFIC_CONNECT from milter inet:localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 220 genome.ku.dk ESMTP Postfix Mar 28 10:57:42 dna01 postfix/smtpd[66648]: < talvi.dovecot.org[94.237.25.159]: EHLO talvi.dovecot.org Mar 28 10:57:42 dna01 postfix/smtpd[66648]: report helo to all milters Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{tls_version}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cipher}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cipher_bits}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cert_subject}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cert_issuer}" Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_helo_event: milter inet:localhost:11332: helo talvi.dovecot.org Mar 28 10:57:42 dna01 postfix/smtpd[66648]: event: SMFIC_HELO; macros: (none) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: skipping reply for event SMFIC_HELO from milter inet:localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-genome.ku.dk Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-PIPELINING Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-SIZE 150000000 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-VRFY Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-ETRN Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-STARTTLS Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-ENHANCEDSTATUSCODES Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-8BITMIME Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250 DSN Mar 28 10:57:42 dna01 postfix/smtpd[66648]: < talvi.dovecot.org[94.237.25.159]: STARTTLS Mar 28 10:57:42 dna01 postfix/smtpd[66648]: query milter states for other event Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_other_event: milter inet:localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 220 2.0.0 Ready to start TLS Mar 28 10:57:42 dna01 postfix/smtpd[66648]: abort all milters Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_abort: abort milter inet:localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: auto_clnt_open: connected to private/tlsmgr Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr request = seed Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr size = 32 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: seed Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: seed Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: HIDDEN_BEFORE_POST Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: (list terminator) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr request = tktkey Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr keyname = [data 16 bytes] Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 4294967295 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: keybuf Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: keybuf Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: HIDDEN_BEFORE_POST Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: (list terminator) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr request = tktkey Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr keyname = [data 0 bytes] Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: keybuf Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: keybuf Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: HIDDEN_BEFORE_POST Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: (list terminator) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: Anonymous TLS connection established from talvi.dovecot.org[94.237.25.159]: TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_create: SASL service=smtp, realm=(null) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: name_mask: noanonymous Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: Connecting Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: VERSION?1?1 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: MECH?PLAIN?plaintext Mar 28 10:57:42 dna01 postfix/smtpd[66648]: name_mask: plaintext Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: MECH?LOGIN?plaintext Mar 28 10:57:42 dna01 postfix/smtpd[66648]: name_mask: plaintext Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: SPID?62898 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: CUID?107 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: COOKIE?HIDDEN_BEFORE_POST Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_connect: auth reply: DONE Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_mech_filter: keep mechanism: PLAIN Mar 28 10:57:42 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_mech_filter: keep mechanism: LOGIN Mar 28 10:57:42 dna01 postfix/smtpd[66648]: < talvi.dovecot.org[94.237.25.159]: QUIT Mar 28 10:57:42 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 221 2.0.0 Bye Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 192.168.3.0/24 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 192.168.3.0/24 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 127.0.0.0/8 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 127.0.0.0/8 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr request = disconnect Mar 28 10:57:42 dna01 postfix/smtpd[66648]: send attr ident = smtp:94.237.25.159 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: (list terminator) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:42 dna01 postfix/smtpd[66648]: disconnect event to all milters Mar 28 10:57:42 dna01 postfix/smtpd[66648]: milter8_disc_event: quit milter inet:localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: disconnect from talvi.dovecot.org[94.237.25.159] ehlo=1 starttls=1 quit=1 commands=3 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: free all milters Mar 28 10:57:42 dna01 postfix/smtpd[66648]: free milter inet:localhost:11332 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: master_notify: status 1 Mar 28 10:57:42 dna01 postfix/smtpd[66648]: connection closed Mar 28 10:57:47 dna01 postfix/smtpd[66648]: auto_clnt_close: disconnect private/tlsmgr stream Mar 28 10:57:55 dna01 postfix/smtpd[66648]: connection established Mar 28 10:57:55 dna01 postfix/smtpd[66648]: master_notify: status 0 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: name_mask: resource Mar 28 10:57:55 dna01 postfix/smtpd[66648]: name_mask: software Mar 28 10:57:55 dna01 postfix/smtpd[66648]: connect from talvi.dovecot.org[94.237.25.159] Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: smtp_stream_setup: maxtime=300 enable_deadline=0 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 192.168.3.0/24 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 192.168.3.0/24 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 127.0.0.0/8 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 127.0.0.0/8 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: send attr request = connect Mar 28 10:57:55 dna01 postfix/smtpd[66648]: send attr ident = smtp:94.237.25.159 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: status Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: count Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: count Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute value: 1 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: rate Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: rate Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute value: 2 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: (list terminator) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: report connect to all milters Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "j" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "genome.ku.dk" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{daemon_name}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "genome.ku.dk" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{daemon_addr}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "192.168.3.112" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "v" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: result "Postfix 3.3.3" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: non-protocol events for protocol version 6: Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: transport=inet endpoint=localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: trying... [127.0.0.1] Mar 28 10:57:55 dna01 postfix/smtpd[66648]: vstream_tweak_tcp: TCP_MAXSEG 32741 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: fd=11: stream buffer size old=0 new=65482 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: my_version=0x6 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: my_actions=0x1ff SMFIF_ADDHDRS SMFIF_CHGBODY SMFIF_ADDRCPT SMFIF_DELRCPT SMFIF_CHGHDRS SMFIF_QUARANTINE SMFIF_CHGFROM SMFIF_ADDRCPT_PAR SMFIF_SETSYMLIST Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: my_events=0x1fffff SMFIP_NOCONNECT SMFIP_NOHELO SMFIP_NOMAIL SMFIP_NORCPT SMFIP_NOBODY SMFIP_NOHDRS SMFIP_NOEOH SMFIP_NR_HDR SMFIP_NOUNKNOWN SMFIP_NODATA SMFIP_SKIP SMFIP_RCPT_REJ SMFIP_NR_CONN SMFIP_NR_HELO SMFIP_NR_MAIL SMFIP_NR_RCPT SMFIP_NR_DATA SMFIP_NR_UNKN SMFIP_NR_EOH SMFIP_NR_BODY SMFIP_HDR_LEADSPC Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: milter inet:localhost:11332 version 6 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: events SMFIP_NR_HDR SMFIP_NR_CONN SMFIP_NR_HELO SMFIP_NR_MAIL SMFIP_NR_RCPT SMFIP_NR_DATA SMFIP_NR_UNKN SMFIP_NR_EOH SMFIP_NR_BODY Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_connect: requests SMFIF_ADDHDRS SMFIF_CHGBODY SMFIF_ADDRCPT SMFIF_DELRCPT SMFIF_CHGHDRS SMFIF_QUARANTINE SMFIF_CHGFROM SMFIF_ADDRCPT_PAR SMFIF_SETSYMLIST Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_conn_event: milter inet:localhost:11332: connect talvi.dovecot.org/94.237.25.159 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: event: SMFIC_CONNECT; macros: j=genome.ku.dk {daemon_name}=genome.ku.dk {daemon_addr}=192.168.3.112 v=Postfix 3.3.3 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: skipping reply for event SMFIC_CONNECT from milter inet:localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 220 genome.ku.dk ESMTP Postfix Mar 28 10:57:55 dna01 postfix/smtpd[66648]: < talvi.dovecot.org[94.237.25.159]: EHLO talvi.dovecot.org Mar 28 10:57:55 dna01 postfix/smtpd[66648]: report helo to all milters Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{tls_version}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cipher}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cipher_bits}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cert_subject}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter_macro_lookup: "{cert_issuer}" Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_helo_event: milter inet:localhost:11332: helo talvi.dovecot.org Mar 28 10:57:55 dna01 postfix/smtpd[66648]: event: SMFIC_HELO; macros: (none) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: skipping reply for event SMFIC_HELO from milter inet:localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-genome.ku.dk Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-PIPELINING Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-SIZE 150000000 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-VRFY Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-ETRN Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-STARTTLS Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-ENHANCEDSTATUSCODES Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250-8BITMIME Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 250 DSN Mar 28 10:57:55 dna01 postfix/smtpd[66648]: < talvi.dovecot.org[94.237.25.159]: STARTTLS Mar 28 10:57:55 dna01 postfix/smtpd[66648]: query milter states for other event Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_other_event: milter inet:localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 220 2.0.0 Ready to start TLS Mar 28 10:57:55 dna01 postfix/smtpd[66648]: abort all milters Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_abort: abort milter inet:localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: auto_clnt_open: connected to private/tlsmgr Mar 28 10:57:55 dna01 postfix/smtpd[66648]: send attr request = seed Mar 28 10:57:55 dna01 postfix/smtpd[66648]: send attr size = 32 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: status Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: seed Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: seed Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute value: HIDDEN_BEFORE_POST Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/tlsmgr: wanted attribute: (list terminator) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: Anonymous TLS connection established from talvi.dovecot.org[94.237.25.159]: TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_create: SASL service=smtp, realm=(null) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: name_mask: noanonymous Mar 28 10:57:55 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_mech_filter: keep mechanism: PLAIN Mar 28 10:57:55 dna01 postfix/smtpd[66648]: xsasl_dovecot_server_mech_filter: keep mechanism: LOGIN Mar 28 10:57:55 dna01 postfix/smtpd[66648]: < talvi.dovecot.org[94.237.25.159]: QUIT Mar 28 10:57:55 dna01 postfix/smtpd[66648]: > talvi.dovecot.org[94.237.25.159]: 221 2.0.0 Bye Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 192.168.3.0/24 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 192.168.3.0/24 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostname: smtpd_client_event_limit_exceptions: talvi.dovecot.org ~? 127.0.0.0/8 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_hostaddr: smtpd_client_event_limit_exceptions: 94.237.25.159 ~? 127.0.0.0/8 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: talvi.dovecot.org: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: match_list_match: 94.237.25.159: no match Mar 28 10:57:55 dna01 postfix/smtpd[66648]: send attr request = disconnect Mar 28 10:57:55 dna01 postfix/smtpd[66648]: send attr ident = smtp:94.237.25.159 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: status Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: status Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute value: 0 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: private/anvil: wanted attribute: (list terminator) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: input attribute name: (end) Mar 28 10:57:55 dna01 postfix/smtpd[66648]: disconnect event to all milters Mar 28 10:57:55 dna01 postfix/smtpd[66648]: milter8_disc_event: quit milter inet:localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: disconnect from talvi.dovecot.org[94.237.25.159] ehlo=1 starttls=1 quit=1 commands=3 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: free all milters Mar 28 10:57:55 dna01 postfix/smtpd[66648]: free milter inet:localhost:11332 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: master_notify: status 1 Mar 28 10:57:55 dna01 postfix/smtpd[66648]: connection closed Mar 28 10:58:00 dna01 postfix/smtpd[66648]: auto_clnt_close: disconnect private/tlsmgr stream -- Christian Anthon

2 2

v2.3.5.1 released
by Aki Tuomi 28 Mar '19

28 Mar '19

https://dovecot.org/releases/2.3/dovecot-2.3.5.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.5.1.tar.gz.sig Binary packages in https://repo.dovecot.org/ * CVE-2019-7524: Missing input buffer size validation leads into arbitrary buffer overflow when reading fts or pop3 uidl header from Dovecot index. Exploiting this requires direct write access to the index files. --- Aki Tuomi Open-Xchange oy

2 2

Panic: file mail-transaction-log-file.c: line 105 (mail_transaction_log_file_free): assertion failed: (!file->locked)
by Arkadiusz Miśkiewicz 28 Mar '19

28 Mar '19

Hello. I have one account with heavy traffic (big mails) and quite often indexes get corrupted. This is dovecot 2.3.5 on local fs (xfs), Linux kernel 4.19.20, glibc 2.28. When corruption happens lmtp and pop3 segfault on accessing it like: > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(24428): Connect from local [0/0] > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(piast_efaktury): pid=<24428> session=<QLacCN5Mm1xsXwAA9fPEKQ>, Error: Index /var/mail/piast_efaktury/dovecot.index: Lost log for seq=13 offset=25648: Missing middle file seq=13 (between 13..4294967295, we have seqs 14,15): .log.2 contains file_seq=14 (initial_mapped=0, reason=Index mapped) > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(piast_efaktury): pid=<24428> session=<QLacCN5Mm1xsXwAA9fPEKQ>, Warning: fscking index file /var/mail/piast_efaktury/dovecot.index > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(piast_efaktury): pid=<24428> session=<QLacCN5Mm1xsXwAA9fPEKQ>, Error: Fixed index file /var/mail/piast_efaktury/dovecot.index: log_file_seq 13 -> 15 > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(piast_efaktury): pid=<24428> session=<QLacCN5Mm1xsXwAA9fPEKQ>, Panic: file mail-transaction-log-file.c: line 105 (mail_transaction_log_file_free): assertion failed: (!file->locked) > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(piast_efaktury): pid=<24428> session=<QLacCN5Mm1xsXwAA9fPEKQ>, Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xe011b) [0x7f25fc82b11b] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe01b1) [0x7f25fc82b1b1] -> /usr/lib64/dovecot/libdovecot.so.0(+0x4bf56) [0x7f25fc796f56] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4b17e) [0x7f25fc92f17e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_logs_clean+0x5c) [0x7f25fc9e6e3c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_close+0x34) [0x7f25fc9e6f04] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_move_to_memory+0xed) [0x7f25fc9e709d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_move_to_memory+0x60) [0x7f25fc9e10b0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_write+0x1e1) [0x7f25fc9df3a1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_fsck+0x68a) [0x7f25fc9ca13a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x5b0) [0x7f25fc9d4090] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x13b) [0x7f25fc9cc1eb] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xfcc96) [0x7f25fc9e0c96] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xfd2a7) [0x7f25fc9e12a7] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x7a) [0x7f25fc9e13aa] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xac) [0x7f25fc9bac1c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x84df9) [0x7f25fc968df9] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x84ecf) [0x7f25fc968ecf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe11c) [0x7f25fc9a211c] -> /usr/lib64/dovecot/plugins/lib20_zlib_plugin.so(+0x46ee) [0x7f25f8ff86ee] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5bd56) [0x7f25fc93fd56] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x4a) [0x7f25fc93ff3a] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save_open+0x63) [0x7f25fca49cc3] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save+0xc9) [0x7f25fca49f29] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x1c6) [0x7f25fca4a586] -> dovecot/lmtp [local DATA](lmtp_local_data+0x6a1) [0x55e3e295a551] -> dovecot/lmtp [local DATA](cmd_data_continue+0x25d) [0x55e3e295920d] -> /usr/lib64/dovecot/libdovecot.so.0(+0x65737) [0x7f25fc7b0737] > Mar 27 11:13:50 mbox dovecot[22370]: lmtp(piast_efaktury): pid=<24428> session=<QLacCN5Mm1xsXwAA9fPEKQ>, Fatal: master: service(lmtp): child 24428 killed with signal 6 (core dumped) > ~ lmtp backtrace: http://ixion.pld-linux.org/~arekm/dovecot/lmtp-gdb.txt log: http://ixion.pld-linux.org/~arekm/dovecot/lmtp.txt pop3 backtrace: http://ixion.pld-linux.org/~arekm/dovecot/pop3-gdb.txt log: http://ixion.pld-linux.org/~arekm/dovecot/pop3.txt deleting dovecot.index* helps until problem starts again like - first entry with problem after deleting indexes: > Mar 26 14:18:12 mbox dovecot[10001]: pop3-login: Login: user=<piast_efaktury>, method=PLAIN, rip=1.1.1.1, lip=2.2.2.2, mpid=5694, session=</YwtJ/+EZPG5sziF> > Mar 26 14:18:12 mbox dovecot[10001]: pop3(piast_efaktury): pid=<5694> session=</YwtJ/+EZPG5sziF>, Error: Index /var/mail/piast_efaktury/dovecot.index: Lost log for seq=13 offset=25648: Missing middle file seq=13 (between 13..4294967295, we have seqs 14,15): .log.2 contains file_seq=14 (initial_mapped=0, reason=Index mapped) > Mar 26 14:18:12 mbox dovecot[10001]: pop3(piast_efaktury): pid=<5694> session=</YwtJ/+EZPG5sziF>, Warning: fscking index file /var/mail/piast_efaktury/dovecot.index > Mar 26 14:18:12 mbox dovecot[10001]: pop3(piast_efaktury): pid=<5694> session=</YwtJ/+EZPG5sziF>, Error: Fixed index file /var/mail/piast_efaktury/dovecot.index: log_file_seq 13 -> 15 > Mar 26 14:18:12 mbox dovecot[10001]: pop3(piast_efaktury): pid=<5694> session=</YwtJ/+EZPG5sziF>, Panic: file mail-transaction-log-file.c: line 105 (mail_transaction_log_file_free): assertion failed: (!file->locked) > Mar 26 14:18:12 mbox dovecot[10001]: pop3(piast_efaktury): pid=<5694> session=</YwtJ/+EZPG5sziF>, Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xe011b) [0x7f20b6e2911b] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe01b1) [0x7f20b6e291b1] -> /usr/lib64/dovecot/libdovecot.so.0(+0x4bf56) [0x7f20b6d94f56] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4b17e) [0x7f20b6f2d17e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_logs_clean+0x5c) [0x7f20b6fe4e3c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_close+0x34) [0x7f20b6fe4f04] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_move_to_memory+0xed) [0x7f20b6fe509d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_move_to_memory+0x60) [0x7f20b6fdf0b0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_write+0x1e1) [0x7f20b6fdd3a1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_fsck+0x68a) [0x7f20b6fc813a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x5b0) [0x7f20b6fd2090] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x13b) [0x7f20b6fca1eb] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xfcc96) [0x7f20b6fdec96] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xfd2a7) [0x7f20b6fdf2a7] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x7a) [0x7f20b6fdf3aa] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xac) [0x7f20b6fb8c1c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x84df9) [0x7f20b6f66df9] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x84ecf) [0x7f20b6f66ecf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe11c) [0x7f20b6fa011c] -> /usr/lib64/dovecot/plugins/lib20_zlib_plugin.so(+0x46ee) [0x7f20b36896ee] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5bd56) [0x7f20b6f3dd56] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x4a) [0x7f20b6f3df3a] -> dovecot/pop3 [piast_efaktury 1.1.1.1](client_init_mailbox+0x7a) [0x5638a04d1bda] -> dovecot/pop3 [piast_efaktury 1.1.1.1](+0x5645) [0x5638a04d0645] -> dovecot/pop3 [piast_efaktury 1.1.1.1](+0x5882) [0x5638a04d0882] -> /usr/lib64/dovecot/libdovecot.so.0(+0x74021) [0x7f20b6dbd021] -> /usr/lib64/dovecot/libdovecot.so.0(+0x7439b) [0x7f20b6dbd39b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x74d1d) [0x7f20b6dbdd1d] > Mar 26 14:18:12 mbox dovecot[10001]: pop3(piast_efaktury): pid=<5694> session=</YwtJ/+EZPG5sziF>, Fatal: master: service(pop3): child 5694 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) dovecot isn't able to auto fix the indexes and manual deletion is required in all such cases -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

2 5

MailCrypt: Encrypted user keys configuration with LDAP & cryptokey generate
by FELINN 28 Mar '19

28 Mar '19

Hi, I try to use the MailCrypt plugin with Floder encryption and encrypted user keys, using LDAP. I use Dovecot 2.2.27 (c0f36b0) I follow the wiki: https://wiki2.dovecot.org/Plugins/MailCrypt doveconf -n and dovecot-ldap.conf.ext attached to this message. I well configured slapd to let dovecot's dn query the userPassword (hashed password SSHA). I use fusiondirectory-mail plugin: ------------------------------------------------------------------------ $ ldapsearch -D 'cn=dovecot,ou=dsa,dc=foo,dc=bar' -W -LLL '(&(objectClass=gosaMailAccount)(objectClass=posixAccount)(uid=<user>))' 'userPassword' dn: cn=<user>,ou=people,dc=foo,dc=bar userPassword:: XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX ------------------------------------------------------------------------ The problem is that mails still readable and no keys are generated, even if a send a mail to this address, or login through webmail. I wait more than 1h until something happens, Cf: https://dovecot.org/list/dovecot/2018-September/112763.html If I try to generate keys manually I get this error: ------------------------------------------------------------------------ $ doeveadm mailbox cryptokey generate -u <user> doveadm(<user>): Error: mail_crypt_user_generate_keypair(<user>) failed: mail_crypt_require_encrypted_user_key set, cannot generate user keypair without password or key Folder Public ID x ERROR: mail_crypt_require_encrypted_user_key set, cannot generate user keypair without password or key doveadm(<user>): Warning: Timeout leak: 0x7f0c439c0180 (mail-index-alloc-cache.c:240) ------------------------------------------------------------------------ It works with -o plugin/mail_crypt_private_password=<password> of course, but by hand it's not the goal >< I probably miss something, I guess that the part of the wiki about sql and password_query is only for configuration that use SQL for dbuser. Is there similar things to do with LDAP? Thank you very much for your time. -- f00wl FELINN https://felinn.org

1 1

Weird things in the mail queue
by Lionel Elie Mamane 27 Mar '19

27 Mar '19

I noticed a mail stuck in my mail queue. dovecot-lda was returning error 64 Invalid parameter given. (EX_USAGE). Weird, weird, weird. After some sleuthing, I found the sender address was FirstLast(a)domain.tld, with a UTF8-encoded Unicode U+FEFF ZERO WIDTH NO-BREAK SPACE character (AKA byte order mark) between "First" and "Last" :) Since that is passed as the -f parameter to dovecot-lda, it was giving the 64 error.

3 3

Maildir permissions issue with Postfix
by Randall R. Sargent 27 Mar '19

27 Mar '19

Hi all, We have a Postfix server that serves as an alias MTA to route to other mail systems. I've recently installed Dovecot on it because we have three service accounts that need simple POP3 mailboxes. I have the accounts set up on the system and mail does get delivered to their ~/Maildir/ locations by Postfix, however, every time a message is dropped in the Maildir for the user, the permissions for the message are set to the user's uid:gid and Dovecot can't access the mail message. Doing a chmod fixes it temporarily until the next message drops. The vmail group has access to the user's home folder structure. Any help is appreciated!! Dovecot: 2.2.36 /etc/dovecot/dovecot.conf: auth_debug = yes disable_plaintext_auth = no first_valid_uid = 1002 log_path = /var/log/dovecot.log mail_debug = yes mail_home = /srv/mail/%Lu mail_location = maildir:~/Maildir mbox_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = / } passdb { driver = pam } service auth-worker { user = root } userdb { args = blocking=no driver = passwd override_fields = uid=vmail gid=vmail } Thanks, Randy

2 1

doveadm backup doesn't transfer mail from root INBOX
by Francis 27 Mar '19

27 Mar '19

Hi, I'm trying to migrate IMAP mails from dovecot 1.1.20apple0.5 (osx) to dovecot 2.2.33.2 (ubuntu). I'm using "doveadm backup" to migrate my data. It works fine for all subfolders, but the root INBOX stay empty on the new server. I suspect a problem related with hierarchy separator ("." on previous server, "/" on new) or with the namespace prefix (set to "INBOX/" on new server). Any hint? Thanks. show there is no messages in INBOX # doveadm mailbox status -u (myuser) all INBOX INBOX messages=0 recent=0 uidnext=1 uidvalidity=1553630060 unseen=0 highestmodseq=1 vsize=0 guid=d54cd42849739b5cb5790000ed87e144 firstsaved=18446744073709551615 show there is messages in subdirectory # doveadm mailbox status -u (myuser) all INBOX/Sent INBOX/Sent messages=253 recent=0 uidnext=8721 uidvalidity=1263328366 unseen=0 highestmodseq=256 vsize=16335358 guid=bfb2e03fdce327671e82bf173b1ccb8b firstsaved=1553634631 The command I'm runnning on the new server to migrate data: # doveadm -o mail_fsync=never backup -R -u (myuser) imapc: # My config on the new server: # doveadm -n # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-46-generic x86_64 Ubuntu 18.04.2 LTS auth_default_realm = example.com doveadm_password = # hidden, use -P to show it doveadm_port = 53683 first_valid_uid = 200 imapc_features = rfc822.size fetch-headers imapc_host = oldmail.example.com imapc_master_user = (removed) imapc_password = # hidden, use -P to show it imapc_user = %n last_valid_uid = 200 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication zlib quota" mail_prefetch_count = 20 mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 10 M namespace inbox { inbox = yes location = mailbox "Éléments envoyés" { special_use = \Sent } mailbox "Éléments supprimés" { special_use = \Trash } mailbox Brouillon { special_use = \Drafts } mailbox "Courrier indésirable" { special_use = \Junk } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcps:mail2.example.com:53683 quota = count:User quota quota_grace = 10%% quota_rule = *:storage=10G quota_rule2 = INBOX/Trash:storage=+100M quota_vsizes = yes quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u quota_warning6 = -storage=80%% quota-warning '-80' %u quota_warning7 = -storage=100%% quota-warning '-100' %u sieve = /var/vmail/domains/%Ld/%Ln/.dovecot.sieve sieve_before = /var/vmail/sieve/before.sieve sieve_default = /var/vmail/sieve/default.sieve sieve_global = /var/vmail/sieve/global zlib_save = lz4 } protocols = " imap lmtp sieve" service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { inet_listener { address = (removed) port = 55123 } unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service doveadm { inet_listener { port = 53683 ssl = yes } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 10 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/ssl/example/example.com.crtbundle ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " notify replication zlib quota sieve" postmaster_address = postmaster(a)example.com } protocol imap { mail_plugins = " notify replication zlib quota imap_zlib imap_quota" } # cat /etc/dovecot/dovecot-ldap.conf.ext | grep -v "^#" | grep -v "^$" uris = ldaps://dc1.ad.example.com ldaps://dc2.ad.example.com dn = (removed) dnpass = (removed) auth_bind = yes base = (removed) scope = subtree deref = never user_filter = (&(mail=%u)(memberOf:1.2.840.113556.1.4.1941:=CN=acces_courriels,(removed))(&(|(objectclass=person))(!(UserAccountControl:1.2.840.113556.1.4.803:=2)))) pass_filter = (&(mail=%u)(memberOf:1.2.840.113556.1.4.1941:=CN=acces_courriels,(removed))(&(|(objectclass=person))(!(UserAccountControl:1.2.840.113556.1.4.803:=2)))) iterate_filter = (&(mail=*)(memberOf:1.2.840.113556.1.4.1941:=CN=acces_courriels,(removed))(&(|(objectclass=person))(!(UserAccountControl:1.2.840.113556.1.4.803:=2)))) iterate_attrs = mail=user user_attrs = \ =quota_rule=*:storage=%{ldap:division:10G}, \ =home=/var/vmail/domains/%Ld/%Ln, \ =mail=mdbox:/var/vmail/domains/%Ld/%Ln/mdbox, \ =uid=200, \ =gid=200

1 0

index problems after update
by Hajo Locke 27 Mar '19

27 Mar '19

Hello List, i have a problem with index-files which is separated in 2 subproblems. May be these problems are connected. Currently we use Ubuntu 18.04 LTS which is bundled with dovecot 2.2.33.2 These servers are fresh installed machines and users are added to the system after, there was no upgrade. Sometimes it happens, that dovecot stops showing new mail. There is no error in log, dovecot just seems to do his normal operations but is not delivering new emails from /var/mail/myuser emails are delivered again if i delete index-files from .imap folder. So index is recreated and everything works again. I cant reproduce this problem, but every 2 days i have one user who is reporting this problem. Second problem is similiar. I Upgraded a server from Ubuntu 16.04 to Ubuntu 18.04. This includes an upgrade from dovecot 2.2.22 to 2.2.33.2. After that i installed an self packaged dovecot 2.2.36.1 Now here is same problem, dovecot is not showing new mails, but the difference is we have a Raw backtrace in Log just as expected: Feb 8 08:45:37 hostname dovecot[14882]: imap(myuser): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xa1ee2) [0x7f78b3b2cee2] -> /usr/lib/dovecot/libdovecot.so.0(+0xa1fda) [0x7f78b3b2cfda] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f78b3abb8a8] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x78a) [0x7f78b3e7940a] -> /usr/lib/dovecot/libdovecot.so.0(+0x83592) [0x7f78b3b0e592] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x74) [0x7f78b3b38814] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f78b3b392fd] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_header_stream+0x4a) [0x7f78b3e7a2ea] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_header_stream+0x4a) [0x7f78b3dfd8da] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x24a) [0x7f78b3ebb57a] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](+0x2081c) [0x5581ac76d81c] -> dovecot/imap [m038422 ip.ip.ip.ip FETCH](+0x1ea54) [0x5581ac76ba54] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](imap_fetch_more+0x39) [0x5581ac76cd69] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](cmd_fetch+0x31b) [0x5581ac75e1bb] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](command_exec+0x5c) [0x5581ac76a09c] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](+0x1b612) [0x5581ac768612] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](+0x1b6ac) [0x5581ac7686ac] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](client_handle_input+0x18d) [0x5581ac768a6d] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](client_input+0xac) [0x5581ac768fbc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f78b3b43482] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7f78b3b44b9e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) [0x7f78b3b43516] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f78b3b436c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f78b3ac6aa3] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](main+0x329) [0x5581ac75b159] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f78b36bbb97] -> dovecot/imap [myuser ip.ip.ip.ip FETCH](_start+0x2a) [0x5581ac75b2fa] Feb 8 08:45:37 hostname dovecot[14882]: imap(myuser): Fatal: master: service(imap): child 14135 killed with signal 6 (core dumped) Over all dovecot and OS versions we use same old-fashioned setup. Mails are delivered by procmail to classic mbox file. This is output of doveconf -n # 2.2.36.1 (5d621cf65): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.18.0-14-generic x86_64 Ubuntu 18.04.1 LTS # Hostname: myhostname auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@üÜöÖäÄ auth_worker_max_count = 60 disable_plaintext_auth = no imap_capability = +XLIST lock_method = flock login_greeting = mailserver ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_cache_min_mail_count = 30 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_max_userip_connections = 30 mbox_read_locks = dotlock mbox_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archiv { auto = no special_use = } mailbox Drafts { auto = no special_use = } mailbox Junk { auto = no special_use = } mailbox Sent { auto = no special_use = } mailbox Trash { auto = no special_use = } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 service auth-worker { idle_kill = 1 mins } service auth { idle_kill = 1 mins unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { executable = /usr/lib/dovecot/imap-login process_min_avail = 4 service_count = 0 user = dovecot } service imap { process_limit = 1024 } service pop3-login { executable = /usr/lib/dovecot/pop3-login process_min_avail = 4 service_count = 0 user = dovecot } service pop3 { executable = /usr/lib/dovecot/pop3 process_limit = 1024 } shutdown_clients = no ssl_ca = </path/cert.pem ssl_cert = </path/cert.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:!DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail mail_plugins = mail_log notify ssl = yes } protocol pop3 { pop3_client_workarounds = oe-ns-eoh outlook-no-nuls pop3_no_flag_updates = no pop3_uidl_format = %08Xu%08Xv ssl = yes } Whats going wrong here? Main problem is first one. dovecot stops showing new mail during service without telling a reason. reason looks like a broken index file. What to do here? Please tell me your opinion. Thanks, Hajo

7 17

Test SASL authentication via telnet (or similar)
by Alessio Cecchi 26 Mar '19

26 Mar '19

Hi, I'm looking for a way to autenticate my email users via Dovecot SASL TCP connections from an external nodejs or python script. Dovecot configuration is fine, if I set in postfix smtpd_sasl_path = inet:127.0.0.1:12345 works fine. But if a try via "telnet 127.0.0.1 12345" to chat with SASL in dovecot log found: dovecot: auth: Error: Authentication client not compatible with this server (mixed old and new binaries?) What is the right way to chat with SASL via TCP port? Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 0

IMAP coredumps for one user
by Odhiambo Washington 26 Mar '19

26 Mar '19

FreeBSD-12 Dovecot-2.3.5 I am having problems with one use Mar 25 21:30:12 imap(gau.mon(a)crownkenya.com)<91364><U7qCZO+ECfCaRh6E>: Fatal: master: service(imap): child 91364 killed with signal 6 (core dumped) Mar 25 21:30:14 imap(gau.mon(a)crownkenya.com)<2381><moHYZO+EDvCaRh6E>: Fatal: master: service(imap): child 2381 killed with signal 6 (core dumped) Mar 26 06:29:26 imap(gau.mon(a)crownkenya.com)<7644><0aVP7faEI/GaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:26 imap(gau.mon(a)crownkenya.com)<8806><valP7faEJPGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:26 imap(gau.mon(a)crownkenya.com)<8493><zKhP7faEIvGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:26 imap(gau.mon(a)crownkenya.com)<9412><2qtP7faEIfGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:28 imap(gau.mon(a)crownkenya.com)<7644><0aVP7faEI/GaTGQE>: Fatal: master: service(imap): child 7644 killed with signal 6 (core dumped) Mar 26 06:29:29 imap(gau.mon(a)crownkenya.com)<10764><7sW+7faEJvGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:31 imap(gau.mon(a)crownkenya.com)<8806><valP7faEJPGaTGQE>: Fatal: master: service(imap): child 8806 killed with signal 6 (core dumped) Mar 26 06:29:33 imap(gau.mon(a)crownkenya.com)<8493><zKhP7faEIvGaTGQE>: Fatal: master: service(imap): child 8493 killed with signal 6 (core dumped) Mar 26 06:29:36 imap(gau.mon(a)crownkenya.com)<9412><2qtP7faEIfGaTGQE>: Fatal: master: service(imap): child 9412 killed with signal 6 (core dumped) Mar 26 06:29:38 imap(gau.mon(a)crownkenya.com)<10764><7sW+7faEJvGaTGQE>: Fatal: master: service(imap): child 10764 killed with signal 6 (core dumped) Mar 26 06:29:57 imap(gau.mon(a)crownkenya.com)<13285><JhMO7vaEKfGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:57 imap(gau.mon(a)crownkenya.com)<19736><UQMD7/aELfGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:57 imap(gau.mon(a)crownkenya.com)<22060><athw7/aEL/GaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:29:57 imap(gau.mon(a)crownkenya.com)<21367><Prhw7/aELvGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:30:00 imap(gau.mon(a)crownkenya.com)<13285><JhMO7vaEKfGaTGQE>: Fatal: master: service(imap): child 13285 killed with signal 6 (core dumped) Mar 26 06:30:00 imap(gau.mon(a)crownkenya.com)<49026><FCSb7/aEMPGaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 06:30:02 imap(gau.mon(a)crownkenya.com)<19736><UQMD7/aELfGaTGQE>: Fatal: master: service(imap): child 19736 killed with signal 6 (core dumped) Mar 26 06:30:05 imap(gau.mon(a)crownkenya.com)<22060><athw7/aEL/GaTGQE>: Fatal: master: service(imap): child 22060 killed with signal 6 (core dumped) Mar 26 06:30:07 imap(gau.mon(a)crownkenya.com)<21367><Prhw7/aELvGaTGQE>: Fatal: master: service(imap): child 21367 killed with signal 6 (core dumped) Mar 26 06:30:10 imap(gau.mon(a)crownkenya.com)<49026><FCSb7/aEMPGaTGQE>: Fatal: master: service(imap): child 49026 killed with signal 6 (core dumped) Mar 26 07:59:40 imap(gau.mon(a)crownkenya.com)<27221><06UEMPiESPKaRh6E>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 07:59:40 imap(gau.mon(a)crownkenya.com)<28883><fssEMPiESvKaRh6E>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 07:59:40 imap(gau.mon(a)crownkenya.com)<29823><28oEMPiESfKaRh6E>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 07:59:40 imap(gau.mon(a)crownkenya.com)<27530><04UEMPiER/KaRh6E>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 07:59:42 imap(gau.mon(a)crownkenya.com)<27221><06UEMPiESPKaRh6E>: Fatal: master: service(imap): child 27221 killed with signal 6 (core dumped) Mar 26 07:59:42 imap(gau.mon(a)crownkenya.com)<30775><w9tqMPiETPKaRh6E>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 07:59:45 imap(gau.mon(a)crownkenya.com)<28883><fssEMPiESvKaRh6E>: Fatal: master: service(imap): child 28883 killed with signal 6 (core dumped) Mar 26 07:59:47 imap(gau.mon(a)crownkenya.com)<29823><28oEMPiESfKaRh6E>: Fatal: master: service(imap): child 29823 killed with signal 6 (core dumped) Mar 26 07:59:50 imap(gau.mon(a)crownkenya.com)<27530><04UEMPiER/KaRh6E>: Fatal: master: service(imap): child 27530 killed with signal 6 (core dumped) Mar 26 07:59:52 imap(gau.mon(a)crownkenya.com)<30775><w9tqMPiETPKaRh6E>: Fatal: master: service(imap): child 30775 killed with signal 6 (core dumped) Mar 26 08:45:40 imap(gau.mon(a)crownkenya.com)<83330><VtGH1PiEr/KaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:45:40 imap(gau.mon(a)crownkenya.com)<84059><lhKI1PiEsPKaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:45:40 imap(gau.mon(a)crownkenya.com)<84406><kRaI1PiEsfKaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:45:40 imap(gau.mon(a)crownkenya.com)<84458><CzKI1PiErvKaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:45:42 imap(gau.mon(a)crownkenya.com)<83330><VtGH1PiEr/KaTGQE>: Fatal: master: service(imap): child 83330 killed with signal 6 (core dumped) Mar 26 08:45:45 imap(gau.mon(a)crownkenya.com)<84059><lhKI1PiEsPKaTGQE>: Fatal: master: service(imap): child 84059 killed with signal 6 (core dumped) Mar 26 08:45:47 imap(gau.mon(a)crownkenya.com)<84406><kRaI1PiEsfKaTGQE>: Fatal: master: service(imap): child 84406 killed with signal 6 (core dumped) Mar 26 08:45:50 imap(gau.mon(a)crownkenya.com)<84458><CzKI1PiErvKaTGQE>: Fatal: master: service(imap): child 84458 killed with signal 6 (core dumped) Mar 26 08:54:55 imap(gau.mon(a)crownkenya.com)<88519><2qiO9fiE0fKaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:54:56 imap(gau.mon(a)crownkenya.com)<90725><ZhDq9fiE0vKaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:54:56 imap(gau.mon(a)crownkenya.com)<91408><oA/q9fiE0/KaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:54:56 imap(gau.mon(a)crownkenya.com)<90661><kc3p9fiE1PKaTGQE>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 08:54:58 imap(gau.mon(a)crownkenya.com)<88519><2qiO9fiE0fKaTGQE>: Fatal: master: service(imap): child 88519 killed with signal 6 (core dumped) Mar 26 08:55:01 imap(gau.mon(a)crownkenya.com)<90725><ZhDq9fiE0vKaTGQE>: Fatal: master: service(imap): child 90725 killed with signal 6 (core dumped) Mar 26 08:55:03 imap(gau.mon(a)crownkenya.com)<91408><oA/q9fiE0/KaTGQE>: Fatal: master: service(imap): child 91408 killed with signal 6 (core dumped) Mar 26 08:55:06 imap(gau.mon(a)crownkenya.com)<90661><kc3p9fiE1PKaTGQE>: Fatal: master: service(imap): child 90661 killed with signal 6 (core dumped) Mar 26 09:26:06 imap(gau.mon(a)crownkenya.com)<45868><K+R8ZPmEJfMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 09:26:06 imap(gau.mon(a)crownkenya.com)<46114><WfR8ZPmEJPMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 09:26:06 imap(gau.mon(a)crownkenya.com)<47667><lCR9ZPmEJ/MpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 09:26:06 imap(gau.mon(a)crownkenya.com)<46900><fAx9ZPmEJvMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 09:26:08 imap(gau.mon(a)crownkenya.com)<45868><K+R8ZPmEJfMpOWd5>: Fatal: master: service(imap): child 45868 killed with signal 6 (core dumped) Mar 26 09:26:08 imap(gau.mon(a)crownkenya.com)<50503><zz+LZfmEKPMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 09:26:11 imap(gau.mon(a)crownkenya.com)<46114><WfR8ZPmEJPMpOWd5>: Fatal: master: service(imap): child 46114 killed with signal 6 (core dumped) Mar 26 09:26:15 imap(gau.mon(a)crownkenya.com)<47667><lCR9ZPmEJ/MpOWd5>: Fatal: master: service(imap): child 47667 killed with signal 6 (core dumped) Mar 26 09:26:17 imap(gau.mon(a)crownkenya.com)<46900><fAx9ZPmEJvMpOWd5>: Fatal: master: service(imap): child 46900 killed with signal 6 (core dumped) Mar 26 09:26:20 imap(gau.mon(a)crownkenya.com)<50503><zz+LZfmEKPMpOWd5>: Fatal: master: service(imap): child 50503 killed with signal 6 (core dumped) Mar 26 09:42:18 imap(andrew.oyugi(a)crownkenya.com)<52237><7dJjnfmEJtPFt2RO>: Error: Mailbox Sent: Saving mail: read(<imap client>) failed: read(size=7224) failed: Connection reset by peer (read reason=) Mar 26 10:13:18 imap(gau.mon(a)crownkenya.com)<81127><JxMuDvqEd/MpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 10:13:18 imap(gau.mon(a)crownkenya.com)<81432><QRMuDvqEePMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 10:13:18 imap(gau.mon(a)crownkenya.com)<79708><LBMuDvqEdvMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 10:13:18 imap(gau.mon(a)crownkenya.com)<78811><IxMuDvqEefMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 10:13:20 imap(gau.mon(a)crownkenya.com)<81127><JxMuDvqEd/MpOWd5>: Fatal: master: service(imap): child 81127 killed with signal 6 (core dumped) Mar 26 10:13:21 imap(gau.mon(a)crownkenya.com)<84406><wIVfDvqEevMpOWd5>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 26 10:13:23 imap(gau.mon(a)crownkenya.com)<81432><QRMuDvqEePMpOWd5>: Fatal: master: service(imap): child 81432 killed with signal 6 (core dumped) Mar 26 10:13:25 imap(gau.mon(a)crownkenya.com)<79708><LBMuDvqEdvMpOWd5>: Fatal: master: service(imap): child 79708 killed with signal 6 (core dumped) Mar 26 10:13:28 imap(gau.mon(a)crownkenya.com)<78811><IxMuDvqEefMpOWd5>: Fatal: master: service(imap): child 78811 killed with signal 6 (core dumped) Mar 26 10:13:30 imap(gau.mon(a)crownkenya.com)<84406><wIVfDvqEevMpOWd5>: Fatal: master: service(imap): child 84406 killed with signal 6 (core dumped) I have a coredump, but I don't see any relation so far: root@gw:/tmp/corefiles # gdb /usr/local/libexec/dovecot/imap imap.core GNU gdb (GDB) 8.2.1 [GDB v8.2.1 for FreeBSD] Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd12.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/libexec/dovecot/imap...(no debugging symbols found)...done. [New LWP 101447] Core was generated by `dovecot/imap'. Program terminated with signal SIGABRT, Aborted. #0 0x000000008153145a in thr_kill () from /lib/libc.so.7 (gdb) bt full #0 0x000000008153145a in thr_kill () from /lib/libc.so.7 No symbol table info available. #1 0x000000008152f844 in raise () from /lib/libc.so.7 No symbol table info available. #2 0x00000000814a2079 in abort () from /lib/libc.so.7 No symbol table info available. #3 0x00000000813257f7 in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x0000000081324000 in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x0000000081324d81 in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #6 0x0000000081324200 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #7 0x0000000081349fcf in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #8 0x0000000081ec2fc2 in XQuerySet::add_term (this=0x7fffffffe3e0, s=0x817892e0 "maureen.xxxxx(a)xxxx.co.ke") at ./fts-backend-xapian-functions.cpp:151 l = <optimized out> i = <optimized out> pos = <optimized out> #9 0x0000000081ec2c22 in XQuerySet::add (this=0x7fffffffe3e0, t=<optimized out>, s=<optimized out>) at ./fts-backend-xapian-functions.cpp:254 tmp1 = "body" tmp2 = "maureen.xxxx(a)xxxx.co.ke" t2 = <optimized out> s2 = 0x817892e0 "maureen.xxxx(a)xxxx.co.ke" i = <optimized out> #10 0x0000000081ec24fb in XQuerySet::add (this=0x7fffffffe3e0, type=<optimized out>, s=<optimized out>) at ./fts-backend-xapian-functions.cpp:182 sp = {<icu::UMemory> = {<No data fields>}, ptr_ = 0x81eb8591 "body", length_ = 4, static npos = 2147483647} t = {<icu::Replaceable> = {<icu::UObject> = {<icu::UMemory> = {<No data fields>}, _vptr$UObject = 0x822c3bc0 <vtable for icu::UnicodeString+16>}, <No data fields>}, fUnion = {fStackFields = {fLengthAndFlags = 130, fBuffer = u<error reading variable>}, fFields = {fLengthAndFlags = 130, fLength = 6553711, fCapacity = 121, fArray = 0x7fffffffe270 u<error reading variable>}}} s2 = <optimized out> sp2 = <optimized out> #11 0x0000000081ec0667 in fts_backend_xapian_lookup (_backend=<optimized out>, box=<optimized out>, args=0x81e35110, flags=<optimized out>, result=0x7fffffffe550) at fts-backend-xapian.cpp:470 a = <optimized out> backend = <optimized out> tp = {tv_sec = 1553584401, tv_usec = 717885} is_and = <error reading variable is_and (Cannot access memory at address 0x1)> hdr = <optimized out> i = <optimized out> r = <optimized out> n = <optimized out> uid = <optimized out> dt = <optimized out> qs = <optimized out> #12 0x0000000081ea5bf4 in fts_backend_lookup () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #13 0x0000000081eaa782 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #14 0x0000000081eaa5d0 in fts_search_lookup () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #15 0x0000000081eace94 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #16 0x000000000104fa47 in imap_search_start () No symbol table info available. #17 0x0000000001040441 in cmd_search () No symbol table info available. #18 0x00000000010486bd in command_exec () No symbol table info available. #19 0x000000000104730a in ?? () No symbol table info available. #20 0x0000000001045ed7 in client_handle_input () No symbol table info available. #21 0x00000000010446c8 in client_input () No symbol table info available. #22 0x000000008133ebbf in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #23 0x00000000813411ed in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #24 0x000000008133f22e in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. --Type <RET> for more, q to quit, c to continue without paging-- #25 0x000000008133ef98 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #26 0x00000000812b2e08 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #27 0x00000000010558a7 in main () No symbol table info available. (gdb) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

2 1

dovecot 2.3.5 - tests fail: http payload echo (ssl)
by Helmut K. C. Tessarek 26 Mar '19

26 Mar '19

Hi, I was womdering, if anyone has experienced the same issues. When I run the tests after compiling 2.3.5, the following 4 tests fail: http payload echo (ssl): sequential .................................. : ok http payload echo (ssl): pipeline .................................... : ok http payload echo (ssl): parallel .................................... : FAILED: Test is hanging http payload echo (ssl) .............................................. : FAILED http payload echo (ssl; unknown size): sequential .................... : ok http payload echo (ssl; unknown size): pipeline ...................... : ok http payload echo (ssl; unknown size): parallel ...................... : FAILED: Test is hanging http payload echo (ssl; unknown size) ................................ : FAILED 4 / 114 tests failed Failed to run: ./test-http-payload The tests ran fine for 2.3.4.1. Is there any way, to debug the issue any further? Do the tests write log files? It just doesn't make amy sense. Nothing has changed on the OS since I compiled and tested 2.3.4.1. Cheers, K. C. -- regards Helmut K. C. Tessarek KeyID 0x172380A011EF4944 Key fingerprint = 8A55 70C1 BD85 D34E ADBC 386C 1723 80A0 11EF 4944 /* Thou shalt not follow the NULL pointer for chaos and madness await thee at its end. */

4 11

Panic
by Odhiambo Washington 25 Mar '19

25 Mar '19

Dovecot-2.3.5, FreeBSD-12 (amd64), I will wait to see coredumps after setting up things to allow it. Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<82746><wg80zdqEy+eaTXHr>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<82746><wg80zdqEy+eaTXHr>: Fatal: master: service(imap): child 82746 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service imap { drop_priv_before_ exec=yes }) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<81688><pdUzzdqEyueaTXHr>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<81688><pdUzzdqEyueaTXHr>: Fatal: master: service(imap): child 81688 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service imap { drop_priv_before_ exec=yes }) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<82020><qO8zzdqEyeeaTXHr>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<82020><qO8zzdqEyeeaTXHr>: Fatal: master: service(imap): child 82020 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service imap { drop_priv_before_ exec=yes }) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<83452><Bw80zdqEzOeaTXHr>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<83452><Bw80zdqEzOeaTXHr>: Fatal: master: service(imap): child 83452 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service imap { drop_priv_before_ exec=yes }) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<84305><9vV0zdqEzueaTXHr>: Panic: file mempool-system.c: line 137 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) Mar 24 20:56:08 imap(john.doe(a)crownkenya.com)<84305><9vV0zdqEzueaTXHr>: Fatal: master: service(imap): child 84305 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service imap { drop_priv_before_ exec=yes }) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

1 0

imapsieve: script not triggered
by Andreas Krischer 25 Mar '19

25 Mar '19

Hi, folks! My problem: I set up dovecot with imapsieve to execute a script whenever a user copies a mail to his Spam folder (spam autolearning). Unfortunately this script is never executed regardless what I’m configuring for imapsieve. It looks like dovecot doesn’t really load the plugin… The "dovecot -n" output is attached. I already tried setting imapsieve_mailbox1_name to *, but even this does not execute the script… Also I tried a mailbox without mail_crypt enabled, no success as well. In the attached mail.log (mail_debug=yes) you can see, that imap_sieve_plugin is loaded, but it isn’t really executed. The normal (LMTP) sieve is working - if a mail is incoming the sieve module shows it work in mail.log: May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: file storage: Storage path `/var/vmail/myhost.name/postmaster/sieve' not found May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: file storage: Storage path `/var/vmail/myhost.name/postmaster/.dovecot.sieve' not found May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: storage: No default script location configured May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: User has no personal script May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: file storage: Using script storage path: /etc/dovecot/sieve/after/ May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: file script: Opened script `spam' from `/etc/dovecot/sieve/after/spam.sieve' May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: executed after user's Sieve script(1): /etc/dovecot/sieve/after/spam.sieve May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: Mailbox <lmtp DATA>: Opened mail UID=1 because: header Message-ID (Cache file is unusable) May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: Opening script 1 of 1 from `/etc/dovecot/sieve/after/spam.sieve' May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: Loading script /etc/dovecot/sieve/after/spam.sieve May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: Script binary /etc/dovecot/sieve/after/spam.svbin successfully loaded May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: binary save: not saving binary /etc/dovecot/sieve/after/spam.svbin, because it is already stored May 7 17:54:04 dovecot dovecot: lmtp(postmaster(a)myhost.name): Debug: YEm9ILyS8FqSaAAAujt/SA: sieve: Executing script from `/etc/dovecot/sieve/after/spam.svbin' I already spent hours on this problem so please let me know if you have any idea what the problem could be… :( Thanks in advance! Andreas

3 4

Sieve matching "size" with user variable?
by Ed W 25 Mar '19

25 Mar '19

Hi, I am trying to create a sieve filter which does something similar to the following: if size :over ${extdata.max_size} { # do something } This doesn't seem supported in recent dovecot and size only appears to accept a literal number? I'm not sure I could extra size into a variable either (to use variable matching). My understanding of sieve filters is that one needs to use something like a match, then use something like SET to put the match into a variable? This syntax doesn't seem to be compatible with the size test here either, so I don't see that I can do this? My goal is that users can set a user configurable setting (in an external front end) and if the email size is greater than this size then we will do some processing on it. This particular filter is actually in a global sieve filter. I guess I could use an external executable program, but is there another way to do this? Thanks for ideas Ed W

2 3

dovecot sasl support
by Wojciech Puchar 24 Mar '19

24 Mar '19

i've tried to replace saslauthd with dovecot sasl service stopped saslauthd daemon and added service auth { unix_listener /var/run/saslauthd/mux { mode = 0660 user = root group = mail } } so it will listen on the same socket. the effect with sendmail is as below Mar 23 21:23:29 <2.3> puchar dovecot: auth: Error: Authentication client not compatible with this server (mixed old and new binaries?) do i need to specify something while compiling sendmail to make it compatible?

3 6

Cannot get sieve script replication to work
by Marcel Menzel 24 Mar '19

24 Mar '19

Hello, I've set up dsync replication on 2 nodes and mail replication is working flawlessly, however it seems that replicating the sieve scripts won't work. Managesieve and sieve filter in gerneral seems to work on both nodes, however in order to have a synchronized state, I have to log onto both nodes with managesieve and save & activate the script. What's funny about this is that only deactivating the active sieve script (which removes the symlink) replicates from one node to the other (it's gone on both nodes then), but saving a new sieve script and activating it does not work. I cannot find anything on the internet about this problem (only old threads where an old commit should've fixed it), so I am asking here. Enabling mail_debug = yes and sieve_trace_debug = yes does not print anything useful here, the only thing I spotted was after creating and deleting the script afterwards, the other node complained about not being able to find the script: dovecot[15942]: doveadm: Debug: sieve: file script: File `/var/vmail/mcl.gg/mail/sieve/unnamed.sieve' not found dovecot[15942]: doveadm: Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/files/unnamed' (last change: 2019-03-24 15:24:27) All the messages about "Debug: sieve: file storage:" are correct. I am using Dovecot 2.3.5 (513208660) with Pigeonhole version 0.5.4 (60b0f48d) on Arch Linux 4.20.16.a-1-hardened. I've attached both node's doveconf -n. Kind regards, Marcel Menzel

1 0

Is this assumption correct?
by Tobi 24 Mar '19

24 Mar '19

Hello list we encounter a weird SSL issue with one of our dovecot (2.2.24 on Centos6) which we can only explain if our assumtion is correct Symptoms are that imaps connections (on port 993) suddenly get veeeery slow. Up to 180s for one connection with openssl s_client The thing we do not understand is that in the same time imap connections with starttls are just 1s. We can see that entropy on the affected system is not so high cat /proc/sys/kernel/random/entropy_avail 138 So our current theory is: we're running short of entropy but imaps connections are much more affected because they are encrypted from first bit. Whereas a starttls connection has an unencrypted part which generates some entropy it does not use. So I can add entropy to the system that other connections can use. We're open for any other theory but for the moment we believe (tm) that this is the reason that starttls is far more less affected than SSL Cheers tobi

3 2

Re: Dovecot quota and Postfix smtpd_recipient_restrictions?
by Davide Marchi 24 Mar '19

24 Mar '19

>> Well, >> >> so the right syntax (in my case) would be: >> >> -o smtpd_recipient_restrictions = >> reject_non_fqdn_recipient,reject_unknown_recipient_domain,permit_sasl_authenticated,reject,check_policy_service >> inet:mailstore.example.com:12340 >> >> right?? > I configured it before the "permit_sasl_authenticated" and the "reject" > statement. > I've a doubt (again): Is it correct the the space between "[..]service" and "inet[..]"? As suggested here: https://blog.sys4.de/postfix-dovecot-mailbox-quota-en.html I've run: postconf smtpd_recipient_restrictions=check_policy_service inet:mailstore.example.com:12340 but obtain the error: postconf: fatal: missing '=' after attribute name: "inet:mailstore.example.com:12340" Please, which is the correct syntax? :-) Thanks again! Davide

2 1

is it possible - username aliases
by Wojciech Puchar 23 Mar '19

23 Mar '19

i already have quite large dovecot installation with multiple domains but with users handled via unix passwd. Domain name mapping in both directions is done by sendmail, and mail delivery by procmail to Maildir format - one account per user. this accounts are often used for more than mail. So for example john smith have email john(a)foo.pl and unix username foo-john. His imap client and smtp client is configured to use login foo-john and email address john(a)foo.pl Everything works flawlessly. But i will have few new users that insist of being able to login as someone(a)somewhere.pl Can i have something similar to sendmail method in dovecot - an alias table like someone(a)somewhere.pl some-unix-account For this few users and have everything like it is now?

2 3

quota-service with Director - A workaround
by Tom Sommer 23 Mar '19

23 Mar '19

I realize quota-service on Director is not supported, which is a shame. As a workaround I'm thinking of setting up quota-service on one of my backend nodes, and have all my Postfix services ask this one node for the quota status. This sort of defeats the purpose of the Director (having per-user assigned hot nodes), since now this one node running the quota-service will access all mailboxes to check the status of all inbound mail. Is this a problem though? In terms of NFS locking etc. etc.? -- Tom

3 5

Send folder disappeared
by Esteban L 23 Mar '19

23 Mar '19

Hello, Dovecot 2.2.27 I have a strange issue, where my "Send" folder was absent in my mailbox. It had been there before, fully functioning. Then, it was gone. I went into: vi /etc/dovecot/conf.d/15-mailboxes.conf And, noticed that my mailbox for Sent was no longer automatically subscribed, so I changed it, and restarted dovecot. > # For \Sent mailboxes there are two widely used names. We'll mark > both of > # them as \Sent. User typically deletes one of them if duplicates > are created. > mailbox Sent { > special_use = \Sent > auto = subscribe > } > mailbox "Sent Messages" { > special_use = \Sent > } > } Now, Sent shows up again, but email I send, doesn't show up in the sent file?? The sent file is, and remains, empty. >

2 2

Is this assumption correct?
by Tobi 23 Mar '19

23 Mar '19

Hello list we encounter a weird SSL issue with one of our dovecot (2.2.24 on Centos6) which we can only explain if our assumtion is correct :-) Symptoms are that imaps connections (on port 993) suddenly get veeeery slow. Up to 180s for one connection with openssl s_client The thing we do not understand is that in the same time imap connections with starttls are just 1s. We can see that entropy on the affected system is not so high cat /proc/sys/kernel/random/entropy_avail 138 So our current theory is: we're running short of entropy but imaps connections are much more affected because they are encrypted from first bit. Whereas a starttls connection has an unencrypted part which generates some entropy it does not use. So I can add entropy to the system that other connections can use. We're open for any other theory but for the moment we believe (tm) that this is the reason that starttls is far more less affected than SSL Cheers tobi

1 0

Messages not saved to my "Sent" folder
by Esteban L 23 Mar '19

23 Mar '19

Hello, Using Dovecot 2.2.27 1. Had an issue where my Sent box, "disappeared." I used to be present, but then it was just gone. I went in and changed the /etc/dovecot/conf.d/15-mailboxes.conf the auto=subscribe feature had disappeared, even though I had added that line at setup. Below is the new changes. # For \Sent mailboxes there are two widely used names. We'll mark both of # them as \Sent. User typically deletes one of them if duplicates are created. mailbox Sent { special_use = \Sent auto = subscribe } mailbox "Sent Messages" { special_use = \Sent } } 2. But, mail is STILL not sent to SENT folder. 3. I have reload both postfix and dovecot, and also systemctl restart postfix && systemctl restart dovecot. The Sent folder is present, but no mail is stored to it. 4. Before sending this email, I checked my mobile client, and the Sent file was full from previously sent email. When I "updated it"/repolled it, it is now empty. Any able to lend a helping hand? Thanks.

1 0

Maildirs on AWS EFS
by Rodolfo Gonzalez 22 Mar '19

22 Mar '19

Hello, AWS released one month ago a EFS system with administered life cycle, which means that files not accessed in the last 30 days are moved to a lower cost storage tier. Currently I hold my e-mail, delivered to Maildir++ folders by postfix and retrieved with Dovecot, in standard EBS volumes. This has the disadvantage that I need to allocate more than enough space to ensure that the volume won't get filled too soon. And this costs. Changing to standard EFS wasn't an option, since it's way more expensive than EBS. But, with the new system, costs are lower. I just have a doubt in the technical side: is it safe to have the email in EFS? I've read experiences about storing in S3 and using a driver to mount the bucket, and it seems that it's not a very good option. But EFS works like NFS4. Does anyone have experience mounting an EFS to store maildirs? Thanks in advanced, Rodolfo.

4 3

Can't remove a folder created with doveadm import from IMAP client
by Francis 22 Mar '19

22 Mar '19

Hi, I imported mails with the doveadm import command. It worked great, but now, I'm unable to remove the folder backup-2019-03-22? In Thunderbird, the folder is displayed with grey italic font. The command I ran: doveadm import -u user(a)example.com mdbox:/var/vmail/domains/ example.com/user/mdbox-backup INBOX/backup-2019-03-22 all I found this help page from Mozilla: http://kb.mozillazine.org/Grey_italic_folders. It says Thunderbird display the folder in grey italic when the folder have the \Noselect flag. Is it the case with the problem I'm having? If yes, how to remove that flag on the folder? Thanks. -- Francis

1 0

dovecot.sieve shows up as a mailbox
by Esteban L 22 Mar '19

22 Mar '19

Hello, Config infos below. Short version, I am getting this weird anomaly on my main email account. Such that, "dovecot.sieve" is showing up as a mailbox in my various email clients (e.g. k-9 (mobile), and Evolution). I have tried deleting the "rogue folder" with doveadm, but it just returns. Anyone have any suggestions where I can track this down. dovecot --version 2.2.27 dovecot -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.8 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes mail_debug = yes mail_location = maildir:/var/mail/vmail/%d/%n mail_plugins = " quota" mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded- character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_grace = 10%% quota_rule = *:storage=10G quota_rule2 = Trash:storage=+1G quota_status_overquota = 552 5.2.2 Mailbox is full quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_after = /etc/dovecot/sieve/spamfilter.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/little-beak.com/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol lmtp { mail_plugins = " quota sieve" postmaster_address = esteban(a)little-beak.com } protocol lda { mail_plugins = " quota sieve" } protocol imap { mail_plugins = " quota imap_quota" }

5 7

Re: imap ---- LIST "" * The returned mailbox does not display quotes
by lty 21 Mar '19

21 Mar '19

Yes, Foxmail for mac client, after dovecot upgrade from 2.1.17 to new version, imap can't receive any email, I perform packet capture test, foxmail will not have next step after sending {LIST "" *} command action. Foxmail for mac client, dovecot version 2.1.17 can receive imap mail normally, because we need to add quota_max_mail_size configuration, we must upgrade to a higher version (https://wiki2.dovecot.org/Quota/Configuration# Maximum_saved_mail_size) After comparison, the new version of dovecot returned without quotes. I hope that the quotes can be changed in the configuration, can I? Can I change the configuration to add quotes now? Or add this setting in the next version. > On 21 Mar 2019, at 6.22, lty via dovecot <dovecot(a)dovecot.org> wrote: > >> dovecot version >> >> v2.2.29 >> >> v2.2.36 >> >> v2.3.5 >> >> LIST "" * The returned mailbox does not display quotes >> v2.1.17 >> >> LIST "" * The returned mailbox shows quotation marks >> >> Why is the quotation mark removed in the new version? > > Because they were unnecessary. The code was changed to use more generic IMAP token writer, which adds quotes only as necessary. > >> Is there any configuration option in the new version to add quotes? > > No. Does it break some client?

4 3

Re: Dovecot quota and Postfix smtpd_recipient_restrictions?
by Davide Marchi 21 Mar '19

21 Mar '19

> From: Urban Loesch <bind(a)enas.net> > Hi, > >> Well, >> >> so the right syntax (in my case) would be: >> >> -o smtpd_recipient_restrictions = >> reject_non_fqdn_recipient,reject_unknown_recipient_domain,permit_sasl_authenticated,reject,check_policy_service >> inet:mailstore.example.com:12340 >> >> right?? > I configured it before the "permit_sasl_authenticated" and the "reject" > statement. > >> >> And eventually, should you suggest me how made some functional >> verification test? > According to: http://www.postfix.org/SMTPD_POLICY_README.html try on > your postfix: > > telnet mailstore.example.com 12340 > > and insert the following lines: > > sender=somesender(a)somedomain.com > recipient=your(a)recipient.com > size=12345 > [empty line] > > > Set a size= in bytes which is greater that your configured quota. > In theory the policy service should respond with your configured error > message "552 5.2.2 Mailbox is full". > > Example on my server: > > ... > sender=postmaster(a)somedomain.com > recipient=my(a)recipient.com > size=123450000000 > > action=552 5.2.2 Mailbox is full > ... > > > For a livetest reduce the quota of your testaccount to ex. 100KB and > the send a mail > 100BK from outside to it. You should see the "552" > error > message in your logs and you should get back a bouncemail from the > sending server. > > Hope I explained it correct. > > Best > Urban WAW! Very very clear your example! Thanks again Urban, you are a friend ;-) I will try... Thanks again to all! Davide -- cosmogoniA n o p r o v a r e n o f a r e o n o n f a r e n o n c e p r o v a r e

1 0

imap ---- LIST "" * The returned mailbox does not display quotes
by lty 21 Mar '19

21 Mar '19

dovecot version v2.2.29 v2.2.36 v2.3.5 LIST "" * The returned mailbox does not display quotes dovecot version v2.1.17 LIST "" * The returned mailbox shows quotation marks Why is the quotation mark removed in the new version? Is there any configuration option in the new version to add quotes? Because I see a lot of big public mailboxes with quotation marks.

2 1

Dovecot crashing when attempting to search in virtual folder with fts_squat activated
by benjamin＠godbersen.info 20 Mar '19

20 Mar '19

Hi everyone, I am running into a problem when trying to use fts_squat in a virtual folder. Without fts_squat plugin the search (from, subject...) works in all folders. With activated fts the search on the inbox folders works expectedly well but any attempt to search anything in any virtual folder leads to the following error. Similarly when attempting "doveadm fts lookup". I also noticed that no search index for the virtual folders gets build - is this expected behaviour? Mar 14 23:14:58 *** dovecot: service=imap, user=***, ip=[::1]. Panic: file mail-storage.c: line 1913 (mailbox_get_open_status): assertion failed: (box->opened) Mar 14 23:14:58 *** dovecot: service=imap, user=***, ip=[::1]. Error: Raw backtrace: /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(+0xba731) [0x7f553a7ff731] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(+0xba7fa) [0x7f553a7ff7fa] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(i_fatal+0) [0x7f553a771638] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot-storage.so.0(mailbox_get_open_status+0x68) [0x7f553aae4a78] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x3684) [0x7f553677a684] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x3820) [0x7f553677a820] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_lookup_multi+0x163) [0x7f5539b016a3] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xd728) [0x7f5539b06728] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_search_lookup+0xeb) [0x7f5539b06bbb] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xf8b8) [0x7f5539b088b8] -> dovecot/imap(imap_search_start+0x6a) [0x5654cb5a0d6a] -> dovecot/imap(cmd_sort+0x293) [0x5654cb593553] -> dovecot/imap(command_exec+0x64) [0x5654cb599874] -> dovecot/imap(+0x1bd22) [0x5654cb597d22] -> dovecot/imap(+0x1bdbc) [0x5654cb597dbc] -> dovecot/imap(client_handle_input+0x1b5) [0x5654cb5981c5] -> dovecot/imap(client_input+0xa4) [0x5654cb5987e4] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f553a8174a9] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7f553a818d1e] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f553a8175ac] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f553a8177b8] -> /usr/lib/x86_64-linux-gnu/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f553a7940a3] -> dovecot/imap(main+0x339) [0x5654cb58a539] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f553a375b97] -> dovecot/imap(_start+0x2a) [0x5654cb58a71a] Mar 14 23:14:58 *** dovecot: service=imap, user=***, ip=[::1]. Fatal: master: service(imap): child 6436 killed with signal 6 (core dumps disabled) This is my config: # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 4.15.0-46-generic x86_64 Ubuntu 18.04.2 LTS ext4 auth_mechanisms = plain login digest-md5 cram-md5 apop auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890&.-_@' default_vsz_limit = 8096 M disable_plaintext_auth = no first_valid_uid = 30 imap_client_workarounds = delay-newmail imap_logout_format = rcvd=%i, sent=%o mail_home = /var/qmail/mailnames/%Ld/%Ln mail_location = maildir:/var/qmail/mailnames/%Ld/%Ln/Maildir mail_log_prefix = "service=%s, user=%u, ip=[%r]. " mail_max_userip_connections = 100 mail_plugins = quota fts fts_squat virtual managesieve_logout_format = rcvd=%i, sent=%o managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeri$ namespace inbox { inbox = yes location = prefix = INBOX. separator = . } namespace virtual { hidden = no inbox = no list = yes location = virtual:/var/qmail/mailnames/%Ld/%Ln/virtual/:INDEX=/var/qmail/mailnames/%Ld/%Ln/virtual/ prefix = separator = . } passdb { driver = plesk } plugin { fts = squat fts_squat = partial=4 full=10 quota = maildir:User quota quota_grace = 0 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = rcvd=%i, sent=%o, top=%t/%p, retr=%r/%b, del=%d/%m, size=%s protocols = imap pop3 sieve service auth-worker { group = user = } service auth { group = unix_listener auth-userdb { group = popuser mode = 0600 user = popuser } user = } service imap-login { process_limit = 2048 service_count = 1 } service imap { process_limit = 2048 service_count = 1 } service pop3-login { process_limit = 2048 service_count = 1 } service pop3 { process_limit = 2048 service_count = 1 } ssl_cert = </etc/dovecot/private/dovecot.pem ssl_cipher_list = HIGH:!aNULL:!MD5 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = uid=popuser gid=popuser driver = static } protocol imap { mail_plugins = quota fts fts_squat virtual imap_quota } protocol pop3 { pop3_uidl_format = UID%u-%v } protocol sieve { mail_plugins = quota fts fts_squat virtual } protocol lda { mail_plugins = quota fts fts_squat virtual sieve } dovecot --version -> 2.3.0.1 (ffd8a29) I will be greatful for any tips hinting me on how to resolve this behaviour. Thank you very much in advance Benjamin

4 5

Dovecot Wiki: Please disable edit on double click
by Michael Goth 20 Mar '19

20 Mar '19

Hi Aki, could you maybe disable the 'edit on doubleclick' feature on wiki2.dovecot.org? Everytime I try to select a word by double clicking on it, I end up in editing mode. It's just a minor thing, but maybe I'm not the only one who's annoyed by this ;) Thanks! Michael

6 6

Checkpassword.
by Niamh Holding 20 Mar '19

20 Mar '19

Hello, I've run into the issue detailed at https://wiki2.dovecot.org/AuthDatabase/CheckPassword#Security Understandably I don't have the skills to modify checkpassword so if I do the suggested will it work? If you can't change the script, you can make Dovecot's checkpassword-reply binary setuid or setgid (e.g. chgrp dovecot /usr/libexec/dovecot/checkpassword-reply; chmod g+s /usr/libexec/dovecot/checkpassword-reply) -- Best regards, Niamh mailto:niamh@fullbore.co.uk

1 1

Re: Dovecot quota and Postfix smtpd_recipient_restrictions?
by Davide Marchi 20 Mar '19

20 Mar '19

> From: Urban Loesch > > Hi, > >> I would like to enable (the same) quota (count) for all >> (virtual)users, >> on Debian Stretch, Postfix 3.1.8, Dovecot 2.2.27, >> and is not clear for me if I need to tell Postfix to communicate with >> the service in /etc/postfix/main.cf as here: >> >> >> smtpd_recipient_restrictions = >> ... >> check_policy_service inet:mailstore.example.com:12340 > I configured it like your example above and it works for me. > > Best > Urban Well, so the right syntax (in my case) would be: -o smtpd_recipient_restrictions = reject_non_fqdn_recipient,reject_unknown_recipient_domain,permit_sasl_authenticated,reject,check_policy_service inet:mailstore.example.com:12340 right? :-) And eventually, should you suggest me how made some functional verification test? Many many many thanks Urban!! ;-) Davide

2 1

Dovecot quota and Postfix smtpd_recipient_restrictions?
by Davide Marchi 20 Mar '19

20 Mar '19

Hi Friends, a doubt: I would like to enable (the same) quota (count) for all (virtual)users, on Debian Stretch, Postfix 3.1.8, Dovecot 2.2.27, and is not clear for me if I need to tell Postfix to communicate with the service in /etc/postfix/main.cf as here: smtpd_recipient_restrictions = ... check_policy_service inet:mailstore.example.com:12340 My current Postfix "smtpd_recipient_restrictions": -o smtpd_recipient_restrictions=reject_non_fqdn_recipient,reject_unknown_recipient_domain,permit_sasl_authenticated,reject Currently I've edited: conf.d/10-mail.conf: # Space separated list of plugins to load for all services. Plugins specific to # IMAP, LDA, etc. are added to this list in their own .conf files. mail_plugins = $mail_plugins quota conf.d/20-imap.conf: protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_quota } conf.d/90-quota.conf: (for use with the quota-status service) plugin { quota_grace = 10%% # 10% is the default quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } /etc/dovecot/conf.d/90-quota.conf: plugin { quota = maildir quota_rule = *:storage=3G quota_rule2 = Trash:storage=+100M # LDA/LMTP allows saving the last mail to bring user from under quota to # over quota, if the quota doesn't grow too high. Default is to allow as # long as quota will stay under 10% above the limit. Also allowed e.g. 10M. #quota_grace = 10%% # 10% is the default quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota #quota = fs:User quota quota = count:User quota # This is required - it uses "virtual sizes" rather than "physical sizes" for quota counting: quota_vsizes = yes } plugin { #quota = dict:user::proxy::quota #quota2 = dict:domain:%d:proxy::quota_domain #quota_rule = *:storage=102400 #quota2_rule = *:storage=1048576 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = dovecot unix_listener quota-warning { user = vmail } } service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } Many many thanks!! Davide

3 2

4sec latency when using director
by Erik de Waard 19 Mar '19

19 Mar '19

Hi, I've been running dovecot for many years, but now i've hit a strange problem. when retrieving imap there is sometimes in 1 of 4 imap requests a 4sec latency. * notes: - connected directly to the backends this latency disappears - removing a director from the loadbalancer(lvs) so i'm the only connected to the director this latency disappears too I would appreciate some feedback of where to look because i tried various options. (client_limit,process_limit) perhaps its just as simple as to add more directors but any feedback would be welcome. Thank you. This is the setup: -- Internet -> LVS -> 3 Directors -> 9 Backends. doveadm director status mail server ip tag vhosts state state changed users 10.0.10.110 100 up - 3309 10.0.10.111 100 up - 3412 10.0.10.112 100 up - 3458 10.0.10.113 100 up - 3437 10.0.10.115 100 up - 3368 10.0.10.116 100 up - 3320 10.0.10.117 100 up - 3305 10.0.10.118 100 up - 3291 10.0.10.223 100 up - 3280 #Director doveconf -n # Pigeonhole version 0.4.22 (22940fb7) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.4 # Hostname: server312.company.com auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 days auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 3000 director_mail_servers = 10.0.10.223 10.0.10.110 10.0.10.111 10.0.10.112 10.0.10.113 10.0.10.115 10.0.10.116 10.0.10.117 10.0.10.118 director_servers = 10.0.10.114 10.0.10.181 10.0.10.182 director_user_expire = 1 days disable_plaintext_auth = no info_log_path = /dev/null lmtp_proxy = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e encryption=%k secured=%c mail_max_userip_connections = 100 passdb { args = proxy=y nopassword=y driver = static } protocols = imap lmtp service director { fifo_listener login/proxy-notify { mode = 0600 user = $default_login_user } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { client_limit = 6000 executable = imap-login director process_limit = 4 process_min_avail = 4 service_count = 0 vsz_limit = 600 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } } ssl_cert = </etc/ssl-certificates/MDC_company_com.crt ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4:!SEED@STRENGTH ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes protocol lmtp { auth_socket_path = director-userdb } #backend doveconf -n # 2.2.34 (874deae): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.22 (22940fb7) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.4 # Hostname: server250.company.com auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 days auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 1500 default_vsz_limit = 600 M disable_plaintext_auth = no info_log_path = /dev/null listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_max_userip_connections = 100 mail_privileged_group = mail mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { sieve_execute_bin_dir = /etc/dovecot/sieve-executables sieve_global_extensions = +vnd.dovecot.execute sieve_plugins = sieve_extprograms } protocols = imap lmtp service anvil { unix_listener anvil-auth-penalty { mode = 0600 } } service auth { user = root } service imap-login { client_limit = 6000 process_limit = 4 process_min_avail = 4 service_count = 0 vsz_limit = 600 M } service imap { client_limit = 1 process_limit = 1024 service_count = 50 } service lmtp { inet_listener lmtp { port = 24 } } ssl = no ssl_cert = </etc/dovecot/dovecot.crt ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " sieve" plugin { sieve = ~/filters.sieve sieve_after = /etc/dovecot/sieve/after.sieve sieve_before = /etc/dovecot/sieve/before.sieve } userdb { args = /etc/dovecot/dovecot-sql-lmtp.conf driver = sql name = } }

1 1

Way to remove FTS indexes
by Peter Mogensen 19 Mar '19

19 Mar '19

Hi, I was wondering if there was anyway to remove FTS indexes in other to have them rebuild on the next BODY search? All the doveadm commands I can find seem to result in fully build indexes. (which is nice if that's what you want). /Peter

2 1

Re: Upgrade from 2.1.17 2.2.36
by lty 19 Mar '19

19 Mar '19

I use the MAC Foxmail client, v2.2.36 can't receive mail, but v2.1.17 can receive mail. I grabbed the network package and found that Foxmail was not processing the next step after sending the D LIST "" * command. I suspect that because of the time of return, Foxmail is not recognized, so I want to remove this time. 在 2019-03-18 18:03，Aki Tuomi 写道： > On 18.3.2019 12.00, lty via dovecot wrote: > >> v2.1.1 >> >> v2.2.36 >> >> The screenshot is the result returned by imap. >> >> I don't want to want dovecot to return time, can I close it? > > Why do you want this? > > Aki

2 3

AD ldap, filter to exclude various kinds of expired, disabled etc etc users
by mj 19 Mar '19

19 Mar '19

Hi, I was revising our AD ldap user_filter and pass_filter to exclude more types of expired / disabled accounts. I started adding things like: > (&(objectclass=person)(sAMAccountName=%n)(!useraccountcontrol=514)(!(useraccountcontrol=546))(!(useraccountcontrol=66050))(!(useraccountcontrol=8388608))) but then I thought, why not simply do: > (&(objectclass=person)(sAMAccountName=%n)(userAccountControl=512)) as 512 would your regular active user accounts only, excluding all other account types. Looking here (https://support.microsoft.com/en-gb/help/305144/how-to-use-useraccountcontr…) there are some many different userAccountControl to check, that it might be smarter to only allow userAccountControl=512, or....? Any ideas on this..? (or examples of how you do it?) MJ

2 1

Dovecot logrotation - old journal files are still in use
by Denis V Razumovskiy 19 Mar '19

19 Mar '19

2 2

dovecot-openssl-common.c and [-Wincompatible-pointer-types]
by Rupert Gallagher 18 Mar '19

18 Mar '19

Warnings from clang 7.0 when compiling dovecot-openssl-common.c from dovecot 2.3.5 with openssl 1.1.1a. This is dovecot's configuration: > config_options="--prefix=$prefix \ > --sysconfdir=$prefix/etc \ > --datarootdir=$prefix/share \ > --mandir=$man \ > --docdir=$doc \ > --with-docs \ > --with-ssl=openssl --with-ssldir=$prefix/etc \ > --with-sodium \ > --with-libiconv-prefix=/opt/libiconv \ > \ > --with-bzlib=no \ > --with-gssapi=no \ > --with-ldap=no \ > --with-lucene=no \ > --with-lz4=no \ > --with-lzma=no \ > --with-pam=no \ > --with-solr=no \ > --with-sql=no \ > --with-vpopmail=no \ > --with-zlib=no \ > \ > --enable-dependency-tracking"; Note on passing: --with-ssldir=$prefix/etc is ignored by the configurator, as it forces $prefix/etc/dovecot.

1 0

Dovecot logrotation - old journal files are still in use (second attempt)
by Denis V Razumovskiy 18 Mar '19

18 Mar '19

Hi all Sorry, it is the second attempt due to wrong format of the first message. In my Dovecot there are 3 files of logging (debug, info and .log) While executing logrotation, the new files are created, but the previos ones, namely dovecot.*.1 are still in use by the process Here is the logger process in memory: root 19140 0.0 0.0 4140 1576 ? S Mar12 0:06 dovecot/log Here the files it uses after the daily logrotation had happened: # lsof -p19140 |grep log ... log 19140 root 33w REG 9,3 811 417675 /var/log/dovecot.log.1 log 19140 root 34w REG 9,3 2842123 417681 /var/log/dovecot.info.1 log 19140 root 35w REG 9,3 14853918 417683 /var/log/dovecot.debug.1 ... After the manual issue 'doveadm log reopen` command the files are changed to # lsof -p19140 |grep dovecot\\\. ... log 19140 root 33w REG 9,3 0 417651 /var/log/dovecot.log log 19140 root 34w REG 9,3 121374 417690 /var/log/dovecot.info log 19140 root 35w REG 9,3 916153 417691 /var/log/dovecot.debug as it is expected to be. I use the logrotate config for dovecot instance: /var/log/dovecot.log /var/log/dovecot.info /var/log/dovecot.debug { daily rotate 14 missingok notifempty compress delaycompress sharedscripts postrotate doveadm log reopen chmod 666 /var/log/dovecot.log chmod 666 /var/log/dovecot.info chmod 666 /var/log/dovecot.debug endscript } At the same time, dovecot itself still uses previous logs: # lsof |grep var\/log\/dovecot\. dovecot 19138 root 8w REG 9,3 12962 417613 /var/log/dovecot.log.1 (deleted) dovecot 19138 root 9w REG 9,3 4097250 416836 /var/log/dovecot.info.1 (deleted) dovecot 19138 root 10w REG 9,3 23816347 417603 /var/log/dovecot.debug.1 (deleted) What can be the root of the issue? I use Dovecot as LDA for Postfix with system users, mbox mail format. System Slackware 12.0 x86, Postfix 2.4.5, Dovecot 2.2.36. Interconnect Postfix-Dovecot has been made via `mailbox_command = ...' Dovecot was compiled from sources Logging configuration (file conf.d/10-logging.conf) contains the following: log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot.info debug_log_path = /var/log/dovecot.debug auth_verbose = yes auth_verbose_passwords = yes auth_debug = yes mail_debug = yes verbose_ssl = yes plugin { } Could the fact, that Postfix require Dovecot logs to be accessible someway, result in such a weird behavior? To allow other processes to access Dovecot logs I had to chmod 0666 all the current logs while integrating Dovecot into Postfix delivery (please see `chmod' commands in the logrotate config above) Please ignore my previos post https://dovecot.org/pipermail/dovecot/2019-March/115075.html Thank you Denis Razoumovskiy

2 1

child-wait.c and [-Wnull-pointer-arithmetic]
by Rupert Gallagher 18 Mar '19

18 Mar '19

Attached warnings from clang 7.0 when compiling child-wait.c from dovecot 2.3.5: "arithmetic on a null pointer treated as a cast from integer to pointer is a GNU extension [-Wnull-pointer-arithmetic]".

2 2

LDAP users issue
by Anushka Bandara 18 Mar '19

18 Mar '19

Hi Team, I have enabled LDAP authentication with webmail client and it works successfully. But I found an error with LDAP user's mail. Email is not loaded when I log with an LDAP user. Login phase is successful and mail box is the issue. I created a mail user without including LDAP and that user works fine. Issue comes only with LDAP users. *Anushka Bandara* Research Engineer Lanka Software Foundation +94715846018

3 4

Upgrade from 2.1.17 2.2.36
by lty 18 Mar '19

18 Mar '19

v2.1.1 v2.2.36 The screenshot is the result returned by imap. I don't want to want dovecot to return time, can I close it?

2 1

`Spam' folder creation for multiple users
by Marek Kozlowski 17 Mar '19

17 Mar '19

:-) I've just added pigeonhole and a simple sieve script: ------------------------------------------------- require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } ------------------------------------------------- If a user has this folder (`Spam') it works fine. If they haven't it results in an error. 1. Can I modify the script to create this folder if the need arise? 2. If not - what's the most recommended way of adding this folder for all users (~1000)? Thanks! Best regards, Marek

3 2

MikroTik Users Contact List
by Kathleen Brown 17 Mar '19

17 Mar '19

Hello, Hope you're having a great day! I just wanted to know if you're looking to acquire MikroTik Users Contact List for your marketing efforts? Information Field: Names, Title, Email, Phone, Company Name, Company URL, Company physical address, SIC Code, Industry and Company Size (Revenue and Employee). Kindly review and let me know of your target interest so that I can get back to you with the exact counts and sample file. Do let me know if you have any questions for me. Regards, Kathleen Brown Database Executive If you do not wish to receive these emails. Please respond Exit.

2 1