- dovecot - dovecot.org

[FOR THE RECORD] CLIENTID Extension for IMAP/SMTP AUTH in dovecot
by Michael Peddemors 13 Feb '20

13 Feb '20

More and more email clients are now starting to support the CLIENTID extension for IMAP, including 'libetpan', SaneBox, BlueMail, and now as of Thunderbird 68.5.0, available there as well. This allows for a form of native two factor support, permission token, and/or access control to prevent the unauthorized use of email address and password. (For more information, please see the RFC Drafts, or reach out to us off list for details) While the version of dovecot we use has supported it for some time now, we would like to make it available for more email providers who use dovecot. For the record, for those interested in having your dovecot support transparent multi-factor, in your implementation, you will have to compile it with the patch listed in: https://github.com/dovecot/core/pull/86 Once that is done, please feel free to reach out to us for the dovecot plugin, that enables CLIENTID to be supported in the IMAP protocol. -- "Catch the Magic of Linux..." ------------------------------------------------------------------------ Michael Peddemors, President/CEO LinuxMagic Inc. Visit us at http://www.linuxmagic.com @linuxmagic A Wizard IT Company - For More Info http://www.wizard.ca "LinuxMagic" a Registered TradeMark of Wizard Tower TechnoServices Ltd. ------------------------------------------------------------------------ 604-682-0300 Beautiful British Columbia, Canada This email and any electronic data contained are confidential and intended solely for the use of the individual or entity to which they are addressed. Please note that any views or opinions presented in this email are solely those of the author and are not intended to represent those of the company.

1 0

Doveadm Sync problem with symbolic folders
by Gianluca Scaglia 12 Feb '20

12 Feb '20

Hi, i have two servers (debian 10) that synchronize the emails bidirectionally with Doveadm Sync (dovecot 2.3.4.1). Before updating to debian 10, then with dovecot 2.2, I could also synchronize symbolic folders (made with ln-s) without any problems. Now, however, it continues to create temporary folders (e.g. Sent-temp-1 etc.) and I am forced to stop synchronization. Is there any way to make Doveadm Sync ignore symbolic folders? Thanks a lot, Luca Scaglia

1 0

feature request for setting alternative pidfile
by Bjoern Jacke 12 Feb '20

12 Feb '20

Hi, because of an unsupported combination of configuration parameters for different dovecot services I looked into setting up two dovecot instances with different configurations on the same host. It looks like running two different dovecot instances on the same host is not easily possible because the pidfile seems to be hard-coded and there is no way to tell dovecot to use a different one, right? It would be great if this could be made customizable. Björn

2 2

tcpwraper errors with v2.3.9.3
by Bobber 12 Feb '20

12 Feb '20

My system was working fine with version 2.3.9.2. I upgraded to 2.3.9.3 and I am getting tcpwraper errors: > imap-login: Error: connect(tcpwrap) failed: No such file or directory Here's my config: > login_access_sockets = tcpwrap > > service tcpwrap { > unix_listener login/tcpwrap { > group = $default_login_user > mode = 0600 > user = $default_login_user > } > } Any ideas what's happening? -- Bob Wooldridge

1 0

tcpwraper errors with v2.3.9.3
by Robert A Wooldridge 12 Feb '20

12 Feb '20

My system was working fine with version 2.3.9.2. I upgraded to 2.3.9.3 and I am getting tcpwraper errors: > imap-login: Error: connect(tcpwrap) failed: No such file or directory Here's my config: > login_access_sockets = tcpwrap > > service tcpwrap { > unix_listener login/tcpwrap { > group = $default_login_user > mode = 0600 > user = $default_login_user > } > } Any ideas what's happening? -- Bob Wooldridge EDM Incorporated

1 0

Dovecot/doveadm quota
by Martynas Bendorius 12 Feb '20

12 Feb '20

Hello, Is there any reason why dovecot relies on S= instead of real disk size email takes? 1) compressed mails take less than than the S= specified 2) we could avoid using "S=" for the lookups and count every file there, including indexes and mails without S=... if we'd read filesizes Eample: # ls -l '1567026317.M331058P4751.testing.server.com,S=3086,W=3148:2,S' -rw------- 1 dev mail 1274 Aug 29 00:05 1567026317.M331058P4751.testing.server.com,S=3086,W=3148:2,S Proposed patch (solves #1, not sure about your opinion on #2): --- src/plugins/quota/quota-maildir.c.orig 2020-02-05 19:21:08.582998417 -0700 +++ src/plugins/quota/quota-maildir.c 2020-02-05 19:21:22.184998798 -0700 @@ -84,7 +84,7 @@ p = strstr(dp->d_name, ",S="); num = (uoff_t)-1; - if (p != NULL) { + if (0 && p != NULL) { /* ,S=nnnn[:,] */ p += 3; for (num = 0; *p >= '0' && *p <= '9'; p++) @@ -104,7 +104,7 @@ str_truncate(path, len); str_append(path, dp->d_name); if (stat(str_c(path), &st) == 0) { - *total_bytes += st.st_size; + *total_bytes += st.st_blocks * 512; *total_count += 1; } else if (errno != ENOENT && errno != ESTALE) { *error_r = t_strdup_printf( Thank you! -- Best regards, Martynas Bendorius

3 4

Dovecot v2.3.9.3 released
by Aki Tuomi 12 Feb '20

12 Feb '20

We are pleased to release v2.3.9.3 of Dovecot. Please find it from locations below https://dovecot.org/releases/2.3/dovecot-2.3.9.3.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.3.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- v2.3.9.3 2019-02-12 Aki Tuomi <aki.tuomi(a)open-xchange.com> * CVE-2020-7046: Truncated UTF-8 can be used to DoS submission-login and lmtp processes. * CVE-2020-7957: Specially crafted mail can crash snippet generation.

2 2

CVE-2020-7046: Truncated UTF-8 can be used to DoS submission-login and lmtp processes
by Aki Tuomi 12 Feb '20

12 Feb '20

Open-Xchange Security Advisory 2020-02-12 Affected product: Dovecot Core Internal reference: DOV-3744 (JIRA ID) Vulnerability type: Improper Input Validation (CWE-30) Vulnerable version: 2.3.9 Vulnerable component: submission-login, lmtp Fixed version: 2.3.9.3 Report confidence: Confirmed Solution status: Fixed Researcher credits: Open-Xchange oy Vendor notification: 2020-01-14 CVE reference: CVE-2020-7046 CVSS: 7.5 (CVSS3.1:AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H) Vulnerability Details: lib-smtp doesn't handle truncated command parameters properly, resulting in infinite loop taking 100% CPU for the process. This happens for LMTP (where it doesn't matter so much) and also for submission-login where unauthenticated users can trigger it. Risk: Attacker can cause submission-login and lmtp processes to be exhausted, leading into denial of service and CPU resource exhaustion. Solution: Upgrade to 2.3.9.3.

1 0

CVE-2020-7957: Specially crafted mail can crash snippet generation
by Aki Tuomi 12 Feb '20

12 Feb '20

Open-Xchange Security Advisory 2020-02-12 Affected product: Dovecot Core Internal reference: DOV-3743 (JIRA ID) Vulnerability type: Improper Input Validation (CWE-30) Vulnerable version: 2.3.9 Vulnerable component: lmtp, imap Fixed version: 2.3.9.3 Report confidence: Confirmed Solution status: Fixed Researcher credits: Open-Xchange oy Vendor notification: 2020-01-14 CVE reference: CVE-2020-7957 CVSS: 3.1 (CVSS:3.1/AV:N/AC:H/PR:N/UI:R/S:U/C:N/I:N/A:L) Vulnerability Details: Snippet generation crashes if: message is large enough that message-parser returns multiple body blocks The first block(s) don't contain the full snippet (e.g. full of whitespace) input ends with '>' Risk: Sending specially crafted email can cause mailbox to have permanently unaccessible mail, or the mail can be stuck in delivery. Solution: Upgrade to 2.3.9.3

1 0

Folders disappears and all mail lost
by Gabriele Fain 11 Feb '20

11 Feb '20

Hello, I have a Dovecot 2.2.22 configured with mdbox storage. THe server have about 50 mailboxes configured. Only in one mailbox I have a strange problem, sometime (in the last 2 month happens 3 times). All the mail (Except INBOX) and all folders disappear. THe space on disk remain allocated. To this mailbox are connected 3 computers (2 PC Windows 10, and 1 Mac OS). I cannot determine who and why this happens to this mailbox. Can someone tellme how I can find the PC that delete all mail.

2 1

[v 2.3.4.1][quota] recalculation
by Thomas Criscione 11 Feb '20

11 Feb '20

Hello, I can't find the information on the wiki :( When is the quota recalculated after a mail deletion ? For instance, I am running low of storage and I use Thunderbird to delete large mail. I only notice a recalculation when I quit Thunderbirdb and I relaunch it. Even, with doveadm CLI, as long as Thunderbird is not disconnected on the client side, the server didn't recalculate the storage available. Thanks for the help ! Thomas -- Thomas Criscione https://thomascriscione.fr GPG: E521 FFF0 13C4 52FB 55EB 8C49 EBDD 0DC6 1ED9 2A4F

3 4

starttls for some services only
by Bjoern Jacke 10 Feb '20

10 Feb '20

Hi, I would like to disable offering starttls to clients for certain dovecot services. Background is that I want to do let a load balancer do the TLS stuff right on connect time and let dovecot only do plain imap without offering starttls (because the clients do imaps actually). Getting rid of the starttls feature offering works only if I set ssl = no globally only. Setting it in the service imap-login section seems to be impossible. If I set it globally to no though, I cannot use it in other services where it is needed like in the manage-sieve, where clients unfortunately only support starttls and no tls on connect. Is there any way to configure dovecot to offer starttls for some services and for some not or is this just not supported currently? Thanks Björn

2 4

Email Server Backup Strategy
by Esteban L 10 Feb '20

10 Feb '20

Hello, Was thinking it would be wise to backup my server, in case anything "bad" ever happened, so that I could quickly get up to speed. 1. clone the whole drive -- which might be the best to ensure I keep the whole system working. 2. But, what about, if I just wanted to backup my Email server components? Postfix - which I think is just config files, and Dovecot - I think there is a doveadm backup for doing such things. What do you guys do, recommend for backups?? Thanks -- https://www.little-beak.com "Doing what we can."

7 9

postmaster_address parameter scope
by mabi 10 Feb '20

10 Feb '20

Hello, I was wondering when I define the following dovecot parameter: postmaster_address = postmaster(a)mydomain.com in my local.conf config file, does this parameter apply globally? I mean because it is not inside any {} curly braces does it also appliy to: protocol lmtp { ... } or do I need o explicitly define again my postmaster_address parameter inside protocol lmtp{} like this? protocol lmtp { postmaster_address = postmaster(a)mydomain.com } My very same question applies also for protocol lda {}... Regards, Mabi

1 0

Reload Dovecot with thousands of domains.
by Victor 10 Feb '20

10 Feb '20

Hello!, I have a dovecot server configured with about 3k different domains. It worked without problems until SSL certificates has been installed. After increase available RAM and stabilizing the service my current problem is in renewals. Dovecot reload process consumes a lot of memory for every one certificate renewal. The server has enough memory to support reload in most cases, but if server has certain load, reload process throws down the service. I’m using lets encrypt certificates and this process is automated. Is there any way to reload just one domain/session?

1 0

How to configure mail-filter plugin
by 刘莹莹 10 Feb '20

10 Feb '20

I config mail-filter plugin like https://wiki2.dovecot.org/Plugins/MailFilter describe， but error occurred mail-filter plugin config in dovecot.conf: mail_plugins = mail_filter plugin { mail_filter = mail-filter %u # %u = username given to the script as first mail_filter_out = mail-filter-out %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh user = vmail group = vmail unix_listener mail-filter { mode = 0666 user = vmail group = vmail } } service mail-filter-out { executable = script /usr/local/bin/mail-filter-out.sh user = vmail group = vmail unix_listener mail-filter-out { mode = 0666 user = vmail group = vmail } } vim /usr/local/bin/mail-filter.sh touch /tmp/testfile cat > /tmp/tempfile cat /tmp/tempfile vim /usr/local/bin/mail-filter-out.sh cat > /tmp/tempfile cat /tmp/tempfile then "dovecot-lda -f q1(a)a.com -d q1(a)a.com < test.eml" Error log: Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Debug: Namespace : Using permissions from /home/a.com/q1: mode=0700 gid=default Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0) Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f049f4ef582] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f049f4ef68e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe4b6e) [0x7f049f4f9b6e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe4bb1) [0x7f049f4f9bb1] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f049f4565e8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bc47) [0x7f049f520c47] -> /usr/lib64/dovecot/libdovecot-storage.so.0(dbox_save_end+0x35) [0x7f049f8262f5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7f049f81af99] -> /usr/lib64/dovecot/libdovecot-lda.so.0(+0x3fbe) [0x7f049fb0efbe] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x73) [0x7f049f801493] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xc9) [0x7f049f7f38e9] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mdbox_copy+0x46) [0x7f049f81b816] -> /usr/lib64/dovecot/libdovecot-lda.so.0(+0x3daa) [0x7f049fb0edaa] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4e87c) [0x7f049f80187c] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1d7) [0x7f049fb103e7] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x2fe) [0x7f049fb10bfe] -> /usr/libexec/dovecot/dovecot-lda(main+0x615) [0x55f636880045] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f049f073c05] -> /usr/libexec/dovecot/dovecot-lda(+0x3b7e) [0x55f636880b7e]

1 0

noreplicate for some users
by mail＠backprod.de 08 Feb '20

08 Feb '20

Hi, I have set up the sync and it is working but I only would like to sync some users. Currently this does not seem to work. Version 2.3.9.2 Relevant Settings: File users: mail@domain.de:{SHA}hash:::t: passdb { driver = passwd-file args = username_format=%u /etc/dovecot/users } userdb { driver = passwd-file args = username_format=%u /etc/dovecot/users default_fields = uid=2222 gid=2222 home=/var/vmail/%d/%n userdb_noreplicate=t } After restart of dovecot I allways get all users with sudo doveadm replicator status "*" usernamepriority fast sync full sync success sync failed abuse(a)domain.net none 00:01:58 03:52:23 - y admin(a)domein.net none 00:01:58 03:52:23 - y abuse(a)domein.de none 00:01:58 07:51:00 - y What value needs to be set to get replication / no replication and to remove the users from the list? I have tried 0 / 1 / True / False / t / f / T / F but I don't see a change in behavior. Best regards Tim

2 2

Re: mail_filter plugin: failed: EOF without input (Gedalya)
by 刘莹莹 08 Feb '20

08 Feb '20

I just modified mail-filter-out.sh like this: cat  mail-filter-out.sh   #!/bin/sh   USER=$1   cat > /tmp/tempfile   cat /tmp/tempfile cat  /tmp/tempfile This message is in MIME format. --nsmail-7bjyg3nr5o-7bmibqhut9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: base64 PHA+Jm5ic3A7PC9wPjxwPiZuYnNwOzIxMjEyMTIxPC9wPjxwPiZuYnNwOzwv cD48cD4mbmJzcDs8L3A+PHA+Jm5ic3A7PC9wPjxwPiZuYnNwOzwvcD4tLS0t PGRpdiBpZD0iY3MyY19tYWlsX3NpZ2F0dXJlIj48L2Rpdj48cD48L3A+ --nsmail-7bjyg3nr5o-7bmibqhut9-- But the log appears:   Feb 08 19:14:18 lda(q1(a)a.com)<71012><m+U/KQqYPl5kFQEA0J78UA>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0)   Feb 08 19:14:18 lda(q1(a)a.com)<71012><m+U/KQqYPl5kFQEA0J78UA>: Error: Raw backtrace: /opt/svn/nsmail-dovecot-2.3.9_4/src/lib- dovecot/.libs/libdovecot.so.0(backtrace_append+0x42) [0x7f60cc7cc5c2] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(backtrace_get+0x1e) [0x7f60cc7cc6ce] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0xe4bae) [0x7f60cc7d6bae] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0xe4bf1) [0x7f60cc7d6bf1] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(i_fatal+0) [0x7f60cc733628] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0x10bc67) [0x7f60cc7fdc67] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(dbox_save_end+0x35) [0x7f60ccb032e5] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7f60ccaf7f99] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(+0x402e) [0x7f60ccdec02e] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mailbox_save_finish+0x73) [0x7f60ccade4b3] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mail_storage_copy+0xc9) [0x7f60ccad08f9] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mdbox_copy+0x46) [0x7f60ccaf8816] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(+0x3e1a) [0x7f60ccdebe1a] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(+0x4e89c) [0x7f60ccade89c] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(mail_deliver_save+0x1d7) [0x7f60ccded457] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(mail_deliver+0x2fe) [0x7f60ccdedc6e] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lda/.libs/lt-dovecot-lda(main+0x644) [0x55e0340b3144] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f60cc350c05] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lda/.libs/lt-dovecot-lda(+0x3cb6) [0x55e0340b3cb6] ------------------ Original ------------------ From: "dovecot-request"<dovecot-request(a)dovecot.org>; Date: Sat, Feb 8, 2020 06:00 PM To: "dovecot"<dovecot(a)dovecot.org>; Subject: dovecot Digest, Vol 202, Issue 11 Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit https://dovecot.org/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." Today's Topics:    1. Re: mail_filter plugin: failed: EOF without input (Gedalya) ---------------------------------------------------------------------- Message: 1 Date: Fri, 7 Feb 2020 23:48:28 +0800 From: Gedalya <gedalya(a)gedalya.net> To: dovecot(a)dovecot.org Cc: ??? <576709166(a)qq.com> Subject: Re: mail_filter plugin: failed: EOF without input Message-ID: <84fcd237-4290-2518-c4cf-486a049d9231(a)gedalya.net> Content-Type: text/plain; charset=gb18030 On 2/7/20 4:33 PM, ??? wrote: > > cat?mail-filter-out.sh > #!/bin/sh > cat > tempfile > cat ?mail-filter.sh > #!/bin/sh > > USER=$1 > cat > tempfile > > Some important Error logs? > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11) > Hi, Your scripts are reading all the available input and not producing any output. This way the email message is lost. You could add the line: cat tempfile or just replace "cat > tempfile" with "tee > tempfile" ------------------------------ Subject: Digest Footer _______________________________________________ dovecot mailing list dovecot(a)dovecot.org https://dovecot.org/mailman/listinfo/dovecot ------------------------------ End of dovecot Digest, Vol 202, Issue 11 ****************************************

1 0

mail_filter plugin: failed: EOF without input
by 刘莹莹 07 Feb '20

07 Feb '20

some import  configure: plugin {   mail_filter = mail-filter %u # %u = username given to the script as first   mail_filter_out = mail-filter-out %u } service mail-filter {  executable = script /usr/local/bin/mail-filter.sh  user = dovecot  unix_listener mail-filter {    mode = 0600    user = vmail  } } service mail-filter-out {  executable = script /usr/local/bin/mail-filter-out.sh  user = dovecot  unix_listener mail-filter-out {    mode = 0600    user = vmail  } } protocol lda {     mail_plugins = quota sieve expire autocreate mail_filter     auth_socket_path = /var/run/dovecot/auth-master     rejection_subject = Rejected: %s     lda_mailbox_autocreate = yes     lda_mailbox_autosubscribe = yes     sendmail_path = /usr/sbin/sendmail } cat mail-filter-out.sh #!/bin/sh cat > tempfile cat  mail-filter.sh #!/bin/sh USER=$1 cat > tempfile Some important Error logs： Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11)

2 1

mail_filter plugin: failed: EOF without input
by 刘莹莹 07 Feb '20

07 Feb '20

some import  configure: plugin {   mail_filter = mail-filter %u # %u = username given to the script as first   mail_filter_out = mail-filter-out %u } service mail-filter {  executable = script /usr/local/bin/mail-filter.sh  user = dovecot  unix_listener mail-filter {    mode = 0600    user = vmail  } } service mail-filter-out {  executable = script /usr/local/bin/mail-filter-out.sh  user = dovecot  unix_listener mail-filter-out {    mode = 0600    user = vmail  } } protocol lda {     mail_plugins = quota sieve expire autocreate mail_filter     auth_socket_path = /var/run/dovecot/auth-master     rejection_subject = Rejected: %s     lda_mailbox_autocreate = yes     lda_mailbox_autosubscribe = yes     sendmail_path = /usr/sbin/sendmail } cat mail-filter-out.sh #!/bin/sh cat > tempfile cat  mail-filter.sh #!/bin/sh USER=$1 cat > tempfile Some important Error logs： Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11)

1 0

re: Dovecot - Upgrade Solr 7.7.2 to 8.4.1
by Francis Augusto Medeiros-Logeay 05 Feb '20

05 Feb '20

On 1/23/20 7:03 AM, Domenico Pastore wrote: >> So, with Dovecot is it possible to use Apache Solr 8.4? >> High RAM usage is the only problem? > I'm using 8.4.0 and it works flawlessly. I want to install fts-solr, but must tutorials are mentioning solr 7.7.0. Any heads-up on what one must pay attention to when installing 8.4.0? Do I need to update the version on the schemas, for example? Best, Francis

2 1

auth-client via SSL?
by Heiko Schlittermann 05 Feb '20

05 Feb '20

Hello, does dovecot support tls-on-connect for AF INET based auth-client sockets? Rationale behind my question: Exim can use the Dovecot auth-client socket to delegate the SMTP-AUTH authentication to Dovecot. Currently Exim supports the AF UNIX only for this socket. Jeremy makes progress in extending this to use AF INET sockets too. While it works with clear text communication already, during testing I was to setup the auch-client socket as an TLS server (tls-on-connect). It doesn't seem to work as I'd expect. The socket still offers clear-text only. Here my configuration snippets regarding this socket ssl = yes ssl_cert = </etc/dovecot/private/server.pem ssl_key = </etc/dovecot/private/server.pem service auth { … unix_listener auth-client { group = _exim mode = 0660 } inet_listener auth-client { name = exim port = 4711 ssl = yes } } SSL connections to :993 work as expected. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 3

Submission service, XCLIENT and HELO
by Riccardo Alfieri 04 Feb '20

04 Feb '20

Hello, I'm using version 2.3.4.1 and I have a fairly simple setup based on a submission server where I run dovecot and a relay server with postfix. The relevant part of dovecot's config is as follows (sanitized): hostname = submission.domain.local submission_client_workarounds = whitespace-before-path submission_relay_host = 192.168.1.1 <- postfix submission_relay_port = 25 submission_relay_trusted = yes Postfix is configured as follows: smtpd_authorized_xclient_hosts = 192.168.1.2 <- submission server Everything apparently works as expected, meaning that I can correctly authenticate on the submission server and the email is relayed to postfix, where I can see the original MUA's IP correctly logged. There is, however, a little problem with the client HELO string that is not being forwarded to postfix. Instead of having the MUA HELO, I see the submission server HELO, as shown in the following tcpdump taken on the postfix server: 220 postfix.domain.local ESMTP Postfix (Ubuntu) EHLO submission.domain.local 250-postfix.domain.local 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-STARTTLS 250-AUTH DIGEST-MD5 CRAM-MD5 NTLM PLAIN LOGIN 250-AUTH=DIGEST-MD5 CRAM-MD5 NTLM PLAIN LOGIN 250-XCLIENT NAME ADDR PROTO HELO REVERSE_NAME PORT LOGIN DESTADDR DESTPORT 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250 SMTPUTF8 XCLIENT ADDR=192.168.1.3 PORT=57116 LOGIN=riccardo-at-domain.local 220 postfix.domain.local ESMTP Postfix (Ubuntu) EHLO submission.domain.local 250-postfix.domain.local 250-PIPELINING ... As you can see the first EHLO is correctly done with the submission server's hostname, but the subsequent one after XCLIENT is -still- the same hostname, while I was expecting that to be the one forwarded from the MUA, or possibly a "HELO=somethingelse" in the XCLIENT line. I've looked almost everywhere and I couldn't find a way to make dovecot use the MUA's HELO string. The question I'm asking is if there is a way to have the MUA's HELO forwarded to the relay server in some way, or if this is a bug or an expected behaviour. Thanks for any help you could give -- Best regards, Riccardo Alfieri Spamhaus Technology https://www.spamhaustech.com/

1 0

Vacation use different SMTP server
by azurit＠pobox.sk 03 Feb '20

03 Feb '20

Hi, in our setup, we have two SMTP servers: - one for receiving messages (this one is using Dovecot's LMTP for delivery) - one for sending messages (this one is used by our users as outgoing SMTP server) Only the first one has list of local domains, local e-mail accoutns etc. so the second one will ALWAYS use MX records for delivery - with this setup, we can allow to our users to add any domain to their accounts (for example, if someone will add gmail.com and create e-mail accounts on it, it's complete safe because we will never deliver mail for gmail.com locally). The only problem seems to be vacation messages (maybe other messages send by sieve), as Dovecot is using the first SMTP server for sending. My questions: Can i set different SMTP server for sieve messages? How exactly is Dovecot/Sieve choosing which SMTP server will be used? Thanks. azur

3 6

mail_filter and mail_filter_out broken somewhere between 2.2.27 and 2.3.4, problem still exists in git
by Michael Fincham 03 Feb '20

03 Feb '20

Hi Dovecot folks, I recently reported this bug in Debian (https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=939442) after a stretch -> buster upgrade, however since I can reproduce it using the latest 2.4 from git I thought perhaps I ought to take it straight upstream. Here's the text I provided Debian about the issue, and below that I've included a syslog snip showing the same issue in a fresh build of git master as well. mail_filter_out seems to fully panic (backtrace below), whereas mail_filter is just behaving oddly. Thanks :) ***************************** Package: dovecot-core Version: 2.3.4.1-5+deb10u1 Severity: important Hi Dovecot maintainers, After upgrading from the latest stretch version of dovecot-core (2.2.27-3+deb9u5) to buster (2.3.4.1-5+deb10u1) the "mail filter" interface seems to have broken. This problem is also present in the sid version (2.3.7.2-1). Mail filter is used to run the content of messages being stored or retrieved through an arbitrary process. The interface used for the external process is described here: https://wiki.dovecot.org/Plugins/MailFilter It is expected that the process will be called with the arguments specified in the configuration then supplied a message body on stdin, however since upgrading it seems that the arguments are not being correctly passed, instead being all jammed in to $1 and separated by tabs, rather than expanded in to argv. Even stranger the first few lines of the body of the message appear in argv rather than in stdin... These reproduction steps were carried out on a fresh install of Debian Buster with the "dovecot-core" package installed initially from stretch then upgraded to the buster version, however this behaviour has also been observed on stretch systems after upgrading to buster. To reproduce, drop this minimalised config in to /etc/dovecot/conf.d/repro.conf: # Minimal maildir setup for LDA first_valid_uid = 0 mail_location = maildir:~/Maildir userdb { driver = static args = allow_all_users=yes uid=mail gid=mail home=/tmp/%u } # Mail filter configuration mail_plugins = $mail_plugins mail_filter plugin { mail_filter = mail-filter read %u mail_filter_out = mail-filter write %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh user = dovecot unix_listener mail-filter { mode = 0666 } } And create the example script in /usr/local/bin/mail-filter.sh with executable permissions: #!/bin/bash echo "arguments were: $@" 1>&2 tempfile=$(mktemp) cat > "${tempfile}" cat "${tempfile}" rm "${tempfile}" This script simply logs the arguments it recieves, writes stdin to a file then retrieves it again from the file. Here's a sample session of me using dovecot-lda to pass a message through this script, then retrieve it again with doveadm: root@scratch-b6fd8bdd:~# /usr/lib/dovecot/dovecot-lda -d fincham@scratch-b6fd8bdd -f 'Test <scratch-b6fd8bdd>' < /root/test.eml root@scratch-b6fd8bdd:~# doveadm fetch -u 'fincham@scratch-b6fd8bdd' hdr subject Test hdr: To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail root@scratch-b6fd8bdd:~# tail /var/log/syslog | grep mail-filter Sep 5 00:07:48 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write fincham@scratch-b6fd8bdd Sep 5 00:07:50 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: read fincham@scratch-b6fd8bdd However after upgrading dovecot to the buster version this process no longer works, and the logged argv of the example script is very strange: root@scratch-b6fd8bdd:~# apt dist-upgrade Reading package lists... Done Building dependency tree Reading state information... Done Calculating upgrade... Done The following NEW packages will be installed: liblua5.3-0 libsodium23 ssl-cert The following packages will be upgraded: dovecot-core [...] root@scratch-b6fd8bdd:~# /usr/lib/dovecot/dovecot-lda -d fincham@scratch-b6fd8bdd -f scratch-b6fd8bdd < /root/test.eml Aborted root@scratch-b6fd8bdd:~# doveadm fetch -u 'fincham@scratch-b6fd8bdd' hdr subject Test hdr: Hello! doveadm(fincham@scratch-b6fd8bdd): Error: Mailbox INBOX: UID=1: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) (read reason=mail stream) doveadm(fincham@scratch-b6fd8bdd): Error: Corrupted record in index cache file /tmp/fincham(a)scratch-b6fd8bdd/Maildir/dovecot.index.cache: UID 1: Broken physical size in mailbox INBOX: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) doveadm(fincham@scratch-b6fd8bdd): Error: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) doveadm(fincham@scratch-b6fd8bdd): Error: fetch(hdr) failed for box=INBOX uid=1: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) root@scratch-b6fd8bdd:~# tail /var/log/syslog | grep mail-filter Sep 5 00:07:48 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write fincham@scratch-b6fd8bdd Sep 5 00:07:50 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: read fincham@scratch-b6fd8bdd Sep 5 00:12:11 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write#011fincham@scratch-b6fd8bdd#011 To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail Sep 5 00:12:14 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: read#011fincham@scratch-b6fd8bdd#011 To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail -- Package-specific info: dovecot configuration --------------------- # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-5-cloud-amd64 x86_64 Debian 10.0 # Hostname: scratch-b6fd8bdd first_valid_uid = 0 mail_location = maildir:~/Maildir mail_plugins = " mail_filter" mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { mail_filter = mail-filter read %u mail_filter_out = mail-filter write %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh unix_listener mail-filter { mode = 0666 } user = dovecot } ssl = no userdb { driver = passwd } userdb { args = allow_all_users=yes uid=mail gid=mail home=/tmp/%u driver = static } -- System Information: Debian Release: 10.0 APT prefers stable-updates APT policy: (500, 'stable-updates'), (500, 'stable') Architecture: amd64 (x86_64) Kernel: Linux 4.19.0-5-cloud-amd64 (SMP w/2 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /usr/bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled Versions of packages dovecot-core depends on: ii adduser 3.118 ii libapparmor1 2.13.2-10 ii libbz2-1.0 1.0.6-9.1 ii libc6 2.28-10 ii libexttextcat-2.0-0 3.4.5-1 ii libicu63 63.1-6 ii liblua5.3-0 5.3.3-1.1 ii liblz4-1 1.8.3-1 ii liblzma5 5.2.4-1 ii libpam-runtime 1.3.1-5 ii libpam0g 1.3.1-5 ii libsodium23 1.0.17-1 ii libssl1.1 1.1.1c-1 ii libstemmer0d 0+svn585-1+b2 ii libwrap0 7.6.q-28 ii lsb-base 10.2019051400 ii openssl 1.1.1c-1 ii ssl-cert 1.0.39 ii ucf 3.0038+nmu1 ii zlib1g 1:1.2.11.dfsg-1 dovecot-core recommends no packages. Versions of packages dovecot-core suggests: pn dovecot-gssapi <none> pn dovecot-imapd <none> pn dovecot-ldap <none> pn dovecot-lmtpd <none> pn dovecot-lucene <none> pn dovecot-managesieved <none> pn dovecot-mysql <none> pn dovecot-pgsql <none> pn dovecot-pop3d <none> pn dovecot-sieve <none> pn dovecot-solr <none> pn dovecot-sqlite <none> pn dovecot-submissiond <none> ii ntp 1:4.2.8p12+dfsg-4 Versions of packages dovecot-core is related to: ii dovecot-core [dovecot-common] 1:2.3.4.1-5+deb10u1 pn dovecot-dev <none> pn dovecot-gssapi <none> pn dovecot-imapd <none> pn dovecot-ldap <none> pn dovecot-lmtpd <none> pn dovecot-managesieved <none> pn dovecot-mysql <none> pn dovecot-pgsql <none> pn dovecot-pop3d <none> pn dovecot-sieve <none> pn dovecot-sqlite <none> -- no debconf information ***************************** And here it is on 2.4 from git: Sep 5 02:18:10 scratch-b6fd8bdd dovecot: master: Dovecot v2.4.devel () starting up for imap, pop3, lmtp Sep 5 02:18:10 scratch-b6fd8bdd systemd[1]: Started LSB: Dovecot init script. Sep 5 02:18:12 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write#011fincham@scratch-b6fd8bdd#011 To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail Sep 5 02:18:12 scratch-b6fd8bdd dovecot: lda(fincham@scratch-b6fd8bdd)<4213><94f8BWRwcF11EAAA/w3Ckw>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0) Sep 5 02:18:12 scratch-b6fd8bdd dovecot: lda(fincham@scratch-b6fd8bdd)<4213><94f8BWRwcF11EAAA/w3Ckw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xef5fb) [0x7f85ed0715fb] -> /usr/lib/dovecot/libdovecot.so.0(+0xef661) [0x7f85ed071661] -> /usr/lib/dovecot/libdovecot.so.0(+0x4e808) [0x7f85ecfd0808] -> /usr/lib/dovecot/libdovecot.so.0(+0x52ec1) [0x7f85ecfd4ec1] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x96) [0x7f85ed1b24d6] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x4395) [0x7f85ed294395] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x82) [0x7f85ed189e52] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xd9) [0x7f85ed17c409] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x52) [0x7f85ed1aea02] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x4221) [0x7f85ed294221] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5c1bc) [0x7f85ed18a1bc] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1b0) [0x7f85ed295390] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x2f6) [0x7f85ed295ad6] -> /usr/libexec/dovecot/dovecot-lda(main+0x81b) [0x560cba869f4b] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7f85ecdde09b] -> /usr/libexec/dovecot/dovecot-lda(_start+0x2a) [0x560cba86a65a]

2 3