February 2020 - dovecot

Reload Dovecot with thousands of domains.
by Victor 10 Feb '20

10 Feb '20

Hello!, I have a dovecot server configured with about 3k different domains. It worked without problems until SSL certificates has been installed. After increase available RAM and stabilizing the service my current problem is in renewals. Dovecot reload process consumes a lot of memory for every one certificate renewal. The server has enough memory to support reload in most cases, but if server has certain load, reload process throws down the service. I’m using lets encrypt certificates and this process is automated. Is there any way to reload just one domain/session?

1 0

How to configure mail-filter plugin
by 刘莹莹 10 Feb '20

10 Feb '20

I config mail-filter plugin like https://wiki2.dovecot.org/Plugins/MailFilter describe， but error occurred mail-filter plugin config in dovecot.conf: mail_plugins = mail_filter plugin { mail_filter = mail-filter %u # %u = username given to the script as first mail_filter_out = mail-filter-out %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh user = vmail group = vmail unix_listener mail-filter { mode = 0666 user = vmail group = vmail } } service mail-filter-out { executable = script /usr/local/bin/mail-filter-out.sh user = vmail group = vmail unix_listener mail-filter-out { mode = 0666 user = vmail group = vmail } } vim /usr/local/bin/mail-filter.sh touch /tmp/testfile cat > /tmp/tempfile cat /tmp/tempfile vim /usr/local/bin/mail-filter-out.sh cat > /tmp/tempfile cat /tmp/tempfile then "dovecot-lda -f q1(a)a.com -d q1(a)a.com < test.eml" Error log: Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Debug: Namespace : Using permissions from /home/a.com/q1: mode=0700 gid=default Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0) Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f049f4ef582] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f049f4ef68e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe4b6e) [0x7f049f4f9b6e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe4bb1) [0x7f049f4f9bb1] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f049f4565e8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bc47) [0x7f049f520c47] -> /usr/lib64/dovecot/libdovecot-storage.so.0(dbox_save_end+0x35) [0x7f049f8262f5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7f049f81af99] -> /usr/lib64/dovecot/libdovecot-lda.so.0(+0x3fbe) [0x7f049fb0efbe] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x73) [0x7f049f801493] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xc9) [0x7f049f7f38e9] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mdbox_copy+0x46) [0x7f049f81b816] -> /usr/lib64/dovecot/libdovecot-lda.so.0(+0x3daa) [0x7f049fb0edaa] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4e87c) [0x7f049f80187c] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1d7) [0x7f049fb103e7] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x2fe) [0x7f049fb10bfe] -> /usr/libexec/dovecot/dovecot-lda(main+0x615) [0x55f636880045] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f049f073c05] -> /usr/libexec/dovecot/dovecot-lda(+0x3b7e) [0x55f636880b7e]

1 0

noreplicate for some users
by mail＠backprod.de 08 Feb '20

08 Feb '20

Hi, I have set up the sync and it is working but I only would like to sync some users. Currently this does not seem to work. Version 2.3.9.2 Relevant Settings: File users: mail@domain.de:{SHA}hash:::t: passdb { driver = passwd-file args = username_format=%u /etc/dovecot/users } userdb { driver = passwd-file args = username_format=%u /etc/dovecot/users default_fields = uid=2222 gid=2222 home=/var/vmail/%d/%n userdb_noreplicate=t } After restart of dovecot I allways get all users with sudo doveadm replicator status "*" usernamepriority fast sync full sync success sync failed abuse(a)domain.net none 00:01:58 03:52:23 - y admin(a)domein.net none 00:01:58 03:52:23 - y abuse(a)domein.de none 00:01:58 07:51:00 - y What value needs to be set to get replication / no replication and to remove the users from the list? I have tried 0 / 1 / True / False / t / f / T / F but I don't see a change in behavior. Best regards Tim

2 2

Re: mail_filter plugin: failed: EOF without input (Gedalya)
by 刘莹莹 08 Feb '20

08 Feb '20

I just modified mail-filter-out.sh like this: cat  mail-filter-out.sh   #!/bin/sh   USER=$1   cat > /tmp/tempfile   cat /tmp/tempfile cat  /tmp/tempfile This message is in MIME format. --nsmail-7bjyg3nr5o-7bmibqhut9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: base64 PHA+Jm5ic3A7PC9wPjxwPiZuYnNwOzIxMjEyMTIxPC9wPjxwPiZuYnNwOzwv cD48cD4mbmJzcDs8L3A+PHA+Jm5ic3A7PC9wPjxwPiZuYnNwOzwvcD4tLS0t PGRpdiBpZD0iY3MyY19tYWlsX3NpZ2F0dXJlIj48L2Rpdj48cD48L3A+ --nsmail-7bjyg3nr5o-7bmibqhut9-- But the log appears:   Feb 08 19:14:18 lda(q1(a)a.com)<71012><m+U/KQqYPl5kFQEA0J78UA>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0)   Feb 08 19:14:18 lda(q1(a)a.com)<71012><m+U/KQqYPl5kFQEA0J78UA>: Error: Raw backtrace: /opt/svn/nsmail-dovecot-2.3.9_4/src/lib- dovecot/.libs/libdovecot.so.0(backtrace_append+0x42) [0x7f60cc7cc5c2] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(backtrace_get+0x1e) [0x7f60cc7cc6ce] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0xe4bae) [0x7f60cc7d6bae] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0xe4bf1) [0x7f60cc7d6bf1] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(i_fatal+0) [0x7f60cc733628] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0x10bc67) [0x7f60cc7fdc67] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(dbox_save_end+0x35) [0x7f60ccb032e5] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7f60ccaf7f99] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(+0x402e) [0x7f60ccdec02e] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mailbox_save_finish+0x73) [0x7f60ccade4b3] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mail_storage_copy+0xc9) [0x7f60ccad08f9] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mdbox_copy+0x46) [0x7f60ccaf8816] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(+0x3e1a) [0x7f60ccdebe1a] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(+0x4e89c) [0x7f60ccade89c] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(mail_deliver_save+0x1d7) [0x7f60ccded457] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(mail_deliver+0x2fe) [0x7f60ccdedc6e] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lda/.libs/lt-dovecot-lda(main+0x644) [0x55e0340b3144] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f60cc350c05] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lda/.libs/lt-dovecot-lda(+0x3cb6) [0x55e0340b3cb6] ------------------ Original ------------------ From: "dovecot-request"<dovecot-request(a)dovecot.org>; Date: Sat, Feb 8, 2020 06:00 PM To: "dovecot"<dovecot(a)dovecot.org>; Subject: dovecot Digest, Vol 202, Issue 11 Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit https://dovecot.org/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." Today's Topics:    1. Re: mail_filter plugin: failed: EOF without input (Gedalya) ---------------------------------------------------------------------- Message: 1 Date: Fri, 7 Feb 2020 23:48:28 +0800 From: Gedalya <gedalya(a)gedalya.net> To: dovecot(a)dovecot.org Cc: ??? <576709166(a)qq.com> Subject: Re: mail_filter plugin: failed: EOF without input Message-ID: <84fcd237-4290-2518-c4cf-486a049d9231(a)gedalya.net> Content-Type: text/plain; charset=gb18030 On 2/7/20 4:33 PM, ??? wrote: > > cat?mail-filter-out.sh > #!/bin/sh > cat > tempfile > cat ?mail-filter.sh > #!/bin/sh > > USER=$1 > cat > tempfile > > Some important Error logs? > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11) > Hi, Your scripts are reading all the available input and not producing any output. This way the email message is lost. You could add the line: cat tempfile or just replace "cat > tempfile" with "tee > tempfile" ------------------------------ Subject: Digest Footer _______________________________________________ dovecot mailing list dovecot(a)dovecot.org https://dovecot.org/mailman/listinfo/dovecot ------------------------------ End of dovecot Digest, Vol 202, Issue 11 ****************************************

1 0

mail_filter plugin: failed: EOF without input
by 刘莹莹 07 Feb '20

07 Feb '20

some import  configure: plugin {   mail_filter = mail-filter %u # %u = username given to the script as first   mail_filter_out = mail-filter-out %u } service mail-filter {  executable = script /usr/local/bin/mail-filter.sh  user = dovecot  unix_listener mail-filter {    mode = 0600    user = vmail  } } service mail-filter-out {  executable = script /usr/local/bin/mail-filter-out.sh  user = dovecot  unix_listener mail-filter-out {    mode = 0600    user = vmail  } } protocol lda {     mail_plugins = quota sieve expire autocreate mail_filter     auth_socket_path = /var/run/dovecot/auth-master     rejection_subject = Rejected: %s     lda_mailbox_autocreate = yes     lda_mailbox_autosubscribe = yes     sendmail_path = /usr/sbin/sendmail } cat mail-filter-out.sh #!/bin/sh cat > tempfile cat  mail-filter.sh #!/bin/sh USER=$1 cat > tempfile Some important Error logs： Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11)

2 1

mail_filter plugin: failed: EOF without input
by 刘莹莹 07 Feb '20

07 Feb '20

some import  configure: plugin {   mail_filter = mail-filter %u # %u = username given to the script as first   mail_filter_out = mail-filter-out %u } service mail-filter {  executable = script /usr/local/bin/mail-filter.sh  user = dovecot  unix_listener mail-filter {    mode = 0600    user = vmail  } } service mail-filter-out {  executable = script /usr/local/bin/mail-filter-out.sh  user = dovecot  unix_listener mail-filter-out {    mode = 0600    user = vmail  } } protocol lda {     mail_plugins = quota sieve expire autocreate mail_filter     auth_socket_path = /var/run/dovecot/auth-master     rejection_subject = Rejected: %s     lda_mailbox_autocreate = yes     lda_mailbox_autosubscribe = yes     sendmail_path = /usr/sbin/sendmail } cat mail-filter-out.sh #!/bin/sh cat > tempfile cat  mail-filter.sh #!/bin/sh USER=$1 cat > tempfile Some important Error logs： Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11)

1 0

re: Dovecot - Upgrade Solr 7.7.2 to 8.4.1
by Francis Augusto Medeiros-Logeay 05 Feb '20

05 Feb '20

On 1/23/20 7:03 AM, Domenico Pastore wrote: >> So, with Dovecot is it possible to use Apache Solr 8.4? >> High RAM usage is the only problem? > I'm using 8.4.0 and it works flawlessly. I want to install fts-solr, but must tutorials are mentioning solr 7.7.0. Any heads-up on what one must pay attention to when installing 8.4.0? Do I need to update the version on the schemas, for example? Best, Francis

2 1

auth-client via SSL?
by Heiko Schlittermann 05 Feb '20

05 Feb '20

Hello, does dovecot support tls-on-connect for AF INET based auth-client sockets? Rationale behind my question: Exim can use the Dovecot auth-client socket to delegate the SMTP-AUTH authentication to Dovecot. Currently Exim supports the AF UNIX only for this socket. Jeremy makes progress in extending this to use AF INET sockets too. While it works with clear text communication already, during testing I was to setup the auch-client socket as an TLS server (tls-on-connect). It doesn't seem to work as I'd expect. The socket still offers clear-text only. Here my configuration snippets regarding this socket ssl = yes ssl_cert = </etc/dovecot/private/server.pem ssl_key = </etc/dovecot/private/server.pem service auth { … unix_listener auth-client { group = _exim mode = 0660 } inet_listener auth-client { name = exim port = 4711 ssl = yes } } SSL connections to :993 work as expected. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 3

Submission service, XCLIENT and HELO
by Riccardo Alfieri 04 Feb '20

04 Feb '20

Hello, I'm using version 2.3.4.1 and I have a fairly simple setup based on a submission server where I run dovecot and a relay server with postfix. The relevant part of dovecot's config is as follows (sanitized): hostname = submission.domain.local submission_client_workarounds = whitespace-before-path submission_relay_host = 192.168.1.1 <- postfix submission_relay_port = 25 submission_relay_trusted = yes Postfix is configured as follows: smtpd_authorized_xclient_hosts = 192.168.1.2 <- submission server Everything apparently works as expected, meaning that I can correctly authenticate on the submission server and the email is relayed to postfix, where I can see the original MUA's IP correctly logged. There is, however, a little problem with the client HELO string that is not being forwarded to postfix. Instead of having the MUA HELO, I see the submission server HELO, as shown in the following tcpdump taken on the postfix server: 220 postfix.domain.local ESMTP Postfix (Ubuntu) EHLO submission.domain.local 250-postfix.domain.local 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-STARTTLS 250-AUTH DIGEST-MD5 CRAM-MD5 NTLM PLAIN LOGIN 250-AUTH=DIGEST-MD5 CRAM-MD5 NTLM PLAIN LOGIN 250-XCLIENT NAME ADDR PROTO HELO REVERSE_NAME PORT LOGIN DESTADDR DESTPORT 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250 SMTPUTF8 XCLIENT ADDR=192.168.1.3 PORT=57116 LOGIN=riccardo-at-domain.local 220 postfix.domain.local ESMTP Postfix (Ubuntu) EHLO submission.domain.local 250-postfix.domain.local 250-PIPELINING ... As you can see the first EHLO is correctly done with the submission server's hostname, but the subsequent one after XCLIENT is -still- the same hostname, while I was expecting that to be the one forwarded from the MUA, or possibly a "HELO=somethingelse" in the XCLIENT line. I've looked almost everywhere and I couldn't find a way to make dovecot use the MUA's HELO string. The question I'm asking is if there is a way to have the MUA's HELO forwarded to the relay server in some way, or if this is a bug or an expected behaviour. Thanks for any help you could give -- Best regards, Riccardo Alfieri Spamhaus Technology https://www.spamhaustech.com/

1 0

Vacation use different SMTP server
by azurit＠pobox.sk 03 Feb '20

03 Feb '20

Hi, in our setup, we have two SMTP servers: - one for receiving messages (this one is using Dovecot's LMTP for delivery) - one for sending messages (this one is used by our users as outgoing SMTP server) Only the first one has list of local domains, local e-mail accoutns etc. so the second one will ALWAYS use MX records for delivery - with this setup, we can allow to our users to add any domain to their accounts (for example, if someone will add gmail.com and create e-mail accounts on it, it's complete safe because we will never deliver mail for gmail.com locally). The only problem seems to be vacation messages (maybe other messages send by sieve), as Dovecot is using the first SMTP server for sending. My questions: Can i set different SMTP server for sieve messages? How exactly is Dovecot/Sieve choosing which SMTP server will be used? Thanks. azur

3 6