- dovecot - dovecot.org

encrypted storage on the fly using user's password without storing password on the server
by Alex Knowles 05 Mar '20

05 Mar '20

Hi all, I just joined the list. I've read through the mail-crypt plugin docs here https://doc.dovecot.org/configuration_manual/mail_crypt_plugin/ I'm still unclear (I'm not an expert) about the following: Is it possible to obtain on-the-fly encrypted storage using the user's password without the password being stored on the server? Basically a zero-knowledge solution. Theoretically this should be possible as the user provides the password when storing or retrieving emails. The above plugin docs don't make it clear for me whether it is supported. Could a kind clarify? I'd also be very grateful for a working conf as an example. Best wishes and thanks in advance, Alex.

2 2

[PATCH] lib-imap: imap-bodystructure: add test with empty header field
by Simon Ser 03 Mar '20

03 Mar '20

This causes the body structure to be incorrect. The RFC says it's fine o have empty header field values. --- This just adds a failing test, inspired from an e-mail spotted in the wild. Ideas welcome to fix it. src/lib-imap/test-imap-bodystructure.c | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/src/lib-imap/test-imap-bodystructure.c b/src/lib-imap/test-imap-bodystructure.c index 6f456a44530b..b8f215d689c4 100644 --- a/src/lib-imap/test-imap-bodystructure.c +++ b/src/lib-imap/test-imap-bodystructure.c @@ -41,6 +41,19 @@ struct parse_test parse_tests[] = { "\"text\" \"plain\" (\"charset\" \"utf-8\") NIL NIL \"8bit\" 8 2 NIL NIL NIL NIL", .body = "\"text\" \"plain\" (\"charset\" \"utf-8\") NIL NIL \"8bit\" 8 2" + },{ + .message = + "From: user(a)domain.org\n" + "Date: Sat, 24 Mar 2017 23:00:00 +0200\n" + "X-Spam-Level:\n" + "Content-Transfer-Encoding: quoted-printable\n" + "\n" + "body\n" + "\n", + .bodystructure = + "\"text\" \"plain\" (\"charset\" \"us-ascii\") NIL NIL \"quoted-printable\" 8 2 NIL NIL NIL NIL", + .body = + "\"text\" \"plain\" (\"charset\" \"us-ascii\") NIL NIL \"quoted-printable\" 8 2" },{ .message = "From: user(a)domain.org\n" -- 2.25.1

3 3

Dovecot autoexpunge
by Philip Colmer 03 Mar '20

03 Mar '20

Following a previous suggestion I'd received to turn on autoexpunge (https://dovecot.org/pipermail/dovecot/2020-February/118281.html) I'm now trying to confirm whether or not it is doing what I expect it to do. I've set the expiration to be 12 weeks (as shown below in the config) but a lot of the mailboxes have email in them that is much older. Reading http://dovecot.2317879.n4.nabble.com/Dovecot-2-2-20-autoexpunge-td54644.html, I've tried using "doveadm search -u user mailbox INBOX savedbefore 2w" to see if it finds any email that is older than 2 weeks (just as a test) and it doesn't. If I change "savedbefore" to be "sentbefore" then it works. If "autoexpunge" is dependent on "savedbefore" working then what do I need to do to fix this? Thanks. Regards Philip Below is the output of doveconf -n: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1041-aws x86_64 Ubuntu 18.04.3 LTS auth_username_format = %Ln auth_verbose = yes disable_plaintext_auth = no listen = 127.0.0.1 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mailbox_list_index = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox INBOX { autoexpunge = 12 weeks } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap lmtp" service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = no ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { driver = passwd }

1 0

Re: Sieve junks mail script creating links
by Aki Tuomi 02 Mar '20

02 Mar '20

On 19.2.2020 8.51, @lbutlr wrote: > On 18 Feb 2020, at 22:52, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: >> Why not turn on autoexpunge after next nuke? https://doc.dovecot.org/configuration_manual/namespace/#namespace-settings > I should have mentioned I did this: > > mailbox Junk { > auto = subscribe > autoexpunge = 2 weeks > special_use = \Junk > > It’s not working. There were over half a million files in my Junk folder, almost all hard links with over 3,000 links. > Keeping reply in-list... Does this happen after each nuke or was it just first time? Aki

2 2

dovecot-lmtp dont see otherMailbox record?
by pi0trek75 01 Mar '20

01 Mar '20

Hello Postfix + LDAP , Samba as LDAP server, Dovecot virtual_transport set in postfix to dovecot-lmtp ( for autoresponder support ) Users have their email aliases in the otherMailbox record For example, account_test@example-domain user has an alias: test@exmaple-domain Query from command line works fine: postmap -q test@example-domain ldap://etc/postfix/ad_virtual_ account_test/Maildir/ (The filter in the query ad_virtual_mailbox_maps2.cf looks like this: [cut] scope = sub query_filter = (&(objectclass=person)(|(mail= result_attribute= uid result_format = %u/Maildir/ ) However, sending an email to the alias test@example-domain ends: Feb 28 12:31:40 mbox-01 postfix/lmtp[13474]: 2367A6EF: to=<test@example-domain>, relay=mbox-01[private/dovecot- delay=0.05, delays=0.02/0/0.02, dsn=5.1.1, status=bounced (host mbox-01[private/dovecot-lmtp] said: 550 5.1.1 <test@example-domain> User doesn't exist: test@example-domain (in reply to RCPT TO command)) I modified dovecot-ldap.conf.ext: I changed: user_filter = (&(objectClass=person)(uid=%u) to: user_filter = (&(objectClass=person)(|(uid=% but that didn't solve the problem. Where's the bug? Any hint? Below dovecot configuration: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.2 # Hostname: mbox-01 auth_cache_negative_ttl = 0 auth_username_format = %Ln disable_plaintext_auth = no mail_gid = vmail mail_location = mbox:~/mail:INBOX=/var/mailbox mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { sieve = /var/mailbox-store/%u/.dovecot sieve_dir = /var/mailbox-store/%u sieve_extensions = +vacation-seconds sieve_trace_debug = yes sieve_trace_dir = /tmp/sieve/ sieve_trace_level = matching sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1h } protocols = " imap lmtp sieve pop3 sieve" service auth { unix_listener /var/spool/postfix/private/aut { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dov { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 1024 } service stats { unix_listener stats-reader { group = vmail mode = 0660 user = vmail } unix_listener stats-writer { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/dovecot/private/dovecot. ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = " sieve" } protocol lda { info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.lo mail_plugins = " sieve" } and dovecot-ldap.conf.ext: [cut] deref = never scope = subtree user_attrs = =mail=maildir:/var/mailbox-sto user_filter = (&(objectClass=person)(|(uid=% pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=person)(uid=%u) default_pass_scheme = CRYPT

1 0

max number of connections per ip
by Esteban L 29 Feb '20

29 Feb '20

I have been haunted by the following error message or months, that we see using Thunderbird. Unable to connect to your IMAP server. You may have exceeded the maximum number of connections to this server. If so, use the Advanced IMAP Server Settings dialogue to reduce the number of cached connections. If I change my location, via a VPN, the error message goes away and I can connect. I have edited my /etc/dovcot/conf.d/20-imap.conf file by adding the following: protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_quota # Maximum number of IMAP connections allowed for a user from each IP address. # NOTE: The username is compared case-sensitively. mail_max_userip_connections = 500 } And, I still get the error message. I know myself, I have about 8-9 accounts, some with as many as 10 folders (I know each one count's as it's own mailbox), as does my partner--who would access the internet from my IP. Does that number really have to be like 10,000, or something? If so, why does it start out so small in the first place. If not, what else could I do to avoid this message going forward??

4 9

doveadm acl recursive
by Armin Schindler 28 Feb '20

28 Feb '20

Hello, I try to set acl settings on a public folder including its subfolders. There is no option for acting recursive. But the documentation says wildcards can be given on the mailbox name. But this doesn't work. No matter how the mailbox name is provided with a wildcard, doveadm always tells Mailbox doesn't exist. Folder example: public/project1 public/project1/subdir1 public/project1/subdir2 public/project1/subdir2/subsubdir3 Setting acl on the given mailbox works for all of them. But how can I set for "public/project1" and all its subfolders in one command? Even "doveadm mailbox list" gives the error above when using wildcard. (I also tried all combinations of quotes). Armin

1 0

dovecot 2 samba ad-dc
by phil 28 Feb '20

28 Feb '20

Helo you, I try to build a mail server based on Centos 7, postfix and dovecot 2. My backend is a Samba4 ad-dc. I tried a lot and I don't know what else I could try.I'm new to this mailing list so please forgive me if I don't give right information or anything Samba4 ad-dc is up incl. dns. Win10 Client joined domain and authentication works. Postfix is up and checks against ldap whether recipient address exists. It takes mail via telnet and queues them. But can't give it to dovecot. my master.cf locks like that: [root@mail1t postfix]# cat master.cf smtp inet n - - - - smtpd submission inet n - - - - smtpd -o smtpd_enforce_tls=yes -o smtpd_tls_security_level=encrypt -o tls_preempt_cipherlist=yes pickup fifo n - - 60 1 pickup cleanup unix n - - - 0 cleanup qmgr fifo n - n 300 1 qmgr tlsmgr unix - - - 1000? 1 tlsmgr rewrite unix - - - - - trivial-rewrite bounce unix - - - - 0 bounce defer unix - - - - 0 bounce trace unix - - - - 0 bounce verify unix - - - - 1 verify flush unix n - - 1000? 0 flush proxymap unix - - n - - proxymap proxywrite unix - - n - 1 proxymap smtp unix - - - - - smtp relay unix - - - - - smtp showq unix n - - - - showq error unix - - - - - error retry unix - - - - - error discard unix - - - - - discard local unix - n n - - local virtual unix - n n - - virtual lmtp unix - - - - - lmtp anvil unix - - - - 1 anvil scache unix - - - - 1 scache maildrop unix - n n - - pipe flags=DRhu user=vmail argv=/usr/bin/maildrop -d ${recipient} uucp unix - n n - - pipe flags=Fqhu user=uucp argv=uux -r -n -z -a$sender - $nexthop!rmail ($recipient) ifmail unix - n n - - pipe flags=F user=ftn argv=/usr/lib/ifmail/ifmail -r $nexthop ($recipient) bsmtp unix - n n - - pipe flags=Fq. user=bsmtp argv=/usr/lib/bsmtp/bsmtp -t$nexthop -f$sender $recipient scalemail-backend unix - n n - 2 pipe flags=R user=scalemail argv=/usr/lib/scalemail/bin/scalemail-store ${nexthop} ${user} ${extension} mailman unix - n n - - pipe flags=FR user=list argv=/usr/lib/mailman/bin/postfix-to-mailman.py ${nexthop} ${user} dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} #smtp inet n - n - 1 postscreen #smtpd pass - - n - - smtpd #dnsblog unix - - n - 0 dnsblog #tlsproxy unix - - n - 0 tlsproxy postlog unix-dgram n - n - 1 postlogd my ldap.conf on mailserver: [root@mail1t openldap]# cat ldap.conf # # LDAP Defaults # # See ldap.conf(5) for details # This file should be world readable but not world writable. #BASE dc=example,dc=com #URI ldap://ldap.example.com ldap://ldap-master.example.com:666 URI ldaps://ldap1t.test.loc:636 #SIZELIMIT 12 #TIMELIMIT 15 #DEREF never #TLS_CACERTDIR /etc/openldap/certs TLS_CACERTDIR /etc/pki/tls/certs/ka # Turning this off breaks GSSAPI used with krb5 when rdns = false SASL_NOCANON on TLS_REQCERT never dovecot.conf: [root@mail1t dovecot]# cat dovecot.conf auth_mechanisms = plain login mail_uid = vmail mail_gid = vmail ssl_cert = </etc/ssl/mail.pem ssl_key = </etc/ssl/key.pem login_log_format_elements = "user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k" #mail_plugins = quota ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA log_timestamp = "%Y-%m-%d %H:%M:%S " log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot-info.log debug_log_path = /var/log/dovecot-debug.log #auth_verbose=yes auth_debug=yes auth_debug_passwords=yes mail_debug=yes verbose_ssl=yes protocols = imap listen = * auth_cache_size = 50000 # ~ 200 Benutzer mit Passwort auth_cache_ttl = 300s # in Sekunden, 5 Minute auth_cache_negative_ttl = 30s # wenn Benutzer nicht existierte bei letztem Check passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } service auth { unix_listener /var/spool/postfix/private/auth_dovecot { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = root } user = root } service dict { unix_listener dict { mode = 0660 user = vmail group = vmail } } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } protocol imap { mail_plugins = quota imap_quota } plugin { quota = maildir:User quota } dovecot-ldap.conf.ext: root@mail1t dovecot]# cat dovecot-ldap.conf.ext #hosts = 192.168.122.30:636 # Windows Active Directory uris = ldaps://192.168.122.30:636 #dn = CN=DovecotAdministrator,OU=ServiceAccounts,OU=Identitiy,DC=test,DC=loc dn = CN=Administrator,CN=Users,DC=test,DC=loc dnpass = Test123! tls = no # Benötige ich (!) nicht auth_bind = yes # Für die Dauer der Authentifizierung bindet sich Dovecot als einloggender Mailuser auth_bind_dn = %u ldap_version = 3 base = OU=Identitiy,DC=domain,DC=local # Meine OU mit Benutzern scope = subtree # Oder "base", falls nicht rekursiv in der OU gesucht werden soll pass_attrs = \ =user=%{ldap:mail}, \ =passwerd=%{ladp:user}, \ user_attrs = \ =user=%{ldap:mail}, \ user_filter = (mailRoutingAddress=%u) pass_filter = (mail=%u) iterate_attrs = mail #mail=user # Wird vor allem von "doveadm" benötigt, um Benutzer zu finden iterate_filter = (objectClass=smiMessageRecipient #(objectClass=person) maillog gives me: Feb 20 08:34:56 mail1t postfix/smtpd[1794]: 04229120B0D: client=unknown[192.168.122.30] Feb 20 08:35:01 mail1t postfix/cleanup[1798]: 04229120B0D: message-id=<> Feb 20 08:35:01 mail1t postfix/qmgr[1268]: 04229120B0D: from=<test(a)test.loc>, size=176, nrcpt=1 (queue active) Feb 20 08:35:01 mail1t postfix/pipe[1799]: 04229120B0D: to=<test(a)test.loc>, relay=dovecot, delay=12, delays=12/0.01/0/0.07, dsn=4.3.0, status=deferred (temporary failure) Feb 20 08:35:03 mail1t postfix/smtpd[1794]: disconnect from unknown[192.168.122.30] helo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 dovecot debug log: 2020-02-20 08:31:18 auth: Debug: Loading modules from directory: /usr/lib/dovecot/auth 2020-02-20 08:31:18 auth: Debug: Module loaded: /usr/lib/dovecot/auth/lib20_auth_var_expand_crypt.so 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: userdb lookup(test(a)test.loc): Started userdb lookup 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=13) 2020-02-20 08:35:01 auth: Debug: Loading modules from directory: /usr/lib/dovecot/auth 2020-02-20 08:35:01 auth: Debug: Module loaded: /usr/lib/dovecot/auth/lib20_auth_var_expand_crypt.so 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Disconnected: Connection closed: read(size=8192) failed: Connection reset by peer (fd=13) 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: userdb lookup(test(a)test.loc): Userdb lookup failed a ldap search gives me: [root@mail1t dovecot]# ldapsearch -D "cn=administrator,cn=Users,dc=test,dc=loc" -W -H ldaps://ldap1t.test.loc:636 -b "ou=Identitiy,dc=test,dc=loc" -s sub -x "(objectclass=person)" Enter LDAP Password: # extended LDIF # # LDAPv3 # base <ou=Identitiy,dc=test,dc=loc> with scope subtree # filter: (objectclass=person) # requesting: ALL # # testuser2, Identitiy, test.loc dn: CN=testuser2,OU=Identitiy,DC=test,DC=loc objectClass: top objectClass: person objectClass: organizationalPerson objectClass: user cn: testuser2 instanceType: 4 whenCreated: 20191029150406.0Z uSNCreated: 4540 name: testuser2 objectGUID:: zfJ3SmPoLkO8wrVKP0Mc6g== badPwdCount: 0 codePage: 0 countryCode: 0 badPasswordTime: 0 lastLogoff: 0 primaryGroupID: 513 objectSid:: AQUAAAAAAAUVAAAAGQ/+ZjR2CNb9IiNGUQQAAA== accountExpires: 9223372036854775807 sAMAccountName: testuser2 sAMAccountType: 805306368 userPrincipalName: testuser2(a)test.loc objectCategory: CN=Person,CN=Schema,CN=Configuration,DC=test,DC=loc mail: test(a)test.loc userAccountControl: 512 lockoutTime: 0 pwdLastSet: 132257935214848870 lastLogon: 132258326087696220 logonCount: 9 lastLogonTimestamp: 132258326087696220 whenChanged: 20200210182328.0Z uSNChanged: 7912 distinguishedName: CN=testuser2,OU=Identitiy,DC=test,DC=loc # DovecotAdministrator, ServiceAccounts, Identitiy, test.loc dn: CN=DovecotAdministrator,OU=ServiceAccounts,OU=Identitiy,DC=test,DC=loc objectClass: top objectClass: person objectClass: organizationalPerson objectClass: user cn: DovecotAdministrator instanceType: 4 whenCreated: 20191029155812.0Z displayName: DovecotAdministrator uSNCreated: 4735 name: DovecotAdministrator objectGUID:: 6LODLEOIQ0iVbSDrOftLgg== badPwdCount: 0 codePage: 0 countryCode: 0 badPasswordTime: 0 lastLogoff: 0 lastLogon: 0 primaryGroupID: 513 objectSid:: AQUAAAAAAAUVAAAAGQ/+ZjR2CNb9IiNGUwQAAA== accountExpires: 9223372036854775807 logonCount: 0 sAMAccountName: DovecotAdministrator sAMAccountType: 805306368 userPrincipalName: DovecotAdministrator(a)test.loc objectCategory: CN=Person,CN=Schema,CN=Configuration,DC=test,DC=loc userAccountControl: 66048 pwdLastSet: 132240938772523690 lastLogonTimestamp: 132263319652676310 whenChanged: 20200216130605.0Z uSNChanged: 7935 distinguishedName: CN=DovecotAdministrator,OU=ServiceAccounts,OU=Identitiy,DC= test,DC=loc # search result search: 2 result: 0 Success # numResponses: 3 # numEntries: 2 Can someone give me a hint? Best Phil

3 2

dovecot-uidlist....
by Chi Min Wang 27 Feb '20

27 Feb '20

Hello Everyone: Is it possible to direct dovecot to modify dovecot-uidlist automatically?? I have some user who use ancient MUA(i.e. Openwebmail) and IMAP/POP3. Since Openwebmail will insert "Status: R" in the eml file,the size of the eml file will increase by 10 bytes. If the user use Openwebmail first,then the size record(S=xxxx) in dovecot-uidlist will be fine. But if he use POP3/IMAP(dovecot) first then use Openwebmail,the size record in dovecot-uidlist will not match the actual size modified by Openwebmail. This will cause dovecot killed by core dump. I'm wondering if there are any method to avoid this situation,Thanks!! *********************************************** CONFIDENTIALITY NOTICE:This e-mail and any attachments are confidential and may be legally privileged. If you are not the intended recipient, (i) please do not read or disclose to others, and (ii) please notify immediately the sender by reply mail, and (iii) please delete all copies of the email from your system. Failure to follow this process may be unlawful. We greatly appreciate your cooperation.

2 1

Matching regexps
by Adam Shostack 26 Feb '20

26 Feb '20

Hi, I'm having some trouble with matching. The regexp in my dovecot.sieve file should match on email addresses, but does not. # The code: if header :matches "From" "<[a-z0-9-]*(a)[a-z0-9-.]*>" { set "sender" "${1}"; } if not execute "grepfrom" ["${sender}"] { if envelope :matches "from" "*" { set "sender" "${1}"; } This failes to match Tamara Denning <tdenning(a)cs.utah.edu> when I check that regexp against that string at regex101.com, it shows a match, but the log (from sieve-test) shows: 348: header test 348: starting `:matches' match with `i;ascii-casemap' comparator: 348: extracting `From' headers from message 348: matching value `Tamara Denning <tdenning(a)cs.utah.edu>' 348: with key `.*<[a-z0-9-]*(a)[a-z0-9-.]*>' => 0 348: finishing match with result: not matched I would appreciate advice on why the match is failing, or what I can change to make it match. Thank you! Adam

2 1

Auto Subscribe not working for LDA/Sieve created Mailbox?
by Larry Rosenman 25 Feb '20

25 Feb '20

I have auto-subscribe turned on, but I had to doveadm mailbox subscribe to a LDA/Sieve created mailbox today. Did something break? doveconf -n attached. FreeBSD dovecot-2.3.9.3 Secure, fast and powerful IMAP and POP3 server dovecot-pigeonhole-0.5.9_1 Sieve plugin for the Dovecot 'deliver' LDA and LMTP -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

2 4

doveadm(nfsnobody) Error
by 横山航平 23 Feb '20

23 Feb '20

Please tell me about maillog Error. I get the following error in maillog：－－－ dovecot: doveadm(nfsnobody): Error: sync: User init failed dovecot: doveadm(nfsnobody): Error: User initialization failed: Namespace '': mkdir(/var/lib/nfs/Maildir) failed: Permission denied (euid=65534(nfsnobody) egid=65534(nfsnobody) missing +w perm: /var/lib/nfs, dir owned by 0:0 mode=0755) －－－ I am using Dsync and the configuration is below：－－－ service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u plugin { mail_replica = remote:root@XXX } service aggregator { fifo_listener replication-notify-fifo { mode = 0777 } unix_listener replication-notify { mode = 0777 } } service replicator { unix_listener replicator-doveadm { mode = 0600 } } replication_max_conns = 10 plugin { # When saving a new mail via IMAP or delivering a mail via LDA/LMTP, # wait for the mail to be synced to the remote site. If it doesn't finish # in 2 seconds, return success anyway. # replication_sync_timeout = 2s } －－－ Is the Dsync setting bad? please tell me.

2 1

Help needed with managesieve
by Laura Smith 22 Feb '20

22 Feb '20

Hi, I'm really struggling with the following inbound filtering: Let's say:• My email address is "my.email(a)example.com" • I've setup a filtered address "filtered.email(a)example.com" • I've setup a sending/reply address "send.email(a)example.com" I am sending a message to a small group of people where detailed tracking is required (yes, I know there are better automated ways outside of Dovecot to do this... but let's leave that topic for another day shall we !) My desired action is as follows : • Message "From" shows "send.email(a)example.com" • Message "To" is set as "filtered.email(a)example.com" • General recipients in Bcc When I send a test to an *external* address, it works as expected, i.e. : • External address receives mail in its inbox • Copy of mail gets put in relevant IMAP folder for "filtered.email(a)example.com" When I send a test to my own address, it does not work, the following happens instead: • Copy of mail gets put in relevant IMAP folder for "filtered.email(a)example.com" (this is good and as expected) • The BCC "my.email(a)example.com" never gets deposited in my inbox (this is not good) My dovecot sieve (as applied to "my.email(a)example.com") is as follows (I have tried both with and without the "stop" as you can see from the comment: anyof (address :is :all "to" ["send.email(a)example.com"], header :contains ["Cc", "Delivered-To"] ["send.email(a)example.com"]) { fileinto :create "XYZmail-replies"; # Ignore stop for this rule only # stop; } elsif anyof (address :is :all "to" ["filtered.email(a)example.com"], header :contains ["Cc", "Delivered-To"] ["filtered.email(a)example.com"]) { fileinto :create "XYZmail-sent"; # Ignore stop for this rule only # stop; }

2 1

Strategy for fts and Replication
by Francis Augusto Medeiros-Logeay 22 Feb '20

22 Feb '20

Hi there, I got successfully to replicate my mail server to another dovecot install using dsync, mainly for redundancy, and it works great. I want to try to install fts, as some of the mailboxes have tens of thousands of messages, and it takes minutes to get some results when searching via IMAP on a Roundcube interface. I want to experiment with fts-solr first, and firstly on my redundant server, ie., not on my main dovecot install. Is it ok to do this? I ask because I am afraid of how this whole reindexing on the redundant install will affect the production server. Also, any tips on something else than fts-solr? I tried it once, but it was so hard to get it right, so many configurations, java, etc., that I'd rather try something else. I also could try fts-elastic or something like that, but, again, having to maintain an elasticsearch install might use more resources than I think is worth. Any thoughts on that? Best, -- Francis

6 10

My sieve is failing
by ＠lbutlr 21 Feb '20

21 Feb '20

I have an active sieve file for my list account that alters the headers for this list (sets the reply-to address to the list instead of the poster) which is suddenly failing. require [ "regex", "variables", "fileinto", "envelope", "mailbox", "imap4flags", "editheader" ]; /* other stuff */ elsif header :contains "List-id" "dovecot.dovecot.org" { if header :matches "Reply-to" "*" { deleteheader "From"; addheader "From" "${1}"; deleteheader "Reply-To"; addheader "Reply-To" "dovecot(a)dovecot.org"; addheader "X-Covisp-Reply-To" "True"; } fileinto :create "dovecot"; stop;} And the trace file: 55: header test 55: starting `:contains' match with `i;ascii-casemap' comparator: 55: extracting `List-id' headers from message 55: matching value `Dovecot Mailing List <dovecot.dovecot.org>' 55: with key `dovecot.dovecot.org' => 1 55: finishing match with result: matched 55: jump if result is false 55: not jumping 56: header test 56: starting `:matches' match with `i;ascii-casemap' comparator: 56: extracting `Reply-to' headers from message 56: finishing match with result: not matched 56: jump if result is false 56: jumping to line 63 63: fileinto action 63: store message in mailbox `dovecot' 64: stop command; end all script execution ## Finished executing script '.active_sieve’ Neither the reply-to header nor the x- header are actually getting added, but the block is getting executed and the mail is filed in the right folder. In dovecot.conf I (still) have: managesieve_sieve_capability = editheader fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave

1 1

Test failure on ARM: backtrace_append
by Julien Lepiller 21 Feb '20

21 Feb '20

Hi, I am a packager in Guix and user of dovecot on an ARM server (armhf). The Guix package fails to build because of a test error (see the last lines of the full build log: https://ci.guix.gnu.org/log/f5if2qb5rsqag3a6jy5vga1l9hm9pkj0-dovecot-2.3.9.3) As the name suggests, this is dovecot 2.3.9.3, the latest version. Previous versions built fine, as well as the same version on x86 and x86_64. Note that the build on guix's build farm was done in a qemu vm, but I got the same test failure on real hardware. I'm not sure what the best course of action is. Did I find a legitimate bug, or should I simply ignore that test for that architecture? Dovecot itself seems to be running fine when I ignore the tests. Thanks for any guidance you could provide!

2 8

How does dovecot determine users from /etc/passwd?
by Philip Colmer 20 Feb '20

20 Feb '20

We're using dovecot on a help desk ticketing system. The system doesn't perform any cleanup of IMAP mailboxes so we have a regular cronjob doing this: /usr/bin/doveadm flags add -A '\Deleted' SEEN SENTBEFORE 12w && /usr/bin/doveadm expunge -A DELETED MAILBOX '*' Recently, doveadm has been reporting this: doveadm(nobody): Error: User initialization failed: Namespace '': mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) egid=65534(nogroup)) doveadm(nobody): Error: User init failed doveadm(DEFAULT-CW-USER): Info: User no longer exists, skipping Indeed, using doveadm user "*" does include "nobody" in the list but I can't understand why. The mail group in /etc/group does not include "nobody" and there are users in /etc/passwd with similar attributes to "nobody" that do not appear in the list of users from doveadm. What can I do to tell doveadm to forget about "nobody"? Thanks. Philip

4 4

BUG: dsync and folder names with "@"
by spamvoll＠googlemail.com 20 Feb '20

20 Feb '20

Hello, dovecot version: 2.3.9.2 When I use dsync: /usr/bin/dsync -v -D -o plugin/quota= -f -u my(a)email.dom backup maildir:/tmp/mailbackup/Maildir it always stops when it comes to a folder with an "@" in its name. Error Message: Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID (maybe it was just deleted?) I dont know if it makes a difference, but my dovecot uses mdbox and the backup export is maildir. Hans

2 2

RE: Unknown setting error with dovecot-sql.conf.ext
by Andy Woolley 20 Feb '20

20 Feb '20

OMG, that was it, so sorry to have wasted your time. The text editor I am using (Ultraedit) is adding a BOM (Byte Order Marker) to the beginning of the file. I have disabled this in settings but it keeps doing it. Thank you so much for pointing me in the right direction. After removing the 3 invisible characters from the dovecot-sql.conf.ext file it magically worked. Andy -----Original Message----- From: Aki Tuomi [mailto:aki.tuomi@open-xchange.com] Sent: 20 February 2020 11:26 To: Andy Woolley <andy(a)milonic.com> Subject: Re: Unknown setting error with dovecot-sql.conf.ext I am unable to reproduce the issue here, can you send me the file itself? Maybe it has some strange thing in it? On 20.2.2020 12.23, Andy Woolley wrote: > > doveconf -n > > # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf > > # OS: Linux 5.4.19-200.fc31.x86_64 x86_64 Fedora release 31 (Thirty > One) > > # Hostname: data.tia3.com > > auth_mechanisms = plain login > > mail_location = /home/vmail/%d/%n > > mail_privileged_group = mail > > mbox_write_locks = fcntl > > namespace inbox { > > inbox = yes > > location = > > mailbox Drafts { > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > special_use = \Sent > > } > > mailbox Trash { > > special_use = \Trash > > } > > prefix = > > } > > passdb { > > driver = pam > > } > > passdb { > > args = /etc/dovecot/dovecot-sql.conf.ext > > driver = sql > > } > > service auth-worker { > > user = vmail > > } > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0660 > > user = postfix > > } > > unix_listener auth-userdb { > > mode = 0600 > > user = vmail > > } > > user = dovecot > > } > > service imap-login { > > inet_listener imap { > > port = 143 > > } > > inet_listener imaps { > > port = 993 > > ssl = yes > > } > > } > > service lmtp { > > unix_listener lmtp { > > group = postfix > > mode = 0600 > > user = postfix > > } > > } > > service pop3-login { > > inet_listener pop3 { > > port = 110 > > } > > inet_listener pop3s { > > port = 995 > > ssl = yes > > } > > } > > ssl = required > > ssl_cert = </etc/letsencrypt/live/intelliset.co.uk/fullchain.pem > > ssl_cipher_list = PROFILE=SYSTEM > > ssl_key = # hidden, use -P to show it > > userdb { > > driver = passwd > > } > > userdb { > > args = /etc/dovecot/dovecot-sql.conf.ext > > driver = sql > > } > > > > > > > > > > dovecot-sql.conf.ext: > > driver = mysql > > connect = host=127.0.0.1 dbname=mail user=foo password=bar > > default_pass_scheme = SHA512-CRYPT > > password_query = SELECT email as user, password FROM users WHERE > email='%u'; > > > > > > > > > > Many thanks, > > Andy > > > > > > *From:*dovecot [mailto:dovecot-bounces@dovecot.org] *On Behalf Of *Aki > Tuomi > *Sent:* 20 February 2020 10:11 > *To:* Andy Woolley <andy(a)milonic.com <mailto:andy@milonic.com>>; > dovecot(a)dovecot.org <mailto:dovecot@dovecot.org> > *Subject:* Re: Unknown setting error with dovecot-sql.conf.ext > > > > > > On 20.2.2020 12.06, Andy Woolley wrote: > > Hi All, > > > > I am trying to install Dovecot connecting to MySQL and all seems to be > working until I try to send/receive. > > > > Im getting a Unknown setting error for anything that is inside > dovecot-sql.conf.ext > > > > dovecot-sql.conf.ext is inside /etc/dovecot and is referenced from > /etc/dovecot/conf.d/auth-sql.conf.ext > > > > The error I get is: > > > > auth: Fatal: sql /etc/dovecot/dovecot-sql.conf.ext: Error in > configuration file /etc/dovecot/dovecot-sql.conf.ext line 1: Unknown > setting: driver > > > > Can anybody help me? > > > > Andy > > > > Post 'doveconf -n' please and the contents of the sql.conf.ext file. > Mind passwords. > > Aki > > > > *From:*dovecot [mailto:dovecot-bounces@dovecot.org] *On Behalf Of *Aki > Tuomi > *Sent:* 20 February 2020 10:11 > *To:* Andy Woolley <andy(a)milonic.com>; dovecot(a)dovecot.org > *Subject:* Re: Unknown setting error with dovecot-sql.conf.ext > > > > > > On 20.2.2020 12.06, Andy Woolley wrote: > > Hi All, > > > > I am trying to install Dovecot connecting to MySQL and all seems > to be working until I try to send/receive. > > > > Im getting a Unknown setting error for anything that is inside > dovecot-sql.conf.ext > > > > dovecot-sql.conf.ext is inside /etc/dovecot and is referenced from > /etc/dovecot/conf.d/auth-sql.conf.ext > > > > The error I get is: > > > > auth: Fatal: sql /etc/dovecot/dovecot-sql.conf.ext: Error in > configuration file /etc/dovecot/dovecot-sql.conf.ext line 1: > Unknown setting: driver > > > > Can anybody help me? > > > > Andy > > > > Post 'doveconf -n' please and the contents of the sql.conf.ext file. > Mind passwords. > > Aki >

1 0

Unknown setting error with dovecot-sql.conf.ext
by Andy Woolley 20 Feb '20

20 Feb '20

Hi All, I am trying to install Dovecot connecting to MySQL and all seems to be working until I try to send/receive. I'm getting a "Unknown setting" error for anything that is inside dovecot-sql.conf.ext dovecot-sql.conf.ext is inside /etc/dovecot and is referenced from /etc/dovecot/conf.d/auth-sql.conf.ext The error I get is: auth: Fatal: sql /etc/dovecot/dovecot-sql.conf.ext: Error in configuration file /etc/dovecot/dovecot-sql.conf.ext line 1: Unknown setting: driver Can anybody help me? Andy

2 2

Flush userdb cache entry
by Tom Sommer 19 Feb '20

19 Feb '20

Hi all I have a problem when users change quota in SQL, the change is not reflected in Dovecot immediately so quota_warning is still triggered on some occasions. I think it's because the quota is stored in userdb, and there is no way to flush userdb cache? Is there a way to flush userdb entries? What controls userdb cache TTL/size? auth_cache entries? I can't seem to find any documentation on this, sadly :( Thanks -- Tom

1 1

Message-id parsing by sieve
by Russell King 19 Feb '20

19 Feb '20

Hi, I'm using Dovecot for my mail with pigeonhole's sieve extension, from debian stable (2.3.4.1 (f79e8e7e4)). One of the sieve stanzas that I use is for duplicate elimination: if duplicate { discard; stop; } This mostly works fine, but I seem to have trouble with some messages that come from certain domains where duplicates are not eliminated. >From /var/log/mail.log, I see: Feb 18 12:48:50 mail dovecot: lmtp(24320:linux@xxx.armlinux.org.uk): sieve: msgid=? <VI1PR04MB513558BF77192255CBE12102B0110(a)VI1PR04MB5135.eurprd04.prod.outlook.com>: stored mail into mailbox 'INBOX' Feb 18 12:49:42 mail dovecot: lmtp(24320:linux@xxx.armlinux.org.uk): sieve: msgid=<VI1PR04MB513558BF77192255CBE12102B0110(a)VI1PR04MB5135.eurprd04.prod.outlook.com>: stored mail into mailbox 'INBOX' The first was received direct from the recipient with a message-id line formatted thusly: Message-ID: <VI1PR04MB513558BF77192255CBE12102B0110(a)VI1PR04MB5135.eurprd04.prod.outlook.com> The second was received from the mailing list with a message-id line formatted thusly: Message-ID: <VI1PR04MB513558BF77192255CBE12102B0110(a)VI1PR04MB5135.eurprd04.prod.outlook.com> It would appear that the parsed message-id value that dovecot uses includes white-space (including newline characters). RFC5322 gives the message-id header format as: message-id = "Message-ID:" msg-id CRLF msg-id = [CFWS] "<" id-left "@" id-right ">" [CFWS] It goes on to say: The message identifier (msg-id) itself MUST be a globally unique identifier for a message. and: Semantically, the angle bracket characters are not part of the msg-id; the msg-id is what is contained between the two angle bracket characters. However, it seems dovecot sieve is using the entire content of the msg-id, including CFWS, as the message id used for detecting duplicate messages. This seems wrong, and appears to lead to duplicates not being detected, and thus seems like a bug. Is there a workaround for this, and/or can it be changed? -- Russell King

2 1

Sieve junks mail script creating links
by ＠lbutlr 19 Feb '20

19 Feb '20

My Junk mailbox is still filling up with hard linked emails. There are some junk mails with over 3000 hard linked files and over half a million files in the .Junk/cur folder. I had a handy script to remove them all by doing a find for inodes and sorting the list by age and keeping the olds hard link and removing all the others, but I now can’t find it :/ so I have just taken to periodically nuking the entire folder, but I’d like to fix this. *everything is current on FreeBSD 12.1-RELEASE => dovecot.conf imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve => /usr/lib/dovecot/sieve/report-spam.sieve: require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables"]; if environment :matches "imap.user" "*" { set "username" "${1}"; } pipe :copy "sa-learn-spam.sh" [ "${username}" ]; => /usr/lib/dovecot/sieve/sa-learn-spam.sh: #!/bin/sh exec /usr/local/bin/sa-learn -u ${1} —spam -- When the stars threw down their spears And watered heaven with their tears, Did He smile his work to see? Did He who made the Lamb make thee?

2 1

managesieve / sieve - append dot prefix on moving mails into folder
by Andre Hoepner - i.based: Systemhaus GmbH + Co. KG 18 Feb '20

18 Feb '20

Hello mailinglist-subscribers, i have an issue with the managesieve / sieve plugin in dovecot. We use roundcube as webmailer and if i define a new filter to move incoming mails directly into a subfolder i get the following sieve-code: require ["fileinto","imap4flags"]; # rule:[mail into folder] if allof (header :contains "from" "sender(a)domain.org") { fileinto "Foldername"; setflag "\\Seen"; } So anything seems to be right and there are no errors on creating the correct syntax. But if a mail comes from the named sender, sieve does not put the email in the folder "Foldername" but ".Foldername". It appends a dot (.) in front of the name and i have no idea, why this happens. There are no errors in logfile and all mails go into the .Folder. Maybe it is wrong separator for mailbox, at the moment there is no separator defined in "10-mail.conf" and we use "Maildir" as mail_location. I have also tried to change the target folder in sieve script an named him "INBOX/Monitoring" - as subfolder of INBOX but than i get an error in .dovecot.sieve.log with message: Invalid mailbox name: Name must not have '/' characters. I edited the new rule with roundcube / managesieve-plugin and maybe this needs separate configuration because of separator in foldernames? Please let me know if i should provide any extra information or dovecot configuration etc. best regards Andre Hoepner

3 3

Re: Shared Mailboxes with Multiple Domains
by Daniel Miller 18 Feb '20

18 Feb '20

Any thoughts on this? --- Daniel ------ Original Message ------ From: "Daniel Miller" <dmiller(a)amfes.com> To: "Dovecot Mailing List" <dovecot(a)dovecot.org> Sent: 2/12/2020 6:16:05 PM Subject: Shared Mailboxes with Multiple Domains >Trying to track down a problem I've been dealing with for a while. Everything else works fine - the problem is with shared mailboxes. > >My present, and desired, prefix for the shared namespace is: > prefix = INBOX/shared/%%d/%%n/ > >Some mail clients, particularly Thunderbird and Android's AquaMail, have no problem with this. But other (presumably broken) clients don't show the shared mailboxes. This includes EM Client and Webmail Lite. Actually, Webmail Lite lists the mailboxes in the subscription window, but then the "live"folder list shows "shared" and "shared/domain" but none of the shared mailboxes below the domain. > >Changing to: > prefix = INBOX/shared/%%u/ > >Works across all clients - but I'd rather have the domain separation. Testing with telnet ". LIST '' '*'" yields the full list with either config. > >The files /var/mail/%d/shared-mailboxes contain entries like: >shared/shared-boxes/group/allshared/user(a)domain.com > 1 > > >Below is "doveconf -n" output. > ># 2.3.9.3 (9f41b88fa): /usr/local/etc/dovecot/dovecot.conf ># Pigeonhole version 0.5.9 (db4e9a2f) ># OS: Linux 5.3.0-28-generic x86_64 Ubuntu 18.04.4 LTS ># Hostname: bubba.amfes.lan >auth_cache_size = 4 k >auth_master_user_separator = * >auth_mechanisms = plain login >auth_policy_hash_nonce = # hidden, use -P to show it >auth_policy_hash_truncate = 8 >auth_policy_server_api_header = Authorization: Basic d2ZvcmNlOnVsdHJhLXNlY3JldC1zZWN1cmUtc2FmZQ >default_login_user = nobody >default_vsz_limit = 2 G >disable_plaintext_auth = no >imap_client_workarounds = tb-extra-mailbox-sep >imap_idle_notify_interval = 29 mins >listen = * >login_trusted_networks = 192.168.0.0/24 >mail_attachment_hash = %{sha512} >mail_plugins = fts fts_solr acl zlib virtual >mail_prefetch_count = 10 >mail_shared_explicit_inbox = yes >managesieve_notify_capability = mailto >managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihaveduplicate mime foreverypart extracttext >mdbox_rotate_size = 20 M >namespace archives { > list = children > location = mdbox:/var/mail/%d/%n/Archives/mdbox > mailbox Unsorted { > auto = no > special_use = \Archive > } > prefix = INBOX/Archives/ > separator = / > subscriptions = no > type = private >} >namespace inbox { > hidden = no > inbox = yes > list = yes > location = > mailbox "Deleted Messages" { > auto = no > autoexpunge = 30 days > special_use = \Trash > } > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Items" { > auto = no > special_use = \Sent > } > mailbox "Sent Messages" { > auto = no > special_use = \Sent > } > mailbox Trash { > auto = subscribe > autoexpunge = 30 days > special_use = \Trash > } > prefix = INBOX/ > separator = / > subscriptions = no > type = private >} >namespace lists { > list = children > location = mdbox:/var/mail/%d/%n/Lists/mdbox > prefix = INBOX/Lists/ > separator = / > subscriptions = no > type = private >} >namespace subscriptions { > hidden = yes > list = no > location = > prefix = > subscriptions = yes >} >namespace usershares { > list = children > location = sdbox:/var/mail/%%d/%%n/sdbox:NO-NOSELECT > prefix = INBOX/shared/%%d/%%n/ > separator = / > subscriptions = no > type = shared >} >namespace virtual { > list = children > location = virtual:/var/mail/%d/%n/virtual > mailbox Flagged { > comment = All my flagged messages > special_use = \Flagged > } > prefix = INBOX/virtual/ > separator = / > subscriptions = no >} >passdb { > args = /usr/local/etc/dovecot/dovecot-sql.conf.ext > driver = sql >} >plugin { > acl = vfile > acl_shared_dict = file:/var/mail/%d/shared-mailboxes > fts = solr > fts_autoindex = yes > fts_autoindex_exclude = \Trash > fts_autoindex_exclude2 = \Junk > fts_autoindex_exclude3 = \Spam > fts_enforced = no > fts_index_timeout = 20s > fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ > mailbox_alias_new = Sent Messages > mailbox_alias_new2 = Sent Items > mailbox_alias_new3 = Deleted Messages > mailbox_alias_old = Sent > mailbox_alias_old2 = Sent > mailbox_alias_old3 = Trash > sieve = file:~/sieve;active=~/.dovecot.sieve >} >protocols = imap lmtp sieve >service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0600 > user = vmail > } >} >service dict { > unix_listener dict { > group = mail > mode = 0660 > user = vmail > } >} >service imap-login { > process_min_avail = 10 > service_count = 1 >} >service imap-postlogin { > executable = script-login /usr/local/etc/dovecot/post-login.sh > user = $default_internal_user >} >service imap { > executable = imap imap-postlogin > vsz_limit = 4 G >} >service indexer-worker { > process_limit = 3 >} >service lmtp { > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = mail > mode = 0666 > user = vmail > } >} >service managesieve-login { > inet_listener sieve { > port = 4190 > } > inet_listener sieve_deprecated { > port = 2000 > } > process_min_avail = 0 > service_count = 1 >} >ssl_cert = </etc/ssl/letsencrypt/live/mail.amfes.com/fullchain.pem >ssl_dh = # hidden, use -P to show it >ssl_key = # hidden, use -P to show it >userdb { > driver = prefetch >} >userdb { > args = /usr/local/etc/dovecot/dovecot-sql.conf.ext > driver = sql >} >verbose_proctitle = yes >protocol lmtp { > mail_plugins = fts fts_solr acl zlib virtual sieve > postmaster_address = postmaster(a)amfes.com >} >protocol lda { > mail_plugins = fts fts_solr acl zlib virtual sieve >} >protocol imap { > mail_max_userip_connections = 50 > mail_plugins = fts fts_solr acl zlib virtual imap_acl imap_zlib mailbox_alias >} > > >-- Daniel > >

2 1

Postfix Dovecot Consultant Availability
by Asai 17 Feb '20

17 Feb '20

Greetings, We're in process of upgrading our Postfix / Dovecot installation, and would like to know if there are any qualified consultants out there that would be willing to work for us to help us verify and improve the deployment for our non-profit organization? This would be a fairly simple job of looking over configs and making recommendations, but may give way into more ongoing work. I know there are a lot of experts on this list that really know how Postfix and Dovecot work and we'd really appreciate some quality advice. I'm sending this request to both Postfix and Dovecot lists. Please email me directly with replies. -- Asai

1 0

Sieve setting a flag on the server (with sieve?)
by Marc Roos 17 Feb '20

17 Feb '20

I want to run a cron job for specific users. I thought the easiest would be a sieve plugin that sets some text in managesieve.sieve. And I just have my cron job check for this setting. This is the forward sieve: if false # true { redirect :copy "test(a)test.com"; } So maybe something like: if false # true { # cronjob1 } Or is there a better way of doing such a thing?

2 1

Question about noreplicate flag
by Bernardo Reino 17 Feb '20

17 Feb '20

Dear all, I've just setup replication between two servers. The e-mail accounts on both servers intersect but are not the same. In dovecot.conf (both are identical except one user /var/mail and the other uses /srv/vmail) I have: --<<-- userdb { driver = passwd-file args = username_format=%Lu /etc/dovecot/virtual_passwd default_fields = uid=vmail gid=vmail home=/var/mail/%d/%n } passdb { driver = passwd-file args = scheme=SHA512-CRYPT username_format=%Lu /etc/dovecot/virtual_passwd } -->>-- i.e. I use a passwd-like database. For the non-overlapping accounts in both servers I want to prevent replication, as it will otherwise fail with "Error: sync: Unknown user in remote". I have added "userdb_noreplicate" (also tried "userdb_noreplicate=y") for those users, but I still see the above error message in the logs. Like: reinob@bbmk.org:{SHA512-CRYPT}$6$e10...4c::::::userdb_noreplicate=y If I run "doveadm user -u reinob(a)bbmk.org" I get the following: userdb: reinob(a)bbmk.org user : reinob(a)bbmk.org uid : 5000 gid : 5000 home : /var/mail/bbmk.org/reinob noreplicate: y Note that I use "userdb_noreplicate" instead of "noreplicate" (which I also tried just in case), as from what I understood the "userdb_" prefix is required when adding the flag to the passwd file. As far as I can tell I'm doing everything right, but for some reason the replication is ignoring that flag. Thanks in advance for any help with this. (Let me know if you need to see the $(doveconf -n), but I believe the only relevant parts are the userdb and passdb.

2 6

Re: .IMAP
by Jos Chrispijn 16 Feb '20

16 Feb '20

On 15-2-20 11:55, Thomas Zajic wrote: > That's probably because the second part of Aki's advise hasn't been followed yet > ("... and ensure the mails are under there, ..."). You need to physically move all > mail related files and folders to the ~/mail subdir of each user. The "Deleted" > mailbox probably still shows up because your MUA has been configured to use a local > folder for it instead of an IMAP folder. Just to let you know that I also noticed that in a far past I created in the BSD root a symbolic link 'home -> usr/home'. That works for most programs, but obviously the use of this '/home' link in my old Dovecot config is not picked up by Dovecot as being redirected to '/usr/home'. ./joz

1 0

shared folder name or public folder with mail address
by Armin Schindler 16 Feb '20

16 Feb '20

Hello! we are about to move from cyrus to dovecot and have one open issue for that migration. With cyrus we have "shared/" folders with a name that is self defined like shared/project-xyz but the email address for direct delivery to that folder my be different (not project-xyz(a)domain.com) With dovecot we try to have it similar (at least how the user sees it in the client) like it is now. When configuring a namespace of type=shared, I see in the docs the the prefix can be configured with %%u , %%n or %%d. But is it possible to configure the name different to the email address? E.g. to hide the email address of that folder and show a nice name instead? I also thought about using public namespace instead. Does this make sense here? With public (maybe configured with prefix=shared/) folder I can set any name as subdir in prefix, right? So would this be more like what we have with cyrus shared folder? If so, how could these public folders have an email address for direct mail delivery into? Can something like a global sieve rule do that? Or can a public folder have an email address? Thanks in advance. Armin

4 13

doveadm backup -R -m -s not picking up a new message
by Daniel Shahaf 16 Feb '20

16 Feb '20

Good morning, I use «doveadm backup -R -m foo -s $state» to create a local mirror of an imapc remote folder. When I run that command, wait for it to finish, deliver a new message to the remote folder, and run that command again, the new message does not get downloaded from the remote. I'll attach the rawlog, doveconf, etc at the end. Allow me first to summarize what I've already checked: - I used «openssl s_client» to issue EXAMINE on the remote mailbox before and after delivering a mail to the remote mailbox, and HIGHESTMODSEQ does increase. - I looked at rawlog for both runs. doveadm issues a «STATUS foo (UIDNEXT UIDVALIDITY)» and receives a correct response (UIDNEXT in the second run is one larger than in the first run). - Other than that STATUS command, doveadm only issues LOGIN, LOGOUT, LIST, and LSUB commands. The remote server's responses do not report the new HIGHESTMODSEQ value for the folder. - The message does get mirrored locally when I run without the -s flag. I'm running dovecot 2.3.9.2 from FreeBSD ports. I've reviewed the FreeBSD port¹; it does have some patches, but none of them seem relevant to this issue. The remote server runs Cyrus. Debug output, etc follow: [[[ % doveconf -n # 2.3.9.2 (cf2918cac): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 12.1-RELEASE amd64 # Hostname: imapmirror.v.shahaf.local2 disable_plaintext_auth = no first_valid_uid = 1000 imapc_features = " rfc822.size fetch-headers modseq" imapc_host = imap.fastmail.com imapc_password = # hidden, use -P to show it imapc_port = 993 imapc_ssl = imaps imapc_user = ... last_valid_uid = 65500 mail_location = maildir:~/Maildir:UTF-8 mail_prefetch_count = 99 namespace { inbox = yes location = prefix = separator = / } passdb { driver = pam } protocols = imap lmtp service imap { drop_priv_before_exec = yes } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </usr/local/etc/dovecot/cert.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { auth_username_format = %n } ]]] [[[ # Baseline % rm -rf /home/fmsync/Maildir % rm -rf /home/fmsync/imapcdir % rm -rf /mnt/rawlog % mkdir /mnt/rawlog % mdmfs -s 1024m auto /mnt/rawlog # mount a tmpfs % chown fmsync /mnt/rawlog # doveadm -o mail_fsync=never backup -u fmsync -s "" -l 15 -R -m lists/zsh imapc:/home/fmsync/imapcdir | sponge state.out dsync(fmsync): Info: imapc(imap.fastmail.com:993): Connected to 66.111.4.135:993 (local 192.168.122.253:56226) # doveadm -o mail_fsync=never backup -u fmsync -s "$(cat state.out)" -l 15 -R -m lists/zsh imapc:/home/fmsync/imapcdir | sponge state.out dsync(fmsync): Info: imapc(imap.fastmail.com:993): Connected to 66.111.4.136:993 (local 192.168.122.253:39150) % openssl s_client -verify_return_error -connect imap.fastmail.com:imaps ⋮ b EXAMINE lists/zsh * 24117 EXISTS * 1 RECENT * FLAGS (\Answered \Flagged \Draft \Deleted \Seen $X-ME-Annot-2 $IsMailingList $IsNotification $HasAttachment $HasTD hasnoatt hasnotd hasatt $X-ME-Annot-1 Old $NotJunk $Junk $Forwarded) * OK [PERMANENTFLAGS ()] Ok * OK [UNSEEN 1759] Ok * OK [UIDVALIDITY 1529153257] Ok * OK [UIDNEXT 24289] Ok * OK [HIGHESTMODSEQ 4910711] Ok * OK [URLMECH INTERNAL] Ok * OK [ANNOTATIONS 65536] Ok b OK [READ-ONLY] Completed c CLOSE c OK Completed ]]] [[[ # In another terminal % swaks -t lists.zsh@… ⋮ <- 250 2.0.0 Ok: queued as 48CjYx6xvmzWp ⋮ ]]] [[[ # Back in s_client d EXAMINE lists/zsh * 24118 EXISTS * 2 RECENT * FLAGS (\Answered \Flagged \Draft \Deleted \Seen $X-ME-Annot-2 $IsMailingList $IsNotification $HasAttachment $HasTD hasnoatt hasnotd hasatt $X-ME-Annot-1 Old $NotJunk $Junk $Forwarded) * OK [PERMANENTFLAGS ()] Ok * OK [UNSEEN 1759] Ok * OK [UIDVALIDITY 1529153257] Ok * OK [UIDNEXT 24290] Ok * OK [HIGHESTMODSEQ 4910779] Ok * OK [URLMECH INTERNAL] Ok * OK [ANNOTATIONS 65536] Ok d OK [READ-ONLY] Completed e CLOSE e OK Completed ]]] [[[ # doveadm -o imapc_rawlog_dir=/mnt/rawlog -Dv backup -u fmsync -s "$(cat state.out)" -l 15 -R -m lists/zsh imapc:/home/fmsync/imapcdir | sponge state.out Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_init" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: Undefined symbol "fts_list_backend" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: Undefined symbol "mail_crypt_user_get_public_key" (this is usually intentional, so just ignore this message) doveadm(fmsync)<966><>: Debug: auth-master: userdb lookup(fmsync): Started userdb lookup doveadm(fmsync)<966><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting doveadm(fmsync)<966><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (uid=0): Client connected (fd=10) doveadm(fmsync)<966><>: Debug: auth-master: userdb lookup(fmsync): auth USER input: fmsync system_groups_user=fmsync uid=1002 gid=1002 home=/home/fmsync doveadm(fmsync)<966><>: Debug: auth-master: userdb lookup(fmsync): Finished userdb lookup (username=fmsync system_groups_user=fmsync uid=1002 gid=1002 home=/home/fmsync) doveadm(fmsync): Debug: Effective uid=1002, gid=1002, home=/home/fmsync doveadm(fmsync): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir:UTF-8 doveadm(fmsync): Debug: maildir++: root=/home/fmsync/Maildir, index=, indexpvt=, control=, inbox=/home/fmsync/Maildir, alt= doveadm(fmsync): Debug: brain M: Imported mailbox states: doveadm(fmsync): Debug: brain M: Mailbox $guid1 state: uidvalidity=1529153257 uid=24288 modseq=4910711 pvt_modseq=0 messages=24117 changes_during_sync=0 doveadm(fmsync): Debug: brain M: Namespace has location maildir:~/Maildir:UTF-8 doveadm(fmsync): Debug: Namespace : Using permissions from /home/fmsync/Maildir: mode=0700 gid=default dsync(fmsync): Debug: Effective uid=1002, gid=1002, home=/home/fmsync dsync(fmsync): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc:/home/fmsync/imapcdir dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Created new connection dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Looking up IP address (reconnect_ok=true, last_connect=1580957435) dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Connecting to 66.111.4.135:993 dsync(fmsync): Info: imapc(imap.fastmail.com:993): Connected to 66.111.4.135:993 (local 192.168.122.253:59074) dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Starting SSL handshake dsync(fmsync): Debug: imapc(imap.fastmail.com:993): SSL handshake successful dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Server capabilities: IMAP4 IMAP4rev1 LITERAL+ ENABLE UIDPLUS SASL-IR NAMESPACE CONDSTORE SORT LIST-EXTENDED QRESYNC MOVE SPECIAL-USE CREATE-SPECIAL-USE IDLE AUTH=PLAIN dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Authenticating as ... dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Server capabilities: IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxten QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SEARCH=FUZZY SORT SORT=MODSEQ SORT=DISPLAY SORT=UID THREAD=ORDEREDSUBJECT THREAD=REFERENCES THREAD=REFS ANNOTATE-EXPERIMENT-1 METADATA LIST-EXTENDED LIST-STATUS LIST-MYRIGHTS LIST-METADATA WITHIN QRESYNC SCAN XLIST XMOVE MOVE SPECIAL-USE CREATE-SPECIAL-USE DIGEST=SHA1 X-REPLICATION STATUS=SIZE OBJECTID SAVEDATE X-CREATEDMODSEQ PREVIEW=FUZZY XAPPLEPUSHSERVICE LOGINDISABLED XCONVERSATIONS COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STORAGE X-QUOTA=X-NUM-FOLDERS IDLE dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Authenticated successfully dsync(fmsync): Debug: imapc: root=/home/fmsync/imapcdir, index=, indexpvt=, control=, inbox=, alt= dsync(fmsync): Debug: maildir++: root=/home/fmsync/imapcdir, index=, indexpvt=, control=, inbox=, alt= dsync(fmsync): Debug: brain M: Locking done locally in /home/fmsync/.dovecot-sync.lock (local hostname=imapmirror.v.shahaf.local2, remote hostname=imapmirror.v.shahaf.local2) dsync(fmsync): Debug: brain S: Namespace has location imapc:/home/fmsync/imapcdir dsync(fmsync): Debug: Namespace : Using permissions from /home/fmsync/imapcdir: mode=0700 gid=default dsync(fmsync): Debug: brain M: Local mailbox tree: lists guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(fmsync): Debug: brain S: Local mailbox tree: lists guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(fmsync): Debug: brain M: Local mailbox tree: lists/zsh guid=$guid1 uid_validity=1529153257 uid_next=24289 subs=yes last_change=0 last_subs=1580956711 dsync(fmsync): Debug: brain S: Local mailbox tree: lists/zsh guid=$guid1 uid_validity=1529153257 uid_next=24290 subs=yes last_change=0 last_subs=0 dsync(fmsync): Debug: brain M: Remote mailbox tree: lists guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(fmsync): Debug: brain M: Remote mailbox tree: lists/zsh guid=$guid1 uid_validity=1529153257 uid_next=24290 subs=yes last_change=0 last_subs=0 dsync(fmsync): Debug: brain S: Remote mailbox tree: lists guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(fmsync): Debug: brain S: Remote mailbox tree: lists/zsh guid=$guid1 uid_validity=1529153257 uid_next=24289 subs=yes last_change=0 last_subs=1580956711 dsync(fmsync): Debug: brain M: Mailbox lists: local=00000000000000000000000000000000/0/0, remote=00000000000000000000000000000000/0/0: Directory name paths are equal dsync(fmsync): Debug: brain M: Mailbox lists/zsh: local=$guid1/0/1, remote=$guid1/0/1: Mailboxes are equal dsync(fmsync): Debug: brain S: Mailbox lists: local=00000000000000000000000000000000/0/0, remote=00000000000000000000000000000000/0/0: Directory name paths are equal dsync(fmsync): Debug: brain S: Mailbox lists/zsh: local=$guid1/0/1, remote=$guid1/0/1: Mailboxes are equal dsync(fmsync): Debug: brain M: Skipping mailbox $guid1 with unchanged state uidvalidity=1529153257 uidnext=24289 highestmodseq=4910711 highestpvtmodseq=0 messages=24117 dsync(fmsync): Debug: imapc(imap.fastmail.com:993): Disconnected dsync(fmsync): Debug: brain M: Exported mailbox states: dsync(fmsync): Debug: brain M: Mailbox $guid1 state: uidvalidity=1529153257 uid=24288 modseq=4910711 pvt_modseq=0 messages=24117 changes_during_sync=0 dsync(fmsync): Debug: brain M: Unlocked /home/fmsync/.dovecot-sync.lock dsync(fmsync): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (uid=0): Disconnected: Connection closed (fd=10) % grep -v LOGIN < /mnt/rawlog/20200206-025036.966.1.out 1580957437.093905 1 CAPABILITY 1580957437.403048 3 LIST "" "" 1580957437.550179 4 LIST "" "*" 1580957437.725211 5 STATUS "lists/zsh" (UIDNEXT UIDVALIDITY) 1580957437.874174 6 LSUB "" "*" 1580957438.184244 7 LOGOUT % grep -w -B 2 5 < /mnt/rawlog/20200206-025036.966.1.in 1580957437.705302 4 OK Completed (...) 1580957437.869540 * STATUS lists/zsh (UIDNEXT 24290 UIDVALIDITY 1529153257) 1580957437.869540 5 OK Completed % doveadm search -u fmsync mailbox lists/zsh HEADER Received 48CjYx6xvmzWp | wc -l 0 % ]]] [[[ # Back in s_client: f EXAMINE lists/zsh ⋮ g UID SEARCH HEADER Received 48CjYx6xvmzWp * SEARCH 24289 g OK Completed (1 msgs in 5.268 secs) ]]] So, my question is: Why doesn't «doveadm backup» sync the new message? (Message number 24118, UID 24289, ESMTP ID 48CjYx6xvmzWp) Cheers, Daniel ¹ https://svn.freebsd.org/ports/head/mail/dovecot

1 2

.IMAP
by Jos Chrispijn 15 Feb '20

15 Feb '20

Dear team, I have my users in /usr/home/user1 for user1, user2 for user2 etc. As these users also have a website, these folders have a /usr/home/user1/www folder, which is the docroot of their website. What happens now is that Dovecot indexes also this /usr/home/user1/www folder and creates in every folder a .imap folder which content is an exact image of the folder it is created in. In practice this causes 2 times of webspace (which also in on the account of that user). Can you pls tell me what I do wrong and how to solve this? I might be missing an 'exclude' folder setting for each dovecot user. Thanks for you expertise, Jos

3 4

Dovecot 2.3 repo for CentOS 8.
by Reio Remma 15 Feb '20

15 Feb '20

Hello! Are there any plans for an official Dovecot repo for CentOS 8? Thanks, Reio

7 10

Very slow mail download/notification with dovecot 2.2.33 and Thunderbird
by ml_dovecot＠thorsten-reichelt.de 15 Feb '20

15 Feb '20

Hi! I know that there are many results if I search for "dovecot thunderbird very slow" on Google but none of them helped me with my problem. :( I am running Ubuntu 18.04 (4GB RAM, 40GB HDD with EXT4) with the following software: - Dovecot 2.2.33 ---- All accounts are using Maildir ---- Sieve filters - Postfix 3.3.0 ---- with opendkim, spamassassin, razor, pyzor, .... And as IMAP client I am using Thunderbird 68.4 on Windows10. Sieve is used to sort incoming mails into my 224 folders (56 INBOX. folders and its subfolders (output of "find .INBOX.* -maxdepth 4 -type d -print |wc -l")). My problem is that it takes very very long to synchonize the INBOX and its subfolders. Even if there are only a few new messages to be downloaded. Sometimes Thunderbird outputs something like "downloading message 1 of 19" and it takes at least 60 seconds to download all of them. None of these 19 mails is larger than 5kB. And sometimes it seems that the transfer is suspended for a long time and it takes >5 Minutes to synchronize only a few mails. :( Every helpful advice is welcome. I just don't know where to look for the cause right now, but I can provide configurations (like output of |doveadm config) |and some logfiles. Thank you very much! Thorsten

2 1

Dovecot Proxy - Oauth2 mech add custom fields
by Domenico Pastore 14 Feb '20

14 Feb '20

Hi, I have a problem with configuring dovecot passdb for Oauth2 with keyclock. A user can access more mailbox, mailboxes are associated with the user. When a user login with this method: OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ AUTH=PLAIN] Dovecot ready. a login mailbox*user password Dovecot when requiring the grant_url send to Keyclock, for example, this post (I have already enabled raw_log for analysis): grant_type=password&username=domenico&password=test&client_id=imap-client&client_secret=99e26b26-0f2a-4b64-8f57-c0ca2147d3a0&scope=emailPOST /auth/realms/example/protocol/openid-connect/token/introspect The call pass to Keyclock only master_user and miss mailbox info. In fact, the JSON response after login return the only username without mailbox: [...] "scope": "profile email", "email_verified": false, "preferred_username": "dome.nico" [...] When Dovecot proxy connects to the backend, email attribute and user have the same value, master-user. This behavior is a problem because when backend tries login access, login with the user and not with the mailbox. This is backend logging: 2020-02-13 19:34:13 auth: Debug: client passdb out: OK 1 user=domenico token=eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJYVy1fSmNnVkF3aW9GUXh1NUhwdjVlbk5uNU8zaW42Y1VpaGJsM2dWX0V3In0.eyJqdGkiOiJhYTMwZ Dk0Yy0xNjE0LTQzN2QtOTA5Zi01ZTAwNGQ2YjNmZTIiLCJleHAiOjE1ODE2MTE5NTQsIm5iZiI6MCwiaWF0IjoxNTgxNjExNjU0LCJpc3MiOiJodHRwczovL2tleWNsb2FrLXBlYy1pYW0ucGVjLWFwcHMucGFyLXRlYy5pdC9hdXRoL3JlYWxtcy9wZWMiLCJhdWQiOiJhY2NvdW50Iiwi c3ViIjoiZjphNTA1NWUzMi1lYzhkLTRmZjgtOWZjNS00ODM4MmQ1MzRhODc6ZG9tZS5uaWNvIiwidHlwIjoiQmVhcmVyIiwiYXpwIjoiaW1hcC1jbGllbnQiLCJhdXRoX3RpbWUiOjAsInNlc3Npb25fc3RhdGUiOiIyN2M0ZDMzYy01YjdlLTQzMWMtYjZmMi0yYmI4NjIzYzMyMjkiLCJ hY3IiOiIxIiwicmVhbG1fYWNjZXNzIjp7InJvbGVzIjpbIm9mZmxpbmVfYWNjZXNzIiwidW1hX2F1dGhvcml6YXRpb24iXX0sInJlc291cmNlX2FjY2VzcyI6eyJhY2NvdW50Ijp7InJvbGVzIjpbIm1hbmFnZS1hY2NvdW50IiwibWFuYWdlLWFjY291bnQtbGlua3MiLCJ2aWV3LXByb2 ZpbGUiXX19LCJzY29wZSI6InByb2ZpbGUgZW1haWwiLCJlbWFpbF92ZXJpZmllZCI6ZmFsc2UsInByZWZlcnJlZF91c2VybmFtZSI6ImRvbWUubmljbyJ9.LlIx-QeRQPr3lK4Cs1vU0qMvHF3uq3h15BGi1atNCBASkM6oPoYWLV-sYdf8hzpRFyOaTcbxN53SN6LfD0hHvUZ2sKHxh7UJ idmxS4hf1SsZq8wJTASpebcPLtBIX5JBvXmpxa-cVnZDE1JVw5np5-LLNs0j4sgHwgg85mJEoE2VmYJzbGZjUsSTvaAAoCbvTA0MfsNoKyq0E5JrLVdkI-twX7HjAESFqFD4yHe7BS4FG_UjddrSr3uXmXreB44VLZ8B4xBgVRjK9K-sjjkXT8Bkv8WbxUdEEHaarWU_qanI5DlhA0CZXlJ CyDsNcRwQfwVHOESxXE7ehgIDPm-NjA I have a mechanism for adding other attributes with Dovecot when calling Keyclock? This for insert email or other fields into the token. Thanks all, Domenico ——— Dovecot Frontend # 2.3.9.2 (cf2918cac): /config/dovecot/dovecot-proxy/dovecot.conf # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) # Hostname: fe-new.example.it auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose = yes auth_verbose_passwords = yes base_dir = /data/dovecot/var/run/dovecot-proxy default_vsz_limit = 768 M disable_plaintext_auth = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ MASTERPWD info_log_path = /LOGS/imap/dovecot-proxy.log instance_name = dovecot-proxy listen = fe-new_imap log_path = /LOGS/imap/dovecot-proxy.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = 101 mail_location = maildir:%h/Maildir mail_max_userip_connections = 50 mail_plugins = quota expire mail_log notify mail_uid = 102 maildir_broken_filename_sizes = yes mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /config/dovecot/dovecot-proxy/dovecot-oauth2.conf driver = oauth2 master = yes mechanisms = plain login } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size } postmaster_address = posta(a)foo.it protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </certs/cert-selfsigned.crt ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4::!3DES:!IDEA ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it protocol lmtp { mail_plugins = quota expire mail_log notify } protocol lda { mail_plugins = quota expire mail_log notify } protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify pop3_uidl_format = UID%u-%v } -> /config/dovecot/dovecot-proxy/dovecot-oauth2.conf grant_url = https://keycloak-iam.apps.example.com/auth/realms/example/protocol/openid-c… use_grant_password = yes introspection_mode = post introspection_url = https://keycloak-iam.apps.example.com/auth/realms/example/protocol/openid-c… username_attribute = username username_format = %Lu tls_ca_cert_file = /etc/ssl/certs/ca-certificates.crt active_attribute = active active_value = true scope = email send_auth_headers = yes debug = yes rawlog_dir = /LOGS/imap/oauth2/ client_id = imap-client client_secret = 99e26b26-0f2a-4b64-8f57-c0ca2147d3a0 pass_attrs = host=192.160.10.4 proxy=y proxy_mech=xoauth2 pass=%{oauth2:access_token}

1 0

Dovecot process died with assertion failed
by TACHIBANA Masashi 13 Feb '20

13 Feb '20

Hi, I'm testing Dovecot v2.3.9.2. So, I found a problem that a Dovecot process termed with Panic, like below: Feb 10 08:50:09 imap(user1(a)example.com)<38440><p9ec0zSeSIQKEAIK>: Panic: file message-snippet.c: line 71 (snippet_add_content): assertion failed: (*count_r <= size) Feb 10 08:50:09 imap(user1(a)example.com)<38440><p9ec0zSeSIQKEAIK>: Error: Raw backtrace: /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(backtrace_append+0x3b) [0x7fee4c46331b] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7fee4c46346e] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(+0xfc90b) [0x7fee4c46f90b] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(+0xfc9c1) [0x7fee4c46f9c1] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fee4c3b470a] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(+0xdea53) [0x7fee4c451a53] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot-storage.so.0(+0xdcd98) [0x7fee4c80bd98] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot-storage.so.0(+0xdd1a5) [0x7fee4c80c1a5] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot-storage.so.0(index_mail_get_special+0x2c1) [0x7fee4c80c591] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot-storage.so.0(dbox_mail_get_special+0x48) [0x7fee4c7adeb8] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot-storage.so.0(+0x78f2b) [0x7fee4c7a7f2b] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot-storage.so.0(mail_get_special+0x10) [0x7fee4c76f3e0] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](+0x2645b) [0x55ffc6c5845b] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](+0x239df) [0x55ffc6c559df] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](imap_fetch_more+0x35) [0x55ffc6c578b5] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](cmd_fetch+0x35f) [0x55ffc6c44aaf] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](command_exec+0xb9) [0x55ffc6c535b9] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](+0x1eacf) [0x55ffc6c50acf] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](+0x1eb87) [0x55ffc6c50b87] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](client_handle_input+0x215) [0x55ffc6c51885] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](client_input+0x7e) [0x55ffc6c5206e] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x7b) [0x7fee4c48bcdb] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x105) [0x7fee4c48dd55] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x59) [0x7fee4c48bde9] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fee4c48c098] -> /usr/local/dovecot-2.3.9.2/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fee4c3e9623] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](main+0x367) [0x55ffc6c40d37] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7fee4bfc7545] -> dovecot-backend-server/imap [user1(a)example.com 10.16.2.10 UID FETCH](+0xefb4) [0x55ffc6c40fb4] Feb 10 08:50:09 imap(user1(a)example.com)<38440><p9ec0zSeSIQKEAIK>: Fatal: master: service(imap): child 38440 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) It was occurred this by a mail had ISO-2022-JP content (Single part mail). I saw that the mail was not strange. When I appended the mail with IMAP APPEND command, that no problem happened. I think the problem comes by LMTP only. Any idea? Regards, -- Tachibana, Masashi QUALITIA CO., LTD. mailto:tachibana@qualitia.co.jp https://www.qualitia.co.jp/

1 1

Shared Mailboxes with Multiple Domains
by Daniel Miller 13 Feb '20

13 Feb '20

Trying to track down a problem I've been dealing with for a while. Everything else works fine - the problem is with shared mailboxes. My present, and desired, prefix for the shared namespace is: prefix = INBOX/shared/%%d/%%n/ Some mail clients, particularly Thunderbird and Android's AquaMail, have no problem with this. But other (presumably broken) clients don't show the shared mailboxes. This includes EM Client and Webmail Lite. Actually, Webmail Lite lists the mailboxes in the subscription window, but then the "live" folder list shows "shared" and "shared/domain" but none of the shared mailboxes below the domain. Changing to: prefix = INBOX/shared/%%u/ Works across all clients - but I'd rather have the domain separation. Testing with telnet ". LIST '' '*'" yields the full list with either config. The files /var/mail/%d/shared-mailboxes contain entries like: shared/shared-boxes/group/allshared/user(a)domain.com 1 Below is "doveconf -n" output. # 2.3.9.3 (9f41b88fa): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: Linux 5.3.0-28-generic x86_64 Ubuntu 18.04.4 LTS # Hostname: bubba.amfes.lan auth_cache_size = 4 k auth_master_user_separator = * auth_mechanisms = plain login auth_policy_hash_nonce = # hidden, use -P to show it auth_policy_hash_truncate = 8 auth_policy_server_api_header = Authorization: Basic d2ZvcmNlOnVsdHJhLXNlY3JldC1zZWN1cmUtc2FmZQ default_login_user = nobody default_vsz_limit = 2 G disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep imap_idle_notify_interval = 29 mins listen = * login_trusted_networks = 192.168.0.0/24 mail_attachment_hash = %{sha512} mail_plugins = fts fts_solr acl zlib virtual mail_prefetch_count = 10 mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 20 M namespace archives { list = children location = mdbox:/var/mail/%d/%n/Archives/mdbox mailbox Unsorted { auto = no special_use = \Archive } prefix = INBOX/Archives/ separator = / subscriptions = no type = private } namespace inbox { hidden = no inbox = yes list = yes location = mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no type = private } namespace lists { list = children location = mdbox:/var/mail/%d/%n/Lists/mdbox prefix = INBOX/Lists/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } namespace usershares { list = children location = sdbox:/var/mail/%%d/%%n/sdbox:NO-NOSELECT prefix = INBOX/shared/%%d/%%n/ separator = / subscriptions = no type = shared } namespace virtual { list = children location = virtual:/var/mail/%d/%n/virtual mailbox Flagged { comment = All my flagged messages special_use = \Flagged } prefix = INBOX/virtual/ separator = / subscriptions = no } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/mail/%d/shared-mailboxes fts = solr fts_autoindex = yes fts_autoindex_exclude = \Trash fts_autoindex_exclude2 = \Junk fts_autoindex_exclude3 = \Spam fts_enforced = no fts_index_timeout = 20s fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ mailbox_alias_new = Sent Messages mailbox_alias_new2 = Sent Items mailbox_alias_new3 = Deleted Messages mailbox_alias_old = Sent mailbox_alias_old2 = Sent mailbox_alias_old3 = Trash sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0660 user = vmail } } service imap-login { process_min_avail = 10 service_count = 1 } service imap-postlogin { executable = script-login /usr/local/etc/dovecot/post-login.sh user = $default_internal_user } service imap { executable = imap imap-postlogin vsz_limit = 4 G } service indexer-worker { process_limit = 3 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = mail mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } process_min_avail = 0 service_count = 1 } ssl_cert = </etc/ssl/letsencrypt/live/mail.amfes.com/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = fts fts_solr acl zlib virtual sieve postmaster_address = postmaster(a)amfes.com } protocol lda { mail_plugins = fts fts_solr acl zlib virtual sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = fts fts_solr acl zlib virtual imap_acl imap_zlib mailbox_alias } -- Daniel

1 0

[FOR THE RECORD] CLIENTID Extension for IMAP/SMTP AUTH in dovecot
by Michael Peddemors 12 Feb '20

12 Feb '20

More and more email clients are now starting to support the CLIENTID extension for IMAP, including 'libetpan', SaneBox, BlueMail, and now as of Thunderbird 68.5.0, available there as well. This allows for a form of native two factor support, permission token, and/or access control to prevent the unauthorized use of email address and password. (For more information, please see the RFC Drafts, or reach out to us off list for details) While the version of dovecot we use has supported it for some time now, we would like to make it available for more email providers who use dovecot. For the record, for those interested in having your dovecot support transparent multi-factor, in your implementation, you will have to compile it with the patch listed in: https://github.com/dovecot/core/pull/86 Once that is done, please feel free to reach out to us for the dovecot plugin, that enables CLIENTID to be supported in the IMAP protocol. -- "Catch the Magic of Linux..." ------------------------------------------------------------------------ Michael Peddemors, President/CEO LinuxMagic Inc. Visit us at http://www.linuxmagic.com @linuxmagic A Wizard IT Company - For More Info http://www.wizard.ca "LinuxMagic" a Registered TradeMark of Wizard Tower TechnoServices Ltd. ------------------------------------------------------------------------ 604-682-0300 Beautiful British Columbia, Canada This email and any electronic data contained are confidential and intended solely for the use of the individual or entity to which they are addressed. Please note that any views or opinions presented in this email are solely those of the author and are not intended to represent those of the company.

1 0

Doveadm Sync problem with symbolic folders
by Gianluca Scaglia 12 Feb '20

12 Feb '20

Hi, i have two servers (debian 10) that synchronize the emails bidirectionally with Doveadm Sync (dovecot 2.3.4.1). Before updating to debian 10, then with dovecot 2.2, I could also synchronize symbolic folders (made with ln-s) without any problems. Now, however, it continues to create temporary folders (e.g. Sent-temp-1 etc.) and I am forced to stop synchronization. Is there any way to make Doveadm Sync ignore symbolic folders? Thanks a lot, Luca Scaglia

1 0

feature request for setting alternative pidfile
by Bjoern Jacke 12 Feb '20

12 Feb '20

Hi, because of an unsupported combination of configuration parameters for different dovecot services I looked into setting up two dovecot instances with different configurations on the same host. It looks like running two different dovecot instances on the same host is not easily possible because the pidfile seems to be hard-coded and there is no way to tell dovecot to use a different one, right? It would be great if this could be made customizable. Björn

2 2

tcpwraper errors with v2.3.9.3
by Bobber 12 Feb '20

12 Feb '20

My system was working fine with version 2.3.9.2. I upgraded to 2.3.9.3 and I am getting tcpwraper errors: > imap-login: Error: connect(tcpwrap) failed: No such file or directory Here's my config: > login_access_sockets = tcpwrap > > service tcpwrap { > unix_listener login/tcpwrap { > group = $default_login_user > mode = 0600 > user = $default_login_user > } > } Any ideas what's happening? -- Bob Wooldridge

1 0

tcpwraper errors with v2.3.9.3
by Robert A Wooldridge 12 Feb '20

12 Feb '20

My system was working fine with version 2.3.9.2. I upgraded to 2.3.9.3 and I am getting tcpwraper errors: > imap-login: Error: connect(tcpwrap) failed: No such file or directory Here's my config: > login_access_sockets = tcpwrap > > service tcpwrap { > unix_listener login/tcpwrap { > group = $default_login_user > mode = 0600 > user = $default_login_user > } > } Any ideas what's happening? -- Bob Wooldridge EDM Incorporated

1 0

Dovecot/doveadm quota
by Martynas Bendorius 12 Feb '20

12 Feb '20

Hello, Is there any reason why dovecot relies on S= instead of real disk size email takes? 1) compressed mails take less than than the S= specified 2) we could avoid using "S=" for the lookups and count every file there, including indexes and mails without S=... if we'd read filesizes Eample: # ls -l '1567026317.M331058P4751.testing.server.com,S=3086,W=3148:2,S' -rw------- 1 dev mail 1274 Aug 29 00:05 1567026317.M331058P4751.testing.server.com,S=3086,W=3148:2,S Proposed patch (solves #1, not sure about your opinion on #2): --- src/plugins/quota/quota-maildir.c.orig 2020-02-05 19:21:08.582998417 -0700 +++ src/plugins/quota/quota-maildir.c 2020-02-05 19:21:22.184998798 -0700 @@ -84,7 +84,7 @@ p = strstr(dp->d_name, ",S="); num = (uoff_t)-1; - if (p != NULL) { + if (0 && p != NULL) { /* ,S=nnnn[:,] */ p += 3; for (num = 0; *p >= '0' && *p <= '9'; p++) @@ -104,7 +104,7 @@ str_truncate(path, len); str_append(path, dp->d_name); if (stat(str_c(path), &st) == 0) { - *total_bytes += st.st_size; + *total_bytes += st.st_blocks * 512; *total_count += 1; } else if (errno != ENOENT && errno != ESTALE) { *error_r = t_strdup_printf( Thank you! -- Best regards, Martynas Bendorius

3 4

Dovecot v2.3.9.3 released
by Aki Tuomi 12 Feb '20

12 Feb '20

We are pleased to release v2.3.9.3 of Dovecot. Please find it from locations below https://dovecot.org/releases/2.3/dovecot-2.3.9.3.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.3.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- v2.3.9.3 2019-02-12 Aki Tuomi <aki.tuomi(a)open-xchange.com> * CVE-2020-7046: Truncated UTF-8 can be used to DoS submission-login and lmtp processes. * CVE-2020-7957: Specially crafted mail can crash snippet generation.

2 2

CVE-2020-7046: Truncated UTF-8 can be used to DoS submission-login and lmtp processes
by Aki Tuomi 12 Feb '20

12 Feb '20

Open-Xchange Security Advisory 2020-02-12 Affected product: Dovecot Core Internal reference: DOV-3744 (JIRA ID) Vulnerability type: Improper Input Validation (CWE-30) Vulnerable version: 2.3.9 Vulnerable component: submission-login, lmtp Fixed version: 2.3.9.3 Report confidence: Confirmed Solution status: Fixed Researcher credits: Open-Xchange oy Vendor notification: 2020-01-14 CVE reference: CVE-2020-7046 CVSS: 7.5 (CVSS3.1:AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H) Vulnerability Details: lib-smtp doesn't handle truncated command parameters properly, resulting in infinite loop taking 100% CPU for the process. This happens for LMTP (where it doesn't matter so much) and also for submission-login where unauthenticated users can trigger it. Risk: Attacker can cause submission-login and lmtp processes to be exhausted, leading into denial of service and CPU resource exhaustion. Solution: Upgrade to 2.3.9.3.

1 0

CVE-2020-7957: Specially crafted mail can crash snippet generation
by Aki Tuomi 12 Feb '20

12 Feb '20

Open-Xchange Security Advisory 2020-02-12 Affected product: Dovecot Core Internal reference: DOV-3743 (JIRA ID) Vulnerability type: Improper Input Validation (CWE-30) Vulnerable version: 2.3.9 Vulnerable component: lmtp, imap Fixed version: 2.3.9.3 Report confidence: Confirmed Solution status: Fixed Researcher credits: Open-Xchange oy Vendor notification: 2020-01-14 CVE reference: CVE-2020-7957 CVSS: 3.1 (CVSS:3.1/AV:N/AC:H/PR:N/UI:R/S:U/C:N/I:N/A:L) Vulnerability Details: Snippet generation crashes if: message is large enough that message-parser returns multiple body blocks The first block(s) don't contain the full snippet (e.g. full of whitespace) input ends with '>' Risk: Sending specially crafted email can cause mailbox to have permanently unaccessible mail, or the mail can be stuck in delivery. Solution: Upgrade to 2.3.9.3

1 0

Folders disappears and all mail lost
by Gabriele Fain 11 Feb '20

11 Feb '20

Hello, I have a Dovecot 2.2.22 configured with mdbox storage. THe server have about 50 mailboxes configured. Only in one mailbox I have a strange problem, sometime (in the last 2 month happens 3 times). All the mail (Except INBOX) and all folders disappear. THe space on disk remain allocated. To this mailbox are connected 3 computers (2 PC Windows 10, and 1 Mac OS). I cannot determine who and why this happens to this mailbox. Can someone tellme how I can find the PC that delete all mail.

2 1

[v 2.3.4.1][quota] recalculation
by Thomas Criscione 11 Feb '20

11 Feb '20

Hello, I can't find the information on the wiki :( When is the quota recalculated after a mail deletion ? For instance, I am running low of storage and I use Thunderbird to delete large mail. I only notice a recalculation when I quit Thunderbirdb and I relaunch it. Even, with doveadm CLI, as long as Thunderbird is not disconnected on the client side, the server didn't recalculate the storage available. Thanks for the help ! Thomas -- Thomas Criscione https://thomascriscione.fr GPG: E521 FFF0 13C4 52FB 55EB 8C49 EBDD 0DC6 1ED9 2A4F

3 4

starttls for some services only
by Bjoern Jacke 10 Feb '20

10 Feb '20

Hi, I would like to disable offering starttls to clients for certain dovecot services. Background is that I want to do let a load balancer do the TLS stuff right on connect time and let dovecot only do plain imap without offering starttls (because the clients do imaps actually). Getting rid of the starttls feature offering works only if I set ssl = no globally only. Setting it in the service imap-login section seems to be impossible. If I set it globally to no though, I cannot use it in other services where it is needed like in the manage-sieve, where clients unfortunately only support starttls and no tls on connect. Is there any way to configure dovecot to offer starttls for some services and for some not or is this just not supported currently? Thanks Björn

2 4

Email Server Backup Strategy
by Esteban L 10 Feb '20

10 Feb '20

Hello, Was thinking it would be wise to backup my server, in case anything "bad" ever happened, so that I could quickly get up to speed. 1. clone the whole drive -- which might be the best to ensure I keep the whole system working. 2. But, what about, if I just wanted to backup my Email server components? Postfix - which I think is just config files, and Dovecot - I think there is a doveadm backup for doing such things. What do you guys do, recommend for backups?? Thanks -- https://www.little-beak.com "Doing what we can."

7 9

postmaster_address parameter scope
by mabi 10 Feb '20

10 Feb '20

Hello, I was wondering when I define the following dovecot parameter: postmaster_address = postmaster(a)mydomain.com in my local.conf config file, does this parameter apply globally? I mean because it is not inside any {} curly braces does it also appliy to: protocol lmtp { ... } or do I need o explicitly define again my postmaster_address parameter inside protocol lmtp{} like this? protocol lmtp { postmaster_address = postmaster(a)mydomain.com } My very same question applies also for protocol lda {}... Regards, Mabi

1 0

Reload Dovecot with thousands of domains.
by Victor 10 Feb '20

10 Feb '20

Hello!, I have a dovecot server configured with about 3k different domains. It worked without problems until SSL certificates has been installed. After increase available RAM and stabilizing the service my current problem is in renewals. Dovecot reload process consumes a lot of memory for every one certificate renewal. The server has enough memory to support reload in most cases, but if server has certain load, reload process throws down the service. I’m using lets encrypt certificates and this process is automated. Is there any way to reload just one domain/session?

1 0

How to configure mail-filter plugin
by 刘莹莹 10 Feb '20

10 Feb '20

I config mail-filter plugin like https://wiki2.dovecot.org/Plugins/MailFilter describe， but error occurred mail-filter plugin config in dovecot.conf: mail_plugins = mail_filter plugin { mail_filter = mail-filter %u # %u = username given to the script as first mail_filter_out = mail-filter-out %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh user = vmail group = vmail unix_listener mail-filter { mode = 0666 user = vmail group = vmail } } service mail-filter-out { executable = script /usr/local/bin/mail-filter-out.sh user = vmail group = vmail unix_listener mail-filter-out { mode = 0666 user = vmail group = vmail } } vim /usr/local/bin/mail-filter.sh touch /tmp/testfile cat > /tmp/tempfile cat /tmp/tempfile vim /usr/local/bin/mail-filter-out.sh cat > /tmp/tempfile cat /tmp/tempfile then "dovecot-lda -f q1(a)a.com -d q1(a)a.com < test.eml" Error log: Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Debug: Namespace : Using permissions from /home/a.com/q1: mode=0700 gid=default Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0) Feb 10 10:00:21 lda(q1(a)a.com)<18794><9ZN8EzW5QF5qSQAA0J78UA>: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f049f4ef582] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f049f4ef68e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe4b6e) [0x7f049f4f9b6e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe4bb1) [0x7f049f4f9bb1] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f049f4565e8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bc47) [0x7f049f520c47] -> /usr/lib64/dovecot/libdovecot-storage.so.0(dbox_save_end+0x35) [0x7f049f8262f5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7f049f81af99] -> /usr/lib64/dovecot/libdovecot-lda.so.0(+0x3fbe) [0x7f049fb0efbe] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x73) [0x7f049f801493] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xc9) [0x7f049f7f38e9] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mdbox_copy+0x46) [0x7f049f81b816] -> /usr/lib64/dovecot/libdovecot-lda.so.0(+0x3daa) [0x7f049fb0edaa] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4e87c) [0x7f049f80187c] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1d7) [0x7f049fb103e7] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x2fe) [0x7f049fb10bfe] -> /usr/libexec/dovecot/dovecot-lda(main+0x615) [0x55f636880045] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f049f073c05] -> /usr/libexec/dovecot/dovecot-lda(+0x3b7e) [0x55f636880b7e]

1 0

noreplicate for some users
by mail＠backprod.de 08 Feb '20

08 Feb '20

Hi, I have set up the sync and it is working but I only would like to sync some users. Currently this does not seem to work. Version 2.3.9.2 Relevant Settings: File users: mail@domain.de:{SHA}hash:::t: passdb { driver = passwd-file args = username_format=%u /etc/dovecot/users } userdb { driver = passwd-file args = username_format=%u /etc/dovecot/users default_fields = uid=2222 gid=2222 home=/var/vmail/%d/%n userdb_noreplicate=t } After restart of dovecot I allways get all users with sudo doveadm replicator status "*" usernamepriority fast sync full sync success sync failed abuse(a)domain.net none 00:01:58 03:52:23 - y admin(a)domein.net none 00:01:58 03:52:23 - y abuse(a)domein.de none 00:01:58 07:51:00 - y What value needs to be set to get replication / no replication and to remove the users from the list? I have tried 0 / 1 / True / False / t / f / T / F but I don't see a change in behavior. Best regards Tim

2 2

Re: mail_filter plugin: failed: EOF without input (Gedalya)
by 刘莹莹 08 Feb '20

08 Feb '20

I just modified mail-filter-out.sh like this: cat  mail-filter-out.sh   #!/bin/sh   USER=$1   cat > /tmp/tempfile   cat /tmp/tempfile cat  /tmp/tempfile This message is in MIME format. --nsmail-7bjyg3nr5o-7bmibqhut9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: base64 PHA+Jm5ic3A7PC9wPjxwPiZuYnNwOzIxMjEyMTIxPC9wPjxwPiZuYnNwOzwv cD48cD4mbmJzcDs8L3A+PHA+Jm5ic3A7PC9wPjxwPiZuYnNwOzwvcD4tLS0t PGRpdiBpZD0iY3MyY19tYWlsX3NpZ2F0dXJlIj48L2Rpdj48cD48L3A+ --nsmail-7bjyg3nr5o-7bmibqhut9-- But the log appears:   Feb 08 19:14:18 lda(q1(a)a.com)<71012><m+U/KQqYPl5kFQEA0J78UA>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0)   Feb 08 19:14:18 lda(q1(a)a.com)<71012><m+U/KQqYPl5kFQEA0J78UA>: Error: Raw backtrace: /opt/svn/nsmail-dovecot-2.3.9_4/src/lib- dovecot/.libs/libdovecot.so.0(backtrace_append+0x42) [0x7f60cc7cc5c2] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(backtrace_get+0x1e) [0x7f60cc7cc6ce] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0xe4bae) [0x7f60cc7d6bae] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0xe4bf1) [0x7f60cc7d6bf1] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(i_fatal+0) [0x7f60cc733628] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-dovecot/.libs/libdovecot.so.0(+0x10bc67) [0x7f60cc7fdc67] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(dbox_save_end+0x35) [0x7f60ccb032e5] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7f60ccaf7f99] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(+0x402e) [0x7f60ccdec02e] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mailbox_save_finish+0x73) [0x7f60ccade4b3] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mail_storage_copy+0xc9) [0x7f60ccad08f9] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(mdbox_copy+0x46) [0x7f60ccaf8816] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(+0x3e1a) [0x7f60ccdebe1a] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-storage/.libs/libdovecot-storage.so.0(+0x4e89c) [0x7f60ccade89c] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(mail_deliver_save+0x1d7) [0x7f60ccded457] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lib-lda/.libs/libdovecot-lda.so.0(mail_deliver+0x2fe) [0x7f60ccdedc6e] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lda/.libs/lt-dovecot-lda(main+0x644) [0x55e0340b3144] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f60cc350c05] -> /opt/svn/nsmail-dovecot-2.3.9_4/src/lda/.libs/lt-dovecot-lda(+0x3cb6) [0x55e0340b3cb6] ------------------ Original ------------------ From: "dovecot-request"<dovecot-request(a)dovecot.org>; Date: Sat, Feb 8, 2020 06:00 PM To: "dovecot"<dovecot(a)dovecot.org>; Subject: dovecot Digest, Vol 202, Issue 11 Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit https://dovecot.org/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." Today's Topics:    1. Re: mail_filter plugin: failed: EOF without input (Gedalya) ---------------------------------------------------------------------- Message: 1 Date: Fri, 7 Feb 2020 23:48:28 +0800 From: Gedalya <gedalya(a)gedalya.net> To: dovecot(a)dovecot.org Cc: ??? <576709166(a)qq.com> Subject: Re: mail_filter plugin: failed: EOF without input Message-ID: <84fcd237-4290-2518-c4cf-486a049d9231(a)gedalya.net> Content-Type: text/plain; charset=gb18030 On 2/7/20 4:33 PM, ??? wrote: > > cat?mail-filter-out.sh > #!/bin/sh > cat > tempfile > cat ?mail-filter.sh > #!/bin/sh > > USER=$1 > cat > tempfile > > Some important Error logs? > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input > Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11) > Hi, Your scripts are reading all the available input and not producing any output. This way the email message is lost. You could add the line: cat tempfile or just replace "cat > tempfile" with "tee > tempfile" ------------------------------ Subject: Digest Footer _______________________________________________ dovecot mailing list dovecot(a)dovecot.org https://dovecot.org/mailman/listinfo/dovecot ------------------------------ End of dovecot Digest, Vol 202, Issue 11 ****************************************

1 0

mail_filter plugin: failed: EOF without input
by 刘莹莹 07 Feb '20

07 Feb '20

some import  configure: plugin {   mail_filter = mail-filter %u # %u = username given to the script as first   mail_filter_out = mail-filter-out %u } service mail-filter {  executable = script /usr/local/bin/mail-filter.sh  user = dovecot  unix_listener mail-filter {    mode = 0600    user = vmail  } } service mail-filter-out {  executable = script /usr/local/bin/mail-filter-out.sh  user = dovecot  unix_listener mail-filter-out {    mode = 0600    user = vmail  } } protocol lda {     mail_plugins = quota sieve expire autocreate mail_filter     auth_socket_path = /var/run/dovecot/auth-master     rejection_subject = Rejected: %s     lda_mailbox_autocreate = yes     lda_mailbox_autosubscribe = yes     sendmail_path = /usr/sbin/sendmail } cat mail-filter-out.sh #!/bin/sh cat > tempfile cat  mail-filter.sh #!/bin/sh USER=$1 cat > tempfile Some important Error logs： Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11)

2 1

mail_filter plugin: failed: EOF without input
by 刘莹莹 07 Feb '20

07 Feb '20

some import  configure: plugin {   mail_filter = mail-filter %u # %u = username given to the script as first   mail_filter_out = mail-filter-out %u } service mail-filter {  executable = script /usr/local/bin/mail-filter.sh  user = dovecot  unix_listener mail-filter {    mode = 0600    user = vmail  } } service mail-filter-out {  executable = script /usr/local/bin/mail-filter-out.sh  user = dovecot  unix_listener mail-filter-out {    mode = 0600    user = vmail  } } protocol lda {     mail_plugins = quota sieve expire autocreate mail_filter     auth_socket_path = /var/run/dovecot/auth-master     rejection_subject = Rejected: %s     lda_mailbox_autocreate = yes     lda_mailbox_autosubscribe = yes     sendmail_path = /usr/sbin/sendmail } cat mail-filter-out.sh #!/bin/sh cat > tempfile cat  mail-filter.sh #!/bin/sh USER=$1 cat > tempfile Some important Error logs： Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Error: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Info: msgid=<77z2kkfmm1-7846bu3tx6(a)nsmail6.0>: save failed to INBOX: Mailbox INBOX: Saving mail: write(/home/a.com/q1/storage/m.1) failed: EOF without input Feb 07 15:49:19 lda(q1(a)a.com)<53648><rY6oIH8WPV6Q0QAA0J78UA>: Debug: auth-master: conn unix:/var/run/dovecot/auth-master (pid=10651,uid=0): Disconnected: Connection closed (fd=11)

1 0

re: Dovecot - Upgrade Solr 7.7.2 to 8.4.1
by Francis Augusto Medeiros-Logeay 05 Feb '20

05 Feb '20

On 1/23/20 7:03 AM, Domenico Pastore wrote: >> So, with Dovecot is it possible to use Apache Solr 8.4? >> High RAM usage is the only problem? > I'm using 8.4.0 and it works flawlessly. I want to install fts-solr, but must tutorials are mentioning solr 7.7.0. Any heads-up on what one must pay attention to when installing 8.4.0? Do I need to update the version on the schemas, for example? Best, Francis

2 1

auth-client via SSL?
by Heiko Schlittermann 05 Feb '20

05 Feb '20

Hello, does dovecot support tls-on-connect for AF INET based auth-client sockets? Rationale behind my question: Exim can use the Dovecot auth-client socket to delegate the SMTP-AUTH authentication to Dovecot. Currently Exim supports the AF UNIX only for this socket. Jeremy makes progress in extending this to use AF INET sockets too. While it works with clear text communication already, during testing I was to setup the auch-client socket as an TLS server (tls-on-connect). It doesn't seem to work as I'd expect. The socket still offers clear-text only. Here my configuration snippets regarding this socket ssl = yes ssl_cert = </etc/dovecot/private/server.pem ssl_key = </etc/dovecot/private/server.pem service auth { … unix_listener auth-client { group = _exim mode = 0660 } inet_listener auth-client { name = exim port = 4711 ssl = yes } } SSL connections to :993 work as expected. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 3

Submission service, XCLIENT and HELO
by Riccardo Alfieri 04 Feb '20

04 Feb '20

Hello, I'm using version 2.3.4.1 and I have a fairly simple setup based on a submission server where I run dovecot and a relay server with postfix. The relevant part of dovecot's config is as follows (sanitized): hostname = submission.domain.local submission_client_workarounds = whitespace-before-path submission_relay_host = 192.168.1.1 <- postfix submission_relay_port = 25 submission_relay_trusted = yes Postfix is configured as follows: smtpd_authorized_xclient_hosts = 192.168.1.2 <- submission server Everything apparently works as expected, meaning that I can correctly authenticate on the submission server and the email is relayed to postfix, where I can see the original MUA's IP correctly logged. There is, however, a little problem with the client HELO string that is not being forwarded to postfix. Instead of having the MUA HELO, I see the submission server HELO, as shown in the following tcpdump taken on the postfix server: 220 postfix.domain.local ESMTP Postfix (Ubuntu) EHLO submission.domain.local 250-postfix.domain.local 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-STARTTLS 250-AUTH DIGEST-MD5 CRAM-MD5 NTLM PLAIN LOGIN 250-AUTH=DIGEST-MD5 CRAM-MD5 NTLM PLAIN LOGIN 250-XCLIENT NAME ADDR PROTO HELO REVERSE_NAME PORT LOGIN DESTADDR DESTPORT 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250 SMTPUTF8 XCLIENT ADDR=192.168.1.3 PORT=57116 LOGIN=riccardo-at-domain.local 220 postfix.domain.local ESMTP Postfix (Ubuntu) EHLO submission.domain.local 250-postfix.domain.local 250-PIPELINING ... As you can see the first EHLO is correctly done with the submission server's hostname, but the subsequent one after XCLIENT is -still- the same hostname, while I was expecting that to be the one forwarded from the MUA, or possibly a "HELO=somethingelse" in the XCLIENT line. I've looked almost everywhere and I couldn't find a way to make dovecot use the MUA's HELO string. The question I'm asking is if there is a way to have the MUA's HELO forwarded to the relay server in some way, or if this is a bug or an expected behaviour. Thanks for any help you could give -- Best regards, Riccardo Alfieri Spamhaus Technology https://www.spamhaustech.com/

1 0

Vacation use different SMTP server
by azurit＠pobox.sk 03 Feb '20

03 Feb '20

Hi, in our setup, we have two SMTP servers: - one for receiving messages (this one is using Dovecot's LMTP for delivery) - one for sending messages (this one is used by our users as outgoing SMTP server) Only the first one has list of local domains, local e-mail accoutns etc. so the second one will ALWAYS use MX records for delivery - with this setup, we can allow to our users to add any domain to their accounts (for example, if someone will add gmail.com and create e-mail accounts on it, it's complete safe because we will never deliver mail for gmail.com locally). The only problem seems to be vacation messages (maybe other messages send by sieve), as Dovecot is using the first SMTP server for sending. My questions: Can i set different SMTP server for sieve messages? How exactly is Dovecot/Sieve choosing which SMTP server will be used? Thanks. azur

3 6

mail_filter and mail_filter_out broken somewhere between 2.2.27 and 2.3.4, problem still exists in git
by Michael Fincham 03 Feb '20

03 Feb '20

Hi Dovecot folks, I recently reported this bug in Debian (https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=939442) after a stretch -> buster upgrade, however since I can reproduce it using the latest 2.4 from git I thought perhaps I ought to take it straight upstream. Here's the text I provided Debian about the issue, and below that I've included a syslog snip showing the same issue in a fresh build of git master as well. mail_filter_out seems to fully panic (backtrace below), whereas mail_filter is just behaving oddly. Thanks :) ***************************** Package: dovecot-core Version: 2.3.4.1-5+deb10u1 Severity: important Hi Dovecot maintainers, After upgrading from the latest stretch version of dovecot-core (2.2.27-3+deb9u5) to buster (2.3.4.1-5+deb10u1) the "mail filter" interface seems to have broken. This problem is also present in the sid version (2.3.7.2-1). Mail filter is used to run the content of messages being stored or retrieved through an arbitrary process. The interface used for the external process is described here: https://wiki.dovecot.org/Plugins/MailFilter It is expected that the process will be called with the arguments specified in the configuration then supplied a message body on stdin, however since upgrading it seems that the arguments are not being correctly passed, instead being all jammed in to $1 and separated by tabs, rather than expanded in to argv. Even stranger the first few lines of the body of the message appear in argv rather than in stdin... These reproduction steps were carried out on a fresh install of Debian Buster with the "dovecot-core" package installed initially from stretch then upgraded to the buster version, however this behaviour has also been observed on stretch systems after upgrading to buster. To reproduce, drop this minimalised config in to /etc/dovecot/conf.d/repro.conf: # Minimal maildir setup for LDA first_valid_uid = 0 mail_location = maildir:~/Maildir userdb { driver = static args = allow_all_users=yes uid=mail gid=mail home=/tmp/%u } # Mail filter configuration mail_plugins = $mail_plugins mail_filter plugin { mail_filter = mail-filter read %u mail_filter_out = mail-filter write %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh user = dovecot unix_listener mail-filter { mode = 0666 } } And create the example script in /usr/local/bin/mail-filter.sh with executable permissions: #!/bin/bash echo "arguments were: $@" 1>&2 tempfile=$(mktemp) cat > "${tempfile}" cat "${tempfile}" rm "${tempfile}" This script simply logs the arguments it recieves, writes stdin to a file then retrieves it again from the file. Here's a sample session of me using dovecot-lda to pass a message through this script, then retrieve it again with doveadm: root@scratch-b6fd8bdd:~# /usr/lib/dovecot/dovecot-lda -d fincham@scratch-b6fd8bdd -f 'Test <scratch-b6fd8bdd>' < /root/test.eml root@scratch-b6fd8bdd:~# doveadm fetch -u 'fincham@scratch-b6fd8bdd' hdr subject Test hdr: To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail root@scratch-b6fd8bdd:~# tail /var/log/syslog | grep mail-filter Sep 5 00:07:48 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write fincham@scratch-b6fd8bdd Sep 5 00:07:50 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: read fincham@scratch-b6fd8bdd However after upgrading dovecot to the buster version this process no longer works, and the logged argv of the example script is very strange: root@scratch-b6fd8bdd:~# apt dist-upgrade Reading package lists... Done Building dependency tree Reading state information... Done Calculating upgrade... Done The following NEW packages will be installed: liblua5.3-0 libsodium23 ssl-cert The following packages will be upgraded: dovecot-core [...] root@scratch-b6fd8bdd:~# /usr/lib/dovecot/dovecot-lda -d fincham@scratch-b6fd8bdd -f scratch-b6fd8bdd < /root/test.eml Aborted root@scratch-b6fd8bdd:~# doveadm fetch -u 'fincham@scratch-b6fd8bdd' hdr subject Test hdr: Hello! doveadm(fincham@scratch-b6fd8bdd): Error: Mailbox INBOX: UID=1: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) (read reason=mail stream) doveadm(fincham@scratch-b6fd8bdd): Error: Corrupted record in index cache file /tmp/fincham(a)scratch-b6fd8bdd/Maildir/dovecot.index.cache: UID 1: Broken physical size in mailbox INBOX: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) doveadm(fincham@scratch-b6fd8bdd): Error: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) doveadm(fincham@scratch-b6fd8bdd): Error: fetch(hdr) failed for box=INBOX uid=1: read() failed: Cached message size larger than expected (115 > 7, box=INBOX, UID=1) root@scratch-b6fd8bdd:~# tail /var/log/syslog | grep mail-filter Sep 5 00:07:48 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write fincham@scratch-b6fd8bdd Sep 5 00:07:50 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: read fincham@scratch-b6fd8bdd Sep 5 00:12:11 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write#011fincham@scratch-b6fd8bdd#011 To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail Sep 5 00:12:14 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: read#011fincham@scratch-b6fd8bdd#011 To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail -- Package-specific info: dovecot configuration --------------------- # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-5-cloud-amd64 x86_64 Debian 10.0 # Hostname: scratch-b6fd8bdd first_valid_uid = 0 mail_location = maildir:~/Maildir mail_plugins = " mail_filter" mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { mail_filter = mail-filter read %u mail_filter_out = mail-filter write %u } service mail-filter { executable = script /usr/local/bin/mail-filter.sh unix_listener mail-filter { mode = 0666 } user = dovecot } ssl = no userdb { driver = passwd } userdb { args = allow_all_users=yes uid=mail gid=mail home=/tmp/%u driver = static } -- System Information: Debian Release: 10.0 APT prefers stable-updates APT policy: (500, 'stable-updates'), (500, 'stable') Architecture: amd64 (x86_64) Kernel: Linux 4.19.0-5-cloud-amd64 (SMP w/2 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /usr/bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled Versions of packages dovecot-core depends on: ii adduser 3.118 ii libapparmor1 2.13.2-10 ii libbz2-1.0 1.0.6-9.1 ii libc6 2.28-10 ii libexttextcat-2.0-0 3.4.5-1 ii libicu63 63.1-6 ii liblua5.3-0 5.3.3-1.1 ii liblz4-1 1.8.3-1 ii liblzma5 5.2.4-1 ii libpam-runtime 1.3.1-5 ii libpam0g 1.3.1-5 ii libsodium23 1.0.17-1 ii libssl1.1 1.1.1c-1 ii libstemmer0d 0+svn585-1+b2 ii libwrap0 7.6.q-28 ii lsb-base 10.2019051400 ii openssl 1.1.1c-1 ii ssl-cert 1.0.39 ii ucf 3.0038+nmu1 ii zlib1g 1:1.2.11.dfsg-1 dovecot-core recommends no packages. Versions of packages dovecot-core suggests: pn dovecot-gssapi <none> pn dovecot-imapd <none> pn dovecot-ldap <none> pn dovecot-lmtpd <none> pn dovecot-lucene <none> pn dovecot-managesieved <none> pn dovecot-mysql <none> pn dovecot-pgsql <none> pn dovecot-pop3d <none> pn dovecot-sieve <none> pn dovecot-solr <none> pn dovecot-sqlite <none> pn dovecot-submissiond <none> ii ntp 1:4.2.8p12+dfsg-4 Versions of packages dovecot-core is related to: ii dovecot-core [dovecot-common] 1:2.3.4.1-5+deb10u1 pn dovecot-dev <none> pn dovecot-gssapi <none> pn dovecot-imapd <none> pn dovecot-ldap <none> pn dovecot-lmtpd <none> pn dovecot-managesieved <none> pn dovecot-mysql <none> pn dovecot-pgsql <none> pn dovecot-pop3d <none> pn dovecot-sieve <none> pn dovecot-sqlite <none> -- no debconf information ***************************** And here it is on 2.4 from git: Sep 5 02:18:10 scratch-b6fd8bdd dovecot: master: Dovecot v2.4.devel () starting up for imap, pop3, lmtp Sep 5 02:18:10 scratch-b6fd8bdd systemd[1]: Started LSB: Dovecot init script. Sep 5 02:18:12 scratch-b6fd8bdd dovecot: mail-filter: Error: arguments were: write#011fincham@scratch-b6fd8bdd#011 To: Test <fincham@scratch-b6fd8bdd> From: Test <fincham@scratch-b6fd8bdd> Subject: This is the test e-mail Sep 5 02:18:12 scratch-b6fd8bdd dovecot: lda(fincham@scratch-b6fd8bdd)<4213><94f8BWRwcF11EAAA/w3Ckw>: Panic: file ostream.c: line 201 (o_stream_flush): assertion failed: (stream->stream_errno != 0) Sep 5 02:18:12 scratch-b6fd8bdd dovecot: lda(fincham@scratch-b6fd8bdd)<4213><94f8BWRwcF11EAAA/w3Ckw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xef5fb) [0x7f85ed0715fb] -> /usr/lib/dovecot/libdovecot.so.0(+0xef661) [0x7f85ed071661] -> /usr/lib/dovecot/libdovecot.so.0(+0x4e808) [0x7f85ecfd0808] -> /usr/lib/dovecot/libdovecot.so.0(+0x52ec1) [0x7f85ecfd4ec1] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x96) [0x7f85ed1b24d6] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x4395) [0x7f85ed294395] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x82) [0x7f85ed189e52] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xd9) [0x7f85ed17c409] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x52) [0x7f85ed1aea02] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x4221) [0x7f85ed294221] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5c1bc) [0x7f85ed18a1bc] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1b0) [0x7f85ed295390] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x2f6) [0x7f85ed295ad6] -> /usr/libexec/dovecot/dovecot-lda(main+0x81b) [0x560cba869f4b] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7f85ecdde09b] -> /usr/libexec/dovecot/dovecot-lda(_start+0x2a) [0x560cba86a65a]

2 3

Sieve prevents tigger of quota-warning
by Tom Sommer 31 Jan '20

31 Jan '20

Hi All I have a few reports from Sieve users, that they are not receiving quota warnings. It appears that when a mailbox is reaching quota, and sieve is responsible for moving mail the mail due to a rule, the quota-warning directive is not triggered? It works fine if Sieve is not part of the flow, and lmtp is alone in handling mail saving. Does anyone have a fix or insights into this? 2.3.9.2 Thanks -- Tom

2 1

Split storage & solr
by Daniel Miller 30 Jan '20

30 Jan '20

Is it possible to setup the following: 1. Primary mailserver with SMTP solutions and Dovecot. 2. Primary server will store recent mails. 3. Secondary server for archival storage and Solr. So I'm not looking for a distributed cluster - simply a splitting of designated functions. Clients would only be connecting to the primary server. I know Dovecot supports an alternate storage location - that's what made me think this was possible. What I'm more uncertain of is Solr. My (probably flawed) thinking is to take advantage of a low-cost high-availability cloud server to provide primary email services. Dovecot, Postfix, and even ASSP don't have significant memory or processor requirements by themselves - especially for my smaller user base. However - storage in the cloud can be at a premium. Therefore I'm thinking of continuing to self-host the archives. And my own server has the raw power & memory to handle Solr easily. What's triggering this is our ISP's quality has been deteriorating - and the alternates don't appear much better. Initial visualization would have a VPN/SSH connection between the servers, and NFS mounting my storage to the cloud server for archives. If our connection drops - in theory "current" mail handling is unaffected. My concerns/questions: 1. If Dovecot is unable to reach the remote Solr - upon re-connection will Solr be told about the new messages to index? Or do I need to setup a periodic re-scan? 2. Is there a "better" method of accessing the archive storage area than NFS? Either a different network file system or is there a way to do it with Dovecot directly? 3. What am I not taking into consideration in this setup that you think will be a problem? --- Daniel

2 1

IMAP compatible Notes app for Android
by Rupert Gallagher 29 Jan '20

29 Jan '20

Hello! Please share your favourite open-source Notes app for Android, as I am struggling to find one compatible with IMAP. Thank you, and happy 2020!

2 2

imap panic: file array.c: line 10 (array_idx_modifiable_i)
by mabi 29 Jan '20

29 Jan '20

Hello, I just migrated a few dovecot IMAP mailbox (Maildir format) from a Dovecot 2.1.7 (Debian 7) mailbox server to a Dovecot 2.3.4 (Debian 10) mailbox server and one particular mailbox does not work properly and generates the following error log entries: Jan 21 09:39:21 Panic: imap(EMAIL_ADDRESS)<7741><UTsrWKKcasoAAAAAAAAAAAAAAAAAAAAB>: file array.c: line 10 (array_idx_modifiable_i): assertion failed: (idx * array->element_size < array->buffer->used) Jan 21 09:39:21 Error: imap(EMAIL_ADDRESS)<7741><UTsrWKKcasoAAAAAAAAAAAAAAAAAAAAB>: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xdb15b) [0x7fa18def215b] -> /usr/lib/dovecot/libdovecot.so.0(+0xdb1f1) [0x7fa18def21f1] -> /usr/lib/dovecot/libdovecot.so.0(+0x4a001) [0x7fa18de61001] -> /usr/lib/dovecot/libdovecot.so.0(+0x493bf) [0x7fa18de603bf] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xde920) [0x7fa18e084920] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x22f) [0x7fa18e096a3f] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x85b4b) [0x7fa18e02bb4b] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x8862a) [0x7fa18e02e62a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x88937) [0x7fa18e02e937] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xa3) [0x7fa18e02ece3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x57) [0x7fa18e002497] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](imap_sync_init+0x91) [0x563d342e16e1] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](cmd_sync_delayed+0x236) [0x563d342e25f6] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](client_handle_input+0x268) [0x563d342d58f8] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](client_input+0x7e) [0x563d342d5d6e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7fa18df0860f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x136) [0x7fa18df09c06] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7fa18df086ac] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fa18df08810] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fa18de88fd3] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](main+0x325) [0x563d342c7bf5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7fa18dc7309b] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](_start+0x2a) [0x563d342c7d8a] Jan 21 09:39:21 Fatal: imap(EMAIL_ADDRESS)<7741><UTsrWKKcasoAAAAAAAAAAAAAAAAAAAAB>: master: service(imap): child 7741 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) Does anyone have any idea what could be going wrong here? Maybe I need to run some kind of conversion or re-generate some indexes? Best regards, Mabi

3 10

Emails in Public folders aren't showing up in Outlook
by Barry Ralphs 29 Jan '20

29 Jan '20

Hi, I've inherited our Devocot setup from someone else & don't know much about it. I can view our Public email folders fine in Thunderbird, but when I try it with Outlook 2013, I can see the folder structure fine, but when I click on a folder it doesn't show any emails. Here's a screen shot of Outlook: https://imgur.com/CHIDJOr And Thunderbird: https://imgur.com/WxmsUTM Here's the version info & config output: # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1062.1.1.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) ext4 # Hostname: nikola auth_mechanisms = plain login auth_verbose = yes debug_log_path = syslog disable_plaintext_auth = no info_log_path = syslog mail_location = maildir:/home/%n/Maildir mbox_write_locks = fcntl namespace TMpublic { location = maildir:/iscsi/public/Maildir:INDEX=~/Maildir/public/index prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } Any suggestions on how to get the Public folders to show the emails in Outlook? Thanks for the help.

1 0

error: include: personal location for included script `foo is unavailable
by Rudolf Schmidt 28 Jan '20

28 Jan '20

Hi, I want to split my active script into smaller chunks but I have issues with the include directive. My doveconf -n is # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: Linux 5.1.15-arch1-1-ARCH x86_64 Arch Linux auth_mechanisms = plain login auth_verbose = yes mail_location = maildir:~/mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext passdb { args = scheme=plain /etc/dovecot/plain.pwd driver = passwd-file } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service stats { unix_listener stats-writer { mode = 0777 } } ssl = required ssl_cert = </etc/letsencrypt/live/domain.com/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail home=/var/mail/virtual/%Ld/%Ln driver = static } protocol lmtp { mail_plugins = " sieve" postmaster_address = rs@domain } I have a script vendors.sieve that I put into ~/sieve (my mails I store in ~/mails) and it does not find the script. include :personal "vendors"; Any ideas? -- Best Regards, Mit freundlichen Grüßen, Rudolf Schmidt

1 1

dict passdb: redis nil values
by Eirik Rye 28 Jan '20

28 Jan '20

Hi, I am trying to implement a dict lookup for disabled accounts, where both the passdb lookup and the disabled lookup is done in the same passdb. I was hoping that this configuration would work: passdb { name = redis driver = dict args = /etc/dovecot/dovecot-redis.conf.ext } --- uri = redis:host=127.0.0.1 key disabled { key = users/%u/disabled/%s format = value default_value = } key user { key = users/%u format = json } passdb_objects = user passdb_fields { fail = %{dict:disabled} } Unfortunately, this will always set the fail passdb_field regardless of whether the disabled key returns its empty default_value. Removing the default_value setting will cause the passdb lookup to fail if key lookup fails, as mentioned in the documentation. Is there a way to have the dict driver handle redis nil values similarly to how the sql driver handles NULL values? A working alternative I found is to set an invalid password if the disabled key is set: passdb_fields { password = %{if;%{dict:disabled};eq;;%{dict:user.password};} } However, this feels hacky. It also makes the auth-worker to log the following error (despite it being functional): dovecot: auth-worker(16229): Error: redis(test,127.0.0.1,<Kd3zJDOdfs1/AAAB>): Multiple password values not supported Any other suggestions, or should I simply fall back to using a separate passdb with deny=yes? Best regards, Eirik

1 0

Dovecot authentication through proxy
by Daniel Niewerth 28 Jan '20

28 Jan '20

Hi everybody, I run two redundant Dovecot servers with a shared Maildir on a GlusterFS volume and a SQL authentication backend based on a mirrored MariaDB database. Because of the splitbrain situation I would like to add two Dovecot Director as proxies. Since a few days I am trying to get the setup running. In the meantime I have achieved that the clients can successfully authenticate on the proxy and that the client connections are forwarded to the backend servers. Unfortunately I still have the problem that no authentication attempts are made on the backend servers. Can someone explain me how to solve this problem? I have read that it is eventually possible to work with Master Users. But I guess that won't work for me, because I use the mailcrypt plugin and the client password is also the password for the encryption key. Best regards Daniel ### Proxy Log ### ############### Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth-worker(20760): Debug: sql(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): Finished passdb lookup Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth-worker(20760): Debug: conn unix:auth-worker (pid=20753,uid=112): auth-worker<1>: Finished Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: sql(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): username changed ***(a)***.** -> *** Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: sql(***,192.168.1.100,<sNTHFdOcbeDAqAFk>): username changed *** -> ***(a)***.** Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: sql(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): Finished passdb lookup Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: auth(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): Auth request finished Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: client passdb out: OK#0111#011user=***@***.**#011proxy#011ssl=any-cert#011starttls=any-cert#011lip=192.168.20.49#011lport=993#011pass=<hidden> Jan 23 19:48:21 vsrv-***-prx01 dovecot: imap-login: Debug: Ignoring unknown passdb extra field: lip Jan 23 19:48:21 vsrv-***-prx01 dovecot: imap-login: Debug: Ignoring unknown passdb extra field: lport ### Backend Log ### ################### Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<r9yRF9OcZODAqBQx> Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<4C+SF9OcauDAqBQx> Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<KDGSF9OcZuDAqBQx> Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<lwKTF9OcbuDAqBQx> ### Proxy Config ### #################### # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # OS: Linux 4.15.0-74-generic x86_64 Ubuntu 18.04.3 LTS # Hostname: vsrv-***-prx01 auth_debug = yes director_mail_servers = 192.168.20.28 192.168.20.29 director_servers = 192.168.20.49:9090 192.168.20.58:9090 disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } passdb { driver = pam } protocols = " imap" service director { inet_listener { port = 9090 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service pop3-login { executable = pop3-login director } ssl = required ssl_cert = </etc/dovecot/private/***-**-fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECDH:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kE$ ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { auth_socket_path = director-userdb } ### Backend Config ### ###################### # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: Linux 4.15.0-72-generic x86_64 Ubuntu 18.04.3 LTS # Hostname: vsrv-**-mta01.**.**.***.** auth_debug = yes auth_mechanisms = plain login mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_fsync = always mail_gid = vmail mail_home = /var/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify mail_crypt" mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_crypt_curve = brainpoolP512r1 mail_crypt_require_encrypted_user_key = # hidden, use -P to show it mail_crypt_save_version = 2 quota = maildir:User quota quota_exceeded_message = Benutzer %u hat das Speichervolumen überschritten. / User %u has exhausted allowed storage space. sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-script.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = required ssl_cert = </etc/letsencrypt/live/******/fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECDH:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 20 mail_plugins = " notify mail_crypt quota imap_quota imap_sieve" } protocol lmtp { mail_plugins = " notify mail_crypt sieve" postmaster_address = postmaster(a)***.** } -- This email was Malware checked by vsrv-dus6-fwl01

2 2

Number of imap-login processes always keeps growing, never goes down
by Jasper Siepkes 26 Jan '20

26 Jan '20

Hi all! I've bumped into an issue which Dovecot which has me a bit stumped; All of a sudden (ie. no obvious changes made to the config as far as I know) Dovecot seems to never stop 'imap-login' processes. This continues to the point where it will hit the 'process_limit'. For a 50-ish user install the limit was set to 100 but I increased it to 512. The only thing this changes it that Dovecot takes a little longer to hit the limit. I started having this problem with Dovecot version 2.3.2.1. After which I updated to the latest version of Dovecot (2.3.9.2) to see if that would fix my problem. However I'm still experiencing the same issue. For a bit of context; We use Dovecot with Open-Xchange where users login via OIDC, get a token and then use that token with Dovecot with the 'oauthbearer' auth method. However users can also login via a username / password combo stored in LDAP for clients that don't support 'oauthbearer' (ie. about all the mail clients ;-). We run Dovecot on SmartOS (ie. Illumos, a Solaris derivative). Oddly enough 'doveadm' is under the impression there are only 3 users loggedin (when there are 512 imap-login processes). I think 'doveadm who' doesn't show users who are authenticated via an token (oauthbearer) because I only see 3 users and I don't see my own user which is logged in via Open-Xchange by using oauthbearer as auth method. I've anonimized the output but you get the idea: ----8<-------------------- # doveadm who username # proto (pids) (ips) foo1(a)foo.nl 2 imap (78393 78391) (52.XXX.XXX.XXX) foo2(a)foo.nl 2 imap (72548 72547) (52.XXX.XXX.XXX) foo3(a)foo.nl 2 imap (480893 481231) (54.XXX.XXX.XXX 54.XXX.XXX.XXX) ----8<-------------------- I don't know if the above issue is related to my problem but the oauthbearer sessions not showing up seems like a bug? Meanwhile there are 512 Dovecot imap-login processes: ----8<-------------------- # ptree | grep imap-login | wc -l 513 ----8<-------------------- I realise that the 'imap-login' process also works as a IMAP proxy and that it stays alive during the entire session of the client since it handles the TLS part of the connection. However there are nowhere near 512 connections active. As far as I know IMAP doesn't support multiplexing (ie. multiple IMAP sessions in a single TCP connection) so with 512 imap-login proccess I would expect to see a lot more connections then I'm seeing: ----8<-------------------- # netstat -a TCP: IPv4 Local Address Remote Address Swind Send-Q Rwind Recv-Q State -------------------- -------------------- ------ ------ ------ ------ ----------- *.ssh *.* 0 0 1048576 0 LISTEN dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.53136 178176 0 1049580 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.53188 126848 0 1049580 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 83.XXX.XXX.XXX.64845 132352 0 1048960 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.7937 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.3.4983 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.34369 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.3.15041 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.49044 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.3.6340 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.11331 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.49920 94976 0 1049580 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.58569 10.100.3.84.ldap 1049792 0 1049800 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.33749 10.100.3.84.ldap 1049792 0 1049800 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.49966 46464 0 1049580 0 ESTABLISHED *.4190 *.* 0 0 1048576 0 LISTEN *.24 *.* 0 0 1048576 0 LISTEN *.imap2 *.* 0 0 1048576 0 LISTEN *.imaps *.* 0 0 1048576 0 LISTEN dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps ec2-54-210-254-232.compute-1.amazonaws.com.32892 107904 0 1049800 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.ssh 10.101.2.14.59256 64128 35 1049880 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps ec2-54-167-34-137.compute-1.amazonaws.com.3890 549632 0 1049800 0 ESTABLISHED TCP: IPv6 Local Address Remote Address Swind Send-Q Rwind Recv-Q State If --------------------------------- --------------------------------- ------ ------ ------ ------ ----------- ----- *.ssh *.* 0 0 1048576 0 LISTEN Active UNIX domain sockets Address Type Vnode Conn Local Address Remote Address ----8<-------------------- This is the running Dovecot config: ----8<-------------------- # doveconf -n -c /etc/dovecot/dovecot.conf # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: SunOS 5.11 i86pc # Hostname: dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl auth_failure_delay = 3 secs auth_mechanisms = plain oauthbearer xoauth2 base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 1000 hostname = imap.supersecretcorp.nl instance_name = dovecot-1 listen = * lmtp_rcpt_check_quota = yes log_path = /dev/stderr mail_attachment_dir = /var/lib/dovecot/attachments mail_attachment_fs = sis-queue /var/lib/dovecot/attachments/queue:posix mail_attachment_hash = %{sha256} mail_attribute_dict = file:~/mdbox/dovecot-attributes mail_gid = vmail mail_home = /var/lib/dovecot/vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = " quota notify" mail_server_admin = mailto:it@ask.supersecretcorp.nl mail_temp_dir = /var/lib/dovecot/tmp mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext metric imap_command_fetch_ok { event_name = imap_command_finished filter { name = FETCH tagged_reply_stat = OK } } metric imap_command_list { event_name = imap_command_finished filter { name = LIST tagged_reply_state = OK } } metric imap_command_search { event_name = imap_command_finished filter { name = SEARCH tagged_reply_stat = OK } } metric imap_command_select { event_name = imap_command_finished filter { name = SELECT tagged_reply_state = OK } } metric imap_select_no { event_name = imap_command_finished filter { name = SELECT tagged_reply_state = NO } } metric imap_select_no_notfound { event_name = imap_command_finished filter { name = SELECT tagged_reply = NO*Mailbox doesn't exist:* } } metric storage_http_gets { categories = storage event_name = http_request_finished filter { method = get } } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox "Sent objects" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-oauth2.conf.ext driver = oauth2 mechanisms = oauthbearer xoauth2 } passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { push_notification_driver = ox:url=http://#hidden_use-P_to_show#@open-xchange.svc.sp-prod.nl1.cns.supersecretcorp.nl:8009/preliminary/http-notify/v1/notify user_from_metadata quota = count:User quota quota_rule2 = Trash:storage=+25M quota_vsizes = yes sieve = file:~/sieve;active=~/.dovecot.sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_quota_max_scripts = 500 sieve_quota_max_storage = 10M sieve_vacation_send_from_recipient = yes } postmaster_address = postmaster(a)supersecretcorp.nl protocols = imap lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = vmail mode = 0770 user = dovecot } user = $default_internal_user } service imap-login { process_limit = 512 process_min_avail = 1 service_count = 1 } service imap { process_limit = 512 } service lmtp { inet_listener lmtp { address = * port = 24 } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 } service managesieve { process_limit = 256 } service stats { unix_listener stats-reader { group = vmail mode = 0660 user = vmail } unix_listener stats-writer { group = vmail mode = 0660 user = vmail } } ssl_client_ca_dir = /opt/local/etc/openssl/certs ssl_dh = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 submission_host = postfix.svc.sp-prod.nl1.cns.supersecretcorp.nl:25 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_plugins = " quota notify imap_quota" ssl_cert = </etc/dovecot/pki/imap.supersecretcorp.nl.crt ssl_key = # hidden, use -P to show it } protocol submission { ssl_cert = </etc/dovecot/pki/smtp.supersecretcorp.nl.crt ssl_key = # hidden, use -P to show it } protocol lmtp { mail_plugins = quota sieve notify push_notification postmaster_address = postmaster(a)supersecretcorp.nl } remote 10.100.2.0/23 { protocol imap { imap_metadata = yes } } ----8<-------------------- Hoping anyone can offer any insights! Kind regards, Jasper

1 0

Lookup master userdb used with GSSAPI causes auth-worker to report "Error: BUG: PASSL had invalid passdb ID"
by Filip Matijević 25 Jan '20

25 Jan '20

Hello to everybody, I'm in the process of setting up test mail server (Ubuntu 19.10 amd64 running as VM under Hyper-V) and got stuck on configuring master user authentication. I use GSSAPI authentication in parallel with PLAIN/LOGIN (pam backend that authenticates against my Active Directory domain) and this works as intended. I then tried adding simple static master passdb that simply returns nopassword='y' and k5principals=... for test and it also works OK. Sadly, using any other backend (I've tried lua and sql) for master passdb instead of static in combination with GSSAPI client causes auth-worker to report "Error: BUG: PASSL had invalid passdb ID". I took a look at the code and my best guess is that in case of GSSAPI + sql/lua master passdb we end up with call to auth_worker_handle_passl with id that auth_worker_handle_passl considers invalid. Continuing with guesswork, I imagine that since GSSAPI doesn't really need passdb in config "virtual" passdb is generated "on the fly" in code. I even tried explicitly defining static passdb with mechanisms set to gssapi to try to force dovecot to use that one instead but it didn't make any difference. At the same time, below configuration works OK when client authenticates with plain/login. dovecot -n (some settings omitted for brevity): # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = * auth_mechanisms = plain login gssapi passdb { args = /etc/dovecot/dovecot-sql-master.conf driver = sql master = yes } passdb { driver = pam } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } Any help is appreciated, even if it requires code changes - I can set up machine with everything needed for building/debugging the source code. Thanks, Filip

1 0

sieve size match with multiple of 4GB not matching (BUG?)
by Matthias Lay 24 Jan '20

24 Jan '20

Hi, I have noticed a strange behaviour when using size matches with GB in sieve. If I use filter that matches mails smaller then 4, or 8GB it does not match in any case. same filter matches with 3,5,6,7 GB example filter: require "vnd.dovecot.debug"; if allof (size :under 4G) { debug_log "MATCH"; } else { debug_log "NO MATCH"; } # sieve-filter -u johnd filter.sieve INBOX >> Filtering message: ID: <5167DFC8.8040207@XXXXXX> Date: Fri, 12 Apr 2013 12:19:52 +0200 Size: 1820898 bytes Subject: Fwd: Multi-media mail demonstration info: DEBUG: NO MATCH. ************************************************************************** same mail with this sieve rule: if allof (size :under 5G) { debug_log "MATCH"; } else { debug_log "NO MATCH"; } # sieve-filter -u johnd filter.sieve INBOX >> Filtering message: ID: <5167DFC8.8040207@XXXXXX> Date: Fri, 12 Apr 2013 12:19:52 +0200 Size: 1820898 bytes Subject: Fwd: Multi-media mail demonstration info: DEBUG: MATCH. same for M. 4096M => NO MATCH 4097M => MATCH Greetz Matze

1 0

Re: Namespace problem? duplicated folders...
by Daniel Miller 24 Jan '20

24 Jan '20

And I should have seen that from your first post but output from "doveconf" is definitive. -- Daniel On 1/23/2020 6:57 PM, Daniel Miller wrote: > Keeping in mind I'm 0% Dovecot certified and 100% certifiable... > > I'm guessing you have your namespace definition separate from your > special-use mailbox declarations. Possibly in 10-mail.conf and > 15-mailboxes.conf? Not that it matters. > > First sugggestion - that first namespace definition. Change it from: > > namespace { > > to > > namespace inbox { > > and see what happens. > > -- > Daniel > > > On 1/23/2020 4:40 PM, Gregory Sloop wrote: >> >> >> *DM> Interesting. >> >> DM> While I don't use mbox (dbox or maildir) I wouldn't think that would >> DM> matter. Your namespace layout looks nearly the same as my own. But to >> DM> verify what's going on - post the output of "doveconf namespace". >> >> DM> Possibly just reviewing that output may tell you enough - otherwise >> DM> share it (fully) here. >> >> DM> -- >> DM> Daniel >> >> *namespace { >> disabled = no >> hidden = no >> ignore_on_failure = no >> inbox = yes >> list = yes >> location = >> order = 0 >> prefix = INBOX/ >> separator = / >> subscriptions = yes >> type = private >> } >> namespace inbox { >> disabled = no >> hidden = no >> ignore_on_failure = no >> inbox = no >> list = yes >> location = >> mailbox Drafts { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Drafts >> } >> mailbox Junk { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Junk >> } >> mailbox Sent { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Sent >> } >> mailbox Trash { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Trash >> } >> order = 0 >> prefix = >> separator = >> subscriptions = yes >> type = private >> } >> > >

1 0

wrong Messages in virtual Folder
by Frank-Ulrich Sommer 24 Jan '20

24 Jan '20

Hello, I created a virtual Folder that should contain all Mails from several different Folders and their subfolders. Recently I added a new folder to the dovecot-virtual file and then found that most Mails from this folder were missing. I always restartet dovecot (is this necessary?) after any change. The system is running Debian Stretch and I am using the supplied dovecot 2.2.7 (see below for output of doveconf -n). To narrow this down I removed all other directories from the dovecot-virtual file and then found that the number of mails is correct, but most mails are the wrong ones from other directories. The dovecot-virtual file currently contains only the source directory and in the last line 4 spaces followed by the keyword "all" and a newline. Mails that where moved there after the directory was added to the virtual folder seemed to be displayed correct. If I move one Mail away from the source diectory a totally different Mail in the virtual Folder disappers. After moving the file back to the source folder it correctly appears in the virtual folder. What might be the cause and how can I fix it? Thanks, Frank Output of "doveconf -n": # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 zfs auth_verbose = yes log_path = /var/log/dovecot.log mail_location = maildir:/home/bananamail/Maildir:INDEX=/var/dovecot_indexes/%u mail_plugins = " virtual fts fts_solr" mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { location = virtual:~/Maildir/virtual prefix = _virtual. separator = . type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { fts = solr fts_autoindex = yes fts_enforced = yes fts_solr = break-imap-search url=http://localhost:8080/solr/ sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster@localhost protocols = imap service imap-login { inet_listener imaps { port = XXXX ssl = yes } } ssl = required ssl_cert = <XXXXXXXXX/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!SSLv3:!EXP:!aNULL ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !TLSv1 userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol imap { mail_max_userip_connections = 200 }

1 0

intermittant passdb error
by NeuralNET 23 Jan '20

23 Jan '20

I'm having great difficulty debugging this problem.. I'm having intermittant problems connecting to dovecot. This started a couple of days ago following an apt-get update on the server. I'm running Ubuntu 14.04, dovecot 2.2.9. Here's my dovecot -n --- # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.19.0-59-generic x86_64 Ubuntu 14.04.4 LTS auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve_dir = ~/sieve } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } user = $default_internal_user } ssl = required ssl_cert = </etc/dovecot/box.neuralnet.org.uk_crt.pem ssl_key = </etc/dovecot/box.neuralnet.org.uk_key.pem ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } --- Pretty standard stuff. In addition disable_plaintext_auth = yes is set in 10-auth.conf This showed up in the mail.err after the reboot; --- May 17 09:04:51 server dovecot: imap-login: Error: read(anvil) failed: EOF May 17 09:04:51 server dovecot: auth: Error: read(anvil-auth-penalty) failed: EOF May 17 09:04:51 server dovecot: auth: Error: net_connect_unix(anvil-auth-penalty) failed: Permission denied --- At that point The following commands were run on the server a few minutes apart with no changes made in the interim; --- username@box /etc/dovecot $ doveadm user username field valueuserdb lookup: user username doesn't exist username@box /etc/dovecot $ doveadm user username field value uid 1000 gid 1000 home /home/username mail maildir:~/Maildir system_groups_user username --- so, passdb wasn't accessible, but now it is ? Imap logins are showing in mail.log as failing, but thunderbird is currently connected; --- May 18 12:00:58 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 19 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> May 18 12:08:27 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 20 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> May 18 12:08:50 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 12 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> --- do I conclude that method=plain is failing, whereas method=login succeeds ? I tried setting auth_debug_password=yes and get the following; --- May 18 12:26:42 box dovecot: auth: Debug: client in: CONT#0111#011A********== (previous base64 data may contain sensitive data) May 18 12:26:42 box dovecot: auth-worker(12214): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth May 18 12:26:42 box dovecot: auth-worker(12214): Debug: pam(expert,10.0.0.3): lookup service=dovecot May 18 12:26:42 box dovecot: auth-worker(12214): Debug: pam(expert,10.0.0.3): #1/1 style=1 msg=Password: May 18 12:26:42 box dovecot: auth-worker(12211): pam(username,10.0.0.3): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: ******) May 18 12:26:44 box dovecot: auth: Debug: client passdb out: FAIL#0112#011user=username --- Any assistance debugging this further is greatly recieved! Thanks.

2 2

Bug: Regex doesn't match ungreedy
by Lorenz Steinert 23 Jan '20

23 Jan '20

Hello, first the mandatory dovecot specs: - dovecot 2.3.9.2-1 - Operating system: Archlinux - x84 cpu - ext4 filesystem My problem is that the sieve regex filter doesn't seem to match ungreedely so the regex: ^(Re: |)\\[(.*?)\\/(.*?)\\] evaluates the last capturing group of [matrix-org/synapse] [Don't merge!!] Backport fix for MAU limits to v1.8.0 (#6763) to synapse] [Don't merge!! wich should have been synapse Best Regards Lorenz Steinert

2 1

Is it possible to enable push notifications for iOS/macOS mail clients on a stock dovecot?
by Gerben Wierda 23 Jan '20

23 Jan '20

Now that Apple has abandoned mail server capabilities in macOS Server.app we have to move to an open source solution. I have done this using Macports and it works well (no thanks to Apple as it never published the in 2018 promised migration info for mail services). The MacPorts Apple Push Notification variant based on a patch written a few years ago for dovecot supports APNS but it requires you to export a certificate form your old High Sierra Server.app. With the patch and that certificate, dovecot tells an email client it supports XAPPLEPUSHSERVICE and that makes Apple mail clients think they are talking to macOS Server and they switch to push notifications for updates. Now, that certificate needs to be renewed yearly by Server.app and imported by hand etc. At some point this will stop working (apart from that you need to keep an old macOS Server around to renew) Is there another way to get this working with an open source dovecot, outside of using Apple’s push notification service? Some other standard? Some other service? Probably not, right? G

5 5

Using dsync for a single mailbox?
by Wim Lewis 23 Jan '20

23 Jan '20

Is it possble to use `doveadm sync` to migrate a single mailbox? I'm migrating accounts from another IMAP server,and most of the mailboxes are in mbox or maildir format, but a few are in MBX. As far as I can tell the only recommended way to "convert" an MBX mailbox is to sync it via imap. But dsync fails in inscrutable ways, and the documentation is kind of scant on how to control what it does. Even just an example command line showing how to copy remote mailbox FOO into dovecot mailbox BAR would be extremely helpful.

2 4

Dovecot - Upgrade Solr 7.7.2 to 8.4.1
by Domenico Pastore 23 Jan '20

23 Jan '20

Hello, I have Dovecot configured with Solr for the indexes. I have need your support for upgrade solr 7.7.2 to 8.4.1. Solr 7.7.2 has a security issue CVE-2019-12409. It's possible upgrade of Solr? Dovecot work correctly with Solr 8.x? The Solr documentation recommended after updating: "It is always strongly recommended that you fully reindex your documents after a major version upgrade." There are tips for Dovecot? Br, Domenico

4 4

Re: JMAP support in Dovecot
by Mike Gao 22 Jan '20

22 Jan '20

Hi, Any news for jmap Support in Dovecot? Thanks, Mike

1 0

socket dovecot-lmtp is not created anymore
by ratatouille 22 Jan '20

22 Jan '20

Hello! Since experiments on my testserver two days ago /var/spool/postfix/private/dovecot-lmtp is not created anymore. This the setting in /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } I searched nearly the whole system for lmtp but can't find the reason why. What can I do? Debug? Andreas

2 2

Cached message size smaller than expected
by Asai 21 Jan '20

21 Jan '20

Greetings, Can anyone help me to solve this problem? When doveadm sync is running nightly, we have a certain user's mailbox that will not properly sync and the logs give me this error (user private info redacted): Error: Mailbox USER/MAILBOX: UID=79: read(/vmail/domain.org/user/.MAILBOX/cur/1575914253.M611834P7822.triata4,S=… failed: Cached message size smaller than expected (41893 < 41897, box=USER/MAILBOX, UID=79) (read reason=mail stream) I have deleted the dovecot indexes in the synced backup of this mailbox, as well as in the actual user's mailbox itself and I'm still getting this error. What am I missing? Thank you for your help here. -Asai

2 2

Dovecot and archived compressed folder
by filbar＠centrum.cz 21 Jan '20

21 Jan '20

Hello, I have large of archive mails which I access occasionally. Is it possible to have in dovecot in user account archive folder which is compressed to save disk space? Thank's Filip Bartmann

2 2

Getting an extprogram script to work
by Eric Abrahamsen 21 Jan '20

21 Jan '20

Hi all, I'm trying to do the same thing everyone else is: having rspamd learn_ham or learn_spam depending on where I move a message. My current problem is that Dovecot seems to be reporting success, but nothing ever happens -- the script somehow fails to run. I'm currently using a dummy script that just writes a file to /tmp, until I can get this much working, at least. My bin_dir: --------------------- me@server:/usr/lib/dovecot/sieve# ls -l total 40 drwxr-xr-x 2 root root 4096 Jan 21 03:35 ./ drwxr-xr-x 4 root root 12288 Aug 29 06:28 ../ -rw-r--r-- 1 root root 112 Jan 21 02:17 report-ham.sieve -rw-r--r-- 1 root root 250 Jan 21 02:17 report-ham.svbin -rw-r--r-- 1 root root 112 Jun 3 2019 report-spam.sieve -rw-r--r-- 1 root root 258 Jun 3 2019 report-spam.svbin -rwxr-xr-x 1 root root 105 Jan 21 03:35 rspamd_ham.sh* -rwxr-xr-x 1 root root 43 Jun 3 2019 rspamd_spam.sh* --------------------- Then the report-ham.sieve script: --------------------- require ["vnd.dovecot.pipe", "copy", "imapsieve", "fileinto"]; pipe :copy "rspamd_ham.sh"; #fileinto "INBOX"; --------------------- And the dummy rspamd_ham.sh script: --------------------- #!/bin/bash #exec /usr/bin/rspamc learn_ham tim=`date +%M-%S` echo "${1}" > "/tmp/${tim}_results.txt" --------------------- I can confirm the above script works correctly when run from the command line, both as root and the vmail user. When run as part of the sieve process, no errors are reported, but no file is created under /tmp. From the logs: --------------------- Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.4.21 (92477967) loaded ... Debug: learn/ham: Mailbox opened because: SELECT Debug: imapsieve: mailbox learn/ham: APPEND event Debug: imapsieve: Matched static mailbox rule [1] Debug: sieve: file storage: Using Sieve script path: /usr/lib/dovecot/sieve/report-ham.sieve Debug: sieve: file script: Opened script `report-ham' from `/usr/lib/dovecot/sieve/report-ham.sieve' Debug: sieve: Opening script 1 of 1 from `/usr/lib/dovecot/sieve/report-ham.sieve' Debug: sieve: Loading script /usr/lib/dovecot/sieve/report-ham.sieve Debug: sieve: Script binary /usr/lib/dovecot/sieve/report-ham.svbin successfully loaded Debug: sieve: binary save: not saving binary /usr/lib/dovecot/sieve/report-ham.svbin, because it is already stored Debug: sieve: Executing script from `/usr/lib/dovecot/sieve/report-ham.svbin' Debug: sieve: action pipe: running program: rspamd_ham.sh Debug: Mailbox learn/ham: Opened mail UID=249 because: mail stream Debug: waiting for program `/usr/lib/dovecot/sieve/rspamd_ham.sh' to finish after 0 msecs sieve: pipe action: piped message to program `rspamd_ham.sh' Debug: learn/ham: Mailbox opened because: lib-lda delivery sieve: left message in mailbox 'learn/ham' --------------------- Near as I can tell, the first time this runs after a dovecot restart, I get this error instead: Error: write(program stdin) failed: Broken pipe Error: sieve: pipe action: failed to program `rspamd_ham.sh': refer to server log for more information. But that only happens once, then it behaves as above. The "Opened mail UID=XXX" bit changes UID (increments monotonically?) every time. I think that ought to be everything but my dovecot -n. Thanks in advance for any help. # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1057-aws x86_64 Ubuntu 18.04.3 LTS ext4 auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_home = /var/mail/vmail/%d/%n mail_location = maildir:/var/mail/vmail/%d/%n/mail:LAYOUT=fs mail_plugins = " quota" mail_prefetch_count = 20 mail_privileged_group = mail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=ssha512 username_format=%u /etc/dovecot/passwd.db driver = passwd-file } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox1_causes = APPEND imapsieve_mailbox1_name = learn/ham quota_rule = *:storage=5G quota_rule2 = Trash:ignore quota_rule3 = Junk:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-auth { mode = 0666 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } ssl = required ssl_cert = </etc/letsencrypt/live/cert-deleted ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL:RC4+RSA:+HIGH:+MEDIUM ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/passwd.db default_fields = uid=vmail gid=vmail home=/var/mail/vmail/%d/%n driver = passwd-file } protocol lmtp { mail_plugins = " quota sieve" postmaster_address = postmaster(a)ericabrahamsen.net } protocol lda { deliver_log_format = msgid=%m: %$ } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = " quota imap_quota imap_sieve" }

1 0

solr fts and removing accounts
by Wojciech Puchar 20 Jan '20

20 Jan '20

i use solr fts indexing. It worls very well but it have one database per system, not per user. Lets suppose i delete one or more e-mail users in system. How to remove them in solr database to reclaim space?

3 2

Authentication per Service
by Oliver Welter 18 Jan '20

18 Jan '20

Hi All, I use dovecot (v2.3.4) with a SQL backend for user authentication, passwords are stored in CRAMMD5 format. My SMTP server uses "doveadm auth" via auth-socket to perform sender authentification. To shut down SMTP access for hacked passwords I want to have a dedicated flag in the user database to allow/disallow SMTP for a user withouth disabling his account for IMAP. So, is there any option to use a separate passdb definition or additional parameters by either setting this in socket definition of "service auth" or using "-x auth_info"? TIA Oliver -- Protect your environment - close windows and adopt a penguin!

3 3

Sieve puts Reference:-Headers into Vacation-Reply
by Christian K 17 Jan '20

17 Jan '20

Hey, I have an issue with misformatted vacation emails. Part of the initial mail ends up in the vacation response and the headers of the vacation response end up in the body. Which also leads to the wrong charset being used by (some) MUAs. (Should be utf-8 but the inital mal was ascii only). I think I narrowed the trigger of the bug down to a long Reference: header line. It only happens if the long line is not the first one. In the attached example I sent to the mangled mailbox mymailbox(a)example.com. The sieve rule triggered is this one ("äöü" are only there to demonstrate the breaking charset): if true { vacation :days 7 :addresses ["mymailbox(a)example.com"] text: This is an automated reply; I am away and will not be able to reply to you immediately.I will get back to you as soon as I return.äöüß . ; } Christian -- $ dovecot --version 2.2.13 $ dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-9-amd64 x86_64 Debian 8.11 disable_plaintext_auth = no dotlock_use_excl = no mail_debug = yes mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl lazy_expunge listescape mail_log notify managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mmap_disable = yes namespace expunged { hidden = yes list = no location = maildir:~/expunged prefix = EXPUNGED. separator = / } namespace inbox { inbox = yes location = maildir:~/maildir prefix = separator = / } passdb { args = username_format=%n /etc/passwd driver = passwd-file } plugin { acl = vfile lazy_expunge = EXPUNGED. mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size recipient_delimiter = + sieve = ~/sieve/dovecot.sieve sieve_dir = ~/sieve/ sieve_extensions = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify sieve_max_redirects = 20 } protocols = imap pop3 sieve lmtp service imap-login { client_limit = 40 process_limit = 50 service_count = 0 vsz_limit = 512 M } service imap { process_limit = 2000 vsz_limit = 512 M } service lmtp { process_limit = 200 vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 2000 } vsz_limit = 512 M } service pop3-login { client_limit = 40 process_limit = 50 service_count = 0 vsz_limit = 512 M } shutdown_clients = no ssl_cert = </etc/ssl/certs/cert.crt ssl_key = </etc/ssl/private/key.key userdb { args = username_format=%n /etc/passwd driver = passwd-file } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 150 mail_plugins = acl lazy_expunge listescape mail_log notify imap_acl } protocol lmtp { lmtp_save_to_detail_mailbox = yes mail_plugins = acl lazy_expunge listescape mail_log notify sieve }

1 0

INDEX= and dovecot.index.log / dovecot.list.index.log
by Arkadiusz Miśkiewicz 16 Jan '20

16 Jan '20

Using 2.3.8 and mail_location = maildir:/var/mail/%Ln:CONTROL=/var/lib/dovecot/control/%Ln:VOLATILEDIR=/var/lib/dovecot/control/%Ln:INDEX=/var/lib/dovecot/control/%Ln + also user_query = SELECT ... CONCAT('maildir:/var/mail/', LOWER(u.login), '/:CONTROL=/var/lib/dovecot/control/%Ln:VOLATILEDIR=/var/lib/dovecot/control/%Ln:INDEX=/var/lib/dovecot/control/%Ln') AS mail, ... but I noticed that dovecot creates dovecot.index.log dovecot.list.index.log still in /var/mail/XYZ instad of /var/lib/dovecot/control/XYZ. Is that normal? I would expect /var/lib/dovecot/control/XYZ to be used also for these two files. ps. lmtp is used here -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

1 1

dovecot cannot drop privileges inside singularity container
by cesco 15 Jan '20

15 Jan '20

Hi all I'm facing an issue while running dovecot inside a singularity (https://sylabs.io/singularity/) container dovecot version is 2.3.4.1 (configuration below) running on debian buster, inside a container made with singularity version 3.4.2 unfortunately, when I try to start dovecot, it gives: Singularity test.sif:~> cat /var/log/mail.log Dec 30 17:23:38 testnode dovecot: master: Dovecot v2.3.4.1 (f79e8e7e4) starting up for imap, lmtp, sieve, pop3, submission (core dumps disabled) Dec 30 17:23:38 testnode dovecot: anvil: Fatal: We couldn't drop root privileges Dec 30 17:23:38 testnode dovecot: master: Error: service(anvil): command startup failed, throttling for 2 secs the same happens on singularity containers based on debian bullseye or alpine linux 3.9.2 many thanks! nzasch Singularity test.sif:~> doveconf -n # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.2 # Hostname: testnode.example.net mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap lmtp sieve pop3 submission" ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd }

2 2

Upgrade 2.2.27 to 2.3.9.2: master(imap): net_connect_unix(imap) failed: Resource temporarily unavailable
by Eirik Rye 15 Jan '20

15 Jan '20

Hi, After upgrading Dovecot from version 2.2.27 to 2.3.9.2, we are sporadically seeing lots of these errors in the error log on many of our servers: imap-login: Error: master(imap): net_connect_unix(imap) failed: Resource temporarily unavailable - http://wiki2.dovecot.org/SocketUnavailable The issue is causing significant delays and/or timeouts on login. From what I can tell, this happens because the imap-login service is unable to connect to the imap service socket, however I am unable to identify the root cause of the issue. We have increased the client_limit for the stats service, as described in the upgrade document at (https://wiki2.dovecot.org/Upgrading/2.3) It is set to the same value as the process_limit for imap service. System CPU usage does not appear to be saturated. The CPU usage sits at around 50% when these errors appear. We have doubled the number of file descriptors after upgrading from 2.2.27. It was previously set to 16392 (which worked fine): ~# cat /proc/`pidof dovecot`/limits | grep "open files" Max open files 30000 30000 files We have tried increasing default_process_limit and default_client_limit from the default 1000 to 3000, but this has no effect. Current configuration (with irrelevant parts removed): ~# doveconf -n default_client_limit = 3000 # these were raised after upgrading in attempt to remedy default_process_limit = 3000 default_vsz_limit = 512 M [...] service imap-login { client_limit = 1250 inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 16 process_min_avail = 16 service_count = 0 vsz_limit = 512 M } service imap { client_limit = 1 process_limit = 20000 } service stats { client_limit = 20000 } [...] We appear to be nowhere near the 20000 process_limit set for the imap service. We are also not seeing any warnings being logged with regards to the process_limit. ~# doveadm who -1 | wc -l 8765 ~# doveadm process status | grep "^imap " | wc -l 7583 ~# ps aux | grep "dovecot/imap" | wc -l 7449 ~# doveadm process status | grep -v "^imap " name pid available_count total_count idle_start last_status_update last_kill_sent stats 19875 12384 582387 0 1578305489 0 pop3-login 19868 1000 0 0 1578061504 0 pop3-login 19867 1000 0 0 1578061503 0 pop3-login 19866 1000 0 0 1578061502 0 pop3-login 19865 1000 0 0 1578061503 0 pop3-login 19864 1000 0 0 1578061503 0 pop3-login 19853 1000 0 0 1578061504 0 pop3-login 19852 1000 0 0 1578061504 0 pop3-login 19851 1000 0 0 1578061504 0 pop3-login 19849 1000 0 0 1578061503 0 pop3-login 19847 1000 0 0 1578061503 0 pop3-login 19846 1000 0 0 1578061503 0 pop3-login 19845 1000 0 0 1578061503 0 pop3-login 19844 1000 0 0 1578061503 0 pop3-login 19843 1000 0 0 1578061503 0 pop3-login 19842 1000 0 0 1578061503 0 pop3-login 19839 1000 0 0 1578061502 0 log 19841 2973 27 0 1578061502 0 imap-login 19873 666 14942 0 1578305488 0 imap-login 19872 523 32792 0 1578305489 0 imap-login 19871 316 62876 0 1578305489 0 imap-login 19870 167 78332 0 1578305489 0 imap-login 19869 118 97989 0 1578305489 0 imap-login 19863 0 184726 0 1578305489 0 imap-login 19862 0 193094 0 1578305489 0 imap-login 19861 0 186800 0 1578305487 0 imap-login 19860 675 17806 0 1578305487 0 imap-login 19859 0 169446 0 1578305489 0 imap-login 19858 0 143517 0 1578305489 0 imap-login 19857 0 119215 0 1578305488 0 imap-login 19856 0 151958 0 1578305489 0 imap-login 19855 483 47036 0 1578305488 0 imap-login 19854 1 185240 0 1578305489 0 imap-login 19840 567 23859 0 1578305485 0 config 19874 2967 124482 0 1578305489 0 auth 19885 2967 124185 0 1578305489 0 anvil 10017 967 7567 0 1578305463 0 -- Eirik

3 13

autoupdate broke
by Steve Egbert 14 Jan '20

14 Jan '20

When attempting to perform autoupdate after my 'autogen.sh' broke, it says that there is missing a file called: dovecot/core/doc/wiki/Makefile.am But in the Github repository, there is a misnamed file named "Makefile.am.in". I think this file is misnamed and should be renamed to "Makefile.am". https://github.com/dovecot/core/tree/master/doc/wiki

3 2

Separate TLS certificate for listener
by Peter Mogensen 13 Jan '20

13 Jan '20

Hi, I've read the howto on overriding the global ssl_cert config by using filters like "local", "remote", "protocol", "local-name". However... is it possible to have a speciel certificate just for a listener where only the port is different? /Peter

2 1

Dovecot HA/Resilience
by Kishore Potnuru 13 Jan '20

13 Jan '20

Hi Dovecot team, I need help in configuring HA/resilence for my dovecot (POP3/IMAP) server. I have one RHEL Linux POP3/IMAP server with Dovecot version 2.2.10. I also installed the postfix(version: 2.6.6) in it. At present it have around 10 domains and each domain is having around 20 email boxes. It has very simple configuration. User's reading the email via some internal applications/Outlook. I would like to create resilience/HA for this environment. Could you please suggest me, what is the easiest way to achieve this? If any one can suggest step by step that will be more helpful to me. Thanks, Kishore

8 16

saving sent mail in sent folder
by soumitri＠iitk.ac.in 13 Jan '20

13 Jan '20

Hello, I am getting following error in info log of dovecot. imap(someshb): Info: Connection closed (No commands sent) in=0 out=374 This error is for some users (not all) while sending email via Thunderbird. The email is sent but not saved int the Sent folder. I tried to debug the issue and getting nothing except following Debug: Effective uid=2121, gid=4619, home=/users02/home/ppd_doaa imap(ppd_doaa): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir:INDEX=/xx/index:CONTROL=/xx/index imap(ppd_doaa): Debug: maildir++: root=/xx/Maildir, index=/xx/index, indexpvt=, control=/xx/index, inbox=/xx/Maildir, alt= imap(ppd_doaa): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none imap(ppd_doaa): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= namespace has following namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } i am using dovecot-2.2.36-10.el8.x86_64 Thanks for any help. -- Sincerely, Soumitri

1 0

Replication question
by John 13 Jan '20

13 Jan '20

Hi I'm currently debugging some replication issues between two dovecot 2.3.9.2 servers, where one is live and the other is just a copy used for backup with no imap user access. After initial alignment (with various error messages such as the stalled io messages a fnctl lock messages) I am seeing replication miss messages or stop altogether on mailboxes, even with no further error messages. doveadm: Error: dsync(REMOTE_HOSTNAME): I/O has stalled, no activity for 600 seconds (last sent=mail_change (EOL), last recv=mailbox) doveadm: Error: Couldn't lock /var/vmail/DOMAIN/USER//.dovecot-sync.lock: fcntl(/var/vmail/DOMAIN/USER//.dovecot-sync.lock, write-lock, F_SETLKW) locking failed: Timed out after 30 seconds (WRITE lock held by pid 30307) I was surprised by this because although I know there were replication issues in 2.3.8 I understood these were resolved in 2.3.9 when both servers had 2.3.9. I am still investigating and will post further if I get any useful insights. However, I have a question, which despite using dovecot for many years in this configuration has never occurred to me before. I configured dovecot using the wiki https://wiki.dovecot.org/Replication using tcp and ssl. Both servers have an identical dovecot configuration except for: 1. different hostnames 2. on the backup server I have removed expire and quota plugins in the global mail_plugins 3. in the configuration of mail_replica tcps://hostname:port each server points to the other server's hostname What I just realized is that nowhere in the wiki does it state that both servers should be set up for replication. I had always assumed that was the logical thing to do. So the question is, for successful replication is it sufficient to setup one master configuration and just have a replication process listening on the other master, or should both servers be set up for replication in an almost identical way (with the 3 exceptions above)? thanks for any insights. John

2 1

RE: Unable to authenticate on Dovecot - auth-userdb issue?
by Mark ADAMS 11 Jan '20

11 Jan '20

Uncommented the section on userdb that was commented because it was throwing errors. It’s still throwing an error. Specifically this one: Jan 10 15:42:37 shuttle postfix/smtpd[21046]: connect from pvr[192.168.1.103] Jan 10 15:42:47 shuttle postfix/smtpd[21046]: fatal: no SASL authentication mechanisms Jan 10 15:42:48 shuttle postfix/master[18850]: warning: process /usr/libexec/postfix/smtpd pid 21046 exit status 1 Jan 10 15:42:48 shuttle postfix/master[18850]: warning: /usr/libexec/postfix/smtpd: bad command startup -- throttling I’ve combed Google for information on “no SASL authentication mechanism” with no solution. I appear to have things configured correctly (unless IM missing something, which is entirely possible given that I’m really struggling with this). Saslauthd is running: # systemctl status saslauthd ● saslauthd.service - SASL authentication daemon. Loaded: loaded (/usr/lib/systemd/system/saslauthd.service; enabled; vendor preset: disabled) Active: active (running) since Mon 2020-01-06 19:13:37 MST; 3 days ago Main PID: 29506 (saslauthd) Memory: 1.5M CGroup: /system.slice/saslauthd.service ├─29506 /usr/sbin/saslauthd -m /run/saslauthd -a pam ├─29507 /usr/sbin/saslauthd -m /run/saslauthd -a pam ├─29508 /usr/sbin/saslauthd -m /run/saslauthd -a pam ├─29509 /usr/sbin/saslauthd -m /run/saslauthd -a pam └─29510 /usr/sbin/saslauthd -m /run/saslauthd -a pam Jan 06 19:13:37 shuttle systemd[1]: Starting SASL authentication daemon.... Jan 06 19:13:37 shuttle saslauthd[29506]: : master pid is: 29506 Jan 06 19:13:37 shuttle systemd[1]: Started SASL authentication daemon.. Jan 06 19:13:37 shuttle saslauthd[29506]: : listening on socket: /run/saslauthd/mux Dovecot and Postfix are running starting and running okay. /var/spool/postfix/private/auth is present and seems to be correct. Here are my current configs on those items: # postconf -n command_directory = /usr/sbin compatibility_level = 2 daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix html_directory = /usr/share/doc/postfix/html inet_interfaces = shuttle inet_protocols = all lmtp-filter_destination_concurrency_limit = 2 lmtp_sasl_mechanism_filter = plain mail_owner = postfix mailbox_transport = dovecot:shuttle:lmtp mailq_path = /usr/bin/mailq manpage_directory = /usr/share/man meta_directory = /etc/postfix mydestination = mynetworks myhostname = shuttle mynetworks = 192.168.1.0/24, 127.0.0.0/8 mynetworks_style = subnet myorigin = shuttle newaliases_path = /usr/bin/newaliases queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix/README_FILES sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop shlib_directory = /usr/lib64 smtp-filter_destination_concurrency_limit = 2 smtp_bind_address = 192.168.1.105 smtp_tls_CAfile = /etc/pki/tls/certs/ca-bundle.crt smtp_tls_security_level = may smtpd_banner = $myhostname ESMTP $mail_name ($mail_version) (Mageia Linux) smtpd_recipient_restrictions = permit_sasl_authenticated,permit_mynetworks,reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CAfile = /etc/pki/tls/certs/ca-bundle.crt smtpd_tls_cert_file = /etc/pki/tls/certs/adams-lan.mail.pem smtpd_tls_key_file = /etc/pki/tls/private/adams-lan.mail.key smtpd_use_tls = yes unknown_local_recipient_reject_code = 450 virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf virtual_mailbox_base = /var/spool/mail/vhosts virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf virtual_transport = dovecot postconf: warning: /etc/postfix/master.cf: unused parameter: flags= # dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # OS: Linux 5.4.6-desktop-2.mga7 x86_64 Mageia 7 # Hostname: shuttle auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_username_format = %Ln disable_plaintext_auth = no first_valid_uid = 0 last_valid_uid = 10001 mail_gid = 10001 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mail_uid = 10001 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = sql } passdb { args = %s driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } service anvil { unix_listener anvil { group = mail mode = 0666 } } service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service stats { unix_listener stats-reader { group = mail mode = 0666 } unix_listener stats-writer { group = mail mode = 0666 } } ssl = required ssl_cert = </etc/pki/tls/certs/fullchain.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { hostname = shuttle postmaster_address = postmaster@shuttle I just need this stuff to move mail on my LAN as it did for years prior to this upgrade. I’m perfectly willing to blow this config away and reinstall from scratch, which I’ve done twice already. I’ve been through at least 4 tutorials on the web and nothing has led to my getting this thing working. Despite all that I’ve learned about Postfix + Dovecot + Mysql, I am still not smart enough to figure this out. I’m still looking for help and/or options. I’m also wondering if it might not be a good idea to ditch the configs in /etc/dovecot/conf.d (by commenting out “!include conf.d/*.conf” in dovecot.conf). I’m just looking to move mail on my LAN. This should be simple, no? Thanks again. Mark From: Alexander Dalloz<mailto:ad+lists@uni-x.org> Sent: Friday, January 10, 2020 11:34 AM To: Mark ADAMS<mailto:madams9@msn.com> Subject: Re: Unable to authenticate on Dovecot - auth-userdb issue? Mark, first of all: please take care to whom you reply. Do not communicate directly with my list mail address. Please keep the discussion on the dovecot list. Thanks. Am 09.01.2020 um 18:29 schrieb Mark ADAMS: > At this point, passdb does not support lookups according to the log. Is there something else I should be looking at? > > I’ve worked on this and seem to be making little progress. A sample transaction log looks like this: > > > Jan 09 10:22:32 shuttle dovecot[26851]: master: Warning: SIGHUP received - reloading configuration > Jan 09 10:23:04 shuttle postfix/smtpd[5448]: connect from pvr[192.168.1.103] > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/modules/auth > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: Module loaded: /usr/lib64/dovecot/modules/auth/lib20_auth_var_expand_crypt.so > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: Read auth token secret from /run/dovecot/auth-token-secret.dat > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: auth client connected (pid=0) > Jan 09 10:23:20 shuttle postfix/smtpd[5448]: 0C6BF4A6302: client=pvr[192.168.1.103] > Jan 09 10:23:30 shuttle postfix/cleanup[5459]: 0C6BF4A6302: message-id=<> > Jan 09 10:23:30 shuttle postfix/qmgr[1385]: 0C6BF4A6302: from=<madams@pvr>, size=180, nrcpt=1 (queue active) > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: master in: USER 1 root@shuttle service=lda > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: static(root): Performing userdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: pam(root): Performing passdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: pam(root): passdb doesn't support credential lookups > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: pam(root): Finished passdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Error: static(root): passdb doesn't support lookups, can't verify user's existence > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: static(root): Finished userdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: userdb out: FAIL 1 > Jan 09 10:23:30 shuttle dovecot[5466]: lda(root@shuttle)<5466><>: Error: auth-master: userdb lookup(root@shuttle): Auth USER lookup failed > Jan 09 10:23:30 shuttle dovecot[5466]: lda: Fatal: Internal error occurred. Refer to server log for more information. > Jan 09 10:23:30 shuttle postfix/pipe[5465]: 0C6BF4A6302: to=<root@shuttle>, relay=dovecot, delay=17, delays=17/0.01/0/0.06, dsn=4.3.0, status=deferred (tempora> > Jan 09 10:23:31 shuttle sshd[5468]: Connection closed by 192.168.1.100 port 48324 [preauth] > Jan 09 10:23:31 shuttle postfix/smtpd[5448]: disconnect from pvr[192.168.1.103] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 > > > My current dovecot configuration looks like this: > > # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf > # OS: Linux 5.4.6-desktop-2.mga7 x86_64 Mageia 7 > # Hostname: shuttle > auth_debug_passwords = yes > auth_username_format = %Ln > disable_plaintext_auth = no > first_valid_uid = 0 > last_valid_uid = 10001 > mail_gid = 10001 > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > mail_uid = 10001 > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = %s > driver = pam > } > plugin { > sieve = file:~/sieve;active=~/.dovecot.sieve > } > service anvil { > unix_listener anvil { > group = mail > mode = 0666 > } > } > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = > mode = 0666 > user = $default_internal_user > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 143 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service stats { > unix_listener stats-reader { > group = mail > mode = 0666 > } > unix_listener stats-writer { > group = mail > mode = 0666 > } > } > ssl = required > ssl_cert = </etc/pki/tls/certs/fullchain.cer > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > protocol lmtp { > hostname = shuttle > postmaster_address = postmaster@shuttle > } > > > As always I appreciate the help and any assistance is appreciated. > > Mark According to your "doveconf -n" output you have no userdb defined. Just do that. https://doc.dovecot.org/configuration_manual/authentication/user_databases_… Maybe this one fits your current system setup https://doc.dovecot.org/configuration_manual/authentication/passwd/#authent… Alexander > From: Alexander Dalloz<mailto:ad+lists@uni-x.org> > Sent: Friday, January 3, 2020 5:26 AM > To: dovecot(a)dovecot.org<mailto:dovecot@dovecot.org> > Subject: Re: Unable to authenticate on Dovecot - auth-userdb issue? > > Am 03.01.2020 um 03:27 schrieb Mark ADAMS: >> Jan 02 18:47:37 shuttle dovecot[6744]: lda(root@shuttle)<6744><>: Error: auth-master: userdb lookup(root@shuttle): connect(/run/dovecot/auth-userdb) failed: Permission denied (euid=8(mail) egid=12(mail) missing +r perm: /run/dovecot/auth-userdb, dir owned by 0:0 mode=0755) > > Run "namei -lv /run/dovecot/auth-userdb" to check the permissions of the > complete path. The auth-userdb socket actually is owned mail:mail > according to your error logging. Is dovecot member of the mail group? > > Actually it does not match the config details you have pasted: > > unix_listener auth-userdb { > group = dovecot > mode = 0600 > user = vmail > } > > On my side it looks like this and I have not custom configured that > part. The defaults are: > > unix_listener auth-userdb { > group = > mode = 0666 > user = $default_internal_user > } > > So on my system the permissions look like this: > > # namei -lv /var/run/dovecot/auth-userdb > f: /var/run/dovecot/auth-userdb > dr-xr-xr-x root root / > drwxr-xr-x root root var > drwxr-xr-x root root run > drwxr-xr-x root dovecot dovecot > srw-rw-rw- dovecot root auth-userdb > >> Jan 02 18:47:37 shuttle dovecot[6744]: lda: Fatal: Internal error occurred. Refer to server log for more information. >> Jan 02 18:47:37 shuttle postfix/pipe[6743]: 6345D4A4A97: to=<root@shuttle>, relay=dovecot, delay=1.1, delays=1.1/0.01/0/0.06, dsn=4.3.0, status=deferred (temporary failure. Command output: lda(root@shuttle): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied ) >> ^C >> >> >> >> Note: this error references "/run/dovecot/auth-userdb". That isn't even supposed to be the location of that file. I have no idea why that location shows up. The correct location should be "/etc/dovecot/auth-userdb". The file does exist at that location. > > Mark, > > I have no idea why you expect the dovecot sockets to be located inside > /etc/dovecot/. /etc is the FHS location for configurations. /run or > /var/run (typically a symlink on modern linux distributions) is the > right location for runtime files like service sockets. > > You say /etc/dovecot/auth-userdb exists. Am I correct to guess that you > have created that manually with whatever content? > > Alexander > >

1 0

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
by Ralf Hildebrandt 10 Jan '20

10 Jan '20

I'm trying this: doveadm import -u restore(a)backup.invalid mdbox:/home/copymail2/mdbox "" \ mailbox INBOX header X-Spam Yes nd I'm getting: doveadm(restore(a)backup.invalid): Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) doveadm(restore(a)backup.invalid): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f598de6cac2] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f598de6cbde] -> /usr/lib/dovecot/libdovecot.so.0(+0xe989e) [0x7f598de7789e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe98e1) [0x7f598de778e1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f598ddced04] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78) [0x7f598e227de8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b) [0x7f598e2103ab] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449) [0x7f598e1f2139] -> /usr/lib/dovecot/libdovecot.so.0(+0xc10a9) [0x7f598de4f0a9] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a) [0x7f598de852ea] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7f598de8562f] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f598de8600d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68) [0x7f598de55a58] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52) [0x7f598de56432] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcc561) [0x7f598e1fc561] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcd85c) [0x7f598e1fd85c] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d) [0x7f598e1fe04d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28) [0x7f598e17df38] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d) [0x7f598e17df9d] -> doveadm(+0x31b13) [0x557f5d487b13] -> doveadm(+0x2c441) [0x557f5d482441] -> doveadm(+0x2d1c9) [0x557f5d4831c9] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x557f5d48409e] -> doveadm(doveadm_cmd_run_ver2+0x55e) [0x557f5d4953ee] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x557f5d495447] -> doveadm(main+0x1d1) [0x557f5d472211] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f598d3cfb97] -> doveadm(_start+0x2a) [0x557f5d47272a] Aborted (core dumped) I'm using ii dovecot-core 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - core files ii dovecot-dbg 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - debug symbols ii dovecot-imapd 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-lmtpd 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - LMTP server ii dovecot-lucene 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - Lucene support Running in gdb results in this backtrace: Program received signal SIGABRT, Aborted. __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007ffff68e4801 in __GI_abort () at abort.c:79 #2 0x00007ffff736d851 in default_fatal_finish (status=0, type=LOG_TYPE_PANIC) at failures.c:459 #3 fatal_handler_real (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:471 #4 0x00007ffff736d8e1 in default_fatal_handler (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:479 #5 0x00007ffff72c4d04 in i_panic (format=format@entry=0x7ffff772dd00 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:523 #6 0x00007ffff771dde8 in mail_index_uint32_to_offset (offset=<optimized out>) at mail-index-util.c:10 #7 0x00007ffff77063ab in mail_cache_header_fields_write (ctx=0x555555855330, buffer=<optimized out>, buffer=<optimized out>) at mail-cache-transaction.c:609 #8 mail_cache_header_add_field (field_idx=15, ctx=0x555555855330) at mail-cache-transaction.c:690 #9 mail_cache_add (ctx=0x555555855330, seq=1, field_idx=field_idx@entry=15, data=0x7ffff773b6d6, data_size=0) at mail-cache-transaction.c:739 #10 0x00007ffff76ea82c in index_mail_cache_add_idx (mail=mail@entry=0x555555869f18, field_idx=field_idx@entry=15, data=data@entry=0x7ffff773b6d6, data_size=data_size@entry=0) at index-mail.c:631 #11 0x00007ffff76e8139 in index_mail_parse_header_finish (mail=<optimized out>) at index-mail-headers.c:132 #12 index_mail_parse_header (part=<optimized out>, hdr=<optimized out>, mail=<optimized out>) at index-mail-headers.c:312 #13 0x00007ffff73450a9 in read_header (mstream=0x555555874740) at istream-header-filter.c:356 #14 i_stream_header_filter_read (stream=0x555555874740) at istream-header-filter.c:446 #15 0x00007ffff737b2ea in i_stream_read_memarea (stream=stream@entry=0x5555558747c0) at istream.c:313 #16 0x00007ffff737b62f in i_stream_read (stream=stream@entry=0x5555558747c0) at istream.c:271 #17 0x00007ffff737c00d in i_stream_read_data (stream=0x5555558747c0, data_r=data_r@entry=0x7fffffffdc08, size_r=size_r@entry=0x7fffffffdc10, threshold=threshold@entry=1) at istream.c:745 #18 0x00007ffff734ba58 in i_stream_read_bytes (wanted=2, size_r=0x7fffffffdc10, data_r=0x7fffffffdc08, stream=<optimized out>) at ../../src/lib/istream.h:217 #19 message_parse_header_next (ctx=0x555555869db0, hdr_r=hdr_r@entry=0x7fffffffdc70) at message-header-parser.c:85 #20 0x00007ffff734c432 in message_parse_header (input=<optimized out>, hdr_size=hdr_size@entry=0x0, flags=flags@entry=MESSAGE_HEADER_PARSER_FLAG_CLEAN_ONELINE, callback=callback@entry=0x7ffff76f1aa0 <search_header>, context=context@entry=0x7fffffffdce0) at message-header-parser.c:392 #21 0x00007ffff76f2561 in search_arg_match_text (ctx=0x555555856fa0, args=0x5555558216d0) at index-search.c:759 #22 search_match_once (ctx=0x555555856fa0) at index-search.c:1399 #23 0x00007ffff76f385c in search_match_next (ctx=0x555555856fa0) at index-search.c:1506 #24 search_more_with_mail (mail=<optimized out>, ctx=0x555555856fa0) at index-search.c:1623 #25 search_more_with_prefetching (mail_r=<optimized out>, ctx=<optimized out>) at index-search.c:1705 #26 search_more (ctx=ctx@entry=0x555555856fa0, mail_r=mail_r@entry=0x7fffffffde10) at index-search.c:1779 #27 0x00007ffff76f404d in index_storage_search_next_nonblock (_ctx=0x555555856fa0, mail_r=0x7fffffffdee0, tryagain_r=0x7fffffffde77) at index-search.c:1807 #28 0x00007ffff7673f38 in mailbox_search_next_nonblock (ctx=0x555555856fa0, mail_r=0x7fffffffdee0, tryagain_r=<optimized out>) at mail-storage.c:2307 #29 0x00007ffff7673f9d in mailbox_search_next (ctx=0x555555856fa0, mail_r=mail_r@entry=0x7fffffffdee0) at mail-storage.c:2292 #30 0x0000555555586d52 in doveadm_mail_iter_next (iter=<optimized out>, mail_r=mail_r@entry=0x7fffffffdee0) at doveadm-mail-iter.c:160 #31 0x0000555555585b13 in cmd_import_box (search_args=<optimized out>, info=0x55555584e7b8, dest_user=<optimized out>, ctx=0x55555581fdb8) at doveadm-mail-import.c:142 #32 cmd_import_run (_ctx=0x55555581fdb8, user=0x5555558374b8) at doveadm-mail-import.c:202 #33 0x0000555555580441 in doveadm_mail_next_user (ctx=ctx@entry=0x55555581fdb8, error_r=error_r@entry=0x7fffffffe0c0) at doveadm-mail.c:462 #34 0x00005555555810db in doveadm_mail_single_user (ctx=ctx@entry=0x55555581fdb8, error_r=error_r@entry=0x7fffffffe0c0) at doveadm-mail.c:492 #35 0x00005555555811c9 in doveadm_mail_cmd_exec (ctx=ctx@entry=0x55555581fdb8, wildcard_user=wildcard_user@entry=0x0) at doveadm-mail.c:653 #36 0x000055555558209e in doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=<optimized out>) at doveadm-mail.c:1144 #37 0x00005555555933ee in doveadm_cmd_run_ver2 (argc=10, argv=0x5555557f6bb8, cctx=cctx@entry=0x7fffffffe2b0) at doveadm-cmd.c:575 #38 0x0000555555593447 in doveadm_cmd_try_run_ver2 (cmd_name=<optimized out>, argc=<optimized out>, argv=<optimized out>, cctx=0x7fffffffe2b0) at doveadm-cmd.c:497 #39 0x0000555555570211 in main (argc=<optimized out>, argv=<optimized out>) at doveadm.c:395 (gdb) -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

1 0

2FA for Dovecot
by Kees de Jong 09 Jan '20

09 Jan '20

Hi, My goal is to protect my mail account with 2FA, which isn't a crazy idea in 2020. Therefore, I would like to know the possibilities of configuring 2FA for Dovecot. In the documentation there are some hints of e.g. OTP in Dovecot [1] and using FreeIPA with Dovecot [2], where FreeIPA has the ability to enable OTP per user [3]. But I can't really find much practical information about such a setup. The documentation of Dovecot is quite silent about the OTP authentication mechanism and the same goes for the FreeIPA and Dovecot combination with OTP. So my question is; is this even a supported setup? And if so, where is the documentation? And if not, what's the recommended method to secure your mail setup? I can imagine alternative solutions like putting the submission and IMAP port behind a VPN and have all the clients use that VPN. And for the public internet, simply use a web interface (e.g. Nextcloud with Rainloop) which supports 2FA. But I prefer having OTP for e.g. Android and Linux clients. [1] https://doc.dovecot.org/configuration_manual/authentication/authentication_… [2] https://www.freeipa.org/page/Dovecot_Integration [3] https://www.freeipa.org/page/Using_FreeIPA_and_FreeRadius_as_a_RADIUS_based… -- Met vriendelijke groet, Kees de Jong De informatie opgenomen in deze e-mail kan vertrouwelijk zijn en is uitsluitend bestemd voor de geadresseerde(n). Indien u deze e-mail onterecht ontvangt, wordt u verzocht de inhoud niet te gebruiken en de afzender direct te informeren door de e-mail te retourneren. Aan deze e-mail inclusief de bijlagen kunnen geen rechten ontleend worden, tenzij schriftelijk anders wordt overeengekomen. -- The information contained in this e-mail may be confidential and is intended to be exclusively for the addressee(s). Should you receive this e-mail unintentionally, please do not use the contents herein and notify the sender immediately by return e-mail. This e-mail including the attachments are not legally binding, unless otherwise agreed upon in writing. -- OpenPGP fingerprint: 0x0E45C98AB51428E6

6 5

Thunderbird Subscription missing
by Phillip Bruce 08 Jan '20

08 Jan '20

Hello, I have an usual isshere we are using thunderbird for client. The version of dovecot is as followed: # dovecot --version 2.2.22 (fe789d2) The dovecot service is runnon on VERSION="16.04.6 LTS (Xenial Xerus)" Thunderbird version 68.3.1 (32 bit) version. What happening when managing subscription there seems to be folders that are missing. They were not purged nor did anything happen like an outage. If you look at this below Sep19 (for September 2019), It list only the following folders: 16Sep19, 25Sep19 26Sep19 [cid:image002.png@01D5C532.1485D710] To me this looks like some indexing gone south. I've tried this # doveadm mailbox status -u arhive doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] # doveadm mailbox status -u archive Maildir # doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] r# doveadm mailbox status -u archive INBOX @doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] The user is archive The user home folder is this: # pwd /home/mail/archive/Maildir This what in it. # ls cur dovecot.index.log dovecot.mailbox.log.2 dovecot-uidvalidity.50ca19bb tmp dovecot.index dovecot.index.log.2 dovecot-uidlist dovecot-uidvalidity.50ca19bc dovecot.index.cache dovecot-keywords dovecot-uidvalidity dovecot-uidvalidity.50ca1b2d dovecot.index.cache.gz dovecot-keywords.gz dovecot-uidvalidity.50ca1990 new dovecot.index.cache.gz.2 dovecot.mailbox.log dovecot-uidvalidity.50ca19ab subscriptions # doveadm log errors # I don't see in errors. I tried to reload dovecot. # doveadm instance list path name last used running /var/run/dovecot dovecot 2020-01-06 22:41:46 yes root@dc3-ops-prod-vserv-archive01:~# There nothing in the logs that I can see. # doveadm user -u archive userdb: archive user : archive system_groups_user: archive uid : 1011 gid : 1011 home : /home/archive root@dc3-ops-prod-vserv-archive01:~# Any suggestions would be helpful. Thanks, Phillip Bruce Sr. System Engineer 415-590-8491 office "The answer to your Traveling Solution" [Deem Demo] This message and any files or text attached to it are intended only for the recipients named above, and contain information that may be confidential or privileged. If you are not an intended recipient, or you have reason to believe that you received this message in error, you must not read, copy, use or disclose this communication. Please also notify the sender by replying to this message, and then delete all copies of it from your system. Thank you.

3 9