- dovecot - dovecot.org

dovecot 2 samba ad-dc
by phil 28 Feb '20

28 Feb '20

Helo you, I try to build a mail server based on Centos 7, postfix and dovecot 2. My backend is a Samba4 ad-dc. I tried a lot and I don't know what else I could try.I'm new to this mailing list so please forgive me if I don't give right information or anything Samba4 ad-dc is up incl. dns. Win10 Client joined domain and authentication works. Postfix is up and checks against ldap whether recipient address exists. It takes mail via telnet and queues them. But can't give it to dovecot. my master.cf locks like that: [root@mail1t postfix]# cat master.cf smtp inet n - - - - smtpd submission inet n - - - - smtpd -o smtpd_enforce_tls=yes -o smtpd_tls_security_level=encrypt -o tls_preempt_cipherlist=yes pickup fifo n - - 60 1 pickup cleanup unix n - - - 0 cleanup qmgr fifo n - n 300 1 qmgr tlsmgr unix - - - 1000? 1 tlsmgr rewrite unix - - - - - trivial-rewrite bounce unix - - - - 0 bounce defer unix - - - - 0 bounce trace unix - - - - 0 bounce verify unix - - - - 1 verify flush unix n - - 1000? 0 flush proxymap unix - - n - - proxymap proxywrite unix - - n - 1 proxymap smtp unix - - - - - smtp relay unix - - - - - smtp showq unix n - - - - showq error unix - - - - - error retry unix - - - - - error discard unix - - - - - discard local unix - n n - - local virtual unix - n n - - virtual lmtp unix - - - - - lmtp anvil unix - - - - 1 anvil scache unix - - - - 1 scache maildrop unix - n n - - pipe flags=DRhu user=vmail argv=/usr/bin/maildrop -d ${recipient} uucp unix - n n - - pipe flags=Fqhu user=uucp argv=uux -r -n -z -a$sender - $nexthop!rmail ($recipient) ifmail unix - n n - - pipe flags=F user=ftn argv=/usr/lib/ifmail/ifmail -r $nexthop ($recipient) bsmtp unix - n n - - pipe flags=Fq. user=bsmtp argv=/usr/lib/bsmtp/bsmtp -t$nexthop -f$sender $recipient scalemail-backend unix - n n - 2 pipe flags=R user=scalemail argv=/usr/lib/scalemail/bin/scalemail-store ${nexthop} ${user} ${extension} mailman unix - n n - - pipe flags=FR user=list argv=/usr/lib/mailman/bin/postfix-to-mailman.py ${nexthop} ${user} dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} #smtp inet n - n - 1 postscreen #smtpd pass - - n - - smtpd #dnsblog unix - - n - 0 dnsblog #tlsproxy unix - - n - 0 tlsproxy postlog unix-dgram n - n - 1 postlogd my ldap.conf on mailserver: [root@mail1t openldap]# cat ldap.conf # # LDAP Defaults # # See ldap.conf(5) for details # This file should be world readable but not world writable. #BASE dc=example,dc=com #URI ldap://ldap.example.com ldap://ldap-master.example.com:666 URI ldaps://ldap1t.test.loc:636 #SIZELIMIT 12 #TIMELIMIT 15 #DEREF never #TLS_CACERTDIR /etc/openldap/certs TLS_CACERTDIR /etc/pki/tls/certs/ka # Turning this off breaks GSSAPI used with krb5 when rdns = false SASL_NOCANON on TLS_REQCERT never dovecot.conf: [root@mail1t dovecot]# cat dovecot.conf auth_mechanisms = plain login mail_uid = vmail mail_gid = vmail ssl_cert = </etc/ssl/mail.pem ssl_key = </etc/ssl/key.pem login_log_format_elements = "user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k" #mail_plugins = quota ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA log_timestamp = "%Y-%m-%d %H:%M:%S " log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot-info.log debug_log_path = /var/log/dovecot-debug.log #auth_verbose=yes auth_debug=yes auth_debug_passwords=yes mail_debug=yes verbose_ssl=yes protocols = imap listen = * auth_cache_size = 50000 # ~ 200 Benutzer mit Passwort auth_cache_ttl = 300s # in Sekunden, 5 Minute auth_cache_negative_ttl = 30s # wenn Benutzer nicht existierte bei letztem Check passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } service auth { unix_listener /var/spool/postfix/private/auth_dovecot { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = root } user = root } service dict { unix_listener dict { mode = 0660 user = vmail group = vmail } } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } protocol imap { mail_plugins = quota imap_quota } plugin { quota = maildir:User quota } dovecot-ldap.conf.ext: root@mail1t dovecot]# cat dovecot-ldap.conf.ext #hosts = 192.168.122.30:636 # Windows Active Directory uris = ldaps://192.168.122.30:636 #dn = CN=DovecotAdministrator,OU=ServiceAccounts,OU=Identitiy,DC=test,DC=loc dn = CN=Administrator,CN=Users,DC=test,DC=loc dnpass = Test123! tls = no # Benötige ich (!) nicht auth_bind = yes # Für die Dauer der Authentifizierung bindet sich Dovecot als einloggender Mailuser auth_bind_dn = %u ldap_version = 3 base = OU=Identitiy,DC=domain,DC=local # Meine OU mit Benutzern scope = subtree # Oder "base", falls nicht rekursiv in der OU gesucht werden soll pass_attrs = \ =user=%{ldap:mail}, \ =passwerd=%{ladp:user}, \ user_attrs = \ =user=%{ldap:mail}, \ user_filter = (mailRoutingAddress=%u) pass_filter = (mail=%u) iterate_attrs = mail #mail=user # Wird vor allem von "doveadm" benötigt, um Benutzer zu finden iterate_filter = (objectClass=smiMessageRecipient #(objectClass=person) maillog gives me: Feb 20 08:34:56 mail1t postfix/smtpd[1794]: 04229120B0D: client=unknown[192.168.122.30] Feb 20 08:35:01 mail1t postfix/cleanup[1798]: 04229120B0D: message-id=<> Feb 20 08:35:01 mail1t postfix/qmgr[1268]: 04229120B0D: from=<test(a)test.loc>, size=176, nrcpt=1 (queue active) Feb 20 08:35:01 mail1t postfix/pipe[1799]: 04229120B0D: to=<test(a)test.loc>, relay=dovecot, delay=12, delays=12/0.01/0/0.07, dsn=4.3.0, status=deferred (temporary failure) Feb 20 08:35:03 mail1t postfix/smtpd[1794]: disconnect from unknown[192.168.122.30] helo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 dovecot debug log: 2020-02-20 08:31:18 auth: Debug: Loading modules from directory: /usr/lib/dovecot/auth 2020-02-20 08:31:18 auth: Debug: Module loaded: /usr/lib/dovecot/auth/lib20_auth_var_expand_crypt.so 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: userdb lookup(test(a)test.loc): Started userdb lookup 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=13) 2020-02-20 08:35:01 auth: Debug: Loading modules from directory: /usr/lib/dovecot/auth 2020-02-20 08:35:01 auth: Debug: Module loaded: /usr/lib/dovecot/auth/lib20_auth_var_expand_crypt.so 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Disconnected: Connection closed: read(size=8192) failed: Connection reset by peer (fd=13) 2020-02-20 08:35:01 lda(test(a)test.loc)<1800><>: Debug: auth-master: userdb lookup(test(a)test.loc): Userdb lookup failed a ldap search gives me: [root@mail1t dovecot]# ldapsearch -D "cn=administrator,cn=Users,dc=test,dc=loc" -W -H ldaps://ldap1t.test.loc:636 -b "ou=Identitiy,dc=test,dc=loc" -s sub -x "(objectclass=person)" Enter LDAP Password: # extended LDIF # # LDAPv3 # base <ou=Identitiy,dc=test,dc=loc> with scope subtree # filter: (objectclass=person) # requesting: ALL # # testuser2, Identitiy, test.loc dn: CN=testuser2,OU=Identitiy,DC=test,DC=loc objectClass: top objectClass: person objectClass: organizationalPerson objectClass: user cn: testuser2 instanceType: 4 whenCreated: 20191029150406.0Z uSNCreated: 4540 name: testuser2 objectGUID:: zfJ3SmPoLkO8wrVKP0Mc6g== badPwdCount: 0 codePage: 0 countryCode: 0 badPasswordTime: 0 lastLogoff: 0 primaryGroupID: 513 objectSid:: AQUAAAAAAAUVAAAAGQ/+ZjR2CNb9IiNGUQQAAA== accountExpires: 9223372036854775807 sAMAccountName: testuser2 sAMAccountType: 805306368 userPrincipalName: testuser2(a)test.loc objectCategory: CN=Person,CN=Schema,CN=Configuration,DC=test,DC=loc mail: test(a)test.loc userAccountControl: 512 lockoutTime: 0 pwdLastSet: 132257935214848870 lastLogon: 132258326087696220 logonCount: 9 lastLogonTimestamp: 132258326087696220 whenChanged: 20200210182328.0Z uSNChanged: 7912 distinguishedName: CN=testuser2,OU=Identitiy,DC=test,DC=loc # DovecotAdministrator, ServiceAccounts, Identitiy, test.loc dn: CN=DovecotAdministrator,OU=ServiceAccounts,OU=Identitiy,DC=test,DC=loc objectClass: top objectClass: person objectClass: organizationalPerson objectClass: user cn: DovecotAdministrator instanceType: 4 whenCreated: 20191029155812.0Z displayName: DovecotAdministrator uSNCreated: 4735 name: DovecotAdministrator objectGUID:: 6LODLEOIQ0iVbSDrOftLgg== badPwdCount: 0 codePage: 0 countryCode: 0 badPasswordTime: 0 lastLogoff: 0 lastLogon: 0 primaryGroupID: 513 objectSid:: AQUAAAAAAAUVAAAAGQ/+ZjR2CNb9IiNGUwQAAA== accountExpires: 9223372036854775807 logonCount: 0 sAMAccountName: DovecotAdministrator sAMAccountType: 805306368 userPrincipalName: DovecotAdministrator(a)test.loc objectCategory: CN=Person,CN=Schema,CN=Configuration,DC=test,DC=loc userAccountControl: 66048 pwdLastSet: 132240938772523690 lastLogonTimestamp: 132263319652676310 whenChanged: 20200216130605.0Z uSNChanged: 7935 distinguishedName: CN=DovecotAdministrator,OU=ServiceAccounts,OU=Identitiy,DC= test,DC=loc # search result search: 2 result: 0 Success # numResponses: 3 # numEntries: 2 Can someone give me a hint? Best Phil

3 2

dovecot-uidlist....
by Chi Min Wang 27 Feb '20

27 Feb '20

Hello Everyone: Is it possible to direct dovecot to modify dovecot-uidlist automatically?? I have some user who use ancient MUA(i.e. Openwebmail) and IMAP/POP3. Since Openwebmail will insert "Status: R" in the eml file,the size of the eml file will increase by 10 bytes. If the user use Openwebmail first,then the size record(S=xxxx) in dovecot-uidlist will be fine. But if he use POP3/IMAP(dovecot) first then use Openwebmail,the size record in dovecot-uidlist will not match the actual size modified by Openwebmail. This will cause dovecot killed by core dump. I'm wondering if there are any method to avoid this situation,Thanks!! *********************************************** CONFIDENTIALITY NOTICE:This e-mail and any attachments are confidential and may be legally privileged. If you are not the intended recipient, (i) please do not read or disclose to others, and (ii) please notify immediately the sender by reply mail, and (iii) please delete all copies of the email from your system. Failure to follow this process may be unlawful. We greatly appreciate your cooperation.

2 1

Matching regexps
by Adam Shostack 26 Feb '20

26 Feb '20

Hi, I'm having some trouble with matching. The regexp in my dovecot.sieve file should match on email addresses, but does not. # The code: if header :matches "From" "<[a-z0-9-]*(a)[a-z0-9-.]*>" { set "sender" "${1}"; } if not execute "grepfrom" ["${sender}"] { if envelope :matches "from" "*" { set "sender" "${1}"; } This failes to match Tamara Denning <tdenning(a)cs.utah.edu> when I check that regexp against that string at regex101.com, it shows a match, but the log (from sieve-test) shows: 348: header test 348: starting `:matches' match with `i;ascii-casemap' comparator: 348: extracting `From' headers from message 348: matching value `Tamara Denning <tdenning(a)cs.utah.edu>' 348: with key `.*<[a-z0-9-]*(a)[a-z0-9-.]*>' => 0 348: finishing match with result: not matched I would appreciate advice on why the match is failing, or what I can change to make it match. Thank you! Adam

2 1

Auto Subscribe not working for LDA/Sieve created Mailbox?
by Larry Rosenman 25 Feb '20

25 Feb '20

I have auto-subscribe turned on, but I had to doveadm mailbox subscribe to a LDA/Sieve created mailbox today. Did something break? doveconf -n attached. FreeBSD dovecot-2.3.9.3 Secure, fast and powerful IMAP and POP3 server dovecot-pigeonhole-0.5.9_1 Sieve plugin for the Dovecot 'deliver' LDA and LMTP -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

2 4

doveadm(nfsnobody) Error
by 横山航平 23 Feb '20

23 Feb '20

Please tell me about maillog Error. I get the following error in maillog：－－－ dovecot: doveadm(nfsnobody): Error: sync: User init failed dovecot: doveadm(nfsnobody): Error: User initialization failed: Namespace '': mkdir(/var/lib/nfs/Maildir) failed: Permission denied (euid=65534(nfsnobody) egid=65534(nfsnobody) missing +w perm: /var/lib/nfs, dir owned by 0:0 mode=0755) －－－ I am using Dsync and the configuration is below：－－－ service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u plugin { mail_replica = remote:root@XXX } service aggregator { fifo_listener replication-notify-fifo { mode = 0777 } unix_listener replication-notify { mode = 0777 } } service replicator { unix_listener replicator-doveadm { mode = 0600 } } replication_max_conns = 10 plugin { # When saving a new mail via IMAP or delivering a mail via LDA/LMTP, # wait for the mail to be synced to the remote site. If it doesn't finish # in 2 seconds, return success anyway. # replication_sync_timeout = 2s } －－－ Is the Dsync setting bad? please tell me.

2 1

Help needed with managesieve
by Laura Smith 22 Feb '20

22 Feb '20

Hi, I'm really struggling with the following inbound filtering: Let's say:• My email address is "my.email(a)example.com" • I've setup a filtered address "filtered.email(a)example.com" • I've setup a sending/reply address "send.email(a)example.com" I am sending a message to a small group of people where detailed tracking is required (yes, I know there are better automated ways outside of Dovecot to do this... but let's leave that topic for another day shall we !) My desired action is as follows : • Message "From" shows "send.email(a)example.com" • Message "To" is set as "filtered.email(a)example.com" • General recipients in Bcc When I send a test to an *external* address, it works as expected, i.e. : • External address receives mail in its inbox • Copy of mail gets put in relevant IMAP folder for "filtered.email(a)example.com" When I send a test to my own address, it does not work, the following happens instead: • Copy of mail gets put in relevant IMAP folder for "filtered.email(a)example.com" (this is good and as expected) • The BCC "my.email(a)example.com" never gets deposited in my inbox (this is not good) My dovecot sieve (as applied to "my.email(a)example.com") is as follows (I have tried both with and without the "stop" as you can see from the comment: anyof (address :is :all "to" ["send.email(a)example.com"], header :contains ["Cc", "Delivered-To"] ["send.email(a)example.com"]) { fileinto :create "XYZmail-replies"; # Ignore stop for this rule only # stop; } elsif anyof (address :is :all "to" ["filtered.email(a)example.com"], header :contains ["Cc", "Delivered-To"] ["filtered.email(a)example.com"]) { fileinto :create "XYZmail-sent"; # Ignore stop for this rule only # stop; }

2 1

Strategy for fts and Replication
by Francis Augusto Medeiros-Logeay 22 Feb '20

22 Feb '20

Hi there, I got successfully to replicate my mail server to another dovecot install using dsync, mainly for redundancy, and it works great. I want to try to install fts, as some of the mailboxes have tens of thousands of messages, and it takes minutes to get some results when searching via IMAP on a Roundcube interface. I want to experiment with fts-solr first, and firstly on my redundant server, ie., not on my main dovecot install. Is it ok to do this? I ask because I am afraid of how this whole reindexing on the redundant install will affect the production server. Also, any tips on something else than fts-solr? I tried it once, but it was so hard to get it right, so many configurations, java, etc., that I'd rather try something else. I also could try fts-elastic or something like that, but, again, having to maintain an elasticsearch install might use more resources than I think is worth. Any thoughts on that? Best, -- Francis

6 10

My sieve is failing
by ＠lbutlr 21 Feb '20

21 Feb '20

I have an active sieve file for my list account that alters the headers for this list (sets the reply-to address to the list instead of the poster) which is suddenly failing. require [ "regex", "variables", "fileinto", "envelope", "mailbox", "imap4flags", "editheader" ]; /* other stuff */ elsif header :contains "List-id" "dovecot.dovecot.org" { if header :matches "Reply-to" "*" { deleteheader "From"; addheader "From" "${1}"; deleteheader "Reply-To"; addheader "Reply-To" "dovecot(a)dovecot.org"; addheader "X-Covisp-Reply-To" "True"; } fileinto :create "dovecot"; stop;} And the trace file: 55: header test 55: starting `:contains' match with `i;ascii-casemap' comparator: 55: extracting `List-id' headers from message 55: matching value `Dovecot Mailing List <dovecot.dovecot.org>' 55: with key `dovecot.dovecot.org' => 1 55: finishing match with result: matched 55: jump if result is false 55: not jumping 56: header test 56: starting `:matches' match with `i;ascii-casemap' comparator: 56: extracting `Reply-to' headers from message 56: finishing match with result: not matched 56: jump if result is false 56: jumping to line 63 63: fileinto action 63: store message in mailbox `dovecot' 64: stop command; end all script execution ## Finished executing script '.active_sieve’ Neither the reply-to header nor the x- header are actually getting added, but the block is getting executed and the mail is filed in the right folder. In dovecot.conf I (still) have: managesieve_sieve_capability = editheader fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave

1 1

Test failure on ARM: backtrace_append
by Julien Lepiller 21 Feb '20

21 Feb '20

Hi, I am a packager in Guix and user of dovecot on an ARM server (armhf). The Guix package fails to build because of a test error (see the last lines of the full build log: https://ci.guix.gnu.org/log/f5if2qb5rsqag3a6jy5vga1l9hm9pkj0-dovecot-2.3.9.3) As the name suggests, this is dovecot 2.3.9.3, the latest version. Previous versions built fine, as well as the same version on x86 and x86_64. Note that the build on guix's build farm was done in a qemu vm, but I got the same test failure on real hardware. I'm not sure what the best course of action is. Did I find a legitimate bug, or should I simply ignore that test for that architecture? Dovecot itself seems to be running fine when I ignore the tests. Thanks for any guidance you could provide!

2 8

How does dovecot determine users from /etc/passwd?
by Philip Colmer 20 Feb '20

20 Feb '20

We're using dovecot on a help desk ticketing system. The system doesn't perform any cleanup of IMAP mailboxes so we have a regular cronjob doing this: /usr/bin/doveadm flags add -A '\Deleted' SEEN SENTBEFORE 12w && /usr/bin/doveadm expunge -A DELETED MAILBOX '*' Recently, doveadm has been reporting this: doveadm(nobody): Error: User initialization failed: Namespace '': mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) egid=65534(nogroup)) doveadm(nobody): Error: User init failed doveadm(DEFAULT-CW-USER): Info: User no longer exists, skipping Indeed, using doveadm user "*" does include "nobody" in the list but I can't understand why. The mail group in /etc/group does not include "nobody" and there are users in /etc/passwd with similar attributes to "nobody" that do not appear in the list of users from doveadm. What can I do to tell doveadm to forget about "nobody"? Thanks. Philip

4 4