January 2020 - dovecot

Dovecot authentication through proxy
by Daniel Niewerth 28 Jan '20

28 Jan '20

Hi everybody, I run two redundant Dovecot servers with a shared Maildir on a GlusterFS volume and a SQL authentication backend based on a mirrored MariaDB database. Because of the splitbrain situation I would like to add two Dovecot Director as proxies. Since a few days I am trying to get the setup running. In the meantime I have achieved that the clients can successfully authenticate on the proxy and that the client connections are forwarded to the backend servers. Unfortunately I still have the problem that no authentication attempts are made on the backend servers. Can someone explain me how to solve this problem? I have read that it is eventually possible to work with Master Users. But I guess that won't work for me, because I use the mailcrypt plugin and the client password is also the password for the encryption key. Best regards Daniel ### Proxy Log ### ############### Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth-worker(20760): Debug: sql(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): Finished passdb lookup Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth-worker(20760): Debug: conn unix:auth-worker (pid=20753,uid=112): auth-worker<1>: Finished Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: sql(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): username changed ***(a)***.** -> *** Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: sql(***,192.168.1.100,<sNTHFdOcbeDAqAFk>): username changed *** -> ***(a)***.** Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: sql(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): Finished passdb lookup Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: auth(***(a)***.**,192.168.1.100,<sNTHFdOcbeDAqAFk>): Auth request finished Jan 23 19:48:21 vsrv-***-prx01 dovecot: auth: Debug: client passdb out: OK#0111#011user=***(a)***.**#011proxy#011ssl=any-cert#011starttls=any-cert#011lip=192.168.20.49#011lport=993#011pass=<hidden> Jan 23 19:48:21 vsrv-***-prx01 dovecot: imap-login: Debug: Ignoring unknown passdb extra field: lip Jan 23 19:48:21 vsrv-***-prx01 dovecot: imap-login: Debug: Ignoring unknown passdb extra field: lport ### Backend Log ### ################### Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<r9yRF9OcZODAqBQx> Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<4C+SF9OcauDAqBQx> Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<KDGSF9OcZuDAqBQx> Jan 23 18:48:51 vsrv-***-mta01 dovecot: imap-login: Disconnected (no auth attempts in 30 secs): user=<>, rip=192.168.20.49, lip=192.168.20.28, TLS handshaking: Connection closed, session=<lwKTF9OcbuDAqBQx> ### Proxy Config ### #################### # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # OS: Linux 4.15.0-74-generic x86_64 Ubuntu 18.04.3 LTS # Hostname: vsrv-***-prx01 auth_debug = yes director_mail_servers = 192.168.20.28 192.168.20.29 director_servers = 192.168.20.49:9090 192.168.20.58:9090 disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } passdb { driver = pam } protocols = " imap" service director { inet_listener { port = 9090 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service pop3-login { executable = pop3-login director } ssl = required ssl_cert = </etc/dovecot/private/***-**-fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECDH:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kE$ ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { auth_socket_path = director-userdb } ### Backend Config ### ###################### # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: Linux 4.15.0-72-generic x86_64 Ubuntu 18.04.3 LTS # Hostname: vsrv-**-mta01.**.**.***.** auth_debug = yes auth_mechanisms = plain login mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_fsync = always mail_gid = vmail mail_home = /var/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify mail_crypt" mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_crypt_curve = brainpoolP512r1 mail_crypt_require_encrypted_user_key = # hidden, use -P to show it mail_crypt_save_version = 2 quota = maildir:User quota quota_exceeded_message = Benutzer %u hat das Speichervolumen überschritten. / User %u has exhausted allowed storage space. sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-script.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = required ssl_cert = </etc/letsencrypt/live/******/fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECDH:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 20 mail_plugins = " notify mail_crypt quota imap_quota imap_sieve" } protocol lmtp { mail_plugins = " notify mail_crypt sieve" postmaster_address = postmaster(a)***.** } -- This email was Malware checked by vsrv-dus6-fwl01

2 2

Number of imap-login processes always keeps growing, never goes down
by Jasper Siepkes 26 Jan '20

26 Jan '20

Hi all! I've bumped into an issue which Dovecot which has me a bit stumped; All of a sudden (ie. no obvious changes made to the config as far as I know) Dovecot seems to never stop 'imap-login' processes. This continues to the point where it will hit the 'process_limit'. For a 50-ish user install the limit was set to 100 but I increased it to 512. The only thing this changes it that Dovecot takes a little longer to hit the limit. I started having this problem with Dovecot version 2.3.2.1. After which I updated to the latest version of Dovecot (2.3.9.2) to see if that would fix my problem. However I'm still experiencing the same issue. For a bit of context; We use Dovecot with Open-Xchange where users login via OIDC, get a token and then use that token with Dovecot with the 'oauthbearer' auth method. However users can also login via a username / password combo stored in LDAP for clients that don't support 'oauthbearer' (ie. about all the mail clients ;-). We run Dovecot on SmartOS (ie. Illumos, a Solaris derivative). Oddly enough 'doveadm' is under the impression there are only 3 users loggedin (when there are 512 imap-login processes). I think 'doveadm who' doesn't show users who are authenticated via an token (oauthbearer) because I only see 3 users and I don't see my own user which is logged in via Open-Xchange by using oauthbearer as auth method. I've anonimized the output but you get the idea: ----8<-------------------- # doveadm who username # proto (pids) (ips) foo1(a)foo.nl 2 imap (78393 78391) (52.XXX.XXX.XXX) foo2(a)foo.nl 2 imap (72548 72547) (52.XXX.XXX.XXX) foo3(a)foo.nl 2 imap (480893 481231) (54.XXX.XXX.XXX 54.XXX.XXX.XXX) ----8<-------------------- I don't know if the above issue is related to my problem but the oauthbearer sessions not showing up seems like a bug? Meanwhile there are 512 Dovecot imap-login processes: ----8<-------------------- # ptree | grep imap-login | wc -l 513 ----8<-------------------- I realise that the 'imap-login' process also works as a IMAP proxy and that it stays alive during the entire session of the client since it handles the TLS part of the connection. However there are nowhere near 512 connections active. As far as I know IMAP doesn't support multiplexing (ie. multiple IMAP sessions in a single TCP connection) so with 512 imap-login proccess I would expect to see a lot more connections then I'm seeing: ----8<-------------------- # netstat -a TCP: IPv4 Local Address Remote Address Swind Send-Q Rwind Recv-Q State -------------------- -------------------- ------ ------ ------ ------ ----------- *.ssh *.* 0 0 1048576 0 LISTEN dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.53136 178176 0 1049580 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.53188 126848 0 1049580 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 83.XXX.XXX.XXX.64845 132352 0 1048960 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.7937 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.3.4983 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.34369 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.3.15041 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.49044 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.3.6340 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 10.100.2.2.11331 16384 0 1049800 0 CLOSE_WAIT dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.49920 94976 0 1049580 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.58569 10.100.3.84.ldap 1049792 0 1049800 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.33749 10.100.3.84.ldap 1049792 0 1049800 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps 52.XXX.XXX.XXX.49966 46464 0 1049580 0 ESTABLISHED *.4190 *.* 0 0 1048576 0 LISTEN *.24 *.* 0 0 1048576 0 LISTEN *.imap2 *.* 0 0 1048576 0 LISTEN *.imaps *.* 0 0 1048576 0 LISTEN dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps ec2-54-210-254-232.compute-1.amazonaws.com.32892 107904 0 1049800 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.ssh 10.101.2.14.59256 64128 35 1049880 0 ESTABLISHED dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl.imaps ec2-54-167-34-137.compute-1.amazonaws.com.3890 549632 0 1049800 0 ESTABLISHED TCP: IPv6 Local Address Remote Address Swind Send-Q Rwind Recv-Q State If --------------------------------- --------------------------------- ------ ------ ------ ------ ----------- ----- *.ssh *.* 0 0 1048576 0 LISTEN Active UNIX domain sockets Address Type Vnode Conn Local Address Remote Address ----8<-------------------- This is the running Dovecot config: ----8<-------------------- # doveconf -n -c /etc/dovecot/dovecot.conf # 2.3.9.2 (cf2918cac): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: SunOS 5.11 i86pc # Hostname: dovecot-1.inst.sp-prod.nl1.cns.supersecretcorp.nl auth_failure_delay = 3 secs auth_mechanisms = plain oauthbearer xoauth2 base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 1000 hostname = imap.supersecretcorp.nl instance_name = dovecot-1 listen = * lmtp_rcpt_check_quota = yes log_path = /dev/stderr mail_attachment_dir = /var/lib/dovecot/attachments mail_attachment_fs = sis-queue /var/lib/dovecot/attachments/queue:posix mail_attachment_hash = %{sha256} mail_attribute_dict = file:~/mdbox/dovecot-attributes mail_gid = vmail mail_home = /var/lib/dovecot/vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = " quota notify" mail_server_admin = mailto:it@ask.supersecretcorp.nl mail_temp_dir = /var/lib/dovecot/tmp mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext metric imap_command_fetch_ok { event_name = imap_command_finished filter { name = FETCH tagged_reply_stat = OK } } metric imap_command_list { event_name = imap_command_finished filter { name = LIST tagged_reply_state = OK } } metric imap_command_search { event_name = imap_command_finished filter { name = SEARCH tagged_reply_stat = OK } } metric imap_command_select { event_name = imap_command_finished filter { name = SELECT tagged_reply_state = OK } } metric imap_select_no { event_name = imap_command_finished filter { name = SELECT tagged_reply_state = NO } } metric imap_select_no_notfound { event_name = imap_command_finished filter { name = SELECT tagged_reply = NO*Mailbox doesn't exist:* } } metric storage_http_gets { categories = storage event_name = http_request_finished filter { method = get } } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox "Sent objects" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-oauth2.conf.ext driver = oauth2 mechanisms = oauthbearer xoauth2 } passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { push_notification_driver = ox:url=http://#hidden_use-P_to_show#@open-xchange.svc.sp-prod.nl1.cns.supersecretcorp.nl:8009/preliminary/http-notify/v1/notify user_from_metadata quota = count:User quota quota_rule2 = Trash:storage=+25M quota_vsizes = yes sieve = file:~/sieve;active=~/.dovecot.sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_quota_max_scripts = 500 sieve_quota_max_storage = 10M sieve_vacation_send_from_recipient = yes } postmaster_address = postmaster(a)supersecretcorp.nl protocols = imap lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = vmail mode = 0770 user = dovecot } user = $default_internal_user } service imap-login { process_limit = 512 process_min_avail = 1 service_count = 1 } service imap { process_limit = 512 } service lmtp { inet_listener lmtp { address = * port = 24 } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 } service managesieve { process_limit = 256 } service stats { unix_listener stats-reader { group = vmail mode = 0660 user = vmail } unix_listener stats-writer { group = vmail mode = 0660 user = vmail } } ssl_client_ca_dir = /opt/local/etc/openssl/certs ssl_dh = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 submission_host = postfix.svc.sp-prod.nl1.cns.supersecretcorp.nl:25 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_plugins = " quota notify imap_quota" ssl_cert = </etc/dovecot/pki/imap.supersecretcorp.nl.crt ssl_key = # hidden, use -P to show it } protocol submission { ssl_cert = </etc/dovecot/pki/smtp.supersecretcorp.nl.crt ssl_key = # hidden, use -P to show it } protocol lmtp { mail_plugins = quota sieve notify push_notification postmaster_address = postmaster(a)supersecretcorp.nl } remote 10.100.2.0/23 { protocol imap { imap_metadata = yes } } ----8<-------------------- Hoping anyone can offer any insights! Kind regards, Jasper

1 0

Lookup master userdb used with GSSAPI causes auth-worker to report "Error: BUG: PASSL had invalid passdb ID"
by Filip Matijević 25 Jan '20

25 Jan '20

Hello to everybody, I'm in the process of setting up test mail server (Ubuntu 19.10 amd64 running as VM under Hyper-V) and got stuck on configuring master user authentication. I use GSSAPI authentication in parallel with PLAIN/LOGIN (pam backend that authenticates against my Active Directory domain) and this works as intended. I then tried adding simple static master passdb that simply returns nopassword='y' and k5principals=... for test and it also works OK. Sadly, using any other backend (I've tried lua and sql) for master passdb instead of static in combination with GSSAPI client causes auth-worker to report "Error: BUG: PASSL had invalid passdb ID". I took a look at the code and my best guess is that in case of GSSAPI + sql/lua master passdb we end up with call to auth_worker_handle_passl with id that auth_worker_handle_passl considers invalid. Continuing with guesswork, I imagine that since GSSAPI doesn't really need passdb in config "virtual" passdb is generated "on the fly" in code. I even tried explicitly defining static passdb with mechanisms set to gssapi to try to force dovecot to use that one instead but it didn't make any difference. At the same time, below configuration works OK when client authenticates with plain/login. dovecot -n (some settings omitted for brevity): # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = * auth_mechanisms = plain login gssapi passdb { args = /etc/dovecot/dovecot-sql-master.conf driver = sql master = yes } passdb { driver = pam } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } Any help is appreciated, even if it requires code changes - I can set up machine with everything needed for building/debugging the source code. Thanks, Filip

1 0

sieve size match with multiple of 4GB not matching (BUG?)
by Matthias Lay 24 Jan '20

24 Jan '20

Hi, I have noticed a strange behaviour when using size matches with GB in sieve. If I use filter that matches mails smaller then 4, or 8GB it does not match in any case. same filter matches with 3,5,6,7 GB example filter: require "vnd.dovecot.debug"; if allof (size :under 4G) { debug_log "MATCH"; } else { debug_log "NO MATCH"; } # sieve-filter -u johnd filter.sieve INBOX >> Filtering message: ID: <5167DFC8.8040207@XXXXXX> Date: Fri, 12 Apr 2013 12:19:52 +0200 Size: 1820898 bytes Subject: Fwd: Multi-media mail demonstration info: DEBUG: NO MATCH. ************************************************************************** same mail with this sieve rule: if allof (size :under 5G) { debug_log "MATCH"; } else { debug_log "NO MATCH"; } # sieve-filter -u johnd filter.sieve INBOX >> Filtering message: ID: <5167DFC8.8040207@XXXXXX> Date: Fri, 12 Apr 2013 12:19:52 +0200 Size: 1820898 bytes Subject: Fwd: Multi-media mail demonstration info: DEBUG: MATCH. same for M. 4096M => NO MATCH 4097M => MATCH Greetz Matze

1 0

Re: Namespace problem? duplicated folders...
by Daniel Miller 24 Jan '20

24 Jan '20

And I should have seen that from your first post but output from "doveconf" is definitive. -- Daniel On 1/23/2020 6:57 PM, Daniel Miller wrote: > Keeping in mind I'm 0% Dovecot certified and 100% certifiable... > > I'm guessing you have your namespace definition separate from your > special-use mailbox declarations. Possibly in 10-mail.conf and > 15-mailboxes.conf? Not that it matters. > > First sugggestion - that first namespace definition. Change it from: > > namespace { > > to > > namespace inbox { > > and see what happens. > > -- > Daniel > > > On 1/23/2020 4:40 PM, Gregory Sloop wrote: >> >> >> *DM> Interesting. >> >> DM> While I don't use mbox (dbox or maildir) I wouldn't think that would >> DM> matter. Your namespace layout looks nearly the same as my own. But to >> DM> verify what's going on - post the output of "doveconf namespace". >> >> DM> Possibly just reviewing that output may tell you enough - otherwise >> DM> share it (fully) here. >> >> DM> -- >> DM> Daniel >> >> *namespace { >> disabled = no >> hidden = no >> ignore_on_failure = no >> inbox = yes >> list = yes >> location = >> order = 0 >> prefix = INBOX/ >> separator = / >> subscriptions = yes >> type = private >> } >> namespace inbox { >> disabled = no >> hidden = no >> ignore_on_failure = no >> inbox = no >> list = yes >> location = >> mailbox Drafts { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Drafts >> } >> mailbox Junk { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Junk >> } >> mailbox Sent { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Sent >> } >> mailbox Trash { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Trash >> } >> order = 0 >> prefix = >> separator = >> subscriptions = yes >> type = private >> } >> > >

1 0

wrong Messages in virtual Folder
by Frank-Ulrich Sommer 24 Jan '20

24 Jan '20

Hello, I created a virtual Folder that should contain all Mails from several different Folders and their subfolders. Recently I added a new folder to the dovecot-virtual file and then found that most Mails from this folder were missing. I always restartet dovecot (is this necessary?) after any change. The system is running Debian Stretch and I am using the supplied dovecot 2.2.7 (see below for output of doveconf -n). To narrow this down I removed all other directories from the dovecot-virtual file and then found that the number of mails is correct, but most mails are the wrong ones from other directories. The dovecot-virtual file currently contains only the source directory and in the last line 4 spaces followed by the keyword "all" and a newline. Mails that where moved there after the directory was added to the virtual folder seemed to be displayed correct. If I move one Mail away from the source diectory a totally different Mail in the virtual Folder disappers. After moving the file back to the source folder it correctly appears in the virtual folder. What might be the cause and how can I fix it? Thanks, Frank Output of "doveconf -n": # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 zfs auth_verbose = yes log_path = /var/log/dovecot.log mail_location = maildir:/home/bananamail/Maildir:INDEX=/var/dovecot_indexes/%u mail_plugins = " virtual fts fts_solr" mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { location = virtual:~/Maildir/virtual prefix = _virtual. separator = . type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { fts = solr fts_autoindex = yes fts_enforced = yes fts_solr = break-imap-search url=http://localhost:8080/solr/ sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster@localhost protocols = imap service imap-login { inet_listener imaps { port = XXXX ssl = yes } } ssl = required ssl_cert = <XXXXXXXXX/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!SSLv3:!EXP:!aNULL ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !TLSv1 userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol imap { mail_max_userip_connections = 200 }

1 0

intermittant passdb error
by NeuralNET 23 Jan '20

23 Jan '20

I'm having great difficulty debugging this problem.. I'm having intermittant problems connecting to dovecot. This started a couple of days ago following an apt-get update on the server. I'm running Ubuntu 14.04, dovecot 2.2.9. Here's my dovecot -n --- # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.19.0-59-generic x86_64 Ubuntu 14.04.4 LTS auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve_dir = ~/sieve } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } user = $default_internal_user } ssl = required ssl_cert = </etc/dovecot/box.neuralnet.org.uk_crt.pem ssl_key = </etc/dovecot/box.neuralnet.org.uk_key.pem ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } --- Pretty standard stuff. In addition disable_plaintext_auth = yes is set in 10-auth.conf This showed up in the mail.err after the reboot; --- May 17 09:04:51 server dovecot: imap-login: Error: read(anvil) failed: EOF May 17 09:04:51 server dovecot: auth: Error: read(anvil-auth-penalty) failed: EOF May 17 09:04:51 server dovecot: auth: Error: net_connect_unix(anvil-auth-penalty) failed: Permission denied --- At that point The following commands were run on the server a few minutes apart with no changes made in the interim; --- username@box /etc/dovecot $ doveadm user username field valueuserdb lookup: user username doesn't exist username@box /etc/dovecot $ doveadm user username field value uid 1000 gid 1000 home /home/username mail maildir:~/Maildir system_groups_user username --- so, passdb wasn't accessible, but now it is ? Imap logins are showing in mail.log as failing, but thunderbird is currently connected; --- May 18 12:00:58 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 19 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> May 18 12:08:27 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 20 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> May 18 12:08:50 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 12 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> --- do I conclude that method=plain is failing, whereas method=login succeeds ? I tried setting auth_debug_password=yes and get the following; --- May 18 12:26:42 box dovecot: auth: Debug: client in: CONT#0111#011A********== (previous base64 data may contain sensitive data) May 18 12:26:42 box dovecot: auth-worker(12214): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth May 18 12:26:42 box dovecot: auth-worker(12214): Debug: pam(expert,10.0.0.3): lookup service=dovecot May 18 12:26:42 box dovecot: auth-worker(12214): Debug: pam(expert,10.0.0.3): #1/1 style=1 msg=Password: May 18 12:26:42 box dovecot: auth-worker(12211): pam(username,10.0.0.3): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: ******) May 18 12:26:44 box dovecot: auth: Debug: client passdb out: FAIL#0112#011user=username --- Any assistance debugging this further is greatly recieved! Thanks.

2 2

Bug: Regex doesn't match ungreedy
by Lorenz Steinert 23 Jan '20

23 Jan '20

Hello, first the mandatory dovecot specs: - dovecot 2.3.9.2-1 - Operating system: Archlinux - x84 cpu - ext4 filesystem My problem is that the sieve regex filter doesn't seem to match ungreedely so the regex: ^(Re: |)\\[(.*?)\\/(.*?)\\] evaluates the last capturing group of [matrix-org/synapse] [Don't merge!!] Backport fix for MAU limits to v1.8.0 (#6763) to synapse] [Don't merge!! wich should have been synapse Best Regards Lorenz Steinert

2 1

Is it possible to enable push notifications for iOS/macOS mail clients on a stock dovecot?
by Gerben Wierda 23 Jan '20

23 Jan '20

Now that Apple has abandoned mail server capabilities in macOS Server.app we have to move to an open source solution. I have done this using Macports and it works well (no thanks to Apple as it never published the in 2018 promised migration info for mail services). The MacPorts Apple Push Notification variant based on a patch written a few years ago for dovecot supports APNS but it requires you to export a certificate form your old High Sierra Server.app. With the patch and that certificate, dovecot tells an email client it supports XAPPLEPUSHSERVICE and that makes Apple mail clients think they are talking to macOS Server and they switch to push notifications for updates. Now, that certificate needs to be renewed yearly by Server.app and imported by hand etc. At some point this will stop working (apart from that you need to keep an old macOS Server around to renew) Is there another way to get this working with an open source dovecot, outside of using Apple’s push notification service? Some other standard? Some other service? Probably not, right? G

5 5

Using dsync for a single mailbox?
by Wim Lewis 23 Jan '20

23 Jan '20

Is it possble to use `doveadm sync` to migrate a single mailbox? I'm migrating accounts from another IMAP server,and most of the mailboxes are in mbox or maildir format, but a few are in MBX. As far as I can tell the only recommended way to "convert" an MBX mailbox is to sync it via imap. But dsync fails in inscrutable ways, and the documentation is kind of scant on how to control what it does. Even just an example command line showing how to copy remote mailbox FOO into dovecot mailbox BAR would be extremely helpful.

2 4