- dovecot - dovecot.org

Lookup master userdb used with GSSAPI causes auth-worker to report "Error: BUG: PASSL had invalid passdb ID"
by Filip Matijević 25 Jan '20

25 Jan '20

Hello to everybody, I'm in the process of setting up test mail server (Ubuntu 19.10 amd64 running as VM under Hyper-V) and got stuck on configuring master user authentication. I use GSSAPI authentication in parallel with PLAIN/LOGIN (pam backend that authenticates against my Active Directory domain) and this works as intended. I then tried adding simple static master passdb that simply returns nopassword='y' and k5principals=... for test and it also works OK. Sadly, using any other backend (I've tried lua and sql) for master passdb instead of static in combination with GSSAPI client causes auth-worker to report "Error: BUG: PASSL had invalid passdb ID". I took a look at the code and my best guess is that in case of GSSAPI + sql/lua master passdb we end up with call to auth_worker_handle_passl with id that auth_worker_handle_passl considers invalid. Continuing with guesswork, I imagine that since GSSAPI doesn't really need passdb in config "virtual" passdb is generated "on the fly" in code. I even tried explicitly defining static passdb with mechanisms set to gssapi to try to force dovecot to use that one instead but it didn't make any difference. At the same time, below configuration works OK when client authenticates with plain/login. dovecot -n (some settings omitted for brevity): # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = * auth_mechanisms = plain login gssapi passdb { args = /etc/dovecot/dovecot-sql-master.conf driver = sql master = yes } passdb { driver = pam } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } Any help is appreciated, even if it requires code changes - I can set up machine with everything needed for building/debugging the source code. Thanks, Filip

1 0

sieve size match with multiple of 4GB not matching (BUG?)
by Matthias Lay 24 Jan '20

24 Jan '20

Hi, I have noticed a strange behaviour when using size matches with GB in sieve. If I use filter that matches mails smaller then 4, or 8GB it does not match in any case. same filter matches with 3,5,6,7 GB example filter: require "vnd.dovecot.debug"; if allof (size :under 4G) { debug_log "MATCH"; } else { debug_log "NO MATCH"; } # sieve-filter -u johnd filter.sieve INBOX >> Filtering message: ID: <5167DFC8.8040207@XXXXXX> Date: Fri, 12 Apr 2013 12:19:52 +0200 Size: 1820898 bytes Subject: Fwd: Multi-media mail demonstration info: DEBUG: NO MATCH. ************************************************************************** same mail with this sieve rule: if allof (size :under 5G) { debug_log "MATCH"; } else { debug_log "NO MATCH"; } # sieve-filter -u johnd filter.sieve INBOX >> Filtering message: ID: <5167DFC8.8040207@XXXXXX> Date: Fri, 12 Apr 2013 12:19:52 +0200 Size: 1820898 bytes Subject: Fwd: Multi-media mail demonstration info: DEBUG: MATCH. same for M. 4096M => NO MATCH 4097M => MATCH Greetz Matze

1 0

Re: Namespace problem? duplicated folders...
by Daniel Miller 24 Jan '20

24 Jan '20

And I should have seen that from your first post but output from "doveconf" is definitive. -- Daniel On 1/23/2020 6:57 PM, Daniel Miller wrote: > Keeping in mind I'm 0% Dovecot certified and 100% certifiable... > > I'm guessing you have your namespace definition separate from your > special-use mailbox declarations. Possibly in 10-mail.conf and > 15-mailboxes.conf? Not that it matters. > > First sugggestion - that first namespace definition. Change it from: > > namespace { > > to > > namespace inbox { > > and see what happens. > > -- > Daniel > > > On 1/23/2020 4:40 PM, Gregory Sloop wrote: >> >> >> *DM> Interesting. >> >> DM> While I don't use mbox (dbox or maildir) I wouldn't think that would >> DM> matter. Your namespace layout looks nearly the same as my own. But to >> DM> verify what's going on - post the output of "doveconf namespace". >> >> DM> Possibly just reviewing that output may tell you enough - otherwise >> DM> share it (fully) here. >> >> DM> -- >> DM> Daniel >> >> *namespace { >> disabled = no >> hidden = no >> ignore_on_failure = no >> inbox = yes >> list = yes >> location = >> order = 0 >> prefix = INBOX/ >> separator = / >> subscriptions = yes >> type = private >> } >> namespace inbox { >> disabled = no >> hidden = no >> ignore_on_failure = no >> inbox = no >> list = yes >> location = >> mailbox Drafts { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Drafts >> } >> mailbox Junk { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Junk >> } >> mailbox Sent { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Sent >> } >> mailbox Trash { >> auto = no >> autoexpunge = 0 >> comment = >> driver = >> special_use = \Trash >> } >> order = 0 >> prefix = >> separator = >> subscriptions = yes >> type = private >> } >> > >

1 0

wrong Messages in virtual Folder
by Frank-Ulrich Sommer 24 Jan '20

24 Jan '20

Hello, I created a virtual Folder that should contain all Mails from several different Folders and their subfolders. Recently I added a new folder to the dovecot-virtual file and then found that most Mails from this folder were missing. I always restartet dovecot (is this necessary?) after any change. The system is running Debian Stretch and I am using the supplied dovecot 2.2.7 (see below for output of doveconf -n). To narrow this down I removed all other directories from the dovecot-virtual file and then found that the number of mails is correct, but most mails are the wrong ones from other directories. The dovecot-virtual file currently contains only the source directory and in the last line 4 spaces followed by the keyword "all" and a newline. Mails that where moved there after the directory was added to the virtual folder seemed to be displayed correct. If I move one Mail away from the source diectory a totally different Mail in the virtual Folder disappers. After moving the file back to the source folder it correctly appears in the virtual folder. What might be the cause and how can I fix it? Thanks, Frank Output of "doveconf -n": # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 zfs auth_verbose = yes log_path = /var/log/dovecot.log mail_location = maildir:/home/bananamail/Maildir:INDEX=/var/dovecot_indexes/%u mail_plugins = " virtual fts fts_solr" mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { location = virtual:~/Maildir/virtual prefix = _virtual. separator = . type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { fts = solr fts_autoindex = yes fts_enforced = yes fts_solr = break-imap-search url=http://localhost:8080/solr/ sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster@localhost protocols = imap service imap-login { inet_listener imaps { port = XXXX ssl = yes } } ssl = required ssl_cert = <XXXXXXXXX/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!SSLv3:!EXP:!aNULL ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !TLSv1 userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol imap { mail_max_userip_connections = 200 }

1 0

intermittant passdb error
by NeuralNET 23 Jan '20

23 Jan '20

I'm having great difficulty debugging this problem.. I'm having intermittant problems connecting to dovecot. This started a couple of days ago following an apt-get update on the server. I'm running Ubuntu 14.04, dovecot 2.2.9. Here's my dovecot -n --- # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.19.0-59-generic x86_64 Ubuntu 14.04.4 LTS auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve_dir = ~/sieve } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } user = $default_internal_user } ssl = required ssl_cert = </etc/dovecot/box.neuralnet.org.uk_crt.pem ssl_key = </etc/dovecot/box.neuralnet.org.uk_key.pem ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } --- Pretty standard stuff. In addition disable_plaintext_auth = yes is set in 10-auth.conf This showed up in the mail.err after the reboot; --- May 17 09:04:51 server dovecot: imap-login: Error: read(anvil) failed: EOF May 17 09:04:51 server dovecot: auth: Error: read(anvil-auth-penalty) failed: EOF May 17 09:04:51 server dovecot: auth: Error: net_connect_unix(anvil-auth-penalty) failed: Permission denied --- At that point The following commands were run on the server a few minutes apart with no changes made in the interim; --- username@box /etc/dovecot $ doveadm user username field valueuserdb lookup: user username doesn't exist username@box /etc/dovecot $ doveadm user username field value uid 1000 gid 1000 home /home/username mail maildir:~/Maildir system_groups_user username --- so, passdb wasn't accessible, but now it is ? Imap logins are showing in mail.log as failing, but thunderbird is currently connected; --- May 18 12:00:58 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 19 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> May 18 12:08:27 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 20 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> May 18 12:08:50 box dovecot: imap-login: Disconnected (auth failed, 3 attempts in 12 secs): user=<username>, method=PLAIN, rip=10.0.0.3, lip=10.0.0.99, TLS, session=<********> --- do I conclude that method=plain is failing, whereas method=login succeeds ? I tried setting auth_debug_password=yes and get the following; --- May 18 12:26:42 box dovecot: auth: Debug: client in: CONT#0111#011A********== (previous base64 data may contain sensitive data) May 18 12:26:42 box dovecot: auth-worker(12214): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth May 18 12:26:42 box dovecot: auth-worker(12214): Debug: pam(expert,10.0.0.3): lookup service=dovecot May 18 12:26:42 box dovecot: auth-worker(12214): Debug: pam(expert,10.0.0.3): #1/1 style=1 msg=Password: May 18 12:26:42 box dovecot: auth-worker(12211): pam(username,10.0.0.3): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: ******) May 18 12:26:44 box dovecot: auth: Debug: client passdb out: FAIL#0112#011user=username --- Any assistance debugging this further is greatly recieved! Thanks.

2 2

Bug: Regex doesn't match ungreedy
by Lorenz Steinert 23 Jan '20

23 Jan '20

Hello, first the mandatory dovecot specs: - dovecot 2.3.9.2-1 - Operating system: Archlinux - x84 cpu - ext4 filesystem My problem is that the sieve regex filter doesn't seem to match ungreedely so the regex: ^(Re: |)\\[(.*?)\\/(.*?)\\] evaluates the last capturing group of [matrix-org/synapse] [Don't merge!!] Backport fix for MAU limits to v1.8.0 (#6763) to synapse] [Don't merge!! wich should have been synapse Best Regards Lorenz Steinert

2 1

Is it possible to enable push notifications for iOS/macOS mail clients on a stock dovecot?
by Gerben Wierda 23 Jan '20

23 Jan '20

Now that Apple has abandoned mail server capabilities in macOS Server.app we have to move to an open source solution. I have done this using Macports and it works well (no thanks to Apple as it never published the in 2018 promised migration info for mail services). The MacPorts Apple Push Notification variant based on a patch written a few years ago for dovecot supports APNS but it requires you to export a certificate form your old High Sierra Server.app. With the patch and that certificate, dovecot tells an email client it supports XAPPLEPUSHSERVICE and that makes Apple mail clients think they are talking to macOS Server and they switch to push notifications for updates. Now, that certificate needs to be renewed yearly by Server.app and imported by hand etc. At some point this will stop working (apart from that you need to keep an old macOS Server around to renew) Is there another way to get this working with an open source dovecot, outside of using Apple’s push notification service? Some other standard? Some other service? Probably not, right? G

5 5

Using dsync for a single mailbox?
by Wim Lewis 23 Jan '20

23 Jan '20

Is it possble to use `doveadm sync` to migrate a single mailbox? I'm migrating accounts from another IMAP server,and most of the mailboxes are in mbox or maildir format, but a few are in MBX. As far as I can tell the only recommended way to "convert" an MBX mailbox is to sync it via imap. But dsync fails in inscrutable ways, and the documentation is kind of scant on how to control what it does. Even just an example command line showing how to copy remote mailbox FOO into dovecot mailbox BAR would be extremely helpful.

2 4

Dovecot - Upgrade Solr 7.7.2 to 8.4.1
by Domenico Pastore 23 Jan '20

23 Jan '20

Hello, I have Dovecot configured with Solr for the indexes. I have need your support for upgrade solr 7.7.2 to 8.4.1. Solr 7.7.2 has a security issue CVE-2019-12409. It's possible upgrade of Solr? Dovecot work correctly with Solr 8.x? The Solr documentation recommended after updating: "It is always strongly recommended that you fully reindex your documents after a major version upgrade." There are tips for Dovecot? Br, Domenico

4 4

Re: JMAP support in Dovecot
by Mike Gao 22 Jan '20

22 Jan '20

Hi, Any news for jmap Support in Dovecot? Thanks, Mike

1 0

socket dovecot-lmtp is not created anymore
by ratatouille 22 Jan '20

22 Jan '20

Hello! Since experiments on my testserver two days ago /var/spool/postfix/private/dovecot-lmtp is not created anymore. This the setting in /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } I searched nearly the whole system for lmtp but can't find the reason why. What can I do? Debug? Andreas

2 2

Cached message size smaller than expected
by Asai 22 Jan '20

22 Jan '20

Greetings, Can anyone help me to solve this problem? When doveadm sync is running nightly, we have a certain user's mailbox that will not properly sync and the logs give me this error (user private info redacted): Error: Mailbox USER/MAILBOX: UID=79: read(/vmail/domain.org/user/.MAILBOX/cur/1575914253.M611834P7822.triata4,S=… failed: Cached message size smaller than expected (41893 < 41897, box=USER/MAILBOX, UID=79) (read reason=mail stream) I have deleted the dovecot indexes in the synced backup of this mailbox, as well as in the actual user's mailbox itself and I'm still getting this error. What am I missing? Thank you for your help here. -Asai

2 2

Dovecot and archived compressed folder
by filbar＠centrum.cz 21 Jan '20

21 Jan '20

Hello, I have large of archive mails which I access occasionally. Is it possible to have in dovecot in user account archive folder which is compressed to save disk space? Thank's Filip Bartmann

2 2

Getting an extprogram script to work
by Eric Abrahamsen 21 Jan '20

21 Jan '20

Hi all, I'm trying to do the same thing everyone else is: having rspamd learn_ham or learn_spam depending on where I move a message. My current problem is that Dovecot seems to be reporting success, but nothing ever happens -- the script somehow fails to run. I'm currently using a dummy script that just writes a file to /tmp, until I can get this much working, at least. My bin_dir: --------------------- me@server:/usr/lib/dovecot/sieve# ls -l total 40 drwxr-xr-x 2 root root 4096 Jan 21 03:35 ./ drwxr-xr-x 4 root root 12288 Aug 29 06:28 ../ -rw-r--r-- 1 root root 112 Jan 21 02:17 report-ham.sieve -rw-r--r-- 1 root root 250 Jan 21 02:17 report-ham.svbin -rw-r--r-- 1 root root 112 Jun 3 2019 report-spam.sieve -rw-r--r-- 1 root root 258 Jun 3 2019 report-spam.svbin -rwxr-xr-x 1 root root 105 Jan 21 03:35 rspamd_ham.sh* -rwxr-xr-x 1 root root 43 Jun 3 2019 rspamd_spam.sh* --------------------- Then the report-ham.sieve script: --------------------- require ["vnd.dovecot.pipe", "copy", "imapsieve", "fileinto"]; pipe :copy "rspamd_ham.sh"; #fileinto "INBOX"; --------------------- And the dummy rspamd_ham.sh script: --------------------- #!/bin/bash #exec /usr/bin/rspamc learn_ham tim=`date +%M-%S` echo "${1}" > "/tmp/${tim}_results.txt" --------------------- I can confirm the above script works correctly when run from the command line, both as root and the vmail user. When run as part of the sieve process, no errors are reported, but no file is created under /tmp. From the logs: --------------------- Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.4.21 (92477967) loaded ... Debug: learn/ham: Mailbox opened because: SELECT Debug: imapsieve: mailbox learn/ham: APPEND event Debug: imapsieve: Matched static mailbox rule [1] Debug: sieve: file storage: Using Sieve script path: /usr/lib/dovecot/sieve/report-ham.sieve Debug: sieve: file script: Opened script `report-ham' from `/usr/lib/dovecot/sieve/report-ham.sieve' Debug: sieve: Opening script 1 of 1 from `/usr/lib/dovecot/sieve/report-ham.sieve' Debug: sieve: Loading script /usr/lib/dovecot/sieve/report-ham.sieve Debug: sieve: Script binary /usr/lib/dovecot/sieve/report-ham.svbin successfully loaded Debug: sieve: binary save: not saving binary /usr/lib/dovecot/sieve/report-ham.svbin, because it is already stored Debug: sieve: Executing script from `/usr/lib/dovecot/sieve/report-ham.svbin' Debug: sieve: action pipe: running program: rspamd_ham.sh Debug: Mailbox learn/ham: Opened mail UID=249 because: mail stream Debug: waiting for program `/usr/lib/dovecot/sieve/rspamd_ham.sh' to finish after 0 msecs sieve: pipe action: piped message to program `rspamd_ham.sh' Debug: learn/ham: Mailbox opened because: lib-lda delivery sieve: left message in mailbox 'learn/ham' --------------------- Near as I can tell, the first time this runs after a dovecot restart, I get this error instead: Error: write(program stdin) failed: Broken pipe Error: sieve: pipe action: failed to program `rspamd_ham.sh': refer to server log for more information. But that only happens once, then it behaves as above. The "Opened mail UID=XXX" bit changes UID (increments monotonically?) every time. I think that ought to be everything but my dovecot -n. Thanks in advance for any help. # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1057-aws x86_64 Ubuntu 18.04.3 LTS ext4 auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_home = /var/mail/vmail/%d/%n mail_location = maildir:/var/mail/vmail/%d/%n/mail:LAYOUT=fs mail_plugins = " quota" mail_prefetch_count = 20 mail_privileged_group = mail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=ssha512 username_format=%u /etc/dovecot/passwd.db driver = passwd-file } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox1_causes = APPEND imapsieve_mailbox1_name = learn/ham quota_rule = *:storage=5G quota_rule2 = Trash:ignore quota_rule3 = Junk:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-auth { mode = 0666 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } ssl = required ssl_cert = </etc/letsencrypt/live/cert-deleted ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL:RC4+RSA:+HIGH:+MEDIUM ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/passwd.db default_fields = uid=vmail gid=vmail home=/var/mail/vmail/%d/%n driver = passwd-file } protocol lmtp { mail_plugins = " quota sieve" postmaster_address = postmaster(a)ericabrahamsen.net } protocol lda { deliver_log_format = msgid=%m: %$ } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = " quota imap_quota imap_sieve" }

1 0

solr fts and removing accounts
by Wojciech Puchar 20 Jan '20

20 Jan '20

i use solr fts indexing. It worls very well but it have one database per system, not per user. Lets suppose i delete one or more e-mail users in system. How to remove them in solr database to reclaim space?

3 2

Authentication per Service
by Oliver Welter 18 Jan '20

18 Jan '20

Hi All, I use dovecot (v2.3.4) with a SQL backend for user authentication, passwords are stored in CRAMMD5 format. My SMTP server uses "doveadm auth" via auth-socket to perform sender authentification. To shut down SMTP access for hacked passwords I want to have a dedicated flag in the user database to allow/disallow SMTP for a user withouth disabling his account for IMAP. So, is there any option to use a separate passdb definition or additional parameters by either setting this in socket definition of "service auth" or using "-x auth_info"? TIA Oliver -- Protect your environment - close windows and adopt a penguin!

3 3

Sieve puts Reference:-Headers into Vacation-Reply
by Christian K 17 Jan '20

17 Jan '20

Hey, I have an issue with misformatted vacation emails. Part of the initial mail ends up in the vacation response and the headers of the vacation response end up in the body. Which also leads to the wrong charset being used by (some) MUAs. (Should be utf-8 but the inital mal was ascii only). I think I narrowed the trigger of the bug down to a long Reference: header line. It only happens if the long line is not the first one. In the attached example I sent to the mangled mailbox mymailbox(a)example.com. The sieve rule triggered is this one ("äöü" are only there to demonstrate the breaking charset): if true { vacation :days 7 :addresses ["mymailbox(a)example.com"] text: This is an automated reply; I am away and will not be able to reply to you immediately.I will get back to you as soon as I return.äöüß . ; } Christian -- $ dovecot --version 2.2.13 $ dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-9-amd64 x86_64 Debian 8.11 disable_plaintext_auth = no dotlock_use_excl = no mail_debug = yes mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl lazy_expunge listescape mail_log notify managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mmap_disable = yes namespace expunged { hidden = yes list = no location = maildir:~/expunged prefix = EXPUNGED. separator = / } namespace inbox { inbox = yes location = maildir:~/maildir prefix = separator = / } passdb { args = username_format=%n /etc/passwd driver = passwd-file } plugin { acl = vfile lazy_expunge = EXPUNGED. mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size recipient_delimiter = + sieve = ~/sieve/dovecot.sieve sieve_dir = ~/sieve/ sieve_extensions = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify sieve_max_redirects = 20 } protocols = imap pop3 sieve lmtp service imap-login { client_limit = 40 process_limit = 50 service_count = 0 vsz_limit = 512 M } service imap { process_limit = 2000 vsz_limit = 512 M } service lmtp { process_limit = 200 vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 2000 } vsz_limit = 512 M } service pop3-login { client_limit = 40 process_limit = 50 service_count = 0 vsz_limit = 512 M } shutdown_clients = no ssl_cert = </etc/ssl/certs/cert.crt ssl_key = </etc/ssl/private/key.key userdb { args = username_format=%n /etc/passwd driver = passwd-file } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 150 mail_plugins = acl lazy_expunge listescape mail_log notify imap_acl } protocol lmtp { lmtp_save_to_detail_mailbox = yes mail_plugins = acl lazy_expunge listescape mail_log notify sieve }

1 0

INDEX= and dovecot.index.log / dovecot.list.index.log
by Arkadiusz Miśkiewicz 16 Jan '20

16 Jan '20

Using 2.3.8 and mail_location = maildir:/var/mail/%Ln:CONTROL=/var/lib/dovecot/control/%Ln:VOLATILEDIR=/var/lib/dovecot/control/%Ln:INDEX=/var/lib/dovecot/control/%Ln + also user_query = SELECT ... CONCAT('maildir:/var/mail/', LOWER(u.login), '/:CONTROL=/var/lib/dovecot/control/%Ln:VOLATILEDIR=/var/lib/dovecot/control/%Ln:INDEX=/var/lib/dovecot/control/%Ln') AS mail, ... but I noticed that dovecot creates dovecot.index.log dovecot.list.index.log still in /var/mail/XYZ instad of /var/lib/dovecot/control/XYZ. Is that normal? I would expect /var/lib/dovecot/control/XYZ to be used also for these two files. ps. lmtp is used here -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

1 1

dovecot cannot drop privileges inside singularity container
by cesco 15 Jan '20

15 Jan '20

Hi all I'm facing an issue while running dovecot inside a singularity (https://sylabs.io/singularity/) container dovecot version is 2.3.4.1 (configuration below) running on debian buster, inside a container made with singularity version 3.4.2 unfortunately, when I try to start dovecot, it gives: Singularity test.sif:~> cat /var/log/mail.log Dec 30 17:23:38 testnode dovecot: master: Dovecot v2.3.4.1 (f79e8e7e4) starting up for imap, lmtp, sieve, pop3, submission (core dumps disabled) Dec 30 17:23:38 testnode dovecot: anvil: Fatal: We couldn't drop root privileges Dec 30 17:23:38 testnode dovecot: master: Error: service(anvil): command startup failed, throttling for 2 secs the same happens on singularity containers based on debian bullseye or alpine linux 3.9.2 many thanks! nzasch Singularity test.sif:~> doveconf -n # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.2 # Hostname: testnode.example.net mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap lmtp sieve pop3 submission" ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd }

2 2

Upgrade 2.2.27 to 2.3.9.2: master(imap): net_connect_unix(imap) failed: Resource temporarily unavailable
by Eirik Rye 15 Jan '20

15 Jan '20

Hi, After upgrading Dovecot from version 2.2.27 to 2.3.9.2, we are sporadically seeing lots of these errors in the error log on many of our servers: imap-login: Error: master(imap): net_connect_unix(imap) failed: Resource temporarily unavailable - http://wiki2.dovecot.org/SocketUnavailable The issue is causing significant delays and/or timeouts on login. From what I can tell, this happens because the imap-login service is unable to connect to the imap service socket, however I am unable to identify the root cause of the issue. We have increased the client_limit for the stats service, as described in the upgrade document at (https://wiki2.dovecot.org/Upgrading/2.3) It is set to the same value as the process_limit for imap service. System CPU usage does not appear to be saturated. The CPU usage sits at around 50% when these errors appear. We have doubled the number of file descriptors after upgrading from 2.2.27. It was previously set to 16392 (which worked fine): ~# cat /proc/`pidof dovecot`/limits | grep "open files" Max open files 30000 30000 files We have tried increasing default_process_limit and default_client_limit from the default 1000 to 3000, but this has no effect. Current configuration (with irrelevant parts removed): ~# doveconf -n default_client_limit = 3000 # these were raised after upgrading in attempt to remedy default_process_limit = 3000 default_vsz_limit = 512 M [...] service imap-login { client_limit = 1250 inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 16 process_min_avail = 16 service_count = 0 vsz_limit = 512 M } service imap { client_limit = 1 process_limit = 20000 } service stats { client_limit = 20000 } [...] We appear to be nowhere near the 20000 process_limit set for the imap service. We are also not seeing any warnings being logged with regards to the process_limit. ~# doveadm who -1 | wc -l 8765 ~# doveadm process status | grep "^imap " | wc -l 7583 ~# ps aux | grep "dovecot/imap" | wc -l 7449 ~# doveadm process status | grep -v "^imap " name pid available_count total_count idle_start last_status_update last_kill_sent stats 19875 12384 582387 0 1578305489 0 pop3-login 19868 1000 0 0 1578061504 0 pop3-login 19867 1000 0 0 1578061503 0 pop3-login 19866 1000 0 0 1578061502 0 pop3-login 19865 1000 0 0 1578061503 0 pop3-login 19864 1000 0 0 1578061503 0 pop3-login 19853 1000 0 0 1578061504 0 pop3-login 19852 1000 0 0 1578061504 0 pop3-login 19851 1000 0 0 1578061504 0 pop3-login 19849 1000 0 0 1578061503 0 pop3-login 19847 1000 0 0 1578061503 0 pop3-login 19846 1000 0 0 1578061503 0 pop3-login 19845 1000 0 0 1578061503 0 pop3-login 19844 1000 0 0 1578061503 0 pop3-login 19843 1000 0 0 1578061503 0 pop3-login 19842 1000 0 0 1578061503 0 pop3-login 19839 1000 0 0 1578061502 0 log 19841 2973 27 0 1578061502 0 imap-login 19873 666 14942 0 1578305488 0 imap-login 19872 523 32792 0 1578305489 0 imap-login 19871 316 62876 0 1578305489 0 imap-login 19870 167 78332 0 1578305489 0 imap-login 19869 118 97989 0 1578305489 0 imap-login 19863 0 184726 0 1578305489 0 imap-login 19862 0 193094 0 1578305489 0 imap-login 19861 0 186800 0 1578305487 0 imap-login 19860 675 17806 0 1578305487 0 imap-login 19859 0 169446 0 1578305489 0 imap-login 19858 0 143517 0 1578305489 0 imap-login 19857 0 119215 0 1578305488 0 imap-login 19856 0 151958 0 1578305489 0 imap-login 19855 483 47036 0 1578305488 0 imap-login 19854 1 185240 0 1578305489 0 imap-login 19840 567 23859 0 1578305485 0 config 19874 2967 124482 0 1578305489 0 auth 19885 2967 124185 0 1578305489 0 anvil 10017 967 7567 0 1578305463 0 -- Eirik

3 13

autoupdate broke
by Steve Egbert 14 Jan '20

14 Jan '20

When attempting to perform autoupdate after my 'autogen.sh' broke, it says that there is missing a file called: dovecot/core/doc/wiki/Makefile.am But in the Github repository, there is a misnamed file named "Makefile.am.in". I think this file is misnamed and should be renamed to "Makefile.am". https://github.com/dovecot/core/tree/master/doc/wiki

3 2

Separate TLS certificate for listener
by Peter Mogensen 13 Jan '20

13 Jan '20

Hi, I've read the howto on overriding the global ssl_cert config by using filters like "local", "remote", "protocol", "local-name". However... is it possible to have a speciel certificate just for a listener where only the port is different? /Peter

2 1

Dovecot HA/Resilience
by Kishore Potnuru 13 Jan '20

13 Jan '20

Hi Dovecot team, I need help in configuring HA/resilence for my dovecot (POP3/IMAP) server. I have one RHEL Linux POP3/IMAP server with Dovecot version 2.2.10. I also installed the postfix(version: 2.6.6) in it. At present it have around 10 domains and each domain is having around 20 email boxes. It has very simple configuration. User's reading the email via some internal applications/Outlook. I would like to create resilience/HA for this environment. Could you please suggest me, what is the easiest way to achieve this? If any one can suggest step by step that will be more helpful to me. Thanks, Kishore

8 16

saving sent mail in sent folder
by soumitri＠iitk.ac.in 13 Jan '20

13 Jan '20

Hello, I am getting following error in info log of dovecot. imap(someshb): Info: Connection closed (No commands sent) in=0 out=374 This error is for some users (not all) while sending email via Thunderbird. The email is sent but not saved int the Sent folder. I tried to debug the issue and getting nothing except following Debug: Effective uid=2121, gid=4619, home=/users02/home/ppd_doaa imap(ppd_doaa): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir:INDEX=/xx/index:CONTROL=/xx/index imap(ppd_doaa): Debug: maildir++: root=/xx/Maildir, index=/xx/index, indexpvt=, control=/xx/index, inbox=/xx/Maildir, alt= imap(ppd_doaa): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none imap(ppd_doaa): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= namespace has following namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } i am using dovecot-2.2.36-10.el8.x86_64 Thanks for any help. -- Sincerely, Soumitri

1 0

Replication question
by John 13 Jan '20

13 Jan '20

Hi I'm currently debugging some replication issues between two dovecot 2.3.9.2 servers, where one is live and the other is just a copy used for backup with no imap user access. After initial alignment (with various error messages such as the stalled io messages a fnctl lock messages) I am seeing replication miss messages or stop altogether on mailboxes, even with no further error messages. doveadm: Error: dsync(REMOTE_HOSTNAME): I/O has stalled, no activity for 600 seconds (last sent=mail_change (EOL), last recv=mailbox) doveadm: Error: Couldn't lock /var/vmail/DOMAIN/USER//.dovecot-sync.lock: fcntl(/var/vmail/DOMAIN/USER//.dovecot-sync.lock, write-lock, F_SETLKW) locking failed: Timed out after 30 seconds (WRITE lock held by pid 30307) I was surprised by this because although I know there were replication issues in 2.3.8 I understood these were resolved in 2.3.9 when both servers had 2.3.9. I am still investigating and will post further if I get any useful insights. However, I have a question, which despite using dovecot for many years in this configuration has never occurred to me before. I configured dovecot using the wiki https://wiki.dovecot.org/Replication using tcp and ssl. Both servers have an identical dovecot configuration except for: 1. different hostnames 2. on the backup server I have removed expire and quota plugins in the global mail_plugins 3. in the configuration of mail_replica tcps://hostname:port each server points to the other server's hostname What I just realized is that nowhere in the wiki does it state that both servers should be set up for replication. I had always assumed that was the logical thing to do. So the question is, for successful replication is it sufficient to setup one master configuration and just have a replication process listening on the other master, or should both servers be set up for replication in an almost identical way (with the 3 exceptions above)? thanks for any insights. John

2 1

RE: Unable to authenticate on Dovecot - auth-userdb issue?
by Mark ADAMS 11 Jan '20

11 Jan '20

Uncommented the section on userdb that was commented because it was throwing errors. It’s still throwing an error. Specifically this one: Jan 10 15:42:37 shuttle postfix/smtpd[21046]: connect from pvr[192.168.1.103] Jan 10 15:42:47 shuttle postfix/smtpd[21046]: fatal: no SASL authentication mechanisms Jan 10 15:42:48 shuttle postfix/master[18850]: warning: process /usr/libexec/postfix/smtpd pid 21046 exit status 1 Jan 10 15:42:48 shuttle postfix/master[18850]: warning: /usr/libexec/postfix/smtpd: bad command startup -- throttling I’ve combed Google for information on “no SASL authentication mechanism” with no solution. I appear to have things configured correctly (unless IM missing something, which is entirely possible given that I’m really struggling with this). Saslauthd is running: # systemctl status saslauthd ● saslauthd.service - SASL authentication daemon. Loaded: loaded (/usr/lib/systemd/system/saslauthd.service; enabled; vendor preset: disabled) Active: active (running) since Mon 2020-01-06 19:13:37 MST; 3 days ago Main PID: 29506 (saslauthd) Memory: 1.5M CGroup: /system.slice/saslauthd.service ├─29506 /usr/sbin/saslauthd -m /run/saslauthd -a pam ├─29507 /usr/sbin/saslauthd -m /run/saslauthd -a pam ├─29508 /usr/sbin/saslauthd -m /run/saslauthd -a pam ├─29509 /usr/sbin/saslauthd -m /run/saslauthd -a pam └─29510 /usr/sbin/saslauthd -m /run/saslauthd -a pam Jan 06 19:13:37 shuttle systemd[1]: Starting SASL authentication daemon.... Jan 06 19:13:37 shuttle saslauthd[29506]: : master pid is: 29506 Jan 06 19:13:37 shuttle systemd[1]: Started SASL authentication daemon.. Jan 06 19:13:37 shuttle saslauthd[29506]: : listening on socket: /run/saslauthd/mux Dovecot and Postfix are running starting and running okay. /var/spool/postfix/private/auth is present and seems to be correct. Here are my current configs on those items: # postconf -n command_directory = /usr/sbin compatibility_level = 2 daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix html_directory = /usr/share/doc/postfix/html inet_interfaces = shuttle inet_protocols = all lmtp-filter_destination_concurrency_limit = 2 lmtp_sasl_mechanism_filter = plain mail_owner = postfix mailbox_transport = dovecot:shuttle:lmtp mailq_path = /usr/bin/mailq manpage_directory = /usr/share/man meta_directory = /etc/postfix mydestination = mynetworks myhostname = shuttle mynetworks = 192.168.1.0/24, 127.0.0.0/8 mynetworks_style = subnet myorigin = shuttle newaliases_path = /usr/bin/newaliases queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix/README_FILES sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop shlib_directory = /usr/lib64 smtp-filter_destination_concurrency_limit = 2 smtp_bind_address = 192.168.1.105 smtp_tls_CAfile = /etc/pki/tls/certs/ca-bundle.crt smtp_tls_security_level = may smtpd_banner = $myhostname ESMTP $mail_name ($mail_version) (Mageia Linux) smtpd_recipient_restrictions = permit_sasl_authenticated,permit_mynetworks,reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CAfile = /etc/pki/tls/certs/ca-bundle.crt smtpd_tls_cert_file = /etc/pki/tls/certs/adams-lan.mail.pem smtpd_tls_key_file = /etc/pki/tls/private/adams-lan.mail.key smtpd_use_tls = yes unknown_local_recipient_reject_code = 450 virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf virtual_mailbox_base = /var/spool/mail/vhosts virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf virtual_transport = dovecot postconf: warning: /etc/postfix/master.cf: unused parameter: flags= # dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # OS: Linux 5.4.6-desktop-2.mga7 x86_64 Mageia 7 # Hostname: shuttle auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_username_format = %Ln disable_plaintext_auth = no first_valid_uid = 0 last_valid_uid = 10001 mail_gid = 10001 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mail_uid = 10001 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = sql } passdb { args = %s driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } service anvil { unix_listener anvil { group = mail mode = 0666 } } service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service stats { unix_listener stats-reader { group = mail mode = 0666 } unix_listener stats-writer { group = mail mode = 0666 } } ssl = required ssl_cert = </etc/pki/tls/certs/fullchain.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { hostname = shuttle postmaster_address = postmaster@shuttle I just need this stuff to move mail on my LAN as it did for years prior to this upgrade. I’m perfectly willing to blow this config away and reinstall from scratch, which I’ve done twice already. I’ve been through at least 4 tutorials on the web and nothing has led to my getting this thing working. Despite all that I’ve learned about Postfix + Dovecot + Mysql, I am still not smart enough to figure this out. I’m still looking for help and/or options. I’m also wondering if it might not be a good idea to ditch the configs in /etc/dovecot/conf.d (by commenting out “!include conf.d/*.conf” in dovecot.conf). I’m just looking to move mail on my LAN. This should be simple, no? Thanks again. Mark From: Alexander Dalloz<mailto:ad+lists@uni-x.org> Sent: Friday, January 10, 2020 11:34 AM To: Mark ADAMS<mailto:madams9@msn.com> Subject: Re: Unable to authenticate on Dovecot - auth-userdb issue? Mark, first of all: please take care to whom you reply. Do not communicate directly with my list mail address. Please keep the discussion on the dovecot list. Thanks. Am 09.01.2020 um 18:29 schrieb Mark ADAMS: > At this point, passdb does not support lookups according to the log. Is there something else I should be looking at? > > I’ve worked on this and seem to be making little progress. A sample transaction log looks like this: > > > Jan 09 10:22:32 shuttle dovecot[26851]: master: Warning: SIGHUP received - reloading configuration > Jan 09 10:23:04 shuttle postfix/smtpd[5448]: connect from pvr[192.168.1.103] > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/modules/auth > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: Module loaded: /usr/lib64/dovecot/modules/auth/lib20_auth_var_expand_crypt.so > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: Read auth token secret from /run/dovecot/auth-token-secret.dat > Jan 09 10:23:04 shuttle dovecot[5432]: auth: Debug: auth client connected (pid=0) > Jan 09 10:23:20 shuttle postfix/smtpd[5448]: 0C6BF4A6302: client=pvr[192.168.1.103] > Jan 09 10:23:30 shuttle postfix/cleanup[5459]: 0C6BF4A6302: message-id=<> > Jan 09 10:23:30 shuttle postfix/qmgr[1385]: 0C6BF4A6302: from=<madams@pvr>, size=180, nrcpt=1 (queue active) > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: master in: USER 1 root@shuttle service=lda > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: static(root): Performing userdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: pam(root): Performing passdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: pam(root): passdb doesn't support credential lookups > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: pam(root): Finished passdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Error: static(root): passdb doesn't support lookups, can't verify user's existence > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: static(root): Finished userdb lookup > Jan 09 10:23:30 shuttle dovecot[5432]: auth: Debug: userdb out: FAIL 1 > Jan 09 10:23:30 shuttle dovecot[5466]: lda(root@shuttle)<5466><>: Error: auth-master: userdb lookup(root@shuttle): Auth USER lookup failed > Jan 09 10:23:30 shuttle dovecot[5466]: lda: Fatal: Internal error occurred. Refer to server log for more information. > Jan 09 10:23:30 shuttle postfix/pipe[5465]: 0C6BF4A6302: to=<root@shuttle>, relay=dovecot, delay=17, delays=17/0.01/0/0.06, dsn=4.3.0, status=deferred (tempora> > Jan 09 10:23:31 shuttle sshd[5468]: Connection closed by 192.168.1.100 port 48324 [preauth] > Jan 09 10:23:31 shuttle postfix/smtpd[5448]: disconnect from pvr[192.168.1.103] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 > > > My current dovecot configuration looks like this: > > # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf > # OS: Linux 5.4.6-desktop-2.mga7 x86_64 Mageia 7 > # Hostname: shuttle > auth_debug_passwords = yes > auth_username_format = %Ln > disable_plaintext_auth = no > first_valid_uid = 0 > last_valid_uid = 10001 > mail_gid = 10001 > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > mail_uid = 10001 > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = %s > driver = pam > } > plugin { > sieve = file:~/sieve;active=~/.dovecot.sieve > } > service anvil { > unix_listener anvil { > group = mail > mode = 0666 > } > } > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = > mode = 0666 > user = $default_internal_user > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 143 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service stats { > unix_listener stats-reader { > group = mail > mode = 0666 > } > unix_listener stats-writer { > group = mail > mode = 0666 > } > } > ssl = required > ssl_cert = </etc/pki/tls/certs/fullchain.cer > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > protocol lmtp { > hostname = shuttle > postmaster_address = postmaster@shuttle > } > > > As always I appreciate the help and any assistance is appreciated. > > Mark According to your "doveconf -n" output you have no userdb defined. Just do that. https://doc.dovecot.org/configuration_manual/authentication/user_databases_… Maybe this one fits your current system setup https://doc.dovecot.org/configuration_manual/authentication/passwd/#authent… Alexander > From: Alexander Dalloz<mailto:ad+lists@uni-x.org> > Sent: Friday, January 3, 2020 5:26 AM > To: dovecot(a)dovecot.org<mailto:dovecot@dovecot.org> > Subject: Re: Unable to authenticate on Dovecot - auth-userdb issue? > > Am 03.01.2020 um 03:27 schrieb Mark ADAMS: >> Jan 02 18:47:37 shuttle dovecot[6744]: lda(root@shuttle)<6744><>: Error: auth-master: userdb lookup(root@shuttle): connect(/run/dovecot/auth-userdb) failed: Permission denied (euid=8(mail) egid=12(mail) missing +r perm: /run/dovecot/auth-userdb, dir owned by 0:0 mode=0755) > > Run "namei -lv /run/dovecot/auth-userdb" to check the permissions of the > complete path. The auth-userdb socket actually is owned mail:mail > according to your error logging. Is dovecot member of the mail group? > > Actually it does not match the config details you have pasted: > > unix_listener auth-userdb { > group = dovecot > mode = 0600 > user = vmail > } > > On my side it looks like this and I have not custom configured that > part. The defaults are: > > unix_listener auth-userdb { > group = > mode = 0666 > user = $default_internal_user > } > > So on my system the permissions look like this: > > # namei -lv /var/run/dovecot/auth-userdb > f: /var/run/dovecot/auth-userdb > dr-xr-xr-x root root / > drwxr-xr-x root root var > drwxr-xr-x root root run > drwxr-xr-x root dovecot dovecot > srw-rw-rw- dovecot root auth-userdb > >> Jan 02 18:47:37 shuttle dovecot[6744]: lda: Fatal: Internal error occurred. Refer to server log for more information. >> Jan 02 18:47:37 shuttle postfix/pipe[6743]: 6345D4A4A97: to=<root@shuttle>, relay=dovecot, delay=1.1, delays=1.1/0.01/0/0.06, dsn=4.3.0, status=deferred (temporary failure. Command output: lda(root@shuttle): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied ) >> ^C >> >> >> >> Note: this error references "/run/dovecot/auth-userdb". That isn't even supposed to be the location of that file. I have no idea why that location shows up. The correct location should be "/etc/dovecot/auth-userdb". The file does exist at that location. > > Mark, > > I have no idea why you expect the dovecot sockets to be located inside > /etc/dovecot/. /etc is the FHS location for configurations. /run or > /var/run (typically a symlink on modern linux distributions) is the > right location for runtime files like service sockets. > > You say /etc/dovecot/auth-userdb exists. Am I correct to guess that you > have created that manually with whatever content? > > Alexander > >

1 0

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
by Ralf Hildebrandt 10 Jan '20

10 Jan '20

I'm trying this: doveadm import -u restore(a)backup.invalid mdbox:/home/copymail2/mdbox "" \ mailbox INBOX header X-Spam Yes nd I'm getting: doveadm(restore(a)backup.invalid): Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) doveadm(restore(a)backup.invalid): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f598de6cac2] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f598de6cbde] -> /usr/lib/dovecot/libdovecot.so.0(+0xe989e) [0x7f598de7789e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe98e1) [0x7f598de778e1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f598ddced04] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78) [0x7f598e227de8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b) [0x7f598e2103ab] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449) [0x7f598e1f2139] -> /usr/lib/dovecot/libdovecot.so.0(+0xc10a9) [0x7f598de4f0a9] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a) [0x7f598de852ea] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7f598de8562f] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f598de8600d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68) [0x7f598de55a58] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52) [0x7f598de56432] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcc561) [0x7f598e1fc561] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcd85c) [0x7f598e1fd85c] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d) [0x7f598e1fe04d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28) [0x7f598e17df38] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d) [0x7f598e17df9d] -> doveadm(+0x31b13) [0x557f5d487b13] -> doveadm(+0x2c441) [0x557f5d482441] -> doveadm(+0x2d1c9) [0x557f5d4831c9] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x557f5d48409e] -> doveadm(doveadm_cmd_run_ver2+0x55e) [0x557f5d4953ee] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x557f5d495447] -> doveadm(main+0x1d1) [0x557f5d472211] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f598d3cfb97] -> doveadm(_start+0x2a) [0x557f5d47272a] Aborted (core dumped) I'm using ii dovecot-core 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - core files ii dovecot-dbg 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - debug symbols ii dovecot-imapd 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-lmtpd 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - LMTP server ii dovecot-lucene 2:2.3.9.2-1+ubuntu18.04 amd64 secure POP3/IMAP server - Lucene support Running in gdb results in this backtrace: Program received signal SIGABRT, Aborted. __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007ffff68e4801 in __GI_abort () at abort.c:79 #2 0x00007ffff736d851 in default_fatal_finish (status=0, type=LOG_TYPE_PANIC) at failures.c:459 #3 fatal_handler_real (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:471 #4 0x00007ffff736d8e1 in default_fatal_handler (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:479 #5 0x00007ffff72c4d04 in i_panic (format=format@entry=0x7ffff772dd00 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:523 #6 0x00007ffff771dde8 in mail_index_uint32_to_offset (offset=<optimized out>) at mail-index-util.c:10 #7 0x00007ffff77063ab in mail_cache_header_fields_write (ctx=0x555555855330, buffer=<optimized out>, buffer=<optimized out>) at mail-cache-transaction.c:609 #8 mail_cache_header_add_field (field_idx=15, ctx=0x555555855330) at mail-cache-transaction.c:690 #9 mail_cache_add (ctx=0x555555855330, seq=1, field_idx=field_idx@entry=15, data=0x7ffff773b6d6, data_size=0) at mail-cache-transaction.c:739 #10 0x00007ffff76ea82c in index_mail_cache_add_idx (mail=mail@entry=0x555555869f18, field_idx=field_idx@entry=15, data=data@entry=0x7ffff773b6d6, data_size=data_size@entry=0) at index-mail.c:631 #11 0x00007ffff76e8139 in index_mail_parse_header_finish (mail=<optimized out>) at index-mail-headers.c:132 #12 index_mail_parse_header (part=<optimized out>, hdr=<optimized out>, mail=<optimized out>) at index-mail-headers.c:312 #13 0x00007ffff73450a9 in read_header (mstream=0x555555874740) at istream-header-filter.c:356 #14 i_stream_header_filter_read (stream=0x555555874740) at istream-header-filter.c:446 #15 0x00007ffff737b2ea in i_stream_read_memarea (stream=stream@entry=0x5555558747c0) at istream.c:313 #16 0x00007ffff737b62f in i_stream_read (stream=stream@entry=0x5555558747c0) at istream.c:271 #17 0x00007ffff737c00d in i_stream_read_data (stream=0x5555558747c0, data_r=data_r@entry=0x7fffffffdc08, size_r=size_r@entry=0x7fffffffdc10, threshold=threshold@entry=1) at istream.c:745 #18 0x00007ffff734ba58 in i_stream_read_bytes (wanted=2, size_r=0x7fffffffdc10, data_r=0x7fffffffdc08, stream=<optimized out>) at ../../src/lib/istream.h:217 #19 message_parse_header_next (ctx=0x555555869db0, hdr_r=hdr_r@entry=0x7fffffffdc70) at message-header-parser.c:85 #20 0x00007ffff734c432 in message_parse_header (input=<optimized out>, hdr_size=hdr_size@entry=0x0, flags=flags@entry=MESSAGE_HEADER_PARSER_FLAG_CLEAN_ONELINE, callback=callback@entry=0x7ffff76f1aa0 <search_header>, context=context@entry=0x7fffffffdce0) at message-header-parser.c:392 #21 0x00007ffff76f2561 in search_arg_match_text (ctx=0x555555856fa0, args=0x5555558216d0) at index-search.c:759 #22 search_match_once (ctx=0x555555856fa0) at index-search.c:1399 #23 0x00007ffff76f385c in search_match_next (ctx=0x555555856fa0) at index-search.c:1506 #24 search_more_with_mail (mail=<optimized out>, ctx=0x555555856fa0) at index-search.c:1623 #25 search_more_with_prefetching (mail_r=<optimized out>, ctx=<optimized out>) at index-search.c:1705 #26 search_more (ctx=ctx@entry=0x555555856fa0, mail_r=mail_r@entry=0x7fffffffde10) at index-search.c:1779 #27 0x00007ffff76f404d in index_storage_search_next_nonblock (_ctx=0x555555856fa0, mail_r=0x7fffffffdee0, tryagain_r=0x7fffffffde77) at index-search.c:1807 #28 0x00007ffff7673f38 in mailbox_search_next_nonblock (ctx=0x555555856fa0, mail_r=0x7fffffffdee0, tryagain_r=<optimized out>) at mail-storage.c:2307 #29 0x00007ffff7673f9d in mailbox_search_next (ctx=0x555555856fa0, mail_r=mail_r@entry=0x7fffffffdee0) at mail-storage.c:2292 #30 0x0000555555586d52 in doveadm_mail_iter_next (iter=<optimized out>, mail_r=mail_r@entry=0x7fffffffdee0) at doveadm-mail-iter.c:160 #31 0x0000555555585b13 in cmd_import_box (search_args=<optimized out>, info=0x55555584e7b8, dest_user=<optimized out>, ctx=0x55555581fdb8) at doveadm-mail-import.c:142 #32 cmd_import_run (_ctx=0x55555581fdb8, user=0x5555558374b8) at doveadm-mail-import.c:202 #33 0x0000555555580441 in doveadm_mail_next_user (ctx=ctx@entry=0x55555581fdb8, error_r=error_r@entry=0x7fffffffe0c0) at doveadm-mail.c:462 #34 0x00005555555810db in doveadm_mail_single_user (ctx=ctx@entry=0x55555581fdb8, error_r=error_r@entry=0x7fffffffe0c0) at doveadm-mail.c:492 #35 0x00005555555811c9 in doveadm_mail_cmd_exec (ctx=ctx@entry=0x55555581fdb8, wildcard_user=wildcard_user@entry=0x0) at doveadm-mail.c:653 #36 0x000055555558209e in doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=<optimized out>) at doveadm-mail.c:1144 #37 0x00005555555933ee in doveadm_cmd_run_ver2 (argc=10, argv=0x5555557f6bb8, cctx=cctx@entry=0x7fffffffe2b0) at doveadm-cmd.c:575 #38 0x0000555555593447 in doveadm_cmd_try_run_ver2 (cmd_name=<optimized out>, argc=<optimized out>, argv=<optimized out>, cctx=0x7fffffffe2b0) at doveadm-cmd.c:497 #39 0x0000555555570211 in main (argc=<optimized out>, argv=<optimized out>) at doveadm.c:395 (gdb) -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

1 0

2FA for Dovecot
by Kees de Jong 09 Jan '20

09 Jan '20

Hi, My goal is to protect my mail account with 2FA, which isn't a crazy idea in 2020. Therefore, I would like to know the possibilities of configuring 2FA for Dovecot. In the documentation there are some hints of e.g. OTP in Dovecot [1] and using FreeIPA with Dovecot [2], where FreeIPA has the ability to enable OTP per user [3]. But I can't really find much practical information about such a setup. The documentation of Dovecot is quite silent about the OTP authentication mechanism and the same goes for the FreeIPA and Dovecot combination with OTP. So my question is; is this even a supported setup? And if so, where is the documentation? And if not, what's the recommended method to secure your mail setup? I can imagine alternative solutions like putting the submission and IMAP port behind a VPN and have all the clients use that VPN. And for the public internet, simply use a web interface (e.g. Nextcloud with Rainloop) which supports 2FA. But I prefer having OTP for e.g. Android and Linux clients. [1] https://doc.dovecot.org/configuration_manual/authentication/authentication_… [2] https://www.freeipa.org/page/Dovecot_Integration [3] https://www.freeipa.org/page/Using_FreeIPA_and_FreeRadius_as_a_RADIUS_based… -- Met vriendelijke groet, Kees de Jong De informatie opgenomen in deze e-mail kan vertrouwelijk zijn en is uitsluitend bestemd voor de geadresseerde(n). Indien u deze e-mail onterecht ontvangt, wordt u verzocht de inhoud niet te gebruiken en de afzender direct te informeren door de e-mail te retourneren. Aan deze e-mail inclusief de bijlagen kunnen geen rechten ontleend worden, tenzij schriftelijk anders wordt overeengekomen. -- The information contained in this e-mail may be confidential and is intended to be exclusively for the addressee(s). Should you receive this e-mail unintentionally, please do not use the contents herein and notify the sender immediately by return e-mail. This e-mail including the attachments are not legally binding, unless otherwise agreed upon in writing. -- OpenPGP fingerprint: 0x0E45C98AB51428E6

6 5

Thunderbird Subscription missing
by Phillip Bruce 08 Jan '20

08 Jan '20

Hello, I have an usual isshere we are using thunderbird for client. The version of dovecot is as followed: # dovecot --version 2.2.22 (fe789d2) The dovecot service is runnon on VERSION="16.04.6 LTS (Xenial Xerus)" Thunderbird version 68.3.1 (32 bit) version. What happening when managing subscription there seems to be folders that are missing. They were not purged nor did anything happen like an outage. If you look at this below Sep19 (for September 2019), It list only the following folders: 16Sep19, 25Sep19 26Sep19 [cid:image002.png@01D5C532.1485D710] To me this looks like some indexing gone south. I've tried this # doveadm mailbox status -u arhive doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] # doveadm mailbox status -u archive Maildir # doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] r# doveadm mailbox status -u archive INBOX @doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] The user is archive The user home folder is this: # pwd /home/mail/archive/Maildir This what in it. # ls cur dovecot.index.log dovecot.mailbox.log.2 dovecot-uidvalidity.50ca19bb tmp dovecot.index dovecot.index.log.2 dovecot-uidlist dovecot-uidvalidity.50ca19bc dovecot.index.cache dovecot-keywords dovecot-uidvalidity dovecot-uidvalidity.50ca1b2d dovecot.index.cache.gz dovecot-keywords.gz dovecot-uidvalidity.50ca1990 new dovecot.index.cache.gz.2 dovecot.mailbox.log dovecot-uidvalidity.50ca19ab subscriptions # doveadm log errors # I don't see in errors. I tried to reload dovecot. # doveadm instance list path name last used running /var/run/dovecot dovecot 2020-01-06 22:41:46 yes root@dc3-ops-prod-vserv-archive01:~# There nothing in the logs that I can see. # doveadm user -u archive userdb: archive user : archive system_groups_user: archive uid : 1011 gid : 1011 home : /home/archive root@dc3-ops-prod-vserv-archive01:~# Any suggestions would be helpful. Thanks, Phillip Bruce Sr. System Engineer 415-590-8491 office "The answer to your Traveling Solution" [Deem Demo] This message and any files or text attached to it are intended only for the recipients named above, and contain information that may be confidential or privileged. If you are not an intended recipient, or you have reason to believe that you received this message in error, you must not read, copy, use or disclose this communication. Please also notify the sender by replying to this message, and then delete all copies of it from your system. Thank you.

3 9

Solved an solution: Pop 3 SSL login dos not work any longer
by Jutta Wrage 07 Jan '20

07 Jan '20

Hi! Logging in with the same use I tested already before, I now get this message in the debug log written by dovecot: pop3-login: Warning: Auth process not responding, delayed sending initial response (greeting): user=<> The SSL negotiation did complete. But then there went something wrong with the user authentification. As ist did work already before, I guess, it is not the clients fault. System where dovecot (pop3 and imap) is installed: latest Ubuntu. My changes after successful repeated pop3 connection with by the testing user: 1. Turning debug logging on 2. minor changes I did search a lot for a solution to this problem but still have no clue how to solve it. Hmm... guess my "minor changes" caused the problem: Found this in debug log now for the start of SSL: "pop3-login: Error: auth: connect(director) failed: No such file or directory" Need to read more about these directors, I think. Maybe they are not needed at the system at all. Jutta

1 0

Thunderbird Issue - Dovecot
by Phillip Bruce 07 Jan '20

07 Jan '20

I have not ever heard of or use dovecot before. Our users uses thunderbird client which happens to be the lastest version. Below is what we get as you can see we are missing folders from September 2019. Dovecot seem to be running but I am not sure why it be missing these folders. The server Dovecot is running on is Unbuntu 16.04 version. # dovecot --version 2.2.22 (fe789d2) The above is the version of dovecot we are running. I would appreciate anyone Helping to trouble shoot this issue. I don't think this is a thunderbird issue. [cid:image001.png@01D5C4B4.9AD315E0] Thunderbird version is this below: [cid:image002.jpg@01D5C4B4.9AD315E0] It looks like we are not indexing. We are not using a SQL database either for this. Any ideas where I can start. Also far I know there been no outages during that time. I appreciate any thoughts or help. Phillip Bruce Sr. System Engineer 415-590-8491 office "The answer to your Traveling Solutino" [Deem Demo] This message and any files or text attached to it are intended only for the recipients named above, and contain information that may be confidential or privileged. If you are not an intended recipient, or you have reason to believe that you received this message in error, you must not read, copy, use or disclose this communication. Please also notify the sender by replying to this message, and then delete all copies of it from your system. Thank you.

2 1

Re: 2FA for Dovecot
by Kees de Jong 07 Jan '20

07 Jan '20

I did mention OTP for 2FA, and OTP can be indeed Google Authenticator, the reason I'm not that specific is because the documentation isn't :) PAM can indeed be used for this, I've read some list conversations about this [1], [2]. However, as I mentioned in my first post, I'm interested to know about the internal Dovecot authentication methods. Since using PAM requires local users and I prefer using the virtual users inside Dovecot. There are several OTP authentication mechanisms in the source code [3], [4], [5]. However, these lack documentation [6]. Therefore, I would like to explore these builtin authentication methods first. Is there someone in the Dovecot community that can provide some more information about this, or the status of these authentication modules? [1] https://dovecot.org/pipermail/dovecot/2013-March/088844.html [2] https://dovecot.org/pipermail/dovecot/2007-February/019340.html [3] https://github.com/dovecot/core/blob/master/src/auth/mech-otp.c [4] https://github.com/dovecot/core/blob/master/src/auth/mech-otp-skey-common.c [5] https://github.com/dovecot/core/blob/master/src/auth/password-scheme-otp.c [6] https://doc.dovecot.org/configuration_manual/authentication/authentication_… On Tue, 2020-01-07 at 05:54 +0200, dovecot-request(a)dovecot.org wrote: > You don't say what sort of 2FA you're considering, but wouldn't you > just tell Dovecot to use PAM, and then extend PAM to use a 2FA > module. For example there's a Google Auth one available in the second > link below. > > https://doc.dovecot.org/configuration_manual/authentication/pam/ > https://github.com/google/google-authenticator-libpam > > P. > (Not a dovecot expert, although I know a fair amount about Linux)

1 0

doveadm auth cache flush does not work through director
by Joe Wong 07 Jan '20

07 Jan '20

Hello, I am using Dovecot 2.3.7.2, configure with Director and Dovecot backend. Everything is running fine through director. However, I found the auth cache flush command can only work on dovecot backend server but not in Director. Any idea? - Joe

1 0

Logging what sieve does
by ＠lbutlr 06 Jan '20

06 Jan '20

Is there anyway to log exactly what sieve does with a message? (Like, what rules triggered, flags applied, headers rewritten, if the message was placed anywhere else before final delivery, etc). -- In Genua, stories came to life. In Genua, someone set out to make dreams come true. Remember some of your dreams?

2 1

LDA-DUPES insists mon being created in the wrong home directory
by Hans Rasmussen 06 Jan '20

06 Jan '20

Hi Vacation sieve is not respecting the days: arguement .dovecot.lda-dupes wants to be created in /home/user which doesn't exist. Below is a log fragment.. Jan 5 17:56:24 mailserv dovecot: lmtp(hans): Error: file_dotlock_open(/home/hans/.dovecot.lda-dupes) failed: No such file or directory dovecot -n says... # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-72-generic x86_64 Ubuntu 18.04.3 LTS ext4 auth_mechanisms = plain login first_valid_gid = 999 first_valid_uid = 999 mail_gid = 999 mail_home = /var/lib/vmail/%u mail_location = maildir:/var/lib/vmail/%u/Maildir mail_privileged_group = mail mail_uid = 999 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext Shouldn't .dovecot.lda-dupes respect the mail_home argument. Thanks much Hans

2 1

Will service restart cause file corruption？
by hfh＠cndns.com 06 Jan '20

06 Jan '20

If the program is writing email content to the disk, will the program restart cause the email content to be written incomplete and the file will be damaged? hfh(a)cndns.com

1 0

Get protocol used in the post login script
by André Rodier 05 Jan '20

05 Jan '20

Hello, I have a post-login script, in Dovecot, that send warnings to users using XMPP. However, I would like hthe warning to include the protocol used, i.e. IMAP or POP3. How can I do this, please? Thanks, André.

1 0

Re: Dovecot, pigeonhole and hardlinks
by Gionatan Danti 03 Jan '20

03 Jan '20

Il 03-01-2020 19:51 @lbutlr ha scritto: > On 03 Jan 2020, at 06:16, Gionatan Danti <g.danti(a)assyoma.it> wrote: >> What surprises me is that hard-linking identical messages saves so >> much space, yet nobody seems to asking/using such feature. >> So, either a) few cares about saving space or b) few are using the >> pigeonhole plugin. And both a) and b) seems unlikely... > > Or > > c) we see nearly no truly identical messages. Well, sure, this is another possibility. However, on all mailserver which I manage, a significant portion of total emails are messages sent to groups/lists rather than single recipient. Cyrus and other proprietary mailservers (eg: CommuniGate Pro) use unix shared storage (aka hardlink) to avoid copying the message to multiple inboxes. This is especially valuable when a) large groups exists or b) a large message is sent to groups/lists. Please also note that, when not using Pigeonhole, Dovecot *does* use hardlink for messages sent to multiple recipients and/or groups. It is only when Pigeonhole is active that the hardlinking does not happen. Thanks. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

1 0

Dovecot, pigeonhole and hardlinks
by Gionatan Danti 03 Jan '20

03 Jan '20

Hi list, many moons ago I asked about preserving hardlink between identical messages when pigeonhole (for sieve filtering) was used. The reply was that, while hardlink worked well for non-filtered messages, using pigeonhole broke the hardlink (ie: some message-specific data was appended to the actual mail file). Here you can find the original thread: https://dovecot.org/pipermail/dovecot/2015-November/102579.html I would ask the same things today: is dovecot+pigeonhole capable of storing the same incoming message, sent to multiple rcpt or to a group/alias expanding in multiple recipients, as a single hardlink? Note: I know about SIS, but it has some important drawback and I would avoid using it. Thanks. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

2 4

Unable to authenticate on Dovecot - auth-userdb issue?
by Mark ADAMS 03 Jan '20

03 Jan '20

Some general information: Mageia Linux 5.4.6-desktop-2.mga7 2.3.7.2 (3c910f64b) postfix + dovecot + mysql 192.168.1.105 (shuttle) the email server machine 192.168.1.103 (pvr) the mail client machine I am unable to authenticate to send email. I've looked at postfix but I can't get past dovecot's authentication. Here is what I'm seeing in logs: Jan 02 18:46:47 shuttle sshd[6660]: Connection closed by 192.168.1.100 port 48506 [preauth] Jan 02 18:47:05 shuttle postfix/smtpd[6352]: connect from pvr[192.168.1.103] Jan 02 18:47:16 shuttle postfix/smtpd[6352]: lost connection after CONNECT from pvr[192.168.1.103] Jan 02 18:47:16 shuttle postfix/smtpd[6352]: disconnect from pvr[192.168.1.103] commands=0/0 Jan 02 18:47:36 shuttle postfix/smtpd[6352]: connect from pvr[192.168.1.103] Jan 02 18:47:36 shuttle postfix/smtpd[6352]: 6345D4A4A97: client=pvr[192.168.1.103] Jan 02 18:47:37 shuttle postfix/cleanup[6500]: 6345D4A4A97: message-id=<> Jan 02 18:47:37 shuttle postfix/qmgr[1385]: 6345D4A4A97: from=<madams@pvr>, size=485, nrcpt=1 (queue active) Jan 02 18:47:37 shuttle postfix/smtpd[6352]: disconnect from pvr[192.168.1.103] helo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 Jan 02 18:47:37 shuttle dovecot[6744]: lda(root@shuttle)<6744><>: Error: auth-master: userdb lookup(root@shuttle): connect(/run/dovecot/auth-userdb) failed: Permission denied (euid=8(mail) egid=12(mail) missing +r perm: /run/dovecot/auth-userdb, dir owned by 0:0 mode=0755) Jan 02 18:47:37 shuttle dovecot[6744]: lda: Fatal: Internal error occurred. Refer to server log for more information. Jan 02 18:47:37 shuttle postfix/pipe[6743]: 6345D4A4A97: to=<root@shuttle>, relay=dovecot, delay=1.1, delays=1.1/0.01/0/0.06, dsn=4.3.0, status=deferred (temporary failure. Command output: lda(root@shuttle): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied ) ^C Note: this error references "/run/dovecot/auth-userdb". That isn't even supposed to be the location of that file. I have no idea why that location shows up. The correct location should be "/etc/dovecot/auth-userdb". The file does exist at that location. There is no "base_dir" configured in /etc/dovecot/dovecot.conf. When I do try an point the configuration at the correct base_dir, I get this when I try to restart dovecot: -- The unit dovecot.service has entered the 'failed' state with result 'exit-code'. Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(aggregator): unlink(/etc/dovecot/replication-notify-fifo) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(pop3): unlink(/etc/dovecot/login/pop3) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(old-stats): unlink(/etc/dovecot/old-stats) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(old-stats): unlink(/etc/dovecot/old-stats-mail) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(old-stats): unlink(/etc/dovecot/old-stats-user) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(log): unlink(/etc/dovecot/log-errors) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(lmtp): unlink(/etc/dovecot/lmtp) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(ipc): unlink(/etc/dovecot/ipc) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(ipc): unlink(/etc/dovecot/login/ipc-proxy) failed: Read-only file system Jan 02 18:51:50 shuttle dovecot[7226]: master: Error: service(indexer-worker): unlink(/etc/dovecot/indexer-worker) failed: Read-only file system And there are about 30 lines of "read-only file system" errors. I haven't been able to track down the cause of that. Once the line "base_dir = /etc/dovecot" is commented out in /etc/dovecot/dovecot.conf, I can start dovecot: # systemctl status dovecot ● dovecot.service - Dovecot IMAP/POP3 email server Loaded: loaded (/usr/lib/systemd/system/dovecot.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2020-01-02 18:54:15 MST; 5s ago Docs: man:dovecot(1) http://wiki2.dovecot.org/ Main PID: 7550 (dovecot) Memory: 3.8M CGroup: /system.slice/dovecot.service ├─7550 /usr/sbin/dovecot -F ├─7554 dovecot/anvil ├─7555 dovecot/log └─7556 dovecot/config Jan 02 18:54:15 shuttle systemd[1]: Started Dovecot IMAP/POP3 email server. Jan 02 18:54:15 shuttle dovecot[7550]: master: Dovecot v2.3.7.2 (3c910f64b) starting up for imap, pop3, lmtp Jan 02 18:54:15 shuttle dovecot[7550]: master: Error: t_readlink(/etc/dovecot/dovecot.conf) failed: readlink() failed: Invalid argument I have no idea what's up with the t_readlink error. Might be related to the errors above. I can't really find out much about it. Trying to send email shows no apparent errors: [madams@pvr ~]$ mail root@shuttle Subject: testing test . EOT [madams@pvr ~]$ Trying to send mail in detail looks like this: $ openssl s_client -connect shuttle:25 -starttls smtp CONNECTED(00000003) depth=0 C = US, ST = NM, O = Personal, OU = Private verify error:num=18:self signed certificate verify return:1 depth=0 C = US, ST = NM, O = Personal, OU = Private verify return:1 --- Certificate chain 0 s:/C=US/ST=NM/O=Personal/OU=Private i:/C=US/ST=NM/O=Personal/OU=Private --- Server certificate <It produces all the right certificate information> -----END CERTIFICATE----- subject=/C=US/ST=NM/O=Personal/OU=Private issuer=/C=US/ST=NM/O=Personal/OU=Private --- No client certificate CA names sent Peer signing digest: SHA512 Server Temp Key: ECDH, P-256, 256 bits --- SSL handshake has read 1764 bytes and written 467 bytes --- New, TLSv1/SSLv3, Cipher is ECDHE-RSA-AES256-GCM-SHA384 Server public key is 2048 bit Secure Renegotiation IS supported Compression: NONE Expansion: NONE No ALPN negotiated SSL-Session: <and all the SSL information is good> Start Time: 1578016729 Timeout : 300 (sec) Verify return code: 18 (self signed certificate) --- 250 CHUNKING ehlo shuttle 250-shuttle 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-AUTH PLAIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250-SMTPUTF8 250 CHUNKING mail from: madams@pvr 250 2.1.0 Ok rcpt to: root@shuttle 250 2.1.5 Ok data 354 End data with <CR><LF>.<CR><LF> subject: testing test . 250 2.0.0 Ok: queued as A73A84A4AE4 quit 221 2.0.0 Bye closed That transaction produces this in journalctl: an 02 19:04:15 shuttle postfix/smtpd[8856]: connect from pvr[192.168.1.103] Jan 02 19:04:15 shuttle dovecot[7555]: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/modules/auth Jan 02 19:04:15 shuttle dovecot[7555]: auth: Debug: Module loaded: /usr/lib64/dovecot/modules/auth/lib20_auth_var_expand_crypt.so Jan 02 19:04:15 shuttle dovecot[7555]: auth: Debug: Read auth token secret from /run/dovecot/auth-token-secret.dat Jan 02 19:04:15 shuttle dovecot[7555]: auth: Debug: auth client connected (pid=0) Jan 02 19:04:31 shuttle postfix/smtpd[8856]: B621F4A4B0F: client=pvr[192.168.1.103] Jan 02 19:04:39 shuttle postfix/cleanup[8914]: B621F4A4B0F: message-id=<> Jan 02 19:04:40 shuttle postfix/qmgr[1385]: B621F4A4B0F: from=<madams@pvr>, size=184, nrcpt=1 (queue active) Jan 02 19:04:40 shuttle dovecot[8947]: lda(root@shuttle)<8947><>: Error: auth-master: userdb lookup(root@shuttle): connect(/run/dovecot/auth-userdb) failed: Permission denied (euid=8(mail) egid=12(mail) missing +r perm: /run/dovecot/auth-userdb, dir owned by 0:0 mode=0755) Jan 02 19:04:40 shuttle dovecot[8947]: lda: Fatal: Internal error occurred. Refer to server log for more information. Jan 02 19:04:40 shuttle postfix/pipe[8946]: B621F4A4B0F: to=<root@shuttle>, relay=dovecot, delay=13, delays=13/0.01/0/0.06, dsn=4.3.0, status=deferred (temporary failure. Command output: lda(root@shuttle): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied ) Jan 02 19:04:43 shuttle postfix/smtpd[8856]: disconnect from pvr[192.168.1.103] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Jan 02 19:04:48 shuttle sshd[8962]: Connection closed by 192.168.1.100 port 48596 [preauth] I've experimented with ownership and permissions on run/dovecot/auth-userdb. It's running as vmail:dovecot, but the permissions I set on it are not persistent - they keep reverting to srw----- whenever I restart dovecot. This is correct given the configuration in dovecot.conf, but should those permissions be set to 0600? Also, that shouldn't be happening in /run/dovcot, it should all be happening in /etc/dovcot. Attempting to test authentication over TLS isn't working and I'm so confused at this point I'm not even sure I should be doing it. 250 CHUNKING ehlo shuttle 250-shuttle 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-AUTH PLAIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250-SMTPUTF8 250 CHUNKING auth login 535 5.7.8 Error: authentication failed: Invalid authentication mechanism auth login bWFkYW1z bm9uZQ== 501 5.5.4 Syntax: AUTH mechanism auth plain bWFkYW1z bm9uZQ== 501 5.5.4 Syntax: AUTH mechanism And those are base64 encoded credentials (bWFkYW1z bm9uZQ==). Here is my config. All I want to do is run from machines on my lan to Thunderbird on my desktop so I can get notices about events and system health from my other servers. Should this be so hard? Is this Postfix's fault? Can anybody help with this? Thanks. And now that config: # dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # OS: Linux 5.4.6-desktop-2.mga7 x86_64 Mageia 7 # Hostname: shuttle auth_debug_passwords = yes auth_username_format = %Ln disable_plaintext_auth = no first_valid_uid = 0 last_valid_uid = 10001 mail_gid = 10001 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mail_uid = 10001 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = %s driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = dovecot mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/pki/tls/certs/fullchain.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it protocol lmtp { hostname = shuttle postmaster_address = postmaster@shuttle }

2 1

iOS Client Not Showing Email Previews, Dovecot Issue?
by asai＠globalchangemusic.org 02 Jan '20

02 Jan '20

Greetings, Just wondering if anybody would know why one of our users' iOS Mail app client doesn't show the email previews (the first few sentences of the email)? We had migrated from an earlier (2.2.4) version of Dovecot to the latest version and once that was done, the user began to report this issue. I don't know if it's a Dovecot issue or not, but can anyone point me in the right direction to begin to debug? Thank you, Asai

3 2

spamsieve question
by Gerben Wierda 31 Dec '19

31 Dec '19

My new dovecot covers spam/ham training through the standard Spam_train and Notspam_train mailboxes. When a message is copied (I’m using macOS/iOS standard Apple clients) it triggers the spam/ham learning by rspamd. So far so good. When I move a message to Spam_train I’d like it to be removed immediately after learning. When I move a message to Notspam_train, I’d like it to move back where it came from after having been piped The first is I think doable, but how? Is the second doable? Gerben Wierda Chess and the Art of Enterprise Architecture <https://ea.rna.nl/the-book/> Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/> Architecture for Real Enterprises <https://www.infoworld.com/blog/architecture-for-real-enterprises/> at InfoWorld On Slippery Ice <https://eapj.org/on-slippery-ice/> at EAPJ

1 0

Problem with big number of pop3-login [1 pre-login]
by Григорий Семенов 30 Dec '19

30 Dec '19

Dear all, I have recently migrated from my old Debian 8 (jessie) system to a new VM with fresh Debian 10 (buster) installation. Previous dovecot version was 2.2.13 and now I have 2.3.4.1. Dovecot was setup from Debian packages. Mostly, it is working, but one problem is just frustrating me. The number of some pop3-login processes are getting higher and higher until they reach my login_max_processes_count option which is equal 1000. From ps aux it looks like this: dovecot 55067 0.0 0.0 8192 6340 ? S 00:09 0:00 dovecot/pop3-login [1 pre-login] dovecot 55344 0.0 0.0 8192 6388 ? S 00:35 0:00 dovecot/pop3-login [1 pre-login] dovecot 55351 0.0 0.0 8192 6268 ? S 00:35 0:00 dovecot/pop3-login [1 pre-login] dovecot 55354 0.0 0.0 8192 6388 ? S 00:35 0:00 dovecot/pop3-login [1 pre-login] dovecot 55594 0.0 0.0 8192 6280 ? S 00:36 0:00 dovecot/pop3-login [1 pre-login] dovecot 56822 0.0 0.0 8192 6300 ? S 00:36 0:00 dovecot/pop3-login [1 pre-login] dovecot 56996 0.0 0.0 8192 6268 ? S 00:36 0:00 dovecot/pop3-login [1 pre-login] … Once it reaches the login_max_processes_count value my users start to complain to no new mail is arriving. Restart resolves the problem just for some time, until it will come to a limit next time (sometimes it take 1 day, sometimes 1 hour). In my old system I had nothing like that, but I guess it could be done something wrong during migration. I don’t know if it is significant but instead of real users I deal with only one third-party application which utilizeses 5 simultaneous tcp connections to check mailboxes via SSL\TLS. My dovecot is not public, and there is nothing else besides these 5 connections. Currently, in a config I have this: service pop3-login { process_min_avail = 4 process_limit = 4 client_limit = 100 service_count = 100 Please friends give me a way how to handle the situation. Might it be a bug? ========= Regards, Greg Semenov

1 0

Re: Issue running Dovecot in Docker Container
by Naveen Reddy 30 Dec '19

30 Dec '19

I'm not using internal logging. I'm running the docker with the logging to the host. I have used the same options you have specified. The problem is that the below processes are not running inside docker container whereas the standalone dovecot is running these processes(meaning without container) dovecot-Dovecot/auth dovecot-Dovecot/ssl-params dovecot-Director/lmtp dovecot-Director/ssl-params dovecot-Director/imap-login director Thanks & Regards, Naveen On Mon, Dec 30, 2019 at 3:16 PM Marc Roos <M.Roos(a)f1-outsourcing.eu> wrote: > > If you are running your container as root. You will not have the issues > I encountered. Dovecot is dropping to the 'dovecot' and 'dovenull'(?) > when needed, this is fine. > > PS. I would not recommend using internal logging, use something like > this to log to the host or remote syslog. > docker run -v /dev/log:/dev/log -it dovecot-proxy > > > -----Original Message----- > Subject: Re: Issue running Dovecot in Docker Container > > Hi Marc, > > I can see the processes are running as a root in container environment. > Do you think that still have issues ? > Here is the processes running inside container: > > bash-4.2# ps -ef > UID PID PPID C STIME TTY TIME CMD > root 1 0 0 Dec27 ? 00:00:00 /bin/bash /bootstrap.sh > root 7 1 0 Dec27 ? 00:00:00 /usr/sbin/dovecot -F -c > /etc/dovecot/director.conf > root 8 1 0 Dec27 ? 00:00:00 /usr/sbin/dovecot -F > root 9 1 0 Dec27 ? 00:00:00 sleep 36000d > dovecot 10 8 0 Dec27 ? 00:00:00 dovecot-Dovecot/anvil > dovecot 14 7 0 Dec27 ? 00:00:00 dovecot-Director/anvil > root 267 8 0 Dec27 ? 00:00:00 dovecot-Dovecot/log > root 269 8 0 Dec27 ? 00:00:08 dovecot-Dovecot/config > root 281 7 0 Dec27 ? 00:00:00 dovecot-Director/log > root 283 7 0 Dec27 ? 00:00:00 dovecot-Director/config > > > > > Thanks & Regards, > Naveen > > > > On Mon, Dec 30, 2019 at 2:56 PM Marc Roos <M.Roos(a)f1-outsourcing.eu> > wrote: > > > > I have noticed several issues with dovecot, trying to run it > without > root. Which is preferable in any container environment. Maybe you > would > like me to document these somewhere? So at some point they can be > applied. > > > -----Original Message----- > From: Naveen Reddy [mailto:naveenreddy99@gmail.com] > Sent: 30 December 2019 09:02 > To: Aki Tuomi > Cc: dovecot(a)dovecot.org > Subject: Re: Issue running Dovecot in Docker Container > > Hi, I can see those values correctly with the doveconf -nc > command. > Here > is the part of output: > > bash-4.2# doveconf -nc /etc/dovecot/director.conf # 2.2.36 > (1f10bfa63): > /etc/dovecot/director.conf # OS: Linux > 4.1.12-112.14.11.el7uek.x86_64 > x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) # > Hostname: > 69b492645b56 auth_debug = yes auth_default_realm = > xxxxxxxxxxxxxxxx > > auth_verbose = yes base_dir = /var/run/dovecot_director > debug_log_path = > $log_path director_mail_servers = xxxxxxxxxxxxxxxxxx > director_servers = > xxxxxxxxxxxxxxxxxxxx disable_plaintext_auth = no first_valid_uid = > 1000 > hostname = xxxxxxxxxxxxxxxxxxxx info_log_path = $log_path > instance_name > = Director lmtp_proxy = yes log_path = /dovecot.log > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l > mpid=%e %c > home=%h > > Thanks & Regards, > Naveen > > > > On Fri, Dec 27, 2019 at 10:08 PM Aki Tuomi > <aki.tuomi(a)open-xchange.com> > wrote: > > > > Can you check with `doveconf -nc /path/to/director.conf` > that the > values are actually set correctly? > > Aki > > On 27/12/2019 15:34 Naveen Reddy > <naveenreddy99(a)gmail.com> > wrote: > > > > The conf.d files are not included. I have added > !include > conf.d/*.conf to director.conf and reloaded the dovecot and > director > services. > > conf.d/10-logging also has the following lines: > > log_path = /dovecot.log > info_log_path = $log_path > debug_log_path = $log_path > > > The /dovecot.log file still shows empty. Nothing > is being > logged to that file. > > > Thanks & Regards, > Naveen > > > > On Thu, Dec 26, 2019 at 10:52 PM Aki Tuomi < > aki.tuomi(a)open-xchange.com> wrote: > > > > Do you have !include or !try_include in > director.conf? > The conf.d files are not included otherwise. > > Aki > > On 26/12/2019 11:27 Naveen Reddy < > naveenreddy99(a)gmail.com> wrote: > > > I have tried these in the > 10-logging.conf but no > luck. There is nothing logged to the file. > > bash-4.2# ps -ef > UID PID PPID C STIME TTY > > TIME CMD > root 1 0 0 Dec23 ? > > 00:00:00 > /bin/bash /bootstrap.sh > root 8 1 0 Dec23 ? > > 00:00:00 > sleep 36000d > root 15681 0 0 08:51 > pts/1 > 00:00:00 bash > root 16340 0 0 09:19 ? > > 00:00:00 > /usr/sbin/dovecot -c /etc/dovecot/director.conf > dovecot 16341 16340 0 09:19 ? > > 00:00:00 > dovecot-Director/anvil > root 16342 16340 0 09:19 ? > > 00:00:00 > dovecot-Director/log > root 16344 16340 0 09:19 ? > > 00:00:00 > dovecot-Director/config > root 16390 0 0 09:22 ? > > 00:00:00 > /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf > dovecot 16391 16390 0 09:22 ? > > 00:00:00 > dovecot-Dovecot/anvil > root 16392 16390 0 09:22 ? > > 00:00:00 > dovecot-Dovecot/log > root 16394 16390 0 09:22 ? > > 00:00:00 > dovecot-Dovecot/config > root 16406 15681 0 09:22 > pts/1 > 00:00:00 ps > -ef > > > The below processes are not > starting as well. > > dovecot-Dovecot/auth > dovecot-Dovecot/ssl-params > dovecot-Director/lmtp > dovecot-Director/ssl-params > dovecot-Director/imap-login > director > > Thanks & Regards, > Naveen > > > > On Tue, Dec 24, 2019 at 10:54 PM > Aki Tuomi < > aki.tuomi(a)open-xchange.com> wrote: > > > > > > On 24/12/2019 > 12:33 > Naveen Reddy < > naveenreddy99(a)gmail.com> wrote: > > > Hello, > > We need help with > an issue that we are > running into when we are trying to run Dovecot in Docker > container. > > Also how do we > enable debugging for > dovecot. Logs doesn't show any info about the issue. > > Below processes > are > not running when a > Director service is started: > > > dovecot-Dovecot/auth > > dovecot-Dovecot/ssl-params > > dovecot-Director/lmtp > > dovecot-Director/ssl-params > > dovecot-Director/imap-login director > > Here is the > version > that I'm running and > including the dovecot -n output below: > > bash-4.2# dovecot > --version > 2.2.36 > > > bash-4.2# dovecot > -n > # 2.2.36 (xxxxx): > /etc/dovecot/dovecot.conf > # OS: Linux > 4.1.12-112.14.11.el7uek.x86_64 > x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) > # Hostname: XXXXXXX > auth_debug = yes > auth_default_realm > = xxxxxxxxxxxx > auth_verbose = yes > > disable_plaintext_auth = no > dotlock_use_excl = > no > hostname = > xxxxxxxxxxxxxxxx > instance_name = > Dovecot > > login_log_format_elements = user=<%u> > method=%m rip=%r lip=%l mpid=%e %c home=% domain=%d > mail_debug = yes > mail_fsync = always > mail_gid = imapd > mail_home = > /xxxxxxxxxxx/%d/%n > mail_location = > dbox:~/ > mail_uid = imapd > mmap_disable = yes > passdb { > args = > /etc/dovecot/lookups/ldap-pass.conf > driver = ldap > } > passdb { > args = > /etc/dovecot/lookups/xxxx.conf > driver = ldap > } > plugin { > stats_refresh = > 30 secs > stats_track_cmds > = yes > } > protocols = imap > lmtp > service auth { > client_limit = > 4096 > unix_listener > auth-userdb { > mode = 0777 > } > } > service imap-login > { > chroot = login > client_limit = 0 > > drop_priv_before_exec = no > executable = > imap-login > extra_groups = > group = > idle_kill = 0 > inet_listener > imap { > address = > port = 1144 > ssl = no > } > inet_listener > imaps { > address = > port = 994 > ssl = yes > } > privileged_group > = > process_limit = 0 > > process_min_avail > = 0 > protocol = imap > service_count = > 50 > type = login > user = > $default_login_user > vsz_limit = > 18446744073709551615 B > } > service imap { > service_count = > 50 > } > service lmtp { > executable = > lmtp > -L > inet_listener > lmtp { > address = > port = 10025 > } > } > service stats { > fifo_listener > stats-mail { > mode = 0600 > user = imapd > } > } > ssl_cert = > </xxxxxxx/cert/dovecot.pem > ssl_cipher_list = > XXXXXX > ssl_key = # > hidden, use -P to show it > ssl_protocols = > XXXXX > userdb { > args = > /etc/dovecot/lookups/ldap-user.conf > driver = ldap > } > userdb { > args = > /etc/dovecot/lookups/xxxxxxx.conf > driver = ldap > } > > > Thanks & Regards, > Naveen > > > > Try setting > > log_path=/dovecot.log > info_log_path=$log_path > debug_log_path=$log_path > --- > Aki Tuomi > > > --- > Aki Tuomi > > > --- > Aki Tuomi > > > > > >

3 4

Re: Issue running Dovecot in Docker Container
by Naveen Reddy 30 Dec '19

30 Dec '19

Hi Marc, I can see the processes are running as a root in container environment. Do you think that still have issues ? Here is the processes running inside container: bash-4.2# ps -ef UID PID PPID C STIME TTY TIME CMD root 1 0 0 Dec27 ? 00:00:00 /bin/bash /bootstrap.sh root 7 1 0 Dec27 ? 00:00:00 /usr/sbin/dovecot -F -c /etc/dovecot/director.conf root 8 1 0 Dec27 ? 00:00:00 /usr/sbin/dovecot -F root 9 1 0 Dec27 ? 00:00:00 sleep 36000d dovecot 10 8 0 Dec27 ? 00:00:00 dovecot-Dovecot/anvil dovecot 14 7 0 Dec27 ? 00:00:00 dovecot-Director/anvil root 267 8 0 Dec27 ? 00:00:00 dovecot-Dovecot/log root 269 8 0 Dec27 ? 00:00:08 dovecot-Dovecot/config root 281 7 0 Dec27 ? 00:00:00 dovecot-Director/log root 283 7 0 Dec27 ? 00:00:00 dovecot-Director/config Thanks & Regards, Naveen On Mon, Dec 30, 2019 at 2:56 PM Marc Roos <M.Roos(a)f1-outsourcing.eu> wrote: > > I have noticed several issues with dovecot, trying to run it without > root. Which is preferable in any container environment. Maybe you would > like me to document these somewhere? So at some point they can be > applied. > > > -----Original Message----- > From: Naveen Reddy [mailto:naveenreddy99@gmail.com] > Sent: 30 December 2019 09:02 > To: Aki Tuomi > Cc: dovecot(a)dovecot.org > Subject: Re: Issue running Dovecot in Docker Container > > Hi, I can see those values correctly with the doveconf -nc command. Here > is the part of output: > > bash-4.2# doveconf -nc /etc/dovecot/director.conf # 2.2.36 (1f10bfa63): > /etc/dovecot/director.conf # OS: Linux 4.1.12-112.14.11.el7uek.x86_64 > x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) # Hostname: > 69b492645b56 auth_debug = yes auth_default_realm = xxxxxxxxxxxxxxxx > auth_verbose = yes base_dir = /var/run/dovecot_director debug_log_path = > $log_path director_mail_servers = xxxxxxxxxxxxxxxxxx director_servers = > xxxxxxxxxxxxxxxxxxxx disable_plaintext_auth = no first_valid_uid = 1000 > hostname = xxxxxxxxxxxxxxxxxxxx info_log_path = $log_path instance_name > = Director lmtp_proxy = yes log_path = /dovecot.log > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c > home=%h > > Thanks & Regards, > Naveen > > > > On Fri, Dec 27, 2019 at 10:08 PM Aki Tuomi <aki.tuomi(a)open-xchange.com> > wrote: > > > > Can you check with `doveconf -nc /path/to/director.conf` that the > values are actually set correctly? > > Aki > > On 27/12/2019 15:34 Naveen Reddy <naveenreddy99(a)gmail.com> > > wrote: > > > > The conf.d files are not included. I have added !include > conf.d/*.conf to director.conf and reloaded the dovecot and director > services. > > conf.d/10-logging also has the following lines: > > log_path = /dovecot.log > info_log_path = $log_path > debug_log_path = $log_path > > > The /dovecot.log file still shows empty. Nothing is being > logged to that file. > > > Thanks & Regards, > Naveen > > > > On Thu, Dec 26, 2019 at 10:52 PM Aki Tuomi < > aki.tuomi(a)open-xchange.com> wrote: > > > > Do you have !include or !try_include in > director.conf? > The conf.d files are not included otherwise. > > Aki > > On 26/12/2019 11:27 Naveen Reddy < > naveenreddy99(a)gmail.com> wrote: > > > I have tried these in the 10-logging.conf > but no > luck. There is nothing logged to the file. > > bash-4.2# ps -ef > UID PID PPID C STIME TTY > TIME CMD > root 1 0 0 Dec23 ? > 00:00:00 > /bin/bash /bootstrap.sh > root 8 1 0 Dec23 ? > 00:00:00 > sleep 36000d > root 15681 0 0 08:51 pts/1 > 00:00:00 bash > root 16340 0 0 09:19 ? > 00:00:00 > /usr/sbin/dovecot -c /etc/dovecot/director.conf > dovecot 16341 16340 0 09:19 ? > 00:00:00 > dovecot-Director/anvil > root 16342 16340 0 09:19 ? > 00:00:00 > dovecot-Director/log > root 16344 16340 0 09:19 ? > 00:00:00 > dovecot-Director/config > root 16390 0 0 09:22 ? > 00:00:00 > /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf > dovecot 16391 16390 0 09:22 ? > 00:00:00 > dovecot-Dovecot/anvil > root 16392 16390 0 09:22 ? > 00:00:00 > dovecot-Dovecot/log > root 16394 16390 0 09:22 ? > 00:00:00 > dovecot-Dovecot/config > root 16406 15681 0 09:22 pts/1 > 00:00:00 ps > -ef > > > The below processes are not starting as > well. > > dovecot-Dovecot/auth > dovecot-Dovecot/ssl-params > dovecot-Director/lmtp > dovecot-Director/ssl-params > dovecot-Director/imap-login director > > Thanks & Regards, > Naveen > > > > On Tue, Dec 24, 2019 at 10:54 PM Aki Tuomi > < > aki.tuomi(a)open-xchange.com> wrote: > > > > > > On 24/12/2019 12:33 Naveen > Reddy < > naveenreddy99(a)gmail.com> wrote: > > > Hello, > > We need help with an issue > that we are > running into when we are trying to run Dovecot in Docker container. > Also how do we enable > debugging for > dovecot. Logs doesn't show any info about the issue. > > Below processes are not > running when a > Director service is started: > > dovecot-Dovecot/auth > dovecot-Dovecot/ssl-params > dovecot-Director/lmtp > dovecot-Director/ssl-params > > dovecot-Director/imap-login director > > Here is the version that > I'm running and > including the dovecot -n output below: > > bash-4.2# dovecot --version > 2.2.36 > > > bash-4.2# dovecot -n > # 2.2.36 (xxxxx): > /etc/dovecot/dovecot.conf > # OS: Linux > 4.1.12-112.14.11.el7uek.x86_64 > x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) > # Hostname: XXXXXXX > auth_debug = yes > auth_default_realm = > xxxxxxxxxxxx > auth_verbose = yes > disable_plaintext_auth = no > dotlock_use_excl = no > hostname = xxxxxxxxxxxxxxxx > instance_name = Dovecot > login_log_format_elements > = user=<%u> > method=%m rip=%r lip=%l mpid=%e %c home=% domain=%d > mail_debug = yes > mail_fsync = always > mail_gid = imapd > mail_home = > /xxxxxxxxxxx/%d/%n > mail_location = dbox:~/ > mail_uid = imapd > mmap_disable = yes > passdb { > args = > /etc/dovecot/lookups/ldap-pass.conf > driver = ldap > } > passdb { > args = > /etc/dovecot/lookups/xxxx.conf > driver = ldap > } > plugin { > stats_refresh = 30 secs > stats_track_cmds = yes > } > protocols = imap lmtp > service auth { > client_limit = 4096 > unix_listener > auth-userdb { > mode = 0777 > } > } > service imap-login { > chroot = login > client_limit = 0 > drop_priv_before_exec = > no > executable = imap-login > extra_groups = > group = > idle_kill = 0 > inet_listener imap { > address = > port = 1144 > ssl = no > } > inet_listener imaps { > address = > port = 994 > ssl = yes > } > privileged_group = > process_limit = 0 > process_min_avail = 0 > protocol = imap > service_count = 50 > type = login > user = > $default_login_user > vsz_limit = > 18446744073709551615 B > } > service imap { > service_count = 50 > } > service lmtp { > executable = lmtp -L > inet_listener lmtp { > address = > port = 10025 > } > } > service stats { > fifo_listener stats-mail > { > mode = 0600 > user = imapd > } > } > ssl_cert = > </xxxxxxx/cert/dovecot.pem > ssl_cipher_list = XXXXXX > ssl_key = # hidden, use > -P to show it > ssl_protocols = XXXXX > userdb { > args = > /etc/dovecot/lookups/ldap-user.conf > driver = ldap > } > userdb { > args = > /etc/dovecot/lookups/xxxxxxx.conf > driver = ldap > } > > > Thanks & Regards, > Naveen > > > > Try setting > > log_path=/dovecot.log > info_log_path=$log_path > debug_log_path=$log_path > --- > Aki Tuomi > > > --- > Aki Tuomi > > > --- > Aki Tuomi > > >

2 1

Issue running Dovecot in Docker Container
by Naveen Reddy 30 Dec '19

30 Dec '19

Hello, We need help with an issue that we are running into when we are trying to run Dovecot in Docker container. Also how do we enable debugging for dovecot. Logs doesn't show any info about the issue. Below processes are not running when a Director service is started: dovecot-Dovecot/auth dovecot-Dovecot/ssl-params dovecot-Director/lmtp dovecot-Director/ssl-params dovecot-Director/imap-login director Here is the version that I'm running and including the dovecot -n output below: bash-4.2# dovecot --version 2.2.36 bash-4.2# dovecot -n # 2.2.36 (xxxxx): /etc/dovecot/dovecot.conf # OS: Linux 4.1.12-112.14.11.el7uek.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) # Hostname: XXXXXXX auth_debug = yes auth_default_realm = xxxxxxxxxxxx auth_verbose = yes disable_plaintext_auth = no dotlock_use_excl = no hostname = xxxxxxxxxxxxxxxx instance_name = Dovecot login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c home=% domain=%d mail_debug = yes mail_fsync = always mail_gid = imapd mail_home = /xxxxxxxxxxx/%d/%n mail_location = dbox:~/ mail_uid = imapd mmap_disable = yes passdb { args = /etc/dovecot/lookups/ldap-pass.conf driver = ldap } passdb { args = /etc/dovecot/lookups/xxxx.conf driver = ldap } plugin { stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap lmtp service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0777 } } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 1144 ssl = no } inet_listener imaps { address = port = 994 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 50 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap { service_count = 50 } service lmtp { executable = lmtp -L inet_listener lmtp { address = port = 10025 } } service stats { fifo_listener stats-mail { mode = 0600 user = imapd } } ssl_cert = </xxxxxxx/cert/dovecot.pem ssl_cipher_list = XXXXXX ssl_key = # hidden, use -P to show it ssl_protocols = XXXXX userdb { args = /etc/dovecot/lookups/ldap-user.conf driver = ldap } userdb { args = /etc/dovecot/lookups/xxxxxxx.conf driver = ldap } Thanks & Regards, Naveen

3 7

Dovecot Postfix MySQL Authentication Issues
by jason hirsh 29 Dec '19

29 Dec '19

I aim using mysql 5.7.28 Postfix 3.4,8 Dovecot 2.3.9.2 It began a whole and I was using the Purple Hat Organiation installation guide which was loaded with minor errors Now dead in water

1 0

Dovecot Postfix MySQL Authentication Issues
by jason hirsh 29 Dec '19

29 Dec '19

I am I a situation where I have to wipe my remote server and reinstall, Its been a while since I built a server and I am not as sharp as I use to be I am running FreeBSD 12.1. well at least the server is... I am getting constant authentication errors like Dec 28 22:10:18 triggerfish dovecot[21809]: imap-login: Aborted login (auth failed, 1 attempts in 6 secs): user=<jason(a)example.com>, method=PLAIN, rip=73.150.178.106, lip=x.x.x.x, TLS, session=<QFSvEM+aA8lJlrJq> Dec 28 22:10:19 triggerfish dovecot[21809]: imap-login: Aborted login (client didn't finish SASL auth, waited 4 secs): user=<>, method=LOGIN, rip=73.150.178.106, lip=x.x.x.x, TLS, session=<FNjXEM+aBMlJlrJq> Dec 28 22:10:19 triggerfish dovecot[21809]: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=73.150.178.106, lip=x,x,x,x, TLS: Connection closed, session=<pNccEc+aBslJlrJq> Dec 28 22:10:24 triggerfish dovecot[21809]: imap-login: Aborted login (auth failed, 1 attempts in 6 secs): user=<jason(a)example.com>, method=LOGIN, rip=73.150.178.106, lip=x,x,x,x, TLS, session=<hukLEc+aBclJlrJq> results of postconf -n are broken_sasl_auth_clients = yes command_directory = /usr/local/sbin compatibility_level = 2 daemon_directory = /usr/local/libexec/postfix data_directory = /var/db/postfix debug_peer_level = 2 debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 dovecot_destination_recipient_limit = 1 html_directory = /usr/local/share/doc/postfix inet_protocols = ipv4 mail_owner = postfix mailq_path = /usr/local/bin/mailq manpage_directory = /usr/local/man message_size_limit = 25600000 meta_directory = /usr/local/libexec/postfix mydestination = localhost mydomain = example.com myhostname = mail.example.com mynetworks_style = host newaliases_path = /usr/local/bin/newaliases queue_directory = /var/spool/postfix readme_directory = /usr/local/share/doc/postfix relay_recipient_maps = mysql:/usr/local/etc/postfix/mysql-virtual-mailbox-maps.cf sample_directory = /usr/local/etc/postfix sendmail_path = /usr/local/sbin/sendmail setgid_group = maildrop shlib_directory = /usr/local/lib/postfix smtp_tls_note_starttls_offer = yes smtp_use_tls = yes smtpd_delay_reject = yes smtpd_helo_required = yes smtpd_helo_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_invalid_hostname, reject_unknown_hostname, reject_non_fqdn_hostname, reject_non_fqdn_helo_hostname, reject_invalid_helo_hostname, permit smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_non_fqdn_hostname, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unauth_destination, reject_unauth_pipelining, reject_rbl_client bl.spamcop.net, reject_rbl_client sbl-xbl.spamhaus.org, reject_rbl_client zen.spamhaus.org, reject_rbl_client dnsbl.sorbs.net, reject_rbl_client rhsbl.sorbs.net, reject_rbl_client db.wpbl.info, reject_rbl_client cbl.abuseat.org, reject_rbl_client proxies.blackholes.wirehub.net, reject_rbl_client query.bondedsender.org permit smtpd_relay_restrictions = permit_mynetworks permit_sasl_authenticated defer_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_sender_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_non_fqdn_sender, reject_unknown_sender_domain, reject_unlisted_sender, permit smtpd_tls_auth_only = yes smtpd_tls_cert_file = /usr/local/etc/ssl/more/server.crt smtpd_tls_key_file = /usr/local/etc/ssl/more/server.key smtpd_tls_loglevel = 0 smtpd_tls_mandatory_protocols = !SSLv2,!SSLv3 smtpd_tls_received_header = yes smtpd_tls_session_cache_timeout = 3600s smtpd_use_tls = yes soft_bounce = no tls_random_source = dev:/dev/urandom unknown_local_recipient_reject_code = 550 virtual_alias_maps = mysql:/usr/local/etc/postfix/mysql-virtual-alias-maps.cf virtual_mailbox_domains = mysql:/usr/local/etc/postfix/mysql-virtual-domains-maps.cf virtual_mailbox_limit = 51200000 virtual_mailbox_maps = mysql:/usr/local/etc/postfix/mysql-virtual-mailbox-maps.cf virtual_transport = lmtp:unix:private/dovecot-lmtp Not sure if I need to post main.cf. I have been beating my head against the screen for a week and thought I'd try here. Probably some stupid typo or stupid action on my part. Feel free to slap me around

2 1

Using "doveadm pw" as unpriviledged user
by Ralf Jung 29 Dec '19

29 Dec '19

Hi all, Some time ago, I wrote a small CGI script to let users change their IMAP password. The script runs as www-data user and uses "doveadm pw" to check if a password hash matches a password. Unfortunately, this means that I have to make large parts of my dovecot config world-readable, as otherwise I get errors like this: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-auth.conf line 123: Couldn't open include file /etc/dovecot/conf.d/auth-sql.conf.ext: Permission denied I understand doveadm also does plenty of things that interact with the running dovecot instance and thus need access to the config, but for generating hashes or comparing hashes with passwords, it should not be necessary to read the dovecot config. This shouldn't require a properly setup dovecot on this machine at all, in fact. I'd prefer to make the config not world-readable, and indeed the Debian packaging sometimes makes those files not-world-readable on upgrades, breaking my setup. Is there any way to call "doveadm pw" as a users that cannot read the dovecot config on the current machine? This happens with the following versions of the dovecot debian package: 1:2.3.4.1-5+deb10u1~bpo9+1, 1:2.3.4.1-5+deb10u1 Thanks! Ralf PS: Please keep me in Cc, as I am not subscribed to the list.

1 0

Packages missing from repo
by Jon Geerars 29 Dec '19

29 Dec '19

Hi, Since a couple of weeks the Dovecot packages for Debian Jessie and Ubuntu Trusty have disappeared from the repo. According to https://repo.dovecot.org/ they should be in https://repo.dovecot.org/ce-2.3-latest/debian/jessie and https://repo.dovecot.org/ce-2.3-latest/ubuntu/trusty, but that leads to a 404. Where can I find them? Jon

2 3

Dovecot proxy: authentication best practices
by William Edwards 28 Dec '19

28 Dec '19

Hi! I have a few questions regarding Dovecot proxy: 1. 1.1 If I understand correctly, setting 'nopassword' in the proxy passdb file, authentication is completely up to the destination host. Setting 'nopassword' in no way means the proxy becomes an open relay. Is this correct? 1.2 Are there any security implications when using 'nopassword' on the proxy? 2. 2.1 I would like to avoid having to store all users in a passdb file on the proxy. I would much rather specify a domain for which Dovecot proxy will route all users to a specific host. Is there a way to let Dovecot proxy route to a destination host based on domain, so individual users don't have to be specified in the proxy passdb? 2.2 Is it correct that userdb does not have any effect on proxying and it can be left out of the config? Source: https://dovecot.org/pipermail/dovecot/2013-October/093138.html (point 2) Met vriendelijke groeten, William Edwards T. 040 - 711 44 96 E. wedwards(a)cyberfusion.nl

2 2

Move mailbox/folder tree?
by Marc Roos 27 Dec '19

27 Dec '19

What would be the adviced method of moving a complete mailbox/folder tree? Eg. to a different namespace. Is this possible with 'doveadm move -u test'

1 0

Setting up expunge rules on a per user basis?
by Peter Reinhold 27 Dec '19

27 Dec '19

Hi all, I was wondering, is it possible to setup for instance expunge rules on a per user basis, when I am using userdb SQL lookups (or, possibly via post-login scripts) Reading the docs it seems like its possible, but I am not entirely sure about the data I should return, so have any of you done something like this, and could maybe post an example? -- Peter Reinhold

1 0

Saving Attachments
by ＠lbutlr 26 Dec '19

26 Dec '19

I have an account that mostly receives automated emails with attachments. I would like to save those attachments outside of the mail/IMAP area and then add a link (in the headers) to the saved attachment in the original mail. I do not need to strip the attachment from the email. I’ve looked at 10-mail.conf. but I am using Maildir and I do not want to alter the email other than adding a header like X-Local-link: URL://server/path/to/file If mdbox or sdbox are the only options for this, can I specify that for a single user account instead of for all my users? My other idea was to break out my old ripmime script that I wrote for procmail and do something in sieve like if anyof (header :contains [“content-type"] [ “multiupart”, “other types”]) { fileinto :create “TempAttach”; } And then let ripmime loose on .TempAttach/new/ via a periodic cron job knowing the message would end up being filed in whatever default mailbox after the copy was dropped in the temp mail, but that doesn’t get me the added header with the link to the attachment without a lot of work. I suppose I could generate a second mail with the details of the attachment (size, name, sender, date). Not ideal. Suggestions? -- No one ever thinks of themselves as one of Them. We're always one of Us. It's Them that do the bad things.

1 0

Thunderbird, server side filtering (sieve) and new email not in "inbox"
by Jesus Cea 25 Dec '19

25 Dec '19

Migrating my extensive thunderbird filtering rules to sieve has the unfortunate effect that thunderbird doesn't realize that there is new email in other mailboxes beside "inbox". According to ancient documentation, <http://kb.mozillazine.org/How_do_I_check_for_new_messages_in_other_folders#…>, I could configure Thunderbird to check each mailbox periodically, but I have >500 mailboxes and I rather prefer the server to notify the client when new email is avaliable somewhere. Reading between lines in that document, looks like Thunderbird would support STATUS updates while in "IDLE". Is that the case?. Do you know how could I configure dovecot to provide that kind of information to thunderbird?. Maybe some extension? I am aware of "notify", but thunderbird is not "notify" compatible. I can write an IMAP4 proxy to "inject" replies to thunderbird side-fetched via "notify", but I need to know what thunderbird expect. Do you have any idea?. Thanks for your time and expertise. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 0

Is there a way to hide the top level virtual IMAP folder when using the virtual plugin?
by Robert L Mathews 24 Dec '19

24 Dec '19

I'm experimenting with the Virtual plugin to give users access to folders like "All Mail", "Recent" and so on, similar to Gmail. Something like this works properly: mail_location = maildir:~/ namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace { prefix = INBOX.virtual. separator = . location = virtual:virtual list = children ignore_on_failure = yes } I can then create "virtual/All Mail/dovecot-virtual" and "virtual/Recent/dovecot-virtual" in the maildir directory, and it works. However, when accessed using IMAP, an IMAP folder named "virtual" shows in the folder hierarchy, with "All Mail" and "Recent" descended from "virtual". It looks like: INBOX Drafts Sent Trash virtual All Mail Recent I'd prefer the virtual folders to be a level up the hierarchy without the "virtual" parent visible, like: INBOX All Mail Drafts Recent Sent Trash Is that possible? I've tried changing the "prefix = INBOX.virtual." on the virtual namespace to just "prefix = INBOX.", but that causes a "Duplicate namespace prefix" error. I also tried using "alias_for" to merge the namespaces, but that causes "namespace configuration error: Namespace virtual. can't have alias_for=INBOX. to a different storage type (virtual vs maildir)". -- Robert L Mathews

1 1

When is a new mail not unseen?
by Philip Colmer 24 Dec '19

24 Dec '19

I'm trying to diagnose a really strange situation where certain emails, when submitted to the mailbox by Postfix, are not considered to be unseen by Dovecot. During testing, I've shut down anything else on the server that might want to access the mailbox. I submit the email to the local postfix instance which then says it has delivered it to the mailbox: Dec 23 09:51:35 ip-10-35-194-108 postfix/smtpd[3283]: connect from localhost[127.0.0.1] Dec 23 09:51:35 ip-10-35-194-108 postfix/smtpd[3283]: 5A0BF40261: client=localhost[127.0.0.1] Dec 23 09:51:35 ip-10-35-194-108 postfix/cleanup[3286]: 5A0BF40261: message-id=<20191223095135.5A0BF40261(a)servicedesk.linaro.org> Dec 23 09:51:35 ip-10-35-194-108 postfix/smtpd[3283]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 Dec 23 09:51:35 ip-10-35-194-108 postfix/qmgr[1660]: 5A0BF40261: from=< philip.colmer(a)linaro.org>, size=702, nrcpt=1 (queue active) Dec 23 09:51:35 ip-10-35-194-108 postfix/local[3287]: 5A0BF40261: to=<local-it-support@localhost>, relay=local, delay=0.06, delays=0.04/0.02/0/0, dsn=2.0.0, status=sent (delivered to mailbox) Dec 23 09:51:35 ip-10-35-194-108 postfix/qmgr[1660]: 5A0BF40261: removed I then use this command to query the state of the mailbox: sudo doveadm mailbox status -u local-it-support all INBOX and get this response: INBOX messages=142 recent=0 uidnext=5596 uidvalidity=1455577845 unseen=0 highestmodseq=1163 vsize=11315688 guid=2a997739f55ac2560d180000e171d23e firstsaved=1577094051 What can be happening that means that Dovecot doesn't treat a newly delivered message as unseen? Installation details: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1041-aws x86_64 Ubuntu 18.04.3 LTS auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no listen = 127.0.0.1 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" ssl = no ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { driver = passwd } Note that we are not using SSL because Dovecot is only accessible locally within the server. Thank you for any suggestions or comments. Regards Philip

4 10

Sieve vacation not getting enough headers "no known (envelope) recipient address found in message headers"
by Marc Roos 24 Dec '19

24 Dec '19

I am getting these errors[1]. With fairly default setup where sendmail is delivering mail via lmtp. Adding these, do not seem to make a difference. Should I add something to the sendmail configuration? sieve_vacation_dont_check_recipient = no sieve_vacation_use_original_recipient = no [1] discarding vacation response for implicitly delivered message; no known (envelope) recipient address found in message headers

1 0

Trouble using reverse dsync backup (log in successful but almost nothing happens)
by Gerben Wierda 23 Dec '19

23 Dec '19

I am migrating an old dovecot 2.2.30 (macOS High SIerra, macO S Server) to a new server with dovecot 2.3.7 (macOS Mojave, macports). To get the data over, I’m trying to do a reverse backup with doveadm between an old and a new mail server, but failing to do so. I’m trying (from the new server, the old server is 192.168.2.67): doveadm -Dv \ -o imapc_host=192.168.2.67 \ -o imapc_user=gerben \ -o imapc_password=’[snip]' \ -o imapc_features='rfc822.size fetch-headers’ \ -o mail_prefetch_count=20 \ -o mail_fsync=never \ -o imapc_ssl=starttls \ -o imapc_ssl_verify=no \ backup -R -u gerben imapc: It seems to start to work: dsync(gerben): Debug: imapc(192.168.2.67:143): Created new connection dsync(gerben): Debug: imapc(192.168.2.67:143): Looking up IP address (reconnect_ok=true, last_connect=1577059834) dsync(gerben): Debug: imapc(192.168.2.67:143): Connecting to 192.168.2.67:143 dsync(gerben): Info: imapc(192.168.2.67:143): Connected to 192.168.2.67:143 (local 192.168.2.66:50804) dsync(gerben): Debug: imapc(192.168.2.67:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS LOGINDISABLED XAPPLEPUSHSERVICE dsync(gerben): Debug: imapc(192.168.2.67:143): Starting SSL handshake dsync(gerben): Debug: imapc(192.168.2.67:143): SSL handshake successful, ignoring invalid certificate: SSL certificate doesn't match expected host name 192.168.2.67: No match to 2 SubjectAltNames dsync(gerben): Debug: imapc(192.168.2.67:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE XAPPLEPUSHSERVICE AUTH=CRAM-MD5 AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=GSSAPI dsync(gerben): Debug: imapc(192.168.2.67:143): Authenticating as gerben dsync(gerben): Debug: imapc(192.168.2.67:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE XAPPLEPUSHSERVICE COMPRESS=DEFLATE QUOTA ACL RIGHTS=texk dsync(gerben): Debug: imapc(192.168.2.67:143): Authenticated successfully dsync(gerben): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= dsync(gerben): Debug: fts: Indexes disabled for namespace '' dsync(gerben): Debug: brain S: Namespace has location imapc: dsync(gerben): Debug: brain M: Local mailbox tree: INBOX guid=184a4c066b219a5dd73700009e3b11ac uid_validity=1570382187 uid_next=18 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1232523592 uid_next=482711 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Notspam_train guid=e0cc8c076b219a5dd73700009e3b11ac uid_validity=1570382188 uid_next=10 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old guid=c71fb29dcfd52e98ffb476033482311a uid_validity=1246525241 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Sent guid=e8c3b0076b219a5dd73700009e3b11ac uid_validity=1570382189 uid_next=17 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk guid=493c1b0ff8829799ae854dcdd35bdc49 uid_validity=1246525654 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Spam_train guid=7076d5076b219a5dd73700009e3b11ac uid_validity=1570382190 uid_next=3719 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/UitNFIMailboxen guid=1da8c05ea358b80ee1c2f3a01cc7f2cc uid_validity=1232523595 uid_next=118 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Trash guid=4810f5076b219a5dd73700009e3b11ac uid_validity=1570382191 uid_next=3 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/RvdR guid=44c6bc132d8b2818930a6bcf0d2a5706 uid_validity=1232523595 uid_next=349 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Junk guid=f8a063086b219a5dd73700009e3b11ac uid_validity=1570382194 uid_next=1 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/Nieuwe Baan guid=75a5c26e35145b08ff594eb249867d0e uid_validity=1232523595 uid_next=380 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Subfolder guid=d8d293340d2c9a5d1d3a00009e3b11ac uid_validity=1570382195 uid_next=1 subs=yes last_change=0 last_subs=1570384909 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/NFI guid=3d3c4682642c7ccb58523e0726a0ecff uid_validity=1232523595 uid_next=289 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Subfolder/SUbSubFolder guid=08fb2d1a402c9a5d1d3a00009e3b11ac uid_validity=1570382196 uid_next=1 subs=yes last_change=0 last_subs=1570384960 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects guid=7843f3ba3f3bfb3c4c965c1bd59b219a uid_validity=1246525385 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Archive guid=d89d4d148903005e6b5501009e3b11ac uid_validity=1570382197 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX guid=2063d233e1533d17e6910c2d1c3d802c uid_validity=1232523594 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Drafts guid=60cd72148903005e6b5501009e3b11ac uid_validity=1570382198 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/Word Hell guid=bbd58ddde1f98e962507f8868f2b8372 uid_validity=1232523594 uid_next=123 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/TUG2003 guid=af8b9bd0abed0f24ff41acd3e0f6cfcf uid_validity=1232523594 uid_next=202 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/TUG ADC guid=2c828ce4f978e96b8199cd3364cf831a uid_validity=1232523594 uid_next=127 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1232523592 uid_next=482711 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old guid=c71fb29dcfd52e98ffb476033482311a uid_validity=1246525241 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk guid=493c1b0ff8829799ae854dcdd35bdc49 uid_validity=1246525654 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/UitNFIMailboxen guid=1da8c05ea358b80ee1c2f3a01cc7f2cc uid_validity=1232523595 uid_next=118 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/RvdR guid=44c6bc132d8b2818930a6bcf0d2a5706 uid_validity=1232523595 uid_next=349 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/Nieuwe Baan guid=75a5c26e35145b08ff594eb249867d0e uid_validity=1232523595 uid_next=380 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/NFI guid=3d3c4682642c7ccb58523e0726a0ecff uid_validity=1232523595 uid_next=289 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects guid=7843f3ba3f3bfb3c4c965c1bd59b219a uid_validity=1246525385 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX guid=2063d233e1533d17e6910c2d1c3d802c uid_validity=1232523594 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/Word Hell guid=bbd58ddde1f98e962507f8868f2b8372 uid_validity=1232523594 uid_next=123 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/TUG2003 guid=af8b9bd0abed0f24ff41acd3e0f6cfcf uid_validity=1232523594 uid_next=202 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/TUG ADC guid=2c828ce4f978e96b8199cd3364cf831a uid_validity=1232523594 uid_next=127 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/TUG guid=0ff5d314b54457b60c266634bca9898a uid_validity=1232523594 uid_next=242 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/TUG guid=0ff5d314b54457b60c266634bca9898a uid_validity=1232523594 uid_next=242 subs=yes last_change=0 last_subs=0 etc. Then, at some point, it changes to: dsync(gerben): Debug: brain M: Mailbox AAA Superjunk: local=00000000000000000000000000000000/0/0, remote=3232b6d3762f0d825fa9c7a1499b292f/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox APG: local=00000000000000000000000000000000/0/0, remote=d857f802643888ecbec4214ad6b7717e/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Administrator: local=00000000000000000000000000000000/0/0, remote=8be9e36e5e0d2a6a87de584aaca0193f/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Apple: local=00000000000000000000000000000000/0/0, remote=e85a0aa21c23f5abd2975a89b6820d63/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Apple Mail To Do: local=00000000000000000000000000000000/0/0, remote=6275568b3221fc326872b07eefccd0b2/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Archive: local=d89d4d148903005e6b5501009e3b11ac/0/1, remote=51a58e1d1d5c491aac71488647b20224/0/1: GUIDs conflict - will be merged later dsync(gerben): Debug: brain M: Mailbox Bounces: local=00000000000000000000000000000000/0/0, remote=3479a3b099333fa68dd4b912625af777/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Calendar Events: local=00000000000000000000000000000000/0/0, remote=498953ab9976b9c77b62da8cb4dd790a/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox DMARC: local=00000000000000000000000000000000/0/0, remote=decbde7a60591d2b65d074f75f07845f/0/1: mailbox not selectable yet with lots of 'mailbox not selectable yet' After I see all the remote (old server) mailboxes being mentioned such, then I see dsync(gerben): Debug: brain M: Deleting mailbox 'Archive' (GUID d89d4d148903005e6b5501009e3b11ac): UIDVALIDITY changed (1295434254 -> 1570382197) dsync(gerben): Debug: brain M: Deleting mailbox 'Drafts' (GUID 60cd72148903005e6b5501009e3b11ac): UIDVALIDITY changed (1232523592 -> 1570382198) dsync(gerben): Debug: brain M: Deleting mailbox 'INBOX' (GUID 184a4c066b219a5dd73700009e3b11ac): UIDVALIDITY changed (1232523592 -> 1570382187) dsync(gerben): Debug: brain M: Deleting mailbox 'Junk' (GUID f8a063086b219a5dd73700009e3b11ac): UIDVALIDITY changed (1295433962 -> 1570382194) dsync(gerben): Debug: brain M: Deleting mailbox 'Notspam_train' (GUID e0cc8c076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Sent' (GUID e8c3b0076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Spam_train' (GUID 7076d5076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Subfolder/SUbSubFolder' (GUID 08fb2d1a402c9a5d1d3a00009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Subfolder' (GUID d8d293340d2c9a5d1d3a00009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Trash' (GUID 4810f5076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: doveadm-sieve: Iterating Sieve mailbox attributes dsync(gerben): Debug: sieve: Pigeonhole version 0.5.7.1 () initializing dsync(gerben): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. dsync(gerben): Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.7.1 () loaded dsync(gerben): Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.7.1 () loaded dsync(gerben): Debug: sieve: file storage: Using active Sieve script path: /private/var/mail/nl.rna.mail/rules/gerben/dovecot.sieve dsync(gerben): Debug: sieve: file storage: Using script storage path: /private/var/mail/nl.rna.mail/rules/gerben/gerben dsync(gerben): Debug: sieve: file storage: Using permissions from /private/var/mail/nl.rna.mail/rules/gerben/gerben: mode=0700 gid=-1 dsync(gerben): Debug: sieve: file storage: Relative path to sieve storage in active link: gerben/ dsync(gerben): Debug: sieve: file storage: sync: Synchronization active dsync(gerben): Debug: sieve: file storage: quota: Storage limit: 52428800 bytes dsync(gerben): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. dsync(gerben): Debug: brain S: Remote mailbox tree: INBOX guid=184a4c066b219a5dd73700009e3b11ac uid_validity=1570382187 uid_next=18 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Notspam_train guid=e0cc8c076b219a5dd73700009e3b11ac uid_validity=1570382188 uid_next=10 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Sent guid=e8c3b0076b219a5dd73700009e3b11ac uid_validity=1570382189 uid_next=17 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Remote mailbox tree: Spam_train guid=7076d5076b219a5dd73700009e3b11ac uid_validity=1570382190 uid_next=3719 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Trash guid=4810f5076b219a5dd73700009e3b11ac uid_validity=1570382191 uid_next=3 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Junk guid=f8a063086b219a5dd73700009e3b11ac uid_validity=1570382194 uid_next=1 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Subfolder guid=d8d293340d2c9a5d1d3a00009e3b11ac uid_validity=1570382195 uid_next=1 subs=yes last_change=0 last_subs=1570384909 dsync(gerben): Debug: brain S: Remote mailbox tree: Subfolder/SUbSubFolder guid=08fb2d1a402c9a5d1d3a00009e3b11ac uid_validity=1570382196 uid_next=1 subs=yes last_change=0 last_subs=1570384960 dsync(gerben): Debug: brain S: Remote mailbox tree: Archive guid=d89d4d148903005e6b5501009e3b11ac uid_validity=1570382197 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Remote mailbox tree: Drafts guid=60cd72148903005e6b5501009e3b11ac uid_validity=1570382198 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: imapc(192.168.2.67:143): Disconnected But nothing has been copied over and while it states it has deleted local mailboxes (such as Subfolder/SUbSubFolder), they are still there. In other words: nothing happens. Well, not quite. The first time I ran this, local directory /var/mail/nl.rna.mail/rules/gerben/gerben/tmp was created. Can anyone see here what is going wrong? Gerben Wierda Chess and the Art of Enterprise Architecture <http://enterprisechess.com/> Mastering ArchiMate <http://masteringarchimate.com/> Architecture for Real Enterprises <https://www.infoworld.com/blog/architecture-for-real-enterprises/> at InfoWorld On Slippery Ice <https://eapj.org/on-slippery-ice/> at EAPJ

1 1

Is it safe to mix dovecot import/backup/sync between dovecot versions 2.2.30.2 and 2.3.7.1?
by Gerben Wierda 22 Dec '19

22 Dec '19

I am migrating a server. The old one uses dovecot 2.2.30.2 and the new one 2.3.7.1. I don’t want to use any tool that might influence flags on messages. I am using Maildir format on both ends and I have a way to let one server access the data on the other (either using an rsync or a direct access). Could I set up a sync between both to create a smooth migration? Gerben Wierda Chess and the Art of Enterprise Architecture <http://enterprisechess.com/> Mastering ArchiMate <http://masteringarchimate.com/> Architecture for Real Enterprises <https://www.infoworld.com/blog/architecture-for-real-enterprises/> at InfoWorld On Slippery Ice <https://eapj.org/on-slippery-ice/> at EAPJ

2 2

dovecot rejecting connects
by Roy 22 Dec '19

22 Dec '19

I am a newbie to dovecot but not postfix and centos I created a new VM with Centos 8 and installed dovecot and postfix. Postfix is working fine but dovecot rejects connections from anything but the local machine. Locally Trying 10.10.100.157... Connected to 10.10.100.157. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. Machine on same subnet. Windows, Linux, etc. Doesn't seem to matter telnet 10.10.100.157 143 Connecting To 10.10.100.157... Could not open connection to the host, on port 143: Connect failed I made sure the iptables are empty so it doesn't seem to be a firewall issue I put some LOG statements in the iptables and it showed the connect packet arriving and the response packet was ICMP type 3 code 13. Any ideas? Roy

3 4

unable to edit wiki 2, here's the edit:
by Steve Newcomb 19 Dec '19

19 Dec '19

In https://wiki.dovecot.org/Migration/Courier , mail_location = maildir:~/Maildir namespace { prefix = INBOX. separator = . inbox = yes } ... is wrong. Apparently it should be ... mail_location = maildir:~/INBOX ...which at least seemed to work, although (by that time?) I wound up re-downloading all mail. Steve Newcomb srn(a)coolheads.com (Unable to edit the wiki page... Mysterious question stood in the way, something like, "How do you prevent spam?" Evidently I don't know the correct answer.

1 0

slow logins over login_trusted_network
by Wojciech Puchar 18 Dec '19

18 Dec '19

i've upgraded dovecot on my server to 2.3.9 works properly but saslauthd that uses it for rimap authentication over 127.0.0.1 works SLOW. You need to wait 15-20 seconds before authentication. only imap login over 127.0.0.1 is slowed down, while over any other IP is quick. i had this problem with older version of dovecot but it was about adding login_trusted_networks = 127.0.0.1 but i already have this and logins is slow. how to disable throttling (or better - put other limits) for 127.0.0.1?

3 5

DSync replication error
by 横山航平 18 Dec '19

18 Dec '19

Please tell me about Dsync replicator. The following are set to enable the "replication" plug-in /etc/dovecot/conf.d/10-mail.conf *---mail_plugins = notify replication---* And I made the following file /etc/dovecot/conf.d/30-dsync.conf *---service replicator { process_min_avail = 1} dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%uplugin { mail_replica = remote:root@"ServerIP"} service aggregator { fifo_listener replication-notify-fifo { user = mail } unix_listener replication-notify { user = mail }} service replicator { unix_listener replicator-doveadm { mode = 0600 }} replication_max_conns = 10 plugin { # When saving a new mail via IMAP or delivering a mail via LDA/LMTP, # wait for the mail to be synced to the remote site. If it doesn't finish # in 2 seconds, return success anyway. # replication_sync_timeout = 2s}---* But replication gives an error --- *Error: open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied* --- Why is this? By the way, When 30-dsync.conf is changed as follows, it works only for one user *---service aggregator { fifo_listener replication-notify-fifo { user = "one user name" } unix_listener replication-notify { user = "one user name" }}---* However, I want to work with all mail users. Please help me what to do. My configuration is as follows *---# 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf# OS: Linux 3.10.0-1062.9.1.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) # Hostname: test1.s1.iwate-np.co.jp <http://test1.s1.iwate-np.co.jp>dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%ufirst_valid_uid = 1000mail_location = maildir:~/Maildirmail_plugins = notify replicationmbox_write_locks = fcntlnamespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = }passdb { driver = pam}plugin { mail_replica = remote:root@192.168.4.2 <remote%3Aroot(a)192.168.4.2>}service aggregator { fifo_listener replication-notify-fifo { user = mail } unix_listener replication-notify { user = mail }}service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 }}ssl = requiredssl_cert = </etc/pki/dovecot/certs/dovecot.pemssl_key = # hidden, use -P to show ituserdb { driver = passwd}---*

2 2

Local lmtp proxy on backend server
by Marc Roos 17 Dec '19

17 Dec '19

I receive a local mail when I do a 'mail test' on a backend svr1 with this[0] configuration. However when I just add only one configuration change 'lmtp_proxy = yes' I am getting these errors[1]. I would expect this email to still be delivered locally, should this be working or do I misunderstand the lmtp proxy functionality? [0] passdb { args = auth_verbose = default default_fields = proxy=y host=svr1 deny = no driver = pam [1] Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Connect from local Dec 15 23:28:48 svr1 dovecot: auth: Debug: master in: PASS#0111#011test#011service=lmtp Dec 15 23:28:48 svr1 dovecot: auth: Debug: pam(test): passdb doesn't support credential lookups Dec 15 23:28:48 svr1 dovecot: auth: Debug: passdb out: FAIL#0111#011reason=Configured passdbs don't support credentials lookups Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Debug: user test: Auth PASS lookup returned temporary failure: reason=Configured passdbs don't support credentials lookups Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Debug: auth PASS input: reason=Configured passdbs don't support credentials lookups dovecot-pigeonhole-2.2.36-3.el7_7.1.x86_64 dovecot-2.2.36-3.el7_7.1.x86_64

2 10

Re: Shared namespace is empty after migration to new Dovecot installation
by Peter Reinhold 17 Dec '19

17 Dec '19

On 2019-12-09 09:42, Aki Tuomi wrote: >> That I can, here (anonymized where relevant) >> > > Config looks fine. Have you tried > > 'A1 SELECT Shared/user(a)sharer.dk'? Yields this, which is the same I got when trying to debug using doveadm acl, it seems like the shared mailboxes aren't placed in the shared namespace at all. A1 SELECT Shared/user(a)sharer.dk A1 NO Mailbox doesn't exist: Shared/user(a)sharer.dk (0.006 + 0.000 + 0.005 secs). -- Peter Reinhold

2 5

Gmail and POP3
by Yannick SIEGLER 17 Dec '19

17 Dec '19

Hi everyone, I'm new to this ML. I have some issue with GMail import settings... I run a dovecot server (2.3.4.1) on Debian10 and I try to connect to my accounts from GMail. It's work fine from thunderbird in pop3,pop3s, imap, imaps... Submission work too... But it won't work on GMail except if I set ssl=yes and disable_plaintext_auth = no... Then GMail connect without SSL or TLS... And in plaintext.... Very unsecure... I can send mail with submission from GMail and ssl=require, that's ok. If I try to connect with SSL activated I've got : pop3-login: Disconnected: Too many bad commands And If I try to connect on port 995 with SSL GMail say that I have some SSL error, and the log says : auth: Debug: auth client connected (pid=21831) pop3-login: Debug: SSL: where=0x10, ret=1: before SSL initialization pop3-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization pop3-login: Debug: SSL: where=0x2002, ret=-1: before SSL initialization pop3-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS read client hello pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write server hello pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write change cipher spec pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 write encrypted extensions pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write certificate pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 write server certificate verify pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write finished pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS read finished pop3-login: Debug: SSL: where=0x20, ret=1: SSLv3/TLS write session ticket pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write session ticket pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write session ticket pop3-login: Debug: SSL: where=0x2002, ret=1: SSL negotiation finished successfully pop3-login: Debug: SSL error: Connection closed But as I say, all is working fine from Thunderbird... For the SSL problem this is maybe because GMail doesn't like this configuration in debian for openssl ? [system_default_sect] MinProtocol = TLSv1.2 CipherString = DEFAULT@SECLEVEL=2 Maybe should I try to set MinProtocol = None CipherString = DEFAULT But this make a lot of security change on my opinion... Do someone have any tips or suggestion about my problem ? Thx Yannick

2 2

CentOS x64 compilation fails.
by Mart Pirita 16 Dec '19

16 Dec '19

Hello. I have problems to compile Dovecot2.2.13 with rpmbuild using options: ./configure \ --prefix=/usr \ --with-ssl=openssl \ --with-ssldir=/etc/ssl \ --sysconfdir=/etc \ --without-vpopmail \ --with-pam \ --without-bsdauth \ --without-sql \ --without-nss \ --without-ldap \ --without-pgsql \ --without-mysql \ --without-sqlite \ --with-rundir=/var/run/dovecot \ --without-deliver \ --without-gssapi make Using CentOS 5.11, option - rpmbuild -ba dovecot2.2.spec fails with error: /bin/mkdir -p '/var/tmp/dovecot-2.2.13-mp-root/usr/lib64/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c libdovecot-storage.la '/var/tmp/dovecot-2.2.13-mp-root/usr/lib64/dovecot' libtool: install: error: cannot install `libdovecot-storage.la' to a directory not ending in /usr/lib/dovecot make[4]: *** [install-pkglibLTLIBRARIES] Error 1 make[4]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[3]: *** [install-am] Error 2 make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[2]: *** [install-recursive] Error 1 make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src' make: *** [install-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.14076 (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.14076 (%install) But using CentOS 5.11with option- rpmbuild --target=i686 -ba dovecot2.2.spec works fine. However, using CentOS 6.5, with option - rpmbuild -ba dovecot2.2.spec fails with error: /bin/mkdir -p '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.x86_64/usr/lib64/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c libdovecot-storage.la '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.x86_64/usr/lib64/dovecot' libtool: install: error: cannot install `libdovecot-storage.la' to a directory not ending in /usr/lib/dovecot make[4]: *** [install-pkglibLTLIBRARIES] Error 1 make[4]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[3]: *** [install-am] Error 2 make[3]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[2]: *** [install-recursive] Error 1 make[2]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src' make: *** [install-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.HP3meN (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.HP3meN (%install) But when CentOS 5.11with option rpmbuild --target=i686 -ba dovecot2.2.spec suceeds, CentOS 6.5still fails: cpio: dovecot-2.2.13/src/lib-compression/abspath.c: Cannot stat: No such file or directory cpio: dovecot-2.2.13/src/lib-compression/compat.h: Cannot stat: No such file or directory cpio: dovecot-2.2.13/src/lib-compression/lib.h: Cannot stat: No such file or directory 18096 blocks + /usr/lib/rpm/check-buildroot /root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot/dovecot-config:LIBDOVECOT='-L/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot -ldovecot' /root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot/dovecot-config:LIBDOVECOT_INCLUDE=-I/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/include/dovecot Found '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386' in installed files; aborting error: Bad exit status from /var/tmp/rpm-tmp.69mGY0 (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.69mGY0 (%install) How to fix these errors? -- Mart

5 8

Suddenly sieve no longer working
by Heiko W. Rupp 16 Dec '19

16 Dec '19

Hey, I have a successful setup with dovecot and sieve and since a few days sieve is all of a sudden no longer working. I am on OSX and my mta is an older version of postfix (apple supplied). Has anyone gone through that and has some hints on how to best debug (and fix) that? Thanks a lot Heiko -- hwr(a)pilhuhn.de m:0179/207 4919 b:http://pilhuhn.blogspot.com

2 2

Panic: file smtp-client-connection.c: line 1212 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded)
by Hativ 16 Dec '19

16 Dec '19

Hello, after migrating from self-compiled Dovecot 2.3.3 to Dovecot 2.3.8 from the repository (Ubuntu 18.04 LTS "Bionic" packages) I have issues with the submission service. If I send an email, it will not be forwarded and I get the following error message: Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Panic: file smtp-client-connection.c: line 1212 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe7f7e) [0x7f64b1f76f7e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8021) [0x7f64b1f77021] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64b1ecfaf4] -> /usr/lib/dovecot/libdovecot.so.0(+0x50ec8) [0x7f64b1edfec8] -> /usr/lib/dovecot/libdovecot.so.0(+0x51078) [0x7f64b1ee0078] -> /usr/lib/dovecot/libdovecot.so.0(+0x541f4) [0x7f64b1ee31f4] -> /usr/lib/dovecot/libdovecot.so.0(smtp_client_command_input_reply+0x1f8) [0x7f64b1edb738] -> /usr/lib/dovecot/libdovecot.so.0(+0x54a93) [0x7f64b1ee3a93] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7f64b1f909af] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13c) [0x7f64b1f9237c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f64b1f90abc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f64b1f90cd8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f64b1eff053] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](main+0x3d1) [0x55dcc748fec1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f64b1abfb97] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](_start+0x2a) [0x55dcc749009a] Does somebody has any idea? The problem has been taking me months, now I want to finally update to the current version. Full debug log: Oct 11 09:29:00 srv2 dovecot: submission-login: Login: user=< hativ(a)example.com>, method=PLAIN, rip=fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e, lip=fec0:4f8:1c0c:8099::1, mpid=15819, TLS, session=<XFnLeJ2U0rgqAoEMwMAIoDQqhHgB7k+O> Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Loading modules from directory: /usr/lib/dovecot/modules Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_mail_crypt_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_quota_clone_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Quota root: name= backend=count args= Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Quota grace: root= bytes=0 (10%) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: initializing backend with data: vfile Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: acl username = hativ(a)example.com Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: owner = 1 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl vfile: Global ACLs disabled Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: initializing backend with data: vfile Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: acl username = hativ(a)example.com Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: owner = 0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl vfile: Global ACLs disabled Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-server: conn [fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e]:47314 [1]: Server accepted connection (fd=7) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-server: conn [fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e]:47314 [1]: Connection created Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: Connection created Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: Looking up IP address Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: DNS lookup successful; got 2 IPs Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-server: conn [fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e]:47314 [1]: Sent: 235 2.7.0 Logged in. Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: Connecting to 10.46.163.91:25 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Connecting Oct 11 09:29:00 srv2 postfix/smtpd[15229]: connect from srv2[10.46.163.91] Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Waiting for connect (fd=8) to finish for max 0 msecs Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Client connected (fd=8) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Connected to server (from 10.46.163.91:60230) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received greeting from server: 220 mta2.example.com ESMTP Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Sending EHLO handshake Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Submitted with priority Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Sent: EHLO mda1-2.example.com Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Got reply (1/1): 250 mta2.example.com PIPELINING SIZE 51200000 ETRN STARTTLS AUTH DIGEST-MD5 CRAM-MD5 NTLM XCLIENT NAME ADDR PROTO HELO REVERSE_NAME PORT LOGIN DESTADDR DESTPORT ENHANCEDSTATUSCODES 8BITMIME SMTPUTF8 (1 commands pending, 0 commands queued) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received handshake reply Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received server capabilities Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Starting TLS Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command STARTTLS: Submitted with priority Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Destroy (0 commands pending, 1 commands queued) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command STARTTLS: Sent: STARTTLS Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command STARTTLS: Got reply (1/1): 220 2.0.0 Ready to start TLS (1 commands pending, 0 commands queued) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received STARTTLS reply: 220 2.0.0 Ready to start TLS Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Starting SSL handshake Oct 11 09:29:01 srv2 postfix/smtpd[15229]: Anonymous TLS connection established from srv2[10.46.163.91]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: SSL handshake successful Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Panic: file smtp-client-connection.c: line 1212 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe7f7e) [0x7f64b1f76f7e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8021) [0x7f64b1f77021] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64b1ecfaf4] -> /usr/lib/dovecot/libdovecot.so.0(+0x50ec8) [0x7f64b1edfec8] -> /usr/lib/dovecot/libdovecot.so.0(+0x51078) [0x7f64b1ee0078] -> /usr/lib/dovecot/libdovecot.so.0(+0x541f4) [0x7f64b1ee31f4] -> /usr/lib/dovecot/libdovecot.so.0(smtp_client_command_input_reply+0x1f8) [0x7f64b1edb738] -> /usr/lib/dovecot/libdovecot.so.0(+0x54a93) [0x7f64b1ee3a93] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7f64b1f909af] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13c) [0x7f64b1f9237c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f64b1f90abc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f64b1f90cd8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f64b1eff053] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](main+0x3d1) [0x55dcc748fec1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f64b1abfb97] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](_start+0x2a) [0x55dcc749009a] Oct 11 09:29:01 srv2 postfix/smtpd[15229]: lost connection after STARTTLS from srv2[10.46.163.91] Oct 11 09:29:01 srv2 postfix/smtpd[15229]: disconnect from srv2[10.46.163.91] ehlo=1 starttls=1 commands=2 Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Fatal: master: service(submission): child 15819 killed with signal 6 (core dumped) Best regards Hativ

3 4

FTS indexer-worker Panic
by Yarema 16 Dec '19

16 Dec '19

Set up fts_xapian over the weekend and re-indexed. https://github.com/grosjo/fts-xapian Tried to search my INBOX and got: > dovecot: indexer-worker: Panic: file charset-iconv.c: line 83 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) What could I possibly have lurking in my INBOX to cause that ?? -- Yarema

2 1

dovecot full text search
by Wojciech Puchar 16 Dec '19

16 Dec '19

what FTP module should i use instead of squat that is probably no longer supported or no longer at all? i want to upgrade my dovecot installation. it currently uses squat but i found it often crashes on FTS on large mailboxes. i found "xapian" addon for dovecot but while it works excellent AFTER database is created, i found it need like 20 or so minutes to index less than 10GB of mails and while doing this - generate many tens of megabytes/s constant write traffic on it's database files. Excellent way of killing SSD. something must be broken. my config is plugin { plugin = fts fts_xapian fts = xapian fts_xapian = partial=2 full=20 verbose=0 fts_autoindex = yes fts_enforced = yes # fts_autoindex_exclude = \Junk # fts_autoindex_exclude2 = \Trash } any ideas?

3 3

Bug: indexer-worker segfaults with fts_xapian 1.2.5
by Martynas Bendorius 16 Dec '19

16 Dec '19

Core was generated by `dovecot/indexer-worker'. Program terminated with signal 11, Segmentation fault. #0 0x00007f30f7ad056d in __exchange_and_add (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:49 49 { return __atomic_fetch_add(__mem, __val, __ATOMIC_ACQ_REL); } (gdb) bt full #0 0x00007f30f7ad056d in __exchange_and_add (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:49 No locals. #1 __exchange_and_add_dispatch (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:82 No locals. #2 std::string::_Rep::_M_dispose (this=0xffffffffffffffe8, __a=...) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/bits/basic_string.h:246 No locals. #3 0x00007f30f7b3407e in _M_dispose (__a=..., this=<optimized out>) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/bits/basic_string.tcc:254 No locals. #4 std::string::assign (this=this@entry=0x55c7b93e0168, __str="return-path") at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/bits/basic_string.tcc:250 __a = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>} #5 0x00007f30fa8776ce in operator= (__str="return-path", this=0x55c7b93e0168) at /usr/include/c++/4.8.2/bits/basic_string.h:547 No locals. #6 fts_backend_xapian_update_set_build_key (_ctx=0x55c7b93e0140, key=0x7ffc1ba2c380) at fts-backend-xapian.cpp:303 ctx = 0x55c7b93e0140 i = <optimized out> f2 = "return-path" backend = <optimized out> field = 0x55c7b943fb5f "RETURN-PATH" j = 11 #7 0x00007f30fb0b8cda in fts_backend_update_set_build_key (ctx=0x55c7b93e0140, key=key@entry=0x7ffc1ba2c380) at fts-api.c:174 __func__ = "fts_backend_update_set_build_key" #8 0x00007f30fb0ba243 in fts_build_mail_header (block=0x7ffc1ba2c340, block=0x7ffc1ba2c340, ctx=0x7ffc1ba2c3b0) at fts-build-mail.c:173 hdr = <optimized out> key = {uid = 6006200, type = FTS_BACKEND_BUILD_KEY_HDR, part = 0x55c7b935eed0, hdr_name = 0x55c7b943fb5f "RETURN-PATH", body_content_type = 0x0, body_content_disposition = 0x0} ret = <optimized out> #9 fts_build_mail_real (may_need_retry_r=0x7ffc1ba2c2f3, retriable_err_msg_r=0x7ffc1ba2c300, mail=0x55c7b93dcff8, update_ctx=0x55c7b93e0140) at fts-build-mail.c:568 block = {part = 0x55c7b935eed0, hdr = 0x55c7b93d7f18, data = 0x55c7b938b8a8 "", size = 0} ret = <optimized out> input = 0x55c7b93d78c0 raw_block = {part = 0x55c7b935eed0, hdr = 0x55c7b93d80b0, data = 0x0, size = 0} skip_body = false ctx = {mail = 0x55c7b93dcff8, update_ctx = 0x55c7b93e0140, content_type = 0x0, content_disposition = 0x0, body_parser = 0x0, word_buf = 0x0, ---Type <return> to continue, or q <return> to quit--- pending_input = 0x0, cur_user_lang = 0x0} prev_part = 0x55c7b935eed0 parser = 0x55c7b93d7b38 decoder = 0x55c7b93d7f00 parts = 0x7ffc1ba2c414 body_part = false body_added = false binary_body = <optimized out> error = 0x5ba5b8 <Address 0x5ba5b8 out of bounds> #10 fts_build_mail (update_ctx=0x55c7b93e0140, mail=mail@entry=0x55c7b93dcff8) at fts-build-mail.c:617 _data_stack_cur_id = 6 attempts = 2 retriable_err_msg = 0x11e900729 <Address 0x11e900729 out of bounds> may_need_retry = false #11 0x00007f30fb0c1102 in fts_mail_index (_mail=0x55c7b93dcff8) at fts-storage.c:550 ft = 0x55c7b9396880 flist = 0x55c7b938b8a8 pmail = 0x55c7b93dcff8 #12 fts_mail_precache (_mail=0x55c7b93dcff8) at fts-storage.c:571 _data_stack_cur_id = 5 mail = 0x55c7b93dcff8 fmail = <optimized out> ft = 0x55c7b9396880 __func__ = "fts_mail_precache" #13 0x00007f30fc1b7d64 in mail_precache (mail=0x55c7b93dcff8) at mail.c:432 _data_stack_cur_id = 4 p = 0x55c7b93dcff8 #14 0x000055c7b8b4c844 in index_mailbox_precache (conn=<optimized out>, box=0x55c7b938ef18) at master-connection.c:102 counter = 0 max = 21569 percentage_sent = 0 storage = <optimized out> status = {messages = 21569, recent = 0, unseen = 0, uidvalidity = 1462447525, uidnext = 6027769, first_unseen_seq = 0, first_recent_uid = 6027758, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = false, allow_new_keywords = false, nonpermanent_modseqs = false, no_modseq_tracking = false, have_guids = true, have_save_guids = true, have_only_guid128 = false} uids = <optimized out> username = 0x55c7b9385988 "msg(a)domain.com" first_uid = 6006200 ---Type <return> to continue, or q <return> to quit--- percentage_str = "\003\000\000" percentage = <optimized out> error = MAIL_ERROR_NONE trans = 0x55c7b9390480 ctx = 0x55c7b93d15f0 last_uid = 6006200 ret = 0 box_vname = 0x55c7b938f280 "INBOX.lfd.SSH login alerts" errstr = <optimized out> search_args = 0x0 mail = 0x55c7b93dcff8 metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_STREAM_HEADER | MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} seq = <optimized out> #15 index_mailbox (user=<optimized out>, user=<optimized out>, what=<optimized out>, max_recent_msgs=<optimized out>, mailbox=<optimized out>, conn=0x55c7b9370df0) at master-connection.c:205 box = 0x55c7b938ef18 status = {messages = 463652304, recent = 32764, unseen = 1, uidvalidity = 0, uidnext = 4225857431, first_unseen_seq = 32560, first_recent_uid = 4226053086, last_cached_seq = 32560, highest_modseq = 94316285707297, highest_pvt_modseq = 94316294200320, keywords = 0x7f30fbe17797 <__x86_return_thunk+5>, permanent_flags = 4226053495, flags = 32560, permanent_keywords = true, allow_new_keywords = true, nonpermanent_modseqs = true, no_modseq_tracking = false, have_guids = true, have_save_guids = false, have_only_guid128 = false} errstr = <optimized out> ret = 0 ns = <optimized out> path = 0x55c7b935e7f8 "/home/username/imap/domain.com/msg/Maildir/.INBOX.lfd.SSH login alerts" error = 21569 sync_flags = <optimized out> #16 master_connection_input_line (line=<optimized out>, conn=0x55c7b9370df0) at master-connection.c:247 str = <optimized out> max_recent_msgs = 0 ret = <optimized out> args = <optimized out> input = {parent_event = 0x0, module = 0x55c7b8b4d05f "mail", service = 0x55c7b8b4d050 "indexer-worker", username = 0x55c7b935d038 "msg(a)domain.com", session_id = 0x0, session_id_prefix = 0x55c7b935d063 "MAYmHNGX9l1rviwA+Lg9Sw", session_create_time = 0, local_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = { family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), ---Type <return> to continue, or q <return> to quit--- no_userdb_lookup = false, debug = false, conn_secured = false, conn_ssl_secured = false} service_user = 0x55c7b93732e8 user = 0x55c7b9385868 error = 0x0 #17 master_connection_input (conn=0x55c7b9370df0) at master-connection.c:287 _data_stack_cur_id = 3 line = <optimized out> #18 0x00007f30fbed69af in io_loop_call_io (io=0x55c7b9370e30) at ioloop.c:718 ioloop = 0x55c7b9365d70 t_id = 2 __func__ = "io_loop_call_io" #19 0x00007f30fbed8413 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55c7b9365d70) at ioloop-epoll.c:222 ctx = 0x55c7b9366ea0 list = 0x55c7b9370e90 io = <optimized out> tv = {tv_sec = 2147483, tv_usec = 0} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __func__ = "io_loop_handler_run_internal" #20 0x00007f30fbed6ab9 in io_loop_handler_run (ioloop=ioloop@entry=0x55c7b9365d70) at ioloop.c:770 __func__ = "io_loop_handler_run" #21 0x00007f30fbed6cf8 in io_loop_run (ioloop=0x55c7b9365d70) at ioloop.c:743 __func__ = "io_loop_run" #22 0x00007f30fbe46d83 in master_service_run (service=0x55c7b9365c00, callback=callback@entry=0x55c7b8b4c3e0 <client_connected>) at master-service.c:809 No locals. #23 0x000055c7b8b4c21e in main (argc=1, argv=0x55c7b9365960) at indexer-worker.c:77 storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT) c = <optimized out> -- Best regards, Martynas Bendorius

2 1

Dovecot v2.3.9.2 released
by aki.tuomi＠dovecot.fi 15 Dec '19

15 Dec '19

We are pleased to release v2.3.9.2 of Dovecot. Please find it from locations below https://dovecot.org/releases/2.3/dovecot-2.3.9.2.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.2.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- - Mails with empty From/To headers can also cause crash in push notification drivers. --- Aki Tuomi Open-Xchange oy

2 1

Bug: icu linking issue in fts plugin
by Martynas Bendorius 15 Dec '19

15 Dec '19

FTS plugin seems not to be linking dynamic libraries correctly: [root@server ~]# ldd /usr/lib/dovecot/lib20_fts_plugin.so linux-vdso.so.1 => (0x00007ffd2eb95000) libicui18n.so.64 => not found libicuuc.so.64 => not found libicudata.so.64 => not found libc.so.6 => /lib64/libc.so.6 (0x00007f1cb5566000) /lib64/ld-linux-x86-64.so.2 (0x00007f1cb5b73000) ICU is in custom directory /usr/local/icu, it's not set in ld.so.conf, so, the linker would need to get this added automatically (that's how it's handled in PHP, for example): -Wl,-rpath=/usr/local/icu/lib Thank you! -- Best regards, Martynas Bendorius

1 0

Solr commit and optimize: which user?
by John Gateley 15 Dec '19

15 Dec '19

Hi, I have Solr FTR working with dovecot, and need to do the commit and optimize recommended here: https://wiki.dovecot.org/Plugins/FTS/Solr Should this run as root, or as each mail user. The documentation above implies, but doesn't state, that it is root. The docs here are similar: http://grimore.org/networking/dovecot/full_text_search But the docs here say it has to be done for each user: http://www.unixsamurai.com/dovecot-full-text-search-jetty-solr/ I don't know Solr well enough to answer. Which is correct? Thanks John

2 1

Parsing variables in config files
by Eudald Valcàrcel Lacasa 15 Dec '19

15 Dec '19

Hello, I'm trying to set up a mailbox for a bunch of domains. To do so I'm running some docker containers (I know I can use multidomain set up and I'm doing so, but I need to have some domains on different containers for specific reasons). In order to keep it all clean, I want to use different PostgreSQL databases for each container, and I'm running the container with an environment file containing database parameters, such as: DB_USER DB_HOST DB_NAME I've been trying to pass these parameters to dovecot's configuration, but they don't get parsed and I end up with messages like: dovecot: auth: Error: pgsql(%{env:DB_HOST}): Connect failed to database %{env:DB_NAME} I've tried to pass variables alone, using import_environment = DB_HOST DB_NAME DB_USER, but I'm stuck at the same errors. Is there anything I could do to fix this? Thank you! Eudald

2 2

Doveadm HTTP API and CORS
by Peter Chiochetti 13 Dec '19

13 Dec '19

While toying around with Doveadmin HTTP api I noticed, there is not much hype around it. Let's change that. Doveadmin REST API so to speak provides a web server. When doing /ajax/ requests, modern browsers block that, unless the response comes with a specific CORS header. Here how to work around with a proxy: > # /etc/dovecot/local.conf > doveadm_allowed_commands = fetch > doveadm_api_key = secret > service doveadm { > inet_listener http { > port = 8084 > } > } > # secret64 = echo -n secret | base64 > # /etc/apache/.../some-site.conf > ProxyVia Block > <Location /doveadm/v1> > RequestHeader set Authorization "X-Dovecot-API secret64" > ProxyPass http://localhost:8084/doveadm/v1 retry=0 timeout=5 > ProxyPassReverse http://localhost:8084/doveadm/v1 > </Location> Intranet only this might be good enough, TLS with username/password Basic-Authentication passthrough might be used for better security. Shameless plug: taken from https://gist.github.com/hungerburg/00d582bf1a6bf3c622797bf5e759f75b -- peter

2 1

BUG: panic when using fs:posix as dict for acl_shared_dict
by Marco Giunta 13 Dec '19

13 Dec '19

Hi, I'm using Dovecot 2.2.33.2 on a RHEL 7, new installation. When I use fs:posix as dict for acl_shared_dict, like in Dovecot wiki (https://wiki.dovecot.org/SharedMailboxes/ClusterSetup) doveadm-server crash with error: # doveadm acl set -u USERNAME FOLDER user=DEST_USERNAME lookup read write-seen doveadm(USERNAME): Panic: file dict-fs.c: line 127 (fs_dict_iterate_init): assertion failed: ((flags & DICT_ITERATE_FLAG_RECURSE) == 0) doveadm(USERNAME): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9f3de) [0x7f0e4a4b23de] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f0e4a4b244a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0e4a44377c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x31688) [0x7f0e4a444688] -> /usr/lib64/dovecot/libdovecot.so.0(dict_iterate_init_multiple+0x4d) [0x7f0e4a47cadd] -> /usr/lib64/dovecot/libdovecot.so.0(dict_iterate_init+0x29) [0x7f0e4a47cb89] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_lookup_dict_rebuild+0x3e1) [0x7f0e49a40371] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_backend_vfile_acllist_rebuild+0x488) [0x7f0e49a3dd18] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_backend_vfile_object_update+0x3c7) [0x7f0e49a3e867] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_mailbox_update_acl+0x68) [0x7f0e49a41e28] -> /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x2c11) [0x7f0e48da1c11] -> /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x3060) [0x7f0e48da2060] -> doveadm(+0x2b41c) [0x556f1280b41c] -> doveadm(+0x2c01a) [0x556f1280c01a] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x23b) [0x556f1280ce7b] -> doveadm(doveadm_cmd_run_ver2+0x50c) [0x556f1281c73c] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x556f1281c7d7] -> doveadm(main+0x1e4) [0x556f127fb944] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f0e4a071c05] -> doveadm(+0x1bd35) [0x556f127fbd35] Aborted Attached coredump and configuration. I'm not a programmer, but seems that assert is raised by 'fs_dict_iterate_init' function inside 'src/lib-dict-extra/dict-fs.c': static struct dict_iterate_context * fs_dict_iterate_init(struct dict *_dict, const char *const *paths, enum dict_iterate_flags flags) { ... /* these flags are not supported for now */ i_assert((flags & DICT_ITERATE_FLAG_RECURSE) == 0); ... because it is called by 'acl_lookup_dict_iterate_read' function in file 'src/plugins/acl/acl-lookup-dict.c' static void acl_lookup_dict_iterate_read(struct acl_lookup_dict_iter *iter) { ... dict_iter = dict_iterate_init(iter->dict->dict, prefix, DICT_ITERATE_FLAG_RECURSE); ... with DICT_ITERATE_FLAG_RECURSE set. Same problem also with Dovecot 2.3.0. Thanks, Marco -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244

4 6

Is is possible to log TLS client versions
by Götz Reinicke 13 Dec '19

13 Dec '19

Hi, is it possible to log the version of TLS a clients is using to connect to dovecot? I’v not found any switch to do that. Thanks and regards . Götz

2 2

CVE-2019-19722: Critical vulnerability in Dovecot
by Aki Tuomi 13 Dec '19

13 Dec '19

Open-Xchange Security Advisory 2019-12-13 Product: Dovecot IMAP/POP3 Server Vendor: OX Software GmbH Internal reference: DOV-3719 Vulnerability type: NULL Pointer Dereference (CWE-476) Vulnerable version: 2.3.9 Vulnerable component: push notification driver Report confidence: Confirmed Solution status: Fixed by Vendor Fixed version: 2.3.9.1 Researcher credits: Frederik Schwan, Michael Stilkerich Vendor notification: 2019-12-10 Solution date: 2019-12-12 Public disclosure: 2019-12-13 CVE reference: CVE-2019-19722 CVSS: 5.3 (CVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:L/E:F/RL:O/RC:C) Vulnerability Details: Mail with group address as sender will cause a signal 11 crash in push notification drivers. Group address as recipient can cause crash in some drivers. Risk: Repeated delivery attempts are made for the problematic mail, causing queueing in MTA. Steps to reproduce: 1. Configure dovecot with push notifications enabled, such as OX push notification driver. This can also be observed with 3rd party plugin XAPS. 2. Send mail a group address as sender Solution: Operators should update to the latest Patch Release.

2 1

Dovecot 2.3.9 - lmtp crashes with Signal 11
by Michael Stilkerich 13 Dec '19

13 Dec '19

Hello, since the upgrade from 2.3.8 to 2.3.9 (using the Ubuntu 18.04 packages from dovecot.org) lmtp crashes for me for some mails. Currently I have three pending mails in my postfix deferred queue since the upgrade a couple of days ago. I did not observe these issues with 2.3.8. The backtrace from one of the coredumps: Reading symbols from /usr/lib/dovecot/lmtp...Reading symbols from /usr/lib/debug/.build-id/f3/3a5089463b1234cbcf90bf10033d1dd5613821.debug...done. done. [New LWP 1554] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/lmtp'. Program terminated with signal SIGSEGV, Segmentation fault. #0 decode_address_header (pool=pool@entry=0x560631ad6d10, hdr=0x560631add4c8 "", address_r=address_r@entry=0x560631ad7090, name_r=name_r@entry=0x560631ad7098) at push-notification-event-message-common.c:20 20 push-notification-event-message-common.c: No such file or directory. (gdb) bt #0 decode_address_header (pool=pool@entry=0x560631ad6d10, hdr=0x560631add4c8 "", address_r=address_r@entry=0x560631ad7090, name_r=name_r@entry=0x560631ad7098) at push-notification-event-message-common.c:20 #1 0x00007f3f37955fbb in decode_address_header (name_r=0x560631ad7098, address_r=0x560631ad7090, hdr=<optimized out>, pool=0x560631ad6d10) at push-notification-event-message-common.c:62 #2 push_notification_message_fill (mail=mail@entry=0x560631adc088, pool=0x560631ad6d10, event_flags=(PUSH_NOTIFICATION_MESSAGE_HDR_FROM | PUSH_NOTIFICATION_MESSAGE_HDR_TO | PUSH_NOTIFICATION_MESSAGE_HDR_SUBJECT | PUSH_NOTIFICATION_MESSAGE_HDR_DATE | PUSH_NOTIFICATION_MESSAGE_BODY_SNIPPE$), from=<optimized out>, to=<optimized out>, subject=<optimized out>, date=0x560631ad7050, date_tz=0x560631ad7058, message_id=0x560631ad7078, flags=0x560631ad706c, flags_set=0x560631ad7068, keywords=0x560631ad7070, snippet=0x560631ad7060, ext=0x560631ad7080) at push-notification-event-message-common.c:62 #3 0x00007f3f37955a41 in push_notification_event_messagenew_event (ptxn=0x560631ad6d38, ec=0x560631ad6fe0, msg=0x560631ad7010, mail=0x560631adc088) at push-notification-event-messagenew.c:83 #4 0x00007f3f379571bd in push_notification_trigger_msg_save_new (txn=0x560631ad6d38, mail=0x560631adc088, msg=0x560631ad7010) at push-notification-triggers.c:138 #5 0x00007f3f383f52f3 in notify_contexts_mail_save (mail=0x560631adc088) at notify-plugin.c:62 #6 0x00007f3f383f65b8 in notify_copy (ctx=0x560631ad7890, mail=0x560631a98b18) at notify-storage.c:104 #7 0x00007f3f3860873d in quota_copy (ctx=0x560631ad7890, mail=0x560631a98b18) at quota-storage.c:302 #8 0x00007f3f39f91e32 in mailbox_copy_int (_ctx=<optimized out>, mail=0x560631a98b18) at mail-storage.c:2759 #9 0x00007f3f3641907f in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #10 0x00007f3f3640e64c in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #11 0x00007f3f3640f11b in sieve_result_implicit_keep () from /usr/lib/dovecot/libdovecot-sieve.so.0 #12 0x00007f3f364226e1 in sieve_multiscript_finish () from /usr/lib/dovecot/libdovecot-sieve.so.0 #13 0x00007f3f3668e488 in ?? () from /usr/lib/dovecot/modules/lib90_sieve_plugin.so #14 0x00007f3f3a2a260d in mail_do_deliver (storage_r=0x7ffedf944b40, ctx=0x7ffedf944c30) at mail-deliver.c:542 #15 mail_deliver (ctx=ctx@entry=0x7ffedf944c30, storage_r=storage_r@entry=0x7ffedf944b40) at mail-deliver.c:592 #16 0x000056063169c0e1 in lmtp_local_default_deliver (client=0x560631a5e898, lrcpt=<optimized out>, cmd=<optimized out>, trans=<optimized out>, lldctx=0x7ffedf944e70) at lmtp-local.c:593 #17 0x000056063169c8cf in lmtp_local_deliver (local=0x560631a849b0, local=0x560631a849b0, session=0x560631a9d748, src_mail=0x560631a98b18, llrcpt=0x560631a7f600, trans=0x560631a7fab8, cmd=0x560631a7f088) at lmtp-local.c:530 #18 lmtp_local_deliver_to_rcpts (session=0x560631a9d748, trans=0x560631a7fab8, cmd=0x560631a7f088, local=0x560631a849b0) at lmtp-local.c:654 #19 lmtp_local_data (client=client@entry=0x560631a5e898, cmd=cmd@entry=0x560631a7f088, trans=trans@entry=0x560631a7fab8, input=<optimized out>) at lmtp-local.c:730 #20 0x000056063169b0cf in client_default_cmd_data (client=0x560631a5e898, cmd=0x560631a7f088, trans=0x560631a7fab8, data_input=0x560631a83c00, data_size=<optimized out>) at lmtp-commands.c:275 #21 0x000056063169ae6f in cmd_data_finish (trans=0x560631a7fab8, cmd=0x560631a7f088, client=0x560631a5e898) at lmtp-commands.c:165 #22 cmd_data_continue (conn_ctx=0x560631a5e898, cmd=0x560631a7f088, trans=0x560631a7fab8) at lmtp-commands.c:213 #23 0x00007f3f39bfa2c7 in cmd_data_do_handle_input (cmd=0x560631a7f088) at smtp-server-cmd-data.c:285 #24 cmd_data_handle_input (cmd=0x560631a7f088) at smtp-server-cmd-data.c:333 #25 0x00007f3f39ca42af in io_loop_call_io (io=0x560631a7d8e0) at ioloop.c:718 #26 0x00007f3f39ca5c8c in io_loop_handler_run_internal (ioloop=ioloop@entry=0x560631a23fd0) at ioloop-epoll.c:222 #27 0x00007f3f39ca43c0 in io_loop_handler_run (ioloop=<optimized out>) at ioloop.c:770 #28 0x00007f3f39ca45e8 in io_loop_run (ioloop=0x560631a23fd0) at ioloop.c:743 #29 0x00007f3f39c124b3 in master_service_run (service=0x560631a23e60, callback=<optimized out>) at master-service.c:809 #30 0x0000560631699b45 in main (argc=<optimized out>, argv=<optimized out>) at main.c:169 I can provide one of the mails causing the crash if helpful (they are all spam). Best regards, Michael

2 7

Dovecot v2.3.9.1 released
by Aki Tuomi 13 Dec '19

13 Dec '19

Hi all! We are pleased to release v2.3.9.1 of Dovecot. Please find it from locations below https://dovecot.org/releases/2.3/dovecot-2.3.9.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.1.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- * CVE-2019-19722: Mails with group addresses in From or To fields caused crash in push notification drivers. --- Aki Tuomi Open-Xchange oy

1 0

Dovecot auth crashing??
by Odhiambo Washington 13 Dec '19

13 Dec '19

Dovecot-2.3.9 I am seeing a lot of the following on my logs: Dec 13 09:16:25 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 09:16:25 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 09:16:25 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 09:16:25 auth: Warning: Event 0x827d6e20 leaked (parent=0x827d4220): auth-request.c:878 Dec 13 09:16:25 auth: Warning: Event 0x827d6420 leaked (parent=0x827d4820): auth-request.c:878 Dec 13 09:16:25 auth: Warning: Event 0x82780c20 leaked (parent=0x827d6220): auth-request.c:878 Dec 13 09:16:25 auth: Warning: Event 0x827d6c20 leaked (parent=0x827d4220): auth-request.c:115 Dec 13 09:16:25 auth: Warning: Event 0x827d4220 leaked (parent=0x827d6a20): auth-request.c:114 Dec 13 09:16:25 auth: Warning: Event 0x827d6a20 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 09:16:25 auth: Warning: Event 0x827d4c20 leaked (parent=0x827d4820): auth-request.c:115 Dec 13 09:16:25 auth: Warning: Event 0x827d4820 leaked (parent=0x827fe620): auth-request.c:114 Dec 13 09:16:25 auth: Warning: Event 0x827fe620 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 09:16:25 auth: Warning: Event 0x827ff420 leaked (parent=0x827d6220): auth-request.c:115 Dec 13 09:16:25 auth: Warning: Event 0x827d6220 leaked (parent=0x82780e20): auth-request.c:114 Dec 13 09:16:25 auth: Warning: Event 0x82780e20 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 11:27:29 master: Warning: Killed with signal 15 (by pid=9326 uid=0 code=kill) Dec 13 11:27:37 master: Warning: Killed with signal 15 (by pid=16518 uid=0 code=kill) Dec 13 11:27:38 auth: Error: net_connect_unix(auth-worker) failed: No such file or directory Dec 13 11:27:39 auth: Error: net_connect_unix(auth-worker) failed: No such file or directory Dec 13 11:27:59 auth: Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: No such file or directory Dec 13 11:27:59 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 11:27:59 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 11:27:59 auth: Warning: Event 0x82781a20 leaked (parent=0x827d4620): auth-request.c:878 Dec 13 11:27:59 auth: Warning: Event 0x827d4220 leaked (parent=0x827d4820): auth-request.c:878 Dec 13 11:27:59 auth: Warning: Event 0x82780e20 leaked (parent=0x827d4620): auth-request.c:115 Dec 13 11:27:59 auth: Warning: Event 0x827d4620 leaked (parent=0x827d0820): auth-request.c:114 Dec 13 11:27:59 auth: Warning: Event 0x827d0820 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 11:27:59 auth: Warning: Event 0x82781220 leaked (parent=0x827d4820): auth-request.c:115 Dec 13 11:27:59 auth: Warning: Event 0x827d4820 leaked (parent=0x827d0c20): auth-request.c:114 Dec 13 11:27:59 auth: Warning: Event 0x827d0c20 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 11:28:07 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 11:28:07 auth: Warning: Event 0x82780c20 leaked (parent=0x82781c20): auth-request.c:878 Dec 13 11:28:07 auth: Warning: Event 0x82781e20 leaked (parent=0x82781c20): auth-request.c:115 Dec 13 11:28:07 auth: Warning: Event 0x82781c20 leaked (parent=0x82781a20): auth-request.c:114 Dec 13 11:28:07 auth: Warning: Event 0x82781a20 leaked (parent=0x0): auth-client-connection.c:338 -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

1 0

dovecot update from 2.1.16 to 2.2.36.4 but I have a trouble.
by iriya＠peach.ocn.ne.jp 13 Dec '19

13 Dec '19

Hi,I have a troble and can not resolve it. Please help me. I updated dovecot from 2.1.16 to 2.2.36.4. As a result, I had a client who could not access via imap. The client showed his logs (- folder not exists:INBOX ) I did not change dovecot config files. So I searched a difference between 2.1.16 and 2.2.36.4, I discovered . Please refer below results. [2.1.16] a03 list "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasNoChildren) "." "INBOX.Drafts" * LIST (\HasNoChildren) "." "INBOX.Sent" * LIST (\HasNoChildren) "." "INBOX.Spam" * LIST (\HasNoChildren) "." "INBOX.Trash" [2.2.36.4] a03 list "" "*" * LIST (\HasChildren) "." INBOX * LIST (\HasNoChildren) "." INBOX.Drafts * LIST (\HasNoChildren) "." INBOX.Sent * LIST (\HasNoChildren) "." INBOX.Spam * LIST (\HasNoChildren) "." INBOX.Trash For example, I noticed INBOX and "INBOX". 2.2.36.4 dovecot is no [""]. What should I do?

2 1

v2.2.36 to v2.3.8 maildirlock bug
by lty＠cndns.com 12 Dec '19

12 Dec '19

Dear all, Dovecot upgraded from v2.2.36 to v2.3.8 There is no problem with the configuration, but the lock directory seems to have an error. [root@spam dovecot]# /usr/libexec/dovecot/maildirlock /path/to/maildir 1 Panic: BUG: No IOs or timeouts set. Not waiting for infinity. 19276[root@spam dovecot]# Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xe227a) [0x7f1cb567a27a] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe2321) [0x7f1cb567a321] -> /usr/lib64/dovecot/libdovecot.so.0(+0x40f31) [0x7f1cb55d8f31] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf93b4) [>xrf1cb56913b4] -> /usr/ Lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x28) [0x7f1cb5693918] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c) [0x7f1cb5691aac] -> /usr/lib64/dovecot/libdovecot. So.0(io_loop_run+0x38) [0x7f1cb5691cc8] -> /usr/libexec/dovecot/maildirlock(main+0x242) [0x7f1cb5b522c2] -> /lib64/libc.so.6(__libc_start_main+0x100) [0x7f1cb5222d20] -> / Usr/libexec/dovecot/maildirlock(+0xfa9) [0x7f1cb5b51fa9] After google seems to be a bug, this is the address Https://bugs.gentoo.org/682498 If this is not fixed, we are temporarily unable to upgrade to use the new version. Will the next version be fixed? We are looking forward to seeing that we have returned v2.2.36

4 5

Lightweight LMTP daemon to avoid overkill MTA
by William Edwards 12 Dec '19

12 Dec '19

Hi, My situation is as follows. -An internet-facing spam filter relays email to destination mail server (Dovecot) with SMTP. - Dovecot should take email and deliver it to user's mailboxes. I guess I'd need LMTP for this. - An external SMTP relay is already in place. I am thinking of using Dovecot submission to relay to the external relaying cluster. So, both relaying and routing are done externally - the Dovecot machine should only store mail. Of course, there should also be a mechanism that takes care of local delivery to Dovecot, like LMTP. Usually, I would use an MTA like Exim to take care of local delivery. I feel like a fully-featured MTA is overkill, though, as all other roles such an MTA would fulfill - relaying and spam filtering - are fulfilled on external servers. Q: Does anyone know of a lightweight LMTP daemon that can take care of local delivery to Dovecot without the need for a full MTA? With kind regards, William Edwards T. 040 - 711 44 96 E. wedwards(a)cyberfusion.nl

3 7

Submission config being ignored
by William Edwards 12 Dec '19

12 Dec '19

I'm having trouble setting up submission with Dovecot proxy. The submission config seems to be getting ignored, but I'm probably doing something wrong. Expected behaviour: have messages sent to submission ports (25, 465) relayed to `submission_relay_host`. -- root@imapproxy1:~# cat /etc/dovecot/conf.d/20-submission.conf submission_logout_format = in=%i out=%o submission_relay_host = smtp.prorelay.nl submission_relay_port = 587 submission_relay_ssl = starttls submission_relay_ssl_verify = no service submission { } service submission-login { inet_listener submission_25 { port = 25 } inet_listener submission_465 { port = 465 ssl = yes } } -- What happens instead: Dovecot is attempting to send mail to the host specified in the passdb file: root@imapproxy1:~# cat /etc/virtual/xalys.nl/passwd test:$password.:8:8::/home/test.nl/test:/bin/false:userdb_quota_rule=*:bytes=0 proxy_maybe=y host=$ipaddr How do I get Dovecot to relay mail sent to submission ports to 'submission_relay_host'? Met vriendelijke groeten, William Edwards T. 040 - 711 44 96 E. wedwards(a)cyberfusion.nl submission_relay_host

2 2

Duplicate e-mail with Dovecot and Sieve
by Claudio Corvino 12 Dec '19

12 Dec '19

Hi everyone, we have a duplicate e-mail problem with Dovecot 2.2.13 (LMTP as MDA) on a Debian 8 server. Our users are on external LDAP. We just need to setup a vacation responder (with Sieve) for our employees with a redirect to an alias (a distribution list), let's call it /LIST(a)domain.com/, that comprehends even the user that just activated the out of office. This generates a loop: when someone write to LIST(a)domain.com every user of the aforementioned distribution list receives a duplicate e-mail generated from the sieve script of the user with vacation responder active that contains the redirect to LIST(a)domain.com. We just tried activating the duplicate extension into sieve script but the redirected e-mail has a different MSG-ID and it's not recognized as a duplicate by the server. Our dovecot conf is: /# 2.2.13: /etc/dovecot/dovecot.conf auth_mechanisms = plain login default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_fsync = never mail_location = maildir:~/Maildir mail_max_userip_connections = 50 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mmap_disable = yes passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-ldap-archive.conf driver = ldap } plugin { sieve = file:/var/www/html/ooo/%n/script sieve_dir = /var/www/html/ooo/%n/ sieve_duplicate_default_period = 1m sieve_duplicate_max_period = 1d sieve_extensions = +vnd.dovecot.duplicate +notify +imapflags +vacation-seconds sieve_global = /etc/dovecot/sieve/ sieve_max_redirects = 10 sieve_user_log = file:/var/www/html/ooo/%n/sieve_error.log sieve_vacation_default_period = 1d sieve_vacation_max_period = 90d sieve_vacation_min_period = 5s } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { process_limit = 200 } service lmtp { executable = lmtp -L process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } user = vmail } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { port = 4190 } process_min_avail = 10 service_count = 1 } service managesieve { executable = /usr/lib/dovecot/managesieve } ssl_cert = </etc/ssl/*xxxxxxxxxxxxxxxxxxxxxxxx* ssl_cipher_list = ALL:!LOW:!aNULL:!eNULL:!SSLv2:!RC4:!MD5:!DES:!EXP:!SEED:!IDEA:!3DES ssl_key = </etc/ssl/private/*xxxxxxxxxxxxxxxxxx* userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-archive.conf driver = ldap } protocol lda { auth_socket_path = /var/run/dovecot/auth-master hostname = *xxxxxxxxxxxxxxxxx* info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " autocreate sieve quota" } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " autocreate sieve quota" postmaster_address = postmaster@*xxxxxxxxxx* } protocol sieve { info_log_path = log_path = mail_max_userip_connections = 10 managesieve_implementation_string = dovecot managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 }/ An example of user sieve script is: /require ["vnd.dovecot.duplicate","copy","fileinto","vacation-seconds"]; # rule:[Outofoffice] if true { vacation :addresses "xxxxxxx(a)domain.tld" :subject "Automatic Reply" text: / /<Text here> . ; fileinto "INBOX";/ / redirect "LIST(a)domain.com";/ /}/ Please could someone give us support on the matter? Removing the redirect from sieve user script is not an option :-) Thanks Cheers -- *Claudio Corvino IT Systems Administrator* Trust Italia S.p.A. <https://www.trustitalia.it/> *DigiCert Italian Affiliate Certified Partner Platinum Elite* Via Flaminia, 497 - 00191 Roma *tel.: +39 06332287* *fax: +39 063336145* *e-mail: * ccorvino(a)trustitalia.it <mailto:ccorvino@trustitalia.it> *website: * www.trustitalia.it <https://www.trustitalia.it> Symantec Authentication Service Le modalità di trattamento dei dati a cui è stato dato il consenso e le relative finalità sono consultabili al link <https://www.trustitalia.it/archivio/legal_agreements/informativa_privacy_em…>. Qualora non desiderasse ricevere le nostre comunicazioni, potrà comunicarlo mediante il seguente link <https://www.trustitalia.it/site/info_css/05110101/revoca-del-consenso>. Inoltre, in ogni momento, potrà modificare o cancellare i dati presenti nel nostro archivio contattandoci all'indirizzo privacy(a)trustitalia.it <mailto:privacy@trustitalia.it> Se possibile non stamparmi! Se possibile, non stamparmi!

8 13

Lmtp redirection to other backend server
by Marc Roos 11 Dec '19

11 Dec '19

I have currently a working local delivery working ok on 2 backend servers. The backend servers use slapd/nslcd/nscd for local accounts. If I enable proxy=yes in the lmtp config section, I am getting this error 'auth: Debug: passdb out: FAIL#0111#011reason=Configured passdbs don't support credentials lookups' which is obvious because I do not have a passdb. I am not sure if it is possible to get this value from the system environment eg. nslcd/nscd, without the need to configure some separate ldap lookup in dovecot? Or do I really need to configure a ldap lmtp lookup just for this host attribute? What would be an efficient solution?

1 1

dkim + arc
by Aki Tuomi 11 Dec '19

11 Dec '19

If I don't get swamp of errors with this email, I'll stop the From munging starting tomorrow. There is now ARC signing done for mails. Lets see how this works, if we can stop rewriting from I'll be happy. Aki

2 2

Ban Atomia.com?
by LuKreme 11 Dec '19

11 Dec '19

Can a mail admin ban atomia.com from posting? I mean, I like the idea that every post is clogging up their support queue, but really, not that much. Sent from my iPhone

5 4

RE: lmtp delivery auth error, but successful delivery
by Marc Roos 11 Dec '19

11 Dec '19

It is a test environment, so I do not have much data. I am testing with 'mail wegjd' seems to deliver ok every time. -----Original Message----- Subject: RE: lmtp delivery auth error, but successful delivery Can you let me know if you get lots of delivery failures? Aki -------- Original message -------- From: Marc Roos <M.Roos(a)f1-outsourcing.eu> Date: 11/12/2019 22.16 (GMT+02:00) To: dovecot <dovecot(a)dovecot.org> Subject: lmtp delivery auth error, but successful delivery How to fix the auth passwd-file unknown user error? I guess I maybe have something active that I do not need? With this configuration in sendmail FEATURE(`local_lmtp',`[IPC]',`TCP [192.168.10.44] 24')dnl MAILER(local)dnl Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Connect from 192.168.10.44 Dec 11 21:04:18 mailsvr dovecot: auth: passwd-file(wegjd,192.168.10.44): unknown user Dec 11 21:04:18 mailsvr dovecot: lmtp(wegjd): msgid=<201912112004.xBBK4HoZ015358(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Disconnect from 192.168.10.44: Successful quit With this configuration in sendmail: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl MAILER(local)dnl Dec 11 21:11:50 mailsvr dovecot: lmtp(15754): Connect from local Dec 11 21:11:51 mailsvr dovecot: auth: passwd-file(wegjd): unknown user Dec 11 21:11:51 mailsvr dovecot: lmtp(wegjd): msgid=<201912112011.xBBKBoRB015751(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:11:51 mailsvr dovecot: lmtp(15754): Disconnect from local: Successful quit

1 0

lmtp delivery auth error, but successful delivery
by Marc Roos 11 Dec '19

11 Dec '19

How to fix the auth passwd-file unknown user error? I guess I maybe have something active that I do not need? With this configuration in sendmail FEATURE(`local_lmtp',`[IPC]',`TCP [192.168.10.44] 24')dnl MAILER(local)dnl Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Connect from 192.168.10.44 Dec 11 21:04:18 mailsvr dovecot: auth: passwd-file(wegjd,192.168.10.44): unknown user Dec 11 21:04:18 mailsvr dovecot: lmtp(wegjd): msgid=<201912112004.xBBK4HoZ015358(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Disconnect from 192.168.10.44: Successful quit With this configuration in sendmail: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl MAILER(local)dnl Dec 11 21:11:50 mailsvr dovecot: lmtp(15754): Connect from local Dec 11 21:11:51 mailsvr dovecot: auth: passwd-file(wegjd): unknown user Dec 11 21:11:51 mailsvr dovecot: lmtp(wegjd): msgid=<201912112011.xBBKBoRB015751(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:11:51 mailsvr dovecot: lmtp(15754): Disconnect from local: Successful quit

1 0

Atomia user activation
by Atomia 11 Dec '19

11 Dec '19

Hi Claudio Corvino via dovecot, A new Atomia account has been created for you. Click the url below to activate your account and select a password! https://support.atomia.com/register/KfOvGCowO4TkXeAXlMH0 If the above URL does not work try copying and pasting it into your browser. If you continue to have problems, please feel free to contact us. Regards, Atomia

1 0

Can't see a specific mail in thunderbird but with mobile mail client
by J. Echter 11 Dec '19

11 Dec '19

Hi, i've seen a strange behaviour in our system (centos 7, dovecot 2.2.36 (1f10bfa63) today. We got a mail and it got delivered. Dec 3 07:56:25 mail postfix/lmtp[4013]: 915B0CEF4C2: to=<user@domain>, relay=mail[private/dovecot-lmtp], delay=1.5, delays=1.3/0.03/0.02/0.19, dsn=2.0.0, status=sent (250 2.0.0 <user@domain> AOhCNBgH5l2vDwAAtnFApQ:2 Saved) Dec 3 07:56:25 mail dovecot: lmtp(user@domain): AOhCNBgH5l2vDwAAtnFApQ:2: sieve: msgid=<289913405.81.1575356173625.JavaMail.SYSTEM@EUWS0716>: stored mail into mailbox 'INBOX' I also see this mail on the filesystem in the users cur dir: -rw-r--r--. 1 vmail vmail 448818 3. Dez 07:56 1575356184.M937345P4015.mail,S=611100,W=619338:2,Sae But i don't see this single mail in thunderbird and not in sogo (http://www.sogo.nu) but i can see it in the mobile mail client. Does anyone have a suggfestion what may be wrong here? I paste my dovecot -n output here: # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: Linux 3.10.0-1062.4.3.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) xfs # Hostname: mail.workgroup.local auth_master_user_separator = * auth_verbose = yes base_dir = /var/run/dovecot/ default_vsz_limit = 2 G imap_id_log = * imap_id_send = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = 5000 mail_home = /DATEN/vmail/%Ld/%Ln mail_location = maildir:/DATEN/vmail/%Ld/%Ln/mail/ mail_plugins = " zlib fts fts_solr mail_log notify" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = no special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/sieve/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mailbox_alias_new = Sent Messages mailbox_alias_new2 = Sent Items mailbox_alias_new3 = Deleted Messages mailbox_alias_new4 = Papierkorb mailbox_alias_new5 = Spam mailbox_alias_old = Sent mailbox_alias_old2 = Sent mailbox_alias_old3 = Trash mailbox_alias_old4 = Trash mailbox_alias_old5 = Junk mailbox_list_index = yes recipient_delimiter = + sieve = /DATEN/vmail/%Ld/%Ln/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms zlib_save = gz zlib_save_level = 6 } protocols = sieve imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = root } service imap-login { chroot = login executable = /usr/libexec/dovecot/imap-login inet_listener imap { port = 0 } process_min_avail = 4 user = dovecot } service imap { executable = /usr/libexec/dovecot/imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { chroot = login user = dovecot } service pop3-login { chroot = login user = dovecot } ssl = required ssl_cert = </etc/pki/tls/certs/server.crt ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } valid_chroot_dirs = /var/spool/vmail protocol lda { mail_plugins = sieve postmaster_address = postmaster } protocol imap { mail_plugins = " zlib fts fts_solr mail_log notify imap_zlib imap_sieve" } protocol lmtp { mail_plugins = " zlib fts fts_solr mail_log notify quota sieve" postmaster_address = postmaster@domain } Thanks for any hints. Greetings Juergen

4 7

configured solr - question 2
by Wojciech Puchar 11 Dec '19

11 Dec '19

How to free space when say folders are removed in mail account. Or whole account is removed?

1 0

configured solr - question 1
by Wojciech Puchar 11 Dec '19

11 Dec '19

tested dovecot with solr. Works well. But it uses TCP connection between solr server and dovecot. Can it be password protected? I have other things than IMAP on the same server including remote users. i don't want them to be able to do mess.

1 0

Solr for Dovecot on Debian 9, package has correct binary?
by John Gateley 11 Dec '19

11 Dec '19

Hello, I am trying to get Solr full text searching working on Debian 9 with Dovecot, and I suspect the binary for dovecot does not have solr enabled (--with-solr). root@elephant:/etc/dovecot/conf.d# /usr/sbin/dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL driver plugins: mysql postgresql sqlite Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap(plugin) nss passwd prefetch passwd-file sql root@elephant:/etc/dovecot/conf.d# If I want to use solr, do I have to build dovecot myself? I'd prefer to use the debian package (Debian 9 for now). Thanks! John

2 1

Learning ham/spam with IMAPSieve: sa-learn-ham.sh terminated abnormally, signal 11
by Jens Rey 11 Dec '19

11 Dec '19

Hello, I am trying to get rspam to learn what is spam and what is ham. After following the IMAPSieve guide in the dovecot wiki (https://wiki2.dovecot.org/HowTo/AntispamWithSieve) the mail.log shows the following, whenever I move a mail from the Spam folder to my inbox and vice versa: sieve: Opening script 1 of 1 from `/usr/lib/dovecot/sieve/report-ham.sieve' sieve: Loading script /usr/lib/dovecot/sieve/report-ham.sieve sieve: Script binary /usr/lib/dovecot/sieve/report-ham.svbin successfully loaded sieve: binary save: not saving binary /usr/lib/dovecot/sieve/report-ham.svbin, because it is already stored sieve: Executing script from `/usr/lib/dovecot/sieve/report-ham.svbin' sieve: action pipe: running program: sa-learn-ham.sh Mailbox INBOX: Opened mail UID=2996 because: mail stream Debug: waiting for program `/usr/lib/dovecot/sieve/sa-learn-ham.sh' to finish after 0 msecs Error: program `/usr/lib/dovecot/sieve/sa-learn-ham.sh' terminated abnormally, signal 11 Error: sieve: pipe action: failed to pipe message to program `sa-learn-ham.sh': refer to server log for more information. [2019-11-17 00:39:33] Error: sieve: Execution of script /usr/lib/dovecot/sieve/report-ham.sieve failed My relevant dovecot configuration: plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-script.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } $ dovecot --version 2.2.27 (c0f36b0) $ ls -l /usr/lib/dovecot/sieve/ total 24 -rw-r--r-- 1 root root 314 Nov 17 00:25 report-ham.sieve -rw-r--r-- 1 root root 448 Nov 17 00:30 report-ham.svbin -rw-r--r-- 1 root root 199 Nov 17 00:25 report-spam.sieve -rw-r--r-- 1 root root 354 Nov 17 00:30 report-spam.svbin -rwxr-xr-x 1 root root 41 Nov 17 00:32 sa-learn-ham.sh -rwxr-xr-x 1 root root 42 Nov 17 00:32 sa-learn-spam.sh $ cat sa-learn-ham.sh #!/bin/sh exec /usr/bin/rspamc learn_ham When I execute the script manually, it seems to work: $ cat [some-mail] | /usr/lib/dovecot/sieve/sa-learn-ham.sh Results for file: stdin (0.011 seconds) success = true; filename = "stdin"; scan_time = 0.012000; Again, with the same mail: $ cat [some-mail] | /usr/lib/dovecot/sieve/sa-learn-ham.sh Results for file: stdin (0.000 seconds) error = "<some-mail> has been already learned as ham, ignore it"; filename = "stdin"; scan_time = 0.0; Any ideas what causes the abnormal temrination of the script? Regards, Jens

3 8

Re: fts_solr: Error: fts_solr: received invalid uid '0'
by Fabian Kuran 10 Dec '19

10 Dec '19

Hi, > Am 23.09.2019 um 09:36 schrieb Filip Hanes <filip.hanes(a)ringier.sk>: > > > št 19. 9. 2019 o 15:30 Fabian via dovecot <dovecot(a)dovecot.org <mailto:dovecot@dovecot.org>> napísal(a): > Are there any other hints or tips regarding this „invalid uid ‚0‘"-message? > from fts-solr source: > case SOLR_XML_CONTENT_STATE_UID: > if (uint32_parse(str, len, &ctx->uid) < 0 || ctx->uid == 0) { > i_error("fts_solr: received invalid uid '%s'", t_strndup(str, len)); > It means that plugin tries to parse '0' when in state of parsing uid in xml response from solr or there is a bug in xml response parser. > I would enable rawlog_dir in config and look there for unusual response or extra tags near usual uid in xml response. For example: > plugin { > fts = solr > fts_solr = url=... rawlog_dir=/var/log/fts-solr/ > } > Thanks for this tip! The rawlog_dir option is not yet supported in our version 2.3.4. What we could provide now would be the XML-Response from Solr. The corresponding search query sometimes causes this error. But Solr's answer seems to always remain the same - in my opinion this already indicates a bug of Dovecot? The XML response can be downloaded here: https://owncloud.eideo.de/index.php/s/8oyJaf5HBK6zdbr Kind regards, Fabian

4 6

Re: Dovecot & OAuth
by Aki Tuomi 10 Dec '19

10 Dec '19

Hi! It seems there is a bug in the oauth2 driver, it loads the cert files wrong way. I'll make an internal bug report of this. Aki > On 06/12/2019 16:42 mizuki <mizuki0621(a)gmail.com> wrote: > > > Hi, > > For troubleshooting purposes, I change the read/write permissions on the certs and confirmed 'dovecot' can read them w/o problem, but still seeing the same errors. :( > Mizuki > > > On Fri, Dec 6, 2019 at 1:35 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > Is the key/cert pair readable by dovecot user? auth process does not run as root. > > > > > > > > > > You can add > > > > > > > > > > service auth { > > > > extra_groups = ssl_cert > > > > } > > > > > > > > > > and chgrp the cert to ssl_cert to allow access to the cert. > > > > > > > > > > Aki > > > > > On 06/12/2019 04:16 mizuki via dovecot <dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > > > > > > > > > > I changed some of the tls options following the document, now config is following: > > > > > > > > > > > > > > > > > > > > > > > > tokeninfo_url = https://keycloak.com/auth/realms/mail/protocol/openid-connect/token > > > introspection_url = https://dovecot:7598e21b-ec34-481f-80d0-059bddae0923@keycloak.com/auth/real… > > > introspection_mode = post > > > debug = yes > > > rawlog_dir = /tmp/oauth2 > > > #force_introspection = yes > > > username_attribute = username > > > #active_attribute = active > > > #active_value = true > > > tls_ca_cert_file = /etc/pki/CA/certs/incommon-rsa-server-ca.crt > > > tls_cert_file = /etc/pki/dovecot/certs/dovecot.pem > > > tls_key_file = /etc/pki/dovecot/private/dovecot.pem > > > > > > > > > --------------- > > > > > > > > > > > > > > > The debug log is showing now slightly different msg ex: > > > > > > Dec 5 21:09:59 mktst4 dovecot: auth: Error: oauth2(mizuki,10.0.2.1,<29b4iv+YKuuCx5Tr>): oauth2 failed: Couldn't initialize SSL context: Can't load SSL certificate: There is no valid PEM certificate. > > > > > > > > > > > > > > > Still not able to connect to the keyclaok server. :( > > > > > > > > > > > > > > > > > > PS: Dovecot & Keycloak severs are both using the same legit cert/key pair with CA file configured. > > > > > > > > > > > > > > > Thanks! > > > > > > Mizuki > > > > > > > > > > > > > > > > > > > > > On Thu, Dec 5, 2019 at 3:06 PM Aki Tuomi < aki.tuomi(a)open-xchange.com> wrote: > > > > > > > > > > Before declaring it not ready for prime time, did you try setting > > > > > > > > tls_ca_cert_file = /etc/ssl/certs/ca-certificates.crt > > > > > > > > In the oauth2 configuration file as documented in https://doc.dovecot.org/configuration_manual/authentication/oauth2 ? > > > > > > > > Aki > > > > > > > > > On 05/12/2019 21:58 mizuki via dovecot < dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > We'd like to enable OAuth with Keycloak in Dovecot, after enabling 'OAUTHBEARER XOAUTH2' in Dovecot based on online document, I can confirm Dovecot is ready for OAuth using openssl command, however when the auth request comes in, it failed in establishing a SSL connection with Keycloak server on port 443, shown as following in debug logs. I can confirming using commands 'openssl s_client -connect <keycloak_server>:443' or 'curl -v https://<keycloak_server/' all returns normal and no errors. Altering some of the SSL options in dovecot such as 'ssl_ca = </etc/pki/CA/certs/root_ca.pem' or 'ssl_client_ca_file = </etc/pki/CA/certs/root_ca.pem' does not help either. The certificate are NOT self-signed but signed the legit authorities. So I'm not sure why dovecot could not establish the connections. > > > > > > > > >

3 4

OAuth2 mail client
by mizuki 10 Dec '19

10 Dec '19

Hi all, I'm wondering if there are any IMAP client software alternative to Thunderbird who can handle OAuth2 other than using gmail, yahoo etc (ex, talk to local auth provider)? Thunderbird does not seem to support well at the time being so I'm wondering what other choices we may have for our user communities. Thank you very much. Mizuki

1 0

Problem With Quota Dovecot
by Gter Marcelo 09 Dec '19

09 Dec '19

Hi Dears, I have one problem with Dovecot in My mailserver. Dovecot Quota setting is not working fine. plugin { quota = dict:User quota::file:MAILDIR/dovecot-quota quota_rule = *:storage=1GB } For example if i put the limit in 1GB, i have accounts in my mailbox with size of maildir in 3gb,4gb for exemple and if i running the command doveadm quota get -u ACCOUNT_MY_USER The user with 2GB should be return 100% or some number bigger , but return 45% used only, If i force running one force-resync, the quota-get return the size correct showing more than 100% Someone can Help me ?

2 4

[whishlist] new option for 'doveadm purge'
by Michael Grimm 09 Dec '19

09 Dec '19

Hi, I do store mail in mdbox format of 150m in size (dovecot 2.3.9). Once in a while I do experience mdbox files of smaller size, even after applying 'doveadm purge' and previous expunges by the users. like: -rw------- 1 vmail dovecot 104854595 Feb 9 2019 /var/mail/.maildirs/userX/storage/m.22 -rw------- 1 vmail dovecot 29088478 Mar 8 2019 /var/mail/.maildirs/userX/storage/m.31 -rw------- 1 vmail dovecot 98210890 Mar 20 2019 /var/mail/.maildirs/userX/storage/m.39 (Currently the counter is at file number 129.) Well, I never experienced missing mail or alike, but these "holes" in filesize irritates me, and yes, it is more or less a cosmetic issue. Nevertheless, I do sometimes want to get rid of these "holes" by backing up all mail and re-injecting the backup into a vanilla account of that user. And I used this approach when I wanted to store all mail messages in larger mdbox files; again, rather a cosmetic issue. BUT that takes a very, very long time contrary to the speed of 'doveadm purge'. Unfortunately, that command starts somewhere with more recent mdbox files and never from scratch (oldest mdbox file). Whishlist: Would it be much of an effort to implement an option like: 'doveadm purge -f' and '-f' standing for 'force' or 'from scratch' or 'from the very first message found' or 'you name it'? Thanks in advance and thanks for Dovecot and with kind regards, Michael

2 2

bash script hook lda_mailbox_autocreate for generate mail-crypt user encrypted private key with user password
by uxqex4efpu＠elude.in 09 Dec '19

09 Dec '19

What it is way most best for causing bash script run (as root) of time mailbox created (lda_mailbox_autocreate)? I use dovecot 2.3.4.1 in Debian 10. And I use of mail-crypt-plugin https://doc.dovecot.org/configuration_manual/mail_crypt_plugin/ I setup mail-crypt for requiring user encrypted EC key (mail_crypt_require_encrypted_user_key = yes). I want for passphrase encrypt EC key using client plaintext password. There is credential no stored on server. But for user with use password too bad, I concatenate user plaintext password with random salt. And then string to SHA512() hash and use as decryption key (mail_crypt_private_password) for EC private key. For above I have plugin config > mail_plugins = $mail_plugins mail_crypt > plugin { > mail_crypt_curve = secp256k1 > mail_crypt_require_encrypted_user_key = yes > mail_crypt_save_version = 2 > } And for returning userdb_mail_crypt_private_password, I have sql query > password_query = SELECT username, password, \ > SHA2( CONCAT('%w',salt), 512 ) AS userdb_mail_crypt_private_password \ > FROM virtual_users WHERE username='%u'; But how I generate key of user automatically? Note for generating key of user, I need user password plaintext. I never save plaintext password of user of the server. Also user of note creates in PHP of web of the server. And for security I do not allow PHP exec shell (php.ini disabled_functions). Definitely not leaving PHP doveadm access! For solving subject to generate user key encrypted, I do imap of call of the service 'imap-postlogin' the service likes document "Post-login scripting' write https://doc.dovecot.org/admin_manual/post_login_scripting/ And 'imap-postlogin' execute my custom script with 'script-login' binary https://github.com/dovecot/core/blob/8606e1abb90a1c91357b84bf547a89564d0535… Here it is config for above > service imap { > executable = imap imap-postlogin > } > service imap-postlogin { > executable = script-login /usr/local/bin/generateKeys.sh > unix_listener imap-postlogin { > } > } And generateKeys.sh it is script simple for generating keys with sha256() hash product mysql. Variable of note ${MAIL_CRYPT_PRIVATE_PASSWORD} automatically put of 'userdb_mail_crypt_private_password' return of mysql field of query when documented https://doc.dovecot.org/admin_manual/post_login_scripting/running-surroundi… > Fields returned by userdb lookup with their keys uppercased > (e.g. if userdb returned home, it's stored in HOME). Here generatekeys.sh > #!/bin/bash > if [ `/usr/bin/doveadm mailbox cryptokey list -u "${USER}" -U > /dev/null | wc -l` -lt 2 ]; then > /usr/bin/doveadm -o "plugin/mail_crypt_private_password=${MAIL_CRYPT_PRIVATE_PASSWORD}" mailbox cryptokey generate -u "${USER}" -U > /dev/null > fi > exec "$@" This work! But I want more good. By why execute each login? Possible has generateKeys.sh execute in the times only of dovecot create mailbox (lda_mailbox_autocreate) instead?

2 4

Execute a script from dovecot when authentication fails
by nb 09 Dec '19

09 Dec '19

Hello, My name is Noury, and I’m new here. I’ve been using dovecot IMAP for years, but I want to do now some extra things. I want to call a script from within dovecot, to build a suspicious IP addresses list when authentication fails. I have tried the PostLoginScripting technic. It works fine but it doesn’t suit my needs. The script executes only after a successful login. I want to execute my script only when auth fails. If I can execute a script and check into it if auth failed, I would be nice too. A kind of « PreLoginScript" Is there a way to achieve this? I’m reading now auth.log file, but I would like to have a realtime processing. Thanks in advance. Noury

2 1

Re: How do I set all my mailboxes to "subscribed"
by Aki Tuomi 09 Dec '19

09 Dec '19

2 1

Shared namespace is empty after migration to new Dovecot installation
by Peter Reinhold 09 Dec '19

09 Dec '19

Hi all, I've used most of this weekend finalizing my migration from an old server running Dovecot 2.2.22 to a brand new installation running 2.3.8. In general, the migration was painless, everything just clicked, but checking up on the finer details post migration i've found out that user shared folders does not seem to work anymore, and I simply can't get it to work. The setups are more or less identical, biggest change is probably the addition of a Solr search index, and i've done very little changes in the configuration files. The acl_shared_dict file is being created and updated when I share a folder In the user thats sharing the folder, the dovecot-acl and dovecot-acl-list files are created and look the same. But, the user that should be reading the shared folder can not see it, the Shared namespace is simply empty, which it is not on the old installation, and namespace setup is identical across the two servers. (Except for the CaSiNg of the location of the index and indexpvt) Logging in and doing an IMAP command : A1 LIST "Shared/" "*" yields this on the old server. (I've replaced the sharing users e-mail to user(a)sharer.dk and the reading users to user(a)reader.dk) A1 LIST "Shared/" "*" * LIST (\HasNoChildren) "/" Shared/user(a)sharer.dk A1 OK List completed (0.000 + 0.000 secs). and this on the new A1 LIST "Shared/" "*" A1 OK List completed (0.006 + 0.000 + 0.005 secs). Log output from the new server below (i've only included the events happening during the LIST account) -- New, non-working log start -- Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/data/mail/%d/%n/maildir:INDEX=~/maildir/shared/%u:INDEXPVT:~/maildir/shared/%u shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= fts: Indexes disabled for namespace 'Shared/%u/' acl: initializing backend with data: vfile acl: acl username = user(a)reader.dk acl: owner = 0 acl vfile: Global ACLs disabled acl vfile: file /data/mail/reader.dk/user/maildir/dovecot-acl not found acl vfile: file /data/mail/reader.dk/user/maildir/.Junk/dovecot-acl not found acl vfile: file /data/mail/reader.dk/user/maildir/.Trash/dovecot-acl not found acl vfile: file /data/mail/reader.dk/user/maildir/.Sent/dovecot-acl not found auth-master: userdb lookup(user(a)sharer.dk): Started userdb lookup auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=1636,uid=0): Client connected (fd=16) auth-master: userdb lookup(user(a)sharer.dk): auth USER input: user(a)sharer.dk uid=120 gid=129 home=/data/mail/sharer.dk/user auth-master: userdb lookup(user(a)sharer.dk): Finished userdb lookup (username=user(a)sharer.dk uid=120 gid=129 home=/data/mail/sharer.dk/user) Namespace Shared/: Using permissions from : mode=0700 gid=default -- New, non-working log end -- and here from the old, working installation -- Old, working log start -- Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/data/mail/%d/%n/maildir:INDEX=~/Maildir/shared/%u:INDEXPVT=~/Maildir/shared/%u shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= acl: initializing backend with data: vfile acl: acl username = user(a)reader.dk acl: owner = 0 acl vfile: Global ACLs disabled auth input: user(a)sharer.dk uid=118 gid=126 home=/data/mail/sharer.dk/user namespace/default/inbox=yes maildir++: root=/data/mail/sharer.dk/user/maildir, index=/data/mail/sharer.dk/user/Maildir/shared/user(a)sharer.dk, indexpvt=/data/mail/sharer.dk/user/Maildir/shared/user(a)sharer.dk, control=, inbox=/data/mail/sharer.dk/user/maildir, alt= acl: initializing backend with data: vfile acl: acl username = user(a)sharer.dk acl: owner = 1 acl vfile: Global ACLs disabled maildir++: root=/data/mail/sharer.dk/user/maildir, index=/data/mail/reader.dk/user/Maildir/shared/user(a)sharer.dk, indexpvt=/data/mail/reader.dk/user/Maildir/shared/user(a)sharer.dk, control=, inbox=/data/mail/sharer.dk/user/maildir, alt= acl: initializing backend with data: vfile acl: acl username = user(a)reader.dk acl: owner = 0 acl vfile: Global ACLs disabled acl vfile: reading file /data/mail/sharer.dk/user/maildir/dovecot-acl acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Junk acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Trash acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Sent acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Drafts acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Junk acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Trash acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Sent acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Drafts -- Old, working log end -- The two logs are quite different, the new one seems to do user lookups via the auth socket, which the old one does not, and then just stops there. I'm not going to try and speculate more, I hope that someone here can see something from the logs, as I simply do not know how to fix this problem. -- Peter Reinhold

2 2

director option
by soumitri＠iitk.ac.in 09 Dec '19

09 Dec '19

Hi, I think option-2 below seems better or am I missing something with director concept. 1. As director and back-end in same server (broken) not recommended, I need minimum 4 servers (2 for director, 2 back-end IMAP). Indexes and mail must be in NFS shared storage(not optimal), as a user may land on any of the back-end servers (assuming no static mapping of user from pass DB). 2) Proxy_may in passDB (static mapping of users to servers makes balancing little partial but can be admin optimized) can achieve the above setup with 2 servers without director. Here indexes can be on their local disk (efficient) and mail on shared storage (NFS). Both case I can use RR DNS to get users IMAP traffic to front end. Any guidance on this is appreciated. -- Sincerely, Soumitri Mishra

1 1

Adding Size information to Maildir files
by ＠lbutlr 08 Dec '19

08 Dec '19

I searched on this, but found information only for very very old dovecot versions, and those answers didn’t quite cover what I am asking. All my current mail has the ",S=51489,W=52449:” style tag in the Maildir filename, but I have many messages in Archive mailboxes that have no size information. Is it possible to automate adding the size info to the files without mucking up the mail in various ways? (In my mail spool its about 10:1 with nearly 400,000 mails tagged with a size field and just over 40,000 not tagged, so it is definitely not something I want to do by hand). -- You know, Rick, I have many a friend in Casablanca, but somehow, just because you despise me, you are the only one I trust.

1 0

SEARCH=INTHREAD not announced in capabilities
by kael 08 Dec '19

08 Dec '19

Hello, Looking at the SEARCH=INTHREAD extension, Dovecot implements it but the server doesn't announce the extension in its capabilities (at least testing with imap://dovecot.org or looking at https://github.com/dovecot/core/blob/169b1ff42a28cdf2768391d20e8fef13aeae54… ) It does work though: a UID SEARCH INTHREAD REFS HEADER subject "Re: bash script" * SEARCH 106075 106076 106084 a OK Search completed (1.047 + 0.000 + 1.046 secs). I'd have thought that announcing THREAD=REFS would imply SEARCH=INTHREAD, but testing with Fastmail only the former is implemented. Looks like a bug in Dovecot as the client can't discover the SEARCH=INTHREAD capability. Cheers. -- kael

1 0

Accessing the -a and -d from dovecot-lda
by Aristedes Maniatis 08 Dec '19

08 Dec '19

I've got exim set up to deliver like this: command = /usr/local/libexec/dovecot/dovecot-lda -a $original_local_part@$original_domain -d $local_part@$domain -f $sender_address If an email to is bob+sales(a)ish.com.au then we should have "-a bob+sales(a)subdomain.ish.com.au -d bob(a)ish.com.au". Now in dovecot, only bob(a)ish.com.au is a real user but I want to be able to use both addresses in different places. For LDAP lookup I need to reference bob(a)ish.com.au. But in sieve, I need to see the original address with plus notation. However, dovecot appears to get the "-a" address into %u and the "-d" address can't be accessed. https://doc.dovecot.org/configuration_manual/config_file/config_variables/ Is what is the point of dovecot-lda having both -a and -d options? Can I get at both bits of data? Thanks Ari

2 1

ssl_min_protocol = TLSv1.3 does not work
by Laurens Post 08 Dec '19

08 Dec '19

Hi all, I'm trying to set up my server with support for TLS 1.3 only, but that does not seem to be supported. First off, TLS 1.3 itself does work fine, so it's not the config or ssl library, and 1.3-only works fine with Postfix. The problem is only in disabling TLS 1.2 for Dovecot. On connection, I'm getting an error that 1.3 is an "Unknown ssl_min_protocol setting". Reading the source code, it seems that `openssl_min_protocol_to_options` in `src/lib-ssl-iostream/iostream-openssl-common.c` is simply missing an entry like { SSL_TXT_TLSV1_3, TLS1_3_VERSION, SSL_OP_NO_SSLv3 | SSL_OP_NO_TLSv1 | SSL_OP_NO_TLSv1_1 | SSL_OP_NO_TLSv1_2 } Is this a bug, something intentional, or has it simply not been added yet because nobody has been crazy enough to ask for it? Kind regards, Laurens

3 2

Dovecot 2.3.8 - How to force index creation for user/mailbox?
by Tomek Lutelmowski 08 Dec '19

08 Dec '19

Hello, I'm using maildirs, and I have problems with big mailboxes (~ 20000 emails, 30-50GB) - sometimes access to such mailbox takes very long (~10 minutes), I would like to be able to create index for mailbox in background, but I couldn't find any way to do it. So far I tried: *doveadm -D -vvv index -u user 'Folder' * But even if this folder have no dovecot.index* files - I always get: doveadm(user): Info: Wersje robocze: Cache is already up to date It seems that doveadm doesn't actually checks if the index is present. The index is created only when I log with IMAP client and check the folder. So i tried: *doveadm mailbox cache purge -u user 'Folder' * No joy either: doveadm(user): Error: Cache is unusable And command below doesn't actually do anything to index: *doveadm -vvv force-resync -u user 'Folder'* Is there any way to use doveadm tool to create/fix index? Shouldn't the index be updated on each email arrival? Cheers, TomekL

5 12

lmtp proxy 'Invalid FROM: Missing domain'
by Marc Roos 06 Dec '19

06 Dec '19

Looks like I have a correct working proxy on pop3. On both backend servers I can run cat /tmp/test.msg | /usr/libexec/dovecot/lmtp Giving 250 2.1.5 OK 354 OK Info: Disconnect from local: Connection closed (in DATA) However if I run the same command on the proxy, I am getting this error 'Invalid FROM: Missing domain'. How is this FROM even relevant if message just needs to be delivered to RCPT TO.

2 2

Sieve redirect does not collect the sendmail child process correctly (Dovecot 2.3.4.1, Pigeonhole 0.5.4)
by Delian Krustev 06 Dec '19

06 Dec '19

Hi, I got this simple test Sieve config: ############################################# # Sieve Filter # Generated by Ingo (http://www.horde.org/apps/ingo/) (11/01/2019, 10:46:06 PM) # Forwards if true { redirect "krustev(a)krustev.net"; } # Forward Keep Action if true { keep; stop; } ############################################# Which used to work fine with: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-8-amd64 x86_64 Debian 9.11 Then I've tried migrating to: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.1 And started getting the following errors: # cat .dovecot.sieve.log sieve: info: started log at Nov 01 22:55:50. error: msgid=<4221584.AlbrL4BjWX@home>: failed to redirect message to <krustev(a)krustev.net>: Failed to execute sendmail (temporary failure). A google search lead me to: https://bugs.archlinux.org/task/56933 which blames systemd service changes: NoNewPrivileges=true , however I'm not running dovecot via systemd but use DJB's daemontools for service supervision . The page above suggested to change from: sendmail_path = /usr/sbin/sendmail to submission_host = localhost in "conf.d/15-lda.conf", which worked fine. But since I don't have other problems with "sendmail" execution I've decided to debug this further. I have dovecot integrated with Qmail: # apt-cache policy qmail qmail: Installed: 1.06-6+b1 Candidate: 1.06-6+b1 Version table: *** 1.06-6+b1 900 900 http://deb.debian.org/debian buster/main amd64 Packages so sendmail's implementation comes from Qmail: # ls -al `which sendmail` lrwxrwxrwx 1 root root 14 Feb 23 2015 /usr/sbin/sendmail -> qmail-sendmail I've strace-d the qmail-lspawn process which executes dovecot's LDA, which processes the Sieve rules and executes "sendmail". The sendmail process executes and returns successfully, the mail is delivered, however the Sieve code does not wait for the child process correctly and tries to kill the already exited process after 30 seconds timeout. Here are the problematic Sieve syscalls: 22:55:15.283482 execve("/usr/lib/dovecot/deliver", ["/usr/lib/dovecot/deliver", "-e", "-a", "tester(a)krustev.net"], 0x5620b4330c40 /* 61 vars */) = 0 ... 22:55:15.286845 pipe([5, 6]) = 0 22:55:15.286870 fcntl(5, F_GETFL) = 0 (flags O_RDONLY) 22:55:15.286889 fcntl(5, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 22:55:15.286909 fcntl(6, F_GETFL) = 0x1 (flags O_WRONLY) 22:55:15.286928 fcntl(6, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 22:55:15.286947 fcntl(5, F_GETFD) = 0 22:55:15.286966 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 22:55:15.286985 fcntl(6, F_GETFD) = 0 22:55:15.287003 fcntl(6, F_SETFD, FD_CLOEXEC) = 0 22:55:15.287024 epoll_create(128) = 7 22:55:15.287043 fcntl(7, F_GETFD) = 0 22:55:15.287062 fcntl(7, F_SETFD, FD_CLOEXEC) = 0 22:55:15.287084 epoll_ctl(7, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=47201248, u64=94699781110752}}) = 0 ... 22:55:15.294625 epoll_ctl(7, EPOLL_CTL_DEL, 5, 0x7ffd59156b8c) = 0 22:55:15.294647 epoll_create(128) = 12 22:55:15.294668 fcntl(12, F_GETFD) = 0 22:55:15.294687 fcntl(12, F_SETFD, FD_CLOEXEC) = 0 22:55:15.294708 epoll_ctl(12, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=47455536, u64=94699781365040}}) = 0 Dovecot/Sieve will wait for this pipe FD 5 later, but no event will arrive. 22:55:15.294740 rt_sigaction(SIGCHLD, {sa_handler=0x7f15404b3640, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO, sa_restorer=0x7f1540229840}, NULL, 8) = 0 22:55:15.294763 pipe([13, 14]) = 0 22:55:15.294788 clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7f15401ec2d0) = 6929 The sendmail child process with PID 6929 is forked here. 22:55:15.294928 close(13) = 0 22:55:15.294969 fcntl(14, F_GETFL) = 0x1 (flags O_WRONLY) 22:55:15.295006 fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 22:55:15.295039 lseek(14, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 22:55:15.295065 getsockname(14, 0x7ffd59156a40, [28]) = -1 ENOTSOCK (Socket operation on non-socket) 22:55:15.295109 write(14, "EDITTED LONG MESSAGE DATA\n", 1461) = 1461 22:55:15.295150 close(14) = 0 22:55:15.295175 wait4(6929, 0x562102d4fee4, WNOHANG, NULL) = 0 22:55:15.295211 epoll_wait(12, [], 1, 30000) = 0 Here's where the 30 second's timeout is requested and waited. 22:55:45.325580 kill(6929, SIGTERM) = 0 22:55:45.325769 epoll_wait(12, [], 1, 5000) = 0 22:55:50.331108 kill(6929, SIGKILL) = 0 22:55:50.332867 wait4(6929, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 6929 22:55:50.333020 epoll_ctl(12, EPOLL_CTL_DEL, 5, 0x7ffd59156b6c) = 0 22:55:50.333060 epoll_ctl(7, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=47201248, u64=94699781110752}}) = 0 22:55:50.333097 close(12) = 0 22:55:50.333240 sendto(9, "<19>Nov 1 22:55:50 dovecot: lda(krustev)<6926><IlpXEdO3vF0OGwAA4EGeoA>: Error: sieve: msgid=<4221584.AlbrL4BjWX@home>: failed to redirect message to <krustev(a)krustev.net>: Failed to execute sendmail (temporary failure)", 220, MSG_NOSIGNAL, NULL, 0) = 220 22:55:50.333321 openat(AT_FDCWD, "/home/krustev/mail/domains/krustev.net/tester/.dovecot.sieve.log", O_WRONLY|O_CREAT|O_APPEND, 0600) = 12 22:55:50.333557 fstat(12, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 22:55:50.333613 lseek(12, 0, SEEK_CUR) = 0 22:55:50.333643 fstat(12, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 22:55:50.333678 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=127, ...}) = 0 22:55:50.333726 write(12, "sieve: info: started log at Nov 01 22:55:50.\n", 45) = 45 22:55:50.333788 write(12, "error: msgid=<4221584.AlbrL4BjWX@home>: failed to redirect message to <krustev(a)krustev.net>: Failed to execute sendmail (temporary failure).\n", 141) = 141 22:55:50.333857 sendto(9, "<19>Nov 1 22:55:50 dovecot: lda(krustev)<6926><IlpXEdO3vF0OGwAA4EGeoA>: Error: sieve: Execution of script /home/krustev/mail/domains/krustev.net/tester/.dovecot.sieve was aborted due to temporary failure (user logfile /home/krustev/mail/domains/krustev.net/tester/.dovecot.sieve.log may reveal additional details)", 317, MSG_NOSIGNAL, NULL, 0) = 317 22:55:50.333941 close(10) = 0 22:55:50.333996 close(12) = 0 22:55:50.334057 lstat("/home/krustev/mail/domains/krustev.net/tester/.dovecot.lda-dupes.lock", {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 22:55:50.334095 unlink("/home/krustev/mail/domains/krustev.net/tester/.dovecot.lda-dupes.lock") = 0 22:55:50.334188 close(11) = 0 22:55:50.334245 write(2, "Execution of Sieve filters was aborted due to temporary failure\n", 64) = 64 22:55:50.334418 munmap(0x7f15401bc000, 103680) = 0 22:55:50.334481 munmap(0x7f15403b3000, 32800) = 0 22:55:50.334516 munmap(0x7f15400fb000, 788352) = 0 22:55:50.334610 epoll_ctl(7, EPOLL_CTL_DEL, 8, 0x7ffd5915706c) = 0 22:55:50.334640 close(8) = 0 22:55:50.334685 epoll_ctl(7, EPOLL_CTL_DEL, 5, 0x7ffd5915706c) = 0 22:55:50.334738 close(5) = 0 22:55:50.334785 close(6) = 0 22:55:50.334813 close(7) = 0 22:55:50.334841 close(4) = 0 22:55:50.334881 exit_group(75) = ? 22:55:50.335077 +++ exited with 75 +++ Here's the interesting part of sendmail's (PID 6929) execution with timestamps: .. 22:55:15.295268 execve("/usr/sbin/sendmail", ["/usr/sbin/sendmail", "-i", "-f", "tester(a)krustev.net", "--", "krustev(a)krustev.net"], NULL) = 0 ... 22:55:15.296024 chdir("/var/lib/qmail") = 0 22:55:15.296055 execve("bin/qmail-inject", ["bin/qmail-inject", "-a", "-f", "tester(a)krustev.net", "--", "krustev(a)krustev.net"], 0x55741b1890e0 /* 2 vars */) = 0 ... 22:55:15.297264 vfork() = 6930 .. 22:55:15.297930 wait4(6930, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 6930 22:55:15.305391 exit_group(0) = ? 22:55:15.305472 +++ exited with 0 +++ The PID 6930 is a call to the setuid qmail-queue, which also executes and returns normally. With all the above stated - It seems that the problem is in the "epoll" calls. Either it is not set-up correctly or dovecot-LDA does not receive the information it waits for. I've tried to make my way trough Dovecot's source code but have concluded that someone more familiar should be able to spot the problem much quicker than me. Let me know if you need some additional information. Sorry for the long mail. Dovecot config follows: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.1 # Hostname: pinko.livehostserver.com auth_mechanisms = plain login disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /dev/stderr log_timestamp = mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox "Deleted Items" { special_use = \Trash } mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox "Junk E-mail" { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Mail" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox sent-mail { special_use = \Sent } prefix = } passdb { args = /usr/local/sbin/vchkpw-dovecot driver = checkpassword } plugin { antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_pipe_program = /bin/sh antispam_pipe_program_notspam_args = -c;HOME=$PWD exec nice sa-learn --ham antispam_pipe_program_spam_args = -c;HOME=$PWD exec nice sa-learn --spam antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = spam;junk;junk * antispam_trash_pattern_ignorecase = trash;Deleted * quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_redirect_envelope_from = recipient } protocols = " imap sieve pop3" service anvil { client_limit = 1536 } service auth { client_limit = 1536 } service imap-login { process_limit = 512 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 } service managesieve { process_limit = 50 } service pop3-login { process_limit = 512 } service stats { client_limit = 1024 unix_listener stats-writer { mode = 0666 } } ssl_ca = </scm/deb-global/etc/ssl/intermediate-CAs.crt ssl_cert = </etc/ssl/default-fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = prefetch } protocol lda { info_log_path = log_path = mail_plugins = " quota sieve" } protocol imap { mail_max_userip_connections = 64 mail_plugins = " quota imap_quota antispam" } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_line_length = 65536 } Best regards -- Delian

2 3

Problem with sievefilter forwarding
by ratatouille 06 Dec '19

06 Dec '19

Hello! dovecot --version 2.2.36 (1f10bfa63) I defined a sievefilter require ["copy"]; # rule:[weiterleitung] if header :contains "to" "user(a)bitclusive.de" { redirect :copy "otheruser(a)gmail.com"; stop; } It doesn't work and I don't know why. I can define a vacationfilter that works fine. Can I debug this somehow and can somebody here explain what is going wrong? Kind regards Andreas

2 2

ACL hide folders
by Peter Chiochetti 06 Dec '19

06 Dec '19

After updating from 2.2.22 to 2.2.33 rsp 2.3.8 my ACLs went bust. Below line in the global acl file hides all folders except INBOX for all users > * group=ALL Next reenable certain folders, eg: > Sent group=ALL lrwsi This made anyone see "Sent" in 2.2.22, but no longer so in 2.2.33 Any ideas how to have it like before? -- peter

1 3

v2.3.9 released
by Aki Tuomi 06 Dec '19

06 Dec '19

Hi all! We are pleased to release v2.3.9 of Dovecot. Please find it from locations below --- Aki Tuomi Open-Xchange oy https://dovecot.org/releases/2.3/dovecot-2.3.9.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- * Changed several event field names for consistency and to avoid conflicts in parent-child event relationships: * SMTP server command events: Renamed "name" to "cmd_name" * Events inheriting from a mailbox: Renamed "name" to "mailbox" * Server connection events have only "remote_ip", "remote_port", "local_ip" and "local_port". * Removed duplicate "client_ip", "ip" and "port". * Mail storage events: Removed "service" field. Use "service:<name>" category instead. * HTTP client connection events: Renamed "host" to "dest_host" and "port" to "dest_port" * auth: Drop Postfix socketmap support. It hasn't been working with recent Postfix versions for a while now. * push-notification-lua: The "subject" field is now decoded to UTF8 instead of kept as MIME-encoded. + push-notification-lua: Added new "from_address", "from_display_name", "to_address" and "to_display_name" fields. The display names are decoded to UTF8. + Added various new fields to existing events. See http://doc.dovecot.net/admin_manual/list_of_events.html + Add lmtp_add_received_header setting. It can be used to prevent LMTP from adding "Received:" headers. + doveadm: Support SSL/STARTTLS for proxied doveadm connections based on doveadm_ssl setting and proxy ssl/tls settings. + Log filters support now "service:<name>", which matches all events for the given service. It can also be used as a category. + lib: Use libunwind to get abort backtraces with function names where available. + lmtp: When the LMTP proxy changes the username (from passdb lookup) add an appropriate ORCPT parameter. - lmtp: Add lmtp_client_workarounds setting to implement workarounds for clients that send MAIL and RCPT commands with additional spaces before the path and for clients that omit <> brackets around the path. See example-config/conf.d/20-lmtp.conf. - lda/lmtp: Invalid MAIL FROM addresses were rejcted too aggressively. Now mails from addresses with unicode characters are delivered, but their Return-Path header will be <> instead of the given MAIL FROM address. - lmtp: The lmtp_hdr_delivery_address setting is ignored. - imap: imap_command_finished event's "args" and "human_args" parameters were always empty. - mbox: Seeking in zlib and bzip2 compressed input streams didn't work correctly. - imap-hibernate: Process crashed when client got destroyed while it was attempted to be unhibernated, and the unhibernation fails. - *-login: Proxying may have crashed if SSL handshake to the backend failed immediately. This was unlikely to happen in normal operation. - *-login: If TLS handshake to upstream server failed during proxying, login process could crash due to invalid memory access. - *-login: v2.3 regression: Using SASL authentication without initial response may have caused SSL connections to hang. This happened often at least with PHP's IMAP library. - *-login: When login processes are flooded with authentication attempts it starts logging errors about "Authentication server sent unknown id". This is still expected. However, it also caused the login process to disconnect from auth server and potentially log some user's password in the error message. - dict-sql: SQL prepared statements were not shared between sessions. This resulted in creating a lot of prepared statements, which was especially inefficient when using Cassandra backend with a lot of Cassandra nodes. - auth: auth_request_finished event didn't have success=yes parameter set for successful authentications. - auth: userdb dict - Trying to list users crashed. - submission: Service could be configured to allow anonymous authentication mechanism and anonymous user access. - LAYOUT=index: Corrupted dovecot.list.index caused folder creation to panic. - doveadm: HTTP server crashes if request target starts with double "/". - dsync: Remote dsync started hanging if the initial doveadm "dsync-server" command was sent in the same TCP packet as the following dsync handshake. v2.3.8 regression. - lib: Several "input streams" had a bug that in some rare situations might cause it to access freed memory. This could lead to crashes or corruption. The only currently known effect of this is that using zlib plugin with external mail attachments (mail_attachment_dir) could cause fetching the mail to return a few bytes of garbage data at the beginning of the header. Note that the mail wasn't saved corrupted, but fetching it caused corrupted mail to be sent to the client. - lib-storage: If a mail only has quoted content, use the quoted text for generating message snippet (IMAP PREVIEW) instead of returning empty snippet. - lib-storage: When vsize header was rebuilt, newly calculated message sizes were added to dovecot.index.cache instead of being directly saved into vsize records in dovecot.index. - lib: JSON generator was escaping UTF-8 characters unnecessarily.

3 2

[2.3.8] possible replication issue
by Carsten Rosenberg 06 Dec '19

06 Dec '19

Hi, some of our customers have discovered a replication issue after upgraded from 2.3.7.2 to 2.3.8. Running 2.3.8 several replication connections are hanging until defined timeout. So after some seconds there are $replication_max_conns hanging connections. Other replications are running fast and successful. Also running a doveadm sync tcp:... is working fine for all users. I can't see exactly, but I haven't seen mailboxes timeouting again and again. So I would assume it's not related to the mailbox. >From the logs: server1: Oct 16 08:29:25 server1 dovecot[5715]: dsync-local(username1(a)domain.com)<FXnVDW22pl0tGAAA1cwDxA>: Error: dsync(172.16.0.1): I/O has stalled, no activity for 600 seconds (version not received) Oct 16 08:29:25 server1 dovecot[5715]: dsync-local(username1(a)domain.com)<FXnVDW22pl0tGAAA1cwDxA>: Error: Timeout during state=master_recv_handshake server2: Oct 16 08:29:25 server2 dovecot[8113]: doveadm: Error: read(server1) failed: EOF (last sent=handshake, last recv=handshake) There aren't any additional logs regarding the replication. I have tried increasing vsz_limit or reducing replication_max_conns. Nothing changed. -- Both customers have 10k+ users. Currently I couldn't reproduce this on smaller test systems. Both installation were downgraded to 2.3.7.2 to fix the issue for now -- I've attached a tcpdump showing the client showing the client stops sending any data after the mailbox_guid table headers. Any idea what could be wrong here or the debug this issue? Thanks. Carsten Rosenberg

5 5

Dovecot & OAuth
by mizuki 06 Dec '19

06 Dec '19

Hi all, We'd like to enable OAuth with Keycloak in Dovecot, after enabling 'OAUTHBEARER XOAUTH2' in Dovecot based on online document, I can confirm Dovecot is ready for OAuth using openssl command, however when the auth request comes in, it failed in establishing a SSL connection with Keycloak server on port 443, shown as following in debug logs. I can confirming using commands 'openssl s_client -connect <keycloak_server>:443' or 'curl -v https://<keycloak_server/' all returns normal and no errors. Altering some of the SSL options in dovecot such as 'ssl_ca = </etc/pki/CA/certs/root_ca.pem' or 'ssl_client_ca_file = </etc/pki/CA/certs/root_ca.pem' does not help either. The certificate are NOT self-signed but signed the legit authorities. So I'm not sure why dovecot could not establish the connections. *Debug logs:* ---------------------------------------------------- Dec 5 14:32:07 mktst4 dovecot: auth: Debug: auth client connected (pid=16554) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: client in: AUTH#0111#011OAUTHBEARER#011service=imap#011secured#011session=QPwA/fmY+tqCx5Tr#011lip=130.199.148.187#011rip=10.0.2.1#011lport=993#011rport=56058#011resp=bixhPW1penVraQFob3N0PW1rdHN0NC5zZGNjLmJubC5nb3YBcG9ydD05OTMBYXV0aD1CZWFyZXIgZXlKaGJHY2lPaUpTVXpJMU5pSXNJblI1Y0NJZ09pQWlTbGRVSWl3aWEybGtJaUE2SUNKcmRHeE5TSFZtYkc1NFZUUmlSR1pLTm5kSGRteFBNVVYxWWxWd2FreEZVVmhIY25GTU5UYzNhSEJSSW4wLmV5SnFkR2tpT2lJNE5XSmxZV05tTkMxak1tTmxMVFJtTkRJdFltUTRNUzAxTnpWaU4yRmpZV05sT1RnaUxDSmxlSEFpT2pFMU56VTJNVEF5TURnc0ltNWlaaUk2TUN3aWFXRjBJam94TlRjMU5UYzBNakE0TENKcGMzTWlPaUpvZEhSd2N6b3ZMMnRsZVdOc2IyRnJNaTV6WkdOakxtSnViQzVuYjNZdllYVjBhQzl5WldGc2JYTXZiV0ZwYkNJc0ltRjFaQ0k2SW1GalkyOTFiblFpTENKemRXSWlPaUkyTmpWa05EVTNNeTA0WVdFMUxUUmtPRFl0WW1NelppMHlaVEpqTWpOaU16WTJORFVpTENKMGVYQWlPaUpDWldGeVpYSWlMQ0poZW5BaU9pSmtiM1psWTI5MElpd2lZWFYwYUY5MGFXMWxJam93TENKelpYTnphVzl1WDNOMFlYUmxJam9pT1RNNE5XRTVOakF0TUROa1pDMDBPR05sTFdFeU4yUXRZVFkzWkdZME5tUXhaRGcxSWl3aVlXTnlJam9pTVNJc0luSmxZV3h0WDJGalkyVnpjeUk2ZXlKeWIyeGxjeUk2V3lKdlptWnNhVzVsWDJGalkyVnpjeUlzSW5WdFlWOWhkWFJvYjNKcGVtRjBhVzl1SWwxOUxDSnlaWE52ZFhKalpWOWhZMk5sYzNNaU9uc2lZV05qYjNWdWRDSTZleUp5YjJ4bGN5STZXeUp0WVc1aFoyVXRZV05qYjNWdWRDSXNJbTFoYm1GblpTMWhZMk52ZFc1MExXeHBibXR6SWl3aWRtbGxkeTF3Y205bWFXeGxJbDE5ZlN3aWMyTnZjR1VpT2lKd2NtOW1hV3hsSUdWdFlXbHNJaXdpWlcxaGFXeGZkbVZ5YVdacFpXUWlPbVpoYkhObExDSnVZVzFsSWpvaVRXbDZkV3RwSUV0aGNtRnpZWGRoSWl3aWNISmxabVZ5Y21Wa1gzVnpaWEp1WVcxbElqb2liV2w2ZFd0cElpd2laMmwyWlc1ZmJtRnRaU0k2SWsxcGVuVnJhU0lzSW1aaGJXbHNlVjl1WVcxbElqb2lTMkZ5WVhOaGQyRWlMQ0psYldGcGJDSTZJbTFwZW5WcmFVQmlibXd1WjI5MkluMC5NZTRwNkl0dmx2T0VYRTIxM2pwSnJpa3FhZGNZb0ZsMnlMVlJzQTJvQTdmWDgteEtJYTR2ckZmamwwLXRwb2JodzIyRnBvVDZ2TWoxbXphLXBWWUxzNW1vM0w5Y0xKT2hVVnV2Tm9YSm5nZlRzLXk2TWxuTXVGV1NQemtidEhhOXJTUEVqZGFZQXBDQk52MG9CWEs2bmhIM0U5ZkNvTl9TQlUycWxaSWk2M1dWOUZXSjFrbHVGT2Iwc0xja2JfWGNGZzhUZ0dXOEdVUlRYTlg4bW1VM1dNLWJ5dnJuTkFyNmFjWW1ibXRaVzRhV0NwTk5FSHRZU29LSmgydHZuQjhHNnl5eWptWWJ5Q2ZhTmwwSnVZYU52VFEzTXhCX2FnLV9Pcy04VkwtTGFLdHBGYXBMNEVNWUJaXzFnZmNhSFdUSUV1VS0wSVdjTjlEa2xxcW1MN19jNlEBAQ== (previous base64 data may contain sensitive data) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: Host created Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: Performing asynchronous DNS lookup Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO…] Submitted Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: DNS lookup successful; got 1 IPs Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Peer created Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com"443: Setting up connection to 10.0.2.2:443 (SSL= example.com) (1 requests pending) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Linked queue https://example.com:443 (1 queues linked) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Started new connection to 10.0.2.2:443 (SSL= example.com) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Creating 1 new connections to handle requests (already 0 usable, connecting to 0, closing 0) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Making new connection 1 of 1 Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: HTTPS connection created (1 parallel connections exist) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connected Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Starting SSL handshake Dec 5 14:32:22 mktst4 dovecot: auth: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Failed to make connection (connections=1, connecting=1) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Failed to set up connection to 10.0.2.2:443 (SSL= example.com) SSL handshaking with 10.0.2.2:443 failed: read(SSL 10.0.2.2:443) failed: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority (1 peers pending, 1 requests pending) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Failed to set up any connection; failing all queued requests Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Unlinked queue https://example.com:443 (0 queues linked) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Dropping request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO… ] Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: Host is idle (timeout = 1799992 msecs) Dec 5 14:32:22 mktst4 dovecot: auth: Error: oauth2(mizuki,10.0.2.1,<QPwA/fmY+tqCx5Tr>): oauth2 failed: SSL handshaking with 10.0.2.2:443 failed: read(SSL 10.0.2.2:443) failed: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO…] Destroy (requests left=1) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO…] Free (requests left=0) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: SSL handshaking with 10.0.2.2:443 failed: read(SSL 10.0.2.2:443) failed: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connection close Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connection disconnect Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connection destroy ---------------------------------------------------- *#dovecot -n * ---------------------------------------------------- # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1062.4.3.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) # Hostname: mktst4.sdcc.bnl.gov auth_debug = yes auth_debug_passwords = yes auth_mechanisms = oauthbearer xoauth2 auth_verbose = yes auth_verbose_passwords = yes first_valid_uid = 1000 mail_debug = yes mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-oauth2.conf.ext driver = oauth2 mechanisms = oauthbearer xoauth2 } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = required ssl_ca = </etc/pki/CA/certs/2.pem ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = ECDH+AESGCM:ECDH+CHACHA20:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:!aNULL:!MD5:!DSS:!RSA ssl_client_ca_file = </etc/pki/CA/certs/2.pem ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_require_crl = no userdb { args = uid=vmail gid=vmail home=/var/vmail/%u driver = static } ---------------------------------------------------- *# cat /etc/dovecot/conf.d/auth-oauth2.conf.ext* ---------------------------------------------------- passdb { driver = oauth2 mechanisms = oauthbearer xoauth2 args = /etc/dovecot/dovecot-oauth2.conf.ext } userdb { driver = static args = uid=vmail gid=vmail home=/var/vmail/%u } ---------------------------------------------------- I wonder if anyone has experienced this possibly know what's going on. Thanks! Mizuki

2 3

Supporting RFC 5466 (IMAP4 Extension for Named Searches (Filters))
by Jesus Cea 06 Dec '19

06 Dec '19

I wonder if Dovecot supports RFC 5466 (IMAP4 Extension for Named Searches (Filters)) or if there is any plan about it. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

4 6

How to rewrite local_lmpt ipc to tcp port 24
by Marc Roos 05 Dec '19

05 Dec '19

How to change this line in sendmail.mc, to the tcp port 24 on eg 127.0.0.1? FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl

2 1

dovecot expunge
by soumitri＠iitk.ac.in 05 Dec '19

05 Dec '19

Hi, Do we have expunge command by UID. I have some duplicate messages (same Message-ID but different UID) to be deleted. doveadm search gives me folder GUID and file UID, I want to use this specific information to delete/expunge. E.g. Following command deletes all duplicates, but I want to keep just one. doveadm expunge -u user1 mailbox INBOX HEADER Message-ID '5de82b2d.6VWfTzsd/fEAxfV7%cytx(a)iitk.ac.in' The following does not help doveadm deduplicate -u user1 mailbox INBOX -- Sincerely, Soumitri Mishra

2 1

How do I set all my mailboxes to "subscribed"
by Steve Litt 05 Dec '19

05 Dec '19

Hi all, I've had a great deal of trouble accessing my Dovecot IMAP from most supposedly IMAP aware email clients, and have been advised that it might be because some of my email folders are not subscribed. Is there s way I can subscribe all my folders? I see no reason to have a folder not subscribed. Thanks, SteveT Steve Litt December 2019 featured book: Rapid Learning for the 21st Century http://www.troubleshooters.com/rl21

2 1

Email blocking emails
by Peter Nabbefeld 05 Dec '19

05 Dec '19

Hello, I had troubles getting emails, because this one caused a Sig 6: https://p.ip.fi/DGSP It might be important that I'm using SOLR. After I removed this mail, I could fetch emails again. Kind regards Peter

2 1

Dovecot 2.3.9 fails on FreeBSD
by Pascal Christen 04 Dec '19

04 Dec '19

Hi I've just tried to build the latest Dovecot 2.3.9 on FreeBSD 11.3. Without success...It fails on the following commit which was introduced in 2.3.9: https://github.com/dovecot/core/commit/c85f1bc3ce612c736c9d2c468cc08306db1b… Following output is the build log: https://pastebin.com/3nvSeDn8 So I guess it has to do with some changes FreeBSD made: https://reviews.freebsd.org/D18630 What do you guys think? Greetings Pascal

4 10

dovecot sieve duplicates detection
by André Rodier 04 Dec '19

04 Dec '19

Hello, I have tested the sieve duplicate script with success so far, but I have a question. I would like to know if the "duplicate" sieve flag in Dovecot is global to all folders, or specific to one folder only. For instance, if I copy an email from one folder to another, and I have a discard action on duplicate email, is this action will be applied (in this case, discard) or not. If the duplicate is global to all folders, is there a way to restrict the search in one folder only. Thanks for your help. André

3 10

About "received" header when using Dovecot proxy
by ml＠riku22.net 04 Dec '19

04 Dec '19

Hello. My name is Riku. Currently, I use Dovecot as a proxy for another SMTP server. However, this seems to cause the IP address of the "received" header to be that of the proxy server. Is it possible to change this so that the IP address of the sender is entered? The version of Dovecot is "2.3.8 (9df20d2db)". Sorry for the incomprehensible explanation. Thank you. Best regards.

4 6

Environment variables in pgsql connect string
by Eirik Rye 04 Dec '19

04 Dec '19

Hi, We are trying to set up a Dovecot Docker image with dynamic database configuration based on environment variables, however the variables do not appear to be expanded in the "connect=" string of the SQL config. The documentation states that environment variables, being listed under global variables, work "everywhere": https://doc.dovecot.org/configuration_manual/config_file/config_variables/#… However, the source code for driver-pgsql.c indicates that the connect string is never expanded: https://github.com/dovecot/core/blob/master/src/lib-sql/driver-pgsql.c#L297 For reference, this is my configuration. dovecot.conf: import_environment = PASSDB_USER PASSDB_DBNAME PASSDB_PASSWORD passdb { override_fields = proxy=y driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } /etc/dovecot/dovecot-sql.conf.ext: driver = pgsql connect = host=mail-passdb dbname=%{env:PASSDB_DBNAME} user=%{env:PASSDB_USER} password=%{env:PASSDB_PASSWORD} Does anyone have any suggestions for how to connect to a database without hardcoding the connection parameters in the Dovecot config, which does not involve patching driver-pgsql.c to make the variable expansion? Best regards, Eirik Rye

2 1

some error about dovecot when compile
by Magiczero 04 Dec '19

04 Dec '19

when i build dovecot in my computer, something has occured like below: root@2030c8624e88:/dovecot-2.3.9# ./autogen.sh --2019-12-04 10:49:53-- https://www.dovecot.org/tmp/wiki2-export.tar.gz Resolving www.dovecot.org (www.dovecot.org) 94.237.12.234, 2a04:3545:1000:720:acc1:5bff:fe5e:4e9 Connecting to www.dovecot.org (www.dovecot.org)|94.237.12.234|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 446263 (436K) [application/x-gzip] Saving to: 'wiki2-export.tar.gz' wiki2-export.tar.gz 100%[===============================>] 435.80K 152KB/s in 2.9s 2019-12-04 10:49:59 (152 KB/s) - 'wiki2-export.tar.gz' saved [446263/446263] configure.ac:298: warning: macro 'AM_ICONV' not found in library libtoolize: putting auxiliary files in '.'. libtoolize: copying file './ltmain.sh' libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. libtoolize: copying file 'm4/libtool.m4' libtoolize: copying file 'm4/ltoptions.m4' libtoolize: copying file 'm4/ltsugar.m4' libtoolize: copying file 'm4/ltversion.m4' libtoolize: copying file 'm4/lt~obsolete.m4' configure.ac:298: warning: macro 'AM_ICONV' not found in library configure.ac:22: error: possibly undefined macro: AC_DEFINE If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. configure.ac:127: error: possibly undefined macro: dnl configure.ac:298: error: possibly undefined macro: AM_ICONV configure.ac:429: error: possibly undefined macro: AC_CHECK_HEADER configure:24018: error: possibly undefined macro: AC_CHECK_LIB configure:25593: error: possibly undefined macro: AC_CHECK_FUNC autoreconf: /usr/bin/autoconf failed with exit status: 1 from the information, i think the problem is macro 'AM_ICONV', there are any problem in the setup script? i want you help me to solve this issue. Thank you. Best MagicZero Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 2

Pigeonhole v0.5.9 released
by Aki Tuomi 04 Dec '19

04 Dec '19

Hi all! We are pleased to release v0.5.9 of Pigeonhole. Please find it from locations below --- Aki Tuomi Open-Xchange oy https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.9.ta… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.9.ta… Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- + Added events for Sieve and ManageSieve, see https://doc.dovecot.org/admin_manual/list_of_events/#pigeonhole + Pigeonhole: Implement the Sieve "special-use" extension described in RFC 8579. - duplicate: Test only compared the handles which would cause different values to be cached as the same duplicate test. Fix to also compare the actual hashes. - imap_sieve_filter: IMAP FILTER Command had various bugs in error handling. Errors may have been duplicated for each email, errors may have been missing entirely, command tag and ERRORS/WARNINGS parameters were swapped.

1 0

Fast searching from android device with Dovecot/Maildir
by John Gateley 03 Dec '19

03 Dec '19

Hello, I am using dovecot as an imap server, mail is stored in mail directories. Configuration is below. One mail directory has about 14 Gb of mail in the inbox and .Sent directories. Searching from an Android phone with gmail is slow or doesn't work (it times out). Is there a configuration for Dovecot that can improve this? A better e-mail client for Android? Thanks, John root@giraffe:~# dovecot --version 2.2.27 (c0f36b0) root@giraffe:~# doveconf -an # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 ... mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } ... protocols = " imap" ...

3 3

fts_solr and # char
by Marcio Merlone 03 Dec '19

03 Dec '19

Hi, Dovecot wiki says the solr url is something like 'solr/dovecot/' but this gives a 404, if I install solr as per the docs I have a 'solr/#/dovecot/' url: https://wiki.dovecot.org/Plugins/FTS/Solr I have installed dovecot 2.3 from https://repo.dovecot.org/ and solr 8.3 as per the wiki on a Ubuntu 18.04. The problem and the guess work I did: fts_solr = url=http://localhost:8983/solr/#/dovecot/ doveconf: Warning: Configuration file /etc/dovecot/conf.d/90-plugin.conf line 13: Ambiguous '#' character in line, treating it as comment. Add a space before it to remove this warning. fts_solr = url="http://localhost:8983/solr/#/dovecot/" Error: fts: Failed to initialize backend 'solr': fts_solr: Failed to parse HTTP url: Path component contains invalid character fts_solr = url='http://localhost:8983/solr/#/dovecot/' Error: fts: Failed to initialize backend 'solr': fts_solr: Failed to parse HTTP url: Relative HTTP URL not allowed fts_solr = url=http://localhost:8983/solr/%23/dovecot/ Error: Failed to expand plugin setting fts_solr = 'url=http://localhost:8983/solr/%23/dovecot/': Unknown variable '%/' fts_solr = 'url=http://localhost:8983/solr/#/dovecot/' fts_solr: Failed to parse HTTP url: URL fragment not allowed for HTTP URL in this context Thanks for any help. -- *Marcio Merlone=*

2 1

running dovecot under different user
by Marc Roos 02 Dec '19

02 Dec '19

Did anyone ever managed to run dovecot as a non-root user?

2 2

Running dovecot proxy as different user
by Marc Roos 02 Dec '19

02 Dec '19

I thought, I read somewhere I could prevent chroot with[1] but I am still getting chroot errors[2]. drwxrwxr-x 2 10053 101 6 Dec 2 16:54 empty drwxr-x--- 2 10053 101 73 Dec 2 17:00 login drwxr-x--- 2 10053 101 44 Dec 2 17:00 token-login [1] service anvil { chroot = } [2] Dec 2 17:07:07 c04 dovecot: stats: Fatal: chroot(/var/dovecot/empty) failed: Operation not permitted Dec 2 17:07:07 c04 dovecot: master: Error: service(stats): command startup failed, throttling for 16 secs Dec 2 17:07:07 c04 dovecot: pop3-login: Fatal: setgid(101(dovenull)) failed with euid=10053(dovecot), gid=10053(dovecot), egid=10053(dovecot): Operation not permitted (This binary should probably be called with process group set to 101(dovenull) instead of 10053(dovecot)) Dec 2 17:07:07 c04 dovecot: master: Error: service(pop3-login): command startup failed, throttling for 16 secs

1 0

Mail-crypt won't encrypt emails
by Serveria Support 02 Dec '19

02 Dec '19

Hi, (Reposting as my previous post got zero replies.) We're running Dovecot 2.2.36 and we need to set up the mail-crypt plugin to encrypt all incoming and outgoing emails. Outgoing emails seem to get encrypted fine but the incoming ones don't. We tried everything including this config: mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_plugins = $mail_plugins mail_crypt plugin { mail_crypt_global_private_key = <ecprivkey.pem mail_crypt_global_public_key = <ecpubkey.pem mail_crypt_save_version = 2 } also this one: plugin { mail_crypt_curve = prime256v1 mail_crypt_save_version = 2 } but to no avail. There are no visible errors, Dovecot restarts fine and outgoing emails get encrypted. Any ideas? -- Kind Regards, Support Team SERVERIA.COM Riga, LV-1063, Latvia US: +1 (213) 224-7938 LV: + (371) 22330032 Skype: bighostlv support(a)serveria.com www.serveria.com

3 2

Cert for ip range?
by Marc Roos 01 Dec '19

01 Dec '19

Is it possible to configure a network for a cert instead of an ip? Something like this: local 192.0.2.0 { ssl_cert = </etc/ssl/dovecot/imap-02.example.com.cert.pem ssl_key = </etc/ssl/dovecot/imap-02.example.com.key.pem } Or local 192.0.2.0/24 { ssl_cert = </etc/ssl/dovecot/imap-02.example.com.cert.pem ssl_key = </etc/ssl/dovecot/imap-02.example.com.key.pem } https://wiki.dovecot.org/SSL/DovecotConfiguration

3 5

Error: proxy: Remote returned invalid banner: 220
by Marc Roos 01 Dec '19

01 Dec '19

I had a working proxy setup added sieve to it, and out of the blue I get this Error: proxy: Remote returned invalid banner: 220 No idea what to do, nothing even in the mail list archive

2 3

dovecot: auth: Error: DNS lookup for xxx failed: Name does not resolve
by Marc Roos 01 Dec '19

01 Dec '19

I had a working container with dovecot configured as proxy. And all of a sudden I am getting these messages 'dovecot: auth: Error: DNS lookup for roosit03 failed: Name does not resolve' Pinging/nslookup these hostnames is ok

2 3

Proxy GSSAPI + PLAIN authentication
by Sam 30 Nov '19

30 Nov '19

Hi, I try to configure a proxy accepting GSSAPI and PLAIN authentication. When authenticating with Kerberos, Dovecot uses master user and password to authenticate to backends (backends can be Cyrus or Exchange servers too) When authenticating with PLAIN passwords, Dovecot sends user's login and password to the backend. For GSSAPI, I use extrafields : k5principals=principal@REALM proxy=Y pass=masterpassword login_user=principal user=masteruser host=backend For PLAIN, I use a static driver : passdb { driver = static args = proxy=y host=cyrus password=%w } I can authenticate fine with Kerberos tickets and login/password on the backend. Trouble is that if I authenticate with PLAIN login/password, with a user known from the passdb lookup made for GSSAPI, I can authenticate with any password, it is not checked. The passdb with masteruser and nopassword=y is checked. I can't restrict the passdb with the k5principals extrafield. I tried static and ldap drivers, with the same wrong behaviour. pass_attrs = \ =proxy=Y, \ =nopassword=Y, \ =pass=masterpassword, \ =login_user=%{ldap:uid}, \ =user=masteruser, \ =host=backend, \ =k5principals=%{ldap:uid}@REALM With the ldap driver, I've got auth_bind = no The user is found in the ldap, and Dovecot logs him with the masterpassword. If I don't configure an ldap passdb, but a userdb only, the proxy try passdb that comes after for PLAIN logins. With a passwd-file driver, the k5principals works fine. The user isn't found if it authenticates with PLAIN. My question is : is it possible to restrict a ldap or static passdb for GSSAPI mechanism only ? Thanks for your help, Regards, Sam

2 2

ESEARCH is announced but it doesn't work
by Jesus Cea 29 Nov '19

29 Nov '19

I am using Dovecot 2.3.4. I could upgrade if necessary. I see this capabilities after login in: """ a OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY SPECIAL-USE] Logged in """ ESEARCH (RFC 7377) seems to be available, but the command is not recognized: """ tag1 ESEARCH IN (mailboxes "folder1" subtree "folder2") unseen tag1 BAD Error in IMAP command ESEARCH: Unknown command (0.001 + 0.000 secs). """ What am I doing wrong? Thanks for your time and expertise. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

2 2

sendmail -> lmtp 501 5.6.0 Data format error
by Marc Roos 29 Nov '19

29 Nov '19

When changing in a working setup sendmail.mc From this MAILER(smtp)dnl MAILER(procmail)dnl To this FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl MAILER(local)dnl I am getting these errors '501 5.6.0 Data format error' and ' Unrecognized host name'. What should I change in my lmtp config? Could this be related that messages are being relayed from other servers? lmtp_address_translate = lmtp_hdr_delivery_address = final lmtp_proxy = no lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lmtp_user_concurrency_limit = 0

2 3

Using dovecot Replication in a medium to large enterprise.
by Brent Clark 28 Nov '19

28 Nov '19

Good day Guys Just wanted to pick the communities brain and experience(s) for a second. At $CORP where I work. My team has inherited a single server mail solution. We need to look to building a standby / replicated solution. One of the things we were looking at is https://wiki.dovecot.org/Replication We have in excess of +/- 500 mail boxes and using just under 1TB of disk space. That is a lot of small files. Reading about this plugin / module, things that stick out and is concerning is the comments: "The replication in general is a bit resource intensive, so it's not recommended to be used in multi-million user installations." "WARNING: Shared folder replication doesn't work correctly right now –" I would like to ask the community (and anyone else in a similar enterprise) how and if this solution works and scales. In short, I am asking, is anyone else using Dovecot Replication in a medium to large enterprise? Can you please share your experiences, pitfalls and if you have any tips managing mail replication. Kindest regards and thanks in advance. Brent Clark

4 3

IMAP Migration Tools
by Julian Kippels 28 Nov '19

28 Nov '19

Hi, I am looking for tools to migrate Mails from one IMAP-Server to another. Until now I have always used imapsync, but it seems very slow. Even over a 2x10GB/s connection I only get speeds of about 600KiB/s, because the programm always pauses betweeen every single mail. Does anyone here have a suggestion for an alternative? Thanks in advance Julian

6 5

Sendmail + lmtp
by Marc Roos 28 Nov '19

28 Nov '19

Is there any guide like this https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP for configuring sendmail?

1 0

Dovecot auth
by j.emerlik 27 Nov '19

27 Nov '19

Hi, is possible to configure post-login script for Service auth ? I would like to run post script after successful login to postfix (smtp). Regards, Jack

2 1

Dovecot FINs after sending "NO Not showing other users' quota"
by Gene Smith 27 Nov '19

27 Nov '19

When I do imap getquota on a shared folder I see the NO response. That's OK but then often dovecot disconnects (sends FIN) to the client right after this. The client acks the disconnect and creates a new connection and continues on. Should dovecot disconnect after this type of imap "NO" response? -gene

2 1

Performance mdbox vs mbox
by Marc Roos 26 Nov '19

26 Nov '19

If I do the same test[1] with mbox I can store around 31k messages and mdbox 16k messages. I noticed also that cpu and disk utilization with mdbox was not very high, while disk utilization on mbox was much higher. That makes me wonder if I can tune mdbox to have better performance? [1] imaptest - append=100,0 logout=0 host=svr port=143 user=test pass=xxx seed=100 secs=240 clients=1 mbox=64kb.mbox box=inbox/test [2] mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u:CONTROL=~/mail/control:INDEX=/var/d ovecot/%u/index:LAYOUT=maildir++ mail_location = mdbox:~/mdbox:INDEX=/home/popindex/%u/index - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. F1 Outsourcing Development Sp. z o.o. Poland t: +48 (0)124466845 f: +48 (0)124466843 e: marc(a)f1-outsourcing.eu

2 1

Dovecot Master User: Access user's mailbox without owner's password
by Dav Rdrz 26 Nov '19

26 Nov '19

Hi, I hope you're all right. I describe below the scenario where the problem occurs. I'm trying to activate a master user [1] to be able to access all the boxes of all users by imap. I have configured the dovecot-master-users [2] file with the appropriate permissions. When I try to access, for example with roundcube, through user@mydomain.com*my_master_user@not-exist.com I see in the log, that it seems to ignore the master-user (*) and tries to authenticate the Active Directory but with the master user's password. Then it shows in the log the messages auth: Info: ldap(user(a)mydomain.com,127.0.0.1,<6sFGXE6XLwB/AAAB> ) invalid credentials auth: Debug: client passdb out: FAIL 1 user=user(a)mydomain.com I have other test cases, but I need to validate the master user login that way. I would appreciate any comments you can make and I am waiting to answer any questions. Regards, [1] https://doc.dovecot.org/configuration_manual/authentication/master_users/ [2] https://docs.iredmail.org/dovecot.master.user.html --------------------------------------------------------------------------------------- root@mail-01:/etc/dovecot# cat /etc/issue Ubuntu 14.04.5 LTS \n \l root@mail-01:/etc/dovecot# dpkg -l | grep dovecot | awk {'print $2" "$3'} dovecot-core 1:2.2.9-1ubuntu2.6 dovecot-imapd 1:2.2.9-1ubuntu2.6 dovecot-ldap 1:2.2.9-1ubuntu2.6 dovecot-lmtpd 1:2.2.9-1ubuntu2.6 dovecot-managesieved 1:2.2.9-1ubuntu2.6 dovecot-mysql 1:2.2.9-1ubuntu2.6 dovecot-pop3d 1:2.2.9-1ubuntu2.6 dovecot-sieve 1:2.2.9-1ubuntu2.6 root@mail-01:/etc/dovecot# cat dovecot.conf | grep -v '#' | grep -v -e '^$' | sed "s/REALDOMAIN/mydomain/g" listen = * [::] mail_plugins = quota mailbox_alias acl protocols = pop3 imap sieve lmtp mail_uid = 2000 mail_gid = 2000 first_valid_uid = 2000 last_valid_uid = 2000 log_path = /var/log/dovecot.log auth_verbose = yes auth_debug = yes ssl_protocols = !SSLv2 !SSLv3 ssl = required verbose_ssl = no ssl_ca = </etc/ssl/certs/mydomain.com.ca-bundle ssl_cert = </etc/ssl/certs/mydomain.com.crt ssl_key = </etc/ssl/private/mydomain.com.key ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:ECDHE-RSA-DES-CBC3-SHA:ECDHE-ECDSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_prefer_server_ciphers = yes disable_plaintext_auth = no mail_location = maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/ auth_default_realm = mydomain.com auth_mechanisms = PLAIN LOGIN service auth { unix_listener /var/spool/postfix/private/dovecot-auth { user = postfix group = postfix mode = 0666 } unix_listener auth-master { user = vmail group = vmail mode = 0666 } unix_listener auth-userdb { user = vmail group = vmail mode = 0660 } } service lmtp { user = vmail process_min_avail = 5 executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { user = postfix group = postfix mode = 0600 } inet_listener lmtp { address = 127.0.0.1 port = 24 } } auth_master_user_separator = * passdb { driver = passwd-file args = /etc/dovecot/dovecot-master-users master = yes } userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { auth_socket_path = /var/run/dovecot/auth-master quota = dict:user::proxy::quotadict quota_rule = *:storage=3G quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_grace = 10%% acl = vfile acl_shared_dict = proxy::acl sieve_dir = %Lh/sieve sieve = %Lh/sieve/dovecot.sieve sieve_global_dir = /var/vmail/sieve sieve_before = /var/vmail/sieve/dovecot.sieve mailbox_alias_old = Sent mailbox_alias_new = Sent Messages mailbox_alias_old2 = Sent mailbox_alias_new2 = Sent Items } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { user = vmail group = vmail mode = 0660 } } service dict { unix_listener dict { mode = 0660 user = vmail group = vmail } } dict { quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf acl = mysql:/etc/dovecot/dovecot-share-folder.conf } protocol lda { mail_plugins = $mail_plugins sieve auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-sieve.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes postmaster_address = it(a)mydomain.com } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = quota sieve postmaster_address = postmaster lmtp_save_to_detail_mailbox = yes recipient_delimiter = + } protocol imap { mail_plugins = $mail_plugins imap_quota imap_acl imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 } protocol pop3 { mail_plugins = $mail_plugins pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv mail_max_userip_connections = 30 } service imap-login { service_count = 1 process_limit = 500 } service pop3-login { service_count = 1 } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } namespace { type = private separator = / prefix = inbox = yes mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Trash { auto = subscribe special_use = \Trash } mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Spam { auto = no special_use = \Junk } mailbox "Junk E-mail" { auto = no special_use = \Junk } mailbox Archive { auto = subscribe special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } } namespace { type = shared separator = / prefix = Shared/%%u/ location = maildir:%%Lh/Maildir/:INDEX=%%Lh/Maildir/Shared/%%u subscriptions = yes list = children } root@mail-01:/etc/dovecot# cat dovecot-ldap.conf | sed "s/realdomain/mydomain/g" hosts = active-directory:389 ldap_version = 3 auth_bind = yes dn = domain\vmail dnpass = Str0ngP4ssw0rd base = ou=Organizational Unit,dc=domain,dc=com scope = subtree deref = never user_filter = (&(userPrincipalName=%n@domain.com)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_filter = (&(userPrincipalName=%n@domain.com)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) #user_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) #pass_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_attrs = userPassword=password default_pass_scheme = CRYPT user_attrs = \ #=mail=master_user, \ #mail=user, \ =user=%Ln(a)mydomain.com, \ =home=/var/vmail/vmail1/mydomain.com/%Ln/Maildir/, \ =mail=maildir:/var/vmail/vmail1/mydomain.com/%Ln/Maildir/, \ maxStorage=quota_rule=*:bytes=%$ root@mail-01:/etc/dovecot# ls -al dovecot-master-users -r-x------ 1 dovecot dovecot 120 Nov 13 14:45 dovecot-master-users

3 3

Shared Mailboxes
by Yousif Alkhateeb 26 Nov '19

26 Nov '19

Hello, I have a mail server linked to Freeipa server, so all users are UNIX users. i want to share the inbox of one user to another, but i can't figure it out how to do it. this is my dovecot -n output # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.8 (b7b03ba2) # OS: Linux 3.10.0-957.21.3.el7.x86_64 x86_64 CentOS Linux release 7.6.1810 (Core) xfs # Hostname: mail.yousifrrr.com doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem auth_default_realm = YOUSIFRR.COM auth_username_format = %n auth_worker_max_count = 60 default_client_limit = 10000 default_process_limit = 1500 disable_plaintext_auth = no first_valid_uid = 1000 login_trusted_networks = 10.1.5.0/24 mail_access_groups = sharedusers mail_location = maildir:/MailUsers/%u mail_plugins = acl mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl metric imap_select_no { event_name = imap_command_finished fields = name filter { name = SELECT tagged_reply_state = NO } } namespace { list = yes location = maildir:/MailUsers/%u:INDEXPVT=/Mailusers/%u/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { driver = pam } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db sieve = /MailUsers/%u/default.sieve sieve_before = /etc/dovecot/default.sieve sieve_default = /etc/dovecot/sieve/default.sieve sieve_dir = /MailUsers/%u/sieve/ sieve_global_dir = /etc/dovecot/default.sieve } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh protocols = imap pop3 lmtp sieve service dict { unix_listener dict { group = dovecot mode = 01402 user = dovecot } } service imap-login { inet_listener imap { port = 143 } } service imap { vsz_limit = 512 M } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { inet_listener pop3 { port = 0 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_plugins = acl imap_acl } the shared folder is not appearing in the users mailboxes. can you please help figure out why it's not working. Thanks in advance.

1 0

Health check curl example
by Marc Roos 25 Nov '19

25 Nov '19

I am not understanding how this health check[1] script should work. From the commandline it works fine when I type a PING I get a PONG. But how do I do a curl to this 5001 port? Tried something like this: bash-5.0# curl http://localhost:5001/ curl: (56) Recv failure: Connection reset by peer bash-5.0# curl http://localhost:5001/PING curl: (56) Recv failure: Connection reset by peer [1] https://doc.dovecot.org/admin_manual/health_check/

3 11

Lmtp logging, does not log
by Marc Roos 25 Nov '19

25 Nov '19

Looks like dovecot is not sending stuff to syslog anymore I am getting some message in /tmp/dovecot.log. However the lmtp log files are not even created. bash-5.0# doveconf | grep log_ auth_policy_log_only = no debug_log_path = deliver_log_format = msgid=%m: %$ doveadm_http_rawlog_dir = imapc_rawlog_dir = info_log_path = lmtp_proxy_rawlog_dir = /tmp/lmtp-proxy.log lmtp_rawlog_dir = /tmp/lmtp.log log_core_filter = log_debug = log_path = /tmp/dovecot.log log_timestamp = "%b %d %H:%M:%S " login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> mail_index_log_rotate_max_size = 1 M mail_index_log_rotate_min_age = 5 mins mail_index_log_rotate_min_size = 32 k mail_index_rewrite_max_log_bytes = 128 k mail_index_rewrite_min_log_bytes = 8 k mail_log_prefix = "%s(%u)<%{pid}><%{session}>: " pop3c_rawlog_dir = rawlog_dir = submission_relay_rawlog_dir = syslog_facility = mail

1 0

proxy dual server setup clarification
by Marc Roos 25 Nov '19

25 Nov '19

I want to migrate mail users to a new environment. If I setup a new server next to the old server, and enable proxy on both. Is this then enough to migrate user by user with the passdb host=newsvr option to the new environment? Eg. I do not need to configure a director setup? I only need to enable proxy for imap and lmtp on both servers? (messages on the oldsvr will be proxied to the newsvr?)

2 2

Lmtp proxy help assertion failed: (conn->remote_port != 0
by Marc Roos 24 Nov '19

24 Nov '19

I have this in my 20-lmtp.conf file and created passdb-file, this should be enough to route a message to svr1? The port 24 is reachable from the proxy. bash-5.0# cat 20-lmtp.conf lmtp_proxy = yes protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). passdb { driver = passwd-file args = /etc/dovecot/special-passdb default_fields = proxy=y host=svr1 } } bash-5.0# cat /etc/dovecot/special-passdb test:password:1000:1000:(gecos):home:/bin/false:host=svr1

1 0

[Sieve] Multiple email recipients, how?
by Robert 24 Nov '19

24 Nov '19

Hi, First, I am very new to using Pigeonhole/Sieve with Dovecot and I am struggling with a problem which could be easy to solve but is just a lack of understanding on my end... We use a simple system for routing emails to different email users by postfixing the addresses with the actual user: xxxJohn@domain; yyyJohn@domain etc all will be delivered to user John. (This way John can invent a new email address on-the-fly and that will be delivered to his email box.) Delivering these emails to the right mailbox is easy: if address :contains "to" "John" ... All mail not matched will go to the general (catchall) mail box. The problem occurs when the email is sent to more addresses at the same domain. Eg. if an email is sent to xxxJohn@domain, zzzAlex@domain and info@domain Either, all emails also end up in the catch-all, or the email is delivered to the first matching rule only. I do not understand how to use the different TO addresses in the match rules. How can I determine that there are recipients other than xxxJohn or zzzAlex? Any help in pointing me in the right direction is appreciated! Robert

5 10

Virtual mailboxes: errors after renaming a folder
by André Rodier 24 Nov '19

24 Nov '19

Hello, I have a dovecot server, running fine, on Debian Stretch. Virtual folders are set up, and works correctly. For instance, I have Unread, All and Conversations, and everything works fine. However, when I rename a folder, I have error messages from Dovecot. For instance, I had a folder INBOX/Bills, which I renamed INBOX/Invoices. After that, I have these error messages: > The reported error was “Failed to select mailbox: Backend mailbox INBOX/Bills' added by another session. Reopen the virtual mailbox. (for backend mailbox Search/All) (0.000 + 0.000 secs).”. How can I avoid these errors, for instance, how can I rebuild the indexes every night or so? Kind regards, André

1 0

Dovecot proxy with ldap, complains about 'host not given'
by Marc Roos 24 Nov '19

24 Nov '19

It looks like the dovecot proxy can authenticate correctly but fails then on with this message Nov 23 23:33:33 test2 dovecot: pop3-login: Error: proxy: host not given: user=<test>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured, session=<LDTlHguYJth/AAAB> I have configured a host= in ldap for this user

3 4

chown(/var/dovecot/login/ipc-proxy
by Marc Roos 22 Nov '19

22 Nov '19

Can we remove/change this in the source? So we do not have to add the CAP_CHOWN with containers. chown(/var/dovecot/login/ipc-proxy) When run as root this has user dovenull, maybe this can be resolved by using a group dovenull? bash-5.0# ls -arlt total 4 srw-rw-rw- 1 root root 0 Nov 21 22:27 pop3 srw-rw-rw- 1 root root 0 Nov 21 22:27 login srw------- 1 dovenull root 0 Nov 21 22:27 ipc-proxy srw-rw-rw- 1 root root 0 Nov 21 22:27 imap drwxr-xr-x 1 dovecot dovecot 4096 Nov 21 22:27 .. drwxr-x--- 1 root dovenull 60 Nov 21 22:27 . Maybe this would work srw-rw---- 1 root dovenull 0 Nov 21 22:27 ipc-proxy

1 1

Virtual folder auto creation
by sergio 22 Nov '19

22 Nov '19

After switching on Virtual Plugin and configuring it as specified on https://doc.dovecot.org/configuration_manual/virtual_plugin/ the virtual folder is created for each user. Is it possible do not creater virtual folder automatically, only manually, for specific users? lda_mailbox_autocreate set to yes, but hope it's not related. -- sergio.

3 3

Lost quota, maildirsize with value S0
by grupodecorreo10 21 Nov '19

21 Nov '19

Hi,We have installed dovecot 2.2.22. we have servers as director dovecot and servers as dovecot backend. The mailboxes are estored in maildir format, over nfs (Emc Isilon).The problem we have is that sometimes some aleatory users loss her quota and the maildirsze show ilimited cuota, with S0 value in maildirsive file.The mails are stored in the mailboxes with maildrop and postfix, but we have done some test with postfix stoped. Only Dovecot openning the mailbox and the maildirsize is corrupted.I do not known where to look. We have configured dovecot with all the recomendarions for nfs.Thank you

1 0

virtual folder index logs
by sergio 21 Nov '19

21 Nov '19

A virtual folder is just really a saved search, but index log files are created. dovecot.list.index.log for the virtual folder itself and dovecot.index.log for all subfolders. Is it correct? Is it possible to disable index logs for virtual folder or it will only make dovecot worse? -- sergio.

1 0

Dovecot can't log in Virtual user - please help
by Andrej Rehak 20 Nov '19

20 Nov '19

Hello Im having issues login to dovecot using imap through telnet. Im running Linux 4.9.0-11-amd64 #1 SMP Debian 4.9.189-3+deb9u1 (2019-09-20) x86_64 GNU/Linux Im totally new to setting up mailservers. I havesetup a postfix for SMTP and it can receive emails. Postfix version is mail_version = 3.1.12 I have also installed Dovecot version:2.2.27 (c0f36b0) My configuration is such that POSTFIX is configured to use DOVECOT SASL through local socket. My system is configured to store emails in /var/mail/owndomain.org/<username>. For each domain i have my own passwd file where dovecot is supposed to lookup usernames and passwords. /var/mail/owndomain.org/passwd. I have created virtualuser for accessing mails and authenticating users. My dovecot (dovecot -n output) configuration is: ------------------------------------------------------------- # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log listen = 192.168.2.2 log_path = /var/log/dovecot.log mail_home = /var/mail/home/%d/%n mail_location = mbox:~/mail:INBOX=/var/spool/mail/%d/%n mail_privileged_group = virtualmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = username_format=%n /var/mail/%d/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = dovecot } ssl = no userdb { driver = passwd } userdb { args = username_format=%n /var/mail/%d/passwd default_fields = uid=virtualmail gid=virtualmail home=/var/mail/%d/%n driver = passwd-file } verbose_proctitle = yes ---------------------------------------- Now the problem: I was testing the configuration using telnet. POSTFIX receives email, stores it. No problem. When i tried to log in onto Dovecot IMAP using Telnet i get this message: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH-LOGIN] Dovecot ready. a login "username(a)owndomain.org" "test" a NO [UNAVAILABLE] Internal error occured. Refer to server log for more information. I have enabled verbose logging and this is the output of logs: /var/log/dovecot.log had this message: Nov 16 14:20:49 auth: Error: plain(username(a)owndomain.org,192.168.9.131,<RF4llXaXisPAqAmD>): user not found from any userdbs Nov 16 14:20:49 imap: Error: Authenticated user not found from userdb, auth lookup id=684589057 (client-pid=9601 client-id=1) /var/log/dovecot-debug.log had this message: Nov 16 14:20:18 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Nov 16 14:20:18 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Nov 16 14:20:18 auth: Debug: auth client connected (pid=9601) Nov 16 14:20:47 auth: Debug: client in: AUTH 1 PLAIN service=imap session=RF4llXaXisPAqAmD lip=192.168.2.2 rip=192.168.9.131 lport=143 rport=$ Nov 16 14:20:47 auth-worker(9603): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Nov 16 14:20:47 auth-worker(9603): Debug: pam(username(a)owndomain.org,192.168.9.131,<RF4llXaXisPAqAmD>): lookup service=dovecot Nov 16 14:20:47 auth-worker(9603): Debug: pam(username(a)owndomain.org,192.168.9.131,<RF4llXaXisPAqAmD>): #1/1 style=1 msg=Password: Nov 16 14:20:49 auth: Debug: passwd-file /var/mail/owndomain.org/passwd: Read 2 users in 0 secs Nov 16 14:20:49 auth: Debug: passwd-file(username(a)owndomain.org,192.168.9.131,<RF4llXaXisPAqAmD>): lookup: user=username file=/var/mail/owndomain.org/passwd Nov 16 14:20:49 auth: Debug: client passdb out: OK 1 user=username(a)owndomain.org Nov 16 14:20:49 auth: Debug: master in: REQUEST 684589057 9601 1 a61dd67ee43390596ddf86e6c08db6f9 session_pid=9604 request_auth_token Nov 16 14:20:49 auth-worker(9603): Debug: passwd(username(a)owndomain.org,192.168.9.131,<RF4llXaXisPAqAmD>): lookup Nov 16 14:20:49 auth: Debug: passwd-file(username(a)owndomain.org,192.168.9.131,<RF4llXaXisPAqAmD>): lookup: user=username file=/var/mail/owndomain.org/passwd Nov 16 14:20:49 auth: Debug: master userdb out: NOTFOUND 684589057 And i am completelly clueless what is the problem. Because it seems as if the password was found but the user is not? Password and user are looked up in the same passwd file. Have i forgotten something to setup? Any help or guidance is appreciated! I have also posted the issue on: https://serverfault.com/questions/992108/dovecot-cant-login-virtual-user Thanks A.

2 3

ios12 clients not getting correct certificate, sni supported not? or config error?
by Marc Roos 20 Nov '19

20 Nov '19

I am having an ios12.4.1 client whine about access problems. He is getting the 'default' self signed ceritificate instead of the hostname alias. openssl s_client -servername mail.xxxxx.com -connect x.x.x.x:pop3s gives a 'Verify return code: 0 (ok)' I can't imagine this sni support is not available in recent versions. Should I remove this default certificate in the main section of 10-ssl.conf? These lines I have added to 10-ssl.conf ssl_cert = </etc/pki/tls/certs/mail-wildcard.crt ssl_key = </etc/pki/tls/private/mail-wildcard.key local 192.168.10.43 { ssl_key = </etc/pki/tls/private/xxxxxxx.local.key ssl_cert = </etc/pki/tls/certs/xxxxxxx.local.crt } local_name mail.xxxxx.com { ssl_key = </etc/pki/tls/private/mail.xxxxx.com.key ssl_cert = </etc/pki/tls/certs/mail.xxxxx.com.crt } local_name imap.xxxxxxx.net { ssl_key = </etc/pki/tls/private/imap.xxxxxxx.net.key ssl_cert = </etc/pki/tls/certs/imap.xxxxxxx.net.crt } [@ conf.d]# doveconf | egrep 'ssl_cert|ssl_key' ssl_cert = </etc/pki/tls/certs/mail-wildcard.crt ssl_cert_username_field = commonName ssl_key = # hidden, use -P to show it ssl_key_password = ssl_cert = </etc/pki/tls/certs/xxxxxxx.local.crt ssl_key = # hidden, use -P to show it ssl_cert = </etc/pki/tls/certs/mail.xxxxx.com.crt ssl_key = # hidden, use -P to show it ssl_cert = </etc/pki/tls/certs/imap.xxxxxxx.net.crt ssl_key = # hidden, use -P to show it

1 0

Error: Raw backtrace and index cache
by Maciej Milaszewski IQ PL 20 Nov '19

20 Nov '19

Hi I have "problem" with dovect 2.2.13 from repo debian8 and I don't know how to solve it ... Server is a virtual (kvm) with debian 8.11 (postfix + dovecot from repo) and storage is mounting via nfs (I have use only one dovecot with external storage) All works fine but sometime ( after a few hours ) I have got a problem with dovecot cache (i use indexes) logs -> http://paste.debian.net/1117072/ The store is mounted via nfs in /home/ index is local in /var/dovecot_indexes%h All go back to normal when i remove indexes like: find /var/dovecot_indexes/home/ -name 'dovecot*' -type f -delete but this is not good solution What am I doing wrong ? For tunning nfs in 10-mail.conf: --------- "mail_location = maildir:~/Maildir:INDEX=/var/dovecot_indexes%h namespace inbox { inbox = yes } mmap_disable = yes dotlock_use_excl = no mail_fsync = always mail_nfs_storage = no mail_nfs_index = no lock_method = fcntl mail_temp_dir = /tmp mail_plugins = quota expire notify mail_log mailbox_idle_check_interval = 30 secs mail_temp_scan_interval = 1w maildir_very_dirty_syncs = no ------------- doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-9-amd64 x86_64 Debian 8.11 auth_mechanisms = plain login disable_plaintext_auth = no dotlock_use_excl = no lda_original_recipient_header = X-Original-To log_path = /var/log/dovecot/dovecot.mail133 mail_fsync = always mail_location = maildir:~/Maildir:INDEX=/var/dovecot_indexes%h mail_plugins = quota expire notify mail_log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/dovecot.sieve sieve_default = /var/lib/dovecot/sieve/default.sieve sieve_dir = %h/sieve sieve_global_dir = /var/lib/dovecot/sieve/ } protocols = " imap lmtp sieve pop3" service auth { unix_listener auth-master { group = users mode = 0666 user = virtual } unix_listener auth-userdb { group = users user = virtual } } service lmtp { inet_listener lmtp { port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = virtual } service managesieve-login { inet_listener sieve { address = 127.0.0.1 94.124.15.58 port = 4190 } } ssl_ca = /etc/postfix/ssl/mail.maximail.pl.pem ssl_cert = </etc/postfix/ssl/mail.maximail.pl.pem ssl_key = </etc/postfix/ssl/mail.maximail.pl.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { info_log_path = /var/log/dovecot/dovecot.mali133 lmtp_save_to_detail_mailbox = yes mail_plugins = quota sieve notify push_notification } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_mailbox_autocreate = yes log_path = /var/log/dovecot/dovecot-lda.mail133 mail_plugins = sieve postmaster_address = root }

2 4

Junk virtual forder
by sergio 20 Nov '19

20 Nov '19

Is it possible to create a virtual folder that selects all mails with imap Junk flag (set by pigeonhole imap4flags' setflag "Junk")? -- sergio.

3 4

Doveadm replicator ssl issues
by Miro Igov 20 Nov '19

20 Nov '19

Hello, I have 2 Dovecot 2.3.8 servers running SSL with valid wildcard certificates. Email clients connect fine, https://www.immuniweb.com/ssl/ tests show certificates are ok. However I can't make replication work when I add ssl = yes. Without ssl it works ok. I added verbose_ssl in config and error log shows: dovecot: doveadm(149.x.x.x): Error: SSL handshake failed: SSL_accept() failed: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol >From the other server 149.x.x.x I tested with openssl: openssl s_client -connect 188.x.x.x:12333 -crlf -CAfile /etc/pki/tls/cert.pem CONNECTED(00000003) depth=2 C = US, ST = New Jersey, L = Jersey City, O = The USERTRUST Network, CN = USERTrust RSA Certification Authority verify return:1 depth=1 C = GB, ST = Greater Manchester, L = Salford, O = Sectigo Limited, CN = Sectigo RSA Organization Validation Secure Server CA verify return:1 depth=0 C = FR, postalCode = 34980, ST = Occitanie, L = Montpellier, street = 123 Main str, O = My Company, OU = PremiumSSL Wildcard, CN = *.domain.com verify return:1 . . SSL-Session: Protocol : TLSv1.2 Cipher : ECDHE-RSA-AES256-SHA384 Session-ID: 95CF7F07702A50CB7CDC5D478986B5A4682EA945C487E770550EE48BFEA53EBC Session-ID-ctx: Master-Key: ECC14F2EE03C04474992A651B3695D78A27A0B07529DB35F61F6FB5F5A5D51395432BDFF37F2 41BD4B3C4B9E1AB6A929 Key-Arg : None Krb5 Principal: None PSK identity: None PSK identity hint: None Start Time: 1574108251 Timeout : 300 (sec) Verify return code: 0 (ok) The configuration of the 2 servers below. 188.x.x.x # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.8 (b7b03ba2) # OS: Linux 2.6.32-754.6.3.el6.x86_64 x86_64 CentOS release 6.10 (Final) # Hostname: login.domain.com default_vsz_limit = 512 M doveadm_password = # hidden, use -P to show it mail_plugins = " notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { mail_replica = tcp:149.x.x.x:12333 sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap pop3 replication_full_sync_interval = 10 mins service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service doveadm { inet_listener { port = 12333 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/dovecot/ssl_chain.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:HIGH:MEDIUM:+TLSv1:+TLSv 1.1:+TLSv1.2:!RC4:!IDEA:!3DES:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!A ESGCM:!CAMELLIA:!SEED ssl_client_ca_file = /etc/pki/tls/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } verbose_ssl = yes local 91.x.x.x { protocol imap { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } local 91.x.x.x { protocol pop3 { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } 149.x.x.x # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-754.6.3.el6.x86_64 x86_64 CentOS release 6.10 (Final) # Hostname: prime.domain.com auth_mechanisms = plain login default_vsz_limit = 1 G disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it mail_location = maildir:~/Maildir mail_plugins = " notify replication" mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = session=yes setcred=yes failure_show_msg=yes dovecot driver = pam } plugin { mail_replica = tcp:188.x.x.x:12333 } protocols = imap pop3 replication_full_sync_interval = 10 mins replication_max_conns = 11 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service doveadm { inet_listener { port = 12333 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/dovecot/ssl_chain.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:HIGH:MEDIUM:+TLSv1:+TLSv 1.1:+TLSv1.2:!RC4:!IDEA:!3DES:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!A ESGCM:!CAMELLIA:!SEED ssl_client_ca_file = /etc/pki/tls/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } local 178.x.x.x { protocol imap { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } local 178.x.x.x { protocol pop3 { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } Your help will be great appreciated.

2 2

[SOLVED] Doveadm replicator ssl issues
by Miro Igov 20 Nov '19

20 Nov '19

Solved, thank you. TCPS was the issue. From: Aki Tuomi <aki.tuomi(a)open-xchange.com> Sent: Wednesday, November 20, 2019 08:54 To: Miro Igov <miro.igov(a)gmail.com>; dovecot(a)dovecot.org Subject: Re: Doveadm replicator ssl issues On 18.11.2019 22.30, Miro Igov via dovecot wrote: Hello, I have 2 Dovecot 2.3.8 servers running SSL with valid wildcard certificates. Email clients connect fine, https://www.immuniweb.com/ssl/ tests show certificates are ok. However I can't make replication work when I add ssl = yes. Without ssl it works ok. I added verbose_ssl in config and error log shows: dovecot: doveadm(149.x.x.x): Error: SSL handshake failed: SSL_accept() failed: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol >From the other server 149.x.x.x I tested with openssl: openssl s_client -connect 188.x.x.x:12333 -crlf -CAfile /etc/pki/tls/cert.pem CONNECTED(00000003) depth=2 C = US, ST = New Jersey, L = Jersey City, O = The USERTRUST Network, CN = USERTrust RSA Certification Authority verify return:1 depth=1 C = GB, ST = Greater Manchester, L = Salford, O = Sectigo Limited, CN = Sectigo RSA Organization Validation Secure Server CA verify return:1 depth=0 C = FR, postalCode = 34980, ST = Occitanie, L = Montpellier, street = 123 Main str, O = My Company, OU = PremiumSSL Wildcard, CN = *.domain.com verify return:1 . . SSL-Session: Protocol : TLSv1.2 Cipher : ECDHE-RSA-AES256-SHA384 Session-ID: 95CF7F07702A50CB7CDC5D478986B5A4682EA945C487E770550EE48BFEA53EBC Session-ID-ctx: Master-Key: ECC14F2EE03C04474992A651B3695D78A27A0B07529DB35F61F6FB5F5A5D51395432BDFF37F2 41BD4B3C4B9E1AB6A929 Key-Arg : None Krb5 Principal: None PSK identity: None PSK identity hint: None Start Time: 1574108251 Timeout : 300 (sec) Verify return code: 0 (ok) The configuration of the 2 servers below. 188.x.x.x # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.8 (b7b03ba2) # OS: Linux 2.6.32-754.6.3.el6.x86_64 x86_64 CentOS release 6.10 (Final) # Hostname: login.domain.com default_vsz_limit = 512 M doveadm_password = # hidden, use -P to show it mail_plugins = " notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { mail_replica = tcp:149.x.x.x:12333 sieve = file:~/sieve;active=~/.dovecot.sieve <file://~/sieve;active=~/.dovecot.sieve> } protocols = imap pop3 replication_full_sync_interval = 10 mins service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service doveadm { inet_listener { port = 12333 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/dovecot/ssl_chain.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:HIGH:MEDIUM:+TLSv1:+TLSv 1.1:+TLSv1.2:!RC4:!IDEA:!3DES:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!A ESGCM:!CAMELLIA:!SEED ssl_client_ca_file = /etc/pki/tls/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } verbose_ssl = yes local 91.x.x.x { protocol imap { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } local 91.x.x.x { protocol pop3 { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } 149.x.x.x # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-754.6.3.el6.x86_64 x86_64 CentOS release 6.10 (Final) # Hostname: prime.domain.com auth_mechanisms = plain login default_vsz_limit = 1 G disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it mail_location = maildir:~/Maildir mail_plugins = " notify replication" mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = session=yes setcred=yes failure_show_msg=yes dovecot driver = pam } plugin { mail_replica = tcp:188.x.x.x:12333 } protocols = imap pop3 replication_full_sync_interval = 10 mins replication_max_conns = 11 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service doveadm { inet_listener { port = 12333 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/dovecot/ssl_chain.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:HIGH:MEDIUM:+TLSv1:+TLSv 1.1:+TLSv1.2:!RC4:!IDEA:!3DES:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!A ESGCM:!CAMELLIA:!SEED ssl_client_ca_file = /etc/pki/tls/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } local 178.x.x.x { protocol imap { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } local 178.x.x.x { protocol pop3 { ssl_cert = </etc/dovecot/ssl_chain.pem ssl_key = # hidden, use -P to show it } } Hi! You need to use tcps in mail_replica. Aki

1 0

[SOLVED] Doveadm replicator ssl issues
by Miro Igov 20 Nov '19

20 Nov '19

Solved, thank you! TCPS was the problem. Hi! You need to use tcps in mail_replica. Aki

1 0

http API for IMAP
by Thomas Güttler 20 Nov '19

20 Nov '19

10 22

Panic: file smtp-client-connection.c: line 1142 (smtp_client_connection_established)
by Dirk 20 Nov '19

20 Nov '19

I'm using dovecot in a multi server setup. Two directors forward pop3, imap and smtp to backend dovecots with their central storage on NFS. Yesterday I stumbled upon these log lines: 2019-11-18 20:17:51 lmtp(17274): Info: Connect from 172.22.1.6 2019-11-18 20:17:51 lmtp(17274): Panic: file smtp-client-connection.c: line 1142 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded) 2019-11-18 20:17:51 lmtp(17274): Fatal: master: service(lmtp): child 17274 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set /proc/sys/fs/suid_dumpable to 2) Is a core dump required to find the source of that error? Thanks for any help! $ doveconf -n # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # OS: Linux 4.9.0-8-amd64 x86_64 # Hostname: m03.company.com auth_cache_negative_ttl = 65 secs auth_cache_ttl = 3 mins auth_cache_verify_password_with_worker = yes auth_mechanisms = plain login auth_verbose = yes debug_log_path = /dev/stdout default_client_limit = 10400 default_process_limit = 1024 default_vsz_limit = 1 G deliver_log_format = msgid=%m: %s %{session_time} %$ director_mail_servers = 10.10.10.2 10.10.10.3 director_servers = 10.10.1.2 10.10.1.3 imap_id_log = * imap_max_line_length = 2 M import_environment = TZ CORE_OUTOFMEM CORE_ERROR info_log_path = /dev/stdout instance_name = dovecot_director listen = 10.10.1.3,:: lmtp_proxy = yes log_path = /dev/stderr log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k session=<%{session}> mail_max_userip_connections = 250 passdb { args = /etc/dovecot/sql/dovecot-dict-sql-passdb.conf driver = sql result_failure = return-fail result_internalfail = return-fail result_success = continue-ok } passdb { args = proxy=y starttls=any-cert master=director(a)m03.company.com pass=#hidden_use-P_to_show# nopassword=y driver = static skip = unauthenticated } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, uidl=%u protocols = imap lmtp pop3 service auth-worker { user = $default_internal_user } service director { fifo_listener login/proxy-notify { mode = 0600 user = $default_login_user } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 user = vmail } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director process_min_avail = 2 vsz_limit = 1 G } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 2 unix_listener lmtp { mode = 00 } user = vmail vsz_limit = 1 G } service log { user = dovenull } service pop3-login { executable = pop3-login director process_min_avail = 2 vsz_limit = 1 G } service pop3 { user = vmail } ssl_cert = </etc/ssl/mail/cert.pem ssl_client_ca_dir = /etc/ssl/certs/ ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = postfix:588 protocol lmtp { auth_socket_path = director-userdb }

2 1

Sieve and recipient_delimiter
by ＠lbutlr 17 Nov '19

17 Nov '19

I use recipient_delimiter addresseses quiet a bit, and I want to put several of them into a mailbox if anyof (header :contains ["to"] [ “FOO", “foo", “bar", “florin"]) { fileinto :create “later"; stop; } When I get an email addressed to me+FOO(a)example.com or me_florin(a)example.com, the messages end up in my inbox (Yes, I have both + and _ defined as delimiters in postfix and in dovecot). Is this because sieve is not seeing the delimiter? I am wondering this because I have another rule that seems to be working fine that is largely the same, but operates on domains: if anyof ( header :contains ["From"] [“kreme.com", “localdomain1.tld”, "localdomain2.tld", "localdomain3.tld", “covisp.net” ]){ fileinto :create "priority"; } -- She'd always tried to face towards the light. But the harder you stared into the brightness the harsher it burned into you until, at last, the temptation picked you up and bid you turn around to see how long, rich, strong and dark, streaming away behind you, your shadow had become- --Carpe Jugulum

2 2

Auto expunge log
by Michael Ludwig 16 Nov '19

16 Nov '19

Hi, I'm just setting up a new dovecot system and wonder why I get this error. On another dovecot system this works with no problems. Log entry when exiting MUA Thunderbird: =========================== Nov 16 20:16:35 myhostname dovecot: imap(info(a)mydomain.de): Error: autoexpunge: Couldn't create dovecot.autoexpunge.lock lock: file_create_locked(/var/mail/vmail/mydomain.de/info//dovecot.autoexpunge.lock) failed: safe_mkstemp(/var/mail/vmail/mydomain.de/info//dovecot.autoexpunge.lock) failed: No such file or directory =========================== Is this double slash between /info//dovecot.auto... okay? I believe there should be a "Mailbox" in between? Configuration in /etc/dovecot/conf.d/15-mailboxed.conf =========================== namespace inbox { mailbox Junk { auto = subscribe special_use = \Junk autoexpunge = 90d } =========================== Maybe you can help me a bit. ;-) Michael

2 1

Feature request: ssl-cert config
by Marc Roos 16 Nov '19

16 Nov '19

I am not sure why this </ is used in the configuration. But I hoped it would concatenate the ssl_cert to have multiple certificates. So one could use it multiple times, as needed. It would be nice to be able to specify the intermediate certificate (bundle) separate from the certificate, so when updating the certificate I just have to replace this file. Something like local_name mail.xxxxxx.xxx { ssl_key = </etc/pki/tls/private/mail.xxxxxx.xxx.key ssl_cert = </etc/pki/tls/certs/mail.xxxxxx.xxx.crt ssl_cert = </etc/pki/tls/certs/SectigoIntermediate.crt } Or local_name mail.xxxxxx.xxx { ssl_key = </etc/pki/tls/private/mail.xxxxxx.xxx.key ssl_cert = </etc/pki/tls/certs/mail.xxxxxx.xxx.crt ssl_int = </etc/pki/tls/certs/SectigoIntermediate.crt } dovecot-2.2.36-3.el7_7.1.x86_64

1 0

SCRAM-SHA-1-PLUS / SCRAM-SHA-224(-PLUS) / SCRAM-SHA-256(-PLUS), SCRAM-SHA-384(-PLUS) and SCRAM-SHA-512(-PLUS) supports
by - Neustradamus - 15 Nov '19

15 Nov '19

Dear all, I send you a new email to know what is the progress of SCRAM-SHA-***(-PLUS) supports? Currently there is only SCRAM-SHA-1: https://doc.dovecot.org/configuration_manual/authentication/password_scheme…. - RFC6331: Moving DIGEST-MD5 to Historic: https://tools.ietf.org/html/rfc6331 - RFC5802: Salted Challenge Response Authentication Mechanism (SCRAM) SASL and GSS-API Mechanisms: https://tools.ietf.org/html/rfc5802 - RFC7677: SCRAM-SHA-256 and SCRAM-SHA-256-PLUS Simple Authentication and Security Layer (SASL) Mechanisms: https://tools.ietf.org/html/rfc7677 - since 2015-11-02 I have seen several months ago, commits about SCRAM-SHA-256. For your information, Cyrus SASL supports: - SCRAM-SHA-1(-PLUS) - SCRAM-SHA-224(-PLUS) - SCRAM-SHA-256(-PLUS) - SCRAM-SHA-384(-PLUS) - SCRAM-SHA-512(-PLUS) -> https://cyrusimap.org/sasl/sasl/authentication_mechanisms.html You can see more and more informations here: https://github.com/scram-xmpp/info/issues/1 Thanks in advance. Regards, Neustradamus

1 0

ACL's with SQL/from mysql table
by Jorge Bastos 15 Nov '19

15 Nov '19

Howdy, Would someone point me to a good howto on how to implement ACL from an sql table? Thanks in advanced,

1 0

IMAP4 extensions for Visual Voicemail (VVM)
by Rajesh Bansal 15 Nov '19

15 Nov '19

Hi Team, I need to develop Visual VoiceMail solution. In this solution I need a IMAP4 server, from which I can get a hit for each mail retrieval. Can anyone help me if dovecot can be used for this purpose. BR, Rajesh Bansal

5 5

SASL AUTH with postfix
by Jorge Bastos 15 Nov '19

15 Nov '19

Hi, I just moved from Cyrus SASL to Dovecot SASL, with postfix. Works great, and no issue with non-ascii chars, has i had with Cyrus. With Cyrus i was getting the username/passwd via SQL, with this: sql_select: select password from smtp_auth_users where username='%u@%r' and status='true' worked ok for users with email addresses, and i had some special users that were just a name, like "user-1", and i was able to AUTH it. Postfix had: smtpd_sasl_local_domain = fastmail and in the database i had the username in the format: user-1@fastmail and worked ok. How can i have the same with dovecot SASL? Thanks in advanced,

3 7

Crash when moving mail from Inbox to Trash
by marvin alcantara 14 Nov '19

14 Nov '19

Hi, I am developing a dovecot plugin, and inside my plugin I am implementing my own expunge function. Inside my function, I am calling the following lines of code: if (storage->v.mail_open(mail, &offset, &mail->open_file) < 0) return -1; The mail_open virtual function is an invalid address. The storage should be mdbox however, it seems that it didn't get the correct mdbox_mail_open of mdbox-storage. Do you have any suggestions as to why this is happening? dovecot version:2.3.7 (a3d493f) Sincerely,Marvin

1 0

RFC 5258 violation: incomplete response for "LIST ($OPT RECURSIVEMATCH) ..."
by Guilhem Moulin 12 Nov '19

12 Nov '19

Hi there, RFC 5258 (IMAP4 LIST command extensions) defines a ‘RECURSIVEMATCH’ selection option which “forces the server to return information about parent mailboxes that don't match other selection options, but have some submailboxes that do.” (Section 3.5 makes the requirement even clearer.) However that's not what Dovecot 2.3.7 does. AFAICT no LIST response is returned for mailboxes that don't meet the selection criteria, regardless of whether they have a child that does. The violation is visible when reproducing example #9 from Section 5 [0]: $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin \ doveadm -c /tmp/dovecot.conf mailbox create foo2 baz2 $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin \ doveadm -c /tmp/dovecot.conf mailbox create -s \ foo2/{bar1,bar2} baz2/{bar2,bar22,bar222} eps2 eps2/mamba qux2/bar2 $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin \ doveadm -c /tmp/dovecot.conf exec imap S: * PREAUTH [CAPABILITY IMAP4rev1 … LIST-EXTENDED …] Logged in as user C: D01 LIST "" "*" S: * LIST (\Noselect \HasChildren) "/" qux2 S: * LIST (\HasNoChildren) "/" qux2/bar2 S: * LIST (\HasChildren) "/" eps2 S: * LIST (\HasNoChildren) "/" eps2/mamba S: * LIST (\HasChildren) "/" baz2 S: * LIST (\HasNoChildren) "/" baz2/bar222 S: * LIST (\HasNoChildren) "/" baz2/bar22 S: * LIST (\HasNoChildren) "/" baz2/bar2 S: * LIST (\HasChildren) "/" foo2 S: * LIST (\HasNoChildren) "/" foo2/bar2 S: * LIST (\HasNoChildren) "/" foo2/bar1 S: * LIST (\HasNoChildren) "/" INBOX S: D01 OK List completed (0.006 + 0.000 + 0.005 secs). C: D02 LIST (SUBSCRIBED) "" "*" S: * LIST (\Subscribed) "/" foo2/bar1 S: * LIST (\Subscribed) "/" foo2/bar2 S: * LIST (\Subscribed) "/" baz2/bar2 S: * LIST (\Subscribed) "/" baz2/bar22 S: * LIST (\Subscribed) "/" baz2/bar222 S: * LIST (\Subscribed) "/" eps2 S: * LIST (\Subscribed) "/" eps2/mamba S: * LIST (\Subscribed) "/" qux2/bar2 S: D02 OK List completed (0.001 + 0.000 secs). A LIST command with ‘RECURSIVEMATCH SUBSCRIBED’ selection options produces an incomplete response: C: D03 LIST (RECURSIVEMATCH SUBSCRIBED) "" "*" S: * LIST (\Subscribed) "/" foo2/bar1 S: * LIST (\Subscribed) "/" foo2/bar2 S: * LIST (\Subscribed) "/" baz2/bar2 S: * LIST (\Subscribed) "/" baz2/bar22 S: * LIST (\Subscribed) "/" baz2/bar222 S: * LIST (\Subscribed) "/" eps2 (CHILDINFO ("SUBSCRIBED")) S: * LIST (\Subscribed) "/" eps2/mamba S: * LIST (\Subscribed) "/" qux2/bar2 S: D03 OK List completed (0.001 + 0.000 secs). The following untagged LIST responses for ‘foo2’ and ‘baz2’ are missing. RFC 5258 mandates their inclusion because even though they're not subscribed to themselves, they each have (at least) a subscribed child. S: * LIST () "/" "foo2" ("CHILDINFO" ("SUBSCRIBED")) S: * LIST () "/" "baz2" ("CHILDINFO" ("SUBSCRIBED")) Cheers, -- Guilhem. [0] https://tools.ietf.org/html/rfc5258#section-5

1 0

How to send a test message directly to lmtp, to test proxying
by Marc Roos 12 Nov '19

12 Nov '19

How to send a test message directly to lmtp, to test proxying?

2 2

Howto pin user in proxy/director <-> backend server setup
by Marc Roos 12 Nov '19

12 Nov '19

I have 1x proxy/director server 2x backend mail server The backend servers are using a ldap database and do not have the option to put a proxy=y value. So I put this as a default in the passdb option in the proxy/director config. When I do telnet localhost 110 on the proxy/director, I can authenticate with a test account on svr1.local 1. Will automatically all users be directed to the first server configured in director_mail_servers = svr1.local svr2.local, when the do not have a proxy=y or host=? If this is the case maybe, we should write this somewhere on https://wiki2.dovecot.org/Director https://doc.dovecot.org/configuration_manual/authentication/proxies/ 2. If I change the host= in the ldap server, I think the proxy/director has archived the previous host and still redirects to the old value. Is there a way around this? (stopping/starting dovecot -F resolves this) 3. Do I need the director even in this setup?

1 0

[SOLVED] dovecot -2.2.24 on Fedora 31
by Frank Elsner 12 Nov '19

12 Nov '19

Hello Aki, thanks for your patience and help. I solved my problems by compiling dovecot-2.3.8 and following the migration hints I got it working. Happy, Frank

1 0

postfix + spamassassin + dovecot-lda (with sieve support)
by Дмитрий До лженко 12 Nov '19

12 Nov '19

Hello, I have FreeBSD 12 server with postfix + spamassassin. Old config work fine. ------ old postfix master.cf spamfilter unix - n n - - pipe flags=R user=nobody argv=/usr/local/bin/spamc -e /usr/sbin/sendmail -oi -f ${sender} ${recipient} ------ I try to add dovecot-lda (with sieve support) as local delivery agent to postfix config ----------- postfix master.cf # Spamd filter spamfilter unix - n n - - pipe flags=DRhu user=nobody argv=/usr/local/bin/spamc -e /usr/local/libexec/dovecot/dovecot-lda -f ${sender} -d ${recipient} ----------- Test mail is bounced with report - --------- If you do so, please include this problem report. You can delete your own text from the attached returned message. The mail system <dol(a)mig.hys.msu.ru>: user unknown --------- /var/log/maillog Nov 11 22:40:49 mig postfix/smtpd[55978]: disconnect from acs366.hys.msu.ru[93.10.51.14] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 Nov 11 22:40:49 mig dovecot[64447]: auth-worker(55751): passwd(dol(a)mig.hys.msu.ru): unknown user System user dol exist, but LDA try to deliver to dol(a)mig.hys.msu.ru Please, help me to solve this problem. I need to serve IMAP and POP3 clients with delivery to /var/mail/username mailboxes if no user sieve rules exists. Best regards, Dmitry.

2 1

dovecot -2.2.24 on Fedora 31
by Frank Elsner 12 Nov '19

12 Nov '19

Hi, I try to compile dovecot -2.2.24 on Fedora 31 and get the following error: iostream-openssl.c: In function ‘openssl_iostream_verify_client_cert’: iostream-openssl.c:118:37: error: dereferencing pointer to incomplete type ‘X509_STORE_CTX’ {aka ‘struct x509_store_ctx_st’} 118 | subject = X509_get_subject_name(ctx->current_cert); | ^~ make[3]: *** [Makefile:561: iostream-openssl.lo] Error 1 All openssl packages installed. What's the reason and how solve the problem? Kind regards, Frank Elsner

2 8

Login/director not created
by Marc Roos 11 Nov '19

11 Nov '19

I have this[0] config, yet the /var/run/dovecot/login/director is not created, what to check in the config? dovecot: imap-login: Error: auth: connect(director) failed: No such file or directory [0] service director { unix_listener login/director { #mode = 0666 } fifo_listener login/proxy-notify { #mode = 0666 } unix_listener director-userdb { #mode = 0600 } inet_listener { #port = } }

2 4

gssapi without passdb
by David Wells 11 Nov '19

11 Nov '19

Good afternoon. I'm configuring dovecot to authenticate users against a samba server running as an active directory domain controller. I followed the instructions as stated in the page https://wiki.dovecot.org/Authentication/Kerberos and considering the sentence that states [...]The Kerberos authentication mechanism doesn't require having a passdb, but you do need a userdb[...] I produced a configuration file that looked like this > auth_gssapi_hostname = $ALL > auth_krb5_keytab = /etc/dovecot/dovecot.keytab > auth_mechanisms = gssapi > auth_username_format = %u > mail_location = > maildir:~/Maildir:INDEX=/var/lib/dovecot/%d/%n:CONTROL=/var/lib/dovecot/%d/%n:UTF-8 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate mime foreverypart > extracttext > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > plugin { > sieve = file:~/sieve;active=~/.dovecot.sieve > } > protocols = imap > ssl_ca = /etc/ssl/certs/cacertificate.crt > ssl_cert = </etc/ssl/certs/certificate.crt > ssl_key = # hidden, use -P to show it > userdb { > args = uid=vmail gid=vmail home=/var/vmail/%d/%n allow_all_users=yes > driver = static > } When I ran these settings I would get an error that read > Nov 8 17:00:00 mail dovecot: auth: Error: > gssapi(user(a)KERBEROSPRINCIPAL,192.168.182.137,<IQMcOtuWI+3AqLaJ>): All > password databases were skipped > Nov 8 17:00:02 mail dovecot: imap-login: Disconnected (auth service > reported temporary failure): user=<user@KERBEROSPRINCIPAL>, > method=GSSAPI, rip=192.168.182.137, lip=192.168.182.4, TLS, > session=<IQMcOtuWI+3AqLaJ> After Trying many things I finally modified my config > auth_gssapi_hostname = $ALL > auth_krb5_keytab = /etc/dovecot/dovecot.keytab > auth_mechanisms = gssapi > auth_username_format = %u > mail_location = > maildir:~/Maildir:INDEX=/var/lib/dovecot/%d/%n:CONTROL=/var/lib/dovecot/%d/%n:UTF-8 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate mime foreverypart > extracttext > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > sieve = file:~/sieve;active=~/.dovecot.sieve > } > protocols = imap > ssl_ca = /etc/ssl/certs/cacertificate.crt > ssl_cert = </etc/ssl/certs/certificate.crt > ssl_key = # hidden, use -P to show it > userdb { > args = uid=vmail gid=vmail home=/var/vmail/%d/%n allow_all_users=yes > driver = static > } The dovecot-ldap.conf.ext file looks like this > hosts = dc1:3268 > tls = yes > auth_bind = yes > auth_bind_userdn = %u > base = With this configuration I can authenticate to the imap server sending user@KERBEROSPRINCIPAL as my username and without setting a password so I'm wondering if the wiki page needs to be updated or if there is something wrong with my first setup. Thanks in advance. Best regards, David Wells.

2 1

Sieve vacation :addresses match only case-sensitive?
by Philipp Faeustlin 11 Nov '19

11 Nov '19

The recipients in the vacation :addresses String list are matched case-sensitive. If the recipient gets a mail with wrong case, the message is discarded with: "discarding vacation response for implicitly delivered message; no known (envelope) recipient address found in message headers" I think the matching should be case-insensitive. Is this a bug or do I miss some option? I'm using Dovecot 2.3.7.2, Pigeonhole version 0.5.7.2. -- Philipp Fäustlin

5 9

Proxy testing in container( chown failed /var/dovecot/login)
by Marc Roos 11 Nov '19

11 Nov '19

I am testing a bit with the proxy, and trying to run dovecot as a normal user. (with cap bind_service). I was wondering what the minimum configuration is for running like a proxy. I am now getting issues like unable to chown on /var/dovecot/login, but I do not need this in such a setup do I? passdb { driver = static args = proxy=y host=192.168.11.10 nopassword=y }

2 3

Error: Corrupted index cache file and Error: Maildir filename has wrong S value
by Brent Clark 11 Nov '19

11 Nov '19

Good day Guys I have been met with a very interesting set of error messages. Here is the snippet(s) https://pastebin.com/raw/nFf79Ebc (Sorry for all the redacted REMOVED_*.) Google is proving to be a bit challenging in helping and explaining. Could anyone please share how something like this happens, but more importantly how to recover from this. doveadm index -u <username> INBOX do the trick? I also would like to ask the community, is there any tips or tricks any of you guys do to mitigate index / cache corruptions. Many thanks Regards Brent Clark

2 5

User found but password failure
by Mauricio Tavares 11 Nov '19

11 Nov '19

Trying to figure out which step is causing me not to be able to login. I am using a password file, passdb { driver = passwd-file args = scheme=SHA512-CRYPT username_format=%u /etc/dovecot/passwd } We will assume that the pw I created using 'doveadm pw -s SHA512-CRYPT' matches the password I will be using to login below. I crank the debugging mode, auth_debug_passwords = yes auth_debug = yes And then try to login [root@mail ~]# nc -t localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=GSSAPI] Howdy a login raub(a)example.com password [blank] which from what I gathered from /var/log/dovecot means it found matching username but did not match password: secured session=lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB lip=::1 rip=::1 lport=143 rport=36340 resp=base64-reply (previous base64 data may contain sensitive data) Aug 26 03:25:52 auth: Debug: passwd-file(raub@example.com,::1,<lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB>): lookup: user=raub(a)example.com file=/etc/dovecot/passwd Aug 26 03:25:52 auth: Debug: client passdb out: OK 1 user=raub(a)example.com Aug 26 03:25:52 auth: Debug: master in: REQUEST 1520959489 26560 1 63ee7f45236f85fd39573a5c8a2eb46a session_pid=26563 request_auth_token Aug 26 03:25:52 auth-worker(26562): Debug: passwd(raub@example.com,::1,<lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB>): lookup Aug 26 03:25:52 auth-worker(26562): Info: passwd(raub@example.com,::1,<lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB>): unknown user Aug 26 03:25:52 auth: Debug: passwd-file(raub@example.com,::1,<lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB>): lookup: user=raub(a)example.com file=/etc/dovecot/passwd Aug 26 03:25:52 auth: Error: plain(raub@example.com,::1,<lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB>): user not found from any userdbs Aug 26 03:25:52 auth: Debug: master userdb out: NOTFOUND 1520959489 Aug 26 03:25:52 imap: Error: Authenticated user not found from userdb, auth lookup id=1520959489 (auth connected 1 msecs ago, handshake 0 msecs ago, request took 1 msecs, client-pid=26560 client-id=1) Aug 26 03:25:52 imap-login: Info: Internal login failure (pid=26560 id=1) (internal failure, 1 successful auths): user=<raub(a)example.com>, method=PLAIN, rip=::1, lip=::1, mpid=26563, secured, session=<lyJttvyQ9I0AAAAAAAAAAAAAAAAAAAAB> Per [1] I decided to see what the response (base64-reply) I am submitting to dovecot looks like: echo 'base64-reply' | base64 -d raub(a)example.compassword Which has the right username and password but follows the userpassword format, not useruserpassword as I was led to believe by [1]. Is that to be expected? If it is then the issue is further down the line. [1] https://wiki.dovecot.org/Debugging/Authentication

3 5

Dovecot on CentOS8 / RHEL8
by Aki Tuomi 11 Nov '19

11 Nov '19

If you are planning to run dovecot on CentOS8 or RedHat 8 using native packages, please be aware that pigeonhole is not currently available (but they are working on it), see https://bugzilla.redhat.com/show_bug.cgi?id=1766985 . We are working on getting our CentOS8 packages available on repo.dovecot.org. Aki

1 0

MariaDB database for users and passwords?
by Ken Wright 10 Nov '19

10 Nov '19

Greetings, All! I've got an email server set up with Postfix and Dovecot, but Dovecot can't find any users. I'd ilke to use the database I set up in MariaDB for users (referenced by Postfix), but I'm just not sure how to do it. There's a line in dovecot.conf specifying /etc/dovecot/passwd.db, but obviously that's not the one I set up in MariaDB. Is what I want even possible? Ken -- Registered Linux user #483005 If you ever think international relations make sense, remember this: because a Serb shot an Austrian in Bosnia, Germany invaded Belgium.

8 14

G Suite migration using dsync
by Paul Pace 09 Nov '19

09 Nov '19

Hello, I am trying to migrate a domain from G Suite using dsync and am not clear on how to configure so I am getting failures. This is the configuration in dovecot.conf: imapc_host = imap.gmail.com imapc_port = 993 imapc_password = 1234 imapc_ssl = imaps imapc_ssl_verify = yes imapc_features = gmail-migration I also tried with imapc_ssl_verify commented. For simplicity, both the username and password are the same for G Suite and Dovecot and are verified to access the G Suite account with other tools. Here is the command (from the wiki) and output: # doveadm backup -a 'virtual/All' -O '-$GmailHaveLabels' -R -u user(a)example.com imapc: dsync(user(a)example.com): Info: imapc(imap.gmail.com:993): Connected to 2607:f8b0:4003:c0f::6c:993 (local IPv6:port) dsync(user(a)example.com): Warning: imapc(imap.gmail.com:993): Server disconnected unexpectedly: SSL_connect() failed: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure: SSL alert number 40 - reconnecting (delay 0 ms) dsync(user(a)example.com): Info: imapc(imap.gmail.com:993): Connected to 74.125.30.109:993 (local IPv4:port) dsync(user(a)example.com): Error: imapc(imap.gmail.com:993): Server disconnected unexpectedly: SSL_connect() failed: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure: SSL alert number 40 - disconnecting dsync(user(a)example.com): Error: User initialization failed: imapc: Login to imap.gmail.com failed: Disconnected from server In reading through the wiki, it seems I am missing something, but I can't figure out what is missing and internet searches don't provide further useful information on the dovecot tools. Thank you, Paul

1 0

Reading config-value from file does not work.
by Jakobus Schürz 08 Nov '19

08 Nov '19

Hi guys! In https://doc.dovecot.org/configuration_manual/config_file/config_file_syntax/ i ca see this: Reading value from file It’s possible to read the value for a setting from a file: key = </path/to/file The value is read exactly as the entire contents of the file. This includes all the whitespace and newlines. The paths are relative to the currently parsed config file’s directory, similar to how !include works. The file is read immediately whenever parsing the configuration file, so if it changes afterwards it requires a configuration reload to see the changes. This functionality is especially useful for reading SSL certificates and keys. So i thought it's a good idea, to write the password for dnpass for my ldap in this notation in my config dnpass = <private/dnpass /etc/dovecot/private/dnpass contains only this myVerYSecretLdApPAssworD no space, no newline. But dovecot cannot authenticate on the ldap-host. I also tried dnpass = </private/dnpass dnpass = </etc/dovecot/private/dnpass Then i tried a file /etc/dovecot/conf.d/00-dnpass.conf with dnpass = myVerYSecretLdApPAssworD It should be included with dovecot.conf !include conf.d/*.conf The only notation that works is the line dnpass = myVerYSecretLdApPAssworD in /etc/dovecot/dovecot-ldap-userdb.conf.ext I thought it's a good idea to write it in an extra file, so i have to manipulate only one small file with ansible, when i renew the password. Is it a bug or does it work as designed, and the doc is wrong? thank you Jakob

1 1

dovecot ignores users sieve-script
by Jakobus Schürz 08 Nov '19

08 Nov '19

Hi there! I recognized that dovecot ignores users sieve-script. The global and the post-sieve-scripts are working, but users sievescript is ignored. You can see the sieve trace-files last lines 65: finishing match with result: not matched 65: jump if result is true 65: not jumping 65: jumping to line 67 67: jumping to line 77 ## Finished executing script 'global' ## Started executing script 'junk' 2: header test 2: starting `:contains' match with `i;ascii-casemap' comparator: 2: extracting `X-Spam' headers from message 2: finishing match with result: not matched 2: jump if result is false 2: jumping to line 6 ## Finished executing script 'junk' Between global and junk-Script should sieve run users sieve script. Before the Upgrade to 2.3.8 sieve was working correct. Now ALL messages go to INBOX, no one is filtered anymore. compiling the sievescript with sudo -u vmail sievec sievefilter.sieve gives no errormessage... My users sievefilter is: /var/mail/jakobus.schuerz/sieve/sievefilter.sieve This directory contains: lrwxrwxrwx 1 vmail vmail 17 Nov 7 12:44 jakobus.schuerz.sieve -> sievefilter.sieve -rw------- 1 vmail vmail 36834 Nov 7 13:25 jakobus.schuerz.svbin -rw------- 1 vmail vmail 45588 Nov 7 11:43 sievefilter.sieve The dovecot conf dump: # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.8 (b7b03ba2) # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.1 # Hostname: mail.mydomain.example auth_mechanisms = plain login cram-md5 digest-md5 auth_socket_path = /var/run/dovecot/auth-userdb disable_plaintext_auth = no first_valid_uid = 1000 imap_capability = +XDOVECOT +SPECIAL-USE imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags delay-newmail lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = *, ::1 login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c tls=%k login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24 172.17.0.0/24 172.18.0.0/24 mail_gid = vmail mail_home = /var/mail/%u mail_location = maildir:~/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene mail_privileged_group = vmail mail_server_admin = mailto:user@mydomain.example mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace Geteilt { hidden = no inbox = no list = children location = maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u prefix = Geteilt/%%n/ separator = / subscriptions = no type = shared } namespace History { hidden = no inbox = no list = children location = maildir:/var/mail/archiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/archiv/%u:CONTROL=/var/lib/dovecot/db/control/archiv/%u mailbox Archiv { auto = subscribe special_use = \Archive } prefix = Archiv/ separator = / subscriptions = no type = private } namespace Synoptic { hidden = no ignore_on_failure = no list = children location = virtual:/var/mail/virtual/synoptic:INDEX=/var/lib/dovecot/db/indexes/virtual/synoptic/%u mailbox AKTUELL { auto = subscribe special_use = \All } mailbox Markierte { auto = subscribe special_use = \Flagged } mailbox Neue { auto = subscribe } mailbox Rechnungen { auto = subscribe } mailbox WICHTIG { auto = subscribe } prefix = Synoptic/ separator = / subscriptions = no } namespace Tulln { list = children location = maildir:/var/mail/public/tulln:SUBSCRIPTIONS=subscriptions/%u:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/public/tulln/%u mailbox Familie { auto = subscribe } mailbox Versicherungen { auto = subscribe } mailbox familyextracard { auto = subscribe } prefix = Tulln/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox "Gelöschte Elemente" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox "Gelöschte Objekte" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Gesendet { auto = no special_use = \Sent } mailbox "Gesendete Elemente" { auto = no special_use = \Sent } mailbox "Gesendete Objekte" { auto = no special_use = \Sent } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Mistkübel { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Papierkorb { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Synoptic/AKTUELL { auto = no comment = All my messages special_use = \All } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } passdb { args = /etc/dovecot/dovecot-ldap-passdb-user.conf.ext driver = ldap name = user } passdb { args = /etc/dovecot/dovecot-ldap-passdb-admin.conf.ext driver = ldap name = admin } passdb { args = /etc/dovecot/dovecot-ldap-passdb-others.conf.ext driver = ldap name = others } plugin { acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. normalize no_snowball imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = INBOX/Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = INBOX/Junk imapsieve_mailbox2_name = * mail_home = /var/mail/%u mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid subject from flags setting_name = sieve, managedsieve sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve sieve_after = /etc/dovecot/sieve/after.d/ sieve_before = /etc/dovecot/sieve/global.sieve sieve_global_dir = /etc/dovecot/sieve/ sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_trace_dir = /var/log/dovecot/sieve/trace sieve_trace_level = matching sieve_user_log = /var/mail/%u/sieve/sieve.log } postmaster_address = postmaster@localhost protocols = " imap lmtp lmtp sieve pop3 sieve" service anvil { client_limit = 199999 unix_listener anvil-auth-penalty { mode = 0700 } } service auth { unix_listener auth-client { group = vmail mode = 0666 user = Debian-exim } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 1 } service imap-postlogin { executable = script-login -d rawlog /etc/dovecot/acl_groups.py unix_listener imap-postlogin { group = vmail user = vmail } } service imap { executable = imap imap-postlogin process_limit = 1024 vsz_limit = 400 M } service lmtp { user = Debian-exim vsz_limit = 400 M } service stats { unix_listener stats-writer { group = vmail mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/letsencrypt/live/imap.mydomain.example/fullchain.pem ssl_cipher_list = ALL:!ADH:!LOW:!SSLv2:!SSLv3:!EXP:!aNULL:+HIGH:+MEDIUM ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext default_fields = home=/var/mail/%u uid=vmail gid=vmail driver = ldap } verbose_proctitle = yes protocol lmtp { auth_username_format = %Ln mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene quota sieve acl } protocol lda { info_log_path = log_path = mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene quota sieve acl } protocol imap { mail_max_userip_connections = 60 mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene imap_quota imap_acl imap_sieve rawlog_dir = %h/rawlog } Thanks for your help

2 2

[2.3.8] possible replication issue
by KOCIK Fabien (Acoss) 08 Nov '19

08 Nov '19

Hi, I'm dealing for few days with replication issues between two dovecot containerized instances in Kubernetes environment. After some search, I found this thread that reports exactly the same symptoms I encountered : https://dovecot.org/pipermail/dovecot/2019-October/117353.html I can confirm that downgrade of dovecot to 2.3.7.2 fixes the issue. Testing usage of -T parameter with a very low value (10s) on 2.3.8 version is reducing perceptible impact of the issue (mails are replicated within the following five minutes). I'm not expert in dovecot architecture but I tried to put an eye in the code and I'm wondering if this commit is not creating a potential phantom stalled I/O timeout ? https://github.com/dovecot/core/commit/ec817bb2185bb21b34ba6bdd83b32af16dd0… In fact, I was unable to see when the counter incremented by io_set_pending is decremented ? Hoping that this information can help... Regards. Fabien. +--------+ For technical details : Container images are based on Arch Linux distro image. Here is the configuration of Dovecot server : dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # OS: Linux 4.19.66-coreos x86_64 ext4 # Hostname: mailstore-0.mailstore.piafe.svc.cluster.local disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 login_greeting = PIAFE Mail Server Ready mail_location = mdbox:/var/mail/%Ld/%Ln mail_plugins = " notify replication quota" namespace inbox { hidden = no inbox = yes list = yes location = mailbox Brouillons { auto = subscribe special_use = \Drafts } mailbox Corbeille { auto = subscribe special_use = \Trash } mailbox "Courrier indésirable" { auto = subscribe special_use = \Junk } mailbox Envoyés { auto = subscribe special_use = \Sent } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:mailstore-1.mailstore.piafe.svc.cluster.local quota = dirsize:User quota quota_grace = 10%% quota_max_mail_size = 20M quota_rule = *:storage=1G quota_rule2 = Trash:storage=+200M quota_status_access = DUNNO quota_status_nouser = DUNNO quota_status_overquota = 552 5.5.2 Mailbox is full } postmaster_address = postmaster(a)piafe.recouv.fr replication_dsync_parameters = -d -N -l 30 -U -T 10 service aggregator { fifo_listener replication-notify-fifo { user = mailer } unix_listener replication-notify { user = mailer } } service doveadm { inet_listener { port = 12345 } inet_listener http { port = 8080 } } service lmtp { inet_listener lmtp { address = * port = 24 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = mailer mode = 0660 } } ssl = no userdb { args = /etc/dovecot/ldap.conf.ext default_fields = uid=500 gid=500 home=/var/mail/%Ld/%Ln driver = ldap } protocol imap { mail_plugins = " notify replication quota quota" }

1 0

Sendmail lmtp delivery and director
by Marc Roos 07 Nov '19

07 Nov '19

If I have sendmail configured to deliver to dovecot lmpt and use the director are incoming messages directed to the correct/configured server? Sendmail.mc with: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl

1 0

Using attachment_dir with plugin zlib corrupt mails
by MAREN ZUBIZARRETA 06 Nov '19

06 Nov '19

Hello: I have found the same problem reported above by Patrick Cernko affecting our system and corrupting our messages. Even worse, Outlook 2016 will no synchronize and the clients cannot see any message, even if there is only one corrupted mail per mailbox. I cannot figure out a feasible workaround for our system, and I can see that in new version 2.38 the bug is not fixed. Will this issue be treated soon? Thanks a lot Maren Zubizarreta WARNING: using attachment_dir with plugin zlib can corrupt mails Patrick Cernko pcernko at mpi-klsb.mpg.de<mailto:dovecot%40dovecot.org?Subject=Re:%20Re%3A%20WARNING%3A%20using%20attachment_dir%20with%20plugin%20zlib%20can%20corrupt%20mails&In-Reply-To=%3C1ab8edcc-bef4-3b41-d09a-c523674a5031%40mpi-klsb.mpg.de%3E> Fri Jul 19 17:52:37 EEST 2019 * Previous message: index worker 2.3.7 undefined symbol errors<https://dovecot.org/list/dovecot/2019-July/116617.html> * Next message: Address family not supported by protocol<https://dovecot.org/list/dovecot/2019-July/116571.html> * Messages sorted by: [ date ]<https://dovecot.org/list/dovecot/2019-July/date.html#116570> [ thread ]<https://dovecot.org/list/dovecot/2019-July/thread.html#116570> [ subject ]<https://dovecot.org/list/dovecot/2019-July/subject.html#116570> [ author ]<https://dovecot.org/list/dovecot/2019-July/author.html#116570> ________________________________ Hello list, hello Dovecot developers, this week, I discovered a serious bug in Dovecot, that lead to several broken mails on our servers. The bug corrupts the first few characters of the mail header during saving. On our setup, it was almost always only the very first line of text, that was corrupted. Depending on the IMAP client (they seem to request different header fields, ... during mail access), the bug causes the imap process to hang up the TCP connection and log errors like this: > imap(USERNAME)<4767><TeQP4ASOTK5/AAAB>: Error: Corrupted record in index cache file /IMAP/mail/mailboxes/USERNAME/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index.cache: UID 489113: Broken fields in mailbox Trash: read(attachments-connector(zlib(/IMAP/mail/mailboxes/USERNAME/mdbox/storage/m.813))): FETCH BODY[HEADER.FIELDS (RETURN-PATH SUBJECT)] got too little data: 2 vs 122 In our case that finally grabbed my attention, the client was the users iphone that did not display any new messages but his Thunderbird did. The bug seems to be triggered by a bad "interaction" of attachment_dir option and zlib plugin. If you use both, you most likely are affected, too, except you only use zlib plugin for reading previously compressed stored mails. That's also the workaround we use now: zlib plugin only enabled in mail_plugins but no plugin/zlib_save set. The bug occurs on very specific mails. Due to privacy reasons I could not provide sample mails here. Storing such mails seems to trigger the bug reproducible. I attached a very minimal doveconf -n config, that can be used to trigger the bug. If one of the developers is interested, I can try to generate an "anonymized" version of such a specific mail that still causes the issue. I discovered the bug on our productive systems, running latest Dovecot 2.2 release, but the latest 2.3 I used during debugging is affected, too. During debugging, I also found one hint, that might help find the bug: If you store a problematic mail with zlib_save=gz (or zlib_save=bz2) and then disable the zlib plugin in mail_plugins, you can call doveadm fetch -u test hdr all | grep -v ^hdr: | gzip --decompress on test's mailbox with only that one broken mail. This will display the beginning of the rfc822 mail text until gzip terminates with "gzip: stdin: unexpected end of file", approximately after twice the length of the mail HEADER. This might indicate, that dovecot stores the uncompressed size of the header in it's data structures although the mail is stored compressed. I also found a very efficient way to find all affected mails in our setup: doveadm -f flow fetch -A 'user guid mailbox uid seq flags hdr' all | \ grep -a "^[^ ]+ user=" | \ grep -avF ' hdr=Return-path: ' | \ grep -av '.* hdr=[[:print:][:space:]]*$' (runtime for ~6M mails on our servers was 20-30min) This can be even more optimized if you have a powerful storage system with GNU parallel: > doveadm user '*' | parallel "doveadm -f flow fetch -u '{}' 'user guid mailbox uid seq flags hdr' all | grep -a '^user=' | grep -avF ' hdr=Return-path: ' | grep -av '.* hdr=[[:print:][:space:]]*$' || true" (runtime for ~6M mails on our servers was ~4min) The command will give you a list of mails that possibly are affected, check the full output of doveadm fetch -u USERNAME hdr guid GUID | less to verify that the header is really broken. On our systems I found 39 mails within ~12M mails. I was able to recover these mails "manually" by reconstructing the Return-Path header line, importing the fixed mails and expunging the corrupt ones. Before importing, I had to disable zlib_save option obviously. Best regards, -- Patrick Cernko <pcernko at mpi-klsb.mpg.de<https://dovecot.org/mailman/listinfo/dovecot>> +49 681 9325 5815 Joint Administration: Information Services and Technology Max-Planck-Institute fuer Informatik & Softwaresysteme

6 11