- dovecot - dovecot.org

Disaster Recovery Help
by Giovanni Bisanti TEST 2 13 Nov '18

13 Nov '18

I lost the whole maildir from my server fro 3 users. They all have iPhones with all the messages safely stored on the Apple Mail app on their phone. There is no way to export them/move them. Is there a way to get Dovecot to just download all the messages and folder structure from the client and restore it on the server? Your help is very very much appreciated. Thanks, ttyllc

4 5

Help Disaster Recovery
by Giovanni Bisanti 12 Nov '18

12 Nov '18

I lost the whole maildir from my server fro 3 users. They all have iPhones with all the messages safely stored on the Apple Mail app on their phone. There is no way to export them/move them. Is there a way to get Dovecot to just download all the messages and folder structure from the client and restore it on the server? Your help is very very much appreciated. Thanks, ttyllc

1 0

Disaster Recovery Help
by Giovanni Bisanti 12 Nov '18

12 Nov '18

I lost the whole maildir from my server fro 3 users. They all have iPhones with all the messages safely stored on the Apple Mail app on their phone. There is no way to export them/move them. Is there a way to get Dovecot to just download all the messages and folder structure from the client and restore it on the server? Your help is very very much appreciated. Thanks, ttyllc

1 0

Disaster Recovery Help
by Giovanni Bisanti 12 Nov '18

12 Nov '18

I lost the whole maildir from my server fro 3 users. They all have iPhones with all the messages safely stored on the Apple Mail app on their phone. There is no way to export them/move them. Is there a way to get Dovecot to just download all the messages and folder structure from the client and restore it on the server? Your help is very very much appreciated. Thanks, ttyllc

1 0

Seen-Flag and Virtual
by Dieter Knopf 12 Nov '18

12 Nov '18

Hello, We have a very large folder structure (in a public namespace) on our Dovecot server and would now like to create a virtual folder containing all mails of the publick namespace. This worked quite well with dovecot-virtual, but the read status (\seen) is not preserved. i.e. when I read a mail inside the virtual folder, the read status does not affect the original mail. Dovecut was configured with per-user \seen-flag. Is it possible to synchronize the \seen-flag somehow? Thanks Dieter

1 0

Re: Cannot make disable_plaintext_auth = no works in configuration
by Tanstaafl 12 Nov '18

12 Nov '18

Please keep list communications on list. If your doveconf -n doesn't reflect the changes you are making, then you are editing the wrong file. On Mon Nov 12 2018 10:22:45 GMT-0500 (Eastern Standard Time), Steve Leung <steveleung597(a)yahoo.com> wrote: > The doveconf -n did not show this setting, which I suppose it is keeping > the default value. > > Thanks > > Sent from Yahoo Mail on Android > <https://go.onelink.me/107872968?pid=InProduct&c=Global_Internal_YGrowth_And…> > > On Mon, Nov 12, 2018 at 6:51 AM, Tanstaafl > <tanstaafl(a)libertytrek.org> wrote: > On 11/11/2018, 4:02:25 AM, Steve Leung <steveleung597(a)yahoo.com > <mailto:steveleung597@yahoo.com>> wrote: > > > Hi, > > > > No matter how I try, I cannot make the config disable_plaintext_auth = > > no to work. I have set it up in 10-auth.conf but when I check with > > doveconf -a it is still disable_plaintext_auth = yes. > > > As expected. > > doveconf -a shows all DEFAULT settings > > doveconf -n shows your custom/current settings being used by the running > dovecot system. > > What does doveconf -n show? >

1 0

Cannot make disable_plaintext_auth = no works in configuration
by Steve Leung 12 Nov '18

12 Nov '18

Hi, No matter how I try, I cannot make the config disable_plaintext_auth = no to work. I have set it up in 10-auth.conf but when I check with doveconf -a it is still disable_plaintext_auth = yes. Here is my config: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-36-generic x86_64 Ubuntu 18.04.1 LTS auth_mechanisms = plain login mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = username_format=%u /etc/dovecot/passwd driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl = no ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Please help! Thanks so much Steve

2 1

moving only new mails from one server to another
by Nicolas 12 Nov '18

12 Nov '18

Hello, I think it is not really the right place to post about that, but lot of dovecot experts there ;) Basically, I have a server with dovecot 2.2.9 that has new (unread) mails (because of a bad DNS config at a migration time). Is there an easy way to move only these unread mails to a another server ? (no perms trouble here : all vmail:vmail) Though to iterate through all /var/vmail/*/*/Maildir/new and scp/rsync them. Would that work ? Thanks in advance for your time. Nicolas

2 1

replication guide
by lty＠cndns.com 12 Nov '18

12 Nov '18

DOVECOT -N # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: Linux 2.6.32-431.23.3.el6.x86_64 x86_64 CentOS release 6.9 (Final) '''' plugin { ''' mail_replica = tcp:10.1.1.20:1111 # replication_sync_timeout = 2s replication_sync_timeout = 2 '''' } '''' /VAR/LOG/DOVECOT/DOVECOT.LOG doveadm(lty(a)cndns.com): Error: replication(lty(a)cndns.com): Invalid replication_sync_timeout value: 2s I am talking about the replication_sync_timeout = 2s in the configuration file changed to replication_sync_timeout = 2, no prompt error, but I get the following prompt /VAR/LOG/DOVECOT/DOVECOT.LOG Nov 12 14:01:10 replicator: Panic: data stack: Out of memory when allocating 268435496 bytes Nov 12 14:01:10 replicator: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x3bdd69f74a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3bdd69f7b6] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3bdd630b8a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3bdd69d34a] -> /usr/lib64/dovecot/libdovecot.so .0() [0x3bdd69d558] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3bdd6bb818] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3bdd69b0a2] -> /usr/ Lib64/dovecot/libdovecot.so.0(buffer_write+0x89) [>xvebd/b. -> dovecot/replicator() [0x4040d0] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x61) [0x3bdd6b4921] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbf ) [0x3bdd6b65cf] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0x3bdd6b49dc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3bdd6b4b98] -> /usr/lib64/do Vecot/libdovecot.so.0(master_service_run+0x13) [0x3bdd63ad43] -> dovecot/replicator(main+0x17e) [0x40461e] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3bb6a1ed1d] -> dovecot/ Replicator() [0x4031f9] Nov 12 14:01:10 replicator: Fatal: master: service(replicator): child 19591 killed with signal 6 (core dumps disabled) /VAR/LOG/DOVECOT/SIEVE.LOG Nov 12 13:54:36 lda(lty(a)cndns.com): Warning: replication(lty(a)cndns.com): Remote sent invalid input: - Nov 12 13:54:36 lda(lty(a)cndns.com): Info: sieve: msgid=unspecified: stored mail into mailbox 'Junk' Nov 12 14:01:10 lda(lty(a)cndns.com): Warning: replication(lty@cndnscom): Sync failure: Nov 12 14:01:10 lda(lty(a)cndns.com): Warning: replication(lty(a)cndns.com): Remote sent invalid input: - Please help me, thank you

1 0

The SSL certificate of repo.dovecot.org has expired.
by Masaki Nemoto 11 Nov '18

11 Nov '18

Hi The SSL certificate of https://repo.dovecot.org has expired. Do you have plans to update it?

1 0

Re: The SSL certificate of repo.dovecot.org has expired.
by Tuomi, Aki 10 Nov '18

10 Nov '18

Yes. Sorry about this.Sent from my Samsung Galaxy smartphone. -------- Original message --------From: Masaki Nemoto <itml(a)ma3ki.net> Date: 11/11/2018 10:00 (GMT+02:00) To: dovecot(a)dovecot.org Subject: The SSL certificate of repo.dovecot.org has expired. HiThe SSL certificate of https://repo.dovecot.org has expired.Do you have plans to update it?

2 1

after reboot listen(*, 995) failed: Address already in use/listen(*, 993) failed: Address already in use
by Robert Kudyba 09 Nov '18

09 Nov '18

This is still happening after a reboot, Fedora 28. Restarting dovecot fixes the problem. Does anyone know if it could be related to this bug report? *https://bugzilla.redhat.com/show_bug.cgi?id=103401#c130 <https://bugzilla.redhat.com/show_bug.cgi?id=103401#c130> * and suggested work around to add ports to /proc/sys/net/ipv4/ip_local_reserved_ports? Nov 8 12:21:41 ourdomain dovecot[1386]: Error: service(pop3-login): listen(*, 995) failed: Address already in use Nov 8 12:21:41 ourdomain dovecot[1386]: Error: service(pop3-login): listen(::, 995) failed: Address already in use Nov 8 12:21:41 ourdomain dovecot[1386]: Error: service(imap-login): listen(*, 993) failed: Address already in use Nov 8 12:21:41 ourdomain dovecot[1386]: Error: service(imap-login): listen(::, 993) failed: Address already in use dovecot --version 2.2.36 (1f10bfa63) dovecot -n # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 4.18.16-200.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight) # Hostname: ourdomain.com auth_debug = yes debug_log_path = /var/log/dovecot-debug.log mail_debug = yes mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = required ssl_cert = </etc/letsencrypt/live/ourdomain.com/fullchain.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol imap { mail_location = mbox:~/mail:INBOX=/var/mail/%u

3 2

Strange log message with dovecot-2.3.3
by Christian Pélissier 08 Nov '18

08 Nov '18

Hi, # dovecot --version 2.3.3 (dcead646b) # doveinfo Nombre d'utilisateurs : 1151 Sockets IMAP : 4356 Process dovecot/imap : 4357 Process dovecot/imap-login : 1339 Process dovecot/pop3 : 0 Process dovecot/pop3-login : 0 Process dovecot/auth : 1 Process dovecot/auth -w : 2 Process dovecot/anvil : 1 Process dovecot/log : 1 Process dovecot/config : 1 Process dovecot/stats : 1 Since I am using dovecot 2.3.X I got the following messages /var/log/dovecot-20180930:Sep 28 17:33:38 balcha dovecot: master: Warning: service(stats): client_limit (1000) reached, client connections are being dropped Users complain the system became slow. I happen when dovecot/imap process grows above 1000. With 2.2.X no default were defined (#default_client_limit = 1000) and I have no such log and no performance problems. With 2.3.3 I first increase default_client_limit to 4096 but the following message come again when dovecot/imap grow above 4096 ====== Nov 6 12:09:12 balcha dovecot: master: Warning: service(stats): client_limit (4096) reached, client connections are being dropped Nov 6 12:09:25 balcha dovecot: imap: Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: Resource temporarily unavailable ... many same lines as above ====== Now 8192 solve my problem default_client_limit = 8192 I don't understand why the first Warning is related to service(stats) instead of service(imap) and why the socket stats-writer became temporarily unavailable # ls -l /var/run/dovecot/stats-writer srw-rw---- 1 root dovecot 0 Nov 8 02:44 /var/run/dovecot/stats-writer PS. # dovecot --version 2.3.3 (dcead646b) # dovecot -n # 2.3.3 (dcead646b): /usr/local/dovecot-2.3.3/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) # OS: Linux 2.6.32-696.30.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.9 (Santiago) # Hostname: balcha.onera base_dir = /var/run/dovecot/ default_client_limit = 8192 <<< default with dovecot 2.2.X changed to 4096 then 8192 disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir:INDEX=~/Maildir:CONTROL=~/Maildir mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl passdb { args = %s driver = pam } plugin { quota = maildir:User quota quota_grace = 6%% quota_rule = ?:storage=6G quota_rule2 = Trash:storage=+5%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster(a)onera.fr quota_full_tempfail = yes rejection_reason = Votre message à <%t> est mis en attente; raison : %n% r rejection_subject = Message (Objet: %s) mis en attente de livraison service anvil { client_limit = 4299 } service auth { client_limit = 5320 } service imap-login { client_limit = 8192 process_limit = 4096 } service imap { process_limit = 8192 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = root mode = 0666 user = root } user = root } ssl_cert = </usr/local/dovecot/etc/certs/dovecot.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it syslog_facility = local1 userdb { driver = passwd } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_reuse_xuidl = yes } -- Christian Pélissier ONERA DSI/ISR BP72 92322 Chatillon CEDEX  34419

1 0

MailLog plugin distinguish between simultaneous logins
by azurit＠pobox.sk 07 Nov '18

07 Nov '18

Hi, is it, somehow, possible to distinguish between multiple simultaneous logins in MailLog plugin? For example, which login deleted which message. Is that p[lugin able to log e.g. session ID? azur

2 3

Dovecot mail-crypt plugin
by Anushka Uditha Bandara 07 Nov '18

07 Nov '18

I configured an email solution using dovecot and postfix and it is working fine. Now I am working for mail encryption. Is it enough to set below configurations on dovecot for mail encryption. Because dovecot wiki is little bit confusing to me. "mail_plugins = $mail_plugins mail_crypt mail_attribute_dict = file:%h/Maildir/dovecot-attributes plugin { mail_crypt_curve = <some curve you like> mail_crypt_save_version = 2 }" I am stuck in here. Thank you in advance, Anushka Bandara

2 9

LMTP with many aliases and replication
by Sean Greenslade 07 Nov '18

07 Nov '18

Hi, all. I'm currently in the process of rethinking / tinkering with my personal mail server. I've hit a few stumbling blocks that make me think I may be approaching this problem from the wrong angle. I have a large number of email addresses across several domains that all alias to the same inbox. In my current setup, postfix handles the aliases and dumps them all into a single "receiving" maildir, which gets processed by a custom python script to sort into one of several destination maildirs handled by dovecot. In evaluating this system, I'd like to move to using sieve for this sorting step, so (according to the docs) I need to use LMTP. This is my first stumble. Since I use so many aliases, my IMAP login username is not my email address. In fact, I have several IMAP usernames with different passwords pointing to the same maildir so that my phone can use a different password than my PC. The dovecot documentation was not very clear on how to make LMTP use a different userdb. I eventually found through some trial and error and some hints from other list threads that I could wrap a second userdb {} section with a protocol lmtp {} section, which seems to do the trick. I'd like to edit the wiki to include this helpful tidbit, but I find it odd that this isn't mentioned anywhere in the documentation for LMTP. Is it actually an intended feature? My second stumble is with the replicator plugin. I'd like to run two identical dovecot servers that replicate their mailboxes across each other. Since there are a large number of alias "accounts" that all feed into one IMAP account, the logical place to put the replication would be the IMAP account. But the way the replicator plugin seems to work, the trigger for synchronous replication on mail receipt fires on the LMTP "account" that received that particular message. Is there any way within dovecot to specify a different replication account to be triggered for sync? Like a userdb extra field or something? I'm trying to avoid needing external scripts if at all possible. I'm interested to hear people's thought / suggestions, especially if anyone has a better way of architecting this system. In case it's relevant, I'm running Arch Linux / Dovecot 2.3.3. Thanks, --Sean

1 0

Re: dovecot: imap Error: read : Broken pipe
by Carl St-Laurent 07 Nov '18

07 Nov '18

I forgot to mention that if I transfer the mail to my Gmail or Outlook address I can download the attachments without any problem. More over I've completely removed the firewall server from the equation, I plugged the adsl line directly into the mail server and the problem is still there, so my guess is that the firewall isn't the problem here. I'll do the pcaps for Aki Thanks for your help On 06/11/2018 02:20, dovecot-request(a)dovecot.org wrote: > Send dovecot mailing list submissions to > dovecot(a)dovecot.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://dovecot.org/mailman/listinfo/dovecot > or, via email, send a message with subject or body 'help' to > dovecot-request(a)dovecot.org > > You can reach the person managing the list at > dovecot-owner(a)dovecot.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of dovecot digest..." > > > Today's Topics: > > 1. imap authentication - shadow vs mysql (Konra Wawryn) > 2. Re: imap authentication - shadow vs mysql (Ralph Seichter) > 3. Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): > auth-client-connection.c:338 (Michael Slusarz) > 4. dovecot: imap Error: read : Broken pipe (Carl St-Laurent) > 5. Re: dovecot: imap Error: read : Broken pipe (Felipe Gasper) > 6. Re: dovecot: imap Error: read : Broken pipe (Aki Tuomi) > 7. Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): > auth-client-connection.c:338 (Mart Pirita) > 8. Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): > auth-client-connection.c:338 (Aki Tuomi) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 05 Nov 2018 13:45:48 +0100 > From: Konra Wawryn <konrad.wawryn(a)virtual-machine.org> > To: dovecot(a)dovecot.org > Subject: imap authentication - shadow vs mysql > Message-ID: <13e143d52fb2f094a285306ccbdec990(a)virtual-machine.org> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > Hi, > > I`m looking for some opinions about authentication process for the > systems with more than 1000 E-mail accounts. > Maybe some one could advise me what is the best authentication method. > > At the moment I`m storing all passwords in my /etc/passwd. My IMAP > server is growing and I`m planning to build new host, my question is: > what is the best authentication model for IMAP server ? Do I need to > store all user/passwords in mysql or maybe in LDAP ? > > I`m searching for some solution which will help me to scale my system > in > the future. > > > Maybe some one could advice me ? > > > Greetings > > Konrad > > > ------------------------------ > > Message: 2 > Date: Mon, 05 Nov 2018 14:21:39 +0100 > From: Ralph Seichter <m16+dovecot(a)monksofcool.net> > To: dovecot(a)dovecot.org > Subject: Re: imap authentication - shadow vs mysql > Message-ID: <m2k1lrek2k.fsf(a)argon.seichter.de> > Content-Type: text/plain > > * Konra Wawryn: > >> I`m searching for some solution which will help me to scale my system >> in the future. > > You provided very little information about your requirements, and "to > scale" is just as vague a term. Hence, I recommend an LDAP server, > because it works in many scenarios, can accommodate thousands of users, > and is basically the default solution for this type of write-seldom- > read-often type of user data storage. > > As for MySQL, I would personally not use it for authentication unless I > had no other option. > > -Ralph > > > ------------------------------ > > Message: 3 > Date: Mon, 5 Nov 2018 10:42:14 -0700 (MST) > From: Michael Slusarz <michael.slusarz(a)open-xchange.com> > To: Mart Pirita <sysadmin(a)e-positive.ee>, dovecot(a)dovecot.org > Subject: Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): > auth-client-connection.c:338 > Message-ID: <750544780.12327.1541439735168(a)appsuite.open-xchange.com> > Content-Type: text/plain; charset=UTF-8 > >> On November 3, 2018 at 9:41 AM Mart Pirita <sysadmin(a)e-positive.ee> >> wrote: >> >> >> Hi, >> >> >> But this harmless is spamming logs, so how to disable it: >> >> grep auth-client-connection.c:338 maillog | wc -l >> ?? 1259 > > If using something like rsyslog, it is trivial to filter out unwanted > entries. > > michael > > >> Aki Tuomi wrote: >> > > On 03 November 2018 at 12:12 Mart Pirita < sysadmin(a)e-positive.ee >> > > <mailto:sysadmin@e-positive.ee>> wrote: >> > > >> > > >> > > Hi, >> > > >> > > >> > > Noticed with latest v2.3.3 some new warning in logs, for example: >> > > >> > > dovecot: auth: Warning: Event 0x80a6fc0 leaked (parent=(nil)): >> > > auth-client-connection.c:338: 1 Time(s) >> > > dovecot: auth: Warning: Event 0x80aa1c8 leaked (parent=(nil)): >> > > auth-client-connection.c:338: 1 Time(s) >> > > dovecot: auth: Warning: Event 0x80aa718 leaked (parent=(nil)): >> > > auth-client-connection.c:338: 1 Time(s) >> > > dovecot: auth: Warning: Event 0x80adac0 leaked (parent=(nil)): >> > > auth-client-connection.c:338: 1 Time(s) >> > > dovecot: auth: Warning: Event 0x80b6c38 leaked (parent=(nil)): >> > > auth-client-connection.c:338: 1 Time(s) >> > > dovecot: auth: Warning: Event 0x80c0e00 leaked (parent=(nil)): >> > > auth-client-connection.c:338: 1 Time(s) >> > > dovecot: auth: Warning: auth client 0 disconnected with 1 pending >> > > requests: EOF: 12 Time(s) >> > > >> > > >> > > What are they? >> > > >> > > >> > > -- >> > > Mart >> > >> > Hi! It's harmless event leak. This is a known issue to us. > > > ------------------------------ > > Message: 4 > Date: Mon, 05 Nov 2018 18:19:26 -0500 > From: Carl St-Laurent <stlauca(a)a3d-concept.com> > To: dovecot(a)dovecot.org > Subject: dovecot: imap Error: read : Broken pipe > Message-ID: <1700cf4385e77a60415db96fa1c586ac(a)a3d-concept.com> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > Hi everyone, > > I'm trying to find a solution for this bug who appears 2 months ago : > > dovecot: imap(%USER%): Error: read(<binary stream of mailbox INBOX UID > (%d)>) failed: Broken pipe (FETCH BINARY[2] for mailbox INBOX UID (%d) > > Where %USER% is the unix user and %d the UID of the mailbox. > > This error appears each time a user tries to download an attachment > from > one of his emails. Whether with RoundCube or Thunderbird via VPN or > not. > I thought that it was related to my firewall but no. Furthermore the > problem isn't present when users are at the office. Upload speed from > our ADSL connection is pretty slow about 1mpbs, I thought maybe it was > related but it was working fine since 2 years. So I'm really short of > ideas. > > Anyone could help me please ? > > Best regards, > Carl > > > # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.16 (fed8554) > # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 > auth_mechanisms = plain login > disable_plaintext_auth = no > mail_location = maildir:~/Maildir > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > plugin { > sieve = file:~/sieve;active=~/.dovecot.sieve > sieve_after = /etc/dovecot/sieve-after > } > protocols = imap imap > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > service imap-login { > inet_listener imap { > port = 0 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > ssl = required > ssl_ca = </etc/ssl/mail/****.pem > ssl_cert = </etc/ssl/mail/****.pem > ssl_key = # hidden, use -P to show it > userdb { > driver = passwd > } > protocol lmtp { > mail_plugins = sieve > } > protocol lda { > mail_plugins = sieve > } > > > ------------------------------ > > Message: 5 > Date: Mon, 5 Nov 2018 19:28:45 -0500 > From: Felipe Gasper <felipe(a)felipegasper.com> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: dovecot: imap Error: read : Broken pipe > Message-ID: <AAAEBE0C-AF9E-41A4-9BB4-668667E2531D(a)felipegasper.com> > Content-Type: text/plain; charset=utf-8 > > >> On Nov 5, 2018, at 6:19 PM, Carl St-Laurent <stlauca(a)a3d-concept.com> >> wrote: >> >> Hi everyone, >> >> I'm trying to find a solution for this bug who appears 2 months ago : >> >> dovecot: imap(%USER%): Error: read(<binary stream of mailbox INBOX UID >> (%d)>) failed: Broken pipe (FETCH BINARY[2] for mailbox INBOX UID (%d) > > That looks a bit goofy ? read() should never produce EPIPE, AFAIK? > > -F > > ------------------------------ > > Message: 6 > Date: Tue, 6 Nov 2018 08:30:54 +0200 > From: Aki Tuomi <aki.tuomi(a)open-xchange.com> > To: Dovecot Mailing List <dovecot(a)dovecot.org>, Carl St-Laurent > <stlauca(a)a3d-concept.com> > Subject: Re: dovecot: imap Error: read : Broken pipe > Message-ID: <2a43ea13-d043-fd45-119c-0e3e1b8d29cd(a)open-xchange.com> > Content-Type: text/plain; charset=utf-8 > > > On 6.11.2018 2.28, Felipe Gasper wrote: >>> On Nov 5, 2018, at 6:19 PM, Carl St-Laurent <stlauca(a)a3d-concept.com> >>> wrote: >>> >>> Hi everyone, >>> >>> I'm trying to find a solution for this bug who appears 2 months ago : >>> >>> dovecot: imap(%USER%): Error: read(<binary stream of mailbox INBOX >>> UID (%d)>) failed: Broken pipe (FETCH BINARY[2] for mailbox INBOX UID >>> (%d) >> That looks a bit goofy ? read() should never produce EPIPE, AFAIK? >> >> -F > > It is bit strange that you are not experiencing this problem at the > office, but only from remote location(s). This does turn the pointing > finger towards firewall (despite what you said). Can you take pcaps > from > this, since it seems to be reproducible and send them to me privately? > > Aki > > > > ------------------------------ > > Message: 7 > Date: Tue, 6 Nov 2018 08:57:23 +0200 > From: Mart Pirita <sysadmin(a)e-positive.ee> > To: dovecot(a)dovecot.org > Subject: Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): > auth-client-connection.c:338 > Message-ID: <c2cc829e-c66a-73b9-2968-194e8add49ab(a)e-positive.ee> > Content-Type: text/plain; charset=windows-1252 > > Hi, > > > I'm not using rsyslog and instead of hiding, this event leak should be > fixed. > > > > Michael Slusarz wrote: >>> On November 3, 2018 at 9:41 AM Mart Pirita <sysadmin(a)e-positive.ee> >>> wrote: >>> >>> >>> Hi, >>> >>> >>> But this harmless is spamming logs, so how to disable it: >>> >>> grep auth-client-connection.c:338 maillog | wc -l >>> ?? 1259 >> If using something like rsyslog, it is trivial to filter out unwanted >> entries. >> >> michael >> >> >>> Aki Tuomi wrote: >>>>> On 03 November 2018 at 12:12 Mart Pirita < sysadmin(a)e-positive.ee >>>>> <mailto:sysadmin@e-positive.ee>> wrote: >>>>> >>>>> >>>>> Hi, >>>>> >>>>> >>>>> Noticed with latest v2.3.3 some new warning in logs, for example: >>>>> >>>>> dovecot: auth: Warning: Event 0x80a6fc0 leaked (parent=(nil)): >>>>> auth-client-connection.c:338: 1 Time(s) >>>>> dovecot: auth: Warning: Event 0x80aa1c8 leaked (parent=(nil)): >>>>> auth-client-connection.c:338: 1 Time(s) >>>>> dovecot: auth: Warning: Event 0x80aa718 leaked (parent=(nil)): >>>>> auth-client-connection.c:338: 1 Time(s) >>>>> dovecot: auth: Warning: Event 0x80adac0 leaked (parent=(nil)): >>>>> auth-client-connection.c:338: 1 Time(s) >>>>> dovecot: auth: Warning: Event 0x80b6c38 leaked (parent=(nil)): >>>>> auth-client-connection.c:338: 1 Time(s) >>>>> dovecot: auth: Warning: Event 0x80c0e00 leaked (parent=(nil)): >>>>> auth-client-connection.c:338: 1 Time(s) >>>>> dovecot: auth: Warning: auth client 0 disconnected with 1 pending >>>>> requests: EOF: 12 Time(s) >>>>> >>>>> >>>>> What are they? >>>>> >>>>> >>>>> -- >>>>> Mart >>>> Hi! It's harmless event leak. This is a known issue to us. > > > -- > Mart > > > > > ------------------------------ > > Message: 8 > Date: Tue, 6 Nov 2018 09:20:22 +0200 > From: Aki Tuomi <aki.tuomi(a)open-xchange.com> > To: Mart Pirita <sysadmin(a)e-positive.ee>, dovecot(a)dovecot.org > Subject: Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): > auth-client-connection.c:338 > Message-ID: <4baea373-fbc3-e850-044c-d174c3a8c65b(a)open-xchange.com> > Content-Type: text/plain; charset=windows-1252 > > It will be fixed. > > Aki > > On 6.11.2018 8.57, Mart Pirita wrote: >> Hi, >> >> >> I'm not using rsyslog and instead of hiding, this event leak should be >> fixed. >> >> >> >> Michael Slusarz wrote: >>>> On November 3, 2018 at 9:41 AM Mart Pirita <sysadmin(a)e-positive.ee> >>>> wrote: >>>> >>>> >>>> Hi, >>>> >>>> >>>> But this harmless is spamming logs, so how to disable it: >>>> >>>> grep auth-client-connection.c:338 maillog | wc -l >>>> ?? 1259 >>> If using something like rsyslog, it is trivial to filter out unwanted >>> entries. >>> >>> michael >>> >>> >>>> Aki Tuomi wrote: >>>>>> On 03 November 2018 at 12:12 Mart Pirita < sysadmin(a)e-positive.ee >>>>>> <mailto:sysadmin@e-positive.ee>> wrote: >>>>>> >>>>>> >>>>>> Hi, >>>>>> >>>>>> >>>>>> Noticed with latest v2.3.3 some new warning in logs, for example: >>>>>> >>>>>> dovecot: auth: Warning: Event 0x80a6fc0 leaked (parent=(nil)): >>>>>> auth-client-connection.c:338: 1 Time(s) >>>>>> dovecot: auth: Warning: Event 0x80aa1c8 leaked (parent=(nil)): >>>>>> auth-client-connection.c:338: 1 Time(s) >>>>>> dovecot: auth: Warning: Event 0x80aa718 leaked (parent=(nil)): >>>>>> auth-client-connection.c:338: 1 Time(s) >>>>>> dovecot: auth: Warning: Event 0x80adac0 leaked (parent=(nil)): >>>>>> auth-client-connection.c:338: 1 Time(s) >>>>>> dovecot: auth: Warning: Event 0x80b6c38 leaked (parent=(nil)): >>>>>> auth-client-connection.c:338: 1 Time(s) >>>>>> dovecot: auth: Warning: Event 0x80c0e00 leaked (parent=(nil)): >>>>>> auth-client-connection.c:338: 1 Time(s) >>>>>> dovecot: auth: Warning: auth client 0 disconnected with 1 pending >>>>>> requests: EOF: 12 Time(s) >>>>>> >>>>>> >>>>>> What are they? >>>>>> >>>>>> >>>>>> -- >>>>>> Mart >>>>> Hi! It's harmless event leak. This is a known issue to us. >> > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot(a)dovecot.org > https://dovecot.org/mailman/listinfo/dovecot > > ------------------------------ > > End of dovecot Digest, Vol 187, Issue 7 > ***************************************

1 0

dovecot: imap Error: read : Broken pipe
by Carl St-Laurent 06 Nov '18

06 Nov '18

Hi everyone, I'm trying to find a solution for this bug who appears 2 months ago : dovecot: imap(%USER%): Error: read(<binary stream of mailbox INBOX UID (%d)>) failed: Broken pipe (FETCH BINARY[2] for mailbox INBOX UID (%d) Where %USER% is the unix user and %d the UID of the mailbox. This error appears each time a user tries to download an attachment from one of his emails. Whether with RoundCube or Thunderbird via VPN or not. I thought that it was related to my firewall but no. Furthermore the problem isn't present when users are at the office. Upload speed from our ADSL connection is pretty slow about 1mpbs, I thought maybe it was related but it was working fine since 2 years. So I'm really short of ideas. Anyone could help me please ? Best regards, Carl # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after } protocols = imap imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } ssl = required ssl_ca = </etc/ssl/mail/****.pem ssl_cert = </etc/ssl/mail/****.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve }

3 2

imap authentication - shadow vs mysql
by Konra Wawryn 05 Nov '18

05 Nov '18

Hi, I`m looking for some opinions about authentication process for the systems with more than 1000 E-mail accounts. Maybe some one could advise me what is the best authentication method. At the moment I`m storing all passwords in my /etc/passwd. My IMAP server is growing and I`m planning to build new host, my question is: what is the best authentication model for IMAP server ? Do I need to store all user/passwords in mysql or maybe in LDAP ? I`m searching for some solution which will help me to scale my system in the future. Maybe some one could advice me ? Greetings Konrad

2 1

errors in mail.err related with ssl
by Poliman - Serwis 05 Nov '18

05 Nov '18

Hi. I have in mail.err file lines like below: Nov 5 08:40:00 s1 dovecot: imap-login: Error: SSL: Stacked error: error:1407609C:SSL routines:SSL23_GET_CLIENT_HELLO:http request Nov 5 08:40:00 s1 dovecot: imap-login: Error: SSL: Stacked error: error:1408A10B:SSL routines:ssl3_get_client_hello:wrong version number Nov 5 08:40:05 s1 dovecot: pop3-login: Error: SSL: Stacked error: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol Nov 5 08:43:07 s1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408A0C1:SSL routines:ssl3_get_client_hello:no shared cipher Nov 5 08:53:31 s1 dovecot: pop3-login: Error: SSL: Stacked error: error:14094085:SSL routines:ssl3_read_bytes:ccs received early What do the above mean? I suppose that somebody tries connect but uses too old/weak ssl version. -- *Pozdrawiam / Best Regards* *Piotr Bracha*

2 4

error Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=)
by Poliman - Serwis 05 Nov '18

05 Nov '18

I have a problem for specific mailbox. In mail.err file I see a lot: Nov 2 07:41:17 s1 dovecot: imap(artur(a)example.pl): Error: unlink(/var/vmail/example.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Nov 2 07:41:17 s1 dovecot: imap(artur(a)example.pl): Error: Corrupted index cache file /var/vmail/example.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 2356 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Nov 2 07:41:19 s1 dovecot: imap(artur(a)example.pl): Error: unlink(/var/vmail/example.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Nov 2 07:41:19 s1 dovecot: imap(artur(a)example.pl): Error: Corrupted index cache file /var/vmail/example.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 2431 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Nov 2 07:41:21 s1 dovecot: imap(artur(a)example.pl): Error: unlink(/var/vmail/example.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Nov 2 07:41:21 s1 dovecot: imap(artur(a)example.pl): Error: Corrupted index cache file /var/vmail/example.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 2552 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Nov 2 07:41:21 s1 dovecot: imap(artur(a)example.pl): Error: unlink(/var/vmail/example.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Nov 2 07:41:21 s1 dovecot: imap(artur(a)example.pl): Error: Corrupted index cache file /var/vmail/example.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 2605 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Nov 2 07:41:24 s1 dovecot: imap(artur(a)example.pl): Error: unlink(/var/vmail/example.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Nov 2 07:41:24 s1 dovecot: imap(artur(a)example.pl): Error: Corrupted index cache file /var/vmail/example.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 2717 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) I have many mailboxes on the server and each of them work perfectly except this one. -- *Pozdrawiam / Best Regards* *Piotr Bracha*

2 3

doveconf error upon boot up
by Jerry 31 Oct '18

31 Oct '18

FreeBSD 11.1-RELEASE-p9 amd64 doveconf # 2.3.1 (8e2f634): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: FreeBSD 11.1-RELEASE-p9 amd64 zfs # Hostname: localhost I can send the entire output if necessary. Error message upon boot up: doveconf: error: t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: No such file or directory Starting dovecot. Dovecot appears to start correctly There is a link in the "/var/run/dovecot directory for dovecot.conf" lrwx------ 1 root wheel 35B 2018-04-10 10:21:52 EDT dovecot.conf@-> /usr/local/etc/dovecot/dovecot.conf This error message has only started since the update to the latest version of dovecot. I am assuming it is just a harmless error message; however, I would like to confirm that hypothesis. -- Jerry

3 4

OCSP Stapling and Certificate Transparency
by Felipe Gasper 31 Oct '18

31 Oct '18

Hi, For CAs that do not include a signed certificate timestamp in their newly-issued certificates, does Dovecot support either OCSP stapling or the Certificate Transparency TLS extension? If the TLS extension is supported, how does the admin configure the timestamp for each certificate? I’m wondering if any MUAs will follow Google’s lead and insist on CT. Thank you! -Felipe Gasper Mississauga, Ontario

4 3

Copying from a previous Dovecot server
by Peter Lindgren 31 Oct '18

31 Oct '18

Hello! I have installed a new dovecot server on a new server, using imap and Maildir. The old Maildirs are accessible on a mounted disk. I have tried to copy a few folders manually, by first creating the folder on the new server through the a-mail client, and then copying the contents of the cur folder from the old to the new. Works fine, but is a manual process. I'm looking for a way to script this. Is it safe to copy a template folder to a new folder, and then copy the cur folder contents? The files that Dovecot creates in an empty folder have different contents, will Dovecot update them when the user retrieves the mails in that folder? Or, can I just make a symlink to the old Maildir somewhere? Peter -- Peter Lindgren peter(a)norrskenkonsult.com 0703-393940

2 1

[dovecot quota-status] error "Invalid character in path"
by k675154＠keit.eu 31 Oct '18

31 Oct '18

Hello, I'm using using: - dovecot 2.3.3 (dcead646b) - postfix 3.3.1 - dovecot "quota = maildir:User quota" I'm facing the error: "quota-status: Error: quota-status: Client sent invalid recipient address: Invalid character in path" This occurred with this e-mail address: "John Smith"@keit.eu Well I know it is not a conventional address but it is normally perfectly authorized. When I disable quota check, I can received correctly the incoming e-mail. So is there a mean to enable quota check with this kind of e-mail address ? Thanks

2 1

Dovecot submission announces CHUNKING but backend Postfix does not support it
by Michael Goth 30 Oct '18

30 Oct '18

Hello, I'm setting up Dovecot 2.3.2.1 as a submission proxy to a Postfix backend server. Dovecot announces CHUNKING, but the Postfix backend does not support (or announce) it. HELO from Postfix: 220 backend.mydomain.com ESMTP Postfix (Ubuntu) ehlo test 250-backend.mydomain.com 250-PIPELINING 250-SIZE 104857600 250-VRFY 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN HELO from Dovecot proxy: 220 proxy.mydomain.com Dovecot ready. ehlo test 250-proxy.mydomain.com 250-8BITMIME 250-AUTH PLAIN LOGIN 250-BURL imap 250-CHUNKING 250-ENHANCEDSTATUSCODES 250-SIZE 250-STARTTLS 250 PIPELINING When a client sends BDAT, Postfix closes the connection. Here's a log snippet from Postfix: < MAIL FROM:<user(a)mydomain.com> > 250 2.1.0 Ok < RCPT TO:<some(a)recipient.com> > 250 2.1.5 Ok < BDAT 114098 LAST > 502 5.5.2 Error: command not recognized < Content-Type: multipart/alternative; boundary=Apple-Mail-55D35F74-2EB7-4B3B-A607-E421DD71C07A > 221 2.7.0 Error: I can break rules, too. Goodbye. Apple Mail seems to ignore the fact that Postfix does not understand BDAT and Postfix does not like that :-) From a quick glance at the code it seems CHUNKING is always added to the capabilities and that's not configurable. Is this a bug or am I doing something wrong? Thanks, Michael

4 7

Request: option to hide user IP/HELO content from mail sent via submissiond
by Lee Maguire 30 Oct '18

30 Oct '18

For reasons of user privacy and security I usually configure submission servers to not include accurate IP address and HELO information of authenticated users. (Usually replacing it with a private-use domain / IPv6 address.) Dovecot submission (2.3.2) will produce a header something like this (where “10.22.36.10" is a public IP address) Received: from [192.168.1.184] ([10.22.36.10]) by x.example.com with ESMTPSA id xY/yDFD9yVtsFwAARu9lhg (envelope-from <test(a)example.com>) for <test(a)example.net>; Fri, 19 Oct 2018 18:50:40 +0100 It would be good if a local administrator could override the trace “from” content with syntactically valid, but privacy respecting, content. e.g. Received: from submission.local ([fdf7:c4e4:1c1e::10]) by x.example.com with ESMTPSA id xY/yDFD9yVtsFwAARu9lhg (envelope-from <test(a)example.com>) for <test(a)example.net>; Fri, 19 Oct 2018 18:50:40 +0100 RFC 5321 specifies that the “from” MUST exist but only specifies that the content SHOULD be the source host. (Assuming that Submission is “an SMTP environment”. RFC 6409 makes some provision for header rewriting to hide machine names. https://tools.ietf.org/html/rfc6409#section-8.8 ) https://tools.ietf.org/html/rfc5321#section-4.4 The FROM clause, which MUST be supplied in an SMTP environment, SHOULD contain both (1) the name of the source host as presented in the EHLO command and (2) an address literal containing the IP address of the source, determined from the TCP connection.

3 2

Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2)
by Peter Nabbefeld 30 Oct '18

30 Oct '18

Hello, cannot fetch mails from an IMAP folder because of the error in the subject - fetching always stops with SIGABRT. Could anybody help me, please? Kind regards Peter

3 3

Problem with cached userdb info
by Ángel L. Mateo 30 Oct '18

30 Oct '18

Hi, I'm having a problem with my cached userdb information. These are my passdb and userdbs: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf.ext } In /etc/dovecot/dovecot-ldap-userdb.conf.ext (userdb) I have: user_attrs = =user=%{ldap:mail},=quota_rule=%{ldap:quota:*:storage=10G},=home_prefix=/mail/mailboxes/%L{domain},=index_prefix=/mail/indexes/%L{domain},=relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=uuid=%L{ldap:umPersonalUniqueId} user_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%{auth_user})(mail=%{auth_user}))) and in /etc/dovecot/dovecot-ldap.conf.ext (passdb) I have: pass_attrs = =userdb_user=%{ldap:mail},=userdb_quota_rule=%{ldap:quota:*:storage=10G},=userdb_home_prefix=/mail/mailboxes/%L{domain},=userdb_index_prefix=/mail/indexes/%L{domain},=userdb_relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=userdb_uuid=%L{ldap:umPersonalUniqueId},=uuid=%L{ldap:umPersonalUniqueId} pass_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%u)(mail=%u))) The problem I have is that quota information is not updated when I changed in my ldap. These are the steps I'm running: 1. First, I check current quota (dovecot just restarted): amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G in the log I get: Oct 29 14:29:46 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:29:46 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache miss Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): user search: base=ou=Usuarios,dc=Telematica scope=subtree filter=(&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=angel.luis@um.es)(mail=angel.luis@um.es))) fields=mail,quota,umServiceUniqueId,umServiceUniqueId,umPersonalUniqueId Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G; mail,umPersonalUniqueId,quota,umServiceUniqueId unused Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G Oct 29 14:29:46 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef 2. Then I change user quota. 3. And later, I flush auth cache: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm auth cache flush angel.luis(a)um.es 0 cache entries flushed with debug log: Oct 29 14:31:00 myotis60 dovecot: auth: Debug: master in: CACHE-FLUSH#0111#011angel.luis(a)um.es 4. Finally, I get again the quota: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G with debug log: Oct 29 14:31:49 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:31:49 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:31:49 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache hit: quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef Oct 29 14:31:49 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef I'm also confussed about that dovecot is always loggin: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb even if I have made a imap/pop3 before the doveadm user command. Am I doing something wrong? Is there any way to flush this userdb cache (without restarting dovecot)? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

clients out of sync after restoring backup
by Frank-Ulrich Sommer 30 Oct '18

30 Oct '18

Hi, due to a failing disk I had to restore everything from a backup including dovecot (2.2.22) and the Maildir containing the stored mails. A period of some days must later be restored manuall, but that is beyond scope for this question. Naturally this causes confusion for the clients as they keep mails that are no longer on the server. That was expected but what puzzles me is that mails arriving after the succesful restore are only sporadically detected by some clients (e.g. K9 and Thunderbird) that were connected before the crash. A client that was connected for the first time after restoring from the backup works exactly as expected. Might this situation lead to reusing UUIDs that some clients still remember as belonging to a different mail? Is there a clean solution for this on the server side or is it necessary to purge locally stored data by the clients (e.g. by temporarily removing account)? Frank -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.

2 1

Read the quota_exceeded_message from a file
by Maysara A. Abdulhaq 29 Oct '18

29 Oct '18

Greetings, I've been trying to have quota_exceeded_message read from a file according to https://wiki2.dovecot.org/Quota/Configuration#Custom_Quota_Exceeded_Message ; I'm running dovecot 2.2.10 on Centos 7. If I set text right to the equal sign, it works fine, but I'd rather load it from a file as I need a new line and %n and \n and simple \ followed by a newline are not working and would understandably crash the processes if malformed. nothing special about my setting, the file is located in the /etc/dovecot directory but separate from the config files (not in the conf.d directory), with a world readable permission. Regards, M.

4 6

maildirlock time unit?
by Kris von Mach 27 Oct '18

27 Oct '18

What is the time unit maildirlock will accept? I've tried 20s, 20 sec, 20 secs, 20 seconds, all results in: Fatal: Invalid timeout value: 20s And if you don't specify time unit you just get: Panic: BUG: No IOs or timeouts set. Not waiting for infinity. This is on 2.3.3. 2.2 worked fine without needing time unit specified.

3 6

Submission and CHUNKING
by Paul Hecker 26 Oct '18

26 Oct '18

Hi, It seems that there is an issue with the submission service when the SMTP server advertises chunking (I use Exim v4.91). I tried this with Dovecot v2.3.3 and current master and could reproduce it with both versions. My setup is that dovecot submission proxies to Exim on port 10025. The first mail gets through without any issues, but the second email will not get send. I had this issue at first with Apple Mail (it just sends a QUIT and shows an error) and could reproduce it with the OpenDMARC report perl script. You can find a little Perl script attached to reproduce it. It seems to me that Dovecot sends an (unexpected or mixed up) second answer to the client. If I add a “$smtp->getline();” (line 110) sending multiple emails works again. Another workaround is to disable CHUNKING in Exim (in this case only on the “proxy port”): chunking_advertise_hosts = ${if eq{$received_port}{10025}{}{*}} Thanks, Paul

2 1

[sieve] Restrict redirects to only own domain
by Yassine Chaouche 26 Oct '18

26 Oct '18

Hello list, I'd like to let my colleagues redirect mail automatically (via a sieve filter) to other mailboxes within the same domain, but deny redirects to outside mailboxes (gmail, yahoo etc.) since this is considered bad practice and could lead to blacklisting (forwarding spam for example). If I set sieve_max_redirect to 0 then no redirect is allowed, at all. I wish to let redirects to internal mailboxes still possible. Ideas ? Yassine.

3 5

SIGABRT when fetching encrypted mail with getmail
by Peter Nabbefeld 26 Oct '18

26 Oct '18

Hello, I'm stuck with receiving an encrypted email from IMAP server. My getmail configuration is (getmail --dump): getmail configuration: getmail version 5.6 Python version 2.7.15 (default, Jun 27 2018, 13:05:28) [GCC 8.1.1 20180531] retriever: SimpleIMAPSSLRetriever(ca_certs="None", certfile="None", getmaildir="/home/peter/.getmail/", keyfile="None", mailboxes="('ALL',)", move_on_delete="None", password="*", password_command="()", port="993", record_mailbox="True", server="imap.gmx.net", ssl_cert_hostname="None", ssl_ciphers="None", ssl_fingerprints="()", ssl_version="None", timeout="180", use_cram_md5="False", use_kerberos="False", use_peek="True", use_xoauth2="False", username="peter.nabbefeld(a)gmx.de") destination: MDA_external(allow_root_commands="False", arguments="('-e', '-d', 'peter.nabbefeld(a)gmx.de')", command="deliver", group="vmail", ignore_stderr="False", path="/usr/lib/dovecot/deliver", unixfrom="False", user="vmail") options: delete : True delete_after : 0 delete_bigger_than : 0 delivered_to : False fingerprint : False logfile : logfile(filename="~/.getmail/log") max_bytes_per_session : 0 max_message_size : 0 max_messages_per_session : 0 message_log : ~/.getmail/log message_log_syslog : False message_log_verbose : False read_all : True received : False verbose : 1 dovecot.log: Oct 26 07:41:20 lda(peter.nabbefeld(a)gmx.de)<24607><UvPzGACp0lsfYAAA7IIYzw>: Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2) Oct 26 07:41:20 lda(peter.nabbefeld(a)gmx.de)<24607><UvPzGACp0lsfYAAA7IIYzw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe8374) [0x7f9ae5706374] -> /usr/lib/dovecot/libdovecot.so.0(+0xe83b1) [0x7f9ae57063b1] -> /usr/lib/dovecot/libdovecot.so.0(+0x44312) [0x7f9ae5662312] -> /usr/lib/dovecot/libdovecot.so.0(+0x4693f) [0x7f9ae566493f] -> /usr/lib/dovecot/libdovecot.so.0(+0xf98b6) [0x7f9ae57178b6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7f9ae5713a31] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7f9ae5713c56] -> /usr/lib/dovecot/libdovecot.so.0(+0xfebf8) [0x7f9ae571cbf8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7f9ae5713a31] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7f9ae5713c56] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4c) [0x7f9ae57146ec] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_copy+0x8a) [0x7f9ae572ec2a] -> /usr/lib/dovecot/libdovecot.so.0(+0x112c12) [0x7f9ae5730c12] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_send_istream+0x4f) [0x7f9ae572e8bf] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_save_continue+0x2e) [0x7f9ae58a965e] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_continue+0x27) [0x7f9ae58480f7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_continue+0x44) [0x7f9ae5819fb4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xf8) [0x7f9ae580b488] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x59) [0x7f9ae5843ea9] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x3dfc) [0x7f9ae593bdfc] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x10d7c) [0x7f9ae53b0d7c] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x58541) [0x7f9ae581a541] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x4e745) [0x7f9ae3136745] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x50d) [0x7f9ae312c0ad] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x57139) [0x7f9ae313f139] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0xa2) [0x7f9ae3140302] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3d49) [0x7f9ae5609d49] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf9) [0x7f9ae593d219] dovecot --version 2.3.3 (dcead646b) For me, it semms like there's a CRLF expected, but probably it cannot be detected correctly, since the mail is encrypted - but that's only my guess ... Any idea how to fix that? Kind regards Peter

1 0

Shared mailboxes - Can't open mailbox shared-boxes/user/name.lastname: Character not allowed in mailbox name: '.'
by Marcio Vogel Merlone dos Santos 25 Oct '18

25 Oct '18

Hi, I am trying to make shared folders work on my server (Ubuntu 18.04, Dovecot 1:2.2.33.2-1ubuntu4.1). Mails are on Maildir++ local filesystem with '.' as layout separator and ALL 100+ users logins fits a template name.lastname, with a dot in the middle. I set up listescape but no luck. When I test with doveadm: root@mail:/etc/dovecot/conf.d# doveadm acl debug -u marcio.merlone(a)a1.ind.br shared-boxes/user/name.lastname doveadm(marcio.merlone(a)a1.ind.br): Error: Can't open mailbox shared-boxes/user/name.lastname: Character not allowed in mailbox name: '.' root@mail:/etc/dovecot/conf.d# Is there something I can do besides changing layout separator? Full dovecot -n output: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-36-generic x86_64 Ubuntu 18.04.1 LTS ext4 auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = * auth_mechanisms = plain ntlm login gssapi auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.@ auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/acl-dict-sql.conf } disable_plaintext_auth = no dotlock_use_excl = no first_valid_uid = 3000 hostname = smtp.a1.ind.br imap_client_workarounds = tb-extra-mailbox-sep delay-newmail last_valid_uid = 3000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_access_groups = vmail dovecot mail_fsync = always mail_gid = 3000 mail_location = maildir:/mnt/maildirs/%u/Maildir:INDEX=/mnt/maildirs/%u/index mail_plugins = acl mail_privileged_group = vmail mail_server_admin = mailto:postmaster@a1.ind.br mail_uid = 3000 mailbox_list_index = yes mailbox_list_index_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace { list = yes location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl listescape_char = \ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = file:~/Maildir/sieve/;active=~/.dovecot.sieve sieve_before = /etc/dovecot/global.sieve sieve_max_actions = 32 sieve_max_redirects = 4 } postmaster_address = postmaster(a)a1.ind.br protocols = " imap lmtp sieve sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 } service managesieve { process_limit = 1024 } ssl_cert = </etc/letsencrypt/live/imap.a1.ind.br/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4::!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it submission_host = localhost syslog_facility = local1 userdb { args = uid=3000 gid=3000 home=/mnt/maildirs/%Ln mail=maildir:/mnt/maildirs/%Ln/Maildir:INBOX=/mnt/maildirs/%Ln/Maildir allow_all_users=yes driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = acl } protocol lda { mail_plugins = acl quota sieve acl listescape } protocol imap { mail_max_userip_connections = 300 mail_plugins = acl quota imap_quota acl imap_acl listescape } Thanks, best regards. -- *Marcio Merlone*

1 0

Exclude userdb from iterate users
by Ángel L. Mateo 25 Oct '18

25 Oct '18

Hi, I have a system with various userdbs defined, mostly all of them based on ldap (and a few passwd-files). I want one of my ldap userdbs not to be used in "doveadm user -A" commands, that is to be excluded in iterate searchs. I have no iterate_filter neither iterate_attrs configured in that userdb, but it is still used. Is it possible? How? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 1

Disable logging for localhost
by André Rodier 24 Oct '18

24 Oct '18

Hello Everyone, I am using Zabbix to monitor my Dovecot server, and my logs are filled with lines like this: > Oct 21 15:04:46 osaka dovecot[1256]: pop3-login: Aborted login (no auth > attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, > session=<bWd0nr14SuF/AAAB> > Oct 21 15:05:29 osaka dovecot[1256]: imap-login: Aborted login (no auth > attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, > session=<MlAGob147Jd/AAAB> How can I disable logging these actions from 127.0.0.1? Thanks, André -- https://github.com/progmaticltd/homebox

4 5

doveadm backup: Error: Both source and destination mail_location points to same directory
by Martin Johannes Dauser 24 Oct '18

24 Oct '18

Hello! I'm using 2 namespaces, "inbox" for INBOX and it's subfolders and "special" containing folders like Sent, Junk or Drafts. Though both use mdbox I decided to represent those namespaces in different locations "mdbox:~/mail" and "mdbox:~/mail_special_folders". The main reason to use 2 namespaces was to keep special_use folders out of INBOX by using the prefix attribute -- it's rather cosmetic. ├── INBOX │ ├── SubFolder1 │ ├── SubFolder2 │ └── SubFolder3 ├── Sent ├── Trash ├── Drafts ├── Junk ├── Templates ├── This is Ham └── Report Spam Now I want to export the emails of some former users to common known maildir or mbox format to be able to hand them over on CD. The problem is that a conversion with doveadm backup fails. I guess this is due to namespace special which is configured with a manual location attribute instead of utilising mail_location. But even telling doveadm to backup only one namespace leads to the identical error (extract of debug message at bottom). As this is a RHEL7 server, the dovecot version is an old 2.2.10 and I don't expect software debugging -- I just ask if I did some misconfiguration or a failure in the command. I already thought of merging the locations of both namespaces. Yet, I'm not sure how to achieve this. >From /etc/dovecot/conf.d/10-mail.conf mail_location = mdbox:~/mail namespace inbox { type = private hidden = no ignore_on_failure = no inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes } namespace special { type = private hidden = no ignore_on_failure = no inbox = no list = yes location = mdbox:~/mail_special_folders prefix = separator = / subscriptions = yes } HOME is set by LDAP user_attrs = =home=/srv/mail/%Ld/%Ln,=uid=20000,=gid=20000,imapQuota=quota_rule=*:st orage=%$G Identical debug messages of following commands: # dsync -Dv backup -u bob(a)cs.sbg.ac.at maildir:/home/Mailexport/bob or # doveadm -Dv backup -u bob(a)cs.sbg.ac.at maildir:/home/Mailexport/bob or # doveadm -Dv backup -u bob(a)cs.sbg.ac.at -n inbox maildir:/home/Mailexport/bob or # doveadm -Dv backup -u bob(a)cs.sbg.ac.at -n special maildir:/home/Mailexport/bob ... doveadm(bob(a)cs.sbg.ac.at): Debug: Namespace inbox: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mail doveadm(bob(a)cs.sbg.ac.at): Debug: fs: root=/srv/mail/cs.sbg.ac.at/bob/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(bob(a)cs.sbg.ac.at): Debug: Namespace special: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mail_special_folders doveadm(bob(a)cs.sbg.ac.at): Debug: fs: root=/srv/mail/cs.sbg.ac.at/bob/mail_special_folders, index=, indexpvt=, control=, inbox=, alt= doveadm(bob(a)cs.sbg.ac.at): Debug: Namespace INBOX/: Using permissions from /srv/mail/cs.sbg.ac.at/bob/mail: mode=0774 gid=default dsync(bob(a)cs.sbg.ac.at): Debug: Effective uid=20000, gid=20000, home=/srv/mail/cs.sbg.ac.at/bob dsync(bob(a)cs.sbg.ac.at): Debug: Quota root: name=User quota backend=dict args=:file:/srv/mail/cs.sbg.ac.at/bob/dovecot-quota ... dsync(bob(a)cs.sbg.ac.at): Debug: Namespace inbox: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/Mailexport/bob dsync(bob(a)cs.sbg.ac.at): Debug: maildir++: root=/home/Mailexport/bob, index=, indexpvt=, control=, inbox=/home/Mailexport/bob, alt= dsync(bob(a)cs.sbg.ac.at): Debug: Namespace special: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mail_special_folders dsync(bob(a)cs.sbg.ac.at): Debug: fs: root=/srv/mail/cs.sbg.ac.at/bob/mail_special_folders, index=, indexpvt=, control=, inbox=, alt= dsync(bob(a)cs.sbg.ac.at): Error: Both source and destination mail_location points to same directory: /srv/mail/cs.sbg.ac.at/bob/mail_special_folders/mailboxes Many thanks for any hint Martin

1 0

Bug: 'noreplicate' database extra field ingnored
by Phil 22 Oct '18

22 Oct '18

The 'noreplicate' user database field described in the wiki appears to make no difference as to whether an account gets replicated or not. My sql user query returns a 'noreplicate' field and I can confirm that this is getting set using 'doveadm user', however when I add a new account with noreplicate=true it gets replicated regardless. User query: user_query = SELECT home, uid, gid, noreplicate FROM mail_accounts WHERE address = '%u' # doveadm user user1(a)mydomain.com field value uid 1000 gid 1000 home /mail/domains/mydomain.com/user1/Maildir mail maildir:/mail/domains/mydomain.com/user1/Maildir noreplicate t # 2.3.3 (dcead646b): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) # OS: FreeBSD 11.2-RELEASE-p4 amd64 # Hostname: mx doveadm_password = # hidden, use -P to show it doveadm_port = 2727 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep listen = * mail_location = maildir:%h managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_replica = tcps:mail2.<mydomain>.com } protocols = imap lmtp submission replication_full_sync_interval = 6 hours service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { user = vmail } user = root } service doveadm { inet_listener { port = 2727 ssl = yes } } service imap-login { inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 } process_limit = 256 process_min_avail = 6 service_count = 1 vsz_limit = 64 M } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/ssl/certs/mail.<mydomain>.com.pem ssl_client_ca_dir = /etc/ssl/ ssl_client_ca_file = /etc/ssl/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 100 } protocol lda { postmaster_address = postmaster@<mydomain>.com sendmail_path = /usr/sbin/sendmail }

2 2

Calendar function ?
by mca＠caloro.ch 22 Oct '18

22 Oct '18

Hello I running no long time with me Email System Postfix/Dovecot/mysql and i'am whery happy the feature to synchroize Calendar, or view the calender entry from me workpartner i will miss this feature, how do you handle this ? isn't possible to insert this to Dovecot or Postfix? Are this question out of topic ? or how do you implement this in our envirement ? Regards Mauri

15 19

Dovecot 2.2.13 error message
by Albert Whale 19 Oct '18

19 Oct '18

In attempting to reactivate my IMAP communications with my Email Spool (NFS Mounted), I have gotten the following while attempting to download the Emails via POP3. Oct 18 08:00:45 ns4 dovecot: pop3-login: Login: user=<aewhale>, method=PLAIN, rip=74.109.213.194, lip=66.207.133.232 Oct 18 08:02:40 ns4 dovecot: pop3(aewhale): Error: Timeout (180s) while waiting for dotlock for transaction log file /home/aewhale/Maildir/dovecot.index.log Oct 18 08:02:40 ns4 dovecot: pop3(aewhale): Disconnected: Storage error during logout. top=0/0, retr=11511/1566975544, del=11511/11511, size=1566691807 Oct 18 08:02:58 ns4 dovecot: pop3(aewhale): Connection closed top=0/0, retr=0/0, del=0/11520, size=1566929900 This is significantly more information than what I can receive from 2.1.15, but still does not resolve the communications issues. Any help is certainly appreciated. -- Albert E. Whale, CEH CHS CISA CISSP President - Chief Security Officer IT Security, Inc. <http://www.it-security-inc.com/> - A Service Disabled Veteran Owned Company - (SDVOSB) HUBZone Certified LinkedIn <https://www.linkedin.com/in/albertwhale> Profile Phone: 412-515-3010 | Email: Albert.Whale(a)IT-Security-inc.com<br> Cell: 412-889-6870

2 5

Fatal: setgid, imap connections dropped.
by J. de Meijer 19 Oct '18

19 Oct '18

Hi, I'm getting errors with my IMAP setup. Basically, everything seems to work. Mail is delivered nicely from Postfix to Dovecot via LMTP. Dovecot does the authentication to LDAP (also for Postfix). Users are able to send mail via authenticated submission (Postfix) and login into IMAP and POP. However, IMAP connections are dropped frequently with an "ERROR: Connection dropped by IMAP server.". After pressing reload on the webmail, or refreshing in the client might help for a short period. So it fails intermittently. The errors in the maillog are below. It seems to be mixing up users kind of randomly. I think when multiple connections are made at the same time. Did a lot of searching, put couldn't find an answer to this problem. All I can find is related to LDA, which I'm not using. Any help would be appreciated. Errors from the log: Sep 28 00:03:24 mailserver dovecot: imap(userD)<14864><WT8DguF2MspUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:03:24 mailserver dovecot: imap(userD)<17009><recJguF2NMpUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:03:26 mailserver dovecot: imap(userD)<12807><8T0iguF2NspUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:06:59 mailserver dovecot: imap(userD)<15661><UcfOjuF2OcpUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:07:54 mailserver dovecot: imap(userA)<45614><NVkakuF2xO5UUoaT>: Fatal: setgid(1011(userA) from userdb lookup) failed with euid=1012(userD), gid=1012(userD), egid=1012(userD): Operation not permitted (This binary should probably be called with process group set to 1011(userA) instead of 1012(userD)) Sep 28 00:08:08 mailserver dovecot: imap(userF)<45055><AWjtkuF2J/ptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1012(userD), gid=1012(userD), egid=1012(userD): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1012(userD)) Sep 28 00:08:08 mailserver dovecot: imap(userF)<46412><87ntkuF2JvptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1011(userA)) Sep 28 00:08:08 mailserver dovecot: imap(userF)<44858><0nXzkuF2KfptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1012(userD), gid=1012(userD), egid=1012(userD): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1012(userD)) Sep 28 00:08:14 mailserver dovecot: imap(userF)<36517><v/NHk+F2K/ptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1017(userC), gid=1017(userC), egid=1017(userC): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1017(userC)) Sep 28 00:08:36 mailserver dovecot: imap(userF)<10531><wpKdlOF2MfptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1011(userA)) # dovecot --version 2.3.2.1 (0719df592) # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) # OS: FreeBSD 11.2-RELEASE amd64 # Hostname: callisto auth_cache_size = 10 M auth_debug = yes imap_idle_notify_interval = 29 mins mail_debug = yes mail_fsync = never mail_location = maildir:~/Maildir mail_plugins = " fts fts_solr" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = create special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve-after.d sieve_before = /usr/local/etc/dovecot/sieve-before.d sieve_quota_max_storage = 50M } protocols = imap pop3 lmtp sieve service auth { client_limit = 1600 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1, ::1 } process_min_avail = 3 service_count = 1 } service imap { process_min_avail = 3 service_count = 256 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { address = 127.0.0.1, ::1 } service_count = 1 } ssl = required ssl_cert = </usr/local/etc/ssl/mail.demeijer.com.dovecot.crt ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { args = /usr/local/etc/dovecot/dovecot-ldap-user.conf.ext driver = ldap } protocol lda { mail_fsync = optimized mail_plugins = " fts fts_solr sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " fts fts_solr imap_sieve" } protocol lmtp { lmtp_save_to_detail_mailbox = yes mail_fsync = optimized mail_plugins = " fts fts_solr quota sieve" postmaster_address = webmaster(a)example.com } In /usr/local/etc/dovecot/dovecot-ldap.conf.ext: hosts = localhost dn = cn=reader,ou=Roles,dc=example,dc=com dnpass = secretpassword auth_bind = yes base = ou=People,dc=example,dc=com deref = never scope = subtree user_attrs = uid=uid,homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(objectClass=posixAccount)(uid=%n)) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=posixAccount)(uid=%u)) default_pass_scheme = SSHA dovecot-ldap-user.conf.ext is the same as dovecot-ldap.conf.ext # freebsd-version 11.2-RELEASE-p3 Everything is installed from ports.

2 6

trouble with ssl disable in centos 7 with version 1.0 1.2 and 3.10
by Joseph Harth 19 Oct '18

19 Oct '18

I am trying to use dovecot without ssl in centos 7. It works with imap but I am not able to make it work with pop3. Pop3 only works with ssl=yes. I can use dovecot in centos 4 ok. I get the same error with thunderbird and outlook. But for some reason it works when I telnet to port 110 and do retr 1. I was able to work pam and shadow passwords. this is the output that does not work with tls disabled Oct 18 13:30:17 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/authOct 18 13:30:17 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.soOct 18 13:30:17 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.soOct 18 13:30:17 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.datOct 18 13:30:17 auth: Debug: auth client connected (pid=22513)Oct 18 13:30:17 auth: Debug: client in: AUTH 1 PLAIN service=pop3 session=WXv1I4R4FOXAqAAK lip=192.168.0.37 rip=192.168.0.10 lport=110 rport=58644Oct 18 13:30:17 auth: Debug: client passdb out: CONT 1Oct 18 13:30:17 auth: Debug: client in: CONT 1 == (previous base64 data may contain sensitive data)Oct 18 13:30:17 auth-worker(22515): Debug: Loading modules from directory: /usr/lib64/dovecot/authOct 18 13:30:17 auth-worker(22515): Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.soOct 18 13:30:17 auth-worker(22515): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.soOct 18 13:30:17 auth-worker(22515): Debug: shadow(joe2,192.168.0.10,<WXv1I4R4FOXAqAAK>): lookupOct 18 13:30:17 auth: Debug: client passdb out: OK 1 user=joe2Oct 18 13:30:17 auth: Debug: master in: REQUEST 2718302209 22513 1 05eac7a2917ce3bc1f0f359b21b138e6 session_pid=22516Oct 18 13:30:17 auth-worker(22515): Debug: passwd(joe2,192.168.0.10,<WXv1I4R4FOXAqAAK>): lookupOct 18 13:30:17 auth: Debug: master userdb out: USER 2718302209 joe2 system_groups_user=joe2 uid=660 gid=661 home=/home/joe2Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Effective uid=660, gid=661, home=/home/joe2Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail/:INBOX=/var/mail/joe2Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: fs: root=/home/joe2/mail, index=, indexpvt=, control=, inbox=/var/mail/joe2, alt=Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Mailbox INBOX: Mailbox opened because: POP3 INBOXOct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: accessOct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: RETR This is the output with TLS and it works Oct 18 13:30:32 auth: Debug: auth client connected (pid=22542)Oct 18 13:30:33 auth: Debug: client in: AUTH 1 PLAIN service=pop3 secured=tls session=44feJIR4FeXAqAAK lip=192.168.0.37 rip=192.168.0.10 lport=110 rport=58645 ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=ECDH ssl_protocol=TLSv1.2Oct 18 13:30:33 auth: Debug: client passdb out: CONT 1Oct 18 13:30:33 auth: Debug: client in: CONT 1 == (previous base64 data may contain sensitive data)Oct 18 13:30:33 auth-worker(22515): Debug: shadow(joe2,192.168.0.10,<44feJIR4FeXAqAAK>): lookupOct 18 13:30:33 auth: Debug: client passdb out: OK 1 user=joe2Oct 18 13:30:33 auth: Debug: master in: REQUEST 4165992449 22542 1 cb03b70f92c0c5c030e25a39ea4b8518 session_pid=22543Oct 18 13:30:33 auth-worker(22515): Debug: passwd(joe2,192.168.0.10,<44feJIR4FeXAqAAK>): lookupOct 18 13:30:33 auth: Debug: master userdb out: USER 4165992449 joe2 system_groups_user=joe2 uid=660 gid=661 home=/home/joe2Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Effective uid=660, gid=661, home=/home/joe2Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail/:INBOX=/var/mail/joe2Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: fs: root=/home/joe2/mail, index=, indexpvt=, control=, inbox=/var/mail/joe2, alt=Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: Mailbox opened because: POP3 INBOXOct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: accessOct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: RETROct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 31: Opened mail because: accessOct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 31: Opened mail because: RETR

2 1

doveadm expunge with static users
by azurit＠pobox.sk 18 Oct '18

18 Oct '18

Hi, is it possible to use 'doveadm expunge' with static user database? Or can i, somehow, tell dovecot the directory location where i need to do an expunge? Thank you. azur

2 3

Ass(et) protection for mobile users
by Rupert Gallagher 18 Oct '18

18 Oct '18

Hello! Is it possible to hide the public folder when the user is on its mobile phone?

2 6

Problems recovering IMAP Data
by Albert Whale 18 Oct '18

18 Oct '18

HELP, I have experience an issue with the long running IMAP service using Dovecot 2.1.15. I have replaced the interface cards (suspected failure), and I have only recently been able to retrieve my Inbox (1.45GB) via POP3 protocol (I normally run IMAP) I am suspecting a corrupted dovecot.index, but which one? I have counted 260 files in my IMAP tree with the word dovecot. I cannot determine which folder is corrupted with 2.1.5 even with the Mail Debug option. How can I recover the use of my IMAP configuration? Thank you.

2 1

dovecot passdb driver=checkpassword as external script for block ip
by bes 18 Oct '18

18 Oct '18

Refer to https://dovecot.org/pipermail/dovecot/2015-March/099971.html https://wiki.dovecot.org/PasswordDatabase I tried to repeat the same thing. Set these passdb: passdb { args = /myscript.sh ip=%r driver = checkpassword result_failure = return-fail result_success = continue } passdb { args = /etc/dovecot/dovecot-sql.conf.ext ( my working auth method ) driver = sql } Created executable /myscript.sh: #!/bin/sh exit 1 But I saw in the logs: dovecot[15111]: auth: Error: checkpassword(techdept(a)nestormedia.com,192.168.99.128,<Mos6jW94XNzAqGOA>): Child 15115 exited with status 1 dovecot[18016]: imap-login: Login: user=....[successful login] Why result_failure=return-fail from first passdb does not work?

2 2

"Broken MIME parts for mail"
by Poliman - Serwis 18 Oct '18

18 Oct '18

I have many lines like below in error.log file: Oct 16 10:03:22 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Oct 16 10:03:22 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: Corrupted index cache file /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 1019 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: Corrupted index cache file /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 1052 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: Corrupted index cache file /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 1098 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) I didn't do anything with Dovecot neither update in last time nor move files or something. Does anybody could tell me what above means and how to fix it?

1 0

Replication 'noreplicate' field usage
by Phil 17 Oct '18

17 Oct '18

I've set up replication as per the wiki under 2.3.3 and in my SQL user query I am returning a 'noreplicate' field, this is a boolean and returns true for all users at the moment. However when I do "doveadm replicator status '*'" it lists all users in my database suggesting it is trying to sync all users regardless of the noreplicate field. ``` user_query = SELECT home, uid, gid, noreplicate FROM users WHERE address = '%u' ``` It seems that the noreplicate field is being ignored, am I using it correctly?

1 0

: Re: Corrupted dbox file/index
by Raymond Sellars 16 Oct '18

16 Oct '18

>On Mon, Oct 15, 2018 at 08:50:21AM +0000, Raymond Sellars wrote: > > Hi > > Looking for some insight into mdbox index file management and recovery from corruptions. > What version of dovecot and what OS are you running? Is NFS linux/bsd/netapp/etc? [Raymond] Linux 2.6.32-279.19.1.el6.x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) - its selectively patched a little higher than this. nfs-utils-1.2.3-64.el6.x86_64 nfs-utils-lib-1.1.5-11.el6.x86_64 NFS is provided by SAN array. Either Isilon SAN or VNX SAN. I believe the older Isilon with NFS. [Raymond Sellars] fstab: <ip removed>:/ mailshare-isi /mailshare nfs _netdev,noatime,vers=3,rsize=32768,wsize=32768,bg,intr,tcp 0 0 Thanks Raymond

1 0

Corrupted dbox file/index
by Raymond Sellars 15 Oct '18

15 Oct '18

Hi Looking for some insight into mdbox index file management and recovery from corruptions. I have a two node cluster on NFS with proxy director in front for user stickness. One node (a nominated master) bidirectionally replicates to a 3rd node on a DR site. We periodically get index file corruptions resulting in rebuilds. However the user experience is poor as messages read/deleted from months/years ago all reappear as unread again. We've seen corruption because of NFS NTP time sync problems, proxy not being stick, but also the DR node being off line for a while and then tripping corruption within production when it comes back on. Error message example (1 of): Error: Corrupted dbox file /mailshare/.. (removed) ../home/mail/storage/m.4 (around offset=993548): EOF reading msg header (got 0/30 bytes) https://wiki2.dovecot.org/MailboxFormat/dbox- i've read up on all the documentation I can find and understand " you must not lose the dbox index files, they can't be regenerated without data loss." Questions: #1 Any additional tips for avoiding mdbox index corruptions with dsync? Or should I revert to maildir format? I like the performance premise of the mdbox but these index corruptions are a reliability issue. #2 I'm guessing read status is one of the meta data items lost. But its seems it can't recover it from dovecot.index.backup files either. Any technique to preserve that item as its key to the user experience? #3 If index/transaction logs are so critical is there some kind of check point backups I can take? Native dovecot feature or do I need to script something. #4 I've noticed that rebuilding the index does not work if the dovecot.index.log file is lost (deleted as a hard test). The dovecot.index.cache can be but once the log file i gone messages are not automatically (or manually that i can find) recovered from the storage directory. I've not seen any dovecot.index.log file corruptions but that file seems very high risk. If rebuilding the index only from the log file or a combination process from storage directory? Is there perhaps an option to just use the transaction log and not the index? Although that doesn't sound wise for performance. #5 In additional to status UNREAD we also notice files moved to the trash reappear. Is that expected behavior? Thanks Raymond

2 1

Problems with qouta_clone plugin
by Christian Ejlertsen 15 Oct '18

15 Oct '18

Hello I'm having troubles getting the quota_clone plugin to work for me. iø, trying to put the quota values into to to fields, messages and usage_in_bytes, in the mysql database. The quotas are getting written to the maildirsize file and can be updated with the doveadm quota recalc -A or -u "*" command But i can't seem to get it to trigger the quota_clone plugin, not even an error or a warning.. At this point a crash would be preferred since it might yield some information :) It is probably something simple but apparantly i'm failing to see it :) Hope someone can help. ------------- dovecot --version 2.3.2.1 (0719df592) cat dovecot-quota-clone-sql.conf.ext connect = **** map { pattern = priv/quota/storage table = virtual_users value_field = usage_in_bytes username_field = email } map { pattern = priv/quota/messages table = virtual_users value_field = messages username_field = email } # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.11.6.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) nfs4 # Hostname: imap01.ltmail.dk auth_debug = yes dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quotaclone = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } doveadm_password = # hidden, use -P to show it lock_method = dotlock login_trusted_networks = 192.168.100.11/32 192.168.100.16/32 mail_fsync = always mail_location = maildir:/storage/vmail/%d/%n mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota notify replication" mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u mail_replica = tcp:imapb01.litmail.dk:12345 quota = maildir:User quota quota_clone_dict = proxy::quotaclone quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO } protocols = imap replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } user = $default_internal_user } service config { unix_listener config { user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service doveadm { group = vmail inet_listener { port = 12345 } user = vmail } service imap-login { inet_listener imap { port = 143 } process_min_avail = 10 service_count = 0 } service quota-status { client_limit = 1 executable = /usr/libexec/dovecot/quota-status -p postfix inet_listener { port = 12340 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } service stats { unix_listener stats-writer { mode = 0600 user = vmail } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_max_userip_connections = 1000 mail_plugins = " quota notify replication imap_quota last_login quota_clone" } protocol submission { mail_max_userip_connections = 1000 } -- Christian Ejlertsen

2 5

Sieve scripts not replicated
by Pascal 13 Oct '18

13 Oct '18

Hello, I use dovecot replication and the sieve scripts are not replicated. Mail replication is working fine. Log when sieve script (with Rainloop webmail) is created: Oct 12 12:57:57 srv1 dovecot: managesieve-login: Login: user=<hativ(a)example.com>, method=PLAIN, rip=91.67.174.186, lip=195.201.251.57, mpid=5360, TLS, session=<OXvK9QV4fOBbQ666> Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Loading modules from directory: /usr/local/lib/dovecot Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib10_mail_crypt_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib20_quota_clone_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib20_replication_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Quota root: name= backend=count args= Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Quota grace: root= bytes=0 (10%) Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: owner = 1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: owner = 0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: Pigeonhole version 0.5.3 (f018bbab) initializing Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using active Sieve script path: /srv/mail/example.com/hativ/.dovecot.sieve Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using script storage path: /srv/mail/example.com/hativ/sieve Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using permissions from /srv/mail/example.com/hativ/sieve: mode=0700 gid=-1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: sync: Synchronization active Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using Sieve script path: /srv/mail/example.com/hativ/sieve/tmp/rainloop.user_1539341877.M470670P5360.srv1.sieve Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file script: Opened script `rainloop.user' from `/srv/mail/example.com/hativ/sieve/tmp/rainloop.user_1539341877.M470670P5360.srv1.sieve' Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file script: Opened script `rainloop.user' from `/srv/mail/example.com/hativ/sieve/rainloop.user.sieve' Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Disconnected: Logged out bytes=865/124 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: auth PASS input: user=hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth PASS input: user=hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota root: name= backend=count args= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota grace: root= bytes=0 (10%) Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 1 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota root: name= backend=count args= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota grace: root= bytes=0 (10%) Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 1 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Archiv/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Templates/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Offen/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Trash/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Junk/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Sent/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Drafts/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace : Using permissions from /srv/mail/example.com/hativ: mode=0700 gid=default Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared/: Using permissions from : mode=0700 gid=default Oct 12 12:57:57 srv1 dovecot: dsync-local(hativ(a)example.com)<gHffIzV+wFvxFAAA69eCHA>: Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found According to the two lines "Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1" it should work, but the sieve script doesn't show up on the second server. Then I try to change the script (disabling it), here the log: Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: auth PASS input: user=hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth PASS input: user=hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota root: name= backend=count args= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota grace: root= bytes=0 (10%) Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 1 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota root: name= backend=count args= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota grace: root= bytes=0 (10%) Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 1 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Archiv/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Templates/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Offen/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Trash/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Junk/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Sent/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Drafts/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace : Using permissions from /srv/mail/example.com/hativ: mode=0700 gid=default Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared/: Using permissions from : mode=0700 gid=default Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: Pigeonhole version 0.5.3 (f018bbab) initializing Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Using active Sieve script path: /srv/mail/example.com/hativ/.dovecot.sieve Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Using script storage path: /srv/mail/example.com/hativ/sieve Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Using permissions from /srv/mail/example.com/hativ/sieve: mode=0700 gid=-1 Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: sync: Synchronization active Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/default' (last change: 2018-10-12 13:03:59) Maybe the line "Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/default' (last change: 2018-10-12 13:03:59)" gives an hint? root@srv1 ~ # doveadm replicator dsync-status username type status root@srv2 ~ # doveadm replicator dsync-status username type status root@srv1 ~ # doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 5 root@srv2 ~ # doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 5 root@srv1 ~ # doveadm sieve list -u hativ(a)example.com rainloop.user root@srv2 ~ # doveadm sieve list -u hativ(a)example.com Relevant configuration: service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = $mail_uid } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = $mail_uid } } plugin { # Replication mail_replica = tcps:mail2.example.com # Sieve imapsieve_mailbox1_name = Junk imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Junk imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after sieve_before = /etc/dovecot/sieve-before sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin/ sieve_plugins = sieve_extprograms sieve_imapsieve } Greetings Pascal

3 2

Ask for little change :)
by kjonca＠o2.pl 12 Oct '18

12 Oct '18

Is it possible, that dovecot-lmtp, has in inserted "Received:" header something about its version ie. instead: --8<---------------cut here---------------start------------->8--- Received: from alfa.kjonca by alfa.kjonca with LMTP id n1O7D5Q3v1toSQAApvcrCQ (envelope-from <envelope@from>) for <kjonca@localhost>; Thu, 11 Oct 2018 13:44:20 +0200 --8<---------------cut here---------------end--------------->8--- would be: --8<---------------cut here---------------start------------->8--- Received: from alfa.kjonca (Dovecot version) by alfa.kjonca with LMTP id n1O7D5Q3v1toSQAApvcrCQ (envelope-from <envelope@from>) for <kjonca@localhost>; Thu, 11 Oct 2018 13:44:20 +0200 --8<---------------cut here---------------end--------------->8--- KJ -- http://stopstopnop.pl/stop_stopnop.pl_o_nas.html można nie mieć nawet żadnego sensownego argumentu, a dzięki odpowiedniej gestykulacji stworzyć poczucie wiarygodności. Puls Biznesu

2 1

Struggling to get dovecot working with postfix auth
by Laura Smith 11 Oct '18

11 Oct '18

Hi, I am trying to create an authenticated relay server using Postfix and Dovecot. However I am having two problems : (a) If I create a dovecot config entry as follows : unix_listener /var/spool/postfix-authrelay/private/dovecot-auth { group = postfix mode = 0666 user = postfix } Dovecot is unable to create the socket ? I thought surely if dovecot is started as root it should create the socket before dropping privileges ? (b) The alternative method of TCP SASL is not working either: 250 DSN ehlo localhost 250-foobar.example.com 250-PIPELINING 250-SIZE 20480000 250-ETRN 250-AUTH PLAIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN AUTH PLAIN <none_of_your_business> 535 5.7.8 Error: authentication failed: and in the logs... 2018-10-11T10:17:40.491483+01:00 X postfix-authrelay/smtpd[18312]: warning: X[X]: SASL PLAIN authentication failed: #### #### postconf #### >postconf -a cyrus dovecot > postconf -c /etc/postfix-authrelay | fgrep sasl broken_sasl_auth_clients = no cyrus_sasl_config_path = lmtp_sasl_auth_cache_name = lmtp_sasl_auth_cache_time = 90d lmtp_sasl_auth_enable = no lmtp_sasl_auth_soft_bounce = yes lmtp_sasl_mechanism_filter = lmtp_sasl_password_maps = lmtp_sasl_path = lmtp_sasl_security_options = noplaintext, noanonymous lmtp_sasl_tls_security_options = $lmtp_sasl_security_options lmtp_sasl_tls_verified_security_options = $lmtp_sasl_tls_security_options lmtp_sasl_type = cyrus proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $smtpd_sender_login_maps $sender_bcc_maps $recipient_bcc_maps $smtp_generic_maps $lmtp_generic_maps $alias_maps $smtpd_client_restrictions $smtpd_helo_restrictions $smtpd_sender_restrictions $smtpd_relay_restrictions $smtpd_recipient_restrictions $address_verify_sender_dependent_default_transport_maps $address_verify_sender_dependent_relayhost_maps $address_verify_transport_maps $fallback_transport_maps $lmtp_discard_lhlo_keyword_address_maps $lmtp_pix_workaround_maps $lmtp_sasl_password_maps $lmtp_tls_policy_maps $mailbox_command_maps $mailbox_transport_maps $postscreen_discard_ehlo_keyword_address_maps $rbl_reply_maps $sender_dependent_default_transport_maps $sender_dependent_relayhost_maps $smtp_discard_ehlo_keyword_address_maps $smtp_pix_workaround_maps $smtp_sasl_password_maps $smtp_tls_policy_maps $smtpd_discard_ehlo_keyword_address_maps $smtpd_milter_maps $virtual_gid_maps $virtual_uid_maps proxy_write_maps = $smtp_sasl_auth_cache_name $lmtp_sasl_auth_cache_name $address_verify_map $postscreen_cache_map send_cyrus_sasl_authzid = no smtp_sasl_auth_cache_name = smtp_sasl_auth_cache_time = 90d smtp_sasl_auth_enable = no smtp_sasl_auth_soft_bounce = yes smtp_sasl_mechanism_filter = smtp_sasl_password_maps = smtp_sasl_path = smtp_sasl_security_options = noplaintext, noanonymous smtp_sasl_tls_security_options = $smtp_sasl_security_options smtp_sasl_tls_verified_security_options = $smtp_sasl_tls_security_options smtp_sasl_type = cyrus smtpd_recipient_restrictions = permit_mynetworks,permit_sasl_authenticated,reject_unauth_destination smtpd_relay_restrictions = permit_mynetworks,permit_sasl_authenticated,reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = no smtpd_sasl_exceptions_networks = smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = inet:localhost:7425 smtpd_sasl_security_options = noanonymous smtpd_sasl_service = smtp smtpd_sasl_tls_security_options = $smtpd_sasl_security_options smtpd_sasl_type = dovecot #### #### DOVECONF #### > doveconf -n # 2.3.1 (8e2f634): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: Linux 4.12.14-lp150.12.19-default x86_64 # Hostname: test.example.com managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } service auth { inet_listener { address = 127.0.0.1 port = 7425 } inet_listener { address = ::1 port = 7425 } # If I disable this, dovecot loads fine, but the tcp auth is unusable ? # If I enable this, dovecot is unable to create the socket ? # unix_listener /var/spool/postfix-authrelay/private/dovecot-auth { # group = postfix # mode = 0666 # user = postfix # } } ssl = no ssl_cipher_list = ALL:!aNULL:!eNULL:!EXPORT:!DES:!3DES:!MD5:!PSK:!RC4:!ADH:!LOW@STRENGTH ssl_options = no_compression ssl_prefer_server_ciphers = yes userdb { driver = passwd }

5 11

Renewal of Let's Encrypt Certificates in Dovecot
by Ignacio Garcia 11 Oct '18

11 Oct '18

Hi there. I've been using Dovecot for quite some time now but I just started using Let's Encrypt certs. Since LE certs are renewed automatically without user intervention I'm wondering if I will need to restart dovecot after that renewal... Has anybody had any experience with that? Thanks so much for your help! Ignacio

5 5

index corruption weirdness
by William Taylor 10 Oct '18

10 Oct '18

We have started seeing index corruption ever since we upgraded (we believe) our imap servers from SL6 to Centos 7. Mail/Indexes are stored on Netapps mounted via NFS. We have 2 lvs servers running surealived in dr/wlc, 2 directors and 6 backend imap/pop servers. Most of the core dumps I've looked at for different users are like "Backtrace 2" with some variations on folder path. This latest crash (Backtrace 1) is different from others I've seen. It is also leaving 0byte files in the users .Drafts/tmp folder. # ls -s /var/spool/mail/15/00/user1/.Drafts/tmp | awk '{print $1}' |sort | uniq -c 9692 0 1 218600 I believe the number of cores here is different from the number of tmp files because this is when we moved the user to our debug server so we could get the core dumps. # ls -la /home/u/user1/core.* |wc -l 8437 Any help/insight would be greatly appreciated. Thanks, William OS Info: CentOS Linux release 7.5.1804 (Core) 3.10.0-862.14.4.el7.x86_64 NFS: # mount -t nfs |grep mail/15 172.16.255.14:/vol/vol1/mail/15 on /var/spool/mail/15 type nfs (rw,nosuid,nodev,relatime,vers=3,rsize=32768,wsize=32768,namlen=255,hard,nordirplus,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=172.16.255.14,mountvers=3,mountport=4046,mountproto=udp,local_lock=none,addr=172.16.255.14) Dovecot Info: dovecot -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.14.4.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) auth_failure_delay = 0 auth_master_user_separator = * auth_username_format = %Ln auth_verbose = yes auth_verbose_passwords = sha1 auth_worker_max_count = 64 login_log_format_elements = user=<%u> session=%{session} method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 172.16.0/24 mail_debug = yes mail_fsync = always mail_log_prefix = "%s(%u): session=%{session} " mail_plugins = zlib maildir_very_dirty_syncs = yes mmap_disable = yes passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = imap driver = pam } plugin { lazy_expunge = DELETED_MESSAGES. mail_log_events = delete expunge flag_change mail_log_fields = uid box msgid from flags size quota = fs:User quota stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 service anvil { client_limit = 10000 } service auth { client_limit = 10000 vsz_limit = 1 G } service doveadm { inet_listener { port = 1842 } unix_listener doveadm-server { mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 7000 process_min_avail = 32 vsz_limit = 256 M } service imap-postlogin { executable = script-login -d /etc/dovecot/bin/foo-imap-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 7000 vsz_limit = 1492 M } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 2000 process_min_avail = 32 vsz_limit = 256 M } service pop3-postlogin { executable = script-login -d /etc/dovecot/bin/foo-pop3-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin process_limit = 2000 } shutdown_clients = no ssl = required ssl_ca = </etc/dovecot/ssl/imap.foo.com.ca-bundle ssl_cert = </etc/dovecot/ssl/imap.foo.com.crt ssl_key = </etc/dovecot/ssl/imap.foo.com.key ssl_parameters_regenerate = 1 days ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local0 userdb { driver = passwd } verbose_proctitle = yes protocol imap { imap_id_send = support-url support-email imap_max_line_length = 128 k mail_max_userip_connections = 20 mail_plugins = zlib mail_log notify imap_zlib ssl_ca = </etc/dovecot/ssl/imap.foo.com.ca-bundle ssl_cert = </etc/dovecot/ssl/imap.foo.com.crt ssl_key = </etc/dovecot/ssl/imap.foo.com.key } protocol pop3 { mail_plugins = zlib lazy_expunge pop3_fast_size_lookups = yes pop3_uidl_format = %f ssl_ca = </etc/dovecot/ssl/pop.foo.com.ca-bundle ssl_cert = </etc/dovecot/ssl/pop.foo.com.crt ssl_key = </etc/dovecot/ssl/pop.foo.com.key } Backtrace 1: Reading symbols from /usr/libexec/dovecot/imap...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/imap.debug...done. Program terminated with signal 6, Aborted. #0 0x00007fbee47e0277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); Thread 1 (Thread 0x7fbee532f840 (LWP 9449)): #0 0x00007fbee47e0277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 9449 selftid = 9449 #1 0x00007fbee47e1968 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 11 times>, 31683224, 140725444114256, 31908720, 140457858143945, 31683224}}, sa_flags = -457466710, sa_restorer = 0x0} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007fbee4bbdb65 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:191 backtrace = 0x1e372d0 "/usr/lib64/dovecot/libdovecot.so.0(+0x46b55) [0x7fbee4bbdb55] -> /usr/lib64/dovecot/libdovecot.so.0(+0x46c1e) [0x7fbee4bbdc1e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbee4b90dda] -> /usr"... #3 0x00007fbee4bbdc1e in i_internal_fatal_handler (ctx=0x7ffd321b77a0, format=<optimized out>, args=<optimized out>) at failures.c:649 status = 0 #4 0x00007fbee4b90dda in i_panic (format=format@entry=0x7fbee4ee0588 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffd321b7890, reg_save_area = 0x7ffd321b77d0}} #5 0x00007fbee4ea96ad in index_mail_parse_body_finish (mail=0x1e69570, field=field@entry=MAIL_CACHE_FLAGS) at index-mail.c:769 parser_input = 0x1e6e370 ret = 1 __FUNCTION__ = "index_mail_parse_body_finish" #6 0x00007fbee4eaaa2b in index_mail_cache_parse_deinit (_mail=<optimized out>, received_date=<optimized out>, success=<optimized out>) at index-mail.c:1624 mail = <optimized out> #7 0x00007fbee4e5dce3 in maildir_save_finish_real (_ctx=0x1e68560) at maildir-save.c:551 ctx = 0x1e68560 e = 0x1e574d0 output_errno = <optimized out> path = 0x1e37218 "/var/spool/mail/15/00/user1/.Drafts/tmp/1539107164.M157986P9449.debug.imapd.foo.com" real_size = <optimized out> size = 1539107194 #8 maildir_save_finish (ctx=0x1e68560) at maildir-save.c:630 _data_stack_cur_id = 3 #9 0x00007fbee4e90ce6 in mailbox_save_cancel (_ctx=_ctx@entry=0x1e58d58) at mail-storage.c:1697 ctx = 0x1e68560 keywords = 0x1e65860 mail = <optimized out> #10 0x0000000000409459 in cmd_append_continue_message (cmd=0x1e58c10) at cmd-append.c:420 client = 0x1e58070 ctx = 0x1e58d10 size = 31819840 ret = 3920 #11 0x000000000041186c in command_exec (cmd=0x1e58c10) at imap-commands.c:148 hook = 0x1e40d00 ret = <optimized out> #12 0x0000000000408d21 in client_input_append (cmd=0x1e58c10) at cmd-append.c:101 ctx = 0x1e58d10 client = 0x1e58070 finished = <optimized out> __FUNCTION__ = "client_input_append" #13 0x00007fbee4bcaaa7 in io_loop_call_io (io=0x1e58b10) at ioloop.c:379 ioloop = 0x1e3f6a0 t_id = 2 #14 0x00007fbee4bcb857 in io_loop_handler_run (ioloop=ioloop@entry=0x1e3f6a0) at ioloop-epoll.c:213 ctx = 0x1e3fa10 events = <optimized out> list = 0x1e58b60 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999445} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> #15 0x00007fbee4bca628 in io_loop_run (ioloop=0x1e3f6a0) at ioloop.c:398 No locals. #16 0x00007fbee4bb6213 in master_service_run (service=0x1e3f550, callback=callback@entry=0x418fb0 <client_connected>) at master-service.c:544 No locals. #17 0x0000000000408933 in main (argc=2, argv=0x1e3f390) at main.c:389 set_roots = {0x41c320 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x1e37090 "/run/dovecot/auth-master", postlogin_socket_path = 0x1e370c0 "/run/dovecot/imap-postlogin", postlogin_timeout_secs = 60, callback = 0x419440 <login_client_connected>, failure_callback = 0x419150 <login_client_failed>} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> Backtrace 2: Reading symbols from /usr/libexec/dovecot/imap...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/imap.debug...done. Program terminated with signal 6, Aborted. #0 0x00007f437288c277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); Thread 1 (Thread 0x7f43733d3840 (LWP 6725)): #0 0x00007f437288c277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 6725 selftid = 6725 #1 0x00007f437288d968 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 11 times>, 19630744, 140729812750864, 1, 139927665268057, 19630744}}, sa_flags = 1925602218, sa_restorer = 0x0} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007f4372c69a25 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:191 backtrace = 0x12b8ad0 "/usr/lib64/dovecot/libdovecot.so.0(+0x46a15) [0x7f4372c69a15] -> /usr/lib64/dovecot/libdovecot.so.0(+0x46ade) [0x7f4372c69ade] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4372c3cdaa] -> /usr"... #3 0x00007f4372c69ade in i_internal_fatal_handler (ctx=0x7ffe367f9260, format=<optimized out>, args=<optimized out>) at failures.c:649 status = 0 #4 0x00007f4372c3cdaa in i_panic (format=format@entry=0x7f4372f83cc8 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffe367f9350, reg_save_area = 0x7ffe367f9290}} #5 0x00007f4372f77eb8 in keywords_update_records (ext=0x13827e8, ext=0x13827e8, uid2=<optimized out>, uid1=<optimized out>, type=MODIFY_ADD, keyword_idx=0, ctx=0x7ffe367f94e0) at mail-index-sync-keywords.c:228 data = <optimized out> data_mask = 1 '\001' seq1 = 346 view = 0x134c110 rec = <optimized out> data_offset = <optimized out> seq2 = 346 #6 mail_index_sync_keywords (ctx=ctx@entry=0x7ffe367f94e0, hdr=hdr@entry=0x1345bb8, rec=rec@entry=0x13a54e4) at mail-index-sync-keywords.c:304 view = <optimized out> keyword_name = <optimized out> ext = 0x13827e8 uid = <optimized out> end = 0x13a54fc seqset_offset = <optimized out> ext_map_idx = 2 keyword_idx = 0 __FUNCTION__ = "mail_index_sync_keywords" #7 0x00007f4372f78822 in mail_index_sync_record_real (data=0x13a54e4, hdr=0x1345bb8, ctx=0x7ffe367f94e0) at mail-index-sync-update.c:779 rec = 0x13a54e4 ret = 0 #8 mail_index_sync_record (ctx=ctx@entry=0x7ffe367f94e0, hdr=0x1345bb8, data=0x13a54e4) at mail-index-sync-update.c:824 _data_stack_cur_id = 7 ret = 0 #9 0x00007f4372f79866 in mail_index_sync_map (_map=_map@entry=0x1346498, type=type@entry=MAIL_INDEX_SYNC_HANDLER_HEAD, force=force@entry=true) at mail-index-sync-update.c:1036 map = <optimized out> index = 0x1346410 view = 0x134c110 sync_map_ctx = {view = 0x134c110, modseq_ctx = 0x138d330, cur_ext_map_idx = 0, ext_intro_seq = 105, ext_intro_offset = 13792, ext_intro_end_offset = 13820, expunge_handlers = {arr = {buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, extra_contexts = { arr = {buffer = 0x134d8c0, element_size = 8}, v = 0x134d8c0, v_modifiable = 0x134d8c0}, unknown_extensions = 0x0, type = MAIL_INDEX_SYNC_HANDLER_HEAD, sync_handlers_initialized = 0, expunge_handlers_set = 0, expunge_handlers_used = 0, cur_ext_ignore = 0, internal_update = 0, errors = 0} thdr = 0x1345bb8 tdata = 0x13a54e4 prev_seq = 105 start_offset = <optimized out> prev_offset = 14084 ret = <optimized out> had_dirty = <optimized out> reset = false __FUNCTION__ = "mail_index_sync_map" #10 0x00007f4372f6a6e4 in mail_index_map (index=index@entry=0x1346410, type=type@entry=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map-read.c:433 ret = <optimized out> __FUNCTION__ = "mail_index_map" #11 0x00007f4372f65a90 in mail_index_try_open (index=index@entry=0x1346410) at mail-index.c:426 ret = <optimized out> __FUNCTION__ = "mail_index_try_open" #12 0x00007f4372f66130 in mail_index_open_files (index=index@entry=0x1346410, flags=flags@entry=(MAIL_INDEX_OPEN_FLAG_CREATE | MAIL_INDEX_OPEN_FLAG_MMAP_DISABLE | MAIL_INDEX_OPEN_FLAG_DOTLOCK_USE_EXCL)) at mail-index.c:504 ret = <optimized out> created = false #13 0x00007f4372f66230 in mail_index_open (index=0x1346410, flags=flags@entry=(MAIL_INDEX_OPEN_FLAG_CREATE | MAIL_INDEX_OPEN_FLAG_MMAP_DISABLE | MAIL_INDEX_OPEN_FLAG_DOTLOCK_USE_EXCL)) at mail-index.c:594 ret = <optimized out> __FUNCTION__ = "mail_index_open" #14 0x00007f4372f57a17 in index_storage_mailbox_open (box=box@entry=0x1388750, move_to_memory=move_to_memory@entry=false) at index-storage.c:231 ibox = 0x1388b48 index_flags = (MAIL_INDEX_OPEN_FLAG_CREATE | MAIL_INDEX_OPEN_FLAG_MMAP_DISABLE | MAIL_INDEX_OPEN_FLAG_DOTLOCK_USE_EXCL) ret = <optimized out> __FUNCTION__ = "index_storage_mailbox_open" #15 0x00007f4372f03212 in maildir_mailbox_open_existing (box=box@entry=0x1388750) at maildir-storage.c:305 mbox = 0x1388750 #16 0x00007f4372f03960 in maildir_mailbox_open (box=0x1388750) at maildir-storage.c:365 box_path = 0x1388f68 "/var/spool/mail/16/47/user2/DELETED_MESSAGES/.INBOX" root_dir = <optimized out> st = {st_dev = 140729812752383, st_ino = 140729812752416, st_nlink = 19629048, st_mode = 914331680, st_uid = 32766, st_gid = 4300439, __pad0 = 0, st_rdev = 140729812752896, st_size = 1, st_blksize = 133, st_blocks = 19629048, st_atim = {tv_sec = 139927662018357, tv_nsec = 4222451713}, st_mtim = {tv_sec = 139927664838496, tv_nsec = 139927664838496}, st_ctim = {tv_sec = 344592, tv_nsec = -140729812752575}, __unused = {129, 32, 4}} ret = <optimized out> #17 0x00007f436fd13942 in zlib_mailbox_open (box=0x1388750) at zlib-plugin.c:346 zbox = 0x1388e30 #18 0x00007f4372f34cc7 in mailbox_open_full (box=0x1388750, input=0x0) at mail-storage.c:907 _data_stack_cur_id = 6 ret = <optimized out> input = 0x0 box = 0x1388750 #19 0x00007f4372f35070 in mailbox_open (box=box@entry=0x1388750) at mail-storage.c:942 No locals. #20 0x00007f4372f56b2b in index_storage_get_status (box=0x1388750, items=STATUS_UNSEEN, status_r=0x7ffe367f9b40) at index-status.c:41 hdr = <optimized out> __FUNCTION__ = "index_storage_get_status" #21 0x00000000004175f5 in imap_status_get (cmd=0x12d99b0, ns=0x12d8590, mailbox=mailbox@entry=0x13883e0 "DELETED_MESSAGES.INBOX", items=items@entry=0x12d9aec, result_r=result_r@entry=0x7ffe367f9b40, error_r=error_r@entry=0x7ffe367f9b38) at imap-status.c:84 client = 0x12d8e60 box = 0x1388750 error = MAIL_ERROR_NONE ret = 0 #22 0x000000000040bee7 in list_send_status (flags=<optimized out>, mutf7_name=0x12b8548 "DELETED_MESSAGES.INBOX", name=0x13883e0 "DELETED_MESSAGES.INBOX", ctx=0x12d9ad0) at cmd-list.c:466 result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 0, permanent_keywords = 0, allow_new_keywords = 0}, metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_DATE | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_NUL_STATE | MAIL_FETCH_IMAP_BODY | MAIL_FETCH_FROM_ENVELOPE | MAIL_FETCH_HEADER_MD5 | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_MAILBOX_NAME | MAIL_FETCH_GUID | unknown: 16779264)}} ns = <optimized out> error = 0x12b8360 "*" #23 list_namespace_mailboxes (ctx=0x12d9ad0) at cmd-list.c:566 _data_stack_cur_id = 5 info = <optimized out> flags = <optimized out> str = 0x12b83c0 ret = 1 ns = 0x0 mutf7_name = 0x12b8510 name = 0x13883e0 "DELETED_MESSAGES.INBOX" #24 cmd_list_continue (cmd=cmd@entry=0x12d99b0) at cmd-list.c:912 _data_stack_cur_id = 4 ctx = 0x12d9ad0 #25 0x000000000040cb27 in cmd_list_full (cmd=0x12d99b0, lsub=<optimized out>) at cmd-list.c:1092 client = 0x12d8e60 args = 0x12c3968 list_args = 0x12c3a40 arg_count = 0 ctx = 0x12d9ad0 patterns = {arr = {buffer = <optimized out>, element_size = 8}, v = <optimized out>, v_modifiable = <optimized out>} pattern = 0x12b8360 "*" patterns_strarr = <optimized out> str = <optimized out> #26 0x00000000004117fc in command_exec (cmd=cmd@entry=0x12d99b0) at imap-commands.c:148 hook = 0x12c1d00 ret = <optimized out> #27 0x000000000041079b in client_command_input (cmd=cmd@entry=0x12d99b0) at imap-client.c:682 client = 0x12d8e60 command = <optimized out> __FUNCTION__ = "client_command_input" #28 0x0000000000410885 in client_command_input (cmd=0x12d99b0) at imap-client.c:733 client = 0x12d8e60 command = <optimized out> __FUNCTION__ = "client_command_input" #29 0x0000000000410aed in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x12d8e60) at imap-client.c:774 size = 52 #30 client_handle_input (client=client@entry=0x12d8e60) at imap-client.c:786 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #31 0x0000000000411302 in client_input (client=0x12d8e60) at imap-client.c:825 cmd = 0x7f4372c69eae <i_set_failure_prefix+46> output = 0x12dde18 bytes = 52 __FUNCTION__ = "client_input" #32 0x00007f4372c76937 in io_loop_call_io (io=0x12d1150) at ioloop.c:379 ioloop = 0x12c06a0 t_id = 2 #33 0x00007f4372c776e7 in io_loop_handler_run (ioloop=ioloop@entry=0x12c06a0) at ioloop-epoll.c:213 ctx = 0x12c0a10 events = <optimized out> list = 0x12d9900 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999765} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> #34 0x00007f4372c764b8 in io_loop_run (ioloop=0x12c06a0) at ioloop.c:398 No locals. #35 0x00007f4372c62113 in master_service_run (service=0x12c0550, callback=callback@entry=0x418f40 <client_connected>) at master-service.c:544 No locals. #36 0x00000000004088e3 in main (argc=2, argv=0x12c0390) at main.c:389 set_roots = {0x41c2a0 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x12b8090 "/run/dovecot/auth-master", postlogin_socket_path = 0x12b80c0 "/run/dovecot/imap-postlogin", postlogin_timeout_secs = 60, callback = 0x4193d0 <login_client_connected>, failure_callback = 0x4190e0 <login_client_failed>} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

5 6

Problem getting quota-warning script to function.
by Ted 10 Oct '18

10 Oct '18

Hello, I'm trying to implement quota enforcement in our mailservers, and it is all working properly except that the quota warnings are not firing when the quota levels are passed. the server stops accepting email when the quota is reached, and you can see tyhe quota usage through the email client connected through, but as the quota passes the set levels the /usr/local/bin/quota-warning.sh script is not called. I checked from the appropriate user and the script executes from the command line with no problem, but dovecot does not invoke it when the quota levels are crossed. The relevant configs are below, any ideas about what the problem may be or how I should approach this? /etc/dovecot/dovecot.conf ## Dovecot configuration file # Protocols we want to be serving. protocols = imap pop3 lmtp sieve mailbox_list_index = yes # Avoid spending excessive time waiting for the quota calculation to finish when # mails' vsizes aren't already cached. If this many mails are opened, finish the # quota calculation on background in indexer-worker process. Mail deliveries will # be assumed to succeed, and explicit quota lookups will return internal error. # (v2.2.28+) # mail_vsize_bg_after_count = 100 plugin { quota_grace = 10%% # 10% is the default # quota_status_success = DUNNO # quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" quota_vsizes = yes } service quota-status { executable = quota-status -p postfix inet_listener { port = 10070 # You can choose any port you want } client_limit = 1 } mail_plugins = $mail_plugins quota mail_log notify protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_quota } # Greeting message for clients. login_greeting = Welcome to easyMail. # Show more verbose process titles (in ps). Currently shows user name and # IP address. Useful for seeing who are actually using the IMAP processes # (eg. shared mailboxes or if same uid is used for multiple accounts). verbose_proctitle = yes # Should all processes be killed when Dovecot master process shuts down. # Setting this to "no" means that Dovecot can be upgraded without # forcing existing client connections to close (although that could also be # a problem if the upgrade is e.g. because of a security fix). shutdown_clients = yes # A config file can also tried to be included without giving an error if # it's not found: !include_try local.conf service auth { unix_listener auth-master { mode = 0600 user = vmail } } /etc/dovecot/dovecot-sql.conf.ext # Database driver: mysql, pgsql, sqlite driver = mysql connect = host=redacted dbname=redacted user=redacted password=reallyredacted # Default password scheme. # # List of supported schemes is in # http://wiki2.dovecot.org/Authentication/PasswordSchemes # default_pass_scheme = CRYPT password_query = select email as user, crypt_password as password, CONCAT('/',volume,'/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1)) AS home, 5000 AS uid, 5000 AS gid, concat('*:storage=', volume_limit ,'G') AS quota_rule from easymail_users where email = '%u' and banned = '0' and active = '1' user_query = SELECT CONCAT('maildir:/',volume,'/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/Maildir') AS mail, CONCAT('/',volume,'/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1)) AS home, 5000 AS uid, 5000 AS gid, concat('*:storage=', volume_limit ,'G') AS quota_rule from easymail_users where email = '%u' and banned = '0' and active = '1' /etc/dovecot/conf.d/90-quota.conf ## ## Quota configuration. ## ## ## Quota warnings ## # You can execute a given command when user exceeds a specified quota limit. # Each quota root has separate limits. Only the command for the first # exceeded limit is excecuted, so put the highest limit first. # The commands are executed via script service by connecting to the named # UNIX socket (quota-warning below). # Note that % needs to be escaped as %%, otherwise "% " expands to empty. plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=80%% quota-warning 80 %u } # Example quota-warning service. The unix listener's permissions should be # set in a way that mail processes can connect to it. Below example assumes # that mail processes run as vmail user. If you use mode=0666, all system users # can generate quota warnings to anyone. service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = dovecot unix_listener quota-warning { user = dovecot mode = 0666 } } ## ## Quota backends ## # Multiple backends are supported: # dirsize: Find and sum all the files found from mail directory. # Extremely SLOW with Maildir. It'll eat your CPU and disk I/O. # dict: Keep quota stored in dictionary (eg. SQL) # maildir: Maildir++ quota # fs: Read-only support for filesystem quota plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota quota = count:User quota #quota = fs:User quota } /usr/local/bin/quota-warning.sh #!/bin/sh # warning email for approaching their quota usage=$1 email=$2 /usr/bin/mailx -r "support(a)easydns.com" -s "Quota Usager Notification" "${email:?}" < /home/vmail/quota"${usage:?}".txt echo "$(date) ${usage} : ${email}" >> /var/log/quotatest.log Thank you Ted easyDNS Technologies

3 9

immediate delete of mails
by tselmeci＠486.hu 10 Oct '18

10 Oct '18

Hello all! I've got a home server running on an ARM Cortex-A7 with my custom Linux distribution. It's also responsible for handling incoming and outgoing mails. The SMTP server is OpenSMTPD-6.0.3p1. I'm using Dovecot-2.3.2.1 to export the mails (mailbox storage format) using IMAP. My old server used to have Dovecot-1.2.0 and honestly, it was absolutely sufficient for me. However, I've decided to use the latest Dovecot on my new system, since all other software components of my system are up-to-date. With my simple IMAP-configuration Dovecot is running fine, expect for one thing: when I press DEL in the mailer client, the mails don't get deleted. They simple reside in the mailbox file. It annoys me a lot, since the mailer client regularly makes them appear with a different (grey) color. The mailer client is Sylpheed and I'm not willing to use another one. I've already tried Thunderbird, Evolution, Claws-mail, Sylpheed, and Sylpheed suits best to my needs. The funny thing is that with the same Sylpheed the old Dovecot was willing to physically remove the mails from mailbox file, but the new Dovecot isn't willing to do so. I've tried to search for an appropriate configuration option, but didn't find what I exactly need. Auto expunge, command-line expunging are nice, but I do want immediate mail delete from mailbox file when I press DEL in the mailer client. I know this can be dangerous and degrades performance. Is there any option to configure Dovecot to behave like this? If it needs to recompile Dovecot I'm also in ;) Thanks a lot! ----------------------------------------------- dovecot -n output: # 2.3.2.1 (0719df592): /etc/dovecot.conf # OS: Linux 4.18.9 armv7l # Hostname: 486 auth_mechanisms = plain login base_dir = /var/run/dovecot/ default_client_limit = 30 default_process_limit = 10 disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.txt mail_gid = 0 mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mail_uid = 0 namespace { hidden = no inbox = yes list = yes location = mailbox { auto = create special_use = \Drafts name = Drafts } mailbox { auto = create special_use = \Sent name = Sent } mailbox { auto = create special_use = \Trash name = Trash } prefix = type = private name = inbox } passdb { driver = passwd } passdb { driver = shadow } protocols = imap service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict-async { name = dict-async } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap-hibernate { name = imap-hibernate } service imap { name = imap-login } service imap-urlauth { name = imap-urlauth-login } service imap-urlauth-worker { name = imap-urlauth-worker } service token-login/imap-urlauth { name = imap-urlauth } service imap-master { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service old-stats-mail { name = old-stats } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator-doveadm { name = replicator } service stats-reader { name = stats } service submission { name = submission-login } service login/submission { name = submission } ssl = no submission_max_mail_size = 0 userdb { driver = passwd } verbose_proctitle = yes -- Selmeci, Tamás http://www.486.hu/

9 16

Submission / Postfix / XCLIENT
by Anton Dollmaier 09 Oct '18

09 Oct '18

Hi all, while testing the new Dovecot Submission Proxy feature, which we greatly appreciate and have been anticipating for a long time, some issues occured. Dovecot is unable to submit mails via XCLIENT: < XCLIENT ADDR=185.115.176.12PORT=39074 > 501 5.5.4 Bad ADDR syntax: 185.115.176.12PORT=39074 Postfix is unable to parse the XCLIENT command from Dovecot submission proxy, as a space seems to be missing. After checking the source code, the issue looks easy to fix - at least to me as a non-Developer. I created my first pull request for that: > https://github.com/dovecot/core/pull/90 Would be great to see this merged. Any additional comments are also appreciated. Best, Anton

2 1

iterate query and dsync replication 2.2.33.2
by Matt Bryant 08 Oct '18

08 Oct '18

All, According to doco replication gets its list of users to replicate from the iterate query but this doesn't seem to be the case or its just being totally ignored .. Have ldap passbd and sql userdb, with the iterate query in the userdb sql file. -The query itself returns the handful of users I want to replicate BUT if I run the command dovecot replicator status '*' it shows pretty much all users in the system .. is there a bug here or is documentation just completely wrong when it comes to what is/is not replicated. rgds Matt

1 0

VOLATILEDIR not really used?
by Tom Sommer 08 Oct '18

08 Oct '18

Hi According to the docs, setting VOLATILEDIR will improve I/O performance when using NFS - but as far as I can see, only vsize lock-files are put here, and little else? Is this correct, and if so are there any plans to move dotlocks etc. to this directory? Thanks. -- Tom

2 7

Dovecot -v 2.2.27 (c0f36b0): Outgoing mail server fails
by Tommy Lane 07 Oct '18

07 Oct '18

Hello Everyone, I'm having an issue with a recent install of postfix and Dovecot. I can authenticate without any issues for "incoming" mail server, but when I attempt to send an email from the account my client gives an auth error. the server shows that I was authed using plain-auth, which I would also like to change as these machines are accross the open internet. Any help would be greatly appreciated. -Tommy

3 3

TLS handshake failure - Client Helo rejected
by VB 07 Oct '18

07 Oct '18

Hi, I can no longer connect to Dovecot (IMAP). The connection is terminated by Dovecot after Client Helo. My server: Dovecot 2.3.3 Debian buster/sid Architecture: ppc My problems started in late August after upgrading Dovecot. SSL settings: ssl_dh = </etc/ssl/dh2048.pem ssl_min_protocol = TLSv1.2 ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_prefer_server_ciphers = yes Client: OS Android 6.0.1 Aquamail Log from Dovecot: Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL: where=0x10, ret=1: before SSL initialization Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL: where=0x2002, ret=-1: before SSL initialization Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL alert: where=0x4008, ret=598: fatal unknown Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL: where=0x2002, ret=-1: error Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL error: SSL_accept() failed: error:14209175:SSL routines:tls_early_post_process_client_hello:inappropriate fallback Sep 15 23:19:02 debian2 dovecot: imap-login: Debug: SSL error: SSL_accept() syscall failed: Invalid argument Sep 15 23:19:02 debian2 dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=XXX.XXX.XXX.XXX, lip=XXX.XXX.XXX.XXX,TLS handshaking: SSL_accept() syscall failed: Invalid argument, session=<XXXXXXXXXXX> Log from client (Aquamail) is a bit longer (see attachment). I have also listened to the communication using Wireshark. The last piece of communication is Client Helo. After the client sends Client Helo, there is no reply from Dovecot and the server closes the communication. This is the Client Helo, in the "structured view" iin Wireshark: |Secure Sockets Layer TLSv1 Record Layer: Handshake Protocol: Client Hello Content Type: Handshake (22) Version: TLS 1.0 (0x0301) Length: 176 Handshake Protocol: Client Hello Handshake Type: Client Hello (1) Length: 172 Version: TLS 1.2 (0x0303) Random: 2b7af5ba92040f081a5a3621e9d9cbab2d50b829b7fe755f... Session ID Length: 0 Cipher Suites Length: 62 Cipher Suites (31 suites) Cipher Suite: TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (0xc030) Cipher Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (0xc02f) Cipher Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 (0xc02c) Cipher Suite: TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256 (0xc02b) Cipher Suite: TLS_DHE_RSA_WITH_AES_256_GCM_SHA384 (0x009f) Cipher Suite: TLS_DHE_RSA_WITH_AES_128_GCM_SHA256 (0x009e) Cipher Suite: TLS_RSA_WITH_AES_256_GCM_SHA384 (0x009d) Cipher Suite: TLS_RSA_WITH_AES_128_GCM_SHA256 (0x009c) Cipher Suite: TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384 (0xc028) Cipher Suite: TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA (0xc014) Cipher Suite: TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384 (0xc024) Cipher Suite: TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA (0xc00a) Cipher Suite: TLS_RSA_WITH_AES_256_CBC_SHA256 (0x003d) Cipher Suite: TLS_RSA_WITH_AES_256_CBC_SHA (0x0035) Cipher Suite: TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 (0xc027) Cipher Suite: TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA (0xc013) Cipher Suite: TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256 (0xc023) Cipher Suite: TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA (0xc009) Cipher Suite: TLS_RSA_WITH_AES_128_CBC_SHA256 (0x003c) Cipher Suite: TLS_RSA_WITH_AES_128_CBC_SHA (0x002f) Cipher Suite: TLS_DHE_RSA_WITH_AES_256_CBC_SHA256 (0x006b) Cipher Suite: TLS_DHE_RSA_WITH_AES_256_CBC_SHA (0x0039) Cipher Suite: TLS_DHE_RSA_WITH_AES_128_CBC_SHA256 (0x0067) Cipher Suite: TLS_DHE_RSA_WITH_AES_128_CBC_SHA (0x0033) Cipher Suite: TLS_ECDHE_RSA_WITH_RC4_128_SHA (0xc011) Cipher Suite: TLS_ECDHE_ECDSA_WITH_RC4_128_SHA (0xc007) Cipher Suite: TLS_RSA_WITH_RC4_128_SHA (0x0005) Cipher Suite: TLS_RSA_WITH_RC4_128_MD5 (0x0004) Cipher Suite: TLS_RSA_WITH_3DES_EDE_CBC_SHA (0x000a) Cipher Suite: TLS_EMPTY_RENEGOTIATION_INFO_SCSV (0x00ff) Cipher Suite: TLS_FALLBACK_SCSV (0x5600) Compression Methods Length: 1 Compression Methods (1 method) Extensions Length: 69 Extension: server_name (len=17) Extension: extended_master_secret (len=0) Extension: signature_algorithms (len=22) Type: signature_algorithms (13) Length: 22 Signature Hash Algorithms Length: 20 Signature Hash Algorithms (10 algorithms) Signature Algorithm: rsa_pkcs1_sha512 (0x0601) Signature Algorithm: ecdsa_secp521r1_sha512 (0x0603) Signature Algorithm: rsa_pkcs1_sha384 (0x0501) Signature Algorithm: ecdsa_secp384r1_sha384 (0x0503) Signature Algorithm: rsa_pkcs1_sha256 (0x0401) Signature Algorithm: ecdsa_secp256r1_sha256 (0x0403) Signature Algorithm: SHA224 RSA (0x0301) Signature Algorithm: SHA224 ECDSA (0x0303) Signature Algorithm: rsa_pkcs1_sha1 (0x0201) Signature Algorithm: ecdsa_sha1 (0x0203) | |What I tried: | * |change all possible settings in Dovecot (ssl_min_protocol, ssl_cipher_list ...)| * |change certificate I use| |I also got in touch with the developer of Aquamail (see our discussion here: https://www.aqua-mail.com/forum/index.php?topic=6824.0 ).| |The developer was able to reproduce the handshake error. We believe that the problem is that Dovecot rejects ClientHello as long as it is wrapped in the TLSv1 Record Layer (see the second lilne in the Wireshark log). According to the developer, Dovecot should accept Client Helo wrapped in the TLSv1 Record Layer.| |Thank you very much for your help. Best regards VB |

2 1

doveadm quota error output in some cases
by Kai Schaetzl 05 Oct '18

05 Oct '18

I am testing a special setup on one machine where I want to put some local users that get mail locally to /home user directories via postfix transport map local: for historical and practical reasons. Other users are setup as virtual users. The local users are *also* setup as virtual users for dovecot so that I can retrieve the mail via dovecot. I changed the SQL for dovecot user_query, so that it gets the local uid and gid (and doesn't use vmail) and also gets the home directory in /home for only those users. After a bit of experimenting this works fine and I can retrieve mail via dovecot. However, there are two problems with quota and one of them has "doveadm get quota" spew out a lot of garbage that I think should actually go to a log and not to the program output. When I run a doveadm quota get -A or -u user I get four errors of this kind (for user/domain storage and message limit) for each special user: doveadm(user): Error: Failed to get quota resource STORAGE: quota-dict: dict_lookup(priv/quota/storage) failed: net_connect_unix (/var/run/dovecot/dict) failed: Permission denied (euid=500(user) egid=200(vmail) missing +r perm: /var/run/dovecot/dict, dir owned by 0:0 mode=0755) (reply took 0.000 secs (0.000 in dict wait, 0.000 in other ioloops, 0.000 in locks)) Then the normal program output follows, with error lines for these special users, of course: user STORAGE error error error The reason is that /var/run/dovecot/dict is owned by vmail:vmail (not root:root as the 0:0 suggests). I don't see a way to change this without blocking the "real" virtual users that use vmail:vmail. Shouldn't this massive error output rather go to a log? (dovecot/error.log) Or: is there a way to avoid this? /var/run/dovecot/dict is a socket. I didn't want to fiddle with it. Can I change the permissions so that it can also be accessed by other system users? Probably only to make it world-readable? If so, what are the implications of doing that? Thanks, Kai

1 1

Username aliases
by Eirik Rye 05 Oct '18

05 Oct '18

Hi, Our organization is currently using a passwd-file user database for our Dovecot installs. However, we now want to provide simple username aliases. We currently use usernames that are -not- equal to the email address, but due to the fact that many major email clients/providers do not even allow you to specifiy a username, we now want to provide aliases where the username is equal to the email address. A simple solution would be to duplicate the lines in the passwd-file, with the email address as the username, but this does not seem be ideal due to data duplication. Ideally, there would be a secondary 'alias' userdb, which on a match would then restart the search in the primary passwd-file userdb using the new username. Is this possible? What would be the best way to go about this?

4 6

vpopmail
by Eric Broch 04 Oct '18

04 Oct '18

Hello list, I run Dovecot with the vpopmail driver and have found that it authenticates against the clear text password in the vpopmail database. Is there a configuration option either at compile time, link time, or a setting in one of the configuration files that tells the program to authenticate against the hash instead of the clear text? -- Eric Broch White Horse Technical Consulting (WHTC)

3 9

Re: [ceph-users] dovecot + cephfs - sdbox vs mdbox
by Webert de Souza Lima 04 Oct '18

04 Oct '18

Thanks Jack. That's good to know. It is definitely something to consider. In a distributed storage scenario we might build a dedicated pool for that and tune the pool as more capacity or performance is needed. Regards, Webert Lima DevOps Engineer at MAV Tecnologia *Belo Horizonte - Brasil* *IRC NICK - WebertRLZ* On Wed, May 16, 2018 at 4:45 PM Jack <ceph(a)jack.fr.eu.org> wrote: > On 05/16/2018 09:35 PM, Webert de Souza Lima wrote: > > We'll soon do benchmarks of sdbox vs mdbox over cephfs with bluestore > > backend. > > We'll have to do some some work on how to simulate user traffic, for > writes > > and readings. That seems troublesome. > I would appreciate seeing these results ! > > > Thanks for the plugins recommendations. I'll take the change and ask you > > how is the SIS status? We have used it in the past and we've had some > > problems with it. > > I am using it since Dec 2016 with mdbox, with no issue at all (I am > currently using Dovecot 2.2.27-3 from Debian Stretch) > The only config I use is mail_attachment_dir, the rest lies as default > (mail_attachment_min_size = 128k, mail_attachment_fs = sis posix, > ail_attachment_hash = %{sha1}) > The backend storage is a local filesystem, and there is only one Dovecot > instance > > > > > Regards, > > > > Webert Lima > > DevOps Engineer at MAV Tecnologia > > *Belo Horizonte - Brasil* > > *IRC NICK - WebertRLZ* > > > > > > On Wed, May 16, 2018 at 4:19 PM Jack <ceph(a)jack.fr.eu.org> wrote: > > > >> Hi, > >> > >> Many (most ?) filesystems does not store multiple files on the same > block > >> > >> Thus, with sdbox, every single mail (you know, that kind of mail with 10 > >> lines in it) will eat an inode, and a block (4k here) > >> mdbox is more compact on this way > >> > >> Another difference: sdbox removes the message, mdbox does not : a single > >> metadata update is performed, which may be packed with others if many > >> files are deleted at once > >> > >> That said, I do not have experience with dovecot + cephfs, nor have made > >> tests for sdbox vs mdbox > >> > >> However, and this is a bit out of topic, I recommend you look at the > >> following dovecot's features (if not already done), as they are awesome > >> and will help you a lot: > >> - Compression (classic, https://wiki.dovecot.org/Plugins/Zlib) > >> - Single-Instance-Storage (aka sis, aka "attachment deduplication" : > >> https://www.dovecot.org/list/dovecot/2013-December/094276.html) > >> > >> Regards, > >> On 05/16/2018 08:37 PM, Webert de Souza Lima wrote: > >>> I'm sending this message to both dovecot and ceph-users ML so please > >> don't > >>> mind if something seems too obvious for you. > >>> > >>> Hi, > >>> > >>> I have a question for both dovecot and ceph lists and below I'll > explain > >>> what's going on. > >>> > >>> Regarding dbox format (https://wiki2.dovecot.org/MailboxFormat/dbox) > >> when > >>> using sdbox, a new file is stored for each email message. > >>> When using mdbox, multiple messages are appended to a single file until > >> it > >>> reaches/passes the rotate limit. > >>> > >>> I would like to understand better how the mdbox format impacts on IO > >>> performance. > >>> I think it's generally expected that fewer larger file translate to > less > >> IO > >>> and more troughput when compared to more small files, but how does > >> dovecot > >>> handle that with mdbox? > >>> If dovecot does flush data to storage upon each and every new email is > >>> arrived and appended to the corresponding file, would that mean that it > >>> generate the same ammount of IO as it would do with one file per > message? > >>> Also, if using mdbox many messages will be appended to a said file > >> before a > >>> new file is created. That should mean that a file descriptor is kept > open > >>> for sometime by dovecot process. > >>> Using cephfs as backend, how would this impact cluster performance > >>> regarding MDS caps and inodes cached when files from thousands of users > >> are > >>> opened and appended all over? > >>> > >>> I would like to understand this better. > >>> > >>> Why? > >>> We are a small Business Email Hosting provider with bare metal, self > >> hosted > >>> systems, using dovecot for servicing mailboxes and cephfs for email > >> storage. > >>> > >>> We are currently working on dovecot and storage redesign to be in > >>> production ASAP. The main objective is to serve more users with better > >>> performance, high availability and scalability. > >>> * high availability and load balancing is extremely important to us * > >>> > >>> On our current model, we're using mdbox format with dovecot, having > >>> dovecot's INDEXes stored in a replicated pool of SSDs, and messages > >> stored > >>> in a replicated pool of HDDs (under a Cache Tier with a pool of SSDs). > >>> All using cephfs / filestore backend. > >>> > >>> Currently there are 3 clusters running dovecot 2.2.34 and ceph Jewel > >>> (10.2.9-4). > >>> - ~25K users from a few thousands of domains per cluster > >>> - ~25TB of email data per cluster > >>> - ~70GB of dovecot INDEX [meta]data per cluster > >>> - ~100MB of cephfs metadata per cluster > >>> > >>> Our goal is to build a single ceph cluster for storage that could > expand > >> in > >>> capacity, be highly available and perform well enough. I know, that's > >> what > >>> everyone wants. > >>> > >>> Cephfs is an important choise because: > >>> - there can be multiple mountpoints, thus multiple dovecot instances > on > >>> different hosts > >>> - the same storage backend is used for all dovecot instances > >>> - no need of sharding domains > >>> - dovecot is easily load balanced (with director sticking users to the > >>> same dovecot backend) > >>> > >>> On the upcoming upgrade we intent to: > >>> - upgrade ceph to 12.X (Luminous) > >>> - drop the SSD Cache Tier (because it's deprecated) > >>> - use bluestore engine > >>> > >>> I was said on freenode/#dovecot that there are many cases where SDBOX > >> would > >>> perform better with NFS sharing. > >>> In case of cephfs, at first, I wouldn't think that would be true > because > >>> more files == more generated IO, but thinking about what I said in the > >>> beginning regarding sdbox vs mdbox that could be wrong. > >>> > >>> Any thoughts will be highlt appreciated. > >>> > >>> Regards, > >>> > >>> Webert Lima > >>> DevOps Engineer at MAV Tecnologia > >>> *Belo Horizonte - Brasil* > >>> *IRC NICK - WebertRLZ* > >>> > >>> > >>> > >>> _______________________________________________ > >>> ceph-users mailing list > >>> ceph-users(a)lists.ceph.com > >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >>> > >> > >> _______________________________________________ > >> ceph-users mailing list > >> ceph-users(a)lists.ceph.com > >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >> > > > >

1 1

Re: Bug reports - auth is broken in Dovecot 2.3.3
by Berindeie Avram-Teodor 04 Oct '18

04 Oct '18

> > I do not have downloaded the source from GitHub. > > On Wed, Oct 3, 2018 at 1:53 PM Timo Sirainen <tss(a)iki.fi> wrote: > >> On 3 Oct 2018, at 13.22, Berindeie Avram-Teodor <berindeie.teo(a)gmail.com> >> wrote: >> > >> > I applied the patch and recompiled but nothing resolved. >> > What else can I do? >> >> You also need to run autogen.sh & configure again. >> >>

4 5

Re: Dovecot User Listing Error - getpwent() failed: Invalid Argument
by Reuben Farrelly 04 Oct '18

04 Oct '18

Sure: https://www.reub.net/files/dovecot/lightning-dovecot.conf https://www.reub.net/files/dovecot/thunderstorm-dovecot.conf Updated nightly. Reuben On 1/09/2018 12:26 am, Aki Tuomi wrote: > Can you provide doveconf -n? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > Date: 31/08/2018 17:12 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi>, Dovecot Mailing List > <dovecot(a)dovecot.org> > Subject: Re: Dovecot User Listing Error - getpwent() failed: Invalid > Argument > > No. Neither of those are installed on either system. > > Reuben > > On 1/09/2018 12:09 am, Aki Tuomi wrote: > > Could apparmor or selinux be causing this! > > > > > > > > --- > > Aki Tuomi > > Dovecot oy > > > > -------- Original message -------- > > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > > Date: 31/08/2018 16:50 (GMT+02:00) > > To: Dovecot Mailing List <dovecot(a)dovecot.org> > > Subject: Dovecot User Listing Error - getpwent() failed: Invalid Argument > > > > Hi, > > > > I'm running dovecot-2.3 git and seeing on 2 of my Dovecot installations, > > the following message logged quite frequently: > > > > Aug 31 16:55:53 lightning.reub.net dovecot[7698]: auth-worker(7707): > > Error: getpwent() failed: Invalid argument > > Aug 31 16:55:53 lightning.reub.net dovecot[7698]: replicator: Error: > > User listing returned failure > > Aug 31 16:55:53 lightning.reub.net dovecot[7698]: replicator: Error: > > listing users failed, can't replicate existing data > > > > It appears that this could be having an effect on replication, but it's > > unclear because the secondary/replica doesn't see much traffic. > > > > Authentication is via PAM and the system is Gentoo Linux x86_64. passb > > driver = pam, userdb driver = static . > > > > doveadm user -u '*' shows the system users listed twice like this (is > > this a problem?) and then prints: > > > > ---- > > reuben > > liam > > reuben > > liam > > <some other users> > > Error: User listing returned failure > > Fatal: user listing failed > > ---- > > > > To me that doesn't look right. > > > > Can anyone suggest what could be causing this? I don't recall seeing > > this message some time ago so I suspect it's a recent change in either > > dovecot, or pam or glibc etc.. > > > > Thanks, > > Reuben

2 10

Authenticate users using their firstname
by Fady AL HAYALI 04 Oct '18

04 Oct '18

Hi, I'm setting up a Postfic and Dovecot with LDAP email server. My users in LDAP is like this: dn: uid=firstname,ou=People,dc=domain,dc=com uid: firstname uidNumber: 4025 gidNumber: 4025 givenName: firstname objectClass: top objectClass: person objectClass: posixAccount objectClass: shadowAccount objectClass: organizationalPerson objectClass: inetOrgPerson loginShell: /bin/bash homeDirectory: /home/firstname cn: firstname lastname mail: firstname.lastname(a)domain.com<mailto:firstname.lastname@domain.com> This is how I connect Dovecot with LDAP hosts = ldapserver ldap_version = 3 base = ou=People,dc=domain,dc=com deref = never scope = subtree user_attrs = user_filter = (&(objectclass=inetOrgPerson)(uid=%n) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectclass=inetOrgPerson)(uid=%n)) default_pass_scheme = SSHA When I enter a user's email address and password as the following: email: firstname.lastname(a)domain.com<mailto:firstname.lastname@domain.com> password: password and according to my setting which I used "%n" as you see above, the username used to authenticate is "firstname.lastname". I checked the Dovecot variables but I couldn't find something useful in this case to manipulate the "%n" variable. I would like to keep using email addresses as "firstname.lastname(a)domain.com"<mailto:firstname.lastname@domain.com> but authenticate users using their first name. I really hit a wall here and any help will be much appreciated.

6 6

Possible architecture ?
by Alexandre Ellert 03 Oct '18

03 Oct '18

Hi, I'd like to achieve the following setup whit dovecot using multiple servers : - one server dedicated to all client IMAP (TLS) connections (i <http://mail.numeezy.com>map.mymaindomain.com, see below ) - each backend server has it's own local storage. no replication - each backend server responsible of a few domains - each backend server has it's own Mysql local database for user's passwords. ===> Server 1 : domains A, B and C ====> i <http://mail.numeezy.com>map.mymaindomain.com ===> Server 2 : domains D, E and F (143 TLS / 993 SSL) ===> Server 3 : domains G, H For example, if a user connects from domain E to i <http://mail.numeezy.com> map.mymaindomain.com, will Dovecot be able to use password database hosted on Server 2 ? Thank you ! Alex

3 3

Delete vs. Expunge in Public Namespace
by Chris 03 Oct '18

03 Oct '18

All, my IMAP client [1] marks messages as deleted, but doesn't expunge. Dovecot (2.2.27-3+deb9u2) expunges them. Is this because the mailbox is part of public namespace? .... ::1.38247-::1.00143: MALP6 STORE 48,49,50,51,52,53,54,55,56,57,58,59,60,61 +FLAGS (\Deleted) ::1.00143-::1.38247: * 48 FETCH (FLAGS (\Deleted \Seen)) * 49 FETCH (FLAGS (\Deleted \Seen)) * 50 FETCH (FLAGS (\Deleted \Seen)) * 51 FETCH (FLAGS (\Deleted \Seen)) * 52 FETCH (FLAGS (\Deleted \Seen)) * 53 FETCH (FLAGS (\Deleted \Seen)) * 54 FETCH (FLAGS (\Deleted \Seen)) * 55 FETCH (FLAGS (\Deleted \Seen)) * 56 FETCH (FLAGS (\Deleted \Seen)) * 57 FETCH (FLAGS (\Deleted \Seen)) * 58 FETCH (FLAGS (\Deleted \Seen)) * 59 FETCH (FLAGS (\Deleted \Seen)) * 60 FETCH (FLAGS (\Deleted \Seen)) * 61 FETCH (FLAGS (\Deleted \Seen)) MALP6 OK Store completed. ::1.38247-::1.00143: MALP7 SEARCH DELETED .... Oct 2 10:18:03 hyptest dovecot: imap(chris): delete: box=MailingListen/test125, uid=180, msgid=<740a9ba3-d637-3fa0-1b87-ff8d79491bf0@ hyp.postbox.xyz>, size=1509 Oct 2 10:18:03 hyptest dovecot: imap(chris): expunge: box=MailingListen/test125, uid=167, msgid=<740a9ba3-d637-3fa0-1b87-ff8d79491bf0 @hyp.postbox.xyz>, size=1509 namespace { list = yes location = maildir:/var/vmail/public/:LAYOUT=fs:INDEXPVT=%h/.public-indexes prefix = MailingListen/ separator = / subscriptions = no type = public } - Chris [1] https://raw.githubusercontent.com/quentinsf/IMAPdedup/master/imapdedup.py

2 3

Bug reports - auth is broken in Dovecot 2.3.3
by Berindeie Avram-Teodor 03 Oct '18

03 Oct '18

I applied the patch and recompiled but nothing resolved. What else can I do?

3 3

Bug reports - auth is broken in Dovecot 2.3.3
by Berindeie Avram-Teodor 03 Oct '18

03 Oct '18

Hello, I have compiled Dovecot 2.3.3 from sources but I have problems with authentication. I tried to rebuild Dovecot 2.3.2.1 but the error persists. I attach a .txt file with the information requested to report a bug. My main mail server is fallen, (the same for the test server) I will send the report from a Gmail address. If you need additional information I will be at your disposal.

2 1

Need to convert mbox to Maildir
by Mark Foley 02 Oct '18

02 Oct '18

I have a mbox file of emails. I want to convert this to Maildir giving me individual message files per email. I've looked at dsync, but as far as I can tell this wants a specific target user and it appears that it will "distribute" the converted messages into that user's INBOX. I don't want to put these mbox messages into any particular user's Maildir hierarchy, just export to file-per-message format to a destination directory of my choosing. Is this possible? THX --Mark

2 2

Help for UID THREAD and SORT optimization
by Alessio Cecchi 02 Oct '18

02 Oct '18

Hello, we are developing a library to show last arrived messages of all threads in a folder with more than 300k messages. As per the RFC 5256, the IMAP thread command has only the option to specify the grouping criteria (REFERENCES vs ORDEREDSUBJECT). So we implemented an algorithm which gets the full UID SORT ordered by date in reverse order then gets all thread relations and then post process all outputs to obtain the final result. Once we have both output we loop through the first uids set (which is ordered) and for every item of it we loop through the other uids set with all the thread relations. If the uid of the first set is contained in one of the elements of the thread messages, we pick it up and push it in the resulting array. This is a pseudo-code that shows what we are doing: array_of_latest_messages_in_thread = [] array_of_sorted_uids = [n,n,n,n,...] // UID SORT (REVERSE DATE) UTF-8 ALL array_of_thread_uids = [n,[n,n],n,[n,n,n],[n,n],n,n,...] // UID THREAD (REFERENCES) UTF-8 ALL foreach(array_of_sorted_uids as s_uid){ foreach(array_of_thread_uids as t_uids){ if(t_uids contains s_uid){ // or a function to loop recursively t_uids to search if a leaf is equal to s_uid array_of_latest_messages_in_thread.push(s_uid) break } } } We have also made some little optimizations in the above code like for example skipping from the outer loop the uids already processed in the inner loop that have not being selected. Anyway, the loop is very expensive in term of computation and we are wondering if there is a better approach to this issue directly using IMAP instead of post processing the output of the two commands at application level. Thanks. -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

2 2

Bug in conditionals to assign values to variables?
by Angel L. Mateo 02 Oct '18

02 Oct '18

Hi, According to https://wiki2.dovecot.org/Variables you could use conditionals to assign values to a varible. The syntax is: %{if;value1;operator;value2;value-if-true;value-if-false} where any of the fields can refer to another field using %v or %{value} syntax. The problem is that when I use a config like: user_attrs = ...,=relpath=%{if;%u;eq;somevalue;valuetrue;valuefalse} it works without any problem. But when I use: user_attrs = ...,=relpath=%{if;%{user};eq;somevalue;valuetrue;valuefalse} then it reports in logs: Sep 28 14:23:22 myotis60 dovecot: auth: Error: var_expand_long(if;%{user}) failed: if: requires four or five parameters, got 1 anyway, the variable is correctly initialized, but I get the log. Is this a bug? PS: I'm running dovecot 2.2.33 -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 3

split auth from other logging
by Kai Schaetzl 02 Oct '18

02 Oct '18

Is there a way to split the auth logging (logins and failed logins) from the other logging that goes to info_log_path = /var/log/dovecot/dovecot.log ? This log gets a lot of other info as well, most notably the lmtp notifications about every filed mail (with no level stamping, btw). This makes it really hard to find authentication errors quickly and comfortably. It would be nice to be able to split at least the lmtp messages away. Kai

4 9

Released Pigeonhole v0.5.3 for Dovecot v2.3.3.
by Stephan Bosch 02 Oct '18

02 Oct '18

Hello Dovecot users, Here's the Pigeonhole release that goes with Dovecot v2.3.3. Only two insignificant memory leak fixes were added since the release candidate (not mentioned in the changelog). Changelog v0.5.3: - Fix assertion panic occurring when managesieve service fails to open INBOX while saving a Sieve script. This was caused by a lack of cleanup after failure. - Fix specific messages causing an assert panic with actions that compose a reply (e.g. vacation). With some rather weird input from the original message, the header folding algorithm (as used for composing the References header for the reply) got confused, causing the panic. - IMAP FILTER=SIEVE capability: Fix FILTER SIEVE SCRIPT command parsing. After finishing reading the Sieve script, the command parsing sometimes didn't continue with the search arguments. This is a time- critical bug that likely only occurs when the Sieve script is sent in the next TCP frame. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.3.ta… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.3.ta… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

v2.3.3 rc1 - Error: sieve: !!BUG!!: Binary compiled from dovecot.sieve is still corrupt
by James 01 Oct '18

01 Oct '18

I have a sieve problem with dovecot v2.3.3 rc1 with either of pigeonhole 0.5.2 or 0.5.3.rc1. The the change that triggers this is in dovecot not pigeonhole. Sieve filtering has been working with v2.3.2 and many earlier versions. Log report: Sep 24 10:36:13 mailhost dovecot: [ID 702911 mail.error] lmtp(user(a)domain.tld)<15816><RnikKw2wqFvIPQAAs831Jw>: Error: sieve: !!BUG!!: Binary compiled from /path/to/domain/user/dovecot.sieve is still corrupt; bailing out and reverting to default delivery This is a sieve script with a vacation handler. My other sieve filters are working. My actual sieve filter worked before and was written by Roundcube web mail. My failing test script is cut-n-paste from the sieve examples https://wiki2.dovecot.org/Pigeonhole/Sieve/Examples so should not be in doubt. The text script compiles to dovecot.svbin and newly compiled files are identical to older versions, the compilation has not changed. James.

5 21

v2.3.3 released
by Timo Sirainen 01 Oct '18

01 Oct '18

https://dovecot.org/releases/2.3/dovecot-2.3.3.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.3.tar.gz.sig * doveconf hides more secrets now in the default output. * ssl_dh setting is no longer enforced at startup. If it's not set and non-ECC DH key exchange happens, error is logged and client is disconnected. + Added log_debug=<filter> setting. + Added log_core_filter=<log filter> setting. + quota-clone: Write to dict asynchronously + --enable-hardening attempts to use retpoline Spectre 2 mitigations + lmtp proxy: Support source_ip passdb extra field. + doveadm stats dump: Support more fields and output stddev by default. + push-notification: Add SSL support for OX backend. - NUL bytes in mail headers can cause truncated replies when fetched. - director: Conflicting host up/down state changes may in some rare situations ended up in a loop of two directors constantly overwriting each others' changes. - director: Fix hang/crash when multiple doveadm commands are being handled concurrently. - director: Fix assert-crash if doveadm disconnects too early - virtual plugin: Some searches used 100% CPU for many seconds - dsync assert-crashed with acl plugin in some situations. - mail_attachment_detection_options=add-flags-on-save assert-crashed with some specific Sieve scripts. - Mail snippet generation crashed with mails containing invalid Content-Type:multipart header. - Log prefix ordering was different for some log lines. - quota: With noenforcing option current quota usage wasn't updated. - auth: Kerberos authentication against Samba assert-crashed. - stats clients were unnecessarily chatty with the stats server. - imapc: Fixed various assert-crashes when reconnecting to server. - lmtp, submission: Fix potential crash if client disconnects while handling a command. - quota: Fixed compiling with glibc-2.26 / support libtirpc. - fts-solr: Empty search values resulted in 400 Bad Request errors - fts-solr: default_ns parameter couldn't be used - submission server crashed if relay server returned over 7 lines in a reply (e.g. to EHLO)

1 0

doveadm backup abort in imapc-client.c
by Evan Klitzke 01 Oct '18

01 Oct '18

I am using Dovecot 2.2.36 and I am trying to use doveadm backup to migrate email from Gmail to Dovecot. When I run doveadm backup, it goes for a while and then eventually hits an assertion error (I've tried this a few times now and it happens reliably). The assertion failure looks like this: dsync(evan(a)eklitzke.org): Panic: file imapc-client.c: line 179 (imapc_client_run_pre): assertion failed: (client->ioloop == NULL) The last few lines of log output before the crash look like this: https://gist.github.com/eklitzke/9a0dd77c44a6ee33e812f85d5773c24c The GDB backtrace when the program panics looks like this: https://gist.github.com/eklitzke/6b311474b08b546c462e0444c5cf479b The output of "dovecot --version" prints "2.2.36 (1f10bfa63)" and I'm using the version provided by Fedora's dovecot-2.2.36-1.fc28.src.rpm package. Is there any other information I can provide to assist in debugging? I could provide a core dump provided there was a way to scrub my IMAP credentials. -- Evan Klitzke pgp: 0x157EFCACBC648422 e: evan(a)eklitzke.org w: https://eklitzke.org

3 3

dsync replication
by Matt Bryant 01 Oct '18

01 Oct '18

We have a setup with ldap and sql passdbs and sql userdb, from my understanding of the documentation dsync repliction picks up the users to replicate via the iterate query. This query returns 646 users in sql (not everyone gets replicated) but when i run a doveadm replicator status Total number of known users 92236 seriously that kinda lot more than 646 Does iterate_query belong in user_db or passdb? Is it the fact I have ldap and sql passdb and its picking up dome default ldap query as well the specified sql iterate query ? rgds Matt

1 0

Local access to IMAP mailboxes
by Victor Sudakov 29 Sep '18

29 Sep '18

Dear Colleagues, I have made mailboxes in ~/Mail available via IMAP (Dovecot 2.3.2.1), that is: "mail_location = mbox:~/Mail:INBOX=/var/mail/%u" However, I often read and modify the mailboxes locally with mutt (e.g. append and delete mails). Should I expect any problems wit Dovecot indexes etc? What if I even do "rm ~/Mail/some/mailbox", will Dovecot be mad at me? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/

6 19

having problems with Argon
by Adam Gold 28 Sep '18

28 Sep '18

Hello everyone. I'm close to completing my first build of a mail server - Postfix, Dovecot, Postgres (I know, sounds like overkill), Rspamd with Redis and Unbound (please infer a mega lack of experience disclaimer). The model is standalone internet with remoted sasl-authenticated clients. Throughout the process I've been having consistent problems with user password authentication. Both when I began when I was only using flat files and now with pgsql, more often than not my username (full email address) and password combo have been rejected. The postfix logs started with fairly innocent 'failed login' messages and eventually reached the "you don't own this email address, you're a spammer" level. Dovecot has been consistent with "auth: Debug: client passdb out: FAIL" messages. Before I looked at this issue specifically, my guess was it came from a Postfix restriction but having spent quite a while going through it today, I don't think that's where it lies. Finally I went back to basics and changed an account password to {PLAIN}12345 and what do you know - effortless success! Previously I'd been using mainly argon, ssha512 sha512-crypt and a few others. My passwords are strong (well in excess of 20 characters, 'randomly' generated). I spent this afternoon narrowing down the hashes and while I haven't finished, the only one I couldn't get to work with 12345 was argon. I also noticed that the wiki says the 2I and 2ID versions of Argon are available, doveadm pw always returned a "does not exist" error when I tried to use 2ID. I'm using Dovecot version 2.3.2.1 (0719df592)

2 1

Collecting S/MIME Certs from (incoming signed) E-Mails
by Jochen Bern 28 Sep '18

28 Sep '18

Two quick questions, if I may: We've been asked to change an existing application (whose builtin S/MIME capabilities are quite unclear) so that the e-mails it sends will be S/MIME encrypted, if possible. I have some experience in getting an MTA to encrypt e-mails in transit, but the trick is, of course, to maintain a list of addressees' (current) certs. Ideally, users send e-mails *to* the application beforehand, and with a bit of luck, they might even *sign* them (which, in the case of S/MIME, IIUC implies that their cert is attached). 1. Are there features in a) the IMAP protocol and/or b) dovecot in particular that would allow me to extract the certs from incoming e-mails before the application retrieves them from the mailbox? (I know that IMAP allows me to download only a MIME part of an e-mail, but I'ld need to somehow determine *which* MIME part to download, I guess?) 2. Assuming that the incoming e-mail is S/MIME signed *and encrypted*, is it actually possible to extract the sender cert *without* having the application's keypair to *decrypt* the e-mail in the process? Kind regards, -- Jochen Bern Systemingenieur www.binect.de www.facebook.de/binect

1 0

Custom variable
by Ángel L. Mateo 27 Sep '18

27 Sep '18

Hi, I know that there are some variables (as user or username) I could use inside dovecot. They are at https://wiki2.dovecot.org/Variables. My question is if I can create my own variables from attributes at my pass/user db and then use it inside dovecot configuration. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 5

Connection and login scripts callback
by Stanislav Humplík 27 Sep '18

27 Sep '18

Hello, currently there is very handy post-login scripting already implemented but it naturally executes only when successful login happens. I would like to have another two script callbacks which runs: 1. immediately after client connects to server - dovecot should run script with connection IP and wait for result and then reject/accept connection with return message accordingly. 2. after failed login - dovecot should exec script with connection IP, login params without waiting for result The main reason behind this idea is to use some logic, database (redis...) or indicators like GeoIP, p0f as bruteforce prevention. It might be also usable for IP based ACLs. AFAIK the only way to create something similar is to proxy whole authentication to some external process, which is not desirable when dovecot manages user database. SH

2 1

Can't authenticate using ARGON2ID crypt scheme from doveadm pw w/rounds != default
by Keith Amidon 27 Sep '18

27 Sep '18

I'm using dovecot version 2.3.2.1 (0719df592) and trying to use the ARGON2ID crypt scheme for authentication using the passdb passwd-file driver. My passdb config is very simple: passdb { driver = passwd-file args = username_format=%u <path-to-file-here> } If I generate a password this way: doveadm pw -s ARGON2ID -p 'This is a test' I get a crypt value for the password that I can place in the password file like: testuser:{ARGON2ID}$argon2id$v=19$m=65536,t=3,p=1$UuqF25QtumNBe9R2FmUZvA$5avvHY5TIaj5Wl5C4k8BOI4bcmNei7BwPLlXYQVybMc And if I test authentication with this command: doveadm auth login testuser 'This is a test' It works as shown by the (lightly redacted) log: Sep 25 22:46:01 myhost dovecot[17538]: auth: Debug: auth client connected (pid=55417) Sep 25 22:46:01 myhost dovecot[17538]: auth: Debug: client in: AUTH 1 PLAIN service=doveadm debug resp=<hidden> Sep 25 22:46:01 myhost dovecot[17538]: auth: Debug: passwd-file(testuser): lookup: user=testuser file=<path-to-passwd-file> Sep 25 22:46:01 myhost dovecot[17538]: auth: Debug: client passdb out: OK 1 user=testuser However, if I instead specify a non-default number of rounds this way: doveadm pw -s ARGON2ID -p 'This is a test' -r 7 and place the result in an entry in the password file like: testuser:{ARGON2ID}$argon2id$v=19$m=1048576,t=7,p=1$kIhnUR13GrtOvvpbJNJmnQ$o7O6Whxs3s8IE09yY9S2dPkJjJyEVc78GRFilYVS9fU Then testing authentication using the same command (repeated here): doveadm auth login testuser 'This is a test' then authentication fails, as shown by this (lightly redacted) log: Sep 25 22:52:05 myhost dovecot[17538]: auth: Debug: auth client connected (pid=55557) Sep 25 22:52:05 myhost dovecot[17538]: auth: Debug: client in: AUTH 1 PLAIN service=doveadm debug resp=<hidden> Sep 25 22:52:05 myhost dovecot[17538]: auth: Debug: passwd-file <path-to-passwd-file>: Read 3 users in 0 secs Sep 25 22:52:05 myhost dovecot[17538]: auth: Debug: passwd-file(testuser): lookup: user=testuser file=<path-to-passwd-file> Sep 25 22:52:05 myhost dovecot[17538]: auth: passwd-file(testuser): Password mismatch Sep 25 22:52:07 myhost dovecot[17538]: auth: Debug: client passdb out: FAIL 1 user=testuser Experimentation with other values for the -r option has not produced a value that works for me. Using the exact same procedure but the BLF-CRYPT scheme, with varying number of rounds, does work. Am I doing something wrong or is there a bug in either the doveadm pw generation or the auth evaluation of the password? I'd like to use ARGON2ID with ~6 rounds if I can make this work. Any help would be greatly appreciated. Thanks, Keith

2 2

What causes folders to be reported as noselect?
by Daniel Miller 27 Sep '18

27 Sep '18

As the subject says. This may be a bit open-ended - but it would really help troubleshooting some obscure folder issues. In my case, I happen to have both some "real" folders and also some "virtual" folders that respond to IMAP LIST commands with the "\NoSelect" flag - and I don't know why. Via telnet, I can manually issue SELECT, SEARCH, and FETCH for such folders without errors. -- Daniel

2 2

Possible bug - otherwise a public admission of oops
by Daniel Miller 27 Sep '18

27 Sep '18

While trying to identify possible causes of wrong mail folder creation I did something...bad. Normally, I would recognize that deleting a mail folder would naturally delete all the contained mails. However...somehow my imaginative self decided that deleting a virtual folder via IMAP would only delete the virtual folder...and not proceed to delete every referenced email via the virtual mapping. So note to self, and possible reminder to others, deleting a virtual folder via a filesystem command is just tiny bit different than via IMAP... Fortunately I keep my feathers numbered for just such an emergency... -- Daniel

1 0

dovecot/FreeBSD and Android IMAP clients
by Victor Sudakov 25 Sep '18

25 Sep '18

Dear Colleagues, I have a fairly vanilla setup of dovecot on FreeBSD, serving IMAP and POP3. Thunderbird/IMAP works fine, and so does mutt/IMAP. However, Android clients (Gmail/IMAP and K-9 Mail) have problems accessing folders other than the INBOX. They either show them empty with no mails (K-9) or just wait forever to view the contents (Gmail app). Do I need to set up some workarounds or hacks in dovecot for Android IMAP clients to work correctly? Any advice is appreciated. My config is below: # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 11.2-RELEASE-p3 amd64 # Hostname: admin.sibptus.ru mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap pop3 ssl_cert = </usr/local/etc/exim/mail.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/

2 2

Nightly builds of Debian packages
by Christoph Pleger 24 Sep '18

24 Sep '18

Hello, how is the future of the automatically built nightly debian packages of dovecot? Has that project been ceased? The current auto-built version is still 2.2.28 from April 28, though 2.2.29 (with a security patch) of dovecot is out now for a while. Regards Christoph

4 3

Last_login plugin and mysql
by Thomas Hooge 24 Sep '18

24 Sep '18

Hello, i have problems configuring the last_login plugin with mysql. I have extended the postfixadmin database with a new field, configured the plugin as described in the wiki. Finally i got errors: table is not writable, INSERT failed. Why is the insert required? The plugin should only UPDATE the column for existing rows. Or am i missing some configuration options? Here is my dictionary config: map { pattern = shared/last-login/$user table = mailbox value_field = x_last_login value_type = uint fields { username = $user } } Dovecot: 2.2.27 (c0f36b0) Kind regards, Thomas

2 2

Error using dsync to convert really old mboxes to Maildir and workaround
by faginbagin 24 Sep '18

24 Sep '18

I ran across what I think may be a bug in dsync when trying to convert from mbox to Maildir format. My first attempt failed with a runaway dsync process spewing out thousands of identical lines of the form: dsync(buus): Error: Duplicate mailbox GUID 00fe691ff60da85b090d0000c8119523 for mailboxes Archive/Personal and Work/VendorInfo - giving a new GUID 00fe691ff60da85b090d0000c8119523 to Archive/Personal These two mail folders happen to be among a number of folders I've had for many years, but also haven't looked at in many years. I used to use UW-IMAP, but switched to dovecot about two years ago, and I'm sure I've never used dovecot to look at those folders. So I suspect the root cause of the above error message was that dovecot had never generated GUIDs for these and some other really old folders. After killing dsync with SIGKILL, which couldn't be killed with SIGTERM, I restored my mbox format Mail folder from backup, restored the mail_location and then coerced dovecot to generate unique GUIDs for all my mail folders with this command: doveadm mailbox status guid `doveadm mailbox list` After the above command, I was able to convert my mail from mbox to Maildir format. Maybe this will help someone else somewhere down the road.

2 2

Released Pigeonhole v0.5.3.rc1 for Dovecot v2.3.3.rc1.
by Stephan Bosch 23 Sep '18

23 Sep '18

Hello Dovecot users, Here is the Pigeonhole release candidate that goes with the Dovecot v2.3.3 release candidate. It consists only of bugfixes. Changelog v0.5.3: - Fix assertion panic occurring when managesieve service fails to open INBOX while saving a Sieve script. This was caused by a lack of cleanup after failure. - Fix specific messages causing an assert panic with actions that compose a reply (e.g. vacation). With some rather weird input from the original message, the header folding algorithm (as used for composing the References header for the reply) got confused, causing the panic. - IMAP FILTER=SIEVE capability: Fix FILTER SIEVE SCRIPT command parsing. After finishing reading the Sieve script, the command parsing sometimes didn't continue with the search arguments. This is a time- critical bug that likely only occurs when the Sieve script is sent in the next TCP frame. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.3/rc/dovecot-2.3-pigeonhole-0.5.3.… http://pigeonhole.dovecot.org/releases/2.3/rc/dovecot-2.3-pigeonhole-0.5.3.… Refer to http://pigeonhole.dovecot.org and the Dovecot wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Global sieve doesn't run and I don't know why
by Ranbir 21 Sep '18

21 Sep '18

Hi Everyone, I have dovecot, postfix, roundcube and piegeonhole managesieve all working nicely together. Personal scripts defined in roundcube run without issue. I have configured the global sieve dir defined in 90-sieve.conf: sieve_global_dir = /var/lib/dovecot/sieve/global/ I pre-compiled the script in there: # ls -l /var/lib/dovecot/sieve/global/ total 8 -rw-r--r--. 1 root root 118 Sep 19 16:52 global.sieve -rw-r--r--. 1 root root 197 Sep 19 16:56 global.svbin But, in the logs for dovecot, I never see the script being run: https://www.pastiebin.com/5ba3faa8628c2 Users are from freeipa. Their home directories are symlinks to where the mail really lives. For example: lrwxrwxrwx. 1 ranbir virtual 42 May 25 2017 ranbir -> /var/spool/mail/domain.tld/ranbir/ And the contents of that dir: [root@mailhost conf.d]# ls -al /home/DOMAIN/ranbir/ total 64 drwxrwx---. 4 ranbir virtual 4096 Sep 18 17:40 . drwxrwx---+ 13 virtual virtual 4096 Jul 8 12:06 .. -rw-------. 1 ranbir ranbir 17808 Sep 20 01:13 .bash_history -rw-------. 1 ranbir ranbir 18 Dec 14 2015 .bash_logout -rw-------. 1 ranbir ranbir 193 Dec 14 2015 .bash_profile -rw-------. 1 ranbir ranbir 231 Dec 14 2015 .bashrc lrwxrwxrwx. 1 virtual virtual 23 Feb 11 2018 .dovecot.sieve -> sieve/managesieve.sieve lrwxrwxrwx. 1 virtual virtual 23 Sep 18 16:53 .dovecot.sieve.log -> sieve/dovecot.sieve.log -rw-rw----. 1 virtual virtual 322 Sep 18 17:40 .dovecot.svbin -rw-------. 1 ranbir ranbir 59 Jun 7 2016 .lesshst drwx------. 56 virtual virtual 4096 Sep 20 15:02 Maildir drwxrwx---. 3 ranbir virtual 89 Sep 18 17:16 sieve -rw-------. 1 ranbir ranbir 6415 Feb 11 2018 .viminfo Did I miss something in the configuration? Dovecot isn't throwing any errors. I can only conclude I haven't completed the setup for global sieve to work or that I've misunderstood what the "sieve_global_dir" paramater is for. Thanks! -- Ranbir

4 11

Re: v2.3.3 release candidate released
by Tuomi, Aki 21 Sep '18

21 Sep '18

It should work if you add it to apt. Directory listing is denied, which causes 403 if you access with browser. Aki -------- Original message --------From: Michael Marley <michael(a)michaelmarley.com> Date: 21/09/2018 18:00 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Re: v2.3.3 release candidate released On 2018-09-21 09:45, Timo Sirainen wrote: > https://dovecot.org/releases/2.3/rc/dovecot-2.3.3.rc1.tar.gz > https://dovecot.org/releases/2.3/rc/dovecot-2.3.3.rc1.tar.gz.sig > > Binary packages are also available in https://repo.dovecot.org/ in > ce-2.3.3 repository (not ce-2.3-latest). > > * doveconf hides more secrets now in the default output. > * ssl_dh setting is no longer enforced at startup. If it's not set and > non-ECC DH key exchange happens, error is logged and client is > disconnected. > > + Added log_debug=<filter> setting. > + Added log_core_filter=<log filter> setting. > + quota-clone: Write to dict asynchronously > + --enable-hardening attempts to use retpoline Spectre 2 mitigations > + lmtp proxy: Support source_ip passdb extra field. > + doveadm stats dump: Support more fields and output stddev by > default. > + push-notification: Add SSL support for OX backend. > - NUL bytes in mail headers can cause truncated replies when fetched. > - director: Conflicting host up/down state changes may in some rare > situations ended up in a loop of two directors constantly > overwriting > each others' changes. > - virtual plugin: Some searches used 100% CPU for many seconds > - dsync assert-crashed with acl plugin in some situations. > - mail_attachment_detection_options=add-flags-on-save assert-crashed > with some specific Sieve scripts. > - Mail snippet generation crashed with mails containing invalid > Content-Type:multipart header. > - Log prefix ordering was different for some log lines. > - quota: With noenforcing option current quota usage wasn't updated. > - auth: Kerberos authentication against Samba assert-crashed. > - stats clients were unnecessarily chatty with the stats server. > - imapc: Fixed various assert-crashes when reconnecting to server. > - lmtp, submission: Fix potential crash if client disconnects while > handling a command. > - quota: Fixed compiling with glibc-2.26 / support libtirpc. > - fts-solr: Empty search values resulted in 400 Bad Request errors > - fts-solr: default_ns parameter couldn't be used > - submission server crashed if relay server returned over 7 lines in > a reply (e.g. to EHLO) It looks like the ce-2.3.3 repository (or at least https://repo.dovecot.org/ce-2.3.3/ubuntu/xenial/) is returning a 403. Michael

1 0