- dovecot - dovecot.org

Re: mremap_anon() failed: Not enough space
by Joseph Tam 20 Jun '19

20 Jun '19

> It?s also possible that the cache files USED to grow quite large in > previous versions and that now they are much more reasonable, but the > only way to reset their size appears to be to delete them and let > dovecot rebuild them. I seem to recall these cache files ballooned in size when I did some doveadm search queries -- under some circumstances some headers fetches are cached for later searches, which may explain the growth over time as clients do mailbox searches. As for Solaris10 mremap_anon() space failures, I'm a litte hazy on memory mapping and shared memory, but I wonder if this has anything to do with kernel maximum shared memory limits. I know that for some of our Solaris 10 servers, I had to up these values in /etc/system to get some of our services to work. Joseph Tam <jtam.home(a)gmail.com>

1 0

mremap_anon() failed: Not enough space
by Dave McGuire 20 Jun '19

20 Jun '19

Hey folks. Suddenly I'm getting lots and lots of messages like this in my logs: Jun 19 14:47:31 <hostname> dovecot: [ID 583609 local0.error] imap(<address>): Error: mremap_anon(/var/mail/<domain>/<uname>/mailboxes/INBOX/Trash/dbox-Mails/dovecot.index.cache, 255557632) failed: Not enough space I'm running 2.2.36.1 under Solaris 10 (patched to current) on UltraSPARC. There's plenty of memory, plenty of swap, and plenty of disk, but this is a fairly busy mail server. Can anyone point me in the right direction? I'm guessing I have to increase a vsz_limit somewhere, but where? It's not clear to me exactly what is running out of what here. The output of doveconf -n is pasted below. Thanks, -Dave -------------------------------------------------- $ doveconf -n # 2.2.36.1 (5d621cf65): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: SunOS 5.10 sun4v # Hostname: mail.neurotica.com auth_failure_delay = 5 secs auth_mechanisms = plain login base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot-debug disable_plaintext_auth = no first_valid_uid = 200 login_access_sockets = tcpwrap mail_fsync = never mail_plugins = fts fts_solr managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader mdbox_rotate_size = 64 M mmap_disable = yes namespace inbox { inbox = yes location = mailbox uncaught-spam { auto = subscribe special_use = \Junk } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8983/solr/ sieve = /var/sieve-scripts/%u.sieve sieve_dir = ~/sieve sieve_extensions = +editheader sieve_global_dir = /var/lib/dovecot/sieve/global/ sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } user = root } service imap-login { process_min_avail = 10 service_count = 10 vsz_limit = 512 M } service imap { executable = /usr/local/libexec/dovecot/imap vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 10 } service pop3-login { process_min_avail = 10 service_count = 10 vsz_limit = 512 M } service pop3 { executable = /usr/local/libexec/dovecot/pop3 } service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } ssl_cert = </etc/letsencrypt/live/mail.neurotica.com/fullchain.pem ssl_key = # hidden, use -P to show it syslog_facility = local0 userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol lda { mail_fsync = optimized mail_plugins = fts fts_solr sieve postmaster_address = postmaster(a)neurotica.com } protocol imap { imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 40 mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = fts fts_solr } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = fts fts_solr sieve } -------------------------------------------------- -- Dave McGuire, AK4HZ New Kensington, PA

4 4

Re: Converting mdbox to mbox/MailDir
by ＠lbutlr 20 Jun '19

20 Jun '19

On 18 Jun 2019, at 20:46, Adam Raszkiewicz <araszkiewicz(a)medallies.com> wrote: > maildir -> mdbox it is maildir to mdbox conversion when I'm looking something opposite: mdbox -> maildir Please go back and read all the words in my previous reply. -- Lead me not into temptation, I can find the way.

3 2

IMAP IDLE
by Jorge Bastos 20 Jun '19

20 Jun '19

Hi, With outlook 2016+ i've seen that IDLE may be missing some configuration. Almost all time, when i'm in the inbox, i don't get new emails if no activity for 1 or 2 minutes (i think), i have to get out of the account and select the inbox or click other folder in the account and go to inbox again for them to appear. My idle conf's are the defaults, the one's bellow. Is there anything else that i need to make it work always and the change folders is not needed for outlook clients? root@fastmail:/etc/dovecot# doveconf |grep -i idle default_idle_kill = 1 mins imap_idle_notify_interval = 2 mins imapc_max_idle_time = 29 mins mailbox_idle_check_interval = 30 secs

2 4

recipient delimiters
by ＠lbutlr 20 Jun '19

20 Jun '19

Since many broken websites and idiot companies will not allow a ‘+’ in an email address, I have long used two delimiters in postfix: recipient_delimiter = +_ However, now that dovecot is handling verification for postfix via reject_unverified_recipient, dovecot complains about any address using an _ as a delimiter. I don’t see a way to tell dovecot what delimiters to use, and it appears it is still using a single delimiter only despite postfix having added support for more than one years ago. Anything that I can do in dovecot to 1) validate these emails and 2) treat user_extension the same as user+extension at delivery? -- Love is like oxygen / You get too much / you get too high / Not enough and you're gonna die

2 3

RFC 8314 § 3.3 support at Dovecot submission proxy service?
by Robert Scheck 20 Jun '19

20 Jun '19

Hello all, I'm currently wondering whether Dovecot submission proxy service supports RFC 8314 § 3.3 as well, which means implicit TLS for SMTP submission. https://github.com/dovecot/core/blob/2cbbe9b4829adb184c83dbf780316f41445590… from Git master just mentions port 587 like this: service submission-login { inet_listener submission { #port = 587 } } As per RFC 8314 § 3.3, I would expect the following to work (which I did not try), and if it already works, I even would expect this snippet part of the future Dovecot example/default configuration: service submission-login { inet_listener submission { #port = 587 } inet_listener submissions { #port = 465 #ssl = yes } } And if it isn't supported yet, I would indeed like to raise this as feature request. Note that 465 is named "submissions" as per RFC 8314 § 7.3. Kind regards Robert Scheck

2 1

Problem syncing mail with IMAP
by Odhiambo Washington 20 Jun '19

20 Jun '19

I am seeing the following errors in my logs, which I believe are preventing Outlook from syncing. How do I solve these? Can I just delete the index.cache?? Jun 18 11:23:34 imap(technical(a)mydomain.co.ke)<59754><g5UC1JSLPhkpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:23:45 imap(sales(a)mydomain.co.ke)<59812><aeLI1JSLoe3FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:24:03 imap(technical(a)mydomain.co.ke)<59891><uJHS1ZSLchkpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:24:12 imap(sales(a)mydomain.co.ke)<59933><q/9j1pSL3e3FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:24:40 imap(sales(a)mydomain.co.ke)<60053><DuQT2JSL9+3FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:24:49 imap(technical(a)mydomain.co.ke)<60079><ChRu2JSLrxkpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:25:09 imap(sales(a)mydomain.co.ke)<60184><i9HC2ZSLEe7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:25:13 imap(technical(a)mydomain.co.ke)<60204><sPL32ZSLx/cpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:25:42 imap(technical(a)mydomain.co.ke)<60328><QFm325SL9fcpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:03 imap(sales(a)mydomain.co.ke)<60358><9ckk3JSLLe7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:26:11 imap(technical(a)mydomain.co.ke)<60455><SKRs3ZSLJfgpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:32 imap(sales(a)mydomain.co.ke)<60548><SAy/3pSLjO7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:26:33 imap(technical(a)mydomain.co.ke)<60553><j3HE3pSLKBspUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:45 imap(technical(a)mydomain.co.ke)<60602><p49635SLUhspUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:51 imap(technical(a)mydomain.co.ke)<60629><NO/K35SLWBspUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:58 imap(technical(a)mydomain.co.ke)<60660><46ou4JSLa/gpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:27:01 imap(sales(a)mydomain.co.ke)<60678><Sxpv4JSLm+7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:27:31 imap(sales(a)mydomain.co.ke)<60809><atU54pSLwe7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:27:59 imap(sales(a)mydomain.co.ke)<60932><9LLs45SL3u7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:28:49 imap(sales(a)mydomain.co.ke)<61091><ekYq5pSLDO/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:29:05 imap(sales(a)mydomain.co.ke)<61225><qenN55SLoLC5HrCp>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Sent Items/dbox-Mails/dovecot.index.cache: UID 1853: Broken virtualsize in mailbox Sent Items: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.254): FETCH BODY[] got too little data: 3510 vs 1068172 Jun 18 11:29:15 imap(sales(a)mydomain.co.ke)<61272><Sb1s6JSLSe/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:29:43 imap(sales(a)mydomain.co.ke)<61393><FJIc6pSLfO/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:30:13 imap(sales(a)mydomain.co.ke)<61532><WGve65SLx+/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:30:39 imap(sales(a)mydomain.co.ke)<61647><e2x47ZSL+e/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:10 imap(sales(a)mydomain.co.ke)<61782><+L4175SLI/DFsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:36 imap(sales(a)mydomain.co.ke)<61905><pK/W8JSLafDFsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:36 imap(technical(a)mydomain.co.ke)<61899><TnXN8JSLifopUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:31:37 imap(sales(a)mydomain.co.ke)<61897><IgvJ8JSL4h0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:37 imap(technical(a)mydomain.co.ke)<61916><xhby8JSL6h0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/Deleted Items/dbox-Mails/dovecot.index.cache: UID 2: Broken virtual size in mailbox Deleted Items: read(/var/spool/virtual/mydomain.co.ke/technical/mdbox/storage/m.460): FETCH BODY[] got too little data: 10123 vs 197577 Jun 18 11:31:37 imap(technical(a)mydomain.co.ke)<61919><hSf38JSL7B0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/Sent Items/dbox-Mails/dovecot.index.cache: UID 2: Broken virtual size in mailbox Sent Items: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.2): FETCH BODY[] got too little data: 3620 vs 817692 Jun 18 11:31:40 imap(sales(a)mydomain.co.ke)<61924><cEP+8JSL7h0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Sent Items/dbox-Mails/dovecot.index.cache: UID 1: Broken virtual size in mailbox Sent Items: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.24): FETCH BODY[] got too little data: 5202 vs 1196884 Jun 18 11:31:44 imap(sales(a)mydomain.co.ke)<61937><bd8o8ZSL8B0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index.cache: UID 9: Broken virtual size in mailbox Sent: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.255): FETCH BODY[] got too little data: 46155 vs 1156185 Jun 18 11:31:46 imap(sales(a)mydomain.co.ke)<61962><cMlt8ZSLqfopUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index.cache: UID 8: Broken virtual size in mailbox Trash: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.657): FETCH BODY[] got too little data: 107289 vs 1338249 Jun 18 11:32:07 imap(sales(a)mydomain.co.ke)<62063><ZEiZ8pSLn/DFsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

2 1

User listing returned failure with -A
by ＠lbutlr 19 Jun '19

19 Jun '19

First, I archive the old messages in the INBOX on my list account # doveadm -Dv move -u kremels(a)kreme.com Archive mailbox INBOX BEFORE 90d Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_lookup" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: Undefined symbol "fts_filter_filter" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: Undefined symbol "mail_crypt_user_get_public_key" (this is usually intentional, so just ignore this message) doveadm(kremels(a)kreme.com)<64937><>: Debug: auth USER input: kremels(a)kreme.com uid=89 gid=89 mail_location=maildir:/usr/local/virtual/kremels@kreme.com/Maildir mail=maildir:/usr/local/virtual/kremels@kreme.com/Maildir home=/usr/local/virtual/kremels(a)kreme.com/ doveadm(kremels(a)kreme.com)<64937><>: Debug: Added userdb setting: mail=maildir:/usr/local/virtual/kremels@kreme.com/Maildir doveadm(kremels(a)kreme.com)<64937><>: Debug: Added userdb setting: mail_location=maildir:/usr/local/virtual/kremels@kreme.com/Maildir doveadm(kremels(a)kreme.com): Debug: Effective uid=89, gid=89, home=/usr/local/virtual/kremels(a)kreme.com/ doveadm(kremels(a)kreme.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/usr/local/virtual/kremels@kreme.com/Maildir doveadm(kremels(a)kreme.com): Debug: maildir++: root=/usr/local/virtual/kremels(a)kreme.com/Maildir, index=, indexpvt=, control=, inbox=/usr/local/virtual/kremels(a)kreme.com/Maildir, alt= doveadm(kremels(a)kreme.com): Debug: Mailbox Archive: Mailbox opened because: move doveadm(kremels(a)kreme.com): Debug: Mailbox INBOX: Mailbox opened because: move OK. that went well, how about all users now? # doveadm -Dv move -A Archive mailbox INBOX BEFORE 90d Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_lookup" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: Undefined symbol "fts_filter_filter" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: Undefined symbol "mail_crypt_user_get_public_key" (this is usually intentional, so just ignore this message) Error: User listing returned failure doveadm: Error: Failed to iterate through some users Ok, so I try the following: # cd /usr/local/virtual && for i in *; do doveadm move -u $i Archive mailbox INBOX BEFORE 90d; done And that works fine. Everything is the same up until the Error but since nothing else is logged, where do I go from here? -- There are strange things done in the midnight sun/By the men who moil for gold; The Arctic trails have their secret tales/That would make your blood run cold; The Northern Lights have seen queer sights,/But the queerest they ever did see Was the night on the marge of Lake Lebarge/ When I cremated Sam McGee

2 4

Cannot connect to DOVECOT from Roundcube using SSL on Port 993
by zahn 19 Jun '19

19 Jun '19

Hello I try to connect to dovecot from roundcube using this setup: $config['default_host'] = 'ssl://chogolisa.akadia.com'; $config['default_port'] = 993; and I get the following error message from dovecot: Jun 19 11:30:21 chogolisa dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=84.253.50.195, lip=84.253.50.195, TLS handshaking: Connection closed, session=<wEra4KmLm+ZU/TLD> When I try to connect from: $config['default_host'] = 'tls://chogolisa.akadia.com'; $config['default_port'] = 143; it works ! Roundcube: 1.0.12 Dovecot: 2.3.6 Can you help me ? -- Schöne Grüsse aus Oberdiessbach Martin Zahn Akadia AG Martin Zahn Software Ing. HTL Oracle Certificate Professional Information Technology Fichtenweg 10 CH-3672 Oberdiessbach Tel: +41 79 410 27 87 Web: www.akadia.com E-Mail: martin.zahn(a)akadia.com

2 1

Shared mailbox: share whole inbox
by Zdeněk Sobotka 19 Jun '19

19 Jun '19

Hi, I'd like to share the whole INBOX of one user with another. That should go through: doveadm acl add -u user1(a)example.cz SharedDirectory user=user2(a)example.cz lookup read insert It's works fine, when I connect through imap I see: . list "" "*"* LIST (\Noselect \HasChildren) "/" shared* LIST (\Noselect \HasChildren) "/" shared/example.cz/name.surname* LIST (\HasNoChildren) "/" shared/example.cz/name.surname/SharedDirectory* LIST (\HasNoChildren) "/" INBOX. OK List completed (0.000 + 0.000 secs). But now I would like to share the whole INBOX by: doveadm acl delete -u user1(a)example.cz SharedDirectory user1(a)example.cz 2 list "" "*" * LIST (\HasNoChildren) "/" INBOX 2 OK List completed (0.000 + 0.000 + 0.002 secs). doveadm acl add -u user1(a)example.cz INBOX user=user2(a)example.cz lookup read insert 2 list "" "*" * LIST (\HasNoChildren) "/" INBOX 2 OK List completed (0.000 + 0.000 + 0.002 secs). But it doesn't do what I expected, IMAP output it's the same and INBOX in shared folder is not subscribed. I'm looking for help to debug what might be wrong. Thanks. Z. auth_cache_size = 10 M auth_default_realm = %d auth_mechanisms = plain login auth_realms = example.cz default_client_limit = 1024 default_process_limit = 1024 dict { acl = pgsql:/etc/dovecot/postgre-acl.conf } mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = acl listescape zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify namespace { list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%d/%%n:INDEXPVT=/var/vmail/%d/%n/Maildir/shared/%%d/%%n prefix = shared/%%d/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap_people.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl recipient_delimiter = + sieve = file:/var/vmail/%d/%n/Maildir/sieve;active=/var/vmail/%d/%n/Maildir/dovecot.sieve sieve_before = /usr/local/etc/dovecot/default.sieve sieve_default = /usr/local/etc/dovecot/default.sieve sieve_extensions = +notify +imapflags +duplicate sieve_trace_debug = yes sieve_trace_level = matching sieve_user_log = file:/var/vmail/%d/%n/Maildir/sieve/sieve_user.log } protocols = " imap lmtp sieve" service auth-worker { user = root } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0660 user = postfix } user = dovecot } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } vsz_limit = 1 G } service imap { vsz_limit = 1 G } service lmtp { executable = lmtp -L process_min_avail = 10 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } ssl_ca = < /etc/ssl/certs/mail.example.cz/mail.example.cz.intermediate.crt ssl_cert = < /etc/ssl/certs/mail.example.cz/mail.example.cz.crt ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-ldap_people.conf.ext driver = ldap } protocol lmtp { info_log_path = /var/log/dovecot/dovecot-lmtp.log log_path = /var/log/dovecot/dovecot-lmtp-errors.log mail_plugins = acl listescape zlib quota sieve postmaster_address = admins(a)example.cz } protocol imap { mail_max_userip_connections = 500 mail_plugins = acl listescape zlib imap_acl } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log mail_max_userip_connections = 100 managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_line_length = 65536 }

1 0

Converting mdbox to mbox/MailDir
by Adam Raszkiewicz 19 Jun '19

19 Jun '19

Is there any way to convert Dovecot's mdbox/dbox to mbox, MailDir or eml format (or any other easy to import format)? Thanks, Adam

3 5

per-user mail_max_userip_connections in userdb extra fields
by Eirik Rye 18 Jun '19

18 Jun '19

Hi, The documentation at https://wiki.dovecot.org/UserDatabase/ExtraFields states that "It's possible to override settings from dovecot.conf", as well as the following: > If you want to override settings inside sections, you can separate the > section name and key with '/'. For example: > > namespace default { > inbox = yes > separator = . > location = maildir:~/Maildir > } > > The separator setting can be overridden by returning namespace/default/separator=. extra field. As such, we would expect for it to be possible to override mail_max_userip_connections under the "protocol imap" section, with a passwdfile userdb looking something like this: example:{CRYPT}x:1011:1011::/mail/example::userdb_protocol/imap/mail_max_userip_connections=100 The userdb returns the expected fields in the correct format (according to the documentation): # doveadm user -u example userdb: example user : example uid : 1011 gid : 1011 home : /mail/example protocol/imap/mail_max_userip_connections: 100 However, this new setting is not honoured. To test, I set "mail_max_userip_connections=1" in 20-imap.conf, and noticed that my second connection was closed with the following error: dovecot[13573]: imap-login: Maximum number of connections from user+IP exceeded (mail_max_userip_connections=1) I also attempted the same setting, without the "protocol/imap" prefix. Is this not possible? Are there restrictions to what settings may be overridden in userdb? The documentation appears to suggest that there isn't. Best regards, Eirik Rye

1 0

Dovecot LMTP rejecting mail from address with apostrophe
by Michal Krzysztofowicz 18 Jun '19

18 Jun '19

Hi, I have an OpenSMTPD / Dovecot installation on an OpenBSD server. I recently came across an issue where Dovecot LMTP would reject a message sent to a local user from an address which contains a single apostrophe (e.g. firstname.o'lastname(a)example.com) Apparently apostrophe, as well as a number of other special characters, are valid characters in the local part of the email address (that's everything to the left of the @ character). The message I get in the logs is: Jun 14 11:57:34 atlantic smtpd[42606]: 21749fd12ac76b57 mda delivery evpid=56aed6237d6444a0 from=<firstname.o'lastname(a)example.com> to=<me(a)example.org> rcpt=<me(a)example.org> user=me delay=0s result=PermFail stat=Error ("mail.lmtp: LMTP server error: 501 5.5.4 Invalid FROM: Invalid character in localpart") where example.com is external domain and example.org is a local one. The part of the message: LMTP server error: 501 5.5.4 Invalid FROM: Invalid character in localpart is returned by dovecot-lmtp. I’ve had a brief look at the source code, and it seems the responsible code is somewhere inside src/lib-smtp/smtp-address.c and, if I understand the code correctly, the address parsing in actually done in src/lib-smtp/smtp-parser.c. My question is is there a configuration option, similar to auth_username_chars which lists valid characters in the email address, to stop Dovecot LMTP from rejecting such emails? or maybe you know another way of getting it to accept an email from such address? My dovecot version is: $ dovecot --version 2.3.5.1 (7ec6d0ade) And in case that makes any difference, I'm running OpenBSD 6.5 patched to 005_libssl. Thanks! Mike -- Michal Krzysztofowicz http://beautifulocean.org/

3 7

Problem syncing e-mails with Outlook
by Odhiambo Washington 18 Jun '19

18 Jun '19

Hello all, I am running dovecot- 2.3.5.2 with mdbox storage. I deleted the dovecot.index* from all my folders, which led to mails not being displayed. I rebuilt the indexes for all the users after that, using: doveadm force-resync -u user@domain "*" However, the problem now is that Outlook,configured for IMAP, is not able to sync the mails with the server. I can login to the server using webmail and I see all the e-mails listed. However, when I connect outlook, it does not sync all these e-mails. I am seeing the errors below. Not sure how to fix that. Jun 18 11:23:34 imap(technical(a)mydomain.co.ke)<59754><g5UC1JSLPhkpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:23:45 imap(sales(a)mydomain.co.ke)<59812><aeLI1JSLoe3FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:24:03 imap(technical(a)mydomain.co.ke)<59891><uJHS1ZSLchkpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:24:12 imap(sales(a)mydomain.co.ke)<59933><q/9j1pSL3e3FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:24:40 imap(sales(a)mydomain.co.ke)<60053><DuQT2JSL9+3FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:24:49 imap(technical(a)mydomain.co.ke)<60079><ChRu2JSLrxkpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:25:09 imap(sales(a)mydomain.co.ke)<60184><i9HC2ZSLEe7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:25:13 imap(technical(a)mydomain.co.ke)<60204><sPL32ZSLx/cpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:25:42 imap(technical(a)mydomain.co.ke)<60328><QFm325SL9fcpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:03 imap(sales(a)mydomain.co.ke)<60358><9ckk3JSLLe7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:26:11 imap(technical(a)mydomain.co.ke)<60455><SKRs3ZSLJfgpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:32 imap(sales(a)mydomain.co.ke)<60548><SAy/3pSLjO7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:26:33 imap(technical(a)mydomain.co.ke)<60553><j3HE3pSLKBspUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:45 imap(technical(a)mydomain.co.ke)<60602><p49635SLUhspUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:51 imap(technical(a)mydomain.co.ke)<60629><NO/K35SLWBspUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:26:58 imap(technical(a)mydomain.co.ke)<60660><46ou4JSLa/gpUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:27:01 imap(sales(a)mydomain.co.ke)<60678><Sxpv4JSLm+7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:27:31 imap(sales(a)mydomain.co.ke)<60809><atU54pSLwe7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:27:59 imap(sales(a)mydomain.co.ke)<60932><9LLs45SL3u7FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:28:49 imap(sales(a)mydomain.co.ke)<61091><ekYq5pSLDO/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:29:05 imap(sales(a)mydomain.co.ke)<61225><qenN55SLoLC5HrCp>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Sent Items/dbox-Mails/dovecot.index.cache: UID 1853: Broken virtualsize in mailbox Sent Items: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.254): FETCH BODY[] got too little data: 3510 vs 1068172 Jun 18 11:29:15 imap(sales(a)mydomain.co.ke)<61272><Sb1s6JSLSe/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:29:43 imap(sales(a)mydomain.co.ke)<61393><FJIc6pSLfO/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:30:13 imap(sales(a)mydomain.co.ke)<61532><WGve65SLx+/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:30:39 imap(sales(a)mydomain.co.ke)<61647><e2x47ZSL+e/FsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:10 imap(sales(a)mydomain.co.ke)<61782><+L4175SLI/DFsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:36 imap(sales(a)mydomain.co.ke)<61905><pK/W8JSLafDFsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:36 imap(technical(a)mydomain.co.ke)<61899><TnXN8JSLifopUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 29: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.1): FETCH BODY[] got too little data: 131524 vs 772408 Jun 18 11:31:37 imap(sales(a)mydomain.co.ke)<61897><IgvJ8JSL4h0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 Jun 18 11:31:37 imap(technical(a)mydomain.co.ke)<61916><xhby8JSL6h0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/Deleted Items/dbox-Mails/dovecot.index.cache: UID 2: Broken virtual size in mailbox Deleted Items: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.460): FETCH BODY[] got too little data: 10123 vs 197577 Jun 18 11:31:37 imap(technical(a)mydomain.co.ke)<61919><hSf38JSL7B0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/technical/mdbox/mailboxes/Sent Items/dbox-Mails/dovecot.index.cache: UID 2: Broken virtual size in mailbox Sent Items: read(/var/spool/virtual/ mydomain.co.ke/technical/mdbox/storage/m.2): FETCH BODY[] got too little data: 3620 vs 817692 Jun 18 11:31:40 imap(sales(a)mydomain.co.ke)<61924><cEP+8JSL7h0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Sent Items/dbox-Mails/dovecot.index.cache: UID 1: Broken virtual size in mailbox Sent Items: read(/var/spool/virtual/mydomain.co.ke/sales/mdbox/storage/m.24): FETCH BODY[] got too little data: 5202 vs 1196884 Jun 18 11:31:44 imap(sales(a)mydomain.co.ke)<61937><bd8o8ZSL8B0pUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index.cache: UID 9: Broken virtual size in mailbox Sent: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.255): FETCH BODY[] got too little data: 46155 vs 1156185 Jun 18 11:31:46 imap(sales(a)mydomain.co.ke)<61962><cMlt8ZSLqfopUFt/>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index.cache: UID 8: Broken virtual size in mailbox Trash: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.657): FETCH BODY[] got too little data: 107289 vs 1338249 Jun 18 11:32:07 imap(sales(a)mydomain.co.ke)<62063><ZEiZ8pSLn/DFsVm2>: Error: Corrupted record in index cache file /var/spool/virtual/ mydomain.co.ke/sales/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: UID 25: Broken virtual size in mailbox INBOX: read(/var/spool/virtual/ mydomain.co.ke/sales/mdbox/storage/m.552): FETCH BODY[] got too little data: 17130 vs 370736 -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

1 0

Deleted dovecot.index.*
by Odhiambo Washington 17 Jun '19

17 Jun '19

I'm using mdbox. What's the consequence of deleting dovecot.index.* from all folders? All mail gets lost or I can rebuild the indexes and get the mails?

3 6

mailbox encryption
by David Mehler 17 Jun '19

17 Jun '19

Hello, I've got dovecot 2.3 going, and I've got a file 10-mailcrypt.conf which is loading mail_crypt, thinking that that plugin would propagate through all the services, sieve, lmtp, and mailbox message storage. I'm not seeing anything in the logs indicating that the encryption is happening. I am using a file format dbox specifically sdbox format, and in my mailbox I am seeing files like u.5 and others, a file check on them reveals them as data. Should I be seeing encryption in the logs? Thanks. Dave.

2 3

LDA vs LMTP change in header
by ＠lbutlr 17 Jun '19

17 Jun '19

Switching to dovecot LMTP appears to have change the information in the received header, which appears to be causing my spam filter to wig out and mark local to local emails as spam. Here’s what the received header used to look like: Received: from [10.0.5.3] (c-71-229-144-93.hsd1.co.comcast.net [71.229.144.93]) by mail.covisp.net (Postfix) with ESMTPS id B67B8118AD59 for <kreme(a)kreme.com>; Sun, 16 Aug 2009 22:19:02 -0600 (MDT) As opposed to now: Received: from darth.lan (c-73-14.161.160.hsd1.co.comcast.net [73.14.161.160]) by mail.covisp.net(Postfix 3.4.5/8.13.0) with SMTP id unknown; Sun, 16 Jun 2019 15:26:32 -0600 (envelope-from <kreme(a)kreme.com>) The first has an ESMTPS id and the other has SMTP id unknown, which seems to be causing Spamass-milter to treat the LMTP emails as unauthenticated and then ding them for being from public IPs. -- Thanks to the human heart by which we live, Thanks to its tenderness, its joys, and fears, To me the meanest flower that blows can give Thoughts that do often lie too deep for tears

1 0

What does Solr index do and how to handle its high avaliablity?
by luckydog xf 17 Jun '19

17 Jun '19

Hi, guys, Can you give me an example of solr usage in dovecot? As far as I know, you can search email easily by MUA like outlook, so which role does solr play? And based on https://dovecot.org/pipermail/dovecot/2019-April/115575.html I'm going to use an VIP to host 2 mail servers. Currently, it works in fail over and fail back test except solr index, so how to resolve this? Is it possible to put dovecot index on shared storage like NFS? How to if it's a yes. It seems it's under /var/solr/data/dovecot/data/ How to rebuild if I don't put index data on shared storage in case of fail over? Thanks,

2 3

Dovecot, quota, warning, and issue with setup?
by David Mehler 16 Jun '19

16 Jun '19

Hello, I'm having an issue or two with my new Dovecot setup. I'm running version 2.3.6 new setup, and using sdbox as the mailbox format. I'm getting the following warning: Jun 16 13:57:16 mail dovecot[9583]: lmtp(59153): Warning: quota: Namespace '' is not Maildir, skipping for Maildir++ quota Jun 16 13:57:16 mail dovecot[9583]: lmtp(username(a)example.net)<59153><rjVgD/yCBl0R5wAATNUJJw>: Warning: quota: Namespace '' is not Maildir, skipping for Maildir++ quota I'm also having issue with the public folder, it's not showing up. Below is my doveconf -n output. Any suggestions welcome. Thanks. Dave. # 2.3.6 (7eab80676): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.6 (92dc263a) # OS: FreeBSD 12.0-RELEASE-p4 amd64 # Hostname: mail.example.local auth_cache_size = 10 M auth_default_realm = example.net auth_mechanisms = plain login auth_realms = example.net example.com dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 2100 first_valid_uid = 2100 hostname = mail.example.net imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins last_valid_gid = 2100 last_valid_uid = 2100 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = 172.16.21.3 lmtp_rcpt_check_quota = yes log_timestamp = "%Y-%m-%d %H:%M:%S " mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /var/vmail/mailboxes/%d/%n mail_location = dbox:~/sdbox mail_plugins = acl fts fts_lucene mail_log notify quota trash virtual welcome zlib mail_crypt mail_privileged_group = vmail mail_server_admin = mailto:postmaster@example.net mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest editheader imapflags notify imapsieve vnd.dovecot.imapsieve namespace { location = sdbox:/var/vmail/public/:CONTROL=~/sdbox/public:INDEX=~/sdbox/public prefix = Public/ separator = / subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl fts = lucene fts_autoindex = yes fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_autoindex_exclude3 = \Spam fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. normalize no_snowball imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_crypt_curve = prime256v1 mail_crypt_global_private_key = # hidden, use -P to show it mail_crypt_global_public_key = # hidden, use -P to show it mail_crypt_save_version = 2 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_rule2 = Trash:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-script.sieve sieve_after = /home/vmail/sieve/after.d sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_extensions = +notify +imapflags +spamtest +spamtestplus +virustest +editheader sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.environment sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_user_log = /home/vmail/sieve/sieve_error.log sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u postmaster@%d welcome_wait = yes } postmaster_address = postmaster(a)example.net protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 } service imap { executable = imap } service lmtp { executable = lmtp unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 172.16.21.3 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ssl/acme.sh/example.net/fullchain.crt ssl_cipher_list = ECDH+AESGCM:ECDH+CHACHA20:ECDH+AES256:ECDH+AES128:!aNULL:!SHA1 ssl_curve_list = P-256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_options = no_ticket ssl_prefer_server_ciphers = yes userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot/dovecot-lmtp.log log_path = /var/log/dovecot/dovecot-lmtp-errors.log mail_fsync = optimized mail_plugins = acl fts fts_lucene mail_log notify quota trash virtual welcome zlib mail_crypt sieve } protocol lda { mail_fsync = optimized mail_plugins = acl fts fts_lucene mail_log notify quota trash virtual welcome zlib mail_crypt sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl fts fts_lucene mail_log notify quota trash virtual welcome zlib mail_crypt imap_acl imap_quota imap_sieve imap_zlib last_login } protocol sieve { info_log_path = /var/log/dovecot/dovecot-sieve.log log_path = /var/log/dovecot/dovecot-sieve-errors.log }

2 1

Self-signed TLS client certificates
by Marvin Gülker 16 Jun '19

16 Jun '19

Dear List, I self-host my e-mail and run Dovecot since ever I do that. Dovecot version is 2.3.4.1 (f79e8e7e4), running on Debian testing. Now I am trying to configure Dovecot for client TLS certificates. I have a self-signed certificate whose private key resides on a smartcard (Yubikey, to be exact). I wanted Dovecot to accept that TLS client certificate instead of a password. So I searched and found this wiki page: <https://wiki2.dovecot.org/SSL/DovecotConfiguration#Client_certificate_verif…> But that Wiki page says: > The CA file should contain the certificate(s) followed by the matching > CRL(s). Note that the CRLs are required to exist. I have now messed three hours or so with OpenSSL to get a CRL generated for my self-signed certificate, but I can't get that to work (the problem appearently being that OpenSSL doesn't play well with private keys on smartcards). It doesn't make sense anyway, why does one need a CRL for a self-signed certificate? If the self-signed certificate's key gets compromised, the CRL does not help at all. So, here are my questions: 1. Is a CRL really a hard requirement? 2. If not: can I just use the self-signed certificate of my private key for the ssl_ca setting? 3. If yes: any idea how I can generate a CRL for my smartcard-bound self-signed certificate? Marvin -- Blog: https://mg.guelker.eu

2 3

failed to pipe to program sa-learn-spam.sh
by ＠lbutlr 16 Jun '19

16 Jun '19

Error: program `/usr/lib/dovecot/sieve/sa-learn-spam.sh' terminated abnormally, signal 11 Error: sieve: pipe action: failed to pipe message to program `sa-learn-spam.sh': refer to server log for more information. [2019-05-29 17:59:12] What server log? This is all that get logged. # pwd /usr/lib/dovecot/sieve # ls -lsa > total 96 > 8 drwxrwxrwx 3 root wheel 512 Jun 18 2018 . > 8 drwxr-xr-x 3 root wheel 512 May 17 17:54 .. > 8 -rw-r--r-- 1 root wheel 86 Jun 15 2018 default.sieve > 8 drwxr-xr-x 2 root wheel 512 Jun 13 2018 global > 8 -rw-r--r-- 1 root wheel 62 May 14 2018 mark-read.sieve > 8 -rw-r--r-- 1 kremels wheel 192 Jun 17 2018 mark-read.svbin > 8 -rwxr-xr-x 1 root wheel 314 Feb 12 2018 report-ham.sieve > 8 -rw-r--r-- 1 lbutler wheel 448 Jun 18 2018 report-ham.svbin > 8 -rwxr-xr-x 1 root wheel 199 Feb 12 2018 report-spam.sieve > 8 -rw-r--r-- 1 kreme wheel 354 Jun 15 2018 report-spam.svbin > 8 -rwxr-xr-x 1 root wheel 131 Jun 18 2018 sa-learn-ham.sh > 8 -rwxr-xr-x 1 root wheel 54 Feb 12 2018 sa-learn-spam.sh # cat sa-learn-spam.sh > #!/bin/sh > exec /usr/local/bin/sa-learn -u ${1} --spam # ls -ls /usr/local/bin/sa-learn > 96 -rwxr-xr-x 1 root wheel 45939 May 29 09:59 /usr/local/bin/sa-learn report-spam.sieve: > require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables"]; > > if environment :matches "imap.user" "*" { > set "username" "${1}"; > } > > pipe :copy "sa-learn-spam.sh" [ "${username}" ]; in doveconf I have: > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > > plugin { > imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve > imapsieve_mailbox1_causes = COPY > imapsieve_mailbox1_name = Junk > … It WAS working. -- Women and cats will do as they please, and men and dogs should relax an get used to the idea.

3 6

NOTIFY: bug on mailbox renaming and deletion ?
by kael 16 Jun '19

16 Jun '19

Hello, Testing the NOTIFY extension on imap.vivaldi.net, seems there's a bug when a mailbox is renamed or deleted. Requesting events with: A1 NOTIFY SET (inboxes (SubscriptionChange MailboxName)) Here are the sent events: - mailbox creation with automatic subscription (ok): * LIST () "." foo * LIST (\Subscribed) "." foo - mailbox renaming (bug ?): * LIST () "." bar ("OLDNAME" (foo)) * LIST (\Subscribed) "." bar * LIST () "." foo - mailbox deletion (bug ?): * LIST (\NonExistent) "." Trash.bar * LIST () "." Trash.bar It seems that for the two latter cases, the last received event is incorrect, Dovecot notifying of mailbox unsubscription after the mailbox has been renamed or deleted. In that case a client would consider those two last events not as mailbox renaming or deletion, but as a mailbox creation, wouldn't it ? Am I missing something ? Cheers. -- kael

1 0

sdbox format, quota not maildir, and public folder
by David Mehler 16 Jun '19

16 Jun '19

Hello, I'm using Dovecot 2.3.x and using dbox as mailbox storage format, specifically sdbox. I'm getting an error from quota about namespace is not maildir is there a setting I have to use for quota to use the sdbox?

1 0

Dovecot 2.3 error, FreeBSD 12 in a jail
by David Mehler 15 Jun '19

15 Jun '19

Hello, I'm trying to get Dovecot going on my system. It's a FreeBSD 12.0-RELEASE system and it's running dovecot 2.3 via ports in a jail. I'm getting the same error message(s) as in this bug report, which has been marked as closed: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=225078 Dovecot is not starting at all in this jail when starting with service dovecot start. A service dovecot status also reveals the error message about /var/run/dovecot/dovecot.conf file, but a doveconf -n does not reveal any configuration file issues. I did put a symlink in /var/run/dovecot to /usr/local/etc/dovecot/dovecot.conf, this did not correct the issue. Any suggestions welcome. Thanks. Dave.

2 1

LMTP doesn't save to +mailbox
by ＠lbutlr 14 Jun '19

14 Jun '19

Since switching to lmtp in dovecot, mail to user+mailboix(a)example.com does not get saved in ‘.mailbox’ as it did with LDA, instead it gets saved into the INBOX. If it matters, these are users who do NOT have a ~/.active_sieve file. I could understand (though it would bene a bit annoying) if the save overrode this mechanism. I did add lmtp_save_to_detail_mailbox = yes in the protocol lmtp block protocol lmtp { postmaster_address = postmaster(a)covisp.net # required mail_plugins = quota sieve info_log_path = /var/log/dovecot-lmtp.log lmtp_save_to_detail_mailbox = yes } This is the error I am getting when sending to luser+covisp(a)covisp.net lmtp(luser(a)covisp.net)<91193><EqkiJV70A105ZAEAIdGjjQ>: Error: sieve: msgid=<A3ED963A-97FB-4A1F-9F09-45F2AEA96CF6(a)kreme.com>: failed to store into mailbox 'covisp': Mailbox doesn't exist: covisp lmtp(luser(a)covisp.net)<91193><EqkiJV70A105ZAEAIdGjjQ>: Error: sieve: Execution of script /usr/lib/dovecot/sieve/default.sieve failed with unsuccessful implicit keep # cat /usr/lib/dovecot/sieve/default.sieve [13:32] [/var/log] require "fileinto"; if header :contains "X-spam-flag" "YES" { fileinto "Junk"; } (This file hasn’t changed in a year, so it worked fine with the lda instead of the lmtp setup. I mean, I can probably just write a sieve to do it. Let me think… if header :regex "to" “+(.*)@" { fileinto :create “${1}"; stop; } Seems like it should work. Should I add this to default.sieve? # 2.3.6 (7eab80676): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.6 (92dc263a) # OS: FreeBSD 11.2-RELEASE-p10 i386 # Hostname: mail.covisp.net auth_failure_delay = 5 secs auth_mechanisms = PLAIN LOGIN default_client_limit = 4096 default_process_limit = 1024 default_vsz_limit = 768 M disable_plaintext_auth = no first_valid_uid = 89 imap_id_log = * login_log_format_elements = user=<%u> %r %m %c mail_location = maildir:~/Maildir mail_max_userip_connections = 90 managesieve_notify_capability = mailto managesieve_sieve_capability = editheader fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/usr/lib/dovecot/sieve/mark-read.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Archive quota_rule2 = .EXPUNGED:ignore sieve = file:~/.sieve;active=~/.active_sieve sieve_default = /usr/lib/dovecot/sieve/default.sieve sieve_default_name = spamassassin sieve_extensions = +editheader sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = ~/sieve.log } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } service stats { unix_listener stats-reader { group = dovecot mode = 0666 user = } unix_listener stats-writer { group = dovecot mode = 0666 user = } } ssl_cert = </usr/local/etc/dehydrated/certs/covisp.net/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.1 userdb { args = /usr/local/etc/dovecot/sql.conf default_fields = uid=vpopmail gid=vchkpw mail_location=maildir:/usr/local/virtual/%u/Maildir mail=maildir:/usr/local/virtual/%u/Maildir driver = sql } protocol imap { mail_plugins = " imap_sieve" } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log lmtp_save_to_detail_mailbox = yes mail_plugins = quota sieve postmaster_address = postmaster(a)covisp.net }

1 2

Dovecot director: show user breakdown by director?
by Eirik Rye 14 Jun '19

14 Jun '19

Hi, We have recently started using the director in some tests. We are using the static passdb setup (proxy=y nopassword=y) for now, where authentication is done on the downstream IMAP servers. "dovecot director status" shows a breakdown of proxied connections per backend, but there does not seem to be a similar breakdown of user connections per director. The output of "doveadm who" is empty. I assume this is due to there being no local userdb/passdb on the directors? root@xxx:/etc/dovecot/conf.d# doveadm who username # proto (pids) (ips) Is there a way in Dovecot to see which (or even how many) users are connected to a specific director without having to count TCP connections? Best regards, Eirik Rye

2 2

Addheader specified field name `Reply-To:' is invalid.
by ＠lbutlr 14 Jun '19

14 Jun '19

Well, progress. At least now editheader loads. Sadly that brings up new errors. specified field name `Reply-To:' is invalid. if header :contains "List-id" "<users.spamassassin.apache.org>" { addheader "Reply-To:" "<users.spamassassin.apache.org>"; addheader "X-added-reply-To:" "True"; fileinto :create “spamassassin"; stop;} -- You only had to look into Teatime's mismatched eyes to know one thing, which was this: if Teatime wanted to find you he would not look everywhere. He'd look in only one place, which would be the place where you were hiding. —Hogfather

2 3

MultiMaster dsync (cluster1 cluster2 cluster3)
by Matthew Brown 14 Jun '19

14 Jun '19

Will MultiMaster dsync work fine or will be big problems ? I configured dovecot to dsync from serv1 to serv2 to serv3 and repeat to serv1 to serv2 to serv3 and repeat... When email received to serv2, it will be synced to serv3, and serv3 will sync it to serv1, and serv1 will sync it to serv2 and will stop here because emails matched. What problems can be with this kind of configuration ? (except that if one of server(cluster) will be stopped, sync will be stopped too until cluster is online again)

2 1

Sieve rewrite headers?
by ＠lbutlr 14 Jun '19

14 Jun '19

I’ve bene looking for examples on how to do this, but so far am coming up short. I want to check certain messages for a reply-ro header and if it is present, rewrite it to X-Reply-To: and then add my own reply-to header. I don’t see anything in the various sieve examples I’ve found on altering the actual message. There is the editheader extension, but I failed to find documentation or examples on how to use it. It appears that I can add a header and delete a header (addheader deleteheader?) but not rewrite one. So something like if header “Reply-to: foo(a)bar.xn--tld-9o0a { addheader "X-Reply-To: foo(a)bar.xn--tld-9o0a deleteheader “Reply-To:” addheader "X-Reply-To: bar(a)foo.xn--tld-9o0a } ?? Do I need to delete the header or will the add header overwrite the one that is there? Also, how do people manage different sieve files? Just cat them all into the active one, or is there a mechanism to import/switch/load other files?

2 1

unknown Sieve Capability `editheader'
by ＠lbutlr 14 Jun '19

14 Jun '19

I am getting "error: error: require command: unknown Sieve capability `editheader’.” In sieve.log: This is the start of .active_sieve ## Active require [ "editheader", "regex", "variables", "fileinto", "envelope", "mailbox", "imap4flags" ]; Editheader is also listed in dovecot.conf managesieve_sieve_capability = editheader fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave

2 1

Re: Re: CASifying dovecot and webmail
by charli AGOSSOU 14 Jun '19

14 Jun '19

Hi. I have been trying for a long time to roundcube but I have trouble doing it. It may therefore be necessary to manage the casification of dovecot. Something that is not easy right now with the operating system version that I use. I am working with a kali 2019, and I have compilation errors when running the make on pam_cas. Any help will be useful to me. Thank you Charlie Harper Best regards,

1 0

Re: Migrated from maildir to sdbox: questions
by Daniel Betz 14 Jun '19

14 Jun '19

Hi Ranbir, i think youre just using the wrong quota backend. https://wiki2.dovecot.org/Quota You should switch from "quota = maildir...." to another one, like dict. Converting your Public mailbox you could try this ( no guarantee .. just guessing. make backup ! ): doveadm -o mail_location="maildir:/var/spool/mail/thesandhufamily.ca/public" sync sdbox:/target/folder Regards, Daniel > > Hi Everyone, > > I migrated my maildir mailboxes to sdbox without any show stopping errors, > but I did see this during the migration and now I'm also seeing it in the log: > > Warning: quota: Namespace '' is not Maildir, skipping for Maildir++ quota > > I'm not quite sure why this is happening. Any ideas? > > I am using a "public" namespace for several mailboxes to share emails: > > # public namespace configuration > namespace { > type = public > # the default separator for Maildir is ".", so that is what should be > # used automatically. > separator = . > prefix = Public. > location = maildir:/var/spool/mail/thesandhufamily.ca/public > subscriptions = no > } > > Under the "public" dir in the old maildir setup, I have folders configured for > various mail accounts. For example: > > .Ads > .Junk > .Bills > > etc. > > These "users" are setup in a passwd file so that I can use a different mail > storage location for them than the one they get from ldap (same as above). > > Using dsync to migrate my other mailboxes was easy, but I don't know how > to migrate these public mailboxes. I looked through the wiki and didn't see > anything about how to do it. Could someone explain how I can migrate the > public mailboxes? > > > -- > Ranbir >

3 2

Outlook renames Junk folder
by Cliff Hayes 13 Jun '19

13 Jun '19

Hello, Some versions of Outlook will randomly rename the Junk folder to Junk Email. This of course causes errors because Dovecot can no longer store junk. I go in to Outlook for each user and add another Junk folder, so now they have Junk and Junk Email. This fix action lasts a while until Outlook decides to do it again. Is there a way to tell Dovecot that if the Junk folder doesn't exist, try sending the email to Junk Email folder? Thanks in advance.

3 3

Sieve logging?
by ＠lbutlr 13 Jun '19

13 Jun '19

I am trying to create some sieve scripts to filter my mailing lists and am wondering if sieve logs anywhere, and it so where? I don’t see anything in mail.log beyond lines like: dovecot: lda(kremels(a)kreme.com)<39790><hNchChSkAV1umwAAIdGjjQ>: sieve: msgid=<267D5D71-D99C-4790-8706-C1A92BCC9F97(a)kreme.com>: stored mail into mailbox ‘INBOX' Which doesn’t really tell me anything other than that the script failed. -- If the #2 pencil is the most popular, why is it still #2?

3 6

Re: Sieve logging?
by Matt Anton 13 Jun '19

13 Jun '19

On 13 Jun 2019, at 14:47, @lbutlr wrote: > What sort of configuration change would I need to do to use LMTP instead of LDA? Regarding dovecot, all you need to do is following: <https://wiki.dovecot.org/LMTP> <https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP> (if postfix is your MTA) <https://wiki.dovecot.org/LMTP/Exim> (if exim is your MTA) > And are there any downsides? Not that I’m aware of. Things remained the same as when I was using LDA but using LMTP over Dovecot’s LDA brings some advantages like better performances (no need to fire up new processes for deliveries) among others one. There were several threads on the list related to LDA vs LMTP, such as: <https://dovecot.org/pipermail/dovecot/2016-June/104670.html> <https://dovecot.org/list/dovecot/2013-July/091617.html> > What do I do about > > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > > ? They’re also used by LMTP so no need to worry when migrating from LDA to LMTP. You can check what LDA’s options are specifically also used by LMTP in examples/conf.d/15-lda.conf -- matt [at] lv223.org GPG key ID: 7D91A8CA

1 0

Migrated from maildir to sdbox: questions
by Ranbir 13 Jun '19

13 Jun '19

Hi Everyone, I migrated my maildir mailboxes to sdbox without any show stopping errors, but I did see this during the migration and now I'm also seeing it in the log: Warning: quota: Namespace '' is not Maildir, skipping for Maildir++ quota I'm not quite sure why this is happening. Any ideas? I am using a "public" namespace for several mailboxes to share emails: # public namespace configuration namespace { type = public # the default separator for Maildir is ".", so that is what should be # used automatically. separator = . prefix = Public. location = maildir:/var/spool/mail/thesandhufamily.ca/public subscriptions = no } Under the "public" dir in the old maildir setup, I have folders configured for various mail accounts. For example: .Ads .Junk .Bills etc. These "users" are setup in a passwd file so that I can use a different mail storage location for them than the one they get from ldap (same as above). Using dsync to migrate my other mailboxes was easy, but I don't know how to migrate these public mailboxes. I looked through the wiki and didn't see anything about how to do it. Could someone explain how I can migrate the public mailboxes? -- Ranbir

1 0

Sieve to strip html from multipart messages
by ＠lbutlr 13 Jun '19

13 Jun '19

Is is possible (I’m sure it is, so how) to strip multipart messages that are HTML and text of the HTML portion and leave the bare text message without also stripping other parts (like images or attached files). Or also to take messages that are only HTML and strip the HTML and replace it with a plain text version? I used to do this a long time ago with procmail and lynx, but it was never reliable since procmail doesn’t really understand MIME.

2 2

Updating passwords
by ＠lbutlr 12 Jun '19

12 Jun '19

I created some new users in my MySQL database using postfoxadmin. The passwords looked correct in the database and show the right prefix {SHA256-CRYPT} but logins were failing, so I manually created new passwords from the command line: doveadm pw -s SHA256-CRYPT -p “a password" -u kremels(a)kreme.com {SHA256-CRYPT}$5$ZKsovTv0Ddc9k4… I then went into the postfix database and manually updated the password field in the database. update mailbox set password = '$5$ZKsovTv0Ddc9k4…' where username like 'kremels(a)kreme.com'; SOME of the accounts can now login, but not all. I get a debug line like: dovecot: auth-worker(26599): Debug: sql(kremels(a)kreme.com,xx.xx.xx.xx,<rnadomlookingstuff>): SHA256-CRYPT(a password) != '$5$ZKsovTv0Ddc9k4… -- 'They've given us the answers,' he [Carrot] said. 'Perhaps we can find out what the questions should have been.' --Feet of Clay

1 1

Password issue
by Cerebus the Aardvark 12 Jun '19

12 Jun '19

I am using SHA-256 crypt for dovecot. I have added some new users vi postfoxadmin, which is also configured to use she-256 crypt. looking at the database: {SHA256-CRYPT}$5$lKfXOxua8j9FIFJt$r4rLmMFHUK/FcJ0c.sp.U4paTeE6Obp0t.mj.6eJQx9 # works {SHA256-CRYPT}$5$Gy.zyFNgYHgSsvmh$C/8Fv47Rjij6S73SwkfhCTwuqGgsmiRCjke6blbt1YD # does not work (I changed some random character in each line, but didn't change the length) Jun 12 12:43:09 mail dovecot: auth: Debug: policy(kremels,73.14.161.160,<0VjtyCSLluJJDqGg>): Policy check action is continue Jun 12 12:43:09 mail dovecot: auth-worker(57297): Debug: sql(kremels,73.14.161.160,<0VjtyCSLluJJDqGg>): query: select password FROM mailbox where username ='kremels' Jun 12 12:43:14 mail dovecot: auth: Debug: client passdb out: FAIL#0111#011user=kremel

1 0

LMTP and Sieve with <prefix><recipient_delimiter><user>
by Paul Muster 11 Jun '19

11 Jun '19

Hi there, Dovecot's LMTP implementation and Pigeonhole Sieve already do support the <user><delimiter><suffix> format. RfC 5233, the Sieve subaddress extension, also offers <prefix><delimiter><user>. Could Docecot's LMTP and Pigeonhole be extended to that effect? Thanks & greetings, Paul

1 2

Compile problem on Solaris
by Roderick Johnstone 11 Jun '19

11 Jun '19

Hi Compiling dovecot 2.2.36.1 with the native compiler on Solaris 10 is giving the error below. Can anyone advise a compiler option or code change to resolve this please. Thanks. Roderick Johnstone # make make all-recursive Making all in . /bin/bash ./update-version.sh . . Making all in src Making all in lib-test Making all in lib make all-am source='sha3.c' object='sha3.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../.. -I/export/home/exim_build_20190605/build_local/include -m64 -c -o sha3.lo sha3.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I/export/home/exim_build_20190605/build_local/include -m64 -c sha3.c -KPIC -DPIC -o .libs/sha3.o "sha3.h", line 49: warning: unnamed struct member "sha3.c", line 142: improper member use: s "sha3.c", line 142: improper member use: s "sha3.c", line 166: improper member use: s "sha3.c", line 173: improper member use: s "sha3.c", line 197: improper member use: s "sha3.c", line 200: improper member use: s "sha3.c", line 227: improper member use: s "sha3.c", line 231: improper member use: s "sha3.c", line 233: improper member use: s "sha3.c", line 259: improper member use: sb "sha3.c", line 268: improper member use: sb cc: acomp failed for sha3.c *** Error code 1

2 2

Potfix+Dovecot with dsync replication problem
by Zeljko Dokman 10 Jun '19

10 Jun '19

Hi all, I am in need of some help. Straggling to make something work, trying to configure postfix and dovecote imap server with dovecote replication. Can’t figure out what is wrong with my configuration. Replication is working only for vmail user account, I am getting this error on my secondary server for all other users… dovecot: doveadm: Fatal: setgid(4015(zdokman) from userdb lookup) failed with euid=5000(vmail), gid=5000(vmail), egid=5000(vmail): Operation not permitted (This binary should probably be called with process group set to 4015(zdokman) instead of 5000(vmail)) primary server reports this error: dovecot: doveadm(zdokman): Error: doveadm server disconnected before handshake: EOF dovecot: doveadm(zdokman): Error: sync: Disconnected from remote: EOF doveadm replicator status '*' username priority fast sync full sync success sync failed vmail none 01:58:13 02:05:25 01:58:13 - zdokman none 00:00:25 02:55:26 - y test none 00:01:00 21:48:13 - y doveadm sync * doveadm(root): Fatal: execvp(Maildir) failed: Permission denied dsync-local(root): Error: read(remote) failed: EOF (version not received) I am attaching my dovecot.conf main.cf and master.cf. I think my problem is with permissions but I can figure out how to workaround it. Best regards

2 3

Sql user and maildirs
by ＠lbutlr 10 Jun '19

10 Jun '19

For many years I had the following in my dovecot.conf: userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext default_fields = uid=vpopmail gid=vchkpw mail_location=/usr/local/virtual/%u/Maildir mail=maildir:/usr/local/virtual/%u/Maildir driver = sql } Recently, I started having quite a lot of errors on one MySQL account (used as a bcc backup account) along the lines of Fatal: Namespace '': Ambiguous mail location setting, don't know what to do with it: /usr/local/virtual/backup@domain/Maildir (try prefixing it with mbox: or maildir: Messages were sitting in the mail and were also getting dumped into /usr/local/virtual/backup@domain/new and I ended up running a fun little awk to move them into the right folders: grep -r "<backup+" . |awk -F: '{t=tolower($2); f=tolower($1); gsub(/@.*/, "/", t); sub(/<backup\+/, "../Maildir/", t); sub(/\.\//, "",f); cmd="mv " f" “t; system(cmd); }’ So I changed my doevecot.conf to: userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext default_fields = uid=vpopmail gid=vchkpw mail_location=maildir:/usr/local/virtual/%u/Maildir mail=maildir:/usr/local/virtual/%u/Maildir driver = sql } And the errors went away. So, no problem here to solve, but I am curious why I haven’t been having issues until quite recently? Was there a change or have I stumbled into something where it only looks like I’ve fixed the issue? In case it matters? # cat dovecot-sql.conf.ex [7:57] [/etc/dovecot] driver = mysql connect = host=localhost dbname=postfixusers user=dovecot password=x default_pass_scheme = SHA256-CRYPT password_query = select password FROM mailbox where username ='%u' user_query = select 89 as uid, 89 as gid, concat('/usr/local/virtual/', maildir, 'Maildir') as home FROM mailbox where username = '%u' The only ‘recent’ change I’ve made to my configuration was creating the Maildir/ subfolder for all the virtual users instead of using the ‘mailder’ from the sql table (that is, I added “, ‘Maildir’” to the concat, but that was quite awhile ago. I’m pretty sure I’d have noticed this before. Is that user_query as it should be or should I set concat('/usr/local/virtual/', maildir) as home and also set concat(‘maildir:/usr/local/virtual/', maildir, 'Maildir') as mail here rather than in the userdb block? -- K is for KATE who was struck by an axe L is for Leo who swallowed some tacks

1 1

Re: doveconf complains No matches on !include conf.d/* line but still writes out contents in conf.d
by Ben Ma 10 Jun '19

10 Jun '19

Further investigation shows that `doveconf` called `/usr/lib/dovecot/managesieve` which in return calls `doveconf` again, but with another uid (possible? I'm not sure) and a few extra arguments, which causes a call to `glob` in `src/config/config-parser.c:settings_include` to fail with `GLOB_NOMATCH`. I'd be appreciate if anyone can provide information on suspicious permission-relating operation that `managesieve` does before calling `doveconf`. I just can't find a way to post reply on previous mails, so I decided to post a new one. The original text follows. On 2019/6/6 3:15, Ben Ma wrote: > I'm on dovecot 2.3.3 (dcead646b). Output of `dovecot -n`: > > # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version > 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file > /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: > managesieve-login: dump-capability process returned 89 doveconf: > Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: > No matches > > While line 98 of dovecot.conf is just "!include conf.d/*.conf". > > Output of `doveconf -n`: > > # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version > 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file > /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: > managesieve-login: dump-capability process returned 89 # OS: Linux > 4.12.14-lp151.28.4-default x86_64 # Hostname: XXX doveconf: Error: > t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: > No such file or directory namespace inbox { ............. (Removed for > simplicity) } ssl = required ssl_cert = > </etc/postfix/ssl/certs/phys.cer ssl_options = no_compression > ssl_prefer_server_ciphers = yes userdb { driver = passwd } > > It's strange that all the extra content (especially ssl conf) only > occurs in conf.d/10-ssl.conf. > > To dig on what's happening underneath I ran `strace doveconf -n 2>&1 > |egrep "\.conf|conf\.d"` and got: > > write(1, "# 2.3.3 (dcead646b): /etc/doveco"..., 47# 2.3.3 (dcead646b): > /etc/dovecot/dovecot.conf openat(AT_FDCWD, > "/etc/dovecot/dovecot.conf", O_RDONLY) = 7 wait4(-1, doveconf: Fatal: > Error in configuration file /etc/dovecot/dovecot.conf line 98: No > matches open("/etc/dovecot/conf.d", > O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 8 openat(AT_FDCWD, > "/etc/dovecot/conf.d/90-sieve.conf", O_RDONLY) = 8 ............. > (Removed for simplicity) openat(AT_FDCWD, > "/etc/dovecot/conf.d/10-ssl.conf", O_RDONLY) = 20 openat(AT_FDCWD, > "/etc/dovecot/conf.d/10-auth.conf", O_RDONLY) = 25 > stat("/etc/dovecot/conf.d/auth-system.conf.ext", > {st_mode=S_IFREG|0644, st_size=2182, ...}) = 0 openat(AT_FDCWD, > "/etc/dovecot/conf.d/auth-system.conf.ext", O_RDONLY) = 26 > stat("/etc/dovecot/local.conf", 0x7ffd94664760) = -1 ENOENT (No such > file or directory) stat("/etc/resolv.conf", {st_mode=S_IFREG|0644, > st_size=709, ...}) = 0 open("/etc/host.conf", O_RDONLY|O_CLOEXEC) = 7 > read(7, "#\n# /etc/host.conf - resolver co"..., 4096) = 370 > open("/etc/resolv.conf", O_RDONLY|O_CLOEXEC) = 7 read(7, "### > /etc/resolv.conf is a symlin"..., 4096) = 709 > readlink("/var/run/dovecot/dovecot.conf", 0x5555db302598, 128) = -1 > ENOENT (No such file or directory) write(2, "doveconf: Error: > t_readlink(/var"..., 112doveconf: Error: > t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: > No such file or directory > > It seems that files in conf.d is never read before doveconf's > complaint! I have totally no idea why this happens. Any help?

1 0

sieve setup. no svbin ?
by Voytek Eymont 09 Jun '19

09 Jun '19

since moving/upgrading system I've noticed I no longer get sieve script compiled, there is no dovecot.svbin created in /var/vmail/vmail1/sbt.net.au/voytek(a)tld.au/sieve what am I missing, how to check ? also, looking at sieve.log, I see a lot of May 31 06:32:50 lda(voytek(a)sbt.net.au)<1234><c4aVBfI98FzSBAAAyLbbsQ>: Error: sieve: Failed to initialize script execution: Invalid postmaster_address: invalid address `root' specified for the postmaster_address setting # grep root dovecot.conf postmaster_address = root what should I have ? # dovecot --version 2.3.6 (7eab80676)

2 5

FTS Xapian
by Daniel Miller 09 Jun '19

09 Jun '19

For my primary namespace this is working fine - thanks to the developers! It also appears to work great for shared folders as well. But my virtual folders aren't returning results - at least not to the client. The logs show FTS Xapian opening several DB files and getting results - but nothing is being returned to client. Is this a config issue on my side or is this a current limitation of the plugin? -- Daniel

2 5

Last Login Plugin Help
by Júlio Covolato 07 Jun '19

07 Jun '19

Hi, I'm configuring Last_Login plugin whith Mysql back end and all works fine. I just wonder to track besides time_stamp, user and domain, the remote IP and proto (imap or pop3) I tried in dovecot.conf: plugin { ... ... # Track last login time on imap and pop3 last_login_dict = proxy::lastlogin last_login_key = last-login/%u/%d/%r } dict { ... lastlogin = mysql:/etc/dovecot/dovecot-last-login.conf ... } protocol imap { mail_plugins = $mail_plugins ... last_login ... } protocol pop3 { mail_plugins = $mail_plugins last_login ... } And dovecot-last-login.conf: connect = host=127.0.0.1 port=3306 dbname=vmail user=vmailadmin password=xxxxxxxxxxxxxxxxxx map { pattern = shared/last-login/$user/$domain table = last_login value_field = last_login value_type = uint fields { username = $user domain = $domain rip = $rip } } And the table criated in mysql: CREATE TABLE IF NOT EXISTS `last_login` ( `username` VARCHAR(255) NOT NULL DEFAULT '', `domain` VARCHAR(255) NOT NULL DEFAULT '', `last_login` INT(11) DEFAULT NULL, `rip` VARCHAR(16) NOT NULL DEFAULT '', PRIMARY KEY (`username`), INDEX (`domain`), INDEX (`last_login`), INDEX (`rip`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8; And got de error in dovecot log: Jun 06 13:56:59 dict(21157): Error: Failed to initialize dictionary 'lastlogin': dict mysql: Error in configuration file /etc/dovecot/dovecot-last-login.conf line 13: Unused variable: rip Thanks in any help. -- ---------------------------------- _ Engº Julio Cesar Covolato 0v0 <julio(a)psi.com.br> /(_)\ F: +55 11 99175-9260 ^ ^ PSI INTERNET ---------------------------------- --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

2 3

doveconf complains No matches on !include conf.d/* line but still writes out contents in conf.d
by runappz 05 Jun '19

05 Jun '19

I'm on dovecot 2.3.3 (dcead646b). Output of `dovecot -n`: # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches While line 98 of dovecot.conf is just "!include conf.d/*.conf". Output of `doveconf -n`: # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: managesieve-login: dump-capability process returned 89 # OS: Linux 4.12.14-lp151.28.4-default x86_64 # Hostname: XXX doveconf: Error: t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: No such file or directory namespace inbox { ............. (Removed for simplicity) } ssl = required ssl_cert = </etc/postfix/ssl/certs/phys.cer ssl_options = no_compression ssl_prefer_server_ciphers = yes userdb { driver = passwd } It's strange that all the extra content (especially ssl conf) only occurs in conf.d/10-ssl.conf. To dig on what's happening underneath I ran `strace doveconf -n 2>&1 |egrep "\.conf|conf\.d"` and got: write(1, "# 2.3.3 (dcead646b): /etc/doveco"..., 47# 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf openat(AT_FDCWD, "/etc/dovecot/dovecot.conf", O_RDONLY) = 7 wait4(-1, doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches open("/etc/dovecot/conf.d", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 8 openat(AT_FDCWD, "/etc/dovecot/conf.d/90-sieve.conf", O_RDONLY) = 8 ............. (Removed for simplicity) openat(AT_FDCWD, "/etc/dovecot/conf.d/10-ssl.conf", O_RDONLY) = 20 openat(AT_FDCWD, "/etc/dovecot/conf.d/10-auth.conf", O_RDONLY) = 25 stat("/etc/dovecot/conf.d/auth-system.conf.ext", {st_mode=S_IFREG|0644, st_size=2182, ...}) = 0 openat(AT_FDCWD, "/etc/dovecot/conf.d/auth-system.conf.ext", O_RDONLY) = 26 stat("/etc/dovecot/local.conf", 0x7ffd94664760) = -1 ENOENT (No such file or directory) stat("/etc/resolv.conf", {st_mode=S_IFREG|0644, st_size=709, ...}) = 0 open("/etc/host.conf", O_RDONLY|O_CLOEXEC) = 7 read(7, "#\n# /etc/host.conf - resolver co"..., 4096) = 370 open("/etc/resolv.conf", O_RDONLY|O_CLOEXEC) = 7 read(7, "### /etc/resolv.conf is a symlin"..., 4096) = 709 readlink("/var/run/dovecot/dovecot.conf", 0x5555db302598, 128) = -1 ENOENT (No such file or directory) write(2, "doveconf: Error: t_readlink(/var"..., 112doveconf: Error: t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: No such file or directory It seems that files in conf.d is never read before doveconf's complaint! I have totally no idea why this happens. Any help?

1 0

Re: Potfix+Dovecot with dsync replication problem
by Zeljko Dokman 05 Jun '19

05 Jun '19

Hi all, I am still struggling with this issue. I scraped my previous configuration and started from beginning. Thanks to Aki Tuomi and his suggestion I changed the users in my configurations from vmail --> root and that helped. Now I have a working replication but with some problems and strange behavior. Replication works only when I manually execute a command: "doveadm sync -A tcp:secundary:server:12345" Automatic fast and full sync do not work: doveadm replicator status "*" username priority fast sync full sync success sync failed zdokman none 01:46:14 01:46:14 01:46:14 - doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 1 doveadm replicator dsync-status username type status - Not connected maillog has no error entries. my conf files are attached. I don't understand why is this happening and how to fix it, any help is much appreciated. Best regards, On Mon, 13 May 2019 at 15:23, Zeljko Dokman <zdokman(a)gmail.com> wrote: > Hi, > Thank you for your reply Aki. > I changed my configuration and substituted vmail user with root user. > > Now I have no error massages in maillog but replication is not working, > mails are not visible on second server. > > BR > > > > > > On Mon, 13 May 2019 at 10:50, Aki Tuomi <aki.tuomi(a)open-xchange.com> > wrote: > >> Your problem is that you are running service doveadm as vmail, but you >> are using real uids. You need to start doveadm server as root to be able to >> switch into the correct target user. >> >> Aki >> >> >> On 13.5.2019 11.26, Zeljko Dokman via dovecot wrote: >> >> Hi all, >> >> Any suggestion? >> >> BR >> >> On Mon, 6 May 2019 at 14:22, Zeljko Dokman <zdokman(a)gmail.com> wrote: >> >>> Hi all, >>> >>> I am in need of some help. >>> >>> Straggling to make something work, trying to configure postfix and >>> dovecote imap server with dovecote replication. >>> >>> Can’t figure out what is wrong with my configuration. >>> >>> >>> >>> Replication is working only for vmail user account, I am getting this >>> error on my secondary server for all other users… >>> >>> >>> >>> dovecot: doveadm: Fatal: setgid(4015(zdokman) from userdb lookup) failed >>> with euid=5000(vmail), gid=5000(vmail), egid=5000(vmail): Operation not >>> permitted (This binary should probably be called with process group set to >>> 4015(zdokman) instead of 5000(vmail)) >>> >>> >>> >>> primary server reports this error: >>> >>> >>> >>> dovecot: doveadm(zdokman): Error: doveadm server disconnected before >>> handshake: EOF >>> >>> dovecot: doveadm(zdokman): Error: sync: Disconnected from remote: EOF >>> >>> >>> >>> >>> >>> doveadm replicator status '*' >>> >>> username >>> priority fast sync full sync success sync failed >>> >>> vmail >>> none 01:58:13 02:05:25 01:58:13 - >>> >>> zdokman >>> none 00:00:25 02:55:26 - y >>> >>> test >>> none 00:01:00 21:48:13 - y >>> >>> >>> >>> doveadm sync * >>> >>> doveadm(root): Fatal: execvp(Maildir) failed: Permission denied >>> >>> dsync-local(root): Error: read(remote) failed: EOF (version not received) >>> >>> >>> >>> I am attaching my dovecot.conf main.cf and master.cf. >>> >>> >>> >>> I think my problem is with permissions but I can figure out how to >>> workaround it. >>> >>> >>> >>> Best regards >>> >> >> >> -- >> >> >> >> >> >> > > -- > > > > > --

1 1

Stats/Metrics in 2.3
by Nikolai Lusan 03 Jun '19

03 Jun '19

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Greetings, So the changes to the stats modules between v2.2 and v2.3 have broken some of my monitoring. I am attempting to use the new method of gathering "metrics" from "events" - but the details in the documentation are a bit thin. I started with the examples provided at https://wiki2.dovecot.org/Statistics and tried to build from there with only moderate success. What I am trying to achieve is the monitoring of login attempts (with successes and failures as separate modules - as well as aborted attempts), user sessions an bytes transferred. All this for multiple virtual domains and users. I have attached my current /etc/dovecot/conf.d/10-stats.conf so people can see what I have attempted so far. Based on that file the output I get is: # doveadm stats dump metric_name field count sum min max avg median stddev %95 imap_login_attempt_lusan.id.au duration 0 0 0 0 0.00 0 0.00 0 imap_login_lusan.id.au_failed duration 0 0 0 0 0.00 0 0.00 0 imap_login_lusan.id.au_success duration 0 0 0 0 0.00 0 0.00 0 imap_select_no duration 702 197998 89 13942 282.05 133 1247.14 278 imap_select_no_notfound duration 702 197998 89 13942 282.05 133 1330.67 285 imap_command_list duration 14 287397 17595 25823 20528.36 20060 2194.36 25823 imap_command_select duration 1593 2354698 355 81662 1478.15 743 4583.03 4460 imap_command_search duration 0 0 0 0 0.00 0 0.00 0 imap_command_fetch_ok duration 0 0 0 0 0.00 0 0.00 0 storage_http_gets duration 0 0 0 0 0.00 0 0.00 0 Based on the metrics I have set I would expect to see entries in the first 2 lines at least, given that there are multiple users logged into the server from the monitored domain (or at least the domain I am trying to monitor to begin with). I am also not sure how to get the session and data transfer information out of the metrics/stats system. If anyone can help me I would appreciate it. Thanks - -- Nikolai Lusan <nikolai(a)lusan.id.au> -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEVfd4GW6z4nsBxdLo4ZaDRV2VL6QFAlzz29EACgkQ4ZaDRV2V L6QnIg/8CcB4V/69QSn+zqNhGNX2sHApoaGK0zCt7ITthOlDDVsdVKNT48hxJ3AR uEtoDQL9g3jcDJOQplsobDXmcs/Z6Po275T++8+CY0Bl5iqWO0/6g5LSvNDi6VlS VZzdLyDvAT0+oemaeTHgT/zPwx2waCrs84ZVwMCnuNVQKlE8l05gV2r6aLpgkRFf /Pc6zBwNEXGdthTcnowV2yPiYZkp87jaEl6+4RcHQcYQO1/Q/JEl38/iYlPWdVFZ NVOHpmzZdY9tGRhN0lqiUgivPLZu7gYyfzBeO6JHDOajLUNFW1NR7aKKhyALEOgM GZmjgSODzLjLw8CYx8iGnyMGRsEBDk+NLrJ1zjDqN+xIZkoUcnjkqwpNzurMIW4c kAkFDaPjquXu9eFy4T6V+r23p9E0z0IcWqTFfUyHkdctQApvkjLBFxoc35Abp1Yy I6LzGlGRmiV2Z2HNQYNM3n0w2O+tl4lDpLDN1UCialzfFO81fbHfopk/f9+RHt7b LHy1gTNrUwnLS+3Lobt5p179zNw3C9gtDMdgq355WC/B8jYYJGrw4Y0Jwh7WoyMF w1lPPEByeGTEl/P4zxegKz7oHL+DDBw9BdRdREJ3praUYAVtnMrZgJCJTS0qGh3Z 3m2wCF6yRSwGG8QkwsmoeIF2A6HwjnXcDWHWbOwkkDwh705BUXo= =QfOl -----END PGP SIGNATURE-----

4 6

Mailman option "Set Reply-To header to list" unavailable
by Ralph Seichter 01 Jun '19

01 Jun '19

Looking at https://dovecot.org/mailman/options/dovecot I see that the option "Set Reply-To header to list?" does not accept any changes from me. I assume this might be related to DMARC related header mangling that was discussed at length before. While I do not want to open that particular can of worms again, I would like to force Reply-To: dovecot(a)dovecot.org for my own (!) postings to this mailing list. I actually set this header in my MUA when I post to the Dovecot ML, but it gets overwritten to include my own sender address in Reply-To, which is not what I want. Is there something I can do on my end to ensure that replies get sent to the list only? If not, Is this something the list owners can set for me? Thanks, Ralph

2 1

[mail-crypt-plugin] Private key location in Folder Key Mode
by emordin 01 Jun '19

01 Jun '19

Nice. It worked but I think there is a little output error (probably not a big issue): When I type the following command I get this output: user'@'host:~$ doveadm -o plugin/mail_crypt_private_private_password=1234 mailbox cryptokey export -u username -U /var/vmail/domain/username/Maildir/dovecot-attributes Folder: Public ID: <Public key ID> Error: -----BEGIN PRIVATE KEY----- <private_key> -----END PRIVATE KEY----- And when I type the following command I get this output: user'@'host:~$ doveadm mailbox cryptokey export -u username -U /var/vmail/domain/username/Maildir/dovecot-attributes Folder: Public ID: <Public key ID> Error: ERROR: error:03070068:bignum routines:BN_mpi2bn:encoding error Key: So in the first command the private key shows but it's under Error, and I believe it should be under Key. Thanks again. Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

macOS Notes.app IMAP Syncing Not Working
by Steven Smith 01 Jun '19

01 Jun '19

I’m requesting help getting macOS’s Notes.app to sync notes with a new dovecot IMAP server. Thanks to dovecot’s excellent online documentation and help from this list, I have a new perfectly functioning IMAP server. The issue is that macOS Note.app does not sync with this server. However, iOS Notes.app *does* sync and work well with this IMAP server, and the differences between macOS and iOS Notes apps are well known. (Thanks, Apple.) https://apple.stackexchange.com/questions/265579/notes-wont-sync-via-imap-i… <https://apple.stackexchange.com/questions/265579/notes-wont-sync-via-imap-i…> https://jpmens.net/2015/09/28/experiments-using-imap-for-notes/ <https://jpmens.net/2015/09/28/experiments-using-imap-for-notes/> … I am migrating from a working Server.app system in which Notes.app syncing does work across all devices, and therefore have a working dovecot configuration from Server.app, although it does not contain an explicit configuration for the “Notes” mailbox. I would greatly appreciate any help or pointers for these questions: Does anyone have a working template for dovecot that works with macOS Notes.app? I’ve posted doveconf -n of both the new server and the old Server.app server below. Would you all be able to provide advice on TO-DO’s and NOT-TO-DO’s for mailbox/name-space reconfiguration as I try to muck around with a nicely working, deployed IMAP server? I believe that the solution has something to do with name spaces and separators, and I’ve already changed the separator from the original ‘/’ to ‘.’ on the working server without success or obvious changes. All the mail boxes on the new IMAP server look like this, *without* a prefix ‘.’: > ls -1 /var/mail/tld.domain.mail/username/mdbox/mailboxes/ > Archive/ > Deleted Messages/ > Drafts/ > INBOX/ > Junk/ > Notes/ > Sent/ > Trash/ All the mailboxes on the working Server.app mailserver look like this, *with* a prefix ‘.’: > $ sudo ls -1 /Library/Server/Mail/Data/mail/users/username > .Archive > .Deleted Messages > .Drafts > .Junk > .Notes > .Sent Messages > cur > … > new > subscriptions > tmp Here are the `doveconf -n` of the new server that doesn’t sync macOS Notes.app, and the old Server.app IMAP server that does: New server `dovecot -n` [Note: original separator was set to ‘/’, now changed to ‘.’ in config.d/10-mail.conf]: > # 2.3.6 (): /opt/local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.6 () > # OS: Darwin 18.6.0 x86_64 apfs > # Hostname: newhost.domain.tld > auth_cache_size = 10 M > auth_gssapi_hostname = $ALL > auth_krb5_keytab = /opt/local/etc/dovecot/imap.keytab > auth_mechanisms = plain gssapi > auth_realms = newhost.domain.tld > auth_socket_path = /opt/local/var/run/dovecot/auth-userdb > auth_username_format = %Ln > debug_log_path = /opt/local/var/log/mail/mail-debug.log > disable_plaintext_auth = no > first_valid_gid = 6 > first_valid_uid = 6 > imap_id_log = * > imap_id_send = "name" * "version" * > imap_idle_notify_interval = 29 mins > imap_urlauth_submit_user = submit > info_log_path = /opt/local/var/log/mail/mail-info.log > last_valid_gid = 100 > lda_mailbox_autocreate = yes > log_path = /opt/local/var/log/mail/mail-err.log > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c > mail_access_groups = mail > mail_attachment_dir = /private/var/mail/tld.domain.mail/attachments > mail_attachment_fs = sis posix:mode=0666 > mail_debug = yes > mail_gid = mail > mail_home = /private/var/mail/tld.domain.mail > mail_location = mdbox:/private/var/mail/tld.domain.mail/%Ln/mdbox > mail_log_prefix = "%s(pid %p user %u): " > mail_plugins = quota zlib acl fts fts_solr fts_lucene > mail_privileged_group = mail > mail_uid = _dovecot > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve > mdbox_rotate_size = 200 M > namespace inbox { > inbox = yes > location = > mailbox Archive { > auto = subscribe > special_use = \Archive > } > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = create > special_use = \Junk > } > mailbox Notspam_train { > auto = create > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Spam_train { > auto = create > special_use = \Junk > } > mailbox Trash { > auto = create > special_use = \Trash > } > prefix = > separator = . > } > passdb { > driver = pam > name = pam > } > plugin { > fts = solr > fts_autoindex = yes > fts_autoindex_exclude = \Junk > fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ > imapsieve_mailbox1_before = file:/opt/local/etc/dovecot/sieve/report-spam.sieve > imapsieve_mailbox1_causes = COPY APPEND > imapsieve_mailbox1_name = Spam_train > imapsieve_mailbox2_before = file:/opt/local/etc/dovecot/sieve/report-ham.sieve > imapsieve_mailbox2_causes = COPY APPEND > imapsieve_mailbox2_name = Notspam_train > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > mail_log_fields = uid box msgid from subject size flags > quota_grace = 10%% > quota_rule = *:storage=16G > quota_rule2 = Trash:storage=+256M > quota_warning = storage=100%% quota-exceeded %u > quota_warning2 = storage=80%% quota-warning %u > recipient_delimiter = + > sieve = /private/var/mail/tld.domain.mail/rules/%Ln/dovecot.sieve > sieve_after = /opt/local/etc/dovecot/sieve-after.d > sieve_before = /opt/local/etc/dovecot/sieve-before.d > sieve_dir = /private/var/mail/tld.domain.mail/rules/%Ln/%u > sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment > sieve_pipe_bin_dir = /opt/local/etc/dovecot/sieve > sieve_plugins = sieve_imapsieve sieve_extprograms > sieve_quota_max_storage = 50M > } > postmaster_address = postmaster(a)domain.tld > protocols = imap lmtp sieve > quota_full_tempfail = yes > sendmail_path = /opt/local/sbin/sendmail > service auth-worker { > group = mail > user = root > } > service auth { > extra_groups = _keytabusers > idle_kill = 15 mins > unix_listener /opt/local/var/spool/postfix/private/auth { > group = mail > mode = 0660 > user = _postfix > } > } > service imap-login { > inet_listener imap { > address = 127.0.0.1, ::1 > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > process_min_avail = 6 > service_count = 0 > vsz_limit = 2 G > } > service imap { > process_limit = 200 > process_min_avail = 6 > } > service lmtp { > unix_listener /opt/local/var/spool/postfix/private/dovecot-lmtp { > group = mail > mode = 0660 > user = _postfix > } > } > ssl = required > ssl_ca = </etc/certificates/newhost.domain.tld.SHA1.chain.pem > ssl_cert = </etc/certificates/newhost.domain.tld.SHA1.cert.pem > ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > ssl_min_protocol = TLSv1.2 > ssl_prefer_server_ciphers = yes > userdb { > driver = passwd > name = passwd > } > verbose_proctitle = yes > protocol lda { > mail_fsync = optimized > mail_plugins = quota zlib acl fts fts_solr fts_lucene sieve > } > protocol imap { > mail_max_userip_connections = 50 > mail_plugins = quota zlib acl fts fts_solr fts_lucene imap_acl imap_quota imap_zlib imap_sieve > } > protocol lmtp { > mail_fsync = optimized > mail_plugins = quota zlib acl fts fts_solr fts_lucene sieve > } Old Server.app server `dovecot -n`: > # 2.2.30.2 (c0c463e): /Library/Server/Mail/Config/dovecot/dovecot.conf > # Pigeonhole version 0.4.18 (29cc74d) > # OS: Darwin 17.7.0 x86_64 apfs > aps_topic = com.apple.mail.XServer.d7d6581e-37ed-4a8a-8775-92c4c5a4bf28 > auth_gssapi_hostname = $ALL > auth_mechanisms = cram-md5 plain login gssapi > auth_realms = host.domain.tld > auth_socket_path = /var/run/dovecot/auth-userdb > auth_username_format = %n > debug_log_path = /Library/Logs/Mail/mail-debug.log > default_internal_user = _dovecot > default_login_user = _dovenull > disable_plaintext_auth = no > first_valid_gid = 6 > first_valid_uid = 6 > imap_id_log = * > imap_id_send = "name" * "version" * > imap_urlauth_submit_user = submit > info_log_path = /Library/Logs/Mail/mail-info.log > log_path = /Library/Logs/Mail/mail-err.log > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c > mail_access_groups = mail > mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict > mail_location = maildir:/Library/Server/Mail/Data/mail/%u > mail_log_prefix = "%s(pid %p user %u): " > mail_plugins = quota zlib acl fts fts_sk > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext > mdbox_rotate_size = 200 M > namespace acl-mailboxes { > list = children > location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u > prefix = shared.%%u. > separator = . > subscriptions = no > type = shared > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > namespace list-archives { > list = children > location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/messages/archive/shared/%%u > prefix = archives.%%u. > separator = . > subscriptions = no > type = shared > } > passdb { > driver = od > } > passdb { > args = /Library/Server/Mail/Config/dovecot/submit.passdb > driver = passwd-file > } > plugin { > acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 > acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes > fts = sk > quota = maildir:User quota > quota_warning = storage=100%% quota-exceeded %u > quota_warning2 = storage=80%% quota-warning %u > sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve > sieve_dir = /Library/Server/Mail/Data/rules/%u > stats_refresh = 30 secs > stats_track_cmds = yes > } > postmaster_address = postmaster(a)host.domain.tld > protocols = imap pop3 lmtp sieve > quota_full_tempfail = yes > service auth { > extra_groups = _keytabusers > idle_kill = 15 mins > unix_listener auth-userdb { > user = _dovecot > } > } > service dns_client { > unix_listener dns-client { > mode = 0600 > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > service_count = 0 > } > service imap { > client_limit = 5 > process_limit = 200 > service_count = 0 > } > service indexer-worker { > user = _dovecot > } > service lmtp { > unix_listener lmtp { > mode = 0600 > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service pop3 { > client_limit = 5 > process_limit = 200 > service_count = 0 > } > service quota-exceeded { > executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh > unix_listener quota-exceeded { > group = mail > mode = 0660 > user = _dovecot > } > user = _dovecot > } > service quota-warning { > executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh > unix_listener quota-warning { > group = mail > mode = 0660 > user = _dovecot > } > user = _dovecot > } > service stats { > fifo_listener stats-mail { > mode = 0600 > user = _dovecot > } > } > ssl = required > ssl_ca = </etc/certificates/host.domain.tld.SHA1.chain.pem > ssl_cert = </etc/certificates/host.domain.tld.SHA1.cert.pem > ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA > ssl_key = # hidden, use -P to show it > ssl_key_path = # hidden, use -P to show it > ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf global_quota=8192 enforce_quotas=yes > driver = od > } > userdb { > args = /Library/Server/Mail/Config/dovecot/submit.passdb > driver = passwd-file > } > verbose_proctitle = yes > protocol lmtp { > mail_plugins = quota zlib acl fts fts_sk sieve push_notify > } > protocol lda { > mail_plugins = quota zlib acl fts fts_sk sieve push_notify > } > protocol imap { > mail_max_userip_connections = 20 > mail_plugins = quota zlib acl fts fts_sk imap_acl imap_quota imap_zlib > } > protocol pop3 { > mail_max_userip_connections = 6 > }

3 6

[mail-crypt-plugin] Private key location in Folder Key Mode
by emordin 01 Jun '19

01 Jun '19

Hi, So I am trying to locate the private key in dovecot-attributes but I can't seem to find it. I have went thru the strings in the file with the lib-dcrypt document as a guide but the private key doesn't seem to be in there. I'm guessing the private key is an internal attribute located here '/private/vendor/vendor.dovecot/pvt' , but according to the mail-attribute.h file that location is not accessible. Is this true? Or is there a way to see the private key? Thanks. Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 1

[mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 31 May '19

31 May '19

> Can you try rm dovecot-attributes file? Okay it worked. I kinda did that by 'rm -rf' the entire /var/vmail/domain, and then I ran the following: doveadm -o plugin/mail_crypt_private_password=desired_password mailbox cryptokey generate -u user -UR And I got the check mark and the ID string of characters. I sent a new email to the server, and was able to open and read the email =) I got confused on the docs... So only if using unencrypted folder keys, could I open a CRYPTED email and read it right away. But if using encrypted folder keys, first I would have to set a password for the key before I could open the CRYPTED email ? I thought logging in to the mailbox would connect the password to the key automatically. Thanks again. Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

[mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 31 May '19

31 May '19

So when I tried this way I got the following output: user'@'host:~$ doveadm -o plugin/mail_crypt_private_password=desired_password mailbox > cryptokey generate -u user -UR user'@'host:~$ And when I tried this way I got the following output: user'@'host:~$doveadm -o plugin/mail_crypt_private_password=desired_password mailbox cryptokey generate -u user -UR Folder Public ID user'@'host:~$ In both cases I sent a new email to the server, and I got errors stating the mailbox can't be opened Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 1

(4) [mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 31 May '19

31 May '19

>> Can you try >> >> doveadm -o plugin/mail_crypt_private_password=desired_password mailbox > cryptokey generate -u user -UR >> >> Aki > > I tried that and got the following: > > [user at host](https://dovecot.org/mailman/listinfo/dovecot) :~$ doveadm -o plugin/mail_crypt_private_password=desired_password mailbox > cryptokey generate -u user -UR > > Folder Public ID > > [user at host](https://dovecot.org/mailman/listinfo/dovecot) :~$ > > Then I sent a new email to the mail server, and I checked it with mutt but got 'Internal Error' 'error opening mailbox' and I > > checked the email with Roundcube and I can see the subject header but when I open the email its just blank. I apologize I forgot to add the '>', in the last one, so I added it and got this output: [user at host](https://dovecot.org/mailman/listinfo/dovecot):~$ doveadm -o plugin/mail_crypt_private_password=desired_password mailbox > cryptokey generate -u user -UR [user at host](https://dovecot.org/mailman/listinfo/dovecot):~$ However it still didn't work. I sent a new email and tried to access it with mutt and Roundcube and I still can't access the body message. Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

[mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 31 May '19

31 May '19

> Can you try > > doveadm -o plugin/mail_crypt_private_password=desired_password mailbox > cryptokey generate -u user -UR > > Aki I tried that and got the following: user@host:~$ doveadm -o plugin/mail_crypt_private_password=desired_password mailbox > cryptokey generate -u user -UR Folder Public ID user@host:~$ Then I sent a new email to the mail server, and I checked it with mutt but got 'Internal Error' 'error opening mailbox' and I checked the email with Roundcube and I can see the subject header but when I open the email its just blank. Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 1

[mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 31 May '19

31 May '19

So I believe I generated a key successfully with: 'doveadm mailbox cryptokey generate -u user -UR' because I got the output with the check mark and the Public ID string of characters. However I still can't read the CRYPTED emails when logging in with IMAP.. i'm still getting the following error in the mail log: Error: read() failed: read(/var/vmail/[domain . com/user/Maildir/cur/](http://domain.com/user/Maildir/cur/)<email_index>) failed: Private key not available: Cannot decrypt key ... : error:03070068:big num routines:BN_mpi2bn:encoding error I've tried to list the key with 'doveadm mailbox cryptokey list -u user' but I'm only getting the following output: Folder Active Public ID And I've tried to create a password with 'doveadm mailbox cryptokey password -u user -n Password1' and I'm getting the following output: result: dcrypt_key_load_private(...) failed: password missing Also my settings in conf.d: 10-mail.conf - mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_plugins = $mail_plugins mail_crypt plugins{ mail_crypt_curve = secp512r1 mail_crypt_save_version = 2 mail_crypt_require_encrypted_user_key = yes } 20-lmtp.conf - protocol lmtp{ mail_plugins = $mail_plugins sieve } And my settings in dovecot-sql.conf.ext: driver = mysql connect = host=127.0.0.1 dbname=mailserver user=mailuser password=1234 password_query = SELECT email as user,password, '%w' AS userdb_mail_crypt_private_password FROM virtual_users WHERE email='%u'; In the virtual_users table I have: id, domain_id, email, password Any ideas what the issue may be? Also am I suppose to add the 'userdb_mail_crypt_private_password' into the table and put the virtual users email login password in there? Or is it suppose to be a temporary query? Thanks. Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 1

Problem SSL entrust certificate
by Il Neofita 31 May '19

31 May '19

Hi I have compiled dovecot 2.3.6 on RH 8, and I copied the configuration from dovecot 2.0.9 however, when I try to connect the new machine the certificate is not recognized The same certificate is working with apache CONNECTED(00000004) depth=0 ... verify error:num=20:unable to get local issuer certificate verify return:1 depth=0 ... verify error:num=21:unable to verify the first certificate verify return:1 ... --- No client certificate CA names sent Peer signing digest: SHA256 Peer signature type: RSA-PSS Server Temp Key: X25519, 253 bits --- SSL handshake has read 2311 bytes and written 404 bytes Verification error: unable to verify the first certificate

1 0

[mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 31 May '19

31 May '19

Please disregard the previous question. But I have another... I have set up Folder Key encryption, and have sent an email to my mail server which is CRYPTED, however when I try to login to read the email I'm getting a 'Private key not available: Cannot decrypt <...>: error:03070068:bignum routines:BN_mpi2bn:encoding error'. I've tried to list the user key and generate a new keypair two different ways and have gotten the following output: doveadm mailbox cryptokey list -U user output: Folder Active Public ID doveadm mailbox cryptokey generate -u user -U output: Folder Public ID doveadm mailbox cryptokey generate -u user -Uf output: Panic: file doveadm-mail.c: line 405 (doveadm_mail_next_user): assertion failed: (ctx->exit_code !=0) Error: Raw backtrace: ............. Aborted Any advice? Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

SIGABRT on fetching mail
by Peter Nabbefeld 30 May '19

30 May '19

Good Morning, I tried using gdb, but that doesn't work for me: $ ulimit -c unlimited $ sudo systemctl restart dovecot $ sudo -E getmail getmail version 5.13 Copyright (C) 1998-2019 Charles Cazabon. Licensed under the GNU GPL version 2. SimpleIMAPSSLRetriever:peter.nabbefeld@gmx.de@imap.gmx.net:993: getmailrc: operation error (child pid 19702 killed by signal 6) 1 messages (12551 bytes) retrieved, 0 skipped $ gdb bt 19702 GNU gdb (GDB) 8.3 Copyright (C) 2019 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... bt: Datei oder Verzeichnis nicht gefunden. Attaching to process 19702 ptrace: Kein passender Prozess gefunden. /home/peter/NetBeansProjects/19702: Datei oder Verzeichnis nicht gefunden. (gdb) Finally, I could find a file in /var/lib/systemd/coredump: -rw-r-----+ 1 root root 710416 30. Mai 08:54 core.deliver.1003.d14b28050b8343f5a60c5998ef3947df.19702.1559199286000000.lz4 This is obviously the required dump. However, I'd not attach such a file to a post to the mailing list, so where can I put that? Send it directly to You? Kind regards Peter PS: I'm using Arch Linux - probably the hint above could be added to https://www.dovecot.org/bugreport-mail as a hint for other Arch users, as it's much easier than using gdb for those not using it?

1 0

[mail-crypt-plugin] Password Query for Folder Keys questions
by emordin 29 May '19

29 May '19

In Folder key plugin operation mode, using the following password query: password_query = SELECT \ email as user, password, \ '%w' AS userdb_mail_crypt_private_password \ FROM virtual_users WHERE email='%u'; Say I have two 'email' users...will each 'email' have a 'userdb_mail_crypt_private_password' field with a plaintext password (%w) in it? And is the 'userdb_mail_crypt_private_password' used automatically to decrypt the user private key which is stored in 'mail_attribute_dict' ? Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

Convert Maildir to Dbox?
by David Mehler 29 May '19

29 May '19

Hello, I've got a Dovecot 2.3.x setup. Currently it's running Maildir storage. I'd like to convert that to Dbox specifically Sdbox safely. I'm also looking to at the same time or shortly thereafter encrypt the email storage with mail_crypt. Any help appreciated. Thanks. Dave.

6 8

Changes in sieve Dovecot 2.2
by Gter Marcelo 29 May '19

29 May '19

Hi People, I'm use dovecot in my mailbox system, until last month i used the dovecot version 2.0 and now i use version 2.2, version 2.2 works well for me, but i have one small problem, in sieve. In version 2.0 i had rules in sieve similiar to rule bellow: if allof (true){ keep; fileinto "INBOX"; redirect "xxxxxx"xxxxxx.com.br"; stop; } In the new version 2.2 this rules above, i have one problem duplicate messages in account from my clients, in paste INBOX, therefore, i changed rule to bellow ( with remove fileinto inbox) if allof (true){ keep; redirect "xxxxxx"xxxxxx.com.br"; stop; } Dovecot really changed your behavor, i did right to fix this ? Thanks a Lot, Marcelo

2 1

JMAP support in Dovecot
by Andrew Jones 29 May '19

29 May '19

Hi there, I understand there were discussions to try and develop JMAP support for Dovecot. Is this still in the pipeline for Dovecot 2.5? Regards Andrew Sent from my iPhone

10 18

mail_max_userip_connections
by hfh＠cndns.com 29 May '19

29 May '19

mail_max_userip_connections Can I set up an ip whitelist list, and the ip in this whitelist is unrestricted? thanks!!! hfh(a)cndns.com

2 1

Dict issue with PostgreSQL for last_login plugin (duplicate key)
by mabi 29 May '19

29 May '19

Hello, I am trying to setup the last_login plugin on Dovecot 2.3 in order to log a user's last IMAP login into a separate PostgreSQL table called last_login. I am actually following that guide: https://docs.iredmail.org/track.user.last.login.html with the exception that I use PostgreSQL instead of MySQL. So far it works at least for the very first login of a user but it looks like Dict always want to add a new record into my last_login table instead of updating the existing record for a specific user. Here is the error message from Dovecot: May 19 12:45:14-mbox1 dovecot: imap(user(a)domain.tld)<51915><if6KTzuJMZ25D+Vc>: Error: last_login_dict: Failed to write value: dict-server returned failure: sql dict: commit failed: ERROR: duplicate key value violates unique constraint "last_logins_pkey" It looks like Dict with PostgreSQL does not support UPDATEing an already existing record in the table. Or am I missing something? or it does not work with PostgreSQL? Which does not make much sense to me... Regards, Mabi

5 22

SIGABRT on fetching mail
by Peter Nabbefeld 29 May '19

29 May '19

Hello, I've never used gdb, so I don't know why I'm running into problems using "gdb bt". Usually, I'm fetching my mail using "sudo -E getmail", but this doesn't seem to work with backtrace. :-/ Output from "dovecot -n" attached. Kind regards, Peter

2 1

imap userdb Fatal setuid errors
by Steven Smith 28 May '19

28 May '19

I’m trying to configure dovecot lmtp in multi-user mode. My error logs are filled with messages saying that an imap process cannot do a setuid to another user: > May 21 22:28:46 imap(pid 17441 user myuser): Fatal: setuid(512(myuser) from userdb lookup) failed with euid=501(adminuser): Operation not permitted (This binary should probably be called with process user set to 512(myuser) instead of 501(adminuser)) I see that others have had similar issues, but I am not able to apply any of the fixes or workarounds to solve this issue (e.g. setting libexec/dovecot/imap as setuid-root). I’ve also tried other fixes like setting the permissions to 0777 on the userdb auth for postfix smtpd. According to the code (restrict-access.c, linked below), it appears that when a user authenticates, an imap worker process is launched that has the bid of the authenticator. When another user authenticates, this last process is used, but it does not have the permissions to perform a setuid to the new user, resulting in the Fatal error that appears in the logs. Is this a bug, or a configuration issue? I’ve posted my doveconf below. Any pointers would be greatly appreciated. Steve Related: https://serverfault.com/questions/930245/dovecot-operation-not-permitted <https://serverfault.com/questions/930245/dovecot-operation-not-permitted> https://dovecot.org/list/dovecot/2012-May/135549.html <https://dovecot.org/list/dovecot/2012-May/135549.html> https://trac.macports.org/ticket/58506 <https://trac.macports.org/ticket/58506> Code at https://github.com/dovecot/core/blob/master/src/lib/restrict-access.c <https://github.com/dovecot/core/blob/master/src/lib/restrict-access.c>: https://github.com/dovecot/core/blob/863887d4272f962926ab279ac4cf37855dd200… <https://github.com/dovecot/core/blob/863887d4272f962926ab279ac4cf37855dd200…> https://github.com/dovecot/core/blob/863887d4272f962926ab279ac4cf37855dd200… <https://github.com/dovecot/core/blob/863887d4272f962926ab279ac4cf37855dd200…> doveconf -n: > # 2.3.0.1 (ffd8a29): /opt/local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.0.1 (d33dca20) > # OS: Darwin 18.6.0 x86_64 apfs > auth_cache_size = 10 M > auth_gssapi_hostname = $ALL > auth_krb5_keytab = /opt/local/etc/dovecot/imap.keytab > auth_mechanisms = plain gssapi > auth_realms = host.domain.tld > auth_socket_path = /opt/local/var/run/dovecot/auth-userdb > auth_username_format = %Ln > debug_log_path = /opt/local/var/log/mail/mail-debug.log > default_internal_user = _dovecot > default_login_user = _dovenull > disable_plaintext_auth = no > first_valid_gid = 6 > first_valid_uid = 6 > imap_id_log = * > imap_id_send = "name" * "version" * > imap_idle_notify_interval = 29 mins > imap_urlauth_submit_user = submit > info_log_path = /opt/local/var/log/mail/mail-info.log > last_valid_gid = 100 > lda_mailbox_autocreate = yes > log_path = /opt/local/var/log/mail/mail-err.log > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c > mail_access_groups = mail > mail_attachment_dir = /private/var/mail/tld.domain.mail/attachments > mail_attachment_fs = sis posix:mode=0666 > mail_debug = yes > mail_gid = mail > mail_home = /private/var/mail/tld.domain.mail > mail_location = mdbox:/private/var/mail/tld.domain.mail/%Ln/mdbox > mail_log_prefix = "%s(pid %p user %u): " > mail_plugins = quota zlib acl fts fts_solr fts_lucene > mail_privileged_group = mail > mail_uid = _dovecot > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve > mdbox_rotate_size = 200 M > namespace inbox { > inbox = yes > location = > mailbox Archive { > auto = subscribe > special_use = \Archive > } > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = create > special_use = \Junk > } > mailbox Notspam_train { > auto = create > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox Spam_train { > auto = create > special_use = \Junk > } > mailbox Trash { > auto = create > special_use = \Trash > } > prefix = > separator = / > } > passdb { > driver = pam > name = pam > } > plugin { > fts = solr > fts_autoindex = yes > fts_autoindex_exclude = \Junk > fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ > imapsieve_mailbox1_before = file:/opt/local/etc/dovecot/sieve/report-spam.sieve > imapsieve_mailbox1_causes = COPY APPEND > imapsieve_mailbox1_name = Spam_train > imapsieve_mailbox2_before = file:/opt/local/etc/dovecot/sieve/report-ham.sieve > imapsieve_mailbox2_causes = COPY APPEND > imapsieve_mailbox2_name = Notspam_train > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > mail_log_fields = uid box msgid from subject size flags > quota_grace = 10%% > quota_rule = *:storage=16G > quota_rule2 = Trash:storage=+256M > quota_warning = storage=100%% quota-exceeded %u > quota_warning2 = storage=80%% quota-warning %u > recipient_delimiter = + > sieve = /private/var/mail/tld.domain.mail/rules/%Ln/dovecot.sieve > sieve_after = /opt/local/etc/dovecot/sieve-after.d > sieve_before = /opt/local/etc/dovecot/sieve-before.d > sieve_dir = /private/var/mail/tld.domain.mail/rules/%Ln/%u > sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment > sieve_pipe_bin_dir = /opt/local/etc/dovecot/sieve > sieve_plugins = sieve_imapsieve sieve_extprograms > sieve_quota_max_storage = 50M > } > postmaster_address = postmaster(a)domain.tld > protocols = imap lmtp sieve > quota_full_tempfail = yes > sendmail_path = /opt/local/sbin/sendmail > service auth-worker { > user = root > } > service auth { > extra_groups = _keytabusers > idle_kill = 15 mins > unix_listener /opt/local/var/spool/postfix/private/auth { > group = mail > mode = 0660 > user = _postfix > } > } > service imap-login { > inet_listener imap { > address = 127.0.0.1, ::1 > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > process_min_avail = 6 > service_count = 0 > vsz_limit = 2 G > } > service imap { > client_limit = 16 > process_limit = 200 > process_min_avail = 6 > service_count = 0 > } > service lmtp { > unix_listener /opt/local/var/spool/postfix/private/dovecot-lmtp { > group = mail > mode = 0660 > user = _postfix > } > } > ssl = required > ssl_ca = </etc/certificates/chain.pem > ssl_cert = </etc/certificates/cert.pem > ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > ssl_min_protocol = TLSv1.2 > ssl_prefer_server_ciphers = yes > userdb { > driver = passwd > name = passwd > } > verbose_proctitle = yes > protocol lda { > mail_fsync = optimized > mail_plugins = quota zlib acl fts fts_solr fts_lucene sieve > } > protocol imap { > mail_max_userip_connections = 50 > mail_plugins = quota zlib acl fts fts_solr fts_lucene imap_acl imap_quota imap_zlib imap_sieve > } > protocol lmtp { > mail_fsync = optimized > mail_plugins = quota zlib acl fts fts_solr fts_lucene sieve > }

2 2

ssl_dh
by ＠lbutlr 28 May '19

28 May '19

Does ssl_dh need to be manually updated each time the underlying certificate renews? -- 2+2=5 for sufficiently large values of 2.

2 1

Hello some help on login users saying it's disabled
by Remo Mattei 28 May '19

28 May '19

Hello I am experiencing some strange issue with the dovecot, the web round cube works fine but when I try to connect with an iPhone over IMAP IMAPs it tells me that the account is disabled. Please advice here is what I see in the logs: May 25 14:30:32 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<4AZjBr2J2cisCqP7> May 25 14:30:32 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<fFVkBr2J2sisCqP7> May 25 14:30:32 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<TnpkBr2J28isCqP7> May 25 14:30:32 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<KcplBr2J3MisCqP7> May 25 14:30:34 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<wPiABr2J3cisCqP7> May 25 14:30:34 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<gDSCBr2J3sisCqP7> May 25 14:30:37 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<byuzBr2J4MisCqP7> May 25 14:30:37 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<ob20Br2J4cisCqP7> May 25 14:30:39 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<bUfQBr2J4sisCqP7> May 25 14:30:39 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=172.10.163.251, lip=208.53.44.237, session=<tsbRBr2J48isCqP7> And the account does not show any mail whereas the Web shows the mail just fine. Thanks

4 3

pam authentication error?
by unknown＠example.com 28 May '19

28 May '19

Getting this: auth-worker(5045): Error: pam(kremels,xxx.xxx.xxx.xxx: pam_authenticate() failed: authentication error (/etc/pam.d/dovecot missing?) # cat /etc/pam.d/dovcot auth required pam_unix.so nullok account required pam_unix.so (file was last updated in April of 2018) passdb { username_filter = "!*@*" driver = pam } userdb { driver = passwd } service auth { unix_listener auth-userdb { } unix_listener /var/spool/postfix/private/auth { mode = 0666 } } # ls -ls /var/spool/postfix/private/auth 0 srw-rw-rw- 1 root wheel 0 May 27 13:57 /var/spool/postfix/private/auth postfix/main.cf: smtpd_sasl_authenticated_header = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_starttls_timeout = 20s smtpd_tls_cert_file = /usr/local/etc/dehydrated/certs/covisp.net/fullchain.pem smtpd_tls_key_file = /usr/local/etc/dehydrated/certs/covisp.net/privkey.pem smtpd_tls_loglevel = 1 smtpd_tls_received_header = yes smtpd_tls_security_level = may 16 -rw------- 1 root 443 4152 May 20 21:08 fullchain-1558408117.pem 0 lrwx------ 1 root 443 24 May 20 21:08 fullchain.pem -> fullchain-1558408117.pem 8 -rw------- 1 root 443 3243 May 20 21:08 privkey-1558408117.pem 0 lrwx------ 1 root 443 22 May 20 21:08 privkey.pem -> privkey-1558408117.pem

2 1

Re: Hello some help on login users saying it's disabled
by Joseph Tam 27 May '19

27 May '19

> Hello I am experiencing some strange issue with the dovecot, the web > round cube works fine but when I try to connect with an iPhone over > IMAP IMAPs it tells me that the account is disabled. > > May 25 14:30:32 imap-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=... > ... It's probably the iPhone mail app trying to be clever and auto-configuring the settings for IMAP (and getting it wrong). To stop this behaviour, hardwire the iPhone IMAP parameters, then disable "Automatic manage connection". If you use SSL/TLS, this will also secure you from plaintext MITM attacks. Other oddities I've seen from Apple mail readers: 1) If you don't disable "Automatic manage connection", it will also hunt around for outgoing mail settings. 2) Once in a while, it initiates an idle authenticated SMTP session (i.e. authenticates, but does nothing). 3) Roofs your user IMAP connection limit when the client does global mail searches. Joseph Tam <jtam.home(a)gmail.com>

1 0

SIGABRT on fetching mail
by Peter Nabbefeld 27 May '19

27 May '19

Hello, I still cannot fetch my mails, relying on my smartphone (which makes it a burden to read my mails ...) - could probably somebody help me? Kind regards, Peter

2 2

Error suggestions please
by Remo Mattei 27 May '19

27 May '19

May 25 15:01:27 imap(xxxxx(a)italy1.com)<10256><LsrOdL2J3uisCqP7>: Error: Mailbox INBOX: UID=208: read(/home/vpopmail/domains/italy1.com/xxxxx/Maildir/cur/1154731221.9257.az… failed: Cached message size smaller than expected (26421 < 26511, box=INBOX, UID=208) (read reason=mail stream) May 25 15:01:27 imap(xxxxxx(a)italy1.com)<10256><LsrOdL2J3uisCqP7>: Error: Corrupted record in index cache file /home/vpopmail/domains/italy1.com/xxxxx/Maildir/dovecot.index.cache: UID 208: Broken physical size in mailbox INBOX: read(/home/vpopmail/domains/italy1.com/xxxxx/Maildir/cur/1154731221.9257.az… failed: Cached message size smaller than expected (26421 < 26511, box=INBOX, UID=208) May 25 15:01:27 imap(xxxxxx(a)italy1.com)<10256><LsrOdL2J3uisCqP7>: Panic: file istream.c: line 315 (i_stream_read_memarea): assertion failed: (old_size <= _stream->pos - _stream->skip) Can someone tell help on how to fix this issue. Thanks

3 3

Unknown error message
by Jerry 26 May '19

26 May '19

dovecot 2.3.6 (7eab80676) FreeBSD 12.0-RELEASE-p5 amd64 I have recently been finding error messages similar to the following in my Dovecot log file: May 26 06:58:32 imap(gerard(a)seibercom.net)<87791><WvXT+LyJHBCubeH6>: Error: stat(/var/mail/vmail/seibercom.net/gerard/.dovecot.sieve/tmp) failed: Not a directory The message is correct as there is no such directory. The question is why has it suddenly started appearing? I checked my maillog file, and there are no messages being transmitted to Dovecot when that error message is created. Neither is there any mail with that ID number either. Could this be someone attempting to hack into my system? Thanks! -- Jerry

2 1

Automatically subscribe to the INBOX folder
by glts 26 May '19

26 May '19

Hello, I am using the ‘auto = subscribe’ feature in the mailbox configuration section in the usual fashion (as shown in conf.d/15-mailboxes.conf): namespace inbox { inbox = yes mailbox Drafts { special_use = \Drafts auto = subscribe } ... } When I connect to an account with the Thunderbird mail client, those mailboxes/folders get autocreated and autosubscribed. Good! INBOX, however, does not get subscribed to automatically. When I look at the account’s subscriptions in Thunderbird, all folders are subscribed, except INBOX. How can I enable autosubscribe for the INBOX folder (like the other folders)? Is there an option for this? This is in Dovecot 2.2.22. Cheers, David

2 1

Workaround for infinite loop in XCLIENT command bug
by mabi 26 May '19

26 May '19

Hello, I am running Dovecot 2.3.5 package on OpenBSD 6.5 and it looks like this bug which has been fixed in 2.3.6 is hitting me: lib-smtp: client: Fix infinite loop in XCLIENT command interaction with server https://github.com/dovecot/core/commit/5d03f39b345127b80d145ee90772739baa7a… so I was wondering if there is any workarounds? Maybe like disabling the XCLIENT command from the config file or something similar? My original post regarding this issue is here: https://www.mail-archive.com/misc@opensmtpd.org/msg04362.html I first thought this was an OpenSMTPD issue but it seems to be that Dovecot bug. Cheers, Mabi

3 6

Dovecot multiple passdb and fail2ban
by Joaquin F 26 May '19

26 May '19

Objective: different password for remote and local imap login Version: 2.2.36 (1f10bfa63) on CentOS 7 Users are from Active Directory, mapped to local users via sssd After much experimentation, I have configured this way: doveconf -n passdb userdb passdb { args = username_format=%Ln /etc/dovecot/remote driver = passwd-file skip = authenticated username_filter = user01 user02 } passdb { driver = pam override_fields = allow_nets=127.0.0.0/8,192.168.1.0/24 skip = authenticated } userdb { driver = passwd } If I put the passdb's in the reverse order, I would get failure messages (when logging in remotely) in /var/log/secure, such as: auth: pam_sss(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=user02 rhost=xx.xx.xx.xx user=user02 Which caused fail2ban to ban that ip /etc/fail2ban/jail.local [dovecot] enabled = true port = imap,imaps If I set "auth_verbose = yes", then I can see messages in (when logging in locally) in /var/log/maillog dovecot: auth: passwd-file(user02,192.168.1.20,<Na/7f8WJC8HAqAEU>): Password mismatch which is probably not a big deal... but seems inefficient? Question: is there a more elegant way to use different passdb depending on ip? Thanks in advance.

1 0

Imap reverse / proxy in front of our clients machines.
by Brent Clark 25 May '19

25 May '19

Good day Guys I have a user story have an imap reverse / proxy in front of our clients servers. Im currently using the following sources for information. https://wiki.failover.de/Email/Dovecot/IMAP/Proxy/ https://gist.github.com/rplessl/dd56d05c84f988706418 https://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy In my vagrant instance, dovecot can connect to the the remote server You can see my debugging and conf: https://pastebin.com/raw/H2AL53Fz https://pastebin.com/raw/hZHSHvcu If anyone can assist it would be greatly appreciated. Many thanks Regards Brent

1 0

Race condition in IMAP NOTIFY for events received NOTIFY_DELAY_MSECS apart
by Guilhem Moulin 25 May '19

25 May '19

Hi there, There seem to be a race condition in IMAP NOTIFY: when two events for the SELECTED mailbox are received soon after one another, sometimes only the first one is being reported to clients that enabled IMAP NOTIFY. On closer look it seems like this is most often reproducible when the delay between the two events is NOTIFY_DELAY_MSECS (500ms). This is with 2.3.4.1 from Debian sid. $ sed -r 's/^\s*//; s/\s+/ /g' >/tmp/dovecot.conf <<-EOF log_path = /tmp/dovecot.log mailbox_list_index = yes mail_home = /dev/shm/dovecot-test/%u mail_location = dbox:~/mail ssl = no EOF (`doveconf -c /tmp/dovecot.conf -n` output enclosed.) $ rm -rf /dev/shm/dovecot-test && mkdir -m0700 /dev/shm/dovecot-test $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin \ doveadm -c /tmp/dovecot.conf exec imap S: * PREAUTH [CAPABILITY IMAP4rev1 … NOTIFY] Logged in as user C: a NOTIFY SET STATUS (SELECTED (MessageNew MessageExpunge FlagChange)) (MAILBOXES (INBOX test) (MessageNew MessageExpunge FlagChange)) S: * STATUS INBOX (MESSAGES 0 UIDNEXT 1 UIDVALIDITY 1558785754 UNSEEN 0 HIGHESTMODSEQ 1) S: a OK NOTIFY completed (0.004 + 0.000 + 0.003 secs). S: * STATUS INBOX (MESSAGES 0 UIDNEXT 1 UIDVALIDITY 1558785754 UNSEEN 0 HIGHESTMODSEQ 1) C: b SELECT INBOX […] S: b OK [READ-WRITE] Select completed (0.001 + 0.000 secs). Now deliver two messages to INBOX with ~500ms in between: $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin sh -c \ 'echo -n . | doveadm -c /tmp/dovecot.conf exec dovecot-lda -e -m INBOX; \ sleep 0.500; \ echo -n . | doveadm -c /tmp/dovecot.conf exec dovecot-lda -e -m INBOX' Only the the first message is reported in the above IMAP session: S: * 1 EXISTS S: * 1 RECENT An UNSELECT doesn't trigger the notification, but (of course) a NOOP does: C: c NOOP S: * 2 EXISTS S: * 2 RECENT S: c OK NOOP completed (0.001 + 0.000 secs). Similarly, for two flag changes within 0.5s only the first is recorded: $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin sh -c \ 'doveadm -c /tmp/dovecot.conf flags add "\\Seen" mailbox INBOX 1; \ sleep 0.500; \ doveadm -c /tmp/dovecot.conf flags add "\\Answered" mailbox INBOX 2' yields a single unsolicited FETCH response: S: * 1 FETCH (MODSEQ (4) FLAGS (\Seen \Recent)) AFAICT this is only reproducible in the ‘SELECTED’ mailbox specifier: after creating a mailbox "test", $ env -i USER=user HOME=/dev/shm/dovecot-test/user PATH=/usr/bin:/bin sh -c \ 'echo -n . | doveadm -c /tmp/dovecot.conf exec dovecot-lda -e -m test; \ sleep 0.500; \ echo -n . | doveadm -c /tmp/dovecot.conf exec dovecot-lda -e -m test' yields two unsolicited STATUS responses as expected: * STATUS test (MESSAGES 1 UIDNEXT 2 UIDVALIDITY 1558787038 UNSEEN 1 HIGHESTMODSEQ 2) * STATUS test (MESSAGES 2 UIDNEXT 3 UIDVALIDITY 1558787038 UNSEEN 2 HIGHESTMODSEQ 3) (And same thing for two flag updates in the "test" mailbox.) This is not specific to INBOX as once "test" is selected the same problem arises. AFAICT the race is in ‘src/lib-storage/list/mailbox-list-index-notify.c’ which for some reason doesn't acknowledge ST_CHANGED() after inotify_rm_watch(), but I couldn't get my head around that file. Cheers, -- Guilhem.

1 0

SIGABRT on fetching mail
by Peter Nabbefeld 24 May '19

24 May '19

Hello, I'm running dovecot with getmail for several months already, but today it's always crashing: "getmailrc: operation error (child pid 2995 killed by signal 6)". The deliver process aborts due to an unknown reason. > tail /var/log/dovecot-info.log May 24 12:10:28 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=2970, secured, session=<n/dfaJ+JuIMAAAAAAAAAAAAAAAAAAAAB> May 24 12:10:49 lda(peter.nabbefeld(a)gmx.de)<2994><kCP3FifD51yyCwAA7IIYzw>: Info: sieve: msgid=<318D121B-37FC-4E8C-B4B8-93C87E0692B8(a)gmx.de>: stored mail into mailbox 'Gesendet' May 24 15:14:30 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=6304, secured, session=<+Rae+qGJ4IUAAAAAAAAAAAAAAAAAAAAB> May 24 15:14:31 imap(peter.nabbefeld(a)gmx.de)<6304><+Rae+qGJ4IUAAAAAAAAAAAAAAAAAAAAB>: Info: Connection closed (append finished 0.562 secs ago) in=157758 out=520 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 May 24 15:14:37 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=6307, secured, session=<MjwD+6GJ4oUAAAAAAAAAAAAAAAAAAAAB> May 24 15:55:28 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=7205, secured, session=<T9ofjaKJgIYAAAAAAAAAAAAAAAAAAAAB> May 24 15:57:00 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=7254, secured, session=<nT6XkqKJhIYAAAAAAAAAAAAAAAAAAAAB> May 24 16:08:22 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=7507, secured, session=<LI40u6KJJIcAAAAAAAAAAAAAAAAAAAAB> May 24 16:16:40 imap(peter.nabbefeld(a)gmx.de)<6307><MjwD+6GJ4oUAAAAAAAAAAAAAAAAAAAAB>: Info: Connection closed (IDLE running for 0.001 + waiting input for 0.001 secs, 2 B in + 10 B out, state=wait-input) in=4251 out=137885 deleted=0 expunged=0 trashed=0 hdr_count=1 hdr_bytes=661 body_count=0 body_bytes=0 May 24 16:16:54 imap-login: Info: Login: user=<peter.nabbefeld(a)gmx.de>, method=PLAIN, rip=::1, lip=::1, mpid=7662, secured, session=<zV++2aKJOIcAAAAAAAAAAAAAAAAAAAAB> > tail /var/log/dovecot.log May 24 11:25:33 master: Warning: Killed with signal 15 (by pid=12275 uid=0 code=kill) May 24 11:25:35 log(660): Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) May 24 12:10:47 lda(peter.nabbefeld(a)gmx.de)<2994><kCP3FifD51yyCwAA7IIYzw>: Warning: Failed to parse return-path header May 24 12:10:50 lda(peter.nabbefeld(a)gmx.de)<2995><hco1BirD51yzCwAA7IIYzw>: Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2) May 24 12:10:50 lda(peter.nabbefeld(a)gmx.de)<2995><hco1BirD51yzCwAA7IIYzw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xeee14) [0x7fd668defe14] -> /usr/lib/dovecot/libdovecot.so.0(+0xeee51) [0x7fd668defe51] -> /usr/lib/dovecot/libdovecot.so.0(+0x46268) [0x7fd668d47268] -> /usr/lib/dovecot/libdovecot.so.0(+0x4892e) [0x7fd668d4992e] -> /usr/lib/dovecot/libdovecot.so.0(+0x1004e6) [0x7fd668e014e6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7fd668dfd681] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7fd668dfd8a6] -> /usr/lib/dovecot/libdovecot.so.0(+0x1058f8) [0x7fd668e068f8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7fd668dfd681] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7fd668dfd8a6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4c) [0x7fd668dfe33c] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_copy+0x8a) [0x7fd668e18aba] -> /usr/lib/dovecot/libdovecot.so.0(+0x119ac2) [0x7fd668e1aac2] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_send_istream+0x4f) [0x7fd668e1874f] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_save_continue+0x2e) [0x7fd668f981ee] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_continue+0x27) [0x7fd668f36887] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_continue+0x44) [0x7fd668f083f4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xf8) [0x7fd668ef9828] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x59) [0x7fd668f32639] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x3d5c) [0x7fd66902ad5c] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x10eec) [0x7fd668a90eec] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x58981) [0x7fd668f08981] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x4e6df) [0x7fd66676e6df] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x4e5) [0x7fd666764065] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x57259) [0x7fd666777259] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0xa2) [0x7fd6667783f2] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3d45) [0x7fd668cecd45] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf9) [0x7fd66902c229] How can I find out which message is causing the crash? It would be very helpful, if the message's subject and receipt time could be logged in case of an abort or anything else that could help identify the corrupt message. This would also enable me to send You the message for further investigation (if appropriate). Kind regards Peter

1 0

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
by Ralf Hildebrandt 24 May '19

24 May '19

I'm encountering a crash which this command: % doveadm import -u restore(a)backup.invalid mdbox:/home/copymail2/mdbox '' mailbox INBOX header X-Spam Yes SAVEDBEFORE 2019-05-23 doveadm(restore(a)backup.invalid): Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) doveadm(restore(a)backup.invalid): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xd9f9e) [0x7fbc52ba7f9e] -> /usr/lib/dovecot/libdovecot.so.0(+0xd9fe1) [0x7fbc52ba7fe1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbc52b0cc54] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78)[0x7fbc52f525e8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b)[0x7fbc52f3ac2b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449)[0x7fbc52f1c969] -> /usr/lib/dovecot/libdovecot.so.0(+0xb6af9) [0x7fbc52b84af9] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a) [0x7fbc52bb531a] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7fbc52bb565f] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d)[0x7fbc52bb604d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68)[0x7fbc52b8b3f8] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52)[0x7fbc52b8bdd2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcadae) [0x7fbc52f26dae] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcc0ac) [0x7fbc52f280ac] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d)[0x7fbc52f288bd] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28)[0x7fbc52ea92e8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d)[0x7fbc52ea934d] -> doveadm(+0x31443) [0x5635b4760443] -> doveadm(+0x2bdb1) [0x5635b475adb1] -> doveadm(+0x2caf9) [0x5635b475baf9] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x5635b475c9ce] -> doveadm(doveadm_cmd_run_ver2+0x55e) [0x5635b476db7e] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5635b476dbd7] -> doveadm(main+0x1d1) [0x5635b474aec1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fbc5210fb97] -> doveadm(_start+0x2a) [0x5635b474b39a] Version info: ii dovecot-core 2:2.3.6-2~bionic amd64 secure POP3/IMAP server - core files ii dovecot-dbg 2:2.3.6-2~bionic amd64 secure POP3/IMAP server - debug symbols ii dovecot-imapd 2:2.3.6-2~bionic amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-lmtpd 2:2.3.6-2~bionic amd64 secure POP3/IMAP server - LMTP server Backtrace: Program received signal SIGABRT, Aborted. __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007ffff68fa801 in __GI_abort () at abort.c:79 #2 0x00007ffff7373f51 in default_fatal_finish (status=0, type=LOG_TYPE_PANIC) at failures.c:459 #3 fatal_handler_real (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:471 #4 0x00007ffff7373fe1 in default_fatal_handler (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:479 #5 0x00007ffff72d8c54 in i_panic (format=format@entry=0x7ffff772e440 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:523 #6 0x00007ffff771e5e8 in mail_index_uint32_to_offset (offset=<optimized out>) at mail-index-util.c:10 #7 0x00007ffff7706c2b in mail_cache_header_fields_write (ctx=0x55555583d960, buffer=<optimized out>, buffer=<optimized out>) at mail-cache-transaction.c:609 #8 mail_cache_header_add_field (field_idx=15, ctx=0x55555583d960) at mail-cache-transaction.c:690 #9 mail_cache_add (ctx=0x55555583d960, seq=1, field_idx=field_idx@entry=15, data=0x7ffff773ba56, data_size=0) at mail-cache-transaction.c:739 #10 0x00007ffff76eafdc in index_mail_cache_add_idx (mail=mail@entry=0x55555583e2f8, field_idx=field_idx@entry=15, data=data@entry=0x7ffff773ba56, data_size=data_size@entry=0) at index-mail.c:621 #11 0x00007ffff76e8969 in index_mail_parse_header_finish (mail=<optimized out>) at index-mail-headers.c:132 #12 index_mail_parse_header (part=<optimized out>, hdr=<optimized out>, mail=<optimized out>) at index-mail-headers.c:312 #13 0x00007ffff7350af9 in read_header (mstream=0x55555584b7f0) at istream-header-filter.c:357 #14 i_stream_header_filter_read (stream=0x55555584b7f0) at istream-header-filter.c:447 #15 0x00007ffff738131a in i_stream_read_memarea (stream=stream@entry=0x55555584b870) at istream.c:313 #16 0x00007ffff738165f in i_stream_read (stream=stream@entry=0x55555584b870) at istream.c:271 #17 0x00007ffff738204d in i_stream_read_data (stream=0x55555584b870, data_r=data_r@entry=0x7fffffffdbe8, size_r=size_r@entry=0x7fffffffdbf0, threshold=threshold@entry=1) at istream.c:745 #18 0x00007ffff73573f8 in i_stream_read_bytes (wanted=2, size_r=0x7fffffffdbf0, data_r=0x7fffffffdbe8, stream=<optimized out>) at ../../src/lib/istream.h:217 #19 message_parse_header_next (ctx=0x55555584ca70, hdr_r=hdr_r@entry=0x7fffffffdc50) at message-header-parser.c:85 #20 0x00007ffff7357dd2 in message_parse_header (input=<optimized out>, hdr_size=hdr_size@entry=0x0,flags=flags@entry=MESSAGE_HEADER_PARSER_FLAG_CLEAN_ONELINE, callback=callback@entry=0x7ffff76f2310 <search_header>, context=context@entry=0x7fffffffdcc0) at message-header-parser.c:392 #21 0x00007ffff76f2dae in search_arg_match_text (ctx=0x55555583dd20, args=0x555555809690) at index-search.c:760 #22 search_match_once (ctx=0x55555583dd20) at index-search.c:1400 #23 0x00007ffff76f40ac in search_match_next (ctx=0x55555583dd20) at index-search.c:1507 #24 search_more_with_mail (mail=<optimized out>, ctx=0x55555583dd20) at index-search.c:1624 #25 search_more_with_prefetching (mail_r=<optimized out>, ctx=<optimized out>) at index-search.c:1706 #26 search_more (ctx=ctx@entry=0x55555583dd20, mail_r=mail_r@entry=0x7fffffffddf0) at index-search.c:1780 #27 0x00007ffff76f48bd in index_storage_search_next_nonblock(_ctx=0x55555583dd20, mail_r=0x7fffffffdec0, tryagain_r=0x7fffffffde57) at index-search.c:1808 #28 0x00007ffff76752e8 in mailbox_search_next_nonblock (ctx=0x55555583dd20, mail_r=0x7fffffffdec0, tryagain_r=<optimized out>) at mail-storage.c:2141 #29 0x00007ffff767534d in mailbox_search_next (ctx=0x55555583dd20, mail_r=mail_r@entry=0x7fffffffdec0) at mail-storage.c:2126 #30 0x0000555555586682 in doveadm_mail_iter_next (iter=<optimized out>, mail_r=mail_r@entry=0x7fffffffdec0) at doveadm-mail-iter.c:160 #31 0x0000555555585443 in cmd_import_box (search_args=<optimized out>, info=0x555555832118, dest_user=<optimized out>, ctx=0x555555807d78) at doveadm-mail-import.c:142 #32 cmd_import_run (_ctx=0x555555807d78, user=0x55555581c688) at doveadm-mail-import.c:202 #33 0x000055555557fdb1 in doveadm_mail_next_user (ctx=ctx@entry=0x555555807d78, error_r=error_r@entry=0x7fffffffe0a0) at doveadm-mail.c:462 #34 0x0000555555580a0b in doveadm_mail_single_user (ctx=ctx@entry=0x555555807d78, error_r=error_r@entry=0x7fffffffe0a0) at doveadm-mail.c:492 #35 0x0000555555580af9 in doveadm_mail_cmd_exec (ctx=ctx@entry=0x555555807d78, wildcard_user=wildcard_user@entry=0x0) at doveadm-mail.c:653 #36 0x00005555555819ce in doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=<optimized out>) at doveadm-mail.c:1144 #37 0x0000555555592b7e in doveadm_cmd_run_ver2 (argc=12, argv=0x5555557f5ae8, cctx=cctx@entry=0x7fffffffe290) at doveadm-cmd.c:574 #38 0x0000555555592bd7 in doveadm_cmd_try_run_ver2 (cmd_name=<optimized out>, argc=<optimized out>, argv=<optimized out>, cctx=0x7fffffffe290) at doveadm-cmd.c:496 #39 0x000055555556fec1 in main (argc=<optimized out>, argv=<optimized out>) at doveadm.c:391 -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

2 2

MailCrypt plugin questions
by MRob 24 May '19

24 May '19

I read the mailcrypt plugin document on the wiki and had couple questions. 1. If I want per-user encryption am I correct I should configure global keys with all related settings override in the userdb lookup? 2. If I do not want to encrypt some user accounts, is it enough to omit the mail_crypt_global_private_key from the userdb lookup? In other word, mail_plugins still active with mail_crypt, will that cause user account to be encrypted unexpectedly if no private key is given? 3. Example command to create EC key does not ask for password, openssl ecparam command does not seem to have password arg. If I want password-protection should I use RSA key which the doc tell to be discouraged?

1 1

Re: Catch all for dovecot authentication?
by Joseph Tam 24 May '19

24 May '19

> as stated by Aki > > > passdb { > > driver = static > > args = nopassword > >} > > works fine and does what I want: accept any SMTP AUTH :-) (Brings back memories of good fun I had with patched Qpopper snare feeding custom messages to the hacker.) Another alternative is to use the checkpassword hook that will accept any username/password. The advantage is you can do post-analysis of credentials as the script has access to them. Joseph Tam <jtam.home(a)gmail.com>

1 0

Catch all for dovecot authentication?
by Tobi 23 May '19

23 May '19

Hi I'm aware that there are several good reasons not to do what I want, but in my use-case it would be an interesting feature. So please no discussions about the reasonableness I have some spamtrap SMTP servers (postfix). Currently SMTP AUTH is disabled. But as I daily have thousands of AUTH tries I thought it would be nice to be able to accept any AUTH request from postfix in dovecot. Is something like this possible with dovecot? If so any good description available on how to achieve? Thanks -- tobi

4 5

How to get original recipient from Postfix when using LMTP?
by MRob 22 May '19

22 May '19

Many people prefer to use LMTP for delivery from postfix for better efficiency but X-Original-to header support still missing after many years. One affect of this is need to set sieve_vacation_dont_check_recipient = yes which violate Sieve standard and cause auto-replyies sent to messages that should not happen. Or abandon LMTP. or abandon postfix?? So while feature request is stalled are there any realistic workarounds?

3 3

weakforced: Possible to access the ip address of report/allow?
by Tobi 22 May '19

22 May '19

Hi I wonder if the information about the origin of report or allow can be accessed somehow. lt.remote gives the IP of the client trying to login but is there anything in lt which gives the ip of the system that connects to wforced? Thanks and have a good one -- tobi

2 3

lmtp report permission denied on delivery to multiple recipients
by Patrick Cernko 22 May '19

22 May '19

Hello, when receiving mails for multiple recipients via LMTP, I often see the following messages on our servers: > May 22 11:06:10 sinon dovecot[44304]: lmtp(119718): Connect from $IP$ > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER1$)<119718><2HnmOgIR5Vym0wEA22L5Rg>: msgid=<$MSGID$>: saved mail to INBOX > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER2$)<119718><2HnmOgIR5Vym0wEA22L5Rg:2>: Error: stat(/IMAP/mail/mailboxes/$USER1$/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache) failed: Permission denied (euid=$UID2$($USER2$) egid=$GID2$(rbg) missing +x perm: /IMAP/mail/mailboxes/$USER1$, dir owned by $UID1$:$GID2$ mode=0700) > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER2$)<119718><2HnmOgIR5Vym0wEA22L5Rg:2>: Error: open(/IMAP/mail/mailboxes/$USER1$/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache) failed: Permission denied (euid=$UID2$($USER2$) egid=$GID2$(rbg) missing +x perm: /IMAP/mail/mailboxes/$USER1$, dir owned by $UID1$:$GID2$ mode=0700) > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER2$)<119718><2HnmOgIR5Vym0wEA22L5Rg:2>: Error: lstat(/IMAP/mail/mailboxes/$USER1$/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache.lock) failed: Permission denied > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER2$)<119718><2HnmOgIR5Vym0wEA22L5Rg:2>: Error: file_dotlock_open(/IMAP/mail/mailboxes/$USER1$/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache) failed: Permission denied (euid=$UID2$($USER2$) egid=$GID2$(rbg) missing +x perm: /IMAP/mail/mailboxes/$USER1$, dir owned by $UID1$:$GID2$ mode=0700) > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER2$)<119718><2HnmOgIR5Vym0wEA22L5Rg:2>: Error: open(/IMAP/mail/mailboxes/$USER1$/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache) failed: Permission denied (euid=$UID2$($USER2$) egid=$GID2$(rbg) missing +x perm: /IMAP/mail/mailboxes/$USER1$, dir owned by $UID1$:$GID2$ mode=0700) > May 22 11:06:11 sinon dovecot[44304]: lmtp($USER2$)<119718><2HnmOgIR5Vym0wEA22L5Rg:2>: 2HnmOgIR5Vym0wEA22L5Rg:2: sieve: msgid=<$MSGID$>: stored mail into mailbox 'INBOX' > May 22 11:06:11 sinon dovecot[44304]: lmtp(119718): Disconnect from $IP$: Successful quit (usernames, uids, gids and IP addresses anonymized) So far, I was not able to reproduce this issue on a simple test setup, but I have the strong impression, that is has something to do with the fact, if some of the affected users have a active sieve script and others do not use sieve. In the example above $USER1$ did not have a sieve script configured but $USER2$ had one, as you can see. As a workaround, I configured an empty sieve script for all users with out sieve configured. This seems to work but actually I do not want to have users with empty sieve scripts. This bug seems to be related to https://dovecot.org/list/dovecot/2013-February/088540.html where Timo stated: "LMTP always delivers the mail to the first user. Then it tries to copy the first mail to the second user, because in some setups this can be done using hard links. With mbox that of course doesn't work, but looks like instead of failing silently it logs an error. So everything is working as it should, except there are these unnecessary errors logged. I'll see about getting rid of them." Is it possible to get rid of these error messages, either by a config setting that prevents if they do not lead to a real problem or by changing the code to avoid the behaviour described by Timo? Attached you can find doveconf -n output and the used ldap.conf (both anonymized), the referenced /etc/dovecot/passdb.deny and /etc/dovecot/userdb.overrides are usually empty files and only used during mailbox migrations. Best regards, -- Patrick Cernko <pcernko(a)mpi-klsb.mpg.de> +49 681 9325 5815 Joint Administration: Information Services and Technology Max-Planck-Institute fuer Informatik & Softwaresysteme

1 0

Integrity check mdbox?
by Marc Roos 22 May '19

22 May '19

Is it possible to do some sort of integrity check on mdbox's

2 1

Converting user mailboxes from maildir to sdbox
by David Mehler 22 May '19

22 May '19

Hello, I've got a Postfix/Dovecot server setup. Currently Dovecot is version 2.3.6, and it's using Maildir storage. The mailbox is: mail_home = /home/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs I'm wanting to convert from Maildir to sdbox. I looked at: https://wiki2.dovecot.org/MailboxFormat I was initially thinking mdbox but that's multiple messages per file, which I do not believe is what I want. Am I correct that in the sdbox format if a single message file is corrupted only that message is corrupt and not the rest of the messages as would be the case in a mdbox setup? On the page: https://wiki2.dovecot.org/Migration/MailFormat " maildir -> sdbox migration. Set mail_location=sdbox:~/sdbox and run dsync -u username mirror maildir:~/Maildir " If I set mail_location=sdbox:~/sdbox will that put the user mailboxes in mail_home/sdbox? So it would be: /home/vmail/mailboxes/example.com/username/sdbox I am needing to do this migration, but am paranoid about loosing mail or corrupting mailboxes. All of my users are virtual users and they are stored in a mysql database. Thanks. Dave.

2 1

[mail-crypt-plugin] How to decrypt mailbox?
by emordin 22 May '19

22 May '19

How do I enable the mail-crypt-plugin globally? Do I have to place 'mail_plugins = $mail_plugins mail_crypt' inside ever conf.d file where there is a protocol code block? Like for example the protocol lda codeblock in 15-lda.conf and the protocol imap codeblock in 20-imap.conf I placed 'mail_plugins = $mail_plugins mail_crypt' in 20-lmtp.conf inside the protocol lmtp code block, and the actual plugin settings are inside 90-plugin.conf inside the plugin codeblock. And I was able to get CRYPTED mail with this config. If I place 'mail_plugins = $mail_plugins mail_crypt' inside 90-plugin.conf, I get an error telling me to put 'mail_plugins = $mail_plugins mail_crypt' in 20-lmtp.conf Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 1

Problems after upgrade from 2.2 to 2.3
by Lampa 21 May '19

21 May '19

Hello, i was using dovecot version 2.2 on debian server. After upgrade to debian version 2.3 i have problems. After some time imap doesn't work. There are lot of messages in log 2019-05-21T10:27:49.186373+02:00 hermes dovecot: imap-login: Error: master(imap): net_connect_unix(imap) failed: Resource temporarily unavailable - http://wiki2.dovecot.org/SocketUnavailable (client-pid=24810, client-id=148, rip=2.2.2.2, created 551 msecs ago, received 0/4 bytes) 2019-05-21T10:27:50.808136+02:00 hermes dovecot: imap-login: Error: master(imap): net_connect_unix(imap) failed: Resource temporarily unavailable - http://wiki2.dovecot.org/SocketUnavailable (client-pid=24810, client-id=169, rip=2.2.2.2, created 531 msecs ago, received 0/4 bytes) Tried client_limit set to 1 , service_count to 1 or 0 , still same results. It's imap server for 3k users. Any suggestions, please let me know. Thank you very much. Regards -- Lampa

1 0

Dovecot with LDAP Proxy
by Federico Bartolucci 21 May '19

21 May '19

Hello, configuring Dovecot with LDAP authentication, adding the parameter in ther sql config file: pass_attrs = \ =proxy=y I see then backend connections always addressed to localhot port 143: /user=utente1(a)domanin.com proxy lip=127.0.0.1 lport=143 / while I expect that connections would be managed by the director and then addressed to my backend IPs and specific port. Is there a way to configure ldap proxy to get that behavior? Thanks in advance. -federico

2 3

Dovecot documentation
by ＠lbutlr 21 May '19

21 May '19

the make config options for dovecot on FreeBSD list list [x] ICU Use libicu for FTS unicode normalization but https://wiki2.dovecot.org/Plugins/FTS makes no mention of libicu (nor of icu at all). is linicu simply in addition to the four options of Solar, Lucene, fts-xapian, and fts-dovecot? Also, the link to fts-dovecot goes to https://wiki2.dovecot.org/Plugins/FTS/Dovecot which is a 404. -- Man is born free, but is everywhere in chains.

1 0

[mail-crypt-plugin] How to decrypt mailbox?
by emordin 21 May '19

21 May '19

Hi, So I am able to encrypt email using the crypt plugin, but when I try to access the email by logging in thru mutt or roundcube the email is still encrypted. Is the decryption process automatic or do I have to create a custom program with the decrypt.rb code? Thanks. Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 1

Further issues on FTS engine
by Joan Moreau 20 May '19

20 May '19

Hi, Additionally to the long list of problem on the FTS previously discussed, here a new: WHen I reset the indexes, the indexer-worker seems paralelleizing the indexing (which is good), however, the number available in "ps aux | grep dove" shows that it does not move: dovecot 28549 0.0 0.0 8620 3920 ? S 06:20 0:00 dovecot/indexer [0 clients, 3 requests] mailuse+ 28550 98.6 0.1 167412 86916 ? R 06:20 5:28 dovecot/indexer-worker [jom(a)grosjo.net XXXX - 800/37755] Looking further, if I put a tracer in teh backend, it treats the *same* message several times in parallel, and therefore does not move very fast on the global indexing of the box ANy clue ? THanks

2 1

enforcing multiple per-mailbox quotas for shared mailboxes
by Jost-Philip Matysik 20 May '19

20 May '19

Hi! I'm trying to get quotas for shared mailboxes set up on my server. It's not working, and I fail to understand why. Documentation for setup of this complexity is rather scarce on the web, and the discussions I found either don't directly apply or terminate with "I got it working" but no explanation. Can someone please help? The setup is rather lengthy and complicated, so I'll try to give a summary first for easier understanding. All help is appreciated! Please respond if you need more info! Thanks! Best regards, Jost Basic setup (where am I coming from?): ====================================== - This is a Debian 9 system with a more recent version of dovecot installed from https://repo.dovecot.org/ce-2.3-latest/debian/stretch - users have individual mailboxes with individual quotas -- this works great! - users can share mailboxes with other users through ACLs. To achieve this, there exists a wildcarded namespace with prefix="ZZZ_Freigaben/%%u" --this also works great! ==> up to here it's pretty much following the examples from the Wiki to the letter. Configuration goal (what do I want to achieve?): ================================================ - attach quotas to mailboxes, not logins - when copying/moving mails across shared mailboxes during imap sessions, enforce quota based on target mailbox, not logged-in user doing the copying. To clarify: ==> so if Bob has a quota of 500MB, all messages in Bob's mailbox should count against (and only against!) Bob's quota, regardless of who put them there. ==> if Alice has access to her own mailbox (directly), as well as Bob's mailbox and Dave's mailbox (through sharing), she should see 3 individual quotas when logging in: her own quota (200MB) for everything in her mailbox, bob's quota (300MB) for everything in Bob's mailbox, and Dave's quota (10GB) for everything in Dave's mailbox. These 3 quotas should be completely independant and neither block, nor override each other. Setup Idea (how I tried to get there): ====================================== - "quota=..." "quota_rule" and "quota_rule2" always refer to the user's own mailbox (with an additional rule for Trash). Everyone has those, so these are loaded statically from dovecot config file. - "quota_rule" is overwritten from userdb with the user's individual mailbox quota (the more I like you, the more space you get...) - since the number of different additional quotas required per user depends on how many mailboxes are shared with that user, individual "quota2=...", "quota3=...", "quotaN=..." fields are dynamically generated by the MySQL backend and loaded from userdb upon login. - consequently, for each "quotaN=..." entry, a corresponding "quotaN_rule=*:storage=XXX" is generated and returned from userdb (substitute N=1,2,3,4,... accordingly) Observations: ============= 1. enforcing quota for the user's personal mailbox works as expected, both through IMAP and when delivering incoming mail 2. overriding "quota_rule=..." from userdb for the user's personal mailbox works great. Individual quota is recognized and enforced both through IMAP and when delivering incoming mail. 3. dynamically loading "quota2=...", "quota3=..." etc. from userdb doesn't seem to work at all! I can see them being added as extra fields in the logs upon user login, but the quota-plugin seems to completely ignore them. They are not enforces, and tools like 'doveadm quota' list the userdb fields in the debug messages, but do not interpret them in any way. They do not throw errors either, the additional quota roots are just silently ignored. 4. the end result is that in an IMAP session the logged-in user's quota is enforced for their individual mailbox, but as soon as they write to someone else's mailbox (move a mail to /ZZZFreigaben/bob/Some-Subfolder), no quota is enforced at all! Additional debugging done: ========================== if I hardcode a "quota2=" and/or "quota3=" in the config file, I can observe the following: - If I hardcode "quota2=count:some_name:ns=ZZZ_Freigaben/", dovecot and doveadm will recognize the additional quota root. But since the folder "ZZZ_Freigaben/" on its own isn't a mailbox (it's just a path CONTAINING mailboxes), the quota is neither displayed in clients, nor enforced. It has no real-word effect, other than 'doveadm quota' showing an additional line. - If I hardcode "quota2=count:other_name:ns=ZZZ_Freigaben/postmaster/" in the config file (with that path being the real IMAP path to a shared mailbox), dovecot will complain in the log saying Error: quota: Unknown namespace: ZZZ_Freigaben/postmaster/ dovecot will start and work for the most part, but again completely ignore settings for the additional quota. - additionally, trying to override "quota2_rule=..." from userdb doesn't work as it does with "quota_rule=..."! If I have both "quota_rule=..." and "quota2_rule=..." in the config file as well as returned from userdb (with different values), dovecot will use "quota_rule" from userdb, but "quota2_rule" from config file. This behavior seems inconsistent! - I tried both maildir and count backends (seperately or mixed). Both show the same behavior. - I tried appending or removing an empty "ns=" to the first "quota=..." entry (the wiki shows some examples with it, some without). Makes no difference... Configuration Dumps below (slightly redacted to remove complete email addresses or IPs) ========================== output of dovecot -n: # 2.3.6 (7eab80676): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.6 (92dc263a) # OS: Linux 4.9.0-9-amd64 x86_64 Debian 9.9 # Hostname: [censored] auth_failure_delay = 10 secs auth_mechanisms = plain login default_vsz_limit = 512 M dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } listen = * lmtp_rcpt_check_quota = yes login_greeting = Mail system ready. mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = " quota acl" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace Freigaben { list = children location = maildir:%%h/Maildir:INDEXPVT=%h/Maildir/Freigaben/%%u prefix = ZZZ_Freigaben/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 61 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 61 days special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.username driver = sql } plugin { acl = vfile:/etc/dovecot/dovecot-acl acl_defaults_from_inbox = yes acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/etc/dovecot/sieve/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * quota = count:User quota:ns= quota_grace = 1%% quota_rule = *:storage=5G quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = yes sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_max_script_size = 10M sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 50M } postmaster_address = postmaster(a)matysik-ingenieurwesen.de protocols = " imap lmtp sieve" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0660 user = dovecot } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { address = [censored] port = 993 ssl = yes } } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { address = [censored] port = 4190 } service_count = 1 } service managesieve { process_limit = 64 } ssl_cert = </etc/letsencrypt/live/fullchain.pem ssl_cipher_list = ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+3DES:!aNULL:!MD5:!DSS ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_options = no_compression ssl_prefer_server_ciphers = yes # comment: since imap logins differ from email-addresses I have 2 # userdb queries. One will return fields for %u='login', the other will # return fields for %u='email(a)domain.tld'. # no %u will ever make BOTH userdbs return rows (they are mutually exclusive) userdb { args = /etc/dovecot/dovecot-sql.conf.email driver = sql } userdb { args = /etc/dovecot/dovecot-sql.conf.username driver = sql } protocol lmtp { mail_plugins = " quota acl sieve" } protocol imap { mail_plugins = " quota acl imap_sieve imap_quota imap_acl" } example userdb output: ======================= root@server:/# doveadm -Dv user jost Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) field valuedoveadm(jost)<25290><>: Debug: auth USER input: jost home=/var/vmail/matysik.it/jost-philip uid=5000 gid=5000 acl_groups=matysik,admin quota_rule=*:storage=10G quota_rule2 = Trash:storage=+100M quota2 = count:shared quota for maschinen:ns=ZZZ_Freigaben/maschinen/ quota2_rule = *:storage=500M quota3 = count:shared quota for matysik:ns=ZZZ_Freigaben/matysik/ quota3_rule = *:storage=10G quota4 = count:shared quota for postmaster:ns=ZZZ_Freigaben/postmaster/ quota4_rule = *:storage=1G uid 5000 gid 5000 home /var/vmail/matysik.it/jost-philip mail maildir:~/Maildir acl_groups matysik,admin quota_rule *:storage=10G quota_rule2 Trash:storage=+100M quota2 count:shared quota for maschinen:ns=ZZZ_Freigaben/maschinen/ quota2_rule *:storage=500M quota3 count:shared quota for matysik:ns=ZZZ_Freigaben/matysik/ quota3_rule *:storage=10G quota4 count:shared quota for postmaster:ns=ZZZ_Freigaben/postmaster/ quota4_rule *:storage=1G

1 0

Create a malicious directory
by lty 20 May '19

20 May '19

Use scripts to create some malicious directories. Here is my creation process. How can I prevent the creation of these directories? I used the python imapclient script to create a directory. There may be no big threat to dovecot, but it is dangerous for doveadm.

4 3