November 2018 - dovecot

Log sync error
by Jakobus Schürz 11 Dec '18

11 Dec '18

Hi there! I get a lot of errormessages. My dovecot is: dovecot-core 2:2.3.2.1-1~stretch from Debian stable. I found this: https://www.dovecot.org/list/dovecot/2013-July/091648.html So the bug came back... The Log is attached Thanks Jakob

1 1

Sieve notify variables not working with body?
by Bambero 09 Dec '18

09 Dec '18

Hi, I want to send notification like this: if body :text :matches "*" { notify :importance "3" :message "[NOTIFY] ${1}" "mailto:test@example,com"; } The notification works but the variable ${1} seems to be empty. But in this case: if header :matches "Subject" "*" { notify :importance "3" :message "[NOTIFY] ${1}" "mailto:test@example,com"; } Everything works correct. Regards, Bambero

2 3

Panic: file dsync-brain-mailbox-tree.c: line 448: unreached
by Marc Weustink 04 Dec '18

04 Dec '18

Hi all, To backup our imap folders I've a cronjob running in the night: /usr/bin/doveadm -o stats_writer_socket_path= backup -R -A -N tcp:xxx.yyy.zzz:4191 This ran successful when I set it up and didn't look at it anymore. Recently I noticed errors: dsync-local(administration)<uO/qHjXS6FteLAAA3i05xw>: Panic: file dsync-mailbox-tree-sync.c: line 1253 (sync_create_mailboxes): assertion failed: (node->ns == other_node->ns) dsync-local(administration)<uO/qHjXS6FteLAAA3i05xw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcceca) [0x7f7029099eca] -> /usr/lib/dovecot/libdovecot.so.0(+0xccf21) [0x7f7029099f21] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7029006f44] -> /usr/bin/doveadm(+0x5206c) [0x558ba9fec06c] -> /usr/bin/doveadm(dsync_mailbox_trees_sync_init+0x2a2) [0x558ba9fedba2] -> /usr/bin/doveadm(dsync_brain_recv_mailbox_tree_deletes+0x246) [0x558ba9fdf6d6] -> /usr/bin/doveadm(dsync_brain_run+0x5b8) [0x558ba9fdbec8] -> /usr/bin/doveadm(+0x42260) [0x558ba9fdc260] -> /usr/bin/doveadm(+0x585bf) [0x558ba9ff25bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f70290b2029] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f70290b3959] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f70290b2132] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f70290b2348] -> /usr/bin/doveadm(+0x27e39) [0x558ba9fc1e39] -> /usr/bin/doveadm(+0x2a3c7) [0x558ba9fc43c7] -> /usr/bin/doveadm(+0x2b1f6) [0x558ba9fc51f6] -> /usr/bin/doveadm(doveadm_mail_try_run+0x1fa) [0x558ba9fc597a] -> /usr/bin/doveadm(main+0x45b) [0x558ba9fb4ceb] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f702891a830] -> /usr/bin/doveadm(_start+0x29) [0x558ba9fb4e69] Aborted (core dumped) I've added the dovecot repo to get dovecot automatically updated, so I cannot tell with which version it started. my doveconf -n: [sudo] password for infraadmin: # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) # OS: Linux 4.4.0-137-generic x86_64 Ubuntu 16.04.5 LTS autofs # Hostname: xxx.xxx.xxx dict { acl = pgsql:/etc/dovecot/dovecot-dict-sql-local.conf.ext } doveadm_password = # hidden, use -P to show it mail_debug = yes mail_gid = vmail mail_home = /home/mail/backup/%n mail_location = maildir:/home/mail/backup/%n/mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } namespace public { location = maildir:/home/mail/backup/Common/mail:INDEXPVT=/home/mail/backup/%n/mail/common prefix = Common/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " sieve" service auth { unix_listener auth-userdb { mode = 0777 } } service dict { unix_listener dict { group = vmail user = vmail } } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

1 1

Relocate subfolders to different mount point
by Marc Roos 03 Dec '18

03 Dec '18

I would like to relocate the subfolders of the Sent folder to a different location. Now send messages mail is stored in mbox format at the location /home/users/testuser/mail/.Sent. I would like to store the subfolders Sent/2017 and Sent/2018 at the location /home/archive/users/testuser/.Sent.2017 and /home/archive/users/testuser/.Sent.2018 Is this even possible? I am using currently using this mail_location: mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u:CONTROL=~/mail/control:INDEX=/var/d ovecot/%u/index:LAYOUT=maildir++ /var/dovecot is on a ssd /var/spool/mail is on sda ~/mail is on sdb with these folders [@mail]# ls -ac1 .folderc .Drafts .foldera control .Trash.folderc .folderb .Sent .Sent.2018 .Trash

2 3

DMARC policies
by Aki Tuomi 01 Dec '18

01 Dec '18

Hi! It seems we accidentically had a high amount of subscribers temporarily disabled due to DMARC on some sender's host. We have now taken actions to prevent this in the future and all temporarily disabled members have been restored. Aki

15 22

Dovecot crash
by JCA 01 Dec '18

01 Dec '18

This happening when my Thunderbird client is trying to establish a connection with a Dovecot server. Some background first: 1) I am running Thunderbird 6.20.1 from a Linux client. 2) Other clients (e.g. Maildroid in my Android phone) do not have any issues. 3) The Dovecot software is version 2.2.9, running in a Linux server. 4) This may be the root of the problem: at some point, the Dovecot software was changed to version 2.3.1, and the reverted to 2.2.9. The crash started to appear when this reversion took place. My guess is that upgrading to 2.3.1 will eliminate this problem. However, in case that does not solve the problem, I would be grateful if anybody could throw some light into exactly what is going on here, and whether it can be fixed even without the need of upgrading to 2.3.1. What follows are the traces generated by Dovecot 2.2.9 when a connection is attempted from Thunderbird, with usernames and IP addresses disguised for privacy, and some blank lines inserted for readability: Nov 28 13:36:20 imap-login: Info: Login: user=<xyz>, method=PLAIN, rip=xxx.yyy.z zz.154, lip=aaa.bbb.ccc.7, mpid=29245, TLS, session=<q7jNhL97qQDMhbWa> Nov 28 13:36:20 imap(xyz): Panic: file mail-index-sync-keywords.c: line 227 (key words_update_records): assertion failed: (data_offset >= sizeof(struct mail_index_record)) Nov 28 13:36:20 imap(xyz): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so. 0(+0x65626) [0xb75ae626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f) [0xb75ae6 9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb756180e] -> /usr/lib/dove cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb76cb6b7] -> /usr /lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7) [0xb76cc167] - > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4) [0xb76cd22 4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c) [0xb76bcb9c ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb76b7c2a] -> /usr/lib /dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb76b7daa] -> /usr/lib/dovecot/libd ovecot-storage.so.0(mail_index_open+0x114) [0xb76b7f54] -> /usr/lib/dovecot/libd ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb76a808b] -> /usr/lib/do vecot/libdovecot-storage.so.0(+0x5a481) [0xb765a481] -> /usr/lib/dovecot/libdove cot-storage.so.0(+0x5a6f2) [0xb765a6f2] -> /usr/lib/dovecot/libdovecot-storage.s o.0(+0x7a017) [0xb767a017] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_o pen+0x26) [0xb767a1d6] -> dovecot/imap(client_open_save_dest_box+0x79) [0x805dca 9] -> dovecot/imap() [0x8052678] -> dovecot/imap(command_exec+0x32) [0x805d7a2] -> dovecot/imap() [0x805c746] -> dovecot/imap() [0x805c820] -> dovecot/imap(clie nt_handle_input+0x125) [0x805cad5] -> dovecot/imap(client_input+0x71) [0x805ce91 ] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0xb75c1292] -> /usr /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xdb) [0xb75c22cb] -> /usr/lib/ dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb75c0cd8] -> /usr/lib/dovecot/libdo vecot.so.0(master_service_run+0x2d) [0xb756728d] -> dovecot/imap(main+0x2bf) [0x 8066fef] -> /lib/libc.so.6(__libc_start_main+0xe6) [0xb73cfdb6] Nov 28 13:36:20 imap(xyz): Fatal: master: service(imap): child 29245 killed with signal 6 (core dumps disabled) Nov 28 13:36:20 imap-login: Info: Login: user=<xyz>, method=PLAIN, rip=xxx.yyy.z zz.154, lip=aaa.bbb.ccc.7, mpid=29247, TLS, session=<xPzShL97lADMhbWa> Nov 28 13:36:21 imap(xyz): Panic: file mail-index-sync-keywords.c: line 227 (key words_update_records): assertion failed: (data_offset >= sizeof(struct mail_inde x_record)) Nov 28 13:36:21 imap(xyz): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so. 0(+0x65626) [0xb7757626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f) [0xb77576 9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb770a80e] -> /usr/lib/dove cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb78746b7] -> /usr /lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7) [0xb7875167] - > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4) [0xb787622 4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c) [0xb7865b9c ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb7860c2a] -> /usr/lib /dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb7860daa] -> /usr/lib/dovecot/libd ovecot-storage.so.0(mail_index_open+0x114) [0xb7860f54] -> /usr/lib/dovecot/libd ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb785108b] -> /usr/lib/do vecot/libdovecot-storage.so.0(+0x5a481) [0xb7803481] -> /usr/lib/dovecot/libdove cot-storage.so.0(+0x5a6f2) [0xb78036f2] -> /usr/lib/dovecot/libdovecot-storage.s o.0(+0x7a017) [0xb7823017] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_o pen+0x26) [0xb78231d6] -> dovecot/imap(client_open_save_dest_box+0x79) [0x805dca 9] -> dovecot/imap() [0x8052678] -> dovecot/imap(command_exec+0x32) [0x805d7a2] -> dovecot/imap() [0x805c746] -> dovecot/imap() [0x805c820] -> dovecot/imap(clie nt_handle_input+0x125) [0x805cad5] -> dovecot/imap(client_input+0x71) [0x805ce91 ] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0xb776a292] -> /usr /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xdb) [0xb776b2cb] -> /usr/lib/ dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb7769cd8] -> /usr/lib/dovecot/libdo vecot.so.0(master_service_run+0x2d) [0xb771028d] -> dovecot/imap(main+0x2bf) [0x 8066fef] -> /lib/libc.so.6(__libc_start_main+0xe6) [0xb7578db6] Nov 28 13:36:21 imap(xyz): Fatal: master: service(imap): child 29247 killed with signal 6 (core dumps disabled)

3 6

Errors wih fts-solr
by Riccardo Bicelli 30 Nov '18

30 Nov '18

Hello, I recently upgraded my solr installation to 6.6.5 When searching through dovecot solr throws this this error: solr Bad contentType for search handler :text/xml I'm running dovecot 2.2.10 on CentOS 7.5. Regards Riccardo

3 4

Replacing email envelope
by jon.sp2＠wp.pl 30 Nov '18

30 Nov '18

Hi, Could you please advice how I can replace envelope of a message received on my server? Best would be using sieve. Simple case - email A(a)example.com receives message, which I'd like to repack into new envelope (I want to have control what values in the envelope will be there - from, to, replay-to et.c) and send to B(a)test.com . At first I wanted to use editheader extension, but it is not allowing me to modify From or To values as far as I can tell. Another idea was to use envelope, but I don't see any way of editing values. Only reading. Now, I am thinking of writing script and from sieve it will be passed there, where I'll do message parsing and send new message using mutt or something similar. Frankly speaking I suppose there is much better solution to that and I'd appreciate any advice on the topic. Thanks, Jon

5 5

rspamd / imapsieve script is not executed/called
by Michael Ludwig 30 Nov '18

30 Nov '18

Hi to all of you, as I am struggling around with this a week or so I'm afraid I have to ask for help here. The problem is sitting right in front of the computer, as most of the time. ;-) So let me explain: Dovecot is working properly for IMAP with LE certificates, so I thought it's time to continue with Christoph Haas tutorial primarily and other blogs and tutorials for setting up the server. Next part would be to get rspamd learning what mails the user puts into junk folder. I followed the tutorial, but it will not work. Also I tried to get into debug mode, but I feel that dovecot is not really logging too much. Server is freshly set up Ubuntu 18.04.1, latest patchlevel with packages mostly from Ubuntu sources, except rspamd, but this was added as ppa if my remembering is correct. This is what I get on syslog, whilst *.* is being put at /var/log/allmessages. ######################################### Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: INBOX/Junk: Mailbox opened because: UID move Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: imapsieve: mailbox INBOX/Junk: MOVE event Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: sieve: Pigeonhole version 0.4.21 (92477967) initializing Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.4.21 (92477967) loaded Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.4.21 (92477967) loaded Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: imapsieve: Static mailbox rule [1]: mailbox=`Junk' from=`*' causes=(COPY) => before=`file:/etc/dovecot/sieve/report-spam.sieve' after=(none) Nov 25 23:30:50 myserver dovecot: imap(info(a)mydomain.tld): Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Junk' causes=(COPY) => before=`file:/etc/dovecot/sieve/report-ham.sieve' after=(none) ######################################### So as far as I can interpret there is absolutely no script called when I move a mail from inbox to junk folder in Thunderbird. Here is the output of dovecot -n but I don't exactly if this is enough, so please give me an info if you need more output. ######################################### # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-39-generic x86_64 Ubuntu 18.04.1 LTS ext4 auth_mechanisms = plain login lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = " quota" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = INBOX/ separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * quota_grace = 20%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota quota_status_success = DUNNO recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after/ sieve_global = /etc/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_pipe_socket_dir = sieve-pipe sieve_plugins = sieve_imapsieve sieve_extprograms sieve_trace_debug = yes } protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 22466 } } ssl_cert = </etc/letsencrypt/live/myserver.mydomain.tld/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } protocol lmtp { mail_plugins = " quota quota sieve" postmaster_address = postmaster(a)mydomain.tld } protocol imap { mail_plugins = " quota imap_sieve imap_quota" } ######################################### Would be really great if somebody knows what the he** I am doing wrong. Thank you for taking the time to go through this. Michael

2 3

Error logs with virtual folder after upgrading to 2.3.4
by Maria Arrea 30 Nov '18

30 Nov '18

4 3