January 2020 - dovecot

Bug: Regex doesn't match ungreedy
by Lorenz Steinert 23 Jan '20

23 Jan '20

Hello, first the mandatory dovecot specs: - dovecot 2.3.9.2-1 - Operating system: Archlinux - x84 cpu - ext4 filesystem My problem is that the sieve regex filter doesn't seem to match ungreedely so the regex: ^(Re: |)\\[(.*?)\\/(.*?)\\] evaluates the last capturing group of [matrix-org/synapse] [Don't merge!!] Backport fix for MAU limits to v1.8.0 (#6763) to synapse] [Don't merge!! wich should have been synapse Best Regards Lorenz Steinert

2 1

Is it possible to enable push notifications for iOS/macOS mail clients on a stock dovecot?
by Gerben Wierda 23 Jan '20

23 Jan '20

Now that Apple has abandoned mail server capabilities in macOS Server.app we have to move to an open source solution. I have done this using Macports and it works well (no thanks to Apple as it never published the in 2018 promised migration info for mail services). The MacPorts Apple Push Notification variant based on a patch written a few years ago for dovecot supports APNS but it requires you to export a certificate form your old High Sierra Server.app. With the patch and that certificate, dovecot tells an email client it supports XAPPLEPUSHSERVICE and that makes Apple mail clients think they are talking to macOS Server and they switch to push notifications for updates. Now, that certificate needs to be renewed yearly by Server.app and imported by hand etc. At some point this will stop working (apart from that you need to keep an old macOS Server around to renew) Is there another way to get this working with an open source dovecot, outside of using Apple’s push notification service? Some other standard? Some other service? Probably not, right? G

5 5

Using dsync for a single mailbox?
by Wim Lewis 23 Jan '20

23 Jan '20

Is it possble to use `doveadm sync` to migrate a single mailbox? I'm migrating accounts from another IMAP server,and most of the mailboxes are in mbox or maildir format, but a few are in MBX. As far as I can tell the only recommended way to "convert" an MBX mailbox is to sync it via imap. But dsync fails in inscrutable ways, and the documentation is kind of scant on how to control what it does. Even just an example command line showing how to copy remote mailbox FOO into dovecot mailbox BAR would be extremely helpful.

2 4

Dovecot - Upgrade Solr 7.7.2 to 8.4.1
by Domenico Pastore 23 Jan '20

23 Jan '20

Hello, I have Dovecot configured with Solr for the indexes. I have need your support for upgrade solr 7.7.2 to 8.4.1. Solr 7.7.2 has a security issue CVE-2019-12409. It's possible upgrade of Solr? Dovecot work correctly with Solr 8.x? The Solr documentation recommended after updating: "It is always strongly recommended that you fully reindex your documents after a major version upgrade." There are tips for Dovecot? Br, Domenico

4 4

Re: JMAP support in Dovecot
by Mike Gao 22 Jan '20

22 Jan '20

Hi, Any news for jmap Support in Dovecot? Thanks, Mike

1 0

socket dovecot-lmtp is not created anymore
by ratatouille 22 Jan '20

22 Jan '20

Hello! Since experiments on my testserver two days ago /var/spool/postfix/private/dovecot-lmtp is not created anymore. This the setting in /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } I searched nearly the whole system for lmtp but can't find the reason why. What can I do? Debug? Andreas

2 2

Cached message size smaller than expected
by Asai 22 Jan '20

22 Jan '20

Greetings, Can anyone help me to solve this problem? When doveadm sync is running nightly, we have a certain user's mailbox that will not properly sync and the logs give me this error (user private info redacted): Error: Mailbox USER/MAILBOX: UID=79: read(/vmail/domain.org/user/.MAILBOX/cur/1575914253.M611834P7822.triata4,S=… failed: Cached message size smaller than expected (41893 < 41897, box=USER/MAILBOX, UID=79) (read reason=mail stream) I have deleted the dovecot indexes in the synced backup of this mailbox, as well as in the actual user's mailbox itself and I'm still getting this error. What am I missing? Thank you for your help here. -Asai

2 2

Dovecot and archived compressed folder
by filbar＠centrum.cz 21 Jan '20

21 Jan '20

Hello, I have large of archive mails which I access occasionally. Is it possible to have in dovecot in user account archive folder which is compressed to save disk space? Thank's Filip Bartmann

2 2

Getting an extprogram script to work
by Eric Abrahamsen 21 Jan '20

21 Jan '20

Hi all, I'm trying to do the same thing everyone else is: having rspamd learn_ham or learn_spam depending on where I move a message. My current problem is that Dovecot seems to be reporting success, but nothing ever happens -- the script somehow fails to run. I'm currently using a dummy script that just writes a file to /tmp, until I can get this much working, at least. My bin_dir: --------------------- me@server:/usr/lib/dovecot/sieve# ls -l total 40 drwxr-xr-x 2 root root 4096 Jan 21 03:35 ./ drwxr-xr-x 4 root root 12288 Aug 29 06:28 ../ -rw-r--r-- 1 root root 112 Jan 21 02:17 report-ham.sieve -rw-r--r-- 1 root root 250 Jan 21 02:17 report-ham.svbin -rw-r--r-- 1 root root 112 Jun 3 2019 report-spam.sieve -rw-r--r-- 1 root root 258 Jun 3 2019 report-spam.svbin -rwxr-xr-x 1 root root 105 Jan 21 03:35 rspamd_ham.sh* -rwxr-xr-x 1 root root 43 Jun 3 2019 rspamd_spam.sh* --------------------- Then the report-ham.sieve script: --------------------- require ["vnd.dovecot.pipe", "copy", "imapsieve", "fileinto"]; pipe :copy "rspamd_ham.sh"; #fileinto "INBOX"; --------------------- And the dummy rspamd_ham.sh script: --------------------- #!/bin/bash #exec /usr/bin/rspamc learn_ham tim=`date +%M-%S` echo "${1}" > "/tmp/${tim}_results.txt" --------------------- I can confirm the above script works correctly when run from the command line, both as root and the vmail user. When run as part of the sieve process, no errors are reported, but no file is created under /tmp. From the logs: --------------------- Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.4.21 (92477967) loaded ... Debug: learn/ham: Mailbox opened because: SELECT Debug: imapsieve: mailbox learn/ham: APPEND event Debug: imapsieve: Matched static mailbox rule [1] Debug: sieve: file storage: Using Sieve script path: /usr/lib/dovecot/sieve/report-ham.sieve Debug: sieve: file script: Opened script `report-ham' from `/usr/lib/dovecot/sieve/report-ham.sieve' Debug: sieve: Opening script 1 of 1 from `/usr/lib/dovecot/sieve/report-ham.sieve' Debug: sieve: Loading script /usr/lib/dovecot/sieve/report-ham.sieve Debug: sieve: Script binary /usr/lib/dovecot/sieve/report-ham.svbin successfully loaded Debug: sieve: binary save: not saving binary /usr/lib/dovecot/sieve/report-ham.svbin, because it is already stored Debug: sieve: Executing script from `/usr/lib/dovecot/sieve/report-ham.svbin' Debug: sieve: action pipe: running program: rspamd_ham.sh Debug: Mailbox learn/ham: Opened mail UID=249 because: mail stream Debug: waiting for program `/usr/lib/dovecot/sieve/rspamd_ham.sh' to finish after 0 msecs sieve: pipe action: piped message to program `rspamd_ham.sh' Debug: learn/ham: Mailbox opened because: lib-lda delivery sieve: left message in mailbox 'learn/ham' --------------------- Near as I can tell, the first time this runs after a dovecot restart, I get this error instead: Error: write(program stdin) failed: Broken pipe Error: sieve: pipe action: failed to program `rspamd_ham.sh': refer to server log for more information. But that only happens once, then it behaves as above. The "Opened mail UID=XXX" bit changes UID (increments monotonically?) every time. I think that ought to be everything but my dovecot -n. Thanks in advance for any help. # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1057-aws x86_64 Ubuntu 18.04.3 LTS ext4 auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_home = /var/mail/vmail/%d/%n mail_location = maildir:/var/mail/vmail/%d/%n/mail:LAYOUT=fs mail_plugins = " quota" mail_prefetch_count = 20 mail_privileged_group = mail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=ssha512 username_format=%u /etc/dovecot/passwd.db driver = passwd-file } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox1_causes = APPEND imapsieve_mailbox1_name = learn/ham quota_rule = *:storage=5G quota_rule2 = Trash:ignore quota_rule3 = Junk:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-auth { mode = 0666 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } ssl = required ssl_cert = </etc/letsencrypt/live/cert-deleted ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL:RC4+RSA:+HIGH:+MEDIUM ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/passwd.db default_fields = uid=vmail gid=vmail home=/var/mail/vmail/%d/%n driver = passwd-file } protocol lmtp { mail_plugins = " quota sieve" postmaster_address = postmaster(a)ericabrahamsen.net } protocol lda { deliver_log_format = msgid=%m: %$ } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = " quota imap_quota imap_sieve" }

1 0

solr fts and removing accounts
by Wojciech Puchar 20 Jan '20

20 Jan '20

i use solr fts indexing. It worls very well but it have one database per system, not per user. Lets suppose i delete one or more e-mail users in system. How to remove them in solr database to reclaim space?

3 2