- dovecot - dovecot.org

Determinant of umask for sieve_pipe_bin_dir scripts?
by Laura Smith 27 May '20

27 May '20

Hi, What determines the umask of sieve_pipe_bin_dir scripts ? The results from my script are always being set to 0600. My script is simple and shown below, even if I adjust the right line to add " && chmod 644", the actual resulting file still remains at 0600 ?!? #!/bin/bash # Usage: imapsieve_copy <email> <spam|ham> MSG_USER="$1" MSG_TYPE="$2" RUN_UUID=$(cat /proc/sys/kernel/random/uuid) BASE_DIR="/foo/bar" TARGET_DIR="${BASE_DIR}/${MSG_TYPE}" TARGET_FILE="${TARGET_DIR}/${RUN_UUID}" cat > "${TARGET_FILE}" < /dev/stdin && pigz -9 "${TARGET_FILE}"

2 2

How to make IMAPS SSL Cert for Dovecot that works with Thunderbird
by hanasaki＠gmail.com 27 May '20

27 May '20

Hello all, What are the instructions for making an SSL cert for Dovecot IMAPS? Two methods have been tried, and work, with Evolution; however generate the following error when Thunderbird tries to connect. Thank you, method 1 : self signed openssl req -newkey rsa:4096 -sha512 -x509 -days 365 -nodes -keyout mykey.key -out mycert.pem method 2 : Let's Encrypt (LE) CA Created with Certbot ERROR TLS handshaking: SSL_accept() failed: error:14094412:SSL routines:ssl3_read_bytes:sslv3 alert bad certificate: SSL alert number 42, session=<+oooooo>

5 10

doveadm: extra lines?
by Felipe Gasper 27 May '20

27 May '20

Hello, I’m sending doveadm “kick” commands to doveadm-server via the doveadm protocol. When “kick” sends back a NOTFOUND error, though, it’s sending back additional output. strace shows: write(3<UNIX:[3158354->3156665]>, "\t\tkick\tmyssltest\n", 17) = 17 ... read(3<UNIX:[3158354->3156665]>, "\n-NOTFOUND\n\n-\n", 8192) = 14 Going by the protocol documentation (https://wiki2.dovecot.org/Design/DoveadmProtocol) there appear to be 3 extra bytes at the end of the server’s response: "\n-\n". Is this a bug in doveadm-server? Or am I misreading the protocol documentation? Thank you! cheers, -Felipe Gasper

1 2

Panic: assert opcode == HASH_TABLE_OP_UPDATE during replication (dsync-local)
by Alexey 26 May '20

26 May '20

Hello. I got an error and have no idea how to fix it, or workaround it. dsync-local(mymail(a)mymail.org)<PR2hBB86zV52SQAACjx0Gw>: Panic: file hash.c: line 251 (hash_table_insert_node): assertion failed: (opcode == HASH_TABLE_OP_UPDATE) dsync-local(mymail(a)mymail.org)<PR2hBB86zV52SQAACjx0Gw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x3d) [0x7fd8acd5d15d] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7fd8acd5d27e] -> /usr/lib/dovecot/libdovecot.so.0(+0xec88b) [0x7fd8acd6688b] -> /usr/lib/dovecot/libdovecot.so.0(+0xec8c1) [0x7fd8acd668c1] -> /usr/lib/dovecot/libdovecot.so.0(+0x4ec56) [0x7fd8accc8c56] -> /usr/lib/dovecot/libdovecot.so.0(+0x4f9b3) [0x7fd8accc99b3] -> doveadm(dsync_mailbox_tree_find_delete+0x1b2) [0x5567056b7aa2] -> doveadm(+0x4a265) [0x5567056ad265] -> doveadm(dsync_brain_recv_mailbox_tree_deletes+0xc8) [0x5567056aded8] -> doveadm(dsync_brain_run+0x1ae) [0x5567056aaa9e] -> doveadm(+0x48104) [0x5567056ab104] -> doveadm(+0x58d1f) [0x5567056bbd1f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fd8acd7cb79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x131) [0x7fd8acd7e0c1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7fd8acd7cc1c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fd8acd7cd90] -> doveadm(+0x2e9f4) [0x5567056919f4] -> doveadm(+0x30b16) [0x556705693b16] -> doveadm(+0x3170a) [0x55670569470a] -> doveadm(doveadm_mail_try_run+0x21e) [0x556705694ffe] -> doveadm(main+0x552) [0x5567056851b2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7fd8ac90109b] -> doveadm(_start+0x2a) [0x5567056852fa] This is output of manual run doveadm sync process between dovecot 2.3.10.1 (side with error message) and dovecot 2.3.7.2 (remote side). I have `require ["fileinto"];` on both sides in .dovecot.sieve files. Regards, Alukardd.

1 0

Avoiding logging password when dict lookup fails
by Geo Mander 26 May '20

26 May '20

I've made a unix-socket auth setup, by looking at the examples here: https://doc.dovecot.org/configuration_manual/authentication/dict/#complete-… I need to ship the plain password to the socket as well, so i have simply added %w to the lookup key, like so: key = passdb/U=%u P=%w My problem is, that if the socket connection is down for whatever reason, dovecot will write the entire message above - including the plaintext password - into the logfile. --- May 25 11:17:48 imap-1 dovecot: auth-worker(32690): Error: dict-client: Lookup 'shared/passdb/U=john.doe(a)example.com P=john123 failed: net_connect_unix(/var/run/dovecot/doveauthdsocket) failed: Connection refused (reply took 0.000 secs (0.000 in dict wait, 0.000 in other ioloops, 0.000 in locks)) May 25 11:17:48 imap-1 dovecot: auth-worker(32690): Error: dict( john.doe(a)example.com,8.8.4.4,<Px/Ic3WmsNhb7s1N>): Failed to lookup key shared/passdb/U=john.doe(a)example.com P=john123 -- Can i disable dict client logging? Or can i structure my dict request in a different way to avoid this logging, while still getting the complete user-name and plaintext password shipped over the socket? $ dovecot --version 2.2.36 (1f10bfa63)

1 0

child killed by signal 6
by Peter Nabbefeld 26 May '20

26 May '20

Hello, from time to time I keep getting problems with some emails causing signal 6. I've already reported those, but it seems not to be easy to find the cause. From the logs, it seems to occur in sieve implementation. I've checked the email envelopes tody by accident, probably this part of my telnet session might help: a11 fetch 1 all * 1 FETCH (RFC822.SIZE 16750 INTERNALDATE "22-May-2020 05:02:34 +0000" ENVELOPE ("Fri, 22 May 2020 03:46:54 +0000" "RE: Http2 tomact server taking time in responding when 1st StreamId is a large integer value like 2147483641" (("Prateek Kohli" NIL "prateek.kohli" "ericsson.com.INVALID")) (("Prateek Kohli" NIL "prateek.kohli" "ericsson.com.INVALID")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) NIL NIL "<d778507f-306b-5395-b583-fc1f2651431d(a)apache.org>" " <DB7PR07MB40285E61F0731810A615E3FB92B40(a)DB7PR07MB4028.eurprd07.prod.outlook.com>") FLAGS (\Seen)) a11 OK FETCH completed a12 fetch 2 all * 2 FETCH (RFC822.SIZE 21146 INTERNALDATE "22-May-2020 06:39:54 +0000" ENVELOPE ("Fri, 22 May 2020 06:39:35 +0000" "RE: RST on TCP level sent by Tomcat" (("Arshiya Shariff" NIL "arshiya.shariff" "ericsson.com.INVALID")) (("Arshiya Shariff" NIL "arshiya.shariff" "ericsson.com.INVALID")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) (("markt(a)apache.org" NIL "markt" "apache.org")("M Venkata Pratap M" NIL "m.m.venkata.pratap" "ericsson.com")) NIL " <AM7PR07MB6561761FA78F23F5AAF398399FB70(a)AM7PR07MB6561.eurprd07.prod.outlook.com>" " <AM7PR07MB65615CD03F422AC8D8384FC09FB40(a)AM7PR07MB6561.eurprd07.prod.outlook.com>") FLAGS ()) a12 OK FETCH completed The first message causes signal 6, the second does not. Probably the problem is killed by the two consecutive "NIL"s? I'm not an experienced administrator, only managing my private computer, so I don't know the meaning of every envelope field. But might these two "NIL"s cause the abort? BTW, to download all messages from my IMAP account to my private dovecot instance I had to delete the first message, since I couldn't download any other messages from the IMAP folder otherwise. Kind regards Peter

3 4

Sieve test string and case sensitivity
by Kim Minh Kaplan 25 May '20

25 May '20

Hello, I have found that Pigeonhole comes with an extensive testsuite against the Sieve RFCs. As I am working on a personal Sieve project I decided to run my tool on this testsuite and it stumbled on "Basic assignment: string test failed"[1]. Pigeonhole defaults to comparator "i;octet"[2] for the string test. But Sieve says that the default comparator should be "i;ascii-casemap"[3]. Did I miss some other part of the standard? Can you point me in the right direction? Thank you, Kim Minh. [1]: https://github.com/dovecot/pigeonhole/blob/master/tests/extensions/variable… [2]: https://github.com/dovecot/pigeonhole/blob/master/src/lib-sieve/plugins/var… [3]: https://tools.ietf.org/html/rfc5228#section-2.7.3

2 1

Sieve addheader directive works only partially
by Peter Folta 25 May '20

25 May '20

Hi all, I want to add a custom header to incoming emails from a particular sender. This is what my user Sieve script looks like: require “editheader”; if address :is "From” “special-sender(a)example.xn--com-9o0a { addheader “X-My-Custom-Header” “Header Value"; } I have enabled the editheader extension in my Dovecot configuration: plugin { … sieve_extensions = +editheader } This doesn’t seem to work and no header is added to the email. However, if I also move the email to a different folder in the same if-block, the header gets added just fine: require “editheader”; require “fileinto”; if address :is "From” “special-sender(a)example.xn--com-9o0a { addheader “X-My-Custom-Header” “Header Value”; fileinto “MyFolder”; } Am I missing something? Thanks Peter

4 6

missing man page for “doveadm dsync-server”?
by Felipe Gasper 25 May '20

25 May '20

Hello, Is there a man page for this command? I don’t see one in the repository. Given its utility in, e.g., syncing mailboxes via SSH, it seems like documentation for this command would be useful? Thank you! -Felipe Gasper

3 3

doveadm backup : Error: Failed to access mailbox
by Laura Smith 25 May '20

25 May '20

Hi All, So close and yet so far. ;-( Have been migrating users from an old Dovecot server to a new one. All of the users have doveadm backup'd perfectly, except for one ! What does the below mean ? $ sudo doveadm -v -o imapc_user=jd(a)example.org.tld -o imapc_password=secretSquirrel -o imapc_host=old-server.example.com backup -1 -R -u jd(a)example.org.tld imapc: dsync(jd(a)example.org.tld): Info: imapc(old-server.example.com:993): Connected to 10.10.10.10:993 (local 10.10.10.11:35858) dsync(jd(a)example.org.tld): Error: Failed to access mailbox Sent Messages (jasmin@example: Mailbox doesn't exist: Sent Messages (jasmin@example (0.001 + 0.000 secs). dsync(jd(a)example.org.tld): Error: Failed to access mailbox Sent Messages (jasmin(a)example.org: Mailbox doesn't exist: Sent Messages (jasmin(a)example.org (0.001 + 0.000 secs). dsync(jd(a)example.org.tld): Error: Failed to access mailbox Drafts (jasmin@example: Mailbox doesn't exist: Drafts (jasmin@example (0.001 + 0.000 secs). dsync(jd(a)example.org.tld): Error: Failed to access mailbox Drafts (jasmin(a)example.org: Mailbox doesn't exist: Drafts (jasmin(a)example.org (0.001 + 0.000 secs). dsync(jd(a)example.org.tld): Error: Failed to access mailbox Deleted Messages (jasmin@example: Mailbox doesn't exist: Deleted Messages (jasmin@example (0.001 + 0.000 secs). dsync(jd(a)example.org.tld): Error: Failed to access mailbox Deleted Messages (jasmin(a)example.org: Mailbox doesn't exist: Deleted Messages (jasmin(a)example.org (0.001 + 0.000 secs).

1 1

A small mistake in a Dovecot error message.
by Bill Shirley 24 May '20

24 May '20

I'm setting up a new mail server and got this message: May 21 11:55:09 vader dovecot[4090]: imap-login: Error: Diffie-Hellman key exchange requested, but no DH parameters provided. Set ssh_dh=</path/to/dh.pem The Dovecot parameter is actually: ss*l*_dh<=/path/to/dh.pem not ssh... Fedora release 32 (Thirty Two) dovecot-2.3.9.3-1.fc32.x86_64 Many thanks for such useful software. Bill

2 1

Dovecot passdb and postfix login
by Laura Smith 24 May '20

24 May '20

Hi, Long story short I've got a fully functional Dovecot IMAP instance and I am now looking to upgrade some perimiter authenticated SMTP relays to authenticate against the Dovecot instance. Trouble is that I am seeing errors such as "auth: Warning: sql: Ignoring changed user_query in /etc/dovecot/local_sql_users.conf, because userdb sql not used." in my Postfix server logs and not able to successfully authenticate via AUTH LOGIN on the Postfi instance. Perhaps I'm missing something obvious from my config ? Here is the doveconf -n from the Postfix server in question: # 2.3.10.1 (a3d0e1171): /etc/dovecot/dovecot.conf # OS: Linux 4.19.0-9-amd64 x86_64 Debian 10.4 # Hostname: foobar.example.com auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1:7 disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/local_sql_users.conf driver = sql } service auth { inet_listener { address = 127.0.0.1 port = 7425 } inet_listener { address = ::1 port = 7425 } unix_listener /var/spool/postfix-authrelay/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl = no The local_sql_users.conf is the same one that's used on the functioning IMAP servers, just copied accross to the authenticated relay server: $ sudo cat /etc/dovecot/local_sql_users.conf driver = pgsql connect = host=foo dbname=bar user=secret password=squirrel default_pass_scheme = ARGON2ID password_query = select dovecot_username as user,password from get_user('%u') user_query = select 'vmail' as uid, 'vmail' as gid iterate_query = select dovecot_username as user from get_users()

2 1

Re: fail2ban setup centos 7 not picking auth fail?
by Voytek Eymont 23 May '20

23 May '20

On Fri, May 22, 2020 2:05 pm, Adi Pircalabu wrote: > On 22-05-2020 10:38, Voytek Eymont wrote: > > Hardly a Dovecot issue. Can you please post the output of this command? > /usr/bin/fail2ban-regex /var/log/dovecot.log > /etc/fail2ban/filter.d/dovecot.conf Adi, thanks, what I get is: # /usr/bin/fail2ban-regex /var/log/dovecot.log /etc/fail2ban/filter.d/dovecot.conf Running tests ============= Use failregex filter file : dovecot, basedir: /etc/fail2ban Use datepattern : Default Detectors Use log file : /var/log/dovecot.log Use encoding : UTF-8 Results ======= Failregex: 5149 total |- #) [# of hits] regular expression | 2) [5149] ^(?:\[\])?\s*(?:<[^.]+\.[^.]+>\s+)?(?:\S+\s+)?(?:kernel:\s?\[ *\d+\.\d+\]:?\s+)?(?:@vserver_\S+\s+)?(?:(?:(?:\[\d+\])?:\s+[\[$]?\S*(?:\(\S+$)?[\]\)]?:?|[\[$]?\S*(?:\(\S+$)?[\]\)]?:?(?:\[\d+\])?:?)\s+)?(?:\[ID \d+ \S+\]\s+)?(?:pop3|imap)-login: (?:Info: )?(?:Aborted login|Disconnected)(?::(?: [^ $]+)+)? \((?:auth failed, \d+ attempts( in \d+ secs)?|tried to use (disabled|disallowed) \S+ auth)$:( user=<[^>]+>,)?( method=\S+,)? rip=<HOST>(?:, lip=\S+)?(?:, TLS(?: handshaking(?:: SSL_accept failed: error:[\dA-F]+:SSL routines:[TLS\d]+_GET_CLIENT_HELLO:unknown protocol)?)?(: Disconnected)?)?(, session=<\S+>)?\s*$ `- Ignoreregex: 0 total Date template hits: |- [# of hits] date format | [338975] {^LN-BEG}(?:DAY )?MON Day %k:Minute:Second(?:\.Microseconds)?(?: ExYear)? `- Lines: 338975 lines, 0 ignored, 5149 matched, 333826 missed [processed in 87.44 sec] Missed line(s): too many to print. Use --print-all-missed to print all 333826 lines

7 8

Sieve regexp matches wrong
by kverizhnikov 23 May '20

23 May '20

Hello! Recently I've faced with strange issue. So, I want to filter some mails which do not contain cyrillic symbols. I would not like receive email on foreign language except russian and I'm using rule below, but it does not work when text of mail has unicode symbol u2019 or ’ - right single quotation mark. |require ["body","regex"];| |# rule:[Regexp test]| |if not body :text :regex ".*[аАбБвВгГдДеЕёЁжЖзЗиИйЙкКлЛмМнНоОпПрРсСтТуУфФхХцЦчЧшШщЩъЪыЫьЬэЭюЮяЯ].*"| |{| | discard;| | stop;| |}| I checked this behavior on different versions of dovecot and pigeonhole, and it was the same in all cases. If I change u2019 to, for instance to apostrophe, it begins work as I expect - the mail discarded. Below some information which was got from sieve-test utility. The text consist of only one phrase *Test’test*. Check string *Test’test *- without u2019, using apostrophe root@a4e4b17d33a1:/srv/mail# tail -2 1586937347.M574837P24389.vps.kveri.ru\,S\=1904\,W\=1944\:2\,S Test'test sieve-test output * Script metadata (block: 0): class = file class.version = 0 location = /srv/mail/roundcube.sieve * Required extensions (block: 1): 0: body (id: 18) 1: regex (id: 13) * Main program (block: 2): Address Line Code 00000000: DEBUG BLOCK: 3 00000001: EXTENSIONS [2]: 00000002: body 00000004: regex 00000006: 3: BODY 00000007: BODY-TRANSFORM: TEXT 0000000b: match type: regex 0000000d: key list: STR[138] ".*[аАбБвВгГдДеЕёЁжЖзЗиИйЙкКлЛмМнНоОпПрРс... 0000009b: 3: JMPTRUE 6 [000000a2] 000000a0: 5: DISCARD 000000a1: 6: STOP 000000a2: 6: [End of code] Performed actions: * discard Implicit keep: (none) In this case the rule works as I expect The second test *Test’test* with ’ instead of apostrophe root@a4e4b17d33a1:/srv/mail# tail -2 1586937347.M574837P24389.vps.kveri.ru\,S\=1904\,W\=1944\:2\,S Test’test sieve-test output * Script metadata (block: 0): class = file class.version = 0 location = /srv/mail/roundcube.sieve * Required extensions (block: 1): 0: body (id: 18) 1: regex (id: 13) * Main program (block: 2): Address Line Code 00000000: DEBUG BLOCK: 3 00000001: EXTENSIONS [2]: 00000002: body 00000004: regex 00000006: 3: BODY 00000007: BODY-TRANSFORM: TEXT 0000000b: match type: regex 0000000d: key list: STR[138] ".*[аАбБвВгГдДеЕёЁжЖзЗиИйЙкКлЛмМнНоОпПрРс... 0000009b: 3: JMPTRUE 6 [000000a2] 000000a0: 5: DISCARD 000000a1: 6: STOP 000000a2: 6: [End of code] Performed actions: (none) Implicit keep: * store message in folder: INBOX In this case email "was located" into INBOX, but I expected it should be discarded. As I said this behavior does not depend on dovecot and pigeonhole version - I've tried dovecot 2.3.7, 2.2.30.x, 2.3.9.3 and 2.3.10, pigeonhole 0.5.7.2, 0.5.9 and 0.5.10, fresh install and working in docker container. The dovecot-sysreport was taken from the last one. What am I doing wrong? Is it pigeonhole bug or smth like that?

2 1

Convert standalone mbox to standalone Maildir with Dsync - hierarchy separator error
by Sam Kuper 23 May '20

23 May '20

Dear Dovecot users/devs, I have the following mbox file: /tmp/dsync_test/mbox/2002-September I would like to convert it to a Maildir: /tmp/dsync_test/maildir (Currently, the latter is just an empty directory.) I am attempting this on an old PC running Debian 9 ("Stretch"). I installed the dovecot-core package in order to make the `dsync` tool available on that PC. I have not otherwise done anything with Dovecot on that PC; for instance, I have not created or edited any Dovecot config files. `man dsync` gives the Dovecot version as 2.2. Inspired by the man page and the Dovecot wiki, here was my first attempt to perform the conversion. (I have added newlines between each line of the output, for readability.) $ dsync -Dv -o 'mail_location=maildir:/tmp/dsync_test/maildir' \ backup \ mbox:/tmp/dsync_test/mbox/:INBOX=/tmp/dsync_test/mbox/2002-September Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_lookup_dict_iterate_visible_next (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(sampablokuper): Debug: Effective uid=1000, gid=1000, home=/home/sampablokuper doveadm(sampablokuper): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/tmp/dsync_test/maildir doveadm(sampablokuper): Debug: maildir++: root=/tmp/dsync_test/maildir, index=, indexpvt=, control=, inbox=/tmp/dsync_test/maildir, alt= doveadm(sampablokuper): Debug: Namespace : Using permissions from /tmp/dsync_test/maildir: mode=0755 gid=default dsync(sampablokuper): Debug: Effective uid=1000, gid=1000, home=/home/sampablokuper dsync(sampablokuper): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/tmp/dsync_test/mbox/:INBOX=/tmp/dsync_test/mbox/2002-September dsync(sampablokuper): Debug: fs: root=/tmp/dsync_test/mbox, index=, indexpvt=, control=, inbox=/tmp/dsync_test/mbox/2002-September, alt= dsync(sampablokuper): Error: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) As you can see, it ends with "Error: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace)". So, I tried specifying a hierarchy separator, but this failed too: $ dsync -Dv \ -o 'separator=.' \ -o 'mail_location=maildir:/tmp/dsync_test/maildir' \ backup \ mbox:/tmp/dsync_test/mbox/:INBOX=/tmp/dsync_test/mbox/2002-September Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_lookup_dict_iterate_visible_next (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(sampablokuper): Debug: Effective uid=1000, gid=1000, home=/home/sampablokuper doveadm(sampablokuper): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/tmp/dsync_test/maildir doveadm(sampablokuper): Debug: maildir++: root=/tmp/dsync_test/maildir, index=, indexpvt=, control=, inbox=/tmp/dsync_test/maildir, alt= doveadm(sampablokuper): Debug: Namespace : Using permissions from /tmp/dsync_test/maildir: mode=0755 gid=default dsync(sampablokuper): Debug: Effective uid=1000, gid=1000, home=/home/sampablokuper dsync(sampablokuper): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/tmp/dsync_test/mbox/:INBOX=/tmp/dsync_test/mbox/2002-September dsync(sampablokuper): Debug: fs: root=/tmp/dsync_test/mbox, index=, indexpvt=, control=, inbox=/tmp/dsync_test/mbox/2002-September, alt= dsync(sampablokuper): Error: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) I got the same error again when I tried the command above with "/" instead of "." as the hierarchy separator. Forgive me for my ignorance, but how should I correct the invocation I used above? In other words: using dsync, how can I extract/copy the emails from the mbox to the new Maildir? Thank you! -- A: When it messes up the order in which people normally read text. Q: When is top-posting a bad thing? () ASCII ribbon campaign. Please avoid HTML emails & proprietary /\ file formats. (Why? See e.g. https://v.gd/jrmGbS ). Thank you.

2 3

What causes mails to get striked-over only, and not deleted?
by Sebastian Nielsen 23 May '20

23 May '20

I have tried with this sieve config: imapsieve_mailbox1_name = Sent imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_after = file:/etc/dovecot/sieve/sent.sieve and this sieve file (sent.sieve): discard; This should clearly cause the mail to be deleted right? But whats happen, is that the mail is not deleted, its just marked for deletion (gets a strike-through in Microsoft Outlook). (have tried with _before too, but it wont help). What can I do to ensure the mail actually gets deleted (completely, not moved to trash) and not just flagged for deletion?

3 3

dsync “destination” argument
by Felipe Gasper 22 May '20

22 May '20

Hello, Some code that I didn’t write but am maintaining passes a local script’s path as dsync’s “destination” argument, like so: dsync -D -u john -v backup -R -1 "/code/dsync_client.pl" 127.0.0.1 john(a)mydomain.org dsync_client.pl establishes a TCP connection with a remote dsync process then acts as a proxy between the two dsync processes. “127.0.0.1” and “john(a)mydomain.xn--org-9o0a are given as arguments to dsync_client.pl. I don’t see this usage described in dsync’s man page. I just want to be sure: is this a supported use of dsync? Thank you! cheers, -Felipe Gasper

2 3

fail2ban setup centos 7 not picking auth fail?
by Voytek Eymont 22 May '20

22 May '20

I'm trying to set up fail2ban with dovecot, I have it working on 'old' server Centos 6, but, not getting anywhere with 'new' server on Centos 7 using standard filters I've copied same 'filter' to new server, still get nothing any idea how to figure this out ? on old server, it logs to syslog/messages CentOS release 6.10 (Final) dovecot 2.3.10.1 (a3d0e1171) old # fail2ban-client status dovecot Status for the jail: dovecot |- Filter | |- Currently failed: 2 | |- Total failed: 168 | `- File list: /var/log/dovecot.log `- Actions |- Currently banned: 0 |- Total banned: 32 `- Banned IP list: on new server CentOS Linux release 7.8.2003 dovecot 2.3.10.1 (a3d0e1171) nothing shows up in fail2ban log (ssh, postfix does, only no dovecot) I've copied the actual /etc/fail2ban/filter.d/dovecot.conf from old server, still nothing not sure where/how to look is there a standard/approved doveot filter..? cat jail.local ... [dovecot] enabled = true filter = dovecot logpath = /var/log/dovecot.log maxretry = 3 ignoreip = 127.0.0.1 127.0.0.0/8 ... # fail2ban-client status dovecot Status for the jail: dovecot |- Filter | |- Currently failed: 0 | |- Total failed: 0 | `- Journal matches: _SYSTEMD_UNIT=dovecot.service `- Actions |- Currently banned: 0 |- Total banned: 0 `- Banned IP list: # grep 'auth failed' /var/log/dovecot.log | wc 7669 149916 1558909 # cat dovecot.conf # Fail2Ban filter Dovecot authentication and pop3/imap server # [INCLUDES] before = common.conf [Definition] _daemon = (auth|dovecot(-auth)?|auth-worker) failregex = ^%(__prefix_line)s(?:%(__pam_auth)s(?:$dovecot:auth$)?:)?\s+authentication failure; logname=\S* uid=\S* euid=\S* tty=dovecot ruser=\S* rhost=<HOST>(?:\s+user=\S*)?\s*$ ^%(__prefix_line)s(?:pop3|imap)-login: (?:Info: )?(?:Aborted login|Disconnected)(?::(?: [^ $]+)+)? \((?:auth failed, \d+ attempts( in \d+ secs)?|tried to use (disabled|disallowed) \S+ auth)$:( user=<[^>]+>,)?( method=\S+,)? rip=<HOST>(?:, lip=\S+)?(?:, TLS(?: handshaking(?:: SSL_accept failed: error:[\dA-F]+:SSL routines:[TLS\d]+_GET_CLIENT_HELLO:unknown protocol)?)?(: Disconnected)?)?(, session=<\S+>)?\s*$ ^%(__prefix_line)s(?:Info|dovecot: auth$default$|auth-worker$\d+$): pam$\S+,<HOST>$: pam_authenticate failed: (User not known to the underlying authentication module: \d+ Time$s$|Authentication failure $password mismatch\?$)\s*$ ^%(__prefix_line)s(?:auth|auth-worker$\d+$): (?:pam|passwd-file)$\S+,<HOST>$: unknown user\s*$ ^%(__prefix_line)s(?:auth|auth-worker$\d+$): Info: ldap$\S*,<HOST>,\S*$: invalid credentials\s*$ ignoreregex = [Init] journalmatch = _SYSTEMD_UNIT=dovecot.service # DEV Notes: # * the first regex is essentially a copy of pam-generic.conf # * Probably doesn't do dovecot sql/ldap backends properly (resolved in edit 21/03/2016) # * Removed the 'no auth attempts' log lines from the matches because produces # lots of false positives on misconfigured MTAs making regexp unusable # # Author: Martin Waschbuesch # Daniel Black (rewrote with begin and end anchors) # Martin O'Neal (added LDAP authentication failure regex) # Sergey G. Brester aka sebres (reviewed, optimized, IPv6-compatibility)

2 1

pass a block of parameters to doveadm
by dovecot-user 21 May '20

21 May '20

Hello everyone. Please tell me how to override the configuration file options when using the doveadm utility with the -o switch in case I need to pass a block of parameters, for example, like this: passdb { args = scheme=PLAIN username_format=%u /path/to/file driver = passwd-file } Thanks.

2 1

v2.3.10.1 released
by Aki Tuomi 21 May '20

21 May '20

We are pleased to release v2.3.10.1 Please find it from locations below: https://dovecot.org/releases/2.3/dovecot-2.3.10.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.10.1.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot Aki Tuomi Open-Xchange oy --- - CVE-2020-10957: lmtp/submission: A client can crash the server by sending a NOOP command with an invalid string parameter. This occurs particularly for a parameter that doesn't start with a double quote. This applies to all SMTP services, including submission-login, which makes it possible to crash the submission service without authentication. - CVE-2020-10958: lmtp/submission: Sending many invalid or unknown commands can cause the server to access freed memory, which can lead to a server crash. This happens when the server closes the connection with a "421 Too many invalid commands" error. The bad command limit depends on the service (lmtp or submission) and varies between 10 to 20 bad commands. - CVE-2020-10967: lmtp/submission: Issuing the RCPT command with an address that has the empty quoted string as local-part causes the lmtp service to crash.

3 2

FTS-lucene errors : language not available for stemming
by David Gessel 21 May '20

21 May '20

I'm getting some log errors with clucene that I am having no luck tracking down on the interwebs. Errors: May 19 05:05:16 indexer-worker(gessel(a)blackrosetech.com)<62971><aPAEI3zLw17A/QAA0J78UA:EF25M3zLw1779QAA0J78UA>: Error: lucene index /mail/blackrosetech.com/gessel//lucene-indexes: IndexWriter::addDocument() failed (#4): language not available for stemming May 19 05:05:16 indexer-worker: Error: May 19 05:05:16 indexer-worker(gessel(a)blackrosetech.com)<62971><aPAEI3zLw17A/QAA0J78UA:EF25M3zLw1779QAA0J78UA>: Error: Mailbox Security: Mail search failed: Internal error occurred. Refer to server log for more information. [2020-05-19 05:05:16] May 19 05:05:16 indexer-worker(gessel(a)blackrosetech.com)<62971><aPAEI3zLw17A/QAA0J78UA:EF25M3zLw1779QAA0J78UA>: Error: Mailbox Security: Transaction commit failed: FTS transaction commit failed: transaction context (attempted to index 1 messages (UIDs 152736..152736)) Config: FreeBSD 11.3-RELEASE-p8 #0 r360490 dovecot-2.3.10_3 clucene-2.3.3.4_19 py37-pystemmer-2.0.0.1 py37-snowballstemmer-1.2.1 icu-67.1,1 plugin { #setting_name = value expire = Trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size fts_autoindex=yes #zlib_save_level = 6 # 1..9 #zlib_save = gz # or bz2 } plugin { fts = lucene # Lucene-specific settings, good ones are: fts_lucene = whitespace_chars=@. mime_parts } I am considering switch to xapian (solr and java... pls noe) as the port is quite tempting from an ease of integration perspective, but the easiest solution would be to resolve these odd indexing errors. Anyone have a clue? -David

6 11

dsync multiple mailboxes per connection?
by Felipe Gasper 21 May '20

21 May '20

Hello, Is it possible to batch syncs of multiple mailboxes in a single dsync session? We’re transferring users between servers and want to use dsync to transfer the mail; ideally we’d like to avoid creating a separate TCP connection per user. Thank you! cheers, -Felipe Gasper

3 2

how to automatically delete folders from Trash after x days
by chayes＠afo.net 20 May '20

20 May '20

This works great for keeping the Trash from overflowing ... doveadm expunge -A mailbox Trash before 30d ... but it doesn't delete folders that the user put in the trash. What is the recommended method for erasing folders from the trash?

2 1

question about director_mail_servers setting
by Joe Wong 20 May '20

20 May '20

Hello, I have a question about director_mail_servers setting for director, I am aware that I can define a list of dovecot backend hostname there but I am not sure if the hashing apply to the hostname or underlying IP address of each hostname given? What if the IP of a specify hostname is changed? Will director pickup the new IP automatically? Will the same user hashed into the original IP still be mapped back to the new IP in this case? - Joe

1 0

Problem with tika
by Arjen Heidinga 19 May '20

19 May '20

Hello all, For some time now we've bin using solr as a search engine (working great). I have added tika for searching inside documents, however it keeps crashing when indexing. When just indexing mails that arrive works good, but a reindex on all mail constantly crashes with below stacktrace. When I observe the packets with wireshark I see a HTTP-flow going to tika and suddenly, midway a document dovecot (or the server) sends a RST. Sometimes after thousands of documents, sometimes after a few. Usually after a few hundred. It appears there are less errors using http than https. Relevant config: OS: CentOS6, fully updated plugin { fts = solr batch_size = 1 fts_solr = url=https://username:password@solr-01.vevida.net:443/solr/dovecot/ #fts_tika = https://solr-01.vevida.net:443/tika/ batch_size = 1000 fts_autoindex=yes soft_commit=no } # dovecot --version 2.3.9.3 (9f41b88fa) # Configure options: --docdir=%{_docdir}/dovecot \ --disable-static \ --with-nss \ --with-shadow \ --with-pam \ --with-gssapi=plugin \ --with-ldap=plugin \ --with-sql=plugin \ --with-pgsql \ --with-sqlite \ --with-zlib \ --with-bzlib \ --with-lzma \ --with-libcap \ --with-ssl=openssl \ --with-ssldir=%{ssldir} \ --with-solr \ --with-docs # It is compiled agains the latest openssl # Tika and Solr: Both latest versions. #Stacktrace: doveadm(info(a)samenmetrenske.nl): Info: Sent: Caching mails seq=1..161 doveadm(info(a)samenmetrenske.nl): Panic: file http-client-request.c: line 1173 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) doveadm(info(a)xxxxxxxxxxxxxxxxxxx.x): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x2f) [0x7f95d805acbf] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x26) [0x7f95d805add6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe90ba) [0x7f95d80660ba] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe9161) [0x7f95d8066161] -> /usr/lib64/dovecot/libdovecot.so.0(+0x41158) [0x7f95d7fbe158] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_more+0x424) [0x7f95d8005094] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_connection_output+0x11a) [0x7f95d800a24a] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x8f6a) [0x7f95d57a2f6a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x114483) [0x7f95d8091483] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x61) [0x7f95d807e581] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc) [0x7f95d808076c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c) [0x7f95d807e67c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f95d807e8c8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x89105) [0x7f95d8006105] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_payload+0x1f) [0x7f95d80063cf] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd31d) [0x7f95d6ad931d] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_parser_more+0x1a) [0x7f95d6ad83ca] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x761) [0x7f95d6ad6401] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x114ca) [0x7f95d6add4ca] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_precache+0x2a) [0x7f95d835ab4a] -> doveadm(+0x31e75) [0x55e7c1052e75] -> doveadm(+0x321fb) [0x55e7c10531fb] -> doveadm(+0x2c321) [0x55e7c104d321] -> doveadm(+0x2c577) [0x55e7c104d577] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x1e8) [0x55e7c104ec38] -> doveadm(doveadm_cmd_run_ver2+0x52e) [0x55e7c105fafe] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x55e7c105fb97] -> doveadm(main+0x21a) [0x55e7c1062aca] -> /lib64/libc.so.6(__libc_start_main+0x100) [0x7f95d7983d20] -> doveadm(+0x1c479) [0x55e7c103d479]

1 1