May 2020 - dovecot - dovecot.org

service doveadm - how to debug proxying with director
by patosec 28 May '20

28 May '20

Hello everyone, I'm on a small dovecot director -> dovecot mailbox setup and I try to get doveadm command proxying to work. Though I don't get the expected output. My directors do not forward the doveadm commands to the expected backend host. Doveadm is working as expected on the backend hosts, the director hosts just dont log anything about the proxying that should happen or anything else about the doveadm commands at all. Can someone guide me in a direction on what to try next or maybe got a working config regarding doveadm proxying? Thanks in advance! Some technical data regarding my problem: Dovecot Version: 2.3.10 (0da0eff44) Output of a 'doveadm director status' command: mail server ip tag vhosts state state changed users 10.0.0.81 tag1 100 up - 0 10.0.0.82 tag1 100 up - 1 Output of a 'doveadm director ring status' command: director ip port type last failed status ping ms input output buffered buffered peak last read last write 10.0.0.193 9090 self never ring synced 5 - - - - - - 10.0.0.194 9090 right never synced 0 2051 6400 0 757 2020-05-28 09:56:37 2020-05-28 09:56:37 10.0.0.195 9090 left never synced 0 4929 1804 0 37 2020-05-28 09:56:37 2020-05-28 09:56:37 This is my dovecot-director hosts configuration (doveadm related part): service doveadm { inet_listener { # any port you want to use for this: port = 24245 } } local 0.0.0.0 { # password to use for client authentication doveadm_password = secret # allow client to only use specified list of commands (default is all): #doveadm_allowed_commands = } # same port as doveadm's inet_listener doveadm_port = 24245 protocol doveadm { # NOTE: director-userdb socket is actually used only for passdb lookups, not userdb lookups auth_socket_path = director-userdb } And here the dovecot-backend hosts configuration (doveadm related part): ### director conf service doveadm { inet_listener { # any port you want to use for this: port = 24245 } } local 0.0.0.0 { # password to use for client authentication doveadm_password = secret # allow client to only use specified list of commands (default is all): #doveadm_allowed_commands = } A 'doveadm user -u test(a)test.com' command on the backend host: userdb: test(a)test.com user : test(a)test.com home : /var/spool/imap/test(a)test.com quota : maildir:User quota quota_rule: *:storage=1048576:messages=153000 A 'doveadm user -u test(a)test.com' command on the director host: userdb: test(a)test.com user : test(a)test.com

2 3

Determinant of umask for sieve_pipe_bin_dir scripts?
by Laura Smith 27 May '20

27 May '20

Hi, What determines the umask of sieve_pipe_bin_dir scripts ? The results from my script are always being set to 0600. My script is simple and shown below, even if I adjust the right line to add " && chmod 644", the actual resulting file still remains at 0600 ?!? #!/bin/bash # Usage: imapsieve_copy <email> <spam|ham> MSG_USER="$1" MSG_TYPE="$2" RUN_UUID=$(cat /proc/sys/kernel/random/uuid) BASE_DIR="/foo/bar" TARGET_DIR="${BASE_DIR}/${MSG_TYPE}" TARGET_FILE="${TARGET_DIR}/${RUN_UUID}" cat > "${TARGET_FILE}" < /dev/stdin && pigz -9 "${TARGET_FILE}"

2 2

How to make IMAPS SSL Cert for Dovecot that works with Thunderbird
by hanasaki＠gmail.com 27 May '20

27 May '20

Hello all, What are the instructions for making an SSL cert for Dovecot IMAPS? Two methods have been tried, and work, with Evolution; however generate the following error when Thunderbird tries to connect. Thank you, method 1 : self signed openssl req -newkey rsa:4096 -sha512 -x509 -days 365 -nodes -keyout mykey.key -out mycert.pem method 2 : Let's Encrypt (LE) CA Created with Certbot ERROR TLS handshaking: SSL_accept() failed: error:14094412:SSL routines:ssl3_read_bytes:sslv3 alert bad certificate: SSL alert number 42, session=<+oooooo>

5 10

doveadm: extra lines?
by Felipe Gasper 27 May '20

27 May '20

Hello, I’m sending doveadm “kick” commands to doveadm-server via the doveadm protocol. When “kick” sends back a NOTFOUND error, though, it’s sending back additional output. strace shows: write(3<UNIX:[3158354->3156665]>, "\t\tkick\tmyssltest\n", 17) = 17 ... read(3<UNIX:[3158354->3156665]>, "\n-NOTFOUND\n\n-\n", 8192) = 14 Going by the protocol documentation (https://wiki2.dovecot.org/Design/DoveadmProtocol) there appear to be 3 extra bytes at the end of the server’s response: "\n-\n". Is this a bug in doveadm-server? Or am I misreading the protocol documentation? Thank you! cheers, -Felipe Gasper

1 2

Panic: assert opcode == HASH_TABLE_OP_UPDATE during replication (dsync-local)
by Alexey 26 May '20

26 May '20

Hello. I got an error and have no idea how to fix it, or workaround it. dsync-local(mymail(a)mymail.org)<PR2hBB86zV52SQAACjx0Gw>: Panic: file hash.c: line 251 (hash_table_insert_node): assertion failed: (opcode == HASH_TABLE_OP_UPDATE) dsync-local(mymail(a)mymail.org)<PR2hBB86zV52SQAACjx0Gw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x3d) [0x7fd8acd5d15d] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7fd8acd5d27e] -> /usr/lib/dovecot/libdovecot.so.0(+0xec88b) [0x7fd8acd6688b] -> /usr/lib/dovecot/libdovecot.so.0(+0xec8c1) [0x7fd8acd668c1] -> /usr/lib/dovecot/libdovecot.so.0(+0x4ec56) [0x7fd8accc8c56] -> /usr/lib/dovecot/libdovecot.so.0(+0x4f9b3) [0x7fd8accc99b3] -> doveadm(dsync_mailbox_tree_find_delete+0x1b2) [0x5567056b7aa2] -> doveadm(+0x4a265) [0x5567056ad265] -> doveadm(dsync_brain_recv_mailbox_tree_deletes+0xc8) [0x5567056aded8] -> doveadm(dsync_brain_run+0x1ae) [0x5567056aaa9e] -> doveadm(+0x48104) [0x5567056ab104] -> doveadm(+0x58d1f) [0x5567056bbd1f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fd8acd7cb79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x131) [0x7fd8acd7e0c1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7fd8acd7cc1c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fd8acd7cd90] -> doveadm(+0x2e9f4) [0x5567056919f4] -> doveadm(+0x30b16) [0x556705693b16] -> doveadm(+0x3170a) [0x55670569470a] -> doveadm(doveadm_mail_try_run+0x21e) [0x556705694ffe] -> doveadm(main+0x552) [0x5567056851b2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7fd8ac90109b] -> doveadm(_start+0x2a) [0x5567056852fa] This is output of manual run doveadm sync process between dovecot 2.3.10.1 (side with error message) and dovecot 2.3.7.2 (remote side). I have `require ["fileinto"];` on both sides in .dovecot.sieve files. Regards, Alukardd.

1 0

Avoiding logging password when dict lookup fails
by Geo Mander 26 May '20

26 May '20

I've made a unix-socket auth setup, by looking at the examples here: https://doc.dovecot.org/configuration_manual/authentication/dict/#complete-… I need to ship the plain password to the socket as well, so i have simply added %w to the lookup key, like so: key = passdb/U=%u P=%w My problem is, that if the socket connection is down for whatever reason, dovecot will write the entire message above - including the plaintext password - into the logfile. --- May 25 11:17:48 imap-1 dovecot: auth-worker(32690): Error: dict-client: Lookup 'shared/passdb/U=john.doe(a)example.com P=john123 failed: net_connect_unix(/var/run/dovecot/doveauthdsocket) failed: Connection refused (reply took 0.000 secs (0.000 in dict wait, 0.000 in other ioloops, 0.000 in locks)) May 25 11:17:48 imap-1 dovecot: auth-worker(32690): Error: dict( john.doe(a)example.com,8.8.4.4,<Px/Ic3WmsNhb7s1N>): Failed to lookup key shared/passdb/U=john.doe(a)example.com P=john123 -- Can i disable dict client logging? Or can i structure my dict request in a different way to avoid this logging, while still getting the complete user-name and plaintext password shipped over the socket? $ dovecot --version 2.2.36 (1f10bfa63)

1 0

child killed by signal 6
by Peter Nabbefeld 26 May '20

26 May '20

Hello, from time to time I keep getting problems with some emails causing signal 6. I've already reported those, but it seems not to be easy to find the cause. From the logs, it seems to occur in sieve implementation. I've checked the email envelopes tody by accident, probably this part of my telnet session might help: a11 fetch 1 all * 1 FETCH (RFC822.SIZE 16750 INTERNALDATE "22-May-2020 05:02:34 +0000" ENVELOPE ("Fri, 22 May 2020 03:46:54 +0000" "RE: Http2 tomact server taking time in responding when 1st StreamId is a large integer value like 2147483641" (("Prateek Kohli" NIL "prateek.kohli" "ericsson.com.INVALID")) (("Prateek Kohli" NIL "prateek.kohli" "ericsson.com.INVALID")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) NIL NIL "<d778507f-306b-5395-b583-fc1f2651431d(a)apache.org>" " <DB7PR07MB40285E61F0731810A615E3FB92B40(a)DB7PR07MB4028.eurprd07.prod.outlook.com>") FLAGS (\Seen)) a11 OK FETCH completed a12 fetch 2 all * 2 FETCH (RFC822.SIZE 21146 INTERNALDATE "22-May-2020 06:39:54 +0000" ENVELOPE ("Fri, 22 May 2020 06:39:35 +0000" "RE: RST on TCP level sent by Tomcat" (("Arshiya Shariff" NIL "arshiya.shariff" "ericsson.com.INVALID")) (("Arshiya Shariff" NIL "arshiya.shariff" "ericsson.com.INVALID")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) (("Tomcat Users List" NIL "users" "tomcat.apache.org")) (("markt(a)apache.org" NIL "markt" "apache.org")("M Venkata Pratap M" NIL "m.m.venkata.pratap" "ericsson.com")) NIL " <AM7PR07MB6561761FA78F23F5AAF398399FB70(a)AM7PR07MB6561.eurprd07.prod.outlook.com>" " <AM7PR07MB65615CD03F422AC8D8384FC09FB40(a)AM7PR07MB6561.eurprd07.prod.outlook.com>") FLAGS ()) a12 OK FETCH completed The first message causes signal 6, the second does not. Probably the problem is killed by the two consecutive "NIL"s? I'm not an experienced administrator, only managing my private computer, so I don't know the meaning of every envelope field. But might these two "NIL"s cause the abort? BTW, to download all messages from my IMAP account to my private dovecot instance I had to delete the first message, since I couldn't download any other messages from the IMAP folder otherwise. Kind regards Peter

3 4

Sieve test string and case sensitivity
by Kim Minh Kaplan 25 May '20

25 May '20

Hello, I have found that Pigeonhole comes with an extensive testsuite against the Sieve RFCs. As I am working on a personal Sieve project I decided to run my tool on this testsuite and it stumbled on "Basic assignment: string test failed"[1]. Pigeonhole defaults to comparator "i;octet"[2] for the string test. But Sieve says that the default comparator should be "i;ascii-casemap"[3]. Did I miss some other part of the standard? Can you point me in the right direction? Thank you, Kim Minh. [1]: https://github.com/dovecot/pigeonhole/blob/master/tests/extensions/variable… [2]: https://github.com/dovecot/pigeonhole/blob/master/src/lib-sieve/plugins/var… [3]: https://tools.ietf.org/html/rfc5228#section-2.7.3

2 1

Sieve addheader directive works only partially
by Peter Folta 25 May '20

25 May '20

Hi all, I want to add a custom header to incoming emails from a particular sender. This is what my user Sieve script looks like: require “editheader”; if address :is "From” “special-sender(a)example.xn--com-9o0a { addheader “X-My-Custom-Header” “Header Value"; } I have enabled the editheader extension in my Dovecot configuration: plugin { … sieve_extensions = +editheader } This doesn’t seem to work and no header is added to the email. However, if I also move the email to a different folder in the same if-block, the header gets added just fine: require “editheader”; require “fileinto”; if address :is "From” “special-sender(a)example.xn--com-9o0a { addheader “X-My-Custom-Header” “Header Value”; fileinto “MyFolder”; } Am I missing something? Thanks Peter

4 6

missing man page for “doveadm dsync-server”?
by Felipe Gasper 25 May '20

25 May '20

Hello, Is there a man page for this command? I don’t see one in the repository. Given its utility in, e.g., syncing mailboxes via SSH, it seems like documentation for this command would be useful? Thank you! -Felipe Gasper

3 3