- dovecot - dovecot.org

error while compiling dovecot
by Rajesh M 15 Aug '18

15 Aug '18

hello my server is centos 6 64 bit while installing dovecot i get this error Failed to run: ./test-compression what could be the reason. could someone guide me please Version dovecot-ce-2.3.0-1 0 / 7 tests failed ==21130== Conditional jump or move depends on uninitialised value(s) ==21130== at 0x349B00ACB2: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B00AEA9: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B003121: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B0061A0: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B005212: lzma_easy_encoder (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x406ACF: o_stream_create_lzma (ostream-lzma.c:206) ==21130== by 0x403D89: test_compression_handler (test-compression.c:36) ==21130== by 0x4040BD: test_compression (test-compression.c:96) ==21130== by 0x408281: test_run_funcs (test-common.c:244) ==21130== by 0x4083E0: test_run (test-common.c:315) ==21130== by 0x40398B: main (test-compression.c:308) ==21130== Failed to run: ./test-compression make[3]: *** [check-local] Error 1 make[3]: Leaving directory `/root/rpmbuild/BUILD/dovecot-ce-2.3.0/src/lib-compression' make[2]: *** [check-am] Error 2 make[2]: Leaving directory `/root/rpmbuild/BUILD/dovecot-ce-2.3.0/src/lib-compression' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/root/rpmbuild/BUILD/dovecot-ce-2.3.0/src' make: *** [check-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.LCwYD9 (%check) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.LCwYD9 (%check) thanks, rajesh

2 1

Confusing search / caps - non caps different results
by Götz Reinicke 15 Aug '18

15 Aug '18

Hi, I have some troubles with searching and could not find an answer yet. The search term is „istop“ in the subject. The client was SOGo. We run the recent dovecot, with solr backend and milder with zlib compression. Searching for all small letters „istop“ shows up no hit. Searching with a capital „S“ „iStop“ shows all messages back 10 years ago. Sprachig for „istopmotion“ all messages show up, wether the subject contains caps or non caps at all. I did a telnet to our dovecot and searched by hand for all three terms: 8 search Subject istop * SEARCH 8 OK Search completed (0.025 + 0.000 + 0.022 secs). 9 search subject iStop * SEARCH 544 604 654 662 910 1394 1471 1474 5493 9 OK Search completed (0.028 + 0.000 + 0.023 secs). 10 search subject istopmotion * SEARCH 544 604 654 662 910 1471 1472 1474 5493 10 OK Search completed (0.027 + 0.000 + 0.023 secs). Any hints or suggestion is welcome as I m very confused and lost. Thanks and regards . Götz

1 0

Re: doveadm mailbox delete not working
by Ralf Becker 15 Aug '18

15 Aug '18

Hi Aki, thanks for looking into this :) Am 14.08.18 um 15:15 schrieb Aki Tuomi: > can you turn on mail_debug=yes and run doveadm -Dv mailbox delete and > provide output and logs from both servers? root@ka-nfs-mail:~# doveadm -Dv mailbox delete -u h 'INBOX/Fachbereiche ' Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<username>): Debug: auth PASS input: doveadm(<username> 32679): Debug: auth USER input: <username> userdb_quota_rule=*:bytes=15728640000 master_user=<username> userdb_acl_groups=koakram@<domain>,wahlkampfnetzwerk@<domain>,wahlkalender 2017@<domain>,lgs@<domain> home=/var/dovecot/imap/<domain>/<user> doveadm(<username> 32679): Debug: Added userdb setting: plugin/master_user=<username> doveadm(<username> 32679): Debug: Added userdb setting: plugin/userdb_acl_groups=koakram@<domain>,wahlkampfnetzwerk@<domain>,wahlkalender 2017@<domain>,lgs@<domain> doveadm(<username> 32679): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=15728640000 doveadm(<username>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<username>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<username>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<username>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<username>): Debug: dict quota: user=<username>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<username>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<username>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 0 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<username>): Debug: INBOX/Fachbereiche : Mailbox opened because: mailbox delete doveadm(<username>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/Fachbereiche /dbox-Mails/dovecot-acl not found doveadm(<username>): Debug: Namespace INBOX/: Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<username>): Debug: replication: Replication requested by 'mailbox delete', priority=1 doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche Output and logs are from the (less loaded) standby/backup node. I can get the logs from the active node tonight. I had to remove some folder-names for privacy reasons, but they all have the same output in the logs. Ralf > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Ralf Becker <rb(a)egroupware.org> > Date: 14/08/2018 16:13 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: doveadm mailbox delete not working > > I have a user who has several folders in his mailbox, which we can not > delete, neither via IMAP nor via doveadm: > > root@ka-nfs-mail:~# doveadm mailbox list -u <username> | grep hbereiche > | cat -v > INBOX/[Fachbereiche ^M > INBOX/Fachbereiche ^M > INBOX/hbereiche^M > INBOX/hbereiche/LAGen]^M > INBOX/hbereiche/LAG^M > INBOX/[Fachbereiche^M > INBOX/[Fachbereiche/LAGen]^M > INBOX/[Fachbereiche]^M > INBOX/[Fachbereiche]/LAGen]^M > INBOX/[Fachbereiche]/LAGe^M > root@ka-nfs-mail:~# doveadm mailbox delete -u <username> > 'INBOX/Fachbereiche ' > doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche > root@ka-nfs-mail:~# doveadm mailbox list -u <username>| grep hbereiche | > cat -v > INBOX/[Fachbereiche ^M > INBOX/Fachbereiche ^M > INBOX/hbereiche^M > INBOX/hbereiche/LAGen]^M > INBOX/hbereiche/LAG^M > INBOX/[Fachbereiche^M > INBOX/[Fachbereiche/LAGen]^M > INBOX/[Fachbereiche]^M > INBOX/[Fachbereiche]/LAGen]^M > INBOX/[Fachbereiche]/LAGe^M > > As far as I tried none of these folders can be deleted (I added single > quotes for trailing space and tried to delete subfolders first). > > Mailbox is in mdbox format on a replication pair under Dovecot 2.2.36 > and I tried both nodes of the replication with same result. > > Any ideas? > > Ralf > > -- > Ralf Becker > EGroupware GmbH [www.egroupware.org] > Handelsregister HRB Kaiserslautern 3587 > Geschäftsführer Birgit und Ralf Becker > Leibnizstr. 17, 67663 Kaiserslautern, Germany > Telefon +49 631 31657-0 > > -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

3 7

Re: doveadm mailbox delete not working
by Ralf Becker 15 Aug '18

15 Aug '18

Hi Aki, Am 15.08.18 um 11:31 schrieb Aki Tuomi: > Such fun folders. Can you try doveadm -Dv mailbox delete -u username > folder and post it to the list? root@ka-nfs-mail:~# doveadm -Dv mailbox delete -u <username> 'INBOX/Fachbereiche ' Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<username> 46922): Debug: Added userdb setting: plugin/master_user=<username> doveadm(<username> 46922): Debug: Added userdb setting: plugin/userdb_acl_groups=koakram@<domain>,wahlkampfnetzwerk@<domain>,wahlkalender 2017@<domain>,lgs@<domain> doveadm(<username> 46922): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=15728640000 doveadm(<username>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<username>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<username>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<username>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<username>): Debug: dict quota: user=<username>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<username>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<username>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 0 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<username>): Debug: INBOX/Fachbereiche : Mailbox opened because: mailbox delete doveadm(<username>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/Fachbereiche /dbox-Mails/dovecot-acl not found doveadm(<username>): Debug: Namespace INBOX/: Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<username>): Debug: replication: Replication requested by 'mailbox delete', priority=1 doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche Event doveadm reporting the folder is deleted, it is not: root@ka-nfs-mail:~# doveadm mailbox list -u <username> 'INBOX/Fachbereiche ' INBOX/Fachbereiche But it can not get a status of it: root@ka-nfs-mail:~# doveadm mailbox status -u <username> all 'INBOX/Fachbereiche ' doveadm(<username>): Error: Mailbox INBOX/Fachbereiche : Failed to lookup mailbox status: Mailbox doesn't exist: INBOX/Fachbereiche Really wired Ralf > Aki > > On 15.08.2018 11:03, Ralf Becker wrote: >> Hi Aki, >> >> I respond to you only on purpose, as the a dont want to show all folders >> public, please remove them when you reply to the list. >> >> This is the folder my previous examples where about: >> >> "mailbox": "INBOX/[Fachbereiche " <-- trailing space >> >> >> Am 15.08.18 um 08:33 schrieb Aki Tuomi: >>> Can you try >>> >>> doveadm -fjson mailbox list -u user INBOX/* -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

1 0

Recommendations for backup methods
by Daniel Miller 14 Aug '18

14 Aug '18

I've been re-thinking my backup strategy - I wanted to see what input others have. At this time - I'm using sdbox as the primary storage format and running on a single server. Previously, all my backups were simple filesystem backups. Either inotify-based or cron-based. The whole mail folder structure would then be copied to a remote storage site. I've changed services - I now use OpenDrive for the remote storage and can access the remote drive as a mounted folder via WebDAV. I also now use a cron-based series of restic jobs for the backup processing. Because I have some large folders - both personal & business letters going back quite some time as well as mailing list archives - some mail folders can be quite sizable. Now I'm wondering, between sdbox's support for alternate locations and the ability to use different storage formats via namespaces - perhaps I should setup archive folders that are stored differently to improve backup performance. Maybe maildir or even mbox for the archive folders - I create one per year? Any comments? Experiences? -- Daniel

2 1

Move messages with doveadm recursively.
by Хлебалов Степан 14 Aug '18

14 Aug '18

Hello. I can move messages with doveadm like this: doveadm move -A Archive mailbox INBOX/* before 2018-02-01 but if inbox has a subfolders then subfolders structure does not move to Archive only messages. Is there a way to move messages to the same folder in new destination? Thanks.

2 1

"For end user, only PGP or similar provides sufficient security against admin." (was: [trees-plugin] - Dovecot index gets corrupted,^M when using maildir and recievend and accessing mail at the same time)
by Steffen Kaiser 13 Aug '18

13 Aug '18

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, 11 Aug 2018, Aki Tuomi wrote: > While this is true, it can be useful to encrypt messages in-rest at 3rd party storage. > For end user, only PGP or similar provides sufficient security against admin. Nice, short, pinpointed words I will file away for upcoming discussions. And I will file M's response, too, for the management. Thanks both of you. > -------- Original message --------From: "M. Balridge" <dovecot(a)r.paypc.com> Date: 11/08/2018 13:56 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Re: [trees-plugin] - Dovecot index gets corrupted, > when using maildir and recievend and accessing mail at the same time > Quoting Joseph Tam <jtam.home(a)gmail.com>: > >> Another privacy plugin that assumes the server operator is unmotivated or >> respects your privacy anyways, and won't just skim your password right off >> the top to look at your mail. A vault with steel walls and a dirt floor. > > *SIGH* As usual, you're right on the money, Joseph. > > I used to let things like this "slide", but somewhat recently I've had some > clients badgering me to implement something like this. It takes longer than it > should to explain how pointless the exercise is. > > Given that: > > 1) Email transactions, from submission, to delivery, to final reception by a > MUA, are done with plaintext contents. Those who want security, will undergo > the additional steps and hassles with using PGP to encrypt the contents, > providing the only demonstrably secure (against "Evil SysAdmins") means of > cloaking your content. The submission, delivery, and final reception is still > performed as "plaintext", albeit with an attachment that is encrypted, a > process done (and undone) by the ultimate endpoint clients. > > 2) Even if the "Evil SysAdmin" doesn't scribble all of the users' passphrases > into a log, it's trivial for various tools, many of which were hastily cobbled > together during the fad of implementing Sarbanes-Oxley Act (SOX) compliance on > mail servers. Tools like "milter-bcc" and friends which automatically clone > all email submitted to or arriving through SMTP, etc. It doesn't matter if > your SMTP software implements 65,536 Jiggabyte Key Quantum-Computing-Resistant > crypto, when it has the decrypted contents in its spool. > > I imagine this is an exercise in buzzword collection, and to be seen to be > "doing something" to improve security and/or privacy. > > If privacy is desired, there are only end-to-end encryption/signature schemes > to ensure anything at all, and even there we're at the mercy of mathematical > gods greater than we. > > Looking to a "magical" oracle on your server to do it for you, whilst keeping > all of the leaky, plaintext, and promiscuous protocols (DSN, bounces, > intermediate MXer hosts that eruct contents to various envelope addresses, > etc) that will betray you behind your back without a moment's notice is a > Fool's Errand. > > Think it over. > > =M= > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBW3ErEMQnQQNheMxiAQJZ+Qf9ECwe0SZXwClaM+wHBVdsOPLPuL6rkSzV TAkPe7bV2jnqUL8J0I7F46MW4yV76ttbWMbZ3wP6Mom2roNOqGoQIxWsQLkgZvib Wdg29L0nsMkHY6A5zCRM/n4rvNi/xDHIUWIinZRUWvFr8J6WWkSaYneX2Xjvf6tF 24nj+tqcuYtFomsY802WySgovLZi5y0s8nSSkQ9nnPA44hpozfbQXXf/pO14D2BL vhsiqvLKnS/3wY83Y05RLCsojfQDG3Vbqgm6qV9qkpOtGN9sLV/ufXc8tui070UW FDmV5S/KnP8Z7ru9Hq83JEhxkaApPhcKqIQcpjUIeWyobIwvYr718A== =cbbG -----END PGP SIGNATURE-----

1 0

[trees-plugin] - Dovecot index gets corrupted, when using maildir and recievend and accessing mail at the same time
by neutron 11 Aug '18

11 Aug '18

Hello dovecot team, at first I want to thank you the awesome dovecot software. I'm currently researching and developing the trees plugin (https://0xacab.org/riseuplabs/trees) In the future I would love to package this software for debian. I run into a problem, which I can not fix by myself, that's why I'm reaching out to you. The plugin is producing a reproducible error, when using dovecots mailbox format maildir, and receiving and accessing mail at the same time. I'm searching for additional information to fix that. I know that it's may not the scope of the mailing list to support external plugins, but since you are the experts, I thought I should ask at least. Trees Plugin: =================== The plugin adds individually encrypted mail storage to the Dovecot IMAP server. It encrypts all (incoming and outgoing) mail on the mail server with a key, which can only be accessed with the users password. So the server operator is not able to see any mail content, if it's saved on the hard disk. Bug Description: =================== I'm using a postfix dovecot setup with the enabled trees plugin with the mailboxformat maildir. When I'm receiving and accessing mail at the same time, the dovecot index gets corrupted. For accessing those mail I use Thunderbird. Example corruption: > ug 4 09:55:15 trees dovecot: imap-login: Login: user=<treesenabled(a)trees.testing>, method=PLAIN, rip=192.168.22.1, lip=192.168.22.77, mpid=4643, TLS, session=<w0OCCplyhLLAqBYB> > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Debug: trees plugin initialized > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Connection closed in=506 out=495 > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Error: Maildir filename has wrong S value, renamed the file from /var/vmail/trees.testing/treesenabled/Maildir/cur/1533376515.M379290P4641.trees,S=1456,W=748:2, to /var/vmail/trees.testing/treesenabled/Maildir/cur/1533376515.M379290P4641.trees,S=783:2, > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Error: Corrupted index cache file /var/vmail/trees.testing/treesenabled/Maildir/dovecot.index.cache: Broken physical size for mail UID 1 in mailbox INBOX: read(/var/vmail/trees.testing/treesenabled/Maildir/cur/1533376515.M379290P4641.trees,S=1456,W=748:2,) failed: Cached message size larger than expected (1456 > 728, box=INBOX, UID=1, cached Message-Id=<4ae8ea2c-17ac-37d5-9b9e-b32c6edc777a(a)trees.testing>) > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Panic: file istream.c: line 175 (i_stream_read): assertion failed: (old_size <= _stream->pos - _stream->skip) > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x95e92) [0x7fa88e2afe92] -> /usr/lib/dovecot/libdovecot.so.0(+0x95f8d) [0x7fa88e2aff8d] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fa88e245a91] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x290) [0x7fa88e2baf20] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7fa88e2bb72d] -> /usr/lib/dovecot/libdovecot.so.0(message_get_body_size+0xfd) [0x7fa88e29ab6d] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x220) [0x7fa88e5eb3d0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x66fc0) [0x7fa88e5a2fc0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream_because+0x5d) [0x7fa88e572e1d] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x536) [0x7fa88e6264f6] -> dovecot-trees.testing/imap(+0x1ebbc) [0x559b794f1bbc] -> dovecot-trees.testing/imap(+0x1cfb6) [0x559b794effb6] -> dovecot-trees.testing/imap(imap_fetch_more+0x39) [0x559b794f10e9] -> dovecot-trees.testing/imap(cmd_fetch+0x33b) [0x559b794e2d9b] -> dovecot-trees.testing/imap(command_exec+0xa5) [0x559b794ee735] -> dovecot-trees.testing/imap(+0x199c2) [0x559b794ec9c2] -> dovecot-trees.testing/imap(+0x19a4c) [0x559b794eca4c] -> dovecot-trees.testing/imap(client_handle_input+0x1b5) [0x559b794ece55] -> dovecot-trees.testing/imap(client_input+0x86) [0x559b794ed3c6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7fa88e2c49f2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7fa88e2c6029] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0x7fa88e2c4a8c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fa88e2c4c38] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fa88e24bfd3] -> dovecot-trees.testing/imap(main+0x328) [0x559b794dfe68] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7fa88de9b2e1] -> dovecot-trees.testing/imap(_start+0x2a) [0x559b794dffea] > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Fatal: master: service(imap): child 4633 killed with signal 6 (core dumps disabled) The behavior does not occur, when I'm using maildir and access my mail after receiving it. It also does not occur with other mailbox formats such as mbox, sdbox and mdbox I opened a bug report at the trees repository, which is more detailed ( https://0xacab.org/riseuplabs/trees/issues/24 ). There I described how it's possible to reproduce this error. In the trees repo there is also a vagrant box, with which it's possible to spin up the exact same setup. Questions: =================== 1.) Do you know what could possibly lead to the the larger cached message size, when accessing this mail via imap? 2.) Why does these sizes differ from each other? Mail size from the log is: 'S=1456,W=748:2' or 'renamed to ...S=783:2'. But I do not see where the size of '728' come from? 3.) Do you have a hint what could lead to this behavior and how could I solve this error? Unrelated but also interesting for trees usage: 4.) Is there a tool, with which you can export and import mail to the same inbox? Background: After activation for an existing mail user, only new outgoing and incoming mail is encrypted. So it would be necessary to "re-save" the existing mail again in this mailbox, to pipe all mails through the encryption process. I know that there is dsync, imapsync and several different tools, but I'm not sure what is the best tool for the job, or if I should use dsync to do a 3 way sync? > existing_mailbox(a)server.com > tmp_mailbox(a)server.com > existing_mailbox(a)server.com Thank you: =================== Thank you for time reading this mail :) Dovecot Config: =================== # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.4 ext4 auth_mechanisms = plain login instance_name = trees.testing login_greeting = trees.testing ready. mail_gid = 5000 mail_location = maildir:/var/vmail/%Ld/%Ln/Maildir mail_plugins = " quota trees" mail_uid = 5000 mailbox_list_index = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 4 } service imap { executable = imap } service pop3 { executable = pop3 } ssl = required ssl_cert = </etc/ssl/certs/ssl-cert-snakeoil.pem ssl_cipher_list = ALL:!LOW:!RC4:!EXP:!aNULL ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

5 5

dovecot stats-writer socket permissions
by Scott Ruckh 11 Aug '18

11 Aug '18

I have seen this thread about being able to run doveadm as a non-root user, but I don't understand the solution even though I have seen other pages give this link as the solution. http://bit.ly/2MC5oq9 What configuration is necessary so that I can set the permissions on /var/run/dovecot/stats-writer socket-file so when dovecot starts my virtual mail account has read/write access? I saw another page about adding service stats { } Although I set user, group, and permissions, it did not seem to have any effect on the permissions when I restarted dovecot. Thank You.

2 2

Re: dying on osx
by Mike Makuch 10 Aug '18

10 Aug '18

$ grep dove /etc/passwd /etc/group /etc/passwd:_dovecot:*:214:6:Dovecot Administrator:/var/empty:/usr/bin/false /etc/passwd:_dovenull:*:227:227:Dovecot Authentication:/var/empty:/usr/bin/false /etc/group:certusers:*:29:root,_jabber,_postfix,_cyrus,_calendar,_dovecot /etc/group:_dovenull:*:227: I'm trying to build on osx so I can try to do some debugging. The INSTALL.md says to do: $ more INSTALL.md Build Instructions ================== For most people, the usual: ``` ./configure make sudo make install ``` But there is no configure file. How would I generate the configure file? Is it generated? Been a long time since I've done open source C code.. Thanks Mike On 8/10/18 11:04, Aki Tuomi wrote: > Is the user member of mail group? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Mike Makuch <1mikemakuch(a)gmail.com> > Date: 10/08/2018 19:02 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi> > Cc: dovecot(a)dovecot.org > Subject: Re: dying on osx > > Maybe an old problem that has resurfaced??? > > https://bugzilla.samba.org/show_bug.cgi?id=8773 > > Mike > > > > On 8/10/18 10:54, Aki Tuomi wrote: >> I have to see if this is reproducible outside mac. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Mike Makuch <1mikemakuch(a)gmail.com> >> Date: 10/08/2018 18:46 (GMT+02:00) >> To: Aki Tuomi <aki.tuomi(a)dovecot.fi> >> Subject: Re: dying on osx >> >> I did find that page and tried a few things there. My config has all of >> the settings there except 3: >> >> mail_access_groups = mail >> mbox_read_locks = fcntl >> mbox_write_locks = fcntl >> >> I add them to my config, restart and get the same abort >> >> 20180810-103849 imap(mkm)<79213><MkA5ihZzmdh/AAAB>: Fatal: >> setgroups(mail,505) failed: Too many extra groups >> >> I've tried numerous other settings as well. >> >> Thanks for any further advice >> >> Mike >> >> >> On 8/10/18 08:45, Aki Tuomi wrote: >> > Can you try this config and report back? >> > >> > >> https://superuser.com/questions/957272/dotlock-permissions-problems-with-do… >> > >> > Aki >> > >> >> On 10 August 2018 at 16:39 Mike Makuch <1mikemakuch(a)gmail.com> wrote: >> >> >> >> >> >> OSX 10.13.6 High Sierra, dovecot 2.3.2.1 >> >> >> >> dovecot starts up and runs but dies as soon as my mail client makes a >> >> request with log and config below. >> >> >> >> And advice appreciated. >> >> >> >> Thanks >> >> >> >> Mike >> >> >> >> >> >> >> >> 20180810-083730 auth: Debug: auth client connected (pid=77432) >> >> >> >> 20180810-083730 auth: Debug: client in: AUTH 1 PLAIN >> >> service=imap secured session=xo1p2BRzZNd/AAAB lip=127.0.0.1 >> >> rip=127.0.0.1 lport=143 rport=55140 >> >> 20180810-083730 auth: Debug: client passdb out: CONT 1 >> >> 20180810-083730 auth: Debug: client in: CONT 1 AG1rbQBta20xMjM= >> >> (previous base64 data may contain sensitive data) >> >> 20180810-083730 auth: Debug: static(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): >> >> lookup >> >> 20180810-083730 auth: Debug: client passdb out: OK 1 user=mkm >> >> host=localhost nopasswd=y >> >> 20180810-083730 auth: Debug: master in: REQUEST 4201906177 77432 >> >> 1 b8126b4b71be2959fc7716888eccc566 session_pid=77433 >> >> request_auth_token >> >> 20180810-083730 auth-worker(77426): Debug: >> >> passwd(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): lookup >> >> 20180810-083730 auth: Debug: master userdb out: USER 4201906177 >> >> mkm system_groups_user=mkm uid=503 gid=20 home=/Users/mkm >> >> auth_token=4d2bb44168df3d63e4e1bb352e59de632bc7da49 >> >> 20180810-083730 imap-login: Info: Login: user=<mkm>, method=PLAIN, >> >> rip=127.0.0.1, lip=127.0.0.1, mpid=77433, secured, >> >> session=<xo1p2BRzZNd/AAAB> >> >> 20180810-083730 imap(mkm)<77433><xo1p2BRzZNd/AAAB>: Fatal: >> >> setgroups(505) failed: Too many extra groups >> >> >> >> # doveconf -n >> >> # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf >> >> # OS: Darwin 17.7.0 x86_64 >> >> # Hostname: pine >> >> auth_debug = yes >> >> auth_debug_passwords = yes >> >> default_internal_user = _dovecot >> >> default_login_user = _dovenull >> >> disable_plaintext_auth = no >> >> listen = 127.0.0.1 >> >> log_path = /var/log/dovecot >> >> log_timestamp = "%Y%m%d-%H%M%S " >> >> mail_debug = yes >> >> mail_gid = staff >> >> mail_location = mbox:~/Mail:INBOX=/var/mail/%u >> >> mail_privileged_group = mail >> >> mail_uid = _dovecot >> >> passdb { >> >> args = password=*** host=localhost nopasswd=y >> >> driver = static >> >> } >> >> passdb { >> >> args = login >> >> driver = pam >> >> } >> >> protocols = imap >> >> service auth { >> >> user = root >> >> } >> >> service imap-login { >> >> inet_listener imap { >> >> address = * >> >> port = 143 >> >> } >> >> } >> >> ssl = no >> >> userdb { >> >> driver = passwd >> >> } >> >> >> >> >> >

1 2

Re: dying on osx
by Mike Makuch 10 Aug '18

10 Aug '18

Maybe an old problem that has resurfaced??? https://bugzilla.samba.org/show_bug.cgi?id=8773 Mike On 8/10/18 10:54, Aki Tuomi wrote: > I have to see if this is reproducible outside mac. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Mike Makuch <1mikemakuch(a)gmail.com> > Date: 10/08/2018 18:46 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi> > Subject: Re: dying on osx > > I did find that page and tried a few things there. My config has all of > the settings there except 3: > > mail_access_groups = mail > mbox_read_locks = fcntl > mbox_write_locks = fcntl > > I add them to my config, restart and get the same abort > > 20180810-103849 imap(mkm)<79213><MkA5ihZzmdh/AAAB>: Fatal: > setgroups(mail,505) failed: Too many extra groups > > I've tried numerous other settings as well. > > Thanks for any further advice > > Mike > > > On 8/10/18 08:45, Aki Tuomi wrote: > > Can you try this config and report back? > > > > > https://superuser.com/questions/957272/dotlock-permissions-problems-with-do… > > > > Aki > > > >> On 10 August 2018 at 16:39 Mike Makuch <1mikemakuch(a)gmail.com> wrote: > >> > >> > >> OSX 10.13.6 High Sierra, dovecot 2.3.2.1 > >> > >> dovecot starts up and runs but dies as soon as my mail client makes a > >> request with log and config below. > >> > >> And advice appreciated. > >> > >> Thanks > >> > >> Mike > >> > >> > >> > >> 20180810-083730 auth: Debug: auth client connected (pid=77432) > >> > >> 20180810-083730 auth: Debug: client in: AUTH 1 PLAIN > >> service=imap secured session=xo1p2BRzZNd/AAAB lip=127.0.0.1 > >> rip=127.0.0.1 lport=143 rport=55140 > >> 20180810-083730 auth: Debug: client passdb out: CONT 1 > >> 20180810-083730 auth: Debug: client in: CONT 1 AG1rbQBta20xMjM= > >> (previous base64 data may contain sensitive data) > >> 20180810-083730 auth: Debug: static(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): > >> lookup > >> 20180810-083730 auth: Debug: client passdb out: OK 1 user=mkm > >> host=localhost nopasswd=y > >> 20180810-083730 auth: Debug: master in: REQUEST 4201906177 77432 > >> 1 b8126b4b71be2959fc7716888eccc566 session_pid=77433 > >> request_auth_token > >> 20180810-083730 auth-worker(77426): Debug: > >> passwd(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): lookup > >> 20180810-083730 auth: Debug: master userdb out: USER 4201906177 > >> mkm system_groups_user=mkm uid=503 gid=20 home=/Users/mkm > >> auth_token=4d2bb44168df3d63e4e1bb352e59de632bc7da49 > >> 20180810-083730 imap-login: Info: Login: user=<mkm>, method=PLAIN, > >> rip=127.0.0.1, lip=127.0.0.1, mpid=77433, secured, > >> session=<xo1p2BRzZNd/AAAB> > >> 20180810-083730 imap(mkm)<77433><xo1p2BRzZNd/AAAB>: Fatal: > >> setgroups(505) failed: Too many extra groups > >> > >> # doveconf -n > >> # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf > >> # OS: Darwin 17.7.0 x86_64 > >> # Hostname: pine > >> auth_debug = yes > >> auth_debug_passwords = yes > >> default_internal_user = _dovecot > >> default_login_user = _dovenull > >> disable_plaintext_auth = no > >> listen = 127.0.0.1 > >> log_path = /var/log/dovecot > >> log_timestamp = "%Y%m%d-%H%M%S " > >> mail_debug = yes > >> mail_gid = staff > >> mail_location = mbox:~/Mail:INBOX=/var/mail/%u > >> mail_privileged_group = mail > >> mail_uid = _dovecot > >> passdb { > >> args = password=*** host=localhost nopasswd=y > >> driver = static > >> } > >> passdb { > >> args = login > >> driver = pam > >> } > >> protocols = imap > >> service auth { > >> user = root > >> } > >> service imap-login { > >> inet_listener imap { > >> address = * > >> port = 143 > >> } > >> } > >> ssl = no > >> userdb { > >> driver = passwd > >> } > >> > >> >

2 1

Re: dying on osx
by Aki Tuomi 10 Aug '18

10 Aug '18

I have to see if this is reproducible outside mac. ---Aki TuomiDovecot oy -------- Original message --------From: Mike Makuch <1mikemakuch(a)gmail.com> Date: 10/08/2018 18:46 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi> Subject: Re: dying on osx I did find that page and tried a few things there. My config has all of the settings there except 3: mail_access_groups = mail mbox_read_locks = fcntl mbox_write_locks = fcntl I add them to my config, restart and get the same abort 20180810-103849 imap(mkm)<79213><MkA5ihZzmdh/AAAB>: Fatal: setgroups(mail,505) failed: Too many extra groups I've tried numerous other settings as well. Thanks for any further advice Mike On 8/10/18 08:45, Aki Tuomi wrote: > Can you try this config and report back? > > https://superuser.com/questions/957272/dotlock-permissions-problems-with-do… > > Aki > >> On 10 August 2018 at 16:39 Mike Makuch <1mikemakuch(a)gmail.com> wrote: >> >> >> OSX 10.13.6 High Sierra, dovecot 2.3.2.1 >> >> dovecot starts up and runs but dies as soon as my mail client makes a >> request with log and config below. >> >> And advice appreciated. >> >> Thanks >> >> Mike >> >> >> >> 20180810-083730 auth: Debug: auth client connected (pid=77432) >> >> 20180810-083730 auth: Debug: client in: AUTH 1 PLAIN >> service=imap secured session=xo1p2BRzZNd/AAAB lip=127.0.0.1 >> rip=127.0.0.1 lport=143 rport=55140 >> 20180810-083730 auth: Debug: client passdb out: CONT 1 >> 20180810-083730 auth: Debug: client in: CONT 1 AG1rbQBta20xMjM= >> (previous base64 data may contain sensitive data) >> 20180810-083730 auth: Debug: static(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): >> lookup >> 20180810-083730 auth: Debug: client passdb out: OK 1 user=mkm >> host=localhost nopasswd=y >> 20180810-083730 auth: Debug: master in: REQUEST 4201906177 77432 >> 1 b8126b4b71be2959fc7716888eccc566 session_pid=77433 >> request_auth_token >> 20180810-083730 auth-worker(77426): Debug: >> passwd(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): lookup >> 20180810-083730 auth: Debug: master userdb out: USER 4201906177 >> mkm system_groups_user=mkm uid=503 gid=20 home=/Users/mkm >> auth_token=4d2bb44168df3d63e4e1bb352e59de632bc7da49 >> 20180810-083730 imap-login: Info: Login: user=<mkm>, method=PLAIN, >> rip=127.0.0.1, lip=127.0.0.1, mpid=77433, secured, >> session=<xo1p2BRzZNd/AAAB> >> 20180810-083730 imap(mkm)<77433><xo1p2BRzZNd/AAAB>: Fatal: >> setgroups(505) failed: Too many extra groups >> >> # doveconf -n >> # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf >> # OS: Darwin 17.7.0 x86_64 >> # Hostname: pine >> auth_debug = yes >> auth_debug_passwords = yes >> default_internal_user = _dovecot >> default_login_user = _dovenull >> disable_plaintext_auth = no >> listen = 127.0.0.1 >> log_path = /var/log/dovecot >> log_timestamp = "%Y%m%d-%H%M%S " >> mail_debug = yes >> mail_gid = staff >> mail_location = mbox:~/Mail:INBOX=/var/mail/%u >> mail_privileged_group = mail >> mail_uid = _dovecot >> passdb { >> args = password=*** host=localhost nopasswd=y >> driver = static >> } >> passdb { >> args = login >> driver = pam >> } >> protocols = imap >> service auth { >> user = root >> } >> service imap-login { >> inet_listener imap { >> address = * >> port = 143 >> } >> } >> ssl = no >> userdb { >> driver = passwd >> } >> >>

1 0

dying on osx
by Mike Makuch 10 Aug '18

10 Aug '18

OSX 10.13.6 High Sierra, dovecot 2.3.2.1 dovecot starts up and runs but dies as soon as my mail client makes a request with log and config below. And advice appreciated. Thanks Mike 20180810-083730 auth: Debug: auth client connected (pid=77432) 20180810-083730 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=xo1p2BRzZNd/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=55140 20180810-083730 auth: Debug: client passdb out: CONT 1 20180810-083730 auth: Debug: client in: CONT 1 AG1rbQBta20xMjM= (previous base64 data may contain sensitive data) 20180810-083730 auth: Debug: static(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): lookup 20180810-083730 auth: Debug: client passdb out: OK 1 user=mkm host=localhost nopasswd=y 20180810-083730 auth: Debug: master in: REQUEST 4201906177 77432 1 b8126b4b71be2959fc7716888eccc566 session_pid=77433 request_auth_token 20180810-083730 auth-worker(77426): Debug: passwd(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): lookup 20180810-083730 auth: Debug: master userdb out: USER 4201906177 mkm system_groups_user=mkm uid=503 gid=20 home=/Users/mkm auth_token=4d2bb44168df3d63e4e1bb352e59de632bc7da49 20180810-083730 imap-login: Info: Login: user=<mkm>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=77433, secured, session=<xo1p2BRzZNd/AAAB> 20180810-083730 imap(mkm)<77433><xo1p2BRzZNd/AAAB>: Fatal: setgroups(505) failed: Too many extra groups # doveconf -n # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 17.7.0 x86_64 # Hostname: pine auth_debug = yes auth_debug_passwords = yes default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no listen = 127.0.0.1 log_path = /var/log/dovecot log_timestamp = "%Y%m%d-%H%M%S " mail_debug = yes mail_gid = staff mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_privileged_group = mail mail_uid = _dovecot passdb { args = password=*** host=localhost nopasswd=y driver = static } passdb { args = login driver = pam } protocols = imap service auth { user = root } service imap-login { inet_listener imap { address = * port = 143 } } ssl = no userdb { driver = passwd }

2 1

limit sharing ability to certain users
by Simeon Ott 10 Aug '18

10 Aug '18

Hello Is it possible to limit the ability of sharing it’s own mailboxes to only a few users? We have a few sensitive mailboxes of users where the ability to share via IMAP SETACL should be prevented. I tried the following so far… doveadm acl remove -u test(a)onnet.ch INBOX user=test(a)onnet.ch admin but when doing this the admin rights are still there doveadm acl rights -u test(a)onnet.ch INBOX vmail@buserver:~$ doveadm acl rights -u test(a)onnet.ch INBOX Rights lookup read write write-seen write-deleted insert post expunge create delete admin Thanks in advance for your help Simeon

4 18

Re: Error compiling pigeonhole managesieve 0.4.24
by Aki Tuomi 10 Aug '18

10 Aug '18

Yep On 10.08.2018 11:06, davide marchi wrote: > Thanks Aki for your quick response!! I'm sorry, so i have to compile > and install dovecot version 2.2.36 before compiling and install > pigeonhole 0.4.24? If so sorry for my noob approach > > Il giorno ven 10 ago 2018 alle ore 09:55 Aki Tuomi > <aki.tuomi(a)dovecot.fi <mailto:aki.tuomi@dovecot.fi>> ha scritto: > > Did you remember to install core before compiling pigeonhole? > > Aki > > > On 10.08.2018 10:45, davide marchi wrote: >> Hi i have a problem compiling as mantioned on object of this >> mail: i'm changing dovecot on my debian 6 from version 2.2.32 to >> 2.2.36 and pigeonhole from 0.4.20 to 0.4.24 >> this is output of dovecot -n for listing versions installed >> >> dovecot -n >> # 2.2.32 (dfbe293d4): /usr/local/etc/dovecot/dovecot.conf >> # Pigeonhole version 0.4.20 (7cd71ba) >> # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.10 >> i have downloaded packages from site and compiling from source >> >> so far so good >> for pigeonhole this is the configure command that i always use >> >> ./configure CFLAGS=-O3 >> but when i run make this is the error that i came accross: >> >> /bin/bash ../../libtool --tag=CC --mode=link gcc -std=gnu99 >> -O3 -Wall -W -Wmissing-prototypes -Wmissing-declarations >> -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast >> -fno-builtin-strftime -Wstrict-aliasing=2 -I../.. >> -export-dynamic -o sievec sievec.o >> ../../src/lib-sieve/libdovecot-sieve.la >> <http://libdovecot-sieve.la> >> ../../src/lib-sieve-tool/libsieve-tool.la >> <http://libsieve-tool.la> -ldovecot-storage -ldovecot-lda >> -L/usr/local/lib/dovecot -ldovecot -lrt >> libtool: link: gcc -std=gnu99 -O3 -Wall -W -Wmissing-prototypes >> -Wmissing-declarations -Wpointer-arith -Wchar-subscripts >> -Wformat=2 -Wbad-function-cast -fno-builtin-strftime >> -Wstrict-aliasing=2 -I../.. -o .libs/sievec sievec.o >> -Wl,--export-dynamic >> ../../src/lib-sieve/.libs/libdovecot-sieve.so >> ../../src/lib-sieve-tool/.libs/libsieve-tool.a >> /usr/local/lib/dovecot/libdovecot-storage.so >> /usr/local/lib/dovecot/libdovecot-lda.so -L/usr/local/lib/dovecot >> /usr/local/lib/dovecot/libdovecot.so -lrt -Wl,-rpath >> -Wl,/usr/local/lib/dovecot >> ../../src/lib-sieve/.libs/libdovecot-sieve.so: undefined >> reference to `str_sanitize_utf8' >> collect2: ld returned 1 exit status >> make[3]: *** [sievec] Error 1 >> make[3]: Leaving directory >> `/download/dovecot-2.2-pigeonhole-0.4.24/src/sieve-tools' >> make[2]: *** [all-recursive] Error 1 >> make[2]: Leaving directory >> `/download/dovecot-2.2-pigeonhole-0.4.24/src' >> make[1]: *** [all-recursive] Error 1 >> make[1]: Leaving directory `/download/dovecot-2.2-pigeonhole-0.4.24' >> make: *** [all] Error 2 >> >> What's wrong ? Thanks in advance on helping me >

1 0

Error compiling pigeonhole managesieve 0.4.24
by davide marchi 10 Aug '18

10 Aug '18

Hi i have a problem compiling as mantioned on object of this mail: i'm changing dovecot on my debian 6 from version 2.2.32 to 2.2.36 and pigeonhole from 0.4.20 to 0.4.24 this is output of dovecot -n for listing versions installed dovecot -n # 2.2.32 (dfbe293d4): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.10 i have downloaded packages from site and compiling from source so far so good for pigeonhole this is the configure command that i always use ./configure CFLAGS=-O3 but when i run make this is the error that i came accross: /bin/bash ../../libtool --tag=CC --mode=link gcc -std=gnu99 -O3 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I../.. -export-dynamic -o sievec sievec.o ../../src/lib-sieve/libdovecot-sieve.la ../../src/lib-sieve-tool/ libsieve-tool.la -ldovecot-storage -ldovecot-lda -L/usr/local/lib/dovecot -ldovecot -lrt libtool: link: gcc -std=gnu99 -O3 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I../.. -o .libs/sievec sievec.o -Wl,--export-dynamic ../../src/lib-sieve/.libs/libdovecot-sieve.so ../../src/lib-sieve-tool/.libs/libsieve-tool.a /usr/local/lib/dovecot/libdovecot-storage.so /usr/local/lib/dovecot/libdovecot-lda.so -L/usr/local/lib/dovecot /usr/local/lib/dovecot/libdovecot.so -lrt -Wl,-rpath -Wl,/usr/local/lib/dovecot ../../src/lib-sieve/.libs/libdovecot-sieve.so: undefined reference to `str_sanitize_utf8' collect2: ld returned 1 exit status make[3]: *** [sievec] Error 1 make[3]: Leaving directory `/download/dovecot-2.2-pigeonhole-0.4.24/src/sieve-tools' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/download/dovecot-2.2-pigeonhole-0.4.24/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/download/dovecot-2.2-pigeonhole-0.4.24' make: *** [all] Error 2 What's wrong ? Thanks in advance on helping me

2 1

Best practices for backing up small mailserver to remote location
by Ian Evans 09 Aug '18

09 Aug '18

My webserver also houses our mailserver. There's about six users on that mail system and I'm thinking it would be good to back up the mailboxes to my always on HTPC computer at home, which is reachable via a dynamic IP service. I know (or think) I need to use doveadm-backup for this but rather than reinvent the wheel (or use the wrong wheel altogether) I'm wondering if anyone can recommend a good tutorial or wiki entry that shows the best way to loop through the users and send their backups to a remote server. Thanks.

6 6

Message delivered twice caused by an LMTP error "Got unexpected reply" during upgrade to 2.3
by Gabriele Nencioni 09 Aug '18

09 Aug '18

Hi all, we are upgrading our dovecot platform from: # dovecot --version 2.2.15.14 (39f57c379ded+) to # dovecot --version 2.3.2.1 (0719df592) Our platform is debian based and it is configured as director and backend proxy. We have just upgrade only 4 servers (2 directors and 2 backends) and when the lmtp traffic flow goes through an upgraded director and a not-upgraded backend sometimes the following error has been arised: Aug 6 14:31:28 monti-director07 dovecot: lmtp(13463): Error: eMFVIKA/aFuXNAAAhXvSMA: Failed to send message to <test2(a)internalinboundcm.eu> at 192.168.72.135:24: Got unexpected reply (1/1 at 210 ms) Aug 6 14:31:28 monti-director07 dovecot: lmtp(13463): Error: eMFVIKA/aFuXNAAAhXvSMA: Failed to send message to <test2(a)internalinboundcm.eu> at 192.168.72.135:24: Got unexpected reply (1/1 at 210 ms) where 172.20.44.7 (monti-director07) is a dovecot 2.3.2.1 192.168.72.135 (monti-backend07) is a dovecot 2.2.15.14 When that error occurs an email is delivered twice, as you can see from the following logs. On smtp server you can see the temp fail (by the upgraded director 172.20.44.7), retry and delivered (by a not-upgraded director 172.20.44.3): 20180806 14:31:28.772 core context="Temporary_Delivery_Failure", _fromemail="test1(a)internalinboundcm.eu", _toemail="test2(a)internalinboundcm.eu", _tos="test2(a)internalinboundcm.eu", _size="80294", dip=172.20.44.7 dport=24 type=lmtp msg="4.4.0 Remote server not answering (bad reply)" duration=5 mailfrom=6/6/0/0 rcptto=6/6/0/0 data=6/5/1/0 tls=0/0 20180806 14:32:28.032 core context="Message_Delivered", _fromemail="test1(a)internalinboundcm.eu", _toemail="test2(a)internalinboundcm.eu", _tos="test2(a)internalinboundcm.eu", _size="80294", dip=172.20.44.3 dport=24 type=lmtp msg="2.0.0 <test2(a)internalinboundcm.eu> AS1CJtQ/aFsqMAAAj5cnUg Saved" duration=21457 mailfrom=3586/3586/0/0 rcptto=3586/3586/0/0 data=3586/3584/2/0 tls=0/0 and on backend server there are the related two delivered log entries: Aug 6 14:31:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<f0WZF5c/aFuPdgAAj5cnUg>: copy from <lmtp DATA>: box=INBOX, uid=2727, msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu> Aug 6 14:31:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<f0WZF5c/aFuPdgAAj5cnUg>: f0WZF5c/aFuPdgAAj5cnUg: msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu>: saved mail to INBOX Aug 6 14:32:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<AS1CJtQ/aFsqMAAAj5cnUg>: copy from <lmtp DATA>: box=INBOX, uid=2728, msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu> Aug 6 14:32:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<AS1CJtQ/aFsqMAAAj5cnUg>: AS1CJtQ/aFsqMAAAj5cnUg: msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu>: saved mail to INBOX This is the strace output of dovecot lmtp director process (13463): 13463 1533558688.759362 read(8, "250 2.0.0 <test2(a)internalinboundcm.eu> f0WZF5c/aFuPdgAAj5cnUg Saved\r\n", 8012) = 71 <0.000028> 13463 1533558688.759493 sendto(14, "<19>Aug 6 14:31:28 dovecot: lmtp(13463): Error: eMFVIKA/aFuXNAAAhXvSMA: Failed to send message to <test2(a)internalinboundcm.eu> at 192.168.72.135:24: Got unexpected reply (1/1 at 210 ms)", 188, MSG_NOSIGNAL, NULL, 0) = 188 <0.000037> So it receives the "Saved" message from backend but it arises the "Got unexpected reply" error anyway. >From tcpdump we have noticed the QUIT response is missed on lmtp trasaction after the "Saved" message from backend at DATA stage: 220 monti-backend07.it.dadainternal Dovecot ready. LHLO monti-director07.it.dadainternal 250-monti-backend07.it.dadainternal 250-8BITMIME 250-ENHANCEDSTATUSCODES 250 PIPELINING MAIL FROM:<test1(a)internalinboundcm.eu> RCPT TO:<test2(a)internalinboundcm.eu> DATA ...truncated message . 250 2.0.0 <test2(a)internalinboundcm.eu> f0WZF5c/aFuPdgAAj5cnUg Saved While it should be something like this: 220 monti-backend07.it.dadainternal Dovecot ready. LHLO monti-director07.it.dadainternal 250-monti-backend07.it.dadainternal 250-8BITMIME 250-ENHANCEDSTATUSCODES 250 PIPELINING MAIL FROM:<test1(a)internalinboundcm.eu> RCPT TO:<test2(a)internalinboundcm.eu> DATA ...truncated message . 250 2.0.0 <test2(a)internalinboundcm.eu> f0WZF5c/aFuPdgAAj5cnUg Saved QUIT 221 2.0.0 OK It follows the both dovecot configurations: # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_cache_negative_ttl = 0 auth_verbose = yes auth_worker_max_count = 350 director_mail_servers = 192.168.72.129 192.168.72.130 192.168.72.131 192.168.72.132 192.168.72.133 192.168.72.134 192.168.72.135 192.168.72.136 192.168.72.137 192.168.72.138 192.168.72.139 192.168.72.140 192.168.72.141 192.168.72.142 192.168.72.143 192.168.72.144 192.168.72.145 192.168.72.146 192.168.72.147 192.168.72.148 192.168.72.149 director_servers = 172.20.44.1 172.20.44.2 172.20.44.3 172.20.44.4 172.20.44.5 172.20.44.6 172.20.44.7 172.20.44.8 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 24242 lmtp_proxy = yes log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%Lu> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> mail_log_prefix = "%s(%Lu)<%{session}>: " mail_max_userip_connections = 500 passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql skip = authenticated } protocols = imap pop3 lmtp service auth-worker { user = dovecot } service auth { client_limit = 0 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24242 } } service imap-login { client_limit = 12000 executable = imap-login director process_limit = 0 process_min_avail = 4 service_count = 0 } service ipc { unix_listener ipc { user = $default_internal_user } } service lmtp { client_limit = 1 executable = lmtp -L inet_listener lmtp { port = 24 } process_limit = 240 process_min_avail = 20 service_count = 1 } service pop3-login { client_limit = 12000 executable = pop3-login director process_limit = 0 process_min_avail = 4 service_count = 0 } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol doveadm { auth_socket_path = director-userdb } protocol lmtp { auth_socket_path = director-userdb mail_plugins = } # 2.2.15.14 (39f57c379ded+): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.9 auth_cache_negative_ttl = 0 auth_worker_max_count = 500 default_vsz_limit = 1 G disable_plaintext_auth = no doveadm_password = first_valid_uid = 508 last_valid_uid = 508 lda_mailbox_autocreate = yes log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%Lu> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> login_trusted_networks = 192.168.72.201 192.168.72.202 192.168.72.203 192.168.72.204 192.168.72.205 192.168.72.206 192.168.72.207 192.168.72.208 mail_fsync = always mail_gid = 508 mail_location = maildir:~/Maildir mail_log_prefix = "%s(%Lu)<%{session}>: " mail_max_userip_connections = 30 mail_plugins = notify mail_log quota mail_uid = 508 maildir_very_dirty_syncs = yes mmap_disable = yes namespace { hidden = yes list = no location = prefix = separator = . } namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Sent { auto = create special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = create special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql skip = authenticated } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid quota = dict:User quota::file:%h/dovecot-quota quota_exceeded_message = Quota exceeded quota_rule2 = Trash:storage=+100M quota_warning = storage=100%% quota-warning -q 100 -n %n -d %d -e OverQuota quota_warning2 = storage=80%% quota-warning -q 80 -n %n -d %d -e FillQuota quota_warning3 = -storage=99%% quota-warning -q 99 -n %n -d %d -e InQuota sieve = ~/.dovecot.sieve sieve_extensions = +editheader sieve_max_redirects = 15 sieve_vacation_default_period = 1h } quota_full_tempfail = yes service auth-worker { user = dovecot } service auth { client_limit = 15000 } service doveadm { inet_listener { port = 24242 } } service imap-login { process_limit = 0 process_min_avail = 16 service_count = 0 } service imap { executable = imap postlogin process_limit = 7000 service_count = 2300 } service lmtp { client_limit = 1 executable = lmtp -L inet_listener lmtp { address = 192.168.72.129 127.0.0.1 port = 24 } process_limit = 240 process_min_avail = 20 service_count = 10 } service pop3-login { process_limit = 0 process_min_avail = 16 service_count = 0 } service pop3 { executable = pop3 postlogin process_limit = 7000 service_count = 2300 } ssl = no submission_host = userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail mail_plugins = notify mail_log quota imap_quota } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %f } protocol lmtp { mail_plugins = notify mail_log quota sieve passdb { args = /etc/dovecot/dovecot-lmtp.conf driver = sql name = } userdb { args = /etc/dovecot/dovecot-lmtp.conf driver = sql name = result_failure = return-fail skip = never } } Please could someone help me? How can I fix that error, in order to avoid the duplicated email? Thanks in advance Regards, -- Gabriele Nencioni System Administrator eml gabriele.nencioni(a)register.it

2 2

Set X-Original-To based an ORCPT?
by Peer Heinlein 08 Aug '18

08 Aug '18

Since http://dovecot.org/pipermail/dovecot-cvs/2014-November/025241.html Dovecot's LMTP does support ORCPT. Is it possible to set X-Original-To-Header based on that ORCPT? Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

5 5

dovecot Panic: file mail-index-sync-update.c: line 1013
by Eugen I 08 Aug '18

08 Aug '18

An email came to several users but one user didn't receive it and we got 'Mail delivery failed' message. As I see from the log below, there were broken index file. Then dovecot repaired that index and we got the error: Panic: file mail-index-sync-update.c: line 1013 (mail_index_sync_map): assertion failed: (map->hdr.indexid == index->indexid || map->hdr.indexid == 0) It was one-time error and it has not reappeared yet. At the moment the user receives emails successfully (in .Queue.A_Sup.group_05 as well). It is supposed that Dovecot had to repair index file and put the email in mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/ directory but it didn't. Is there something wrong with Dovecot? Thanks. --- Operating system: Linux Centos 7 3.10.0-862.3.2.el7.x86_64 #1 SMP Mon May 21 23:36:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux rpm -qa |grep dovecot dovecot-pigeonhole-2.2.10-8.el7.x86_64 dovecot-2.2.10-8.el7.x86_64 dovecot.log output --------------------- Aug 06 23:19:24 lda: Debug: Loading modules from directory: /usr/lib64/dovecot Aug 06 23:19:24 lda: Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Aug 06 23:19:24 lda(user05): Debug: Effective uid=10492, gid=10001, home=/mnt/mail/user05 Aug 06 23:19:24 lda(user05): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/mnt/mail//user05/Maildir:INBOX=/mnt/mail//user05/Maildir Aug 06 23:19:24 lda(user05): Debug: maildir++: root=/mnt/mail//user05/Maildir, index=, indexpvt=, control=, inbox=/mnt/mail//user05/Maildir, alt= Aug 06 23:19:24 lda(user05): Debug: userdb lookup skipped, username taken from USER environment Aug 06 23:19:24 lda(user05): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Aug 06 23:19:24 lda(user05): Debug: Destination address: user05(a)imap.po.com (source: user@hostname) Aug 06 23:19:24 lda(user05): Debug: sieve: Pigeonhole version 0.4.2 initializing Aug 06 23:19:24 lda(user05): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Aug 06 23:19:24 lda(user05): Debug: sieve: executed before user's personal Sieve script(1): /etc/dovecot/sieve/before/priority_colors.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: using the following location for user's Sieve script: /mnt/mail//user05/.dovecot.sieve;name=main script Aug 06 23:19:24 lda(user05): Debug: sieve: executed after user's Sieve script(3): /etc/dovecot/sieve/after/spam.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: opening script 1 of 3 from /etc/dovecot/sieve/before/priority_colors.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: loading script /etc/dovecot/sieve/before/priority_colors.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: script binary /etc/dovecot/sieve/before/priority_colors.svbin successfully loaded Aug 06 23:19:24 lda(user05): Debug: sieve: binary save: not saving binary /etc/dovecot/sieve/before/priority_colors.svbin, because it is already stored Aug 06 23:19:24 lda(user05): Debug: sieve: executing script from /etc/dovecot/sieve/before/priority_colors.svbin Aug 06 23:19:24 lda(user05): Debug: sieve: opening script 2 of 3 from /mnt/mail//user05/.dovecot.sieve;name=main script Aug 06 23:19:24 lda(user05): Debug: sieve: loading script /mnt/mail//user05/.dovecot.sieve;name=main script Aug 06 23:19:24 lda(user05): Debug: sieve: script binary /mnt/mail//user05/.dovecot.svbin successfully loaded Aug 06 23:19:24 lda(user05): Debug: sieve: binary save: not saving binary /mnt/mail//user05/.dovecot.svbin, because it is already stored Aug 06 23:19:24 lda(user05): Debug: sieve: executing script from /mnt/mail//user05/.dovecot.svbin Aug 06 23:19:24 lda(user05): Error: Index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: indexid changed: 1533501509 -> 1464071305 Aug 06 23:19:24 lda(user05): Error: Corrupted transaction log file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index.log seq 3: indexid changed: 1533501509 -> 1464071305 (sync_offset=168) Aug 06 23:19:24 lda(user05): Error: Transaction log file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index.log: marked corrupted Aug 06 23:19:24 lda: Debug: Loading modules from directory: /usr/lib64/dovecot Aug 06 23:19:24 lda(user05): Error: Corrupted index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: messages_count too large (2915 > 85) Aug 06 23:19:24 lda(user05): Warning: fscking index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index Aug 06 23:19:24 lda(user05): Error: Corrupted index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: messages_count too large (2915 > 85) Aug 06 23:19:24 lda(user05): Warning: fscking index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index Aug 06 23:19:24 lda(user05): Error: Fixed index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: log_file_seq 670 -> 2 Aug 06 23:19:24 lda(user05): Error: Fixed index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: messages_count 2915 -> 85 Aug 06 23:19:24 lda(user05): Panic: file mail-index-sync-update.c: line 1013 (mail_index_sync_map): assertion failed: (map->hdr.indexid == index->indexid || map->hdr.indexid == 0) Aug 06 23:19:24 lda(user05): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x6a06e) [0x7f1ada8a106e] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1ada8a10da] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f1ada85952c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x651) [0x7f1adabda2c1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x3e7) [0x7f1adabcab77] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb937d) [0x7f1adabc637d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb9990) [0x7f1adabc6990] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x8c) [0x7f1adabc6a7c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x87) [0x7f1adabb79c7] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d882) [0x7f1adab5a882] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d963) [0x7f1adab5a963] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x802b4) [0x7f1adab8d2b4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7f1adab8d430] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save_open+0xad) [0x7f1adae3240d] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x3f0a2) [0x7f1ad9e130a2] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0xc5) [0x7f1ad9e0b0f5] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0x119) [0x7f1ad9e1b3c9] -> /usr/lib64/dovecot/lib90_sieve_plugin.so(+0x2e97) [0x7f1ada062e97] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x4a) [0x7f1adae32b3a] -> /usr/libexec/dovecot/deliver(main+0x3b5) [0x556390a1e885] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f1ada48c445] -> /usr/libexec/dovecot/deliver(+0x318c) [0x556390a1f18c] dovecot -n output: =========== # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.3.2.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) fuse.encfs auth_verbose = yes first_valid_uid = 1000 lda_mailbox_autocreate = yes log_path = /var/log/dovecot.log mail_debug = yes mail_home = /mnt/mail/%d/%n mail_location = maildir:/mnt/mail/%d/%n/Maildir:INBOX=/mnt/mail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox dat e ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { setting_name = value sieve sieve = /mnt/mail/%d/%n/.dovecot.sieve sieve_after = /etc/dovecot/sieve/after/ sieve_before = /etc/dovecot/sieve/before/ sieve_dir = /mnt/mail/%d/%n/sieve } protocols = imap pop3 lmtp sieve service imap-login { process_limit = 2000 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 1024 } ssl = required ssl_ca = </etc/CERT/SSL_CA_Bundle.pem ssl_cert = </etc/CERT/po.com.crt ssl_key = </etc/CERT/po.com.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 20 } ================

2 1

Reproducible SIGSEGV when Dovecot 2.3 compiled against glibc-2.28
by Reuben Farrelly 08 Aug '18

08 Aug '18

Hi, Dovecot 2.3 (release and current -git) versions compile, but fail to run when compiled against glibc-2.28. This is what is logged on startup: Aug 8 08:24:39 thunderstorm.reub.net dovecot[569]: master: Dovecot v2.3.2.1 (0719df592) starting up for imap, lmtp, sieve, submission, sieve Aug 8 08:24:39 thunderstorm.reub.net dovecot[569]: master: Error: service(auth): command startup failed, throttling for 2 secs Aug 8 08:24:39 thunderstorm.reub.net dovecot[574]: auth: Fatal: master: service(auth): child 582 killed with signal 11 (core dumped) Aug 8 08:24:39 thunderstorm.reub.net dovecot[574]: replicator: Error: userdb lookup: Disconnected unexpectedly Aug 8 08:24:52 thunderstorm.reub.net dovecot[569]: master: Warning: Killed with signal 15 (by pid=670 uid=0 code=kill) The issue is specifically with the 'auth' binary. Other components all appear to be unaffected. The 'auth' binary dies with a Segmentation Fault when run as a standalone executable too. As the auth binary is critical to many different parts of Dovecot, a failure of this is catastrophic. This is a 100% reproducible problem. The platform is Gentoo x86_64. thunderstorm /usr/libexec/dovecot # ./auth-old Segmentation fault thunderstorm /usr/libexec/dovecot # [I've renamed the original binary to auth-old, and put in it's place a working 'auth' binary built against glibc-2.27 in order to have a functioning system] Problem matrix looks like this: Build on a glibc-2.27 system, run on a glibc-2.27 - OK Build on a glibc-2.27 system, run on a glibc-2.28 - OK Build on a glibc-2.28 system, run on a glibc-2.27 - SEGFAULT Build on a glibc-2.28 system, run on a glibc-2.28 - SEGFAULT (All other components including gcc otherwise identical) ./configure --prefix=/usr --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu --mandir=/usr/share/man --infodir=/usr/share/info --datadir=/usr/share --sysconfdir=/etc --localstatedir=/var/lib --disable-dependency-tracking --disable-silent-rules --docdir=/usr/share/doc/dovecot-9999_p20180807 --htmldir=/usr/share/doc/dovecot-9999_p20180807/html --libdir=/usr/lib64 --with-rundir=/run/dovecot --with-statedir=/var/lib/dovecot --with-moduledir=/usr/lib64/dovecot --without-stemmer --disable-rpath --without-libbsd --with-icu --with-ssl --with-systemdsystemunitdir=/lib/systemd/system --with-sodium --with-bzlib --without-libcap --without-gssapi --without-lua --without-ldap --with-lucene --with-lz4 --with-lzma --without-mysql --with-pam --without-pgsql --without-sqlite --without-solr --with-libwrap --without-textcat --without-vpopmail --with-zlib --disable-static Strace: thunderstorm /usr/libexec/dovecot # strace ./auth-old execve("./auth-old", ["./auth-old"], 0x7ffd17c804c0 /* 27 vars */) = 0 brk(NULL) = 0x557e9dc28000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/x86_64/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls/x86_64/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/x86_64/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/x86_64/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libstats_auth.so", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\t\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=18848, ...}) = 0 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3eef676000 mmap(NULL, 2105632, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eef24f000 mprotect(0x7f3eef251000, 2093056, PROT_NONE) = 0 mmap(0x7f3eef450000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x7f3eef450000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/x86_64/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls/x86_64/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/x86_64/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/x86_64/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p\277\3\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=4783816, ...}) = 0 mmap(NULL, 4186392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eeee50000 mprotect(0x7f3eef043000, 2093056, PROT_NONE) = 0 mmap(0x7f3eef242000, 40960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1f2000) = 0x7f3eef242000 mmap(0x7f3eef24c000, 8472, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eef24c000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=54433, ...}) = 0 mmap(NULL, 54433, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f3eef668000 close(3) = 0 openat(AT_FDCWD, "/lib64/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=39064, ...}) = 0 mmap(NULL, 2322976, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eeec18000 mprotect(0x7f3eeec20000, 2097152, PROT_NONE) = 0 mmap(0x7f3eeee20000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x8000) = 0x7f3eeee20000 mmap(0x7f3eeee22000, 184864, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eeee22000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libpam.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libpam.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/lib64/libpam.so.0", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200&\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=55840, ...}) = 0 mmap(NULL, 2151000, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eeea0a000 mprotect(0x7f3eeea17000, 2093056, PROT_NONE) = 0 mmap(0x7f3eeec16000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x7f3eeec16000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libsodium.so.23", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libsodium.so.23", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/libsodium.so.23", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\305\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=318056, ...}) = 0 mmap(NULL, 2413576, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eee7bc000 mprotect(0x7f3eee809000, 2093056, PROT_NONE) = 0 mmap(0x7f3eeea08000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x4c000) = 0x7f3eeea08000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\3407\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1869376, ...}) = 0 mmap(NULL, 3975016, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eee3f1000 mprotect(0x7f3eee5b3000, 2093056, PROT_NONE) = 0 mmap(0x7f3eee7b2000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1c1000) = 0x7f3eee7b2000 mmap(0x7f3eee7b8000, 14184, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eee7b8000 close(3) = 0 openat(AT_FDCWD, "/lib64/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\16\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=14424, ...}) = 0 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3eef666000 mmap(NULL, 2109712, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eee1ed000 mprotect(0x7f3eee1f0000, 2093056, PROT_NONE) = 0 mmap(0x7f3eee3ef000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f3eee3ef000 close(3) = 0 openat(AT_FDCWD, "/lib64/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\0j\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=118024, ...}) = 0 mmap(NULL, 2229408, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eedfcc000 mprotect(0x7f3eedfe8000, 2093056, PROT_NONE) = 0 mmap(0x7f3eee1e7000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b000) = 0x7f3eee1e7000 mmap(0x7f3eee1e9000, 13472, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eee1e9000 close(3) = 0 mmap(NULL, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3eef663000 arch_prctl(ARCH_SET_FS, 0x7f3eef663b80) = 0 mprotect(0x7f3eee7b2000, 16384, PROT_READ) = 0 mprotect(0x7f3eee1e7000, 4096, PROT_READ) = 0 mprotect(0x7f3eee3ef000, 4096, PROT_READ) = 0 mprotect(0x7f3eeea08000, 4096, PROT_READ) = 0 mprotect(0x7f3eeec16000, 4096, PROT_READ) = 0 mprotect(0x7f3eeee20000, 4096, PROT_READ) = 0 mprotect(0x7f3eef242000, 28672, PROT_READ) = 0 mprotect(0x7f3eef450000, 4096, PROT_READ) = 0 mprotect(0x557e9c5e7000, 12288, PROT_READ) = 0 mprotect(0x7f3eef678000, 4096, PROT_READ) = 0 munmap(0x7f3eef668000, 54433) = 0 set_tid_address(0x7f3eef663e50) = 19762 set_robust_list(0x7f3eef663e60, 24) = 0 rt_sigaction(SIGRTMIN, {sa_handler=0x7f3eedfd2380, sa_mask=[], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f3eedfe0400}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {sa_handler=0x7f3eedfd2430, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO, sa_restorer=0x7f3eedfe0400}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0 getrandom("\xfb\x47\x75\x83", 4, 0) = 4 brk(NULL) = 0x557e9dc28000 brk(0x557e9dc49000) = 0x557e9dc49000 uname({sysname="Linux", nodename="thunderstorm", ...}) = 0 getpid() = 19762 openat(AT_FDCWD, "/dev/null", O_WRONLY) = 3 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 rt_sigaction(SIGPIPE, {sa_handler=SIG_IGN, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART, sa_restorer=0x7f3eee4297c0}, NULL, 8) = 0 rt_sigaction(SIGALRM, {sa_handler=0x7f3eeef9899b, sa_mask=[], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f3eee4297c0}, NULL, 8) = 0 openat(AT_FDCWD, "/proc/sys/crypto/fips_enabled", O_RDONLY) = -1 ENOENT (No such file or directory) --- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0xffffffffeee4f200} --- +++ killed by SIGSEGV +++ Segmentation fault thunderstorm /usr/libexec/dovecot # gdb: thunderstorm /var/core # gdb auth core.auth.18428 GNU gdb (Gentoo 8.1.1 p1) 8.1.1 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from auth...done. warning: exec file is newer than core file. [New LWP 18428] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/auth'. Program terminated with signal SIGSEGV, Segmentation fault. #0 __strcmp_sse2_unaligned () at ../sysdeps/x86_64/multiarch/strcmp-sse2-unaligned.S:31 31 ../sysdeps/x86_64/multiarch/strcmp-sse2-unaligned.S: No such file or directory. (gdb) bt full #0 __strcmp_sse2_unaligned () at ../sysdeps/x86_64/multiarch/strcmp-sse2-unaligned.S:31 No locals. #1 0x000055bbe3362dcf in password_scheme_register_crypt () at password-scheme-crypt.c:191 i = 0 crypted = 0xfffffffffdbcf200 <error: Cannot access memory at address 0xfffffffffdbcf200> __func__ = <optimized out> #2 0x000055bbe33627cb in password_schemes_init () at password-scheme.c:874 i = 27 #3 0x000055bbe332a82a in main_preinit () at main.c:185 mod_set = { abi_version = 0xfe2096c0 <error: Cannot access memory at address 0xfe2096c0>, binary_name = 0x599ce8cff6a85000 <error: Cannot access memory at address 0x599ce8cff6a85000>, setting_name = 0x7f1efdc1b011 <__x86_return_thunk+5> "\363\220\017\256\350\353\371H\215d$\b\303\350\a", filter_callback = 0x7f1efdc51029 <master_getopt+149>, filter_context = 0x7f1efdc1b011 <__x86_return_thunk+5>, require_init_funcs = false, debug = false, ignore_dlopen_errors = false, ignore_missing = false} services = 0x55bbe3819fa0 #4 0x000055bbe332aef5 in main (argc=1, argv=0x55bbe3819ae0) at main.c:392 c = -1 (gdb) Release notes for glibc are here: https://www.sourceware.org/ml/libc-alpha/2018-08/msg00003.htm There are some notes about changes to crypt functions which could be relevant given the gdb has references to crypt password schemes. I have libgcrypt-1.8.3 installed but I _haven't_ specifically disabled crypt in glibc (see release notes). Thanks, Reuben

3 6

Error: connect(ipc-proxy) failed: Permission denied
by MAREN ZUBIZARRETA 08 Aug '18

08 Aug '18

Hello: We have got 2 directors and three backend mailbox servers. I get the following error " Error: connect(ipc-proxy) failed: Permission denied". I have read the article https://www.dovecot.org/list/dovecot/2012-August/137349.html and we have done as signaled in the two director servers with no success, So, we have tried now to set it like this: service ipc { unix_listener ipc { user = dovecot # This is already the default in v2.3.1+ group = mode = 0777 } } that cause the socket to have full permissions: srwxrwxrwx 1 dovecot root 0 ago 8 10:00 /var/run/dovecot/ipc but even so, I still get the same behaviour. And when you try "doveadm director kick user" , nothing happens Can anyone give me any hint. Thanks a lot in advance Maren Zubizarreta Sistemen Analista / Analista de Sistemas maren.zubizarreta(a)ehu.es<mailto:maren.zubizarreta@ehu.es> 94 601 8389 IKT GERENTEORDETZA/VICEGERENCIA TIC UPV/EHU Barrio Sarriena,s/n | 48940 LEIOA T.: +34 946012000 | F.: +34 946012200 www.ehu.es<http://www.ehu.es/> [http://www.unibertsitate-hedakuntza.ehu.es/p268-content/es/contenidos/infor…] ERNE! Baliteke mezu honen zatiren bat edo mezu osoa legez babestuta egotea. Mezuak badu bere hartzailea. Okerreko helbidera heldu bada (helbidea gaizki idatzi, transmisioak huts egin) eman abisu igorleari, korreo honi erantzunda. Kontuz! Mezua ez bada zuretzat, ez erabili, ez zabaldu beste inori, ez kopiatu eta ez baliatu. ¡ATENCIÓN! Este mensaje contiene información privilegiada o confidencial a la que sólo tiene derecho a acceder el destinatario. Si usted lo recibe por error le agradeceríamos que no hiciera uso de la información y que se pusiese en contacto con el remitente. [http://www.unibertsitate-hedakuntza.ehu.es/p077-9030/es/contenidos/informac…] E-mail hau inprimatu baino lehen egiaztatu inprimatzeko beharra. Antes de imprimir este e-mail piense bien si es necesario hacerlo.

1 0

AW: 2.3.2.1 - relay to lmtps from other lan host
by Tobi 06 Aug '18

06 Aug '18

You have lmtp as unix socket configured but want to access from remote via tcp socket? I think you need inet_listener instead of unix_ listener ----- Originale Nachricht ----- Von: "ѽ҉ᶬḳ℠" <vtol(a)gmx.net> Gesendet: 06.08.18 - 20:14 An: dovecot <dovecot(a)dovecot.org> Betreff: 2.3.2.1 - relay to lmtps from other lan host > Hi, > > looked into the [ dovecot wiki ] but a search for [ lmtps ] came up > empty and thus hoping to get some assistance here. > > I am trying to relay with [ msmtp ] via [ lmtps ] from a lan host other > than [ dovecot ] is running on. > > [ dovecot config ] > >> service lmtp { >> unix_listener lmtp { >> #mode = 0666 >> } > > [ ss -wxl | grep lmtp ] >> u_strLISTEN 0 100 /var/run/dovecot/lmtp 68262 * 0 > > So far so good. Now from the other lan host -> [ msmtp --serverinfo > --tls --tls-certcheck=off --host=172.24.109.6 --protocol=lmtp --port=262 > ] produces: > >> msmtp: cannot connect to 172.24.109.6, port 262: Connection refused > >

2 2

2.3.2.1 - relay to lmtps from other lan host
by ѽ҉ᶬḳ℠ 06 Aug '18

06 Aug '18

Hi, looked into the [ dovecot wiki ] but a search for [ lmtps ] came up empty and thus hoping to get some assistance here. I am trying to relay with [ msmtp ] via [ lmtps ] from a lan host other than [ dovecot ] is running on. [ dovecot config ] > service lmtp { > unix_listener lmtp { > #mode = 0666 > } [ ss -wxl | grep lmtp ] > u_strLISTEN 0 100 /var/run/dovecot/lmtp 68262 * 0 So far so good. Now from the other lan host -> [ msmtp --serverinfo --tls --tls-certcheck=off --host=172.24.109.6 --protocol=lmtp --port=262 ] produces: > msmtp: cannot connect to 172.24.109.6, port 262: Connection refused

3 2

dsync not replicating ".dovecot.sieve -> .sieve/managesieve.sieve"
by Tony 06 Aug '18

06 Aug '18

Hi, Currently using dovecot 2.3.2.1 and pigeonhole 0.5.2 on two identical hosts. I recently noticed ".dovecot.sieve" and ".sieve/managesieve.sieve" are not replicating from one host to the other in either direction. Mail is having no trouble replicating on both hosts with dsync, it is only sieve files that are not replicating for unclear reasons. # doveconf -n host 1: https://ptpb.pw/njs3 host 2: https://ptpb.pw/KsfK If I enable sieve debug logs I don't see anything that would cause alarm. The error logs are also not reporting any trouble. I have tested creating filters in Roundcube which is hosted from host1. This creates the sieve files as expected, but the same sieve files do not replicate to host2. When using Sieve with Thunderbird if the sieve files are created on host1 or host2, these are not replicating with dsync. So it does not seem to matter if the sieve files are created on either host and with any mail client, they just do not replicate at all. # host1 stat /home/vmail/example.email/user\(a)example.email/.dovecot.sieve File: /home/vmail/example.email/user(a)example.email/.dovecot.sieve -> .sieve/managesieve.sieve Size: 24 Blocks: 0 IO Block: 4096 symbolic link Device: 800h/2048d Inode: 596605 Links: 1 Access: (0777/lrwxrwxrwx) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 15:24:41.351827516 -0700 Modify: 2018-08-05 15:24:41.351827516 -0700 Change: 2018-08-05 15:24:41.351827516 -0700 Birth: - stat /home/vmail/example.email/user\(a)example.email/.sieve/managesieve.sieve File: /home/vmail/example.email/user(a)example.email/.sieve/managesieve.sieve Size: 65 Blocks: 8 IO Block: 4096 regular file Device: 800h/2048d Inode: 1657978 Links: 1 Access: (0600/-rw-------) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 15:27:30.034984088 -0700 Modify: 2018-08-05 15:27:30.034984088 -0700 Change: 2018-08-05 15:27:30.034984088 -0700 Birth: - # host2 stat /home/vmail/example.email/user\(a)example.email/.dovecot.sieve File: /home/vmail/example.email/user(a)example.email/.dovecot.sieve -> .sieve/managesieve.sieve Size: 24 Blocks: 0 IO Block: 4096 symbolic link Device: fe03h/65027d Inode: 787482 Links: 1 Access: (0777/lrwxrwxrwx) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 16:10:54.832151815 -0700 Modify: 2018-08-05 16:10:54.815484905 -0700 Change: 2018-08-05 16:10:54.815484905 -0700 Birth: - stat /home/vmail/example.email/user\(a)example.email/.sieve/managesieve.sieve File: /home/vmail/example.email/user(a)example.email/.sieve/managesieve.sieve Size: 18 Blocks: 8 IO Block: 4096 regular file Device: fe03h/65027d Inode: 786938 Links: 1 Access: (0600/-rw-------) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 16:10:54.815484905 -0700 Modify: 2018-08-05 16:10:49.818745528 -0700 Change: 2018-08-05 16:10:49.822078910 -0700 Birth: - Here is the Maildir tree view. tree -a /home/vmail/example.email/user\(a)example.email/ /home/vmail/example.email/user(a)example.email/ ├── .dovecot.sieve -> .sieve/managesieve.sieve ├── Maildir │ ├── .Archive │ │ ├── cur │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── cur │ │ ├── 1531611877.M860311P418538.mail,S=5999,W=6167:2,RS │ │ ├── 1531624146.M201381P535494.mail,S=2133,W=2184:2,S │ │ ├── 1533194577.M483202P864896.mail,S=6117,W=6393:2,S │ │ └── 1533195582.M123163P877084.mail,S=1739,W=1786:2,S │ ├── dovecot.index │ ├── dovecot.index.cache │ ├── dovecot.index.log │ ├── dovecot-keywords │ ├── dovecot.list.index │ ├── dovecot.list.index.log │ ├── dovecot.mailbox.log │ ├── dovecot-uidlist │ ├── dovecot-uidvalidity │ ├── dovecot-uidvalidity.5b4a79b5 │ ├── .Drafts │ │ ├── cur │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── maildirsize │ ├── new │ ├── .Sent │ │ ├── cur │ │ │ ├── 1531611855.M403833P418688.mail,S=3510,W=3623:2,S │ │ │ └── 1531624037.M238133P535494.mail,S=436,W=451:2,S │ │ ├── dovecot.index.cache │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── .Sent Messages │ │ ├── cur │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── .Spam │ │ ├── cur │ │ ├── dovecot.index.cache │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── subscriptions │ ├── tmp │ └── .Trash │ ├── cur │ ├── dovecot.index.cache │ ├── dovecot.index.log │ ├── dovecot-uidlist │ ├── maildirfolder │ ├── new │ └── tmp └── .sieve ├── managesieve.sieve └── tmp 30 directories, 41 files I know at one point sieve files must have been replicating with dsync, it's just not clear to me at which version of dovecot and pigeonhole this began with the exception of mail files which are replicating. Cheers, Tony

2 1

Re: replication fails and corrupts index with zlib enabled
by fauno 05 Aug '18

05 Aug '18

El 04/08/18 a las 13:13, Aki Tuomi escribió: > There has definetly been fixes in this area since 2.2.13 and most likely your issue is fixed. Thanks! I built 2.2.36, I'll test it and come back with results :)

1 0

Assertion failure with IMAP NOTIFY
by Florian Pritz 05 Aug '18

05 Aug '18

Hi, For a few weeks I've been running a custom notification script[1] that uses IMAP NOTIFY. The script uses a single connection, sets up a NOTIFY watch on a couple of mailboxes + automatic FETCH for the selected mailbox. If a status update arrives for a different mailbox, it selects that box and fetches the mail. Today I got the following error in the log: > Aug 5 14:56:12 karif dovecot[1881]: imap(xxxx)<22699><TBjUXqtyZI5R2c0k>: Panic: file mail.c: line 242 (mail_get_header_stream): assertion failed: (headers->box == mail->box) > Aug 5 14:56:12 karif dovecot[1881]: imap(xxxx)<22699><TBjUXqtyZI5R2c0k>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcfbff) [0x7fda11806bff] -> /usr/lib/dovecot/libdovecot.so.0(+0xcfcba) [0x7fda11806cba] -> /usr/lib/dovecot/libdovecot.so.0(+0x414bb) [0x7fda117784bb] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x3566e) [0x7fda11aec66e] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x43b) [0x7fda11bb3a1b] -> dovecot/imap(+0x211ed) [0x55e00d2a21ed] -> dovecot/imap(+0x1f69c) [0x55e00d2a069c] -> dovecot/imap(imap_fetch_more_no_lock_update+0xf) [0x55e00d2a17ff] -> dovecot/imap(+0x23891) [0x55e00d2a4891] -> dovecot/imap(imap_client_notify_newmails+0xfa) [0x55e00d2a4a6a] -> dovecot/imap(imap_sync_more+0x755) [0x55e00d2a9f75] -> dovecot/imap(+0x29006) [0x55e00d2aa006] -> dovecot/imap(cmd_sync_delayed+0x27b) [0x55e00d2aa50b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0x10d) [0x7fda1181c82d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd2) [0x7fda1181df52] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4d) [0x7fda1181caad] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x41) [0x7fda1181cc11] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0x7fda117a0074] -> dovecot/imap(main+0x342) [0x55e00d28fb82] -> /usr/lib/libc.so.6(__libc_start_main+0xeb) [0x7fda1139e06b] -> dovecot/imap(_start+0x2a) [0x55e00d28fd1a] > Aug 5 14:56:12 karif dovecot[1881]: imap(xxxx)<22699><TBjUXqtyZI5R2c0k>: Fatal: master: service(imap): child 22699 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set /proc/sys/fs/suid_dumpable to 2) I'm not sure what happened exactly, but I can tell you that a new mail, that went to the selected mailbox (INBOX), was arriving at the time of the crash. The script logs the IMAP traffic (sadly without timestamps so far). Here's a slightly censored (3 dots in a few places) and stripped log in the hope that it helps. Lines prefixed with >> are sent to the server, those with << are received from the server. > [login stuff] > server-speed >> CMD-2 notify set (selected (MessageExpunge MessageNew (uid body.peek[header.fields (from to subject)]))) (mailboxes (INBOX INBOX.Postmaster ... ... ... ...) (MessageNew MessageExpunge MailboxName)) > server-speed << CMD-2 OK NOTIFY completed (0.002 + 0.000 + 0.001 secs). > [various untagged fetches/selects + fetch/noops] > [script was in a different mailbox, status update for INBOX arrives thus script select INBOX] > server-speed >> CMD-51 select INBOX > server-speed << * OK [CLOSED] Previous mailbox closed. > server-speed << * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $MDNSent Junk redirected $label2 $label4 $label5 NonJunk $Forwarded $label3 $label1 done Old) > server-speed << * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $MDNSent Junk redirected $label2 $label4 $label5 NonJunk $Forwarded $label3 $label1 done Old \*)] Flags permitted. > server-speed << * 20 EXISTS > server-speed << * 1 RECENT > server-speed << * OK [UNSEEN 14] First unseen. > server-speed << * OK [UIDVALIDITY 1336752926] UIDs valid > server-speed << * OK [UIDNEXT 41885] Predicted next UID > server-speed << * OK [HIGHESTMODSEQ 138681] Highest > server-speed << CMD-51 OK [READ-WRITE] Select completed (0.001 + 0.000 secs). > server-speed >> CMD-52 uid fetch 41884 (body.peek[header.fields (from to subject)]) > server-speed << * 20 FETCH (UID 41884 BODY[HEADER.FIELDS (FROM TO SUBJECT)] {164} > server-speed << From: ... > server-speed << To: ... > server-speed << Subject: ... > server-speed << > server-speed << ) > server-speed << CMD-52 OK Fetch completed (0.001 + 0.000 secs). > Got data for notification: [...] > Sending notification with data: {...} > [the next few lines happen over a span of roughly 9 minutes] > server-speed << * 20 EXPUNGE > server-speed << * 0 RECENT > server-speed << * 8 EXPUNGE > server-speed << * 11 EXPUNGE > server-speed << * 18 EXISTS > server-speed << * 1 RECENT > server-speed << * 18 FETCH (UID 41885 > [this is apparnently when the server crashed] I'm afraid I can't reproduce the issue and I don't have the time to try right now, so I can't provide much more information than what is in here. Still, if you have questions, feel free to ask me. Just know that I won't be getting you a better backtrace/coredump any time soon. [1] https://git.server-speed.net/users/flo/App-ImapNotify/tree/ Florian

1 1

limit sharing ability to certain users
by simeon.ott＠onnet.ch 05 Aug '18

05 Aug '18

Hello Is it possible to limit the ability of sharing it’s own mailboxes to only a few users? We have a few sensitive mailboxes of users where the ability to share via IMAP SETACL should be prevented. I tried the following so far… doveadm acl remove -u test(a)onnet.ch <mailto:test@onnet.ch> INBOX user=test(a)onnet.ch <mailto:user=test@onnet.ch> admin but when doing this the admin rights are still there doveadm acl rights -u test(a)onnet.ch <mailto:test@onnet.ch> INBOX vmail@buserver:~$ doveadm acl rights -u test(a)onnet.ch <mailto:test@onnet.ch> INBOX Rights lookup read write write-seen write-deleted insert post expunge create delete admin Thanks in advance for your help Simeon

1 0

replication fails and corrupts index with zlib enabled
by fauno 04 Aug '18

04 Aug '18

Hi, I have two Debian Jessie servers with Dovecot 2.2.13 TCP replication on that have worked fine for years, but now one of them is running low on disk space, so I wanted to try enabling zlib. I crafted a script following the description given in https://wiki.dovecot.org/Plugins/Zlib and xz'ed some inboxes on the stand-by server, the one with low disk space. So every email in those inboxes is xz'ed but the file name hasn't changed and contains the original size. This server is on stand-by so most of the email is replicated unidirectionally to it. But administrative emails like cronjobs and monitoring are delivered locally, so it replicates those to the hot server. The issue appeared when this stand-by server receives such an email and tries to replicate them to the other server. I'm attaching the full snippet of the log from the hot server, because it throws a longer backtrace. The short version is like this: dovecot[8438]: imap(redacted(a)address.org): Error: Cached message size larger than expected (478 > 289) dovecot[8438]: imap(redacted(a)address.org): Error: Maildir filename has wrong S value, renamed the file from /srv/email/address.org/redacted/Maildir/cur/1533393328.M502775P20341.standby_server,S=478:2, to /srv/email/address.org/redacted/Maildir/cur/1533393328.M502775P20341.standby_server,S=289:2, dovecot[8438]: imap(redacted(a)address.org): Error: Corrupted index cache file /srv/email/address.org/redacted/Maildir/dovecot.index.cache: Broken physical size for mail UID 45123 After this there's an error and the replication fails. The file is there, it's gzipped and can be zcat'ed but it appears as a blank email on clients. I've recovered a backup but the issue persists. I also changed from xz to gz because the Debian package docs only mention gz and bzip2, but the issue is the same. From what I understand and tested, the stand-by server is receiving the email and compressing it but maintaining the original size on the file name. So that's ok, but when the hot server receives the copy, it believes the size is wrong and changes it to the compressed size. Then for some reason the index gets corrupted. I'm attaching the doveconf for both servers. They're mostly the same, and the only changes introduced were the zlib plugin and its options. Also the script(s) that I used to compress the inboxes. Am I correct? Is it an issue of replicator not understanding the emails are compressed? I couldn't find anything related to zlib with replication. Maybe it's something fixed in newer versions and I should go that rabbit hole? Thanks! :)

2 1

Proxy lmtp to smtp server
by grupo correo 03 Aug '18

03 Aug '18

Hi, I need to use lmtp server proxy, to proxy a remote smtp server, the documentation says "It's possible to use Dovecot LMTP server as a proxy to remote LMTP or SMTP servers", but i do not find how to configure. Can anybody gel me to understand? Best regards

3 6

Re: ssl_dh required, even though DH is disabled.
by Aki Tuomi 03 Aug '18

03 Aug '18

Hi! This change has now been committed, please find it at https://github.com/dovecot/core/compare/cd08262%5E...dd6323.patch Aki On 16.07.2018 09:53, Aki Tuomi wrote: > This is a known issue, but thanks for reporting it. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Eric Toombs <ewtoombs(a)uwaterloo.ca> > Date: 16/07/2018 08:41 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: ssl_dh required, even though DH is disabled. > > Here's my config: > > # 2.3.2 (582970113): /etc/dovecot/dovecot.conf > # OS: Linux 4.17.5-1-ARCH x86_64 Arch Linux > # Hostname: vault > passdb { > driver = pam > } > protocols = imap > service imap-login { > inet_listener imap { > port = 0 > } > } > ssl = required > ssl_cert = </etc/letsencrypt/live/myhostname.com/fullchain.pem > ssl_cipher_list = > ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA:ECDHE-ECDSA-AES128-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384 > ssl_key = # hidden, use -P to show it > ssl_min_protocol = TLSv1.2 > > My filesystem is ext4. > > Even though I use ssl_cipher_list to forbid DH, dovecot still doesn't > work unless I provide an ssl_dh, delivering the following error: > > > Jul 14 21:48:08 vault dovecot[8349]: imap-login: Error: Failed to > initialize SSL server context: Couldn't parse DH parameters: > error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: DH > PARAMETERS: user=<>, rip=10.0.0.1, lip=10.0.0.2, > session=<4sGi5/9w3pwKAAAB> > > While providing an ssl_dh is only a minor annoyance, it would be nice if > I didn't have to.

1 0

Dovecot lifecycle announcement
by Aki Tuomi 03 Aug '18

03 Aug '18

Hi! We are giving the following end of life (EOL) statements: For any version before 2.2, we are not going to be providing any patches or fixes. This has been the case before, but we are now officially declaring them EOL. For 2.2 versions, we are going to provide security and critical bug fixes for 2.2.36 only. If you are using 2.2.x version prior to .36, we will not be providing anything other than critical security fixes. This means that if you are experiencing a problem with Dovecot, we need you to upgrade into latest 2.3 release and reproduce the problem there. If this happens, please file a bug report and we are more than happy to take a look! If you are using a 2.2.x version packaged from an Operating System Vendor, please open a bug against them for fixing it. We do not provide patches or bug fixes against these OS Vendor specific releases. 2.3.x is the current main release, which will receive feature, bug and security patches. We accept bug reports against latest 2.3 version or master version of Dovecot. If you need packages for 2.3, please see https://repo.dovecot.org. Thank you for using Dovecot! Note: Users with a commercial agreement with Open-Xchange (Dovecot Pro) have a separate EOL policy, so this announcement does not apply to those customers. Aki Tuomi Open-Xchange Oy

1 0

Debugging rules with Pigeonhole Sieve
by Pete Gonzalez 03 Aug '18

03 Aug '18

I have a lot of rules in my Sieve script. Sometimes an email message ends up in the wrong folder, due to a problem with one of the rules. However, this is very difficult to debug, because I have no idea which rule matched the email. A log file might be helpful, but that wouldn't be readable without shell access to the mail server. This is not a solution that would work for everyday users, who configure their rules via a web page UI. What would be great would be for the Sieve interpreter to append a custom header to each email message after it gets processed. This header would record which Sieve rules matched the email. Does this feature exist already? Or is there a way to accomplish it via the Dovecot server configuration? Thanks!

1 0

Managesieve stopped working - Undefined symbol "i_stream_read_memarea"
by Henrik Larsson 02 Aug '18

02 Aug '18

After upgrading Dovecot to 2.3.2.1 and Pigeonhole to 0.5.2, managesieve stopped working. I'm using FreeBSD ports tree, to build these. Only domains have been modified in below output. A FreeBSD bug report have also been created. But I'm not sure if this is FreeBSD ports related or Dovecot/Pigeonhole related: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=228067 %uname -a FreeBSD 10.4-RELEASE-p9 FreeBSD 10.4-RELEASE-p9 #0: Sat Jul 14 22:38:37 CEST 2018 /usr/obj/usr/src/sys/GENERIC amd64 %pkg version -v dovecot-2.3.2.1 = up-to-date with index dovecot-pigeonhole-0.5.2_2 = up-to-date with index %dmesg -a /usr/local/libexec/dovecot/managesieve: Undefined symbol "i_stream_read_memarea" doveconf: Error: managesieve-login: dump-capability process returned 1 % dovecot -n # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) /usr/local/libexec/dovecot/managesieve: Undefined symbol "i_stream_read_memarea" doveconf: Error: managesieve-login: dump-capability process returned 1 # OS: FreeBSD 10.4-RELEASE-p9 amd64 # Hostname: mail.example.com auth_mechanisms = plain login first_valid_uid = 125 hostname = mail.example.com listen = * log_path = /var/log/dovecot mail_plugins = zlib mail_privileged_group = postfix mail_temp_dir = /var/db/dovecot namespace compat { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox "Sent Items" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /home/mail/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service lmtp { executable = lmtp -L unix_listener /home/mail/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/example.com-chained.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { log_path = /var/log/dovecot-deliver mail_plugins = zlib sieve } protocol lda { mail_plugins = zlib sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib imap_zlib }

2 5

Re: LMTP error, mysterious
by Andras Kemeny 01 Aug '18

01 Aug '18

you mean i should define another, "fallback" userdb service if prefetch doesn't work for some reason? is it the problem that it's a chicken and egg scenario and with LMTP address verification (from postfix) there is no login beforehand so then dovecot needs to consult the userdb once again and having no fallback mechanism, it gives up? i can understand that, but then it would need to be emphasized in either the prefetch document or the lmtp document on the wiki. i've tried it and now it works, thank you ever so much. (but please make a mental note to add this info on the wiki.) cheers, a 2018. 08. 02. 1:10 keltezéssel, Aki Tuomi írta: > applies for ldap too if you use prefetch. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Andras Kemeny <pdx(a)pdx.hu> > Date: 02/08/2018 01:59 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: LMTP error, mysterious > > ah well, but i'm not using sql at all. > > here's doveconf -n: > > # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.16 (fed8554) > # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.4 > auth_cache_negative_ttl = 0 > auth_mechanisms = plain login > hostname = rhyno.tech > mail_debug = yes > mail_location = maildir:~/mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocols = " imap lmtp pop3" > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 0 > } > } > ssl_cert = </etc/letsencrypt/live/wc-rhyno.tech/fullchain.pem > ssl_key = # hidden, use -P to show it > submission_host = localhost:25 > userdb { > driver = prefetch > } > protocol lmtp { > mail_plugins = sieve > } > protocol lda { > mail_plugins = sieve > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > } > > > 2018. 08. 02. 0:48 keltezéssel, Aki Tuomi írta: >> protocol lmtp { >> userdb { >> driver = sql >> args = /path/to/dovecot-sql.conf.ext >> } >> } >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Andras Kemeny <pdx(a)pdx.hu> >> Date: 02/08/2018 01:35 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: LMTP error, mysterious >> >> hi (especially to you, Aki), >> >> so to solve the previous UID issue, i went the full LMTP route. however, >> i seem to be having problems with the prefetch userdb (i'm trying to >> minimize load on the LDAP server). namely, the log says: >> >> Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: >> client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik >> Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: >> message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> >> Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: >> from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) >> Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local >> Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): >> userdb lookup not possible with only userdb prefetch >> Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user >> aik(a)rhyno.tech: Auth USER lookup failed >> Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: >> to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], >> delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host >> beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> >> Internal error occurred. Refer to server log for more information. (in >> reply to RCPT TO command)) >> Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: >> Successful quit >> Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from >> localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 >> >> (the above is a transcript of a full session i've done over telneting to >> localhost 587 and auth login-ing with valid credentials) >> >> so, i've tested the actual login process, and it works flawlessly, and >> it looks like IMAP is up and running: >> >> Connected to localhost. >> Escape character is '^]'. >> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. >> 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword >> 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS >> THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN >> NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH >> ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE >> SPECIAL-USE] Logged in >> 1 list "" "%" >> * LIST (\HasNoChildren \Sent) "." Sent >> * LIST (\HasNoChildren \Trash) "." Trash >> * LIST (\HasNoChildren) "." INBOX >> 1 OK List completed (0.000 + 0.000 secs). >> 2 status INBOX (MESSAGES) >> * STATUS INBOX (MESSAGES 2) >> 2 OK Status completed (0.000 + 0.000 secs). >> >> this is how i send the test mails: >> >> Connected to localhost. >> Escape character is '^]'. >> 220 beach.rhyno.tech mail server >> ehlo x >> 250-beach.rhyno.tech >> 250-PIPELINING >> 250-SIZE 10240000 >> 250-ETRN >> 250-STARTTLS >> 250-AUTH PLAIN LOGIN >> 250-AUTH=PLAIN LOGIN >> 250-ENHANCEDSTATUSCODES >> 250-8BITMIME >> 250-DSN >> 250 SMTPUTF8 >> auth login >> 334 VXNlcm5hbWU6 >> ***obviously_masked*** >> 334 UGFzc3dvcmQ6 >> ***obviously_masked*** >> 235 2.7.0 Authentication successful >> mail from:<pdx(a)pdx.hu> >> 250 2.1.0 Ok >> rcpt to:<aik(a)rhyno.tech> >> 250 2.1.5 Ok >> data >> 354 End data with <CR><LF>.<CR><LF> >> test >> . >> 250 2.0.0 Ok: queued as 5EEF35C05C5 >> quit >> 221 2.0.0 Bye >> Connection closed by foreign host. >> >> my concern is these two: >> >> Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): >> userdb lookup not possible with only userdb prefetch >> Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user >> aik(a)rhyno.tech: Auth USER lookup failed >> >> 10-auth.conf has these settings: >> >> passdb { >> driver = ldap >> args = /etc/dovecot/dovecot-ldap.conf.ext >> } >> userdb { >> driver = prefetch >> } >> >> dovecot-ldap.conf.ext has these settings (only the relevant ones) >> >> dn = ***whatever, it works*** >> dnpass = ***whatever, it works*** >> auth_bind = no >> base = dc=rhyno,dc=tech >> pass_attrs = \ >> =user=%{ldap:uid}, \ >> =password=%{ldap:userPassword}, \ >> =userdb_home=%{ldap:homeDirectory}, \ >> =userdb_uid=%{ldap:uidNumber}, \ >> =userdb_gid=%{ldap:gidNumber} >> pass_filter = >> (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) >> >> so what am i missing? also, this format of setting variables >> (=<output_field>=%{<whatever_special_result_field>}) is never explained >> on the wiki (or am i just blind?) >> >> thanks in advance, >> a >> >

1 0

Re: LMTP error, mysterious
by Andras Kemeny 01 Aug '18

01 Aug '18

ah well, but i'm not using sql at all. here's doveconf -n: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.4 auth_cache_negative_ttl = 0 auth_mechanisms = plain login hostname = rhyno.tech mail_debug = yes mail_location = maildir:~/mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap lmtp pop3" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl_cert = </etc/letsencrypt/live/wc-rhyno.tech/fullchain.pem ssl_key = # hidden, use -P to show it submission_host = localhost:25 userdb { driver = prefetch } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep } 2018. 08. 02. 0:48 keltezéssel, Aki Tuomi írta: > protocol lmtp { > userdb { > driver = sql > args = /path/to/dovecot-sql.conf.ext > } > } > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Andras Kemeny <pdx(a)pdx.hu> > Date: 02/08/2018 01:35 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: LMTP error, mysterious > > hi (especially to you, Aki), > > so to solve the previous UID issue, i went the full LMTP route. however, > i seem to be having problems with the prefetch userdb (i'm trying to > minimize load on the LDAP server). namely, the log says: > > Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: > client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik > Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: > message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> > Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: > from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) > Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local > Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): > userdb lookup not possible with only userdb prefetch > Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user > aik(a)rhyno.tech: Auth USER lookup failed > Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: > to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], > delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host > beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> > Internal error occurred. Refer to server log for more information. (in > reply to RCPT TO command)) > Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: > Successful quit > Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from > localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 > > (the above is a transcript of a full session i've done over telneting to > localhost 587 and auth login-ing with valid credentials) > > so, i've tested the actual login process, and it works flawlessly, and > it looks like IMAP is up and running: > > Connected to localhost. > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword > 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN > NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH > ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE > SPECIAL-USE] Logged in > 1 list "" "%" > * LIST (\HasNoChildren \Sent) "." Sent > * LIST (\HasNoChildren \Trash) "." Trash > * LIST (\HasNoChildren) "." INBOX > 1 OK List completed (0.000 + 0.000 secs). > 2 status INBOX (MESSAGES) > * STATUS INBOX (MESSAGES 2) > 2 OK Status completed (0.000 + 0.000 secs). > > this is how i send the test mails: > > Connected to localhost. > Escape character is '^]'. > 220 beach.rhyno.tech mail server > ehlo x > 250-beach.rhyno.tech > 250-PIPELINING > 250-SIZE 10240000 > 250-ETRN > 250-STARTTLS > 250-AUTH PLAIN LOGIN > 250-AUTH=PLAIN LOGIN > 250-ENHANCEDSTATUSCODES > 250-8BITMIME > 250-DSN > 250 SMTPUTF8 > auth login > 334 VXNlcm5hbWU6 > ***obviously_masked*** > 334 UGFzc3dvcmQ6 > ***obviously_masked*** > 235 2.7.0 Authentication successful > mail from:<pdx(a)pdx.hu> > 250 2.1.0 Ok > rcpt to:<aik(a)rhyno.tech> > 250 2.1.5 Ok > data > 354 End data with <CR><LF>.<CR><LF> > test > . > 250 2.0.0 Ok: queued as 5EEF35C05C5 > quit > 221 2.0.0 Bye > Connection closed by foreign host. > > my concern is these two: > > Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): > userdb lookup not possible with only userdb prefetch > Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user > aik(a)rhyno.tech: Auth USER lookup failed > > 10-auth.conf has these settings: > > passdb { > driver = ldap > args = /etc/dovecot/dovecot-ldap.conf.ext > } > userdb { > driver = prefetch > } > > dovecot-ldap.conf.ext has these settings (only the relevant ones) > > dn = ***whatever, it works*** > dnpass = ***whatever, it works*** > auth_bind = no > base = dc=rhyno,dc=tech > pass_attrs = \ > =user=%{ldap:uid}, \ > =password=%{ldap:userPassword}, \ > =userdb_home=%{ldap:homeDirectory}, \ > =userdb_uid=%{ldap:uidNumber}, \ > =userdb_gid=%{ldap:gidNumber} > pass_filter = > (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) > > so what am i missing? also, this format of setting variables > (=<output_field>=%{<whatever_special_result_field>}) is never explained > on the wiki (or am i just blind?) > > thanks in advance, > a >

2 1

LMTP error, mysterious
by Andras Kemeny 01 Aug '18

01 Aug '18

hi (especially to you, Aki), so to solve the previous UID issue, i went the full LMTP route. however, i seem to be having problems with the prefetch userdb (i'm trying to minimize load on the LDAP server). namely, the log says: Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): userdb lookup not possible with only userdb prefetch Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user aik(a)rhyno.tech: Auth USER lookup failed Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: Successful quit Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 (the above is a transcript of a full session i've done over telneting to localhost 587 and auth login-ing with valid credentials) so, i've tested the actual login process, and it works flawlessly, and it looks like IMAP is up and running: Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE] Logged in 1 list "" "%" * LIST (\HasNoChildren \Sent) "." Sent * LIST (\HasNoChildren \Trash) "." Trash * LIST (\HasNoChildren) "." INBOX 1 OK List completed (0.000 + 0.000 secs). 2 status INBOX (MESSAGES) * STATUS INBOX (MESSAGES 2) 2 OK Status completed (0.000 + 0.000 secs). this is how i send the test mails: Connected to localhost. Escape character is '^]'. 220 beach.rhyno.tech mail server ehlo x 250-beach.rhyno.tech 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-AUTH PLAIN LOGIN 250-AUTH=PLAIN LOGIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250 SMTPUTF8 auth login 334 VXNlcm5hbWU6 ***obviously_masked*** 334 UGFzc3dvcmQ6 ***obviously_masked*** 235 2.7.0 Authentication successful mail from:<pdx(a)pdx.hu> 250 2.1.0 Ok rcpt to:<aik(a)rhyno.tech> 250 2.1.5 Ok data 354 End data with <CR><LF>.<CR><LF> test . 250 2.0.0 Ok: queued as 5EEF35C05C5 quit 221 2.0.0 Bye Connection closed by foreign host. my concern is these two: Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): userdb lookup not possible with only userdb prefetch Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user aik(a)rhyno.tech: Auth USER lookup failed 10-auth.conf has these settings: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } dovecot-ldap.conf.ext has these settings (only the relevant ones) dn = ***whatever, it works*** dnpass = ***whatever, it works*** auth_bind = no base = dc=rhyno,dc=tech pass_attrs = \ =user=%{ldap:uid}, \ =password=%{ldap:userPassword}, \ =userdb_home=%{ldap:homeDirectory}, \ =userdb_uid=%{ldap:uidNumber}, \ =userdb_gid=%{ldap:gidNumber} pass_filter = (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) so what am i missing? also, this format of setting variables (=<output_field>=%{<whatever_special_result_field>}) is never explained on the wiki (or am i just blind?) thanks in advance, a

2 1

[SIEVE] pipe :copy to external program with arguments
by spamvoll＠googlemail.com 01 Aug '18

01 Aug '18

Hi all, quick questions about sieve pipe: I want to pipe spam messages to an external program with additional parameters my spamlearn.sieve script: require ["vnd.dovecot.pipe", "copy", "imapsieve"]; pipe :copy "mybin" ["-h 127.0.0.1:44444" , "markspam"]; I also tried: pipe :copy "mybin" ["-h 127.0.0.1:44444 markspam"]; pipe :copy "mybin" ["-h 127.0.0.1:44444"] ["markspam"]; pipe :copy :args ["-h 127.0.0.1:44444 markspam"] "mybin" ; It never executes correct, it always ends with: Error: sieve: Execution of script /my/path/to/spamlearn.sieve failed So whats the correct syntax ? What works is a single argument: pipe :copy "myscript" ["markspam"]; Dovecot Version 2.3.2.1

3 2

Problems with Sieve and vnd.dovecot.pipe
by Haiko Hertes 01 Aug '18

01 Aug '18

Hello all! I have changed my mailserver from spamassasin and procmail to rspamd and sieve. Rspamd is working, but with some sieve script I still have problems. I have created a script to learn spam: haiko@SERVERNAME:~$ sudo cat /var/vmail/sieve/global/learn-spam.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve"]; pipe :copy "rspamd-learn-spam.sh"; If I run sieve to use this script I get this: haiko@SERVERNAME:~$ sudo sieve /var/vmail/sieve/global/learn-spam.sieve sieve: vnd.dovecot.pipe: file not found sieve: can't require vnd.dovecot.pipe Speicherzugriffsfehler I think, my configs are OK: haiko@SERVERNAME:~$ doveconf -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_debug_passwords = yes auth_mechanisms = plain login PLAIN LOGIN auth_username_format = %Ln debug_log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot.log listen = * log_path = /var/log/dovecot.log mail_gid = postfix mail_location = maildir:~/Maildir mail_privileged_group = postfix mail_uid = postfix managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacati on subaddress comparator-i;ascii-numeric relational regex imap4flags copy includ e variables body enotify environment mailbox date index ihave duplicate mime for everypart extracttext imapsieve namespace inbox { inbox = yes location = mailbox "Deleted Items" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * quota = maildir:User quota quota_exceeded_message = Benutzer %u hat das Speichervolumen überschritten. / User %u has exhausted allowed storage space. sieve = ~/.dovecot.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_implicit_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_pipe_bin_dir = /var/vmail/sieve/global sieve_plugins = sieve_imapsieve sieve_extprograms sieve_trace_level = tests sieve_user_log = ~/.dovecot.sieve.log } postmaster_address = postmaster(a)hertes.net protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imaps { address = * } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } service pop3-login { inet_listener pop3s { address = * } } ssl = required ssl_cert = </etc/letsencrypt/live/hertes.net/fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECD H:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:! RC4: !SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = passwd } userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster(a)hertes.net } protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 20 mail_plugins = " imap_quota imap_sieve quota imap_quota imap_sieve" } Does anyone of you have a hint what could be wrong here?? Thanks! Best regards, Haiko

2 1

Basic question about file permissions for sieve error log
by J Doe 01 Aug '18

01 Aug '18

Hello, I have an admittedly very basic question, but I am not able to get it to work. I store my global sieve script in: /etc/dovecot. I recently made a mistake in my global sieve script which causes Dovecot to attempt to log the errors in: /etc/dovecot/sieve-global.log In /var/log/dovecot.log I see: Jul 24 15:33:32 lmtp(test(a)example.com): Error: ABVWGAx/V1uKLAAA1B5X9w: sieve: failed to open logfile (LOGGING TO STDERR): open(/etc/dovecot/sieve-global.log) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /etc/dovecot, we're not in group 122(dovecot), dir owned by 0:122 mode=0775) …but the group membership shows: $ sudo -u vmail groups vmail dovecot …and I restarted Dovecot, but the same error happens. What am I doing wrong ? Thanks, - J

3 2

LMTP Log
by Thomas Kristensen 01 Aug '18

01 Aug '18

Hey I got a server setup where the Postfix and dovecot is on separated servers. In the postfis log is goes like this on mail in: Jul 26 10:23:13 edimailsl2 postfix/smtpd[12812]: 41blTs18Bzz40nl: client=unknown[172.0.0.12] Jul 26 10:23:21 edimailsl2 postfix/cleanup[12825]: 41blTs18Bzz40nl: message-id=<> Jul 26 10:23:21 edimailsl2 postfix/qmgr[10666]: 41blTs18Bzz40nl: from=<tk(a)multimed.dk>, size=225, nrcpt=1 (queue active) Jul 26 10:23:21 edimailsl2 postfix/lmtp[12827]: 41blTs18Bzz40nl: to=<test(a)domain.dk>, relay=172.26.248.178[172.26.248.178]:2003, delay=8.6, delays=8.5/0.06/0.01/0.08, dsn=2.0.0, status=sent (250 2.0.0 <test(a)domain.dk> oCuyJ/mEWVvFfwAAbOxY/Q Saved) Jul 26 10:23:21 edimailsl2 postfix/qmgr[10666]: 41blTs18Bzz40nl: removed And the LMTP on the Dovecot server is: Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(32709): Connect from 172.0.0.1 Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(test@ domain.dk): msgid=unspecified: saved mail to INBOX Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(32709): Disconnect from 172.0.0.1: Successful quit How can I make LMTP log the ID it gives postfix (oCuyJ/mEWVvFfwAAbOxY/Q)? So I can relate the logs from the 2 servers. Med venlig hilsen Thomas Kristensen [MM_mail_logo_3_AS] Storhaven 12 - 7100 Vejle Tlf: 75 72 54 99 - Fax: 75 72 65 33 E-mail: tk(a)multimed.dk<mailto:tk@multimed.dk>

2 1

question about using procmail
by Joe Wong 01 Aug '18

01 Aug '18

Hello, I am new to Dovecot, testing the setup with Solr FTS plugin. Currently I am using procmail to delivery email into user's mailbox. I am using maildir on file system. I found that if email is delivered via procmail, the indexer-worker is not being called. But when I move the email between folders via IMAP, indexer is involved. Is this expected? - Joe

3 5

lmtp + tcpwrap
by A. Schulze 31 Jul '18

31 Jul '18

Hello, Using the TCP Wrapper Dovecot could control access to IMAP and POP3 servers. Is it also possible to controll access to an LMTP Server listening on Port 24? Andreas

1 0

Re: Get rid of the "dbox-Mails"-folder
by Hativ 31 Jul '18

31 Jul '18

Hey Aki, DIRNAME with empty value has no effect, just like with FULLDIRNAME. "~/sdbox" instead of "~/" doesn't change that.. Greetings, Hativ Am 07.07.2018 um 20:24 schrieb Aki Tuomi: > Does it work better if you use > > mail_location=sdbox:~/sdbox:DIRNAME= > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Hativ <hativ3(a)gmail.com> > Date: 07/07/2018 20:53 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Get rid of the "dbox-Mails"-folder > > Hey again, > > sorry, but I have to correct me: Even with dot it's not working > completely. The subscriptions file is not created and the dovecot-acl > file has the wrong path, too. > > :-( > > Greetings, > > Hativ > > Am 07.07.2018 um 02:26 schrieb Hativ: >> Hey again, >> >> I've found a working configuration: mail_location = >> sdbox:~/:FULLDIRNAME=. >> >> I use a dot instead of slash or empty value. >> >> Now my folder structure looks like I want and Dovecot is working fine. >> >> Can anyone (maybe even a Dovecot developer?) say if the configuration >> is okay? I've tried to check the source code, but I don't know C as >> good as it's needed for that. >> >> Greetings, >> >> Hativ >> >> Am 06.07.2018 um 16:10 schrieb Hativ: >>> Hey to all, >>> >>> is it possible to get rid of the "dbox-Mails"-folder when using sdbox? >>> >>> Currently my folder structure looks like this (I hope the output >>> from tree would be formatted well): >>> /srv/mail/ >>> └── example.com >>> └── user >>> ├── dovecot-acl-list >>> ├── dovecot-attributes >>> ├── dovecot.list.index.log >>> ├── dovecot.mailbox.log >>> ├── dovecot-uidvalidity >>> ├── dovecot-uidvalidity.5b3f746f >>> ├── mailboxes >>> │ ├── Drafts >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ ├── INBOX >>> │ │ └── dbox-Mails >>> │ │ ├── dovecot.index.cache >>> │ │ ├── dovecot.index.log >>> │ │ └── u.1 >>> │ ├── Junk >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ ├── Sent >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ └── Trash >>> │ └── dbox-Mails >>> │ └── dovecot.index.log >>> └── subscriptions >>> >>> I would like to let it look like this: >>> /srv/mail/ >>> └── example.com >>> └── user >>> ├── dovecot-acl-list >>> ├── dovecot-attributes >>> ├── dovecot.list.index.log >>> ├── dovecot.mailbox.log >>> ├── dovecot-uidvalidity >>> ├── dovecot-uidvalidity.5b3f746f >>> ├── mailboxes >>> │ ├── Drafts >>> │ │ └── dovecot.index.log >>> │ ├── INBOX >>> │ │ └── dovecot.index.cache >>> │ │ └── dovecot.index.log >>> │ │ └── u.1 >>> │ ├── Junk >>> │ │ └──dovecot.index.log >>> │ ├── Sent >>> │ │ └── dovecot.index.log >>> │ └── Trash >>> │ └── dovecot.index.log >>> └── subscriptions >>> >>> My path configuration: >>> mail_attribute_dict = file:%h/dovecot-attributes >>> mail_home = /srv/mail/%d/%n/ >>> mail_location = sdbox:~/ >>> >>> I have tried >>> mail_location = sdbox:~/:FULLDIRNAME= >>> and >>> mail_location = sdbox:~/:FULLDIRNAME=/ >>> but it doesn't work. >>> >>> The first doesn't change anything. The second auto-creates the >>> folders after first login like I want, but after next login they are >>> greyed out and no longer accessible. >>> >>> Is it possible to get rid of the "dbox-Mails"-folder? I want this >>> because I don't like to have an unneeded deep folder structure. Or >>> is there a good reason to let the "dbox-Mails" folder in my setup? >>> >>> Greetings, >>> >>> Hativ >>> >> >

2 2

Re: uid problem
by Aki Tuomi 31 Jul '18

31 Jul '18

https://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP Aki On 31.07.2018 14:35, Andras Kemeny wrote: > > can you point me to an url regarding LTMP between postfix and dovecot? > it might be an area worth exploring for me. > > thanks, > a > > > 2018. 07. 31. 12:46 keltezéssel, Aki Tuomi írta: >> >> Well, I don't know about yuuuge security risk (not saying there isn't >> any...), but if this concerns you, you can also use LTMP instead, >> which is probably a better solution here. >> >> Aki >> >> >> On 31.07.2018 13:42, Andras Kemeny wrote: >>> >>> yeah, the only problem about that is it's a yuuuge security risk :), >>> and also, postfix simply won't let me: >>> >>> Jul 31 02:20:37 rhyno postfix/pipe[29532]: fatal: user= command-line >>> attribute specifies root privileges >>> >>> so it's entirely possible i'm knocking on the wrong door, and >>> instead i should be asking this in the postfix mailing list. >>> >>> however, i'm also worried about this: "to bypass this check, set: >>> service auth { unix_listener /var/run/dovecot/auth-userdb { >>> mode=0777 } }", as i have done what it says, and the check wasn't >>> bypassed so i'm wary about something bad coming up once i somehow >>> fix this initial UID problem. >>> >>> thanks, >>> a >>> >>> >>> 2018. 07. 31. 7:12 keltezéssel, Aki Tuomi írta: >>>> You could run dovecot-lda as root. It will setuid to correct account. >>>> >>>> >>>> >>>> --- >>>> Aki Tuomi >>>> Dovecot oy >>>> >>>> -------- Original message -------- >>>> From: Andras Kemeny <pdx(a)pdx.hu> >>>> Date: 31/07/2018 04:46 (GMT+02:00) >>>> To: dovecot(a)dovecot.org >>>> Subject: uid problem >>>> >>>> hi, >>>> >>>> contacting this mailing list is my last-ditch effort to somehow >>>> come to >>>> a working configuration where postfix "ends in" dovecot, IE for >>>> special >>>> LDAP-based users, featured in the virtual mailbox delivery, dovecot >>>> would act as LDA. >>>> >>>> here's the deal. >>>> >>>> i've set up dovecot's access to the LDAP server, and for the >>>> purposes of >>>> being an IMAP server and a SASL auth backend, dovecot works >>>> brilliantly >>>> and without a glitch. i can access my test mailbox (in maildir >>>> format), >>>> i can use the LDA as root and it delivers the message correctly >>>> (after a >>>> switch to the target user's UID), and even postfix's submission works >>>> with dovecot as its SASL backend. >>>> >>>> what does not work is dovecot as LDA from postfix. >>>> >>>> i'm getting these errors in the log: >>>> >>>> Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER >>>> lookup failed >>>> Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client >>>> doesn't >>>> have lookup permissions for this user: userdb uid (10001) doesn't >>>> match >>>> peer uid (5000) (to bypass this check, set: service auth { >>>> unix_listener >>>> /var/run/dovecot/auth-userdb { mode=0777 } }) >>>> Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. >>>> Refer to server log for more information. >>>> >>>> for the sake of clarity, i've tried the "to bypass this check" >>>> instructions, didn't help. >>>> >>>> also, for the sake of operational clarity, "aik" is the LDAP account >>>> with the following parameters: >>>> >>>> dn: uid=aik,ou=People,dc=rhyno,dc=tech >>>> objectClass: account >>>> objectClass: posixAccount >>>> objectClass: postfixUser >>>> cn: aik >>>> uid: aik >>>> uidNumber: 10001 >>>> gidNumber: 10001 >>>> homeDirectory: /home/aik >>>> loginShell: /bin/sh >>>> gecos: aik >>>> description: User account >>>> structuralObjectClass: account >>>> entryUUID: db947584-0369-1038-98b3-675e2f0cea17 >>>> creatorsName: cn=admin,dc=rhyno,dc=tech >>>> createTimestamp: 20180613152616Z >>>> email: *********** >>>> userPassword:: ************************* >>>> mailacceptinggeneralid: andras.kemeny >>>> mailacceptinggeneralid: kemeny.andras >>>> mailacceptinggeneralid: aik >>>> mailacceptinggeneralid: pdx >>>> mailacceptinggeneralid: @rhyno.tech >>>> mailacceptinggeneralid: @rhynotechnologies.com >>>> maildrop: aik >>>> >>>> and postfix's master.cf says: >>>> >>>> dovecot unix - n n - - pipe >>>> flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f >>>> ${sender} -d ${user} >>>> >>>> so i'm stuck at this point. obviously, if the LDA is spawned with >>>> vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and >>>> passwd >>>> accounts were once connected, but for security reasons, the connection >>>> has been severed -- still the /home/aik/mail dir is owned by uid >>>> 10001 etc). >>>> >>>> what am i doint wrong? >>>> >>>> thanks, >>>> a >>> >> >

1 0

Almost there with Sieve
by Danny Horne 31 Jul '18

31 Jul '18

Hi all, Dovecot - 2.2.35 Pigeonhole - 0.4.23 I've recently moved mail filtering from local filtering (using Thunderbird) to Sieve. I've got filtering into folders and flagging emails working fine, but for possibly one tiny glitch. When specifying folders to filter into I have to use the format 'INBOX/Folder name' instead of just 'Folder name'. Can this be corrected? No real biggie but would be nice if it could. [root@kepler ~]# dovecot -n # 2.2.35 (b1cb664): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.23 (b2e41927) # OS: Linux 4.17.3-200.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight) xfs # Hostname: kepler.trisect.uk auth_mechanisms = cram-md5 base_dir = /var/run/dovecot/ mail_access_groups = mail mail_home = /var/spool/vhosts/homedir/%d/%n mail_location = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/mail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=cram-md5 /etc/cram-md5.pwd driver = passwd-file } passdb { driver = pam } plugin { sieve = file:/var/spool/vhosts/sieve-scripts;active=/var/spool/vhosts/sieve-scripts/%u.sieve sieve_user_email = postmaster(a)trisect.uk } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 0 vsz_limit = 256 M } service managesieve { process_limit = 1024 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail driver = static } userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 200 } protocol sieve { mail_max_userip_connections = 25 managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } Thanks for looking

2 2

Re: uid problem
by Aki Tuomi 31 Jul '18

31 Jul '18

Well, I don't know about yuuuge security risk (not saying there isn't any...), but if this concerns you, you can also use LTMP instead, which is probably a better solution here. Aki On 31.07.2018 13:42, Andras Kemeny wrote: > > yeah, the only problem about that is it's a yuuuge security risk :), > and also, postfix simply won't let me: > > Jul 31 02:20:37 rhyno postfix/pipe[29532]: fatal: user= command-line > attribute specifies root privileges > > so it's entirely possible i'm knocking on the wrong door, and instead > i should be asking this in the postfix mailing list. > > however, i'm also worried about this: "to bypass this check, set: > service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 > } }", as i have done what it says, and the check wasn't bypassed so > i'm wary about something bad coming up once i somehow fix this initial > UID problem. > > thanks, > a > > > 2018. 07. 31. 7:12 keltezéssel, Aki Tuomi írta: >> You could run dovecot-lda as root. It will setuid to correct account. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Andras Kemeny <pdx(a)pdx.hu> >> Date: 31/07/2018 04:46 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: uid problem >> >> hi, >> >> contacting this mailing list is my last-ditch effort to somehow come to >> a working configuration where postfix "ends in" dovecot, IE for special >> LDAP-based users, featured in the virtual mailbox delivery, dovecot >> would act as LDA. >> >> here's the deal. >> >> i've set up dovecot's access to the LDAP server, and for the purposes of >> being an IMAP server and a SASL auth backend, dovecot works brilliantly >> and without a glitch. i can access my test mailbox (in maildir format), >> i can use the LDA as root and it delivers the message correctly (after a >> switch to the target user's UID), and even postfix's submission works >> with dovecot as its SASL backend. >> >> what does not work is dovecot as LDA from postfix. >> >> i'm getting these errors in the log: >> >> Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER >> lookup failed >> Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client doesn't >> have lookup permissions for this user: userdb uid (10001) doesn't match >> peer uid (5000) (to bypass this check, set: service auth { unix_listener >> /var/run/dovecot/auth-userdb { mode=0777 } }) >> Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. >> Refer to server log for more information. >> >> for the sake of clarity, i've tried the "to bypass this check" >> instructions, didn't help. >> >> also, for the sake of operational clarity, "aik" is the LDAP account >> with the following parameters: >> >> dn: uid=aik,ou=People,dc=rhyno,dc=tech >> objectClass: account >> objectClass: posixAccount >> objectClass: postfixUser >> cn: aik >> uid: aik >> uidNumber: 10001 >> gidNumber: 10001 >> homeDirectory: /home/aik >> loginShell: /bin/sh >> gecos: aik >> description: User account >> structuralObjectClass: account >> entryUUID: db947584-0369-1038-98b3-675e2f0cea17 >> creatorsName: cn=admin,dc=rhyno,dc=tech >> createTimestamp: 20180613152616Z >> email: *********** >> userPassword:: ************************* >> mailacceptinggeneralid: andras.kemeny >> mailacceptinggeneralid: kemeny.andras >> mailacceptinggeneralid: aik >> mailacceptinggeneralid: pdx >> mailacceptinggeneralid: @rhyno.tech >> mailacceptinggeneralid: @rhynotechnologies.com >> maildrop: aik >> >> and postfix's master.cf says: >> >> dovecot unix - n n - - pipe >> flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f >> ${sender} -d ${user} >> >> so i'm stuck at this point. obviously, if the LDA is spawned with >> vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and passwd >> accounts were once connected, but for security reasons, the connection >> has been severed -- still the /home/aik/mail dir is owned by uid >> 10001 etc). >> >> what am i doint wrong? >> >> thanks, >> a >

1 0

2.3.2.1 - EC keys suppport?
by ѽ҉ᶬḳ℠ 31 Jul '18

31 Jul '18

Hi, facing [ no shared cipher ] error with EC private keys. This happens when the private key is generated with [ openssl ecparam -name brainpoolP512t1 -genkey ] with OpenSSL 1.1.0hh on the same machine Dovecot is running on. Tried some variations of [ ssl_cipher_list ] but to no avail - the [ no shared cipher ] error persists. Once the key is generated with [ openssl genpkey -algorithm RSA ] however the error is gone. Thus wondering whether (1) I am missing something or (2) this a bug or (3) there is no support for EC keys?

3 21

Re: dsync: expunge from pop3 does not replicate
by Jakub Lánský 31 Jul '18

31 Jul '18

Here is it # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (5d6d7c92) # OS: Linux 4.4.0-112-generic x86_64 Ubuntu 16.04.4 LTS # Hostname: mda22 auth_cache_negative_ttl = 2 secs auth_cache_size = 16 M auth_cache_ttl = 1 mins auth_master_user_separator = / auth_mechanisms = plain login auth_verbose = yes default_client_limit = 2000 default_process_limit = 2000 default_vsz_limit = 16894 M deliver_log_format = %m %f/%e %s -> %e %p: %$ dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlsieve = mysql:/etc/dovecot/dovecot-dict-sqlsieve.conf.ext } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_rcpt_check_quota = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 10.3.13.0/24 10.3.14.0/24 mail_gid = nogroup mail_home = /datastore/maildir/%d/%n mail_location = maildir:~/ mail_plugins = " quota mail_log notify old_stats replication" mail_uid = nobody maildir_copy_with_hardlinks = no managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Inbox { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = box msgid from subject size mail_replica = tcp:10.3.13.51:54321 old_stats_command_min_time = 1 mins old_stats_domain_min_time = 12 hours old_stats_ip_min_time = 12 hours old_stats_memory_limit = 16 M old_stats_refresh = 30 secs old_stats_session_min_time = 15 mins old_stats_track_cmds = yes old_stats_user_min_time = 1 hours quota = dict:User quota::proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 50%% quota_warning = storage=95%% quota-warning 95 %u %d size quota_warning2 = messages=95%% quota-warning 95 %u %d count recipient_delimiter = + sieve = file:/datastore/sieve/%d/%n/;active=/datastore/sieve/%d/%n/active.sieve sieve_before = dict:proxy::sqlsieve;name=before_inbox_forward;bindir=/datastore/sieve/%d/%n/ sieve_max_actions = 32 sieve_max_redirects = 50 sieve_max_script_size = 1M sieve_redirect_envelope_from = recipient sieve_user_log = /datastore/sieve/%d/%n/.sieve.log } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_reuse_xuidl = yes pop3_save_uidl = yes protocols = " imap lmtp sieve pop3 sieve" replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = nobody } unix_listener replication-notify { mode = 0666 user = nobody } } service auth { inet_listener { port = 12345 ssl = yes } } service dict { unix_listener dict { group = nogroup user = nobody } } service doveadm { inet_listener { port = 54321 ssl = no } } service imap-login { process_limit = 32 process_min_avail = 8 service_count = 0 } service imap { process_limit = 16384 } service lmtp { executable = lmtp -L inet_listener lmtp { port = 24 ssl = no } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 2 service_count = 1 vsz_limit = 196 M } service managesieve { process_limit = 2048 } service old-stats { fifo_listener old-stats-mail { mode = 0666 user = nobody } inet_listener { address = 127.0.0.1 port = 24242 } } service pop3 { process_limit = 2048 } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { mode = 0666 user = nobody } user = nobody } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 user = nobody } } service stats { idle_kill = 5 mins unix_listener stats-reader { group = nogroup mode = 0666 user = nobody } unix_listener stats-writer { group = nogroup mode = 0666 user = nobody } } ssl_cert = </etc/dovecot/private/mda.vshosting.cloud/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 10.3.14.30:587 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota mail_log notify old_stats replication sieve" } protocol lda { mail_plugins = " quota mail_log notify old_stats replication sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota mail_log notify old_stats replication imap_quota imap_old_stats" } protocol sieve { managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 50 } -- Jakub Lánský IT administration/support technician jakub(a)lansky.biz GSM: +420776172737 Jabber/GTalk: lenny(a)blesmrt.net -------- Původní zpráva -------- Od: Aki Tuomi <aki.tuomi(a)dovecot.fi> Komu: Jakub Lánský <jakub(a)lansky.biz>, dovecot(a)dovecot.org Předmět: Re: dsync: expunge from pop3 does not replicate Datum: Wed, 25 Jul 2018 14:04:14 +0300 Please provide doveconf -n --- Aki Tuomi Dovecot oy -------- Original message -------- From: Jakub Lánský <jakub(a)lansky.biz> Date: 25/07/2018 11:37 (GMT+02:00) To: dovecot(a)dovecot.org Subject: dsync: expunge from pop3 does not replicate Hi, I'm using dovecot 2.3.2.1 on Xenial from upstream packages on two Dovecot servers connected with dsync over TCP. E-mails which are deleted via POP3 protocol are not correctly deleted on second server via dsync. Jul 25 09:29:19 mda11 dovecot: pop3(jakub@***)<7587><8xaJ1c1x9uEqAB7QADwAAAAAAAAAAL7v>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Nothing happened on the second machine then. After running # doveadm replicator replicate "jakub@***", e-mail got expunged immediately on second server. Jul 25 09:50:56 mda22 dovecot: dsync- local(jakub@***)<Xt6oFy8nWFsjIwAA0YRh9g>: expunge: box=INBOX, msgid=< 6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Any ideas what to do or test? Thank you

2 3

Welcome plugin - user and domain vars?
by Tony 31 Jul '18

31 Jul '18

Hi List, I have multiple mail domains and depending on the domain name was looking for a way to pass the user and domain into a welcome.sh script. I looked at the quota script and saw of the 3 vars one of them is for the user. BOUNDARY="$1" USER="$2" MSG="" For the username - could we still reference USER="$2" in order to pass the username in the welcome email or is this only supported with the quota plugin? For the domain - how could one pass the 1st time login user's mail domain to the script? I looked at the welcome-plugin.c source, but didn't find anything that might reference a domain. Ideally I was hoping maybe something similar to the quota script could work.. MSG="" if [[ "$DOMAIN" = "domain.net" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.com" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.me" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.email" ]]; then MSG="..." fi Thanks for any suggestions. Cheers, Tony

2 1

uid problem
by Andras Kemeny 31 Jul '18

31 Jul '18

hi, contacting this mailing list is my last-ditch effort to somehow come to a working configuration where postfix "ends in" dovecot, IE for special LDAP-based users, featured in the virtual mailbox delivery, dovecot would act as LDA. here's the deal. i've set up dovecot's access to the LDAP server, and for the purposes of being an IMAP server and a SASL auth backend, dovecot works brilliantly and without a glitch. i can access my test mailbox (in maildir format), i can use the LDA as root and it delivers the message correctly (after a switch to the target user's UID), and even postfix's submission works with dovecot as its SASL backend. what does not work is dovecot as LDA from postfix. i'm getting these errors in the log: Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER lookup failed Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client doesn't have lookup permissions for this user: userdb uid (10001) doesn't match peer uid (5000) (to bypass this check, set: service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 } }) Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. for the sake of clarity, i've tried the "to bypass this check" instructions, didn't help. also, for the sake of operational clarity, "aik" is the LDAP account with the following parameters: dn: uid=aik,ou=People,dc=rhyno,dc=tech objectClass: account objectClass: posixAccount objectClass: postfixUser cn: aik uid: aik uidNumber: 10001 gidNumber: 10001 homeDirectory: /home/aik loginShell: /bin/sh gecos: aik description: User account structuralObjectClass: account entryUUID: db947584-0369-1038-98b3-675e2f0cea17 creatorsName: cn=admin,dc=rhyno,dc=tech createTimestamp: 20180613152616Z email: *********** userPassword:: ************************* mailacceptinggeneralid: andras.kemeny mailacceptinggeneralid: kemeny.andras mailacceptinggeneralid: aik mailacceptinggeneralid: pdx mailacceptinggeneralid: @rhyno.tech mailacceptinggeneralid: @rhynotechnologies.com maildrop: aik and postfix's master.cf says: dovecot unix - n n - - pipe flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f ${sender} -d ${user} so i'm stuck at this point. obviously, if the LDA is spawned with vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and passwd accounts were once connected, but for security reasons, the connection has been severed -- still the /home/aik/mail dir is owned by uid 10001 etc). what am i doint wrong? thanks, a

2 1

dovecot 2.3.x, ECC and wildcard certificates, any issues
by David Mehler 31 Jul '18

31 Jul '18

Hello, Does dovecot 2.3.x have any issues recognizing or using certificates that are ECC and wildcard? I'm trying to switch my letsencrypt implementation from acme-client which does not support either of those capabilities to acme.sh which does. Since then external clients checking their email has not worked. A manual telnet to mail.example.com 993 gives a connected message but then nothing no greeting or capabilities. The certificate is for example.com with an alt name of *.example.com if that's not right let me know, i'm not sure about that one, connecting to the web sites of these pages seems noticeably slower, I'm wondering if both of these issues aren't key related? Thanks. Dave.

5 12

mdbox_deleted proper syntax
by Johan Huldtgren 30 Jul '18

30 Jul '18

hello, on the wiki, https://wiki2.dovecot.org/MailboxFormat/dbox, it says that one can use either doveadm fetch or doveadm import, however I can find no correct syntax with fetch that'll actually work. Is the idea to simply override the mail_location with -o ? That seems to work for doveadm mailbox but not for doveadm fetch or search # doveadm -f table mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 1362145026 0 1 164208086 64bd9f0003af305190040000b9256959 1471825482 # doveadm -f table -o "mail_location=mdbox_deleted:~/mdbox" mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 0 0 1 0 ddb9421479f0595bf21b0100b9256959 18446744073709551615 # doveadm -f flow fetch -u johan size.virtual mailbox dovecot size.virtual=2869 size.virtual=2960 size.virtual=8023 size.virtual=6683 ... # # doveadm -f flow -o "mail_location=mdbox_deleted:~/mdbox" fetch -u johan size.virtual mailbox dovecot # # doveadm search -u johan mailbox dovecot subject "LMTP Log" 64bd9f0003af305190040000b9256959 8642 64bd9f0003af305190040000b9256959 21302 64bd9f0003af305190040000b9256959 21373 64bd9f0003af305190040000b9256959 21420 64bd9f0003af305190040000b9256959 21434 64bd9f0003af305190040000b9256959 21435 64bd9f0003af305190040000b9256959 21460 64bd9f0003af305190040000b9256959 21461 64bd9f0003af305190040000b9256959 21463 64bd9f0003af305190040000b9256959 23684 # doveadm -o "mail_location=mdbox_deleted:~/mdbox" search -u johan mailbox dovecot subject "LMTP Log" # What I'm really trying to accomplish is see if a mail which a user deleted still exists in mdbox_deleted, so I wanted to do a fetch / search to see and then try to copy / import that message back. This is on OpenBSD 6.3-current with dovecot 2.2.36, doveconf -n below. thanks, .jh --- # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: OpenBSD 6.3 amd64 # Hostname: www.example.com auth_mechanisms = plain login first_valid_gid = 0 first_valid_uid = 507 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_id_log = * last_valid_uid = 1059 listen = 127.0.0.1 mail_home = /home/vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = stats fts fts_solr mail_privileged_group = _dovecot mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = mailbox spam { auto = subscribe special_use = \Junk } mailbox drafts { auto = subscribe special_use = \Drafts } mailbox sent-mail { auto = subscribe special_use = \Sent } mailbox trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-pgsql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-pgsql2.conf driver = sql } passdb { args = cache_key=%u%r%l * driver = bsdauth } plugin { antispam_backend = mailtrain antispam_mail_notspam = learn_ham antispam_mail_sendmail = /usr/local/bin/rspamc antispam_mail_sendmail_args = -h;127.0.0.1:11334;-P;q1 antispam_mail_spam = learn_spam antispam_spam = caughtspam antispam_trash = trash fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/dovecot/sieve/before/ sieve_default = /var/dovecot/sieve/default.sieve sieve_extensions = +spamtest +spamtestplus +virustest sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = _postfix mode = 0666 user = _postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_limit = 200 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix user = _postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service stats { fifo_listener stats-mail { mode = 0666 user = _postfix } } ssl = required ssl_cert = </etc/ssl/acme/example.com/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = uid=507 gid=507 driver = static } userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = stats fts fts_solr sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = stats fts fts_solr antispam imap_stats }

2 2

Doveadm protocol; dovecot v2.2.10
by David White 30 Jul '18

30 Jul '18

Hi there, Just wondering what is considered current best practice for managing dovecot? The options I see are: Doveadm binary Doveadm protocol via socket Doveadm http protocol I’m currently on v2.2.10 and it appears the doveadm protocol command set is limited to just the “mailbox” commands and the http protocol hasn’t been implemented. Is the doveadm http protocol still experimental in v2.3.2? Thanks, David White ISP Engineer Trustpower T 021 223 6208 E david.white(a)trustpower.co.nz<mailto:david.white@trustpower.co.nz> Trustpower Limited, Private Bag 12023, Tauranga Mail Centre, Tauranga 3143 ------------------------------------------------------------------------------------ The contents of this email and any attachments are confidential and may be privileged. If you are not the intended recipient, you may not use, copy or disclose this email or its attachments. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete both emails from your system. It is your responsibility to check this email and any attachments for viruses or other harmful code before opening or sending on. Trustpower Limited and its subsidiaries (collectively, Trustpower) accepts no responsibility for any such virus or any effects of a virus on your systems or data. Trustpower does not endorse anything in this email that is not related to its official business. Please think of the environment before printing this email. ------------------------------------------------------------------------------------

2 1

2.3.2.1 - ssl_alt_key revealed with dovecot -n
by ѽ҉ᶬḳ℠ 30 Jul '18

30 Jul '18

Seems like a minor cosmetic bug with [ dovecot -n ] ssl_alt_key = </etc/pki/private/some.key.pem ssl_key = # hidden, use -P to show it

1 0

Restricting SSL/TLS protocol versions on Dovecot 2.2.22
by J Doe 30 Jul '18

30 Jul '18

Hello, I have a question regarding SSL/TLS settings for Dovecot version 2.2.22. In: 10-ssl.conf there are two parameters: ssl_protocols ssl_cipher_list ssl_protocols is commented with “SSL protocol to use” and ssl_cipher_list is commented with “SSL ciphers to use”. If I want to disable SSLv3, for example, do I need to use both parameters or will disabling SSLv3 ciphers in ssl_cipher_list do the same thing ? So is: ssl_cipher_list = !SSLv3 …equivalent to: ssl_protocols = !SSLv3 ssl_cipher_list = !SSLv3 Thanks, - J

4 4

[Dovecot] quota-status not working in distributed environment
by Benoit Panizzon 30 Jul '18

30 Jul '18

Hello List Quick overview of our set-up: Postfix / Dovecot (2.2.2.1) / MySQL Cluster on (at the moment) three Servers to create a HA environment where you could easily add additional servers as the demand or load grows. Circular dovecot replication is used so each server uses another one as replication partner and allowing one server to fail. Dovecot Proxy Feature being used, so we can use round-robin DNS and each server can forward the connecting user to the correct 'master' for his mailbox. So far, everything works as expected. Now we want to reject emails to 'full' mailboxes during SMTP to prevent backscatter and use the quota-status policy service from within postfix. That works fine, if the mailbox or it's replica is present on the machine where quota-status is called, but it fails if it's run on a machine where neither the mailbox or the replica is present. In our case, we get a correct SMTP 550 'Mailbox Full' Reject in two cases and a LMTP generated bounce in the later case. Also `doveadm quota get -u user(a)example.com` return the correct quota if run on the two machines which have the mailbox and it's copy locale, but return 0% used if run on the other machine. Is there a way to get quota-status to also use the proxy feature to request the quota information from the correct machine? Or is the postfix policy daemon call to the quota-status socket documented somewhere (it must be, but where?) so we could implement it from within the Milter? (we use the sendmail Milter API from postfix to filter spam and viruses, do sender/recipient rewriting, forward bounce matching, rate limmiting, login/IP statistics to block botnets abusing phished addresses and legal intercept stuff anyway) Kind regards Benoit Panizzon -- I m p r o W a r e A G - ______________________________________________________ Zurlindenstrasse 29 Tel +41 61 826 93 07 CH-4133 Pratteln Fax +41 61 826 93 02 Schweiz Web http://www.imp.ch ______________________________________________________

5 6

OT - copied maildir from 2T drive to 4T drive
by Marc Perkel 29 Jul '18

29 Jul '18

And it's taking up more space on the 4T drive. What did I miss?

2 1

[SOLR] Where is solr-schema.xml?
by Peter Nabbefeld 27 Jul '18

27 Jul '18

Hello, running dovecot 2.3.2.1 on Arch Linux, and installed solr 7.4.0. According to the wiki, there should be doc/solr-schema.xml, but I cannot find it. Tried "whereis dovecot": dovecot: /usr/bin/dovecot /usr/lib/dovecot /etc/dovecot /usr/include/dovecot /usr/share/dovecot /usr/share/man/man1/dovecot.1.gz But I cannot find any xml files using find /usr/{lib,share}/dovecot -name "*.xml" Kind regards Peter

4 5

Imap post-login script
by j.emerlik 27 Jul '18

27 Jul '18

Dovecot v.2.2.32 and I have configured two imap post-login scripts and it seems like after successfully login scripts are not closed (dovecot_node/imap imap-postlogin : multiple processes are running still) and after some times there are too many processes and the limit is reached (imap proces_limit 1500): 1) #!/bin/sh case $IP in 10.10.1[1-2][0-7].*) exec "$@" ;; 10.11.2.4[0-9]) exec "$@" ;; esac CHECK_USER=`PGPASSWORD="password" /usr/local/pg952/bin/psql -h 10.11.1.3 -q -t -U postfixuser -d mail -c "select imap_allowed from users where name = '$USER' LIMIT 1"` if [ $CHECK_USER == "t" ] ; then exec "$@" fi if [ $CHECK_USER == "f" ] ; then exit 0 fi 2) PGPASSWORD="password" /usr/local/pg952/bin/psql -U postfixuser -d mail2 -h 10.11.1.3 -c "select last_auth('$USER','$RIP2','1')" > /dev/null exec "$@" Regards, Jack

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 26 Jul '18

26 Jul '18

Hi There! I run into this problem with virtual Mailboxes on release-2.3.2 (and also in master and in older versions of dovecot) I added the core-file. Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7ffad9ac0eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffad9a2efe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7ffad9bbb1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7ffad9792b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7ffad9792d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7ffad9795f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b4602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b460 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): child 11292 killed with signal 6 (core dumped) Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: AUTH 19 PLAIN service=imap secured=tls session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 20 lport=143 rport=41758 local_name=aldebaran.xundeenergie.at ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: CONT 19 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: CONT<hidden> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: OK 19 user=jakob Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: REQUEST 2436366337 10570 19 dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 request_auth_token Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb out: USER 2436366337 jakob home=/var/mail/jakob acl_groups=home,admin auth_token=3ea3b630e131 3bf5beb0f26ff740450189f63e3e Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, mpid=11298, TLS, session=<9KKNZclxHqPAqADc> Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7fbd982b2eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbd98220fe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fbd983ad1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7fbd97f84b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7fbd97f84d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7fbd97f87f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa6602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd98411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa660 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] Jul 25 04:11:30 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): child 11298 killed with signal 6 (core dumped) jakob

4 12

doveadm who reverse dns lookups
by Michael Grant 25 Jul '18

25 Jul '18

Perhaps this is a feature request... It would be nice if the ‘doveadm who’ command printed out the reverse dns name of where the user was logged in from. Would it be possible to either add some option to doveadm who for this, or make it the do it by default and add a ‘-n’ option (like many of the other programs that look up ip addresses by default) and take a -n option to not do that? Not sure if that would break some existing thing which is why I hesitate. Might be safer to add, say, a -r option to do the rDNS lookup. However, it would definitely save me a step in figuring out where someone was logged in from to know if it’s legit. Michael Grant

3 2

Re: doveadm expunge didn't clear Trash mailbox
by Joseph Tam 25 Jul '18

25 Jul '18

On Mon, 23 Jul 2018, Michael Wagner wrote: > here works a dovecot 2.2.27 on a raspberrypi and the behaviour is as > expected. > > doveadm -f tab fetch -u <user> "uid date.saved" mailbox Trash > uid date.saved > 314 2018-06-23 00:35:59 > 315 2018-06-23 12:39:10 > 316 2018-06-24 10:32:43 > ... > > And I have a cron script that expunges the mails older than 30 days. > /usr/bin/doveadm expunge -u <user> mailbox Trash savedbefore 30d Hi Michael, Thanks for your observation. I think you probably use maildir format, yes? I think my problem stems from the fact I use mbox, so one file contains many messages, whereas maildir uses one file for each message. Dovecot, from my understanding, will use the message file's mtime for date.saved if it doesn't have it in the cached. This is probably why I am seeing multiple messages with the same value. What's confusing is that if I query a message's date.saved, that value -- whether from the cache or the mailbox's mtime -- remains in the cache, so the next query will give me that value. So running "doveadm fetch ... date.saved", will get the mailbox's mtime at the time I fetched those values. In order to get near accurate date.saved values, I would have to run "doveadm fetch ... date.saved" frequently. (I think this behaviour must have changed recently because this no longer works consistently.) However, if each message is stored in a separate file (like maildir does), then each message can have an accurate date.saved(=mtime). Once you have accurate date.saved, then the "expunge savedbefore" works correctly. Another reason I really ought to switch to maildir. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: Panic: Leaked view for index - virtual mailbox
by Jakob Schuerz 25 Jul '18

25 Jul '18

1 0

Re: Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 25 Jul '18

25 Jul '18

Hi Aki! Sorry. Here is the right output. # gdb /usr/local/libexec/dovecot/imap /var/core/24491 GNU gdb (Debian 8.1-3) 8.1 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/libexec/dovecot/imap...(no debugging symbols found)...done. [New LWP 24491] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap [jakob 213'. Program terminated with signal SIGABRT, Aborted. #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51 ../sysdeps/unix/sysv/linux/raise.c: Datei oder Verzeichnis nicht gefunden. (gdb) bt full #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 set = {__val = {0, 140735982403592, 140035444961075, 2331576704, 12138802451775488, 140035444733018, 206158430240, 4096, 140735982403592, 94124639053616, 4096, 443744500087950336, 2389, 2380, 2381, 94124639053616}} pid = <optimized out> tid = <optimized out> ret = <optimized out> #1 0x00007f5c8ac4e2f1 in __GI_abort () at abort.c:79 save_stage = 1 act = {__sigaction_handler = {sa_handler = 0x33580, sa_sigaction = 0x33580}, sa_mask = {__val = {2048, 140035446034307, 140035441399298, 140035443714067, 140035445631889, 140035441273723, 140035445630673, 94124639049440, 443744500087950336, 512, 140035444801458, 140735982404016, 94124639049440, 140735982404016, 140035444801849, 94124639049440}}, sa_flags = -1964120006, sa_restorer = 0x5} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007f5c8aee5daf in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00007f5c8aee5eba in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x00007f5c8ae53fe8 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x00007f5c8b08b028 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x00007f5c8b06272a in index_storage_mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #7 0x00007f5c8afe01aa in mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #8 0x00007f5c8abb7b80 in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #9 0x00007f5c8abb7d3b in virtual_backend_box_open () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #10 0x00007f5c8abbaf19 in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #11 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #12 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #13 0x00007f5c8b060ed1 in index_storage_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #14 0x00007f5c8abb6ead in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #15 0x00007f5c8b044f83 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #16 0x00007f5c8abd9602 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #17 0x00007f5c8ae0e813 in ?? () from /usr/local/lib/dovecot/lib01_acl_plugin.so No symbol table info available. #18 0x00007f5c8afe2b91 in mailbox_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #19 0x00007f5c8abbab7b in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #20 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #21 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #22 0x00007f5c8b060ed1 in index_storage_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #23 0x00007f5c8abb6ead in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #24 0x00007f5c8b044f83 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #25 0x00007f5c8abd9602 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #26 0x00007f5c8ae0e813 in ?? () from /usr/local/lib/dovecot/lib01_acl_plugin.so No symbol table info available. #27 0x00007f5c8afe2b91 in mailbox_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #28 0x00007f5c8abbab7b in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #29 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #30 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #31 0x0000559b17308ace in cmd_select_full () No symbol table info available. #32 0x0000559b17310384 in command_exec () No symbol table info available. #33 0x0000559b1730e832 in ?? () No symbol table info available. #34 0x0000559b1730e8cc in ?? () No symbol table info available. #35 0x0000559b1730ecd5 in client_handle_input () No symbol table info available. #36 0x0000559b1730f2f4 in client_input () No symbol table info available. #37 0x00007f5c8aefe009 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #38 0x00007f5c8aeff8ce in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #39 0x00007f5c8aefe10c in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #40 0x00007f5c8aefe318 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #41 0x00007f5c8ae78413 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #42 0x0000559b17300f81 in main () No symbol table info available. (gdb) quit Jakob Am 25.07.2018 um 10:01 schrieb Aki Tuomi: > Try running gdb again with corrected path for imap binary > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Jakobus Schürz <jakobus.schuerz(a)ebcont.com> > Date: 25/07/2018 10:46 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Panic: Leaked view for index - virtual mailbox > > Hi Aki! > > The config is in the attachment. > > The output from gdb is this: > > > # gdb /usr/lib/dovecot/imap /var/core/24491 > GNU gdb (Debian 8.1-3) 8.1 > Copyright (C) 2018 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <http://www.gnu.org/software/gdb/bugs/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > For help, type "help". > Type "apropos word" to search for commands related to "word"... > /usr/lib/dovecot/imap: Datei oder Verzeichnis nicht gefunden. > [New LWP 24491] > Core was generated by `dovecot/imap [jakob 213'. > Program terminated with signal SIGABRT, Aborted. > #0 0x00007f5c8ac4cf3b in ?? () > (gdb) bt full > #0 0x00007f5c8ac4cf3b in ?? () > No symbol table info available. > #1 0x0000000000000000 in ?? () > No symbol table info available. > (gdb) quit > > And i have a complex setup for virtual mailboxes... > > For Synoptic/AKTUELL it is: > > # cat /var/mail/virtual/AKTUELL/dovecot-virtual > !Real/halbjahr > all > > And for Real/halbjahr it is: > > # cat /var/mail/real/halbjahr/dovecot-virtual > !Real/Alle > all younger 15768000 > > And for Real/Alle it is: > > # cat /var/mail/real/Alle/dovecot-virtual > !INBOX > INBOX/* > -INBOX/Trash > -INBOX/Trash/* > -INBOX/Archives > -INBOX/Archives/* > -INBOX/Drafts > -INBOX/Drafts/* > -INBOX/Junk > -INBOX/Junk/* > -INBOX/SYSTEM > -INBOX/SYSTEM/* > all > > > jakob > > > Am 25.07.2018 um 09:11 schrieb Aki Tuomi: > > So the core file is not very useful... > > > > can you, instead, attach your doveconf -n and your virtual folder > configurations and also > > > > gdb /usr/lib/dovecot/imap /path/to/core > > bt full > > > > Aki > > > >> On 25 July 2018 at 09:55 Jakobus Schürz > <jakobus.schuerz(a)ebcont.com> wrote: > >> > >> > >> Hi Aki! > >> > >> This is debian buster, but a self-compiled dovecot from git! > >> > >> /usr/local/sbin/dovecot --version > >> 2.3.2.1 (0719df592) > >> > >> jakob > >> > >> > >> Am 25.07.2018 um 08:30 schrieb Aki Tuomi: > >>> And can you provide dovecot --version too, please. > >>> > >>> Aki > >>> > >>>> On 25 July 2018 at 09:18 Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > >>>> > >>>> > >>>> Hi! > >>>> > >>>> Which debian release is this? > >>>> > >>>> Aki > >>>> > >>>>> On 25 July 2018 at 05:18 Jakobus Schürz > <jakobus.schuerz(a)ebcont.com> wrote: > >>>>> > >>>>> > >>>>> Hi There! > >>>>> > >>>>> I run into this problem with virtual Mailboxes on release-2.3.2 (and > >>>>> also in master and in older versions of dovecot) > >>>>> > >>>>> I added the core-file. > >>>>> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index > >>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: > Opened > >>>>> in index-storage.c:338 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+ > >>>>> 0xceeba) [0x7ffad9ac0eba] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7ffad9a2efe8] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) > >>>>> [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s > >>>>> torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) > >>>>> [0x7ffad9bbb1aa] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 > >>>>> x7ffad9792b80] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) > >>>>> [0x7ffad9792d3b] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) > >>>>> [0x7ffad9795f1 > >>>>> 9] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7ffad9bbd6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo > >>>>> vecot-storage.so.0(index_storage_get_status+0x31) > [0x7ffad9c3bed1] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) > [0x7ffad9791ead] > >>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad > >>>>> 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7ffad97b4602] -> > /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7ffad99e9813] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox > >>>>> _get_status+0x31) [0x7ffad9bbdb91] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) > >>>>> [0x7ffad9795b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 > >>>>> x7ffad9bbd6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7ffad9bbd787] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) > >>>>> [0x7ffad9c3bed1] -> /usr/loca > >>>>> l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) > >>>>> [0x7ffad9c1ff83] -> > /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7ffad97b460 > >>>>> 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7ffad99e9813] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) > >>>>> [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug > >>>>> in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7ffad9bbd6d1] > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): > >>>>> child 11292 killed with signal 6 (core dumped) > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: > >>>>> AUTH 19 PLAIN service=imap secured=tls > >>>>> session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 > >>>>> 20 lport=143 rport=41758 > >>>>> local_name=aldebaran.xundeenergie.at > >>>>> ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 > >>>>> ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb > >>>>> out: CONT 19 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: > >>>>> CONT<hidden> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: > >>>>> passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: > user=jakob > >>>>> file=/usr/local/etc/dovecot/users > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb > >>>>> out: OK 19 user=jakob > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: > >>>>> REQUEST 2436366337 10570 19 > >>>>> dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 > request_auth_token > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: > >>>>> passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: > user=jakob > >>>>> file=/usr/local/etc/dovecot/users > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb > >>>>> out: USER 2436366337 jakob home=/var/mail/jakob > >>>>> acl_groups=home,admin auth_token=3ea3b630e131 > >>>>> 3bf5beb0f26ff740450189f63e3e > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: > >>>>> user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, > >>>>> mpid=11298, TLS, session=<9KKNZclxHqPAqADc> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index > >>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: > Opened > >>>>> in index-storage.c:338 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+ > >>>>> 0xceeba) [0x7fbd982b2eba] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7fbd98220fe8] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) > >>>>> [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s > >>>>> torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) > >>>>> [0x7fbd983ad1aa] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 > >>>>> x7fbd97f84b80] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) > >>>>> [0x7fbd97f84d3b] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) > >>>>> [0x7fbd97f87f1 > >>>>> 9] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7fbd983af6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo > >>>>> vecot-storage.so.0(index_storage_get_status+0x31) > [0x7fbd9842ded1] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) > [0x7fbd97f83ead] > >>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 > >>>>> 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7fbd97fa6602] -> > /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7fbd981db813] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox > >>>>> _get_status+0x31) [0x7fbd983afb91] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) > >>>>> [0x7fbd97f87b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 > >>>>> x7fbd983af6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7fbd983af787] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) > >>>>> [0x7fbd9842ded1] -> /usr/loca > >>>>> l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) > >>>>> [0x7fbd98411f83] -> > /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7fbd97fa660 > >>>>> 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7fbd981db813] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) > >>>>> [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug > >>>>> in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7fbd983af6d1] > >>>>> Jul 25 04:11:30 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): > >>>>> child 11298 killed with signal 6 (core dumped) > >>>>> > >>>>> > >>>>> jakob > >>>>> >

1 0

dsync: expunge from pop3 does not replicate
by Jakub Lánský 25 Jul '18

25 Jul '18

Hi, I'm using dovecot 2.3.2.1 on Xenial from upstream packages on two Dovecot servers connected with dsync over TCP. E-mails which are deleted via POP3 protocol are not correctly deleted on second server via dsync. Jul 25 09:29:19 mda11 dovecot: pop3(jakub@***)<7587><8xaJ1c1x9uEqAB7QADwAAAAAAAAAAL7v>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Nothing happened on the second machine then. After running # doveadm replicator replicate "jakub@***", e-mail got expunged immediately on second server. Jul 25 09:50:56 mda22 dovecot: dsync-local(jakub@***)<Xt6oFy8nWFsjIwAA0YRh9g>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Any ideas what to do or test? Thank you -- Jakub Lánský IT administration/support technician jakub(a)lansky.biz GSM: +420776172737 Jabber/GTalk: lenny(a)blesmrt.net

2 1

Dsync fails to connect to remote IMAP server
by Andrzej Polatyński 24 Jul '18

24 Jul '18

Hi, I'm trying to migrate from an old courier IMAP server to Dovecot 2.3.1 (8e2f634). The old server uses self signed SSL certificate. I'm using the following configuration: imapc_host = 10.1.1.3 imapc_user = %u imapc_features = rfc822.size fetch-headers imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no mail_prefetch_count = 20 mail_shared_explicit_inbox = no Launching dsync with the command: doveadm -o mail_fsync=never -o imapc_password=PASSWORD -Dv backup -R -u USER @DOMAIN <andrzej(a)datatel.net> imapc: In the output logs I get messages like below: dsync(USER@DOMAIN): Error: imapc(10.1.1.3:993): Couldn't initialize SSL context: Can't verify remote server certs without trusted CAs (ssl_client_ca_* settings) dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Created new connection dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Looking up IP address (reconnect_ok=true, last_connect=1532016643) dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Connecting to 10.1.1.3:993 dsync(USER@DOMAIN): Info: imapc(10.1.1.3:993): Connected to 10.1.1.3:993 (local 172.17.0.5:51972) dsync(USER@DOMAIN): Error: imapc(10.1.1.3:993): No SSL context dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Disconnected Am I missing some configuration parameters? -- Regards, Andrew

2 2

dovecot sometimes sends non-default SSL cert if IMAP client won't send SNI
by Martin Johannes Dauser 24 Jul '18

24 Jul '18

Hi, I recognised some funny behaviour on my server. IMAP clients which won't send an Server Name Indication (SNI) sometimes get the wrong certificate. I would expect that those clients always get the default certificate (of my new domain), instead in about 20 to 50% of connections the certificate of my old domain will be presented. (sample rate was 3 times 30 connections) Clients sending SNI always get the right certificate. A user informed me that offlineIMAP complains 'CA Cert verifying failed: no matching domain name found in certificate' So at least offlineIMAP 7.0.12 from Debain stretch won't send SNI, there is a newer version upstream though. I myself checked the server's behaviour with openssl: $ openssl s_client -showcerts -connect IP-address:993 and $ openssl s_client -showcerts -connect IP-address:993 -servername imap.domain I'm totally clueless about how come. Best regards Martin Johannes Dauser # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.5 (Maipo) ... service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } ... ssl = required # set default cert ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_cipher_list = DHE-RSA-AES256-SHA:DHE-RSA-AES128- SHA:ALL:!LOW:!SSLv2:!EXP:!aNULL:!MD5:!RC4:!DES:!3DES:!TLSv1 ssl_key = </etc/pki/dovecot/private/mail_new_domain.key ssl_protocols = !SSLv2 !SSLv3 ... # set alternativ cert for old domain local_name mail.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } local_name imap.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } local_name pop.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } # set explicit cert for new domain local_name mail.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_doman.key } local_name imap.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_domain.key } local_name pop.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_domain.key }

2 3

Namespace question
by J Doe 24 Jul '18

24 Jul '18

Hi, I have a question about the “inbox” namespace, as mentioned in: conf.d/10-mail.conf. I have written my dovecot.conf file from scratch and do not include: conf.d/10-mail.conf. I have not defined the “inbox” namespace and so I am assuming that one is created by default. When I list the dovecot defaults via “sudo doveconf -d”, I notice that no “namespace inbox” entry exists. If “namespace inbox” is not specified, is one still created by default ? Thanks, - J

2 1

anvil in 2.3.2.1?
by kevin martin 23 Jul '18

23 Jul '18

Has anvil gone away in 2.3.2.1? I ask only because I don't find an example of anvil in the conf.d files anymore and I'm migrating from 2.2.10 version to 2.3.2.1. Thanks.

1 0

doveadm expunge didn't clear Trash mailbox
by Sophie Loewenthal 23 Jul '18

23 Jul '18

Hi, Why did my 'doveadm expunge' command not clear the Trash out of a mailbox? The oldest messages was put into the Trash on the 26th June 2018 as shown in the file timestamp. -rw------- 1 vmail mail 33056 Jun 26 16:46 1530031582.M768773P18242.mx10,S=33056,W=33510:2,RS # doveadm -D expunge -u testuser(a)example.org mailbox Trash savedbefore 2d Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_lookup_dict_iterate_visible_next (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(testuser(a)example.org): Debug: Added userdb setting: mail=maildir:/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: Added userdb setting: plugin/quota=dirsize:storage= doveadm(testuser(a)example.org): Debug: Effective uid=150, gid=8, home=/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: maildir++: root=/var/vmail/example.org/testuser@example.org, index=, indexpvt=, control=, inbox=/var/vmail/example.org/testuser@example.org, alt= Sophie

3 6

Dovecot pop3d and imapd problem
by John Paul Iglesia 23 Jul '18

23 Jul '18

Hi, My dovecot version : 2.2.22 Recently, i had issues on dovecot. All packages of dovecot were installed on my system then suddenly when I checked yesterday the packages for dovecot-pop3d and dovecot-imapd were no longer on the list of app installed. Because of this dovecot service stop running. I checked the apt history log, term log and even dpkg log, there were no information about removing the packages. It just shown on my apt list the packages were not longer there. I had to reinstalled these 2 packages just to make dovecot run and for me to be able to receive and send messages. What do you think is the problem, is it dovecot bug? Please advise. Thanks, paul.tcbc

3 3

dovecot lmtp and drop privileges to specific user
by Christos Chatzaras 23 Jul '18

23 Jul '18

Is it possible when dovecot LMTP to drop privileges to a specific user instead of the e-mail account user?

2 1

Stopping login via "nologin" parameter
by J Doe 22 Jul '18

22 Jul '18

Hello, I have a basic e-mail server with Postfix 3.1 and Dovecot 2.2.22. I am using a passwd-file for both userdb and passdb: /etc/dovecot/dovecot.conf userdb { driver = passwd-file args = /etc/dovecot/passwd } passdb { driver = passwd-file args = /etc/dovecot/passwd } } In the passwd file, I want to have user account names for SMTP SASL AUTH and IMAP that are NOT e-mail addresses. For example, employee one of ABC corp would have a SMTP SASL AUTH/IMAP account name in the form: abc_company_employeeid (for example: abc_company_03284). The idea behind that is that I do not want someone outside of the company to be able to know the first half of the username and password pair just because they have an employee's e-mail address. For the e-mail address I specify something like: bob(a)abc.com however I never want someone to be able to login via their e-mail address. Originally, I specified the password field as empty, with the understanding being that the default encryption of a password is {CRYPT}. Since crypt() cannot output a null string, this meant that there was never a valid password. So passwd looked like this: /etc/dovecot/passwd # SMTP SASL AUTH and IMAP accounts abc_company_03284:::::::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_co… # IMAP bob@abc.com:vmail:vmail::/home/vmail/bob::userdb_maill=maildir:/var/mail/vhosts/abc.com/abc_company_03284 I tested SMTP SASL AUTH and IMAP via the openssl s_client and can confirm that I can login and send e-mail as well as retrieve mail only via the: abc_company_03284 account, but because an empty password field isn’t mentioned on the Dovecot wiki, I was wondering if I should add “nologin” to explicitly make it impossible for: bob(a)abc.com. “nologin” was mentioned to me in a previous e-mail to this list. So passwd would now look like this: /etc/dovecot/passwd # SMTP SASL AUTH and IMAP accounts abc_company_03284:::::::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_co… # IMAP bob@abc.com:vmail:vmail::/home/vmail/bob::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_company_03284 nologin I restarted Dovecot and tested this with openssl s_client for SMTP SASL AUTH and IMAP, but just wanted to make sure that this STOPS ANY LOGINS via the e-mail address: bob(a)abc.com ? Thanks, - J

1 1

ot: LE server conf setup/ iPhone 'expired cert' message
by Voytek Eymont 22 Jul '18

22 Jul '18

I've installed LE certs on my Dovecot a while back, and, it has been working OK since, but, today, an iPhone user said he can't get emails as iphone says 'cert is expired', searching around, I see some other iPhone similar issues reported, do I have my conf correct, I have; # cat dovecot.conf | grep ssl ssl = required verbose_ssl = no ssl_cert = </etc/letsencrypt/live/fqn.myserver/fullchain.pem ssl_key = </etc/letsencrypt/live/fqn.myserver/privkey.pem is fullchain.pem and privkey.pem is what I should be using ? anythought how to force an iphone to reload cert ? actual cert was renewed 15/7, old/previous one expired earlier today ls /etc/letsencrypt/live/fqn.myserver/ cert.pem chain.pem fullchain.pem privkey.pem (if I open mailserver host in browser, padlock shows current/valid cert) -- Voytek

6 8

Dbox lost messages
by Fineware PM 20 Jul '18

20 Jul '18

Hello, I use dovecot with dbox storage system. Today I receive 2 mail (I see that in the maillog ) but I don't find in INBOX using my IMAP client. I look in the files m.* and I find the message that I receive. But I cannot find it in any IMAP folder. I try to run "doveadm force-resync -u user inbox" but nothing change. I export all email using the command "doveadm backup -u user mbox:/tmp/mail:INDEX:/tmp/imap:LAYOUT:maildir++ and in the mbox file for inbox I found the 2 mails arrived. How I can understand why I cannot see the messages ? or how I can recover it ? Bet regards.

2 5

OT: 'lost' emails
by Voytek 20 Jul '18

20 Jul '18

I suspect this is mail client issue, but looking for any suggestions: user with Thunderbird says " I'm losing emails, mail is not in inbox, but, when I search, that email shows in search result, but, I can't open the email body" i don't fully understand what he was trying to say, and, won't be able to look at his PC till Monday. Looking at inbox's 'cur' directory, I can see the'missing' email amongst the other 2000 emails in 'cur' Is there any indexing I should do on the user's email folder, how? or, is this purely Thunderbird issue, and, I need to re index Thunderbird? V -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

3 2

SIS: dovecot creates duplicated attachments (sometimes)
by Alexander Moisseev 20 Jul '18

20 Jul '18

SIS deduplication was broken in 2.2.16 and has been fixed with https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c84158… but still sometimes (just several times in a month or so) dovecot creates duplicated attachments. As you can see in directory listings below all attachments was created at (about) the same time, but one of them has different inode number. It easy to discover using https://github.com/moisseev/doveadm-tools/blob/master/bin/dsisck # dsisck -n mail_uid=vmail mail_attachment_dir=/vmail/attachments ==> Checking SIS... # ln -f ./30/b3/30b367c584a123eee59478adf3e4f4c9e1226545-c56eae04a67c3157287f01003d96bafd ./30/b3/30b367c584a123eee59478adf3e4f4c9e1226545-7ad0a411d17c31572b7a01003d96bafd # mkdir -p -m 700 ./64/8f/hashes && ln ./64/8f/648f5cfa27af6d20c8570fdcaeab997663e15105-55430d2cd4432c571cb600003d96bafd ./64/8f/hashes/648f5cfa27af6d20c8570fdcaeab997663e15105 # ln -f ./6f/3f/6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-b1935817ed753557546700003d96bafd ./6f/3f/6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-72da1f32e38e3557947b00003d96bafd # ln -f ./dd/d9/ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-6bf7c122fefb3157ad3500003d96bafd ./dd/d9/ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-90fd1415e7e53157112800003d96bafd -------------------------------------------------------------- Unexpected objects found: 0 Attachments processed: 43500 Different attachments with similar hashes skipped: 0 Attachments deduplicated: 3 File system blocks freed up: 1800 Attachment deduplication attempts failed: 0 Hash files created: 1 Hash files creation attempts failed: 0 Hash files re-linked: 0 Hash files re-link attempts failed: 0 Orphaned hash files: 0 Invalid hash files (not a regular file): 0 -------------------------------------------------------------- # cd /vmail/attachments # ls -li ./30/b3/ ./30/b3/hashes/ ./30/b3/: total 1996 7464083 -rw------- 1 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-7ad0a411d17c31572b7a01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-bb6eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-bd6eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-bf6eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-c36eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-c56eae04a67c3157287f01003d96bafd 7464084 drwx------ 2 vmail vmail 512 May 10 09:16 hashes ./30/b3/hashes/: total 332 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545 # ls -li ./6f/3f/ ./6f/3f/hashes/ ./6f/3f/: total 644 15088414 -rw------- 1 vmail vmail 326656 May 13 11:23 6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-72da1f32e38e3557947b00003d96bafd 15088422 -rw------- 2 vmail vmail 326656 May 13 11:23 6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-b1935817ed753557546700003d96bafd 15088448 drwx------ 2 vmail vmail 512 May 13 11:23 hashes ./6f/3f/hashes/: total 320 15088422 -rw------- 2 vmail vmail 326656 May 13 11:23 6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe # ls -li ./dd/d9/ ./dd/d9/hashes/ ./dd/d9/: total 748 80548 -rw------- 3 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-68f7c122fefb3157ad3500003d96bafd 80548 -rw------- 3 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-6bf7c122fefb3157ad3500003d96bafd 80547 -rw------- 1 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-90fd1415e7e53157112800003d96bafd 80549 drwx------ 2 vmail vmail 512 May 10 18:19 hashes ./dd/d9/hashes/: total 248 80548 -rw------- 3 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b # doveconf -n # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: FreeBSD 10.3-RELEASE i386 auth_default_realm = example.com auth_mechanisms = digest-md5 cram-md5 plain apop doveadm_password = # hidden, use -P to show it first_valid_gid = 1000 first_valid_uid = 1000 lda_mailbox_autosubscribe = yes listen = * mail_attachment_dir = /vmail/attachments mail_gid = vmail mail_home = /vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = quota zlib acl mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = mdbox:%%h/mdbox:INDEXPVT=~/mdbox/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archives { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = scheme=plain username_format=%n /usr/local/etc/dovecot/dovecot.auth/%d.passwd driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/vmail/shared-mailboxes.db antispam_backend = mailtrain antispam_mail_notspam = report_ham antispam_mail_sendmail = /usr/local/libexec/dovecot/dovecot-lda antispam_mail_sendmail_args = -d;spam(a)example.com;-m antispam_mail_spam = report_spam antispam_spam = Junk antispam_trash = Trash;train_ham;train_prob;train_spam quota = dict:User quota::file:%h/dovecot-quota quota_rule = *:storage=2G quota_rule2 = Trash:storage=+10%% quota_rule3 = Spam:storage=+20%% quota_status_nouser = DUNNO quota_status_success = DUNNO sieve_after = /usr/local/etc/dovecot/sieve/sieve.after sieve_before = /usr/local/etc/dovecot/sieve/sieve.before sieve_vacation_min_period = 0 zlib_save = gz zlib_save_level = 3 } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve pop3 quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { user = vmail } } service config { unix_listener config { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 0 } process_limit = 200 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service pop3-login { inet_listener pop3s { port = 0 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } ssl_cert = </etc/ssl/certs/mx.example.com.crt ssl_key = </etc/ssl/private/mx.example.com.key userdb { args = username_format=%n /usr/local/etc/dovecot/dovecot.auth/%d.passwd driver = passwd-file } verbose_proctitle = yes protocol imap { mail_plugins = quota zlib acl antispam imap_quota imap_zlib imap_acl } protocol lmtp { mail_plugins = quota zlib acl sieve }

1 1

folders not visible on copied mail folders
by Mark Foley 20 Jul '18

20 Jul '18

We had a user quit recently. Three days ago I copied his entire Maildir folder to another user to that user's Maildir/.JoesEmail. I changed ownership and made the permission 'chmod -R og-rwx .', just like all the other files/directories of the new owner. This didn't work to show the new folder. Today, in his Thunderbird client, I subscribed to the 'JoesEmail' folder. I restarted dovecot and restarted Thunderbird. In Thunderbird, the 'JoesEmail' folder now shows, but it is empty and shows none of the subordinate mail folders. I ran 'doveadm index -u newowner JoesEmail' and 'doveadm force-resync -u newowner JoesEmail'. This didn't help. I did this once before with a previous user who quit and only changed ownership, no subscribing, no doveadm, and that worked. What am I doing wrong? THX --Mark

4 9

100% Dovecot MTA Replacement Setup
by David Favor 19 Jul '18

19 Jul '18

Working out upgrade of old 1.x + 2.x Dovecot installs to latest 2.3.2.1 out of Ubuntu Bionic repositories. _______ https://wiki.dovecot.org/Services suggests Dovecot can be used for full mail infrastructure, avoiding the complexity of exim4 or other MTA setup/management. Let me know if I understand this correctly. 1) https://wiki.dovecot.org/Submission can be used to listen on port 25 + port 587 (with auth). 2) https://wiki.dovecot.org/Pigeonhole can be used for filtering, including forwarding email to other machines. 3) https://wiki.dovecot.org/Pigeonhole/ManageSieve/Configuration can be used to forward off machine email, for example flowing through a relay service like MailGun, using a simple script or service like ESMTPD. 4) https://wiki.dovecot.org/LMTP can be used to deposit messages into filesystem as Maildir or dbox or mdbox backing stores.

2 1

Replication problems
by Thomas Kristensen 19 Jul '18

19 Jul '18

Hey I am trying to setup a dovecot cluster with 2 servers using replication /dsync. In front of it I got a Fortinet ADC (Load balance) and I think that I messing up the dsync. I see mails duplicated in the sync progress. If I disable one of the servers in the ADC, it seems to work and the sync if working without a problem. But if I use both servers with a round robin on the ADC, I see mailed duplicated. Ex. I sent 100 mails thru the SMTP (Postfix) and 107 mails is in both servers, but as said before, if I disable one of the servers in the ADC, I see the correct amount of mails in both dovecot servers. In the header of the duplicated mails I see the exact same postfix id and LMTP id from dovecot. Also I cant seem to get any log from the sync progress. Med venlig hilsen Thomas Kristensen [MM_mail_logo_3_AS] Storhaven 12 - 7100 Vejle Tlf: 75 72 54 99 - Fax: 75 72 65 33 E-mail: tk(a)multimed.dk<mailto:tk@multimed.dk>

2 1

Re: Sendmail Dovecot Trouble
by John Rowan 19 Jul '18

19 Jul '18

/var/mail is a symlink to /var/spool/mail I tried both, neither works. I just wiped out the server, reinstalled from scratch this time I selected e-mail server while selecting packages after specifying GUI-server on the CentOS install. I had previously installed Dovecot after the initial server build. This time Dovecot was installed and active at boot but still can't find my mail in /var/spool/mail. On 7/13/2018 11:44 AM, Aki Tuomi wrote: > Should your INBOX path be /var/spool/mail/%u then? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: John Rowan <rowan(a)rownetco.com> > Date: 13/07/2018 17:44 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Sendmail Dovecot Trouble > > I've been struggling trying to get Thunderbird to read e-mail off a > CentOS 7 server. > > Sendmail writes mail in /var/spool/mail > > I've configured dovecot to try to read from there using Thunderbird > (POP3/SMTP). > > The firewall allows ports 25/110. > > I verified I have mail in /var/spool/mail > > but Thunderbird is unable to retrieve that mail. > > I've googled sendmail / dovecot config, I've looked a the wiki but I > just can't figure this out. > > Please don't suggest using postfix, I just want to get sendmail / > dovecot working. > > > [@mail conf.d]# dovecot --version > 2.2.10 > > [root@mail conf.d]# dovecot -n > # 2.2.10: /etc/dovecot/dovecot.conf > # OS: Linux 3.10.0-327.36.3.el7.i686 i686 CentOS Linux release 7.2.1511 > (AltArch) > auth_mechanisms = plain login > disable_plaintext_auth = no > > mail_location = mbox:~/mail:INBOX=/var/mail/%u > > mbox_write_locks = fcntl > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > protocols = > ssl_cert = </etc/pki/dovecot/certs/dovecot.pem > ssl_key = </etc/pki/dovecot/private/dovecot.pem > userdb { > driver = passwd > } > > > --- > This email has been checked for viruses by Avast antivirus software. > https://www.avast.com/antivirus >

2 1

Force a user to use POP3
by John Doe Vecot 18 Jul '18

18 Jul '18

[dovecot-2.3.2.1] I have dovecotrunning icw postfixandhave IMAP and POP3 available to retrieve mail. Can you tell me how I can configure Dovecot in order to force certain users to use POP3 (download messages) only? Thanks, Jos

3 2

Re: Sendmail Dovecot Trouble
by John Rowan 18 Jul '18

18 Jul '18

Having reinstalled CentOS 7 including e-mail server in initial software configuration it installed Postfix/Dovecot. I've been using Sendmail for 20 years and no experience with Postfix. Looked in Webmin -> servers -> Postfix and specified Maildir, changed the 10-mail.conf to specify mail_location = maildir:~/Maildir and everything's working. Thanks for help. On 7/13/2018 11:44 AM, Aki Tuomi wrote: > Should your INBOX path be /var/spool/mail/%u then? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: John Rowan <rowan(a)rownetco.com> > Date: 13/07/2018 17:44 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Sendmail Dovecot Trouble > > I've been struggling trying to get Thunderbird to read e-mail off a > CentOS 7 server. > > Sendmail writes mail in /var/spool/mail > > I've configured dovecot to try to read from there using Thunderbird > (POP3/SMTP). > > The firewall allows ports 25/110. > > I verified I have mail in /var/spool/mail > > but Thunderbird is unable to retrieve that mail. > > I've googled sendmail / dovecot config, I've looked a the wiki but I > just can't figure this out. > > Please don't suggest using postfix, I just want to get sendmail / > dovecot working. > > > [@mail conf.d]# dovecot --version > 2.2.10 > > [root@mail conf.d]# dovecot -n > # 2.2.10: /etc/dovecot/dovecot.conf > # OS: Linux 3.10.0-327.36.3.el7.i686 i686 CentOS Linux release 7.2.1511 > (AltArch) > auth_mechanisms = plain login > disable_plaintext_auth = no > > mail_location = mbox:~/mail:INBOX=/var/mail/%u > > mbox_write_locks = fcntl > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > protocols = > ssl_cert = </etc/pki/dovecot/certs/dovecot.pem > ssl_key = </etc/pki/dovecot/private/dovecot.pem > userdb { > driver = passwd > } > > > --- > This email has been checked for viruses by Avast antivirus software. > https://www.avast.com/antivirus >

1 0

best practices for migrating to new dovecot version
by Shawn Heisey 18 Jul '18

18 Jul '18

I have a machine with my mail service on it running Debian Squeeze. The version of dovecot on that server is 1.2.15. I'm building a new server with Ubuntu 18.04 (started with 16.04, upgraded in place), where the dovecot version is 2.2.33. I plan to migrate all my services to this new machine. The virtual mailboxes are on disk in maildir format, with accounts in a mysql database managed by postfixadmin. When I copy them over to the new machine, would there be any value to excluding the files that dovecot creates, and letting the new version recreate them? In one mailbox here are some of the files I am considering excluding: dovecot.index dovecot.index.cache dovecot.index.log dovecot.index.thread dovecot-keywords dovecot-uidlist dovecot-uidvalidity dovecot-uidvalidity.5876ca77 There are other files under consideration, like maildirsize and maildirfolder. One that I would be sure to *not* remove is subscriptions. If there are recommendations about dovecot files in a maildir that should not be removed during a migration, please let me know. I'm aware that rebuilding this information could be slow. My own personal mailbox on the system is over 8GB in size and has well over nine hundred thousand files in it. Thanks, Shawn

4 3

Dovecot Quota and subject utf-8
by Danilo G. Baio 17 Jul '18

17 Jul '18

Hi. When a user is over quota and a message is rejected, it sends a message back changing partially the subject (depending on the size). With utf-8 it breaks the information, we noticed this behavior when the subject line uses utf-8 and it is broken in more than one line: Subject: Quêm casé erat vim id, vix ín dicit putânt, minim çónsequuntur ea iús. Agam cetêro tê eôs, ád vim ipsum tantâs expetêndis. Ut prõ vidit diçit iudicabit, cum út çômmódo Subject of a delivered message: Subject: =?UTF-8?Q?Qu=C3=AAm_cas=C3=A9_erat_vim_id=2C_vix_=C3=ADn_dicit_p?= =?UTF-8?Q?ut=C3=A2nt=2C_minim_=C3=A7=C3=B3nsequuntur_ea_i=C3=BAs=2E_Agam_?= =?UTF-8?Q?cet=C3=AAro_t=C3=AA_e=C3=B4s=2C_=C3=A1d_vim_ipsum_tant=C3=A2s_e?= =?UTF-8?Q?xpet=C3=AAndis=2E_Ut_pr=C3=B5_vidit_di=C3=A7it_iudicabit=2C_cum?= =?UTF-8?Q?_=C3=BAt_=C3=A7=C3=B4mm=C3=B3do?= Subject of a message rejected with Dovecot Quota: Subject: Rejected: =?UTF-8?Q?Qu=C3=AAm_cas=C3=A9_erat_vim_id=2C_vix_=C3=ADn_dicit_p?=? =?... Auto-Submitted: auto-replied (rejected) Precedence: bulk https://pastebin.com/raw/SWJJARga Regards. -- Danilo G. Baio (dbaio)

1 0

Dovecot and Sieve setup
by Will Merkens 17 Jul '18

17 Jul '18

I thought I had sieve working I could create the rules in TB and it says it's communicating properly and saves the file but the sieve rules do not seem to be working. when I look at /var/spool/maildir/domain/user I see Maildir Maildir =uid=1000 inside Maildir =uid=1000/sieve I see my sieve script I created Test.sieve and a tmp directory Should not this be in the main Maildir/sieve directory. -- William Merkens IT Support Analyst Userful Corporation +1 403.538.7767 ext.289 +1 866.873.0091 Suite 300 736 8th Ave SW Calgary AB T2P 1H4 Canada https://www.userful.com

2 1

dsync panic
by Infoomatic 16 Jul '18

16 Jul '18

Hi, I just upgraded from dovecot 2.2.19 to 2.3.2. "doveadm backup" worked fine in v 2.2.19, but now panics (user with shared folder): /opt/dovecot/bin/doveadm backup -u testuser -1 sdbox:/tmp/testuser dsync(standl2): Panic: file mailbox-attribute.c: line 360 (mailbox_attribute_get_stream): assertion failed: (value_r->value != NULL || value_r->value_stream != NULL) dsync(standl2): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xcb6fa) [0x7f43679986fa] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xcb769) [0x7f4367998769] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f43679069c1] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(+0x568ff) [0x7f4367c9d8ff] -> /opt/dovecot/bin/doveadm(dsync_mailbox_import_attribute+0x4d) [0x56234f7b68dd] -> /opt/dovecot/bin/doveadm(dsync_brain_sync_mails+0x2fd) [0x56234f7b217d] -> /opt/dovecot/bin/doveadm(dsync_brain_run+0x538) [0x56234f7adb28] -> /opt/dovecot/bin/doveadm(+0x27fec) [0x56234f793fec] -> /opt/dovecot/bin/doveadm(+0x2a0e7) [0x56234f7960e7] -> /opt/dovecot/bin/doveadm(+0x2ad7b) [0x56234f796d7b] -> /opt/dovecot/bin/doveadm(doveadm_mail_try_run+0x1fa) [0x56234f79769a] -> /opt/dovecot/bin/doveadm(main+0x45b) [0x56234f786b2b] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f4367523830] -> /opt/dovecot/bin/doveadm(_start+0x29) [0x56234f786ca9] regards, infoomatic

5 8

ssl_dh required, even though DH is disabled.
by Eric Toombs 16 Jul '18

16 Jul '18

Here's my config: # 2.3.2 (582970113): /etc/dovecot/dovecot.conf # OS: Linux 4.17.5-1-ARCH x86_64 Arch Linux # Hostname: vault passdb { driver = pam } protocols = imap service imap-login { inet_listener imap { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/myhostname.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA:ECDHE-ECDSA-AES128-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384 ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 My filesystem is ext4. Even though I use ssl_cipher_list to forbid DH, dovecot still doesn't work unless I provide an ssl_dh, delivering the following error: Jul 14 21:48:08 vault dovecot[8349]: imap-login: Error: Failed to initialize SSL server context: Couldn't parse DH parameters: error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: DH PARAMETERS: user=<>, rip=10.0.0.1, lip=10.0.0.2, session=<4sGi5/9w3pwKAAAB> While providing an ssl_dh is only a minor annoyance, it would be nice if I didn't have to.

2 1

Re: Letsencrypt certificate for repo.dovecot.org expired May 14th..
by DurgaPrasad - DatasoftComnet 15 Jul '18

15 Jul '18

:) Rgds/DP 9849111010 Sent from my iPhone. Pls excuse brevity and typos if any. > On 15-Jul-2018, at 5:00 PM, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > > certbot clearly hates me > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: "B. Reino" <reinob(a)bbmk.org> > Date: 15/07/2018 11:49 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi> > Cc: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: Letsencrypt certificate for repo.dovecot.org expired May 14th.. > > Dear Aki, > > I think the renewal failed again. The SSL certificate expired Saturday, > 14 July 2018. > > This affects (at least) the repo.dovecot.org website and debian > repository. > > Thanks, > Bernardo. > > On 2018-05-15 08:15, Aki Tuomi wrote: > > On 15.05.2018 09:14, B. Reino wrote: > >> Dear all, > >> > >> Just in case you've missed it, the certificate for repo.dovecot.org > >> just expired yesterday. > >> > >> This causes errors in e.g. apt-get update. > >> > >> Thanks in advance for fixing it, > >> > >> -- > >> B. Reino > > > > Seems something went wrong during deployment, thanks. It's fixed now. > > > > Aki

1 0

Connection closed (IDLE running for 0.001 + waiting input for
by Sophie Loewenthal 15 Jul '18

15 Jul '18

Hi, Just noticed an Android email client called K9 Mail is producing these entries in a server's dovecot log: Jul 11 21:03:28 mx1 dovecot: imap(me(a)example.org): Connection closed (IDLE running for 0.001 + waiting input for 1728.597 secs, 2 B in + 10+0 B out, state=wait-input) in=353 out=2154 Jul 11 21:03:31 mx1 dovecot: imap(me(a)example.org): Connection closed (IDLE running for 0.001 + waiting input for 1731.069 secs, 2 B in + 10+0 B out, state=wait-input) in=389 out=1910 I cannot find out what this means after googling. Any ideas? Best wishes, Sophie

2 1

Sendmail Dovecot Trouble
by John Rowan 14 Jul '18

14 Jul '18

I've been struggling trying to get Thunderbird to read e-mail off a CentOS 7 server. Sendmail writes mail in /var/spool/mail I've configured dovecot to try to read from there using Thunderbird (POP3/SMTP). The firewall allows ports 25/110. I verified I have mail in /var/spool/mail but Thunderbird is unable to retrieve that mail. I've googled sendmail / dovecot config, I've looked a the wiki but I just can't figure this out. Please don't suggest using postfix, I just want to get sendmail / dovecot working. [@mail conf.d]# dovecot --version 2.2.10 [root@mail conf.d]# dovecot -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-327.36.3.el7.i686 i686 CentOS Linux release 7.2.1511 (AltArch) auth_mechanisms = plain login disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

3 2

Re: Sendmail Dovecot Trouble
by Alexander Dalloz 14 Jul '18

14 Jul '18

Am 13.07.2018 um 17:44 schrieb Aki Tuomi: > Should your INBOX path be/var/spool/mail/%u then? /var/spool/mail is the same as /var/mail on CentOS 7 as /var/mail is a symlink. Alexander

1 0

mdbox+ ALT storage + lazyexpunge
by Matt Bryant 14 Jul '18

14 Jul '18

All, Anyone know that if you setup lazyexpounge with mdbox that as ALT storage defined, whether the mail location for namespace used by lazyexpunge also need the ALT= specified ?? rgds Matt

1 1

mdbox + alt storage + purge = wtf ...
by Matt Bryant 14 Jul '18

14 Jul '18

All, Is there a bug in doveadm purge ? Configured alt storage and move messages in inbox to the alternate path all well and good. However, after deleting some messages and running a purge on the mailbox found that all messages got recopied over to primary location. I guess this maybe because its re-writing the file and ditching the purged mail .. but shouldnt it keep a track that they were located on alt storage path ?? rgds Matt

1 0

Question about verbose_proctitle
by J Doe 13 Jul '18

13 Jul '18

Hello, I have a question relating to the detail that the verbose_proctitle parameter enables for ps. I have TLS configured for IMAP as follows: /etc/dovecot/dovecot.conf ssl = required ssl_cert = </path/to/cert.pem> ssl_key = </path/to/key.pem> protocols = imap lmtp service imap-login { # Disable insecure IMAP over TCP 143 inet_listener imap { port=0 } } . . . verbose_proctitle = yes If I have a single MUA connect (Apple Mail in this case), I see: $ ps aux | grep -i dovevot dovenull 5552 0.0 0.1 18820 5444 ? S 18:53 0:00 dovecot/imap-login [1 connections (1 TLS)] vmail 5553 0.3 0.1 13612 4304 ? S 18:53 0:00 dovecot/imap [user(a)example.com 1.2.3.4 IDLE] The first part makes sense to me - imap-login is showing the user being connected via imap-login and with TLS. The second part, however, shows the IMAP session with the username, IP address and IMAP command (IDLE), but it does not state TLS. Does this mean that I have logins for IMAP connections protected by TLS but the actual IMAP traffic (mail contents, etc.), is *NOT* configured to use TLS ? That is to say, IMAP traffic is flowing over port 993 without TLS ? From the wiki [1] it appears to state that I only have to configure TLS settings for IMAP if the IMAP protocol is being secured via a *DIFFERENT* TLS certificate. Is this correct ? Thanks, - J Sources: [1] https://wiki2.dovecot.org/SSL/DovecotConfiguration

2 3

Whitelist file for LDAP authentication
by whpang 13 Jul '18

13 Jul '18

Hi, The dovecot version is 2.2.33.2 and we are using LDAP to do the authentication for SMTP service. We have the following configuration in auth-ldap.conf.ext to deny some users for LDAP auth. passdb { args = /etc/dovecot/deny.smtp driver = passwd-file deny = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } And now we want to change the mechanism and only users in the list can send to LDAP auth and deny all others: passdb { args = /etc/dovecot/allow.smtp driver = passwd-file deny = no result_failure = return-fail result_internalfail = return-fail result_success = continue-fail } passdb { # Path for LDAP configuration file, see example-config/dovecot-ldap.conf.ext args = /etc/dovecot/dovecot-ldap.conf driver = ldap } Since we do not have the users’ password in the plain text file “allow.smtp”, the authentication process will fail and exit in the first passdb. Anyone can help to advice how to configure dovecot to have a whitelist for user LDAP authentication? Thank you very much. Best regards, William Pang Academic Computing and Technology Services Section Information and Communication Technology Office University of Macau Tel: 8822 8407

3 2

Pigeonhole extdata repo?
by tai74＠vfemail.net 12 Jul '18

12 Jul '18

Pigeonhole download page has links for extdata plugin up to v0.4 but nothing more and no link to the master repository https://pigeonhole.dovecot.org/download.html I want to use with dovecot 2.3.2rc1 but v0.4 won't compile with it. Thanks for helping ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

3 4