- dovecot - dovecot.org

Saving Attachments
by ＠lbutlr 26 Dec '19

26 Dec '19

I have an account that mostly receives automated emails with attachments. I would like to save those attachments outside of the mail/IMAP area and then add a link (in the headers) to the saved attachment in the original mail. I do not need to strip the attachment from the email. I’ve looked at 10-mail.conf. but I am using Maildir and I do not want to alter the email other than adding a header like X-Local-link: URL://server/path/to/file If mdbox or sdbox are the only options for this, can I specify that for a single user account instead of for all my users? My other idea was to break out my old ripmime script that I wrote for procmail and do something in sieve like if anyof (header :contains [“content-type"] [ “multiupart”, “other types”]) { fileinto :create “TempAttach”; } And then let ripmime loose on .TempAttach/new/ via a periodic cron job knowing the message would end up being filed in whatever default mailbox after the copy was dropped in the temp mail, but that doesn’t get me the added header with the link to the attachment without a lot of work. I suppose I could generate a second mail with the details of the attachment (size, name, sender, date). Not ideal. Suggestions? -- No one ever thinks of themselves as one of Them. We're always one of Us. It's Them that do the bad things.

1 0

Thunderbird, server side filtering (sieve) and new email not in "inbox"
by Jesus Cea 25 Dec '19

25 Dec '19

Migrating my extensive thunderbird filtering rules to sieve has the unfortunate effect that thunderbird doesn't realize that there is new email in other mailboxes beside "inbox". According to ancient documentation, <http://kb.mozillazine.org/How_do_I_check_for_new_messages_in_other_folders#…>, I could configure Thunderbird to check each mailbox periodically, but I have >500 mailboxes and I rather prefer the server to notify the client when new email is avaliable somewhere. Reading between lines in that document, looks like Thunderbird would support STATUS updates while in "IDLE". Is that the case?. Do you know how could I configure dovecot to provide that kind of information to thunderbird?. Maybe some extension? I am aware of "notify", but thunderbird is not "notify" compatible. I can write an IMAP4 proxy to "inject" replies to thunderbird side-fetched via "notify", but I need to know what thunderbird expect. Do you have any idea?. Thanks for your time and expertise. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 0

Is there a way to hide the top level virtual IMAP folder when using the virtual plugin?
by Robert L Mathews 24 Dec '19

24 Dec '19

I'm experimenting with the Virtual plugin to give users access to folders like "All Mail", "Recent" and so on, similar to Gmail. Something like this works properly: mail_location = maildir:~/ namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace { prefix = INBOX.virtual. separator = . location = virtual:virtual list = children ignore_on_failure = yes } I can then create "virtual/All Mail/dovecot-virtual" and "virtual/Recent/dovecot-virtual" in the maildir directory, and it works. However, when accessed using IMAP, an IMAP folder named "virtual" shows in the folder hierarchy, with "All Mail" and "Recent" descended from "virtual". It looks like: INBOX Drafts Sent Trash virtual All Mail Recent I'd prefer the virtual folders to be a level up the hierarchy without the "virtual" parent visible, like: INBOX All Mail Drafts Recent Sent Trash Is that possible? I've tried changing the "prefix = INBOX.virtual." on the virtual namespace to just "prefix = INBOX.", but that causes a "Duplicate namespace prefix" error. I also tried using "alias_for" to merge the namespaces, but that causes "namespace configuration error: Namespace virtual. can't have alias_for=INBOX. to a different storage type (virtual vs maildir)". -- Robert L Mathews

1 1

When is a new mail not unseen?
by Philip Colmer 24 Dec '19

24 Dec '19

I'm trying to diagnose a really strange situation where certain emails, when submitted to the mailbox by Postfix, are not considered to be unseen by Dovecot. During testing, I've shut down anything else on the server that might want to access the mailbox. I submit the email to the local postfix instance which then says it has delivered it to the mailbox: Dec 23 09:51:35 ip-10-35-194-108 postfix/smtpd[3283]: connect from localhost[127.0.0.1] Dec 23 09:51:35 ip-10-35-194-108 postfix/smtpd[3283]: 5A0BF40261: client=localhost[127.0.0.1] Dec 23 09:51:35 ip-10-35-194-108 postfix/cleanup[3286]: 5A0BF40261: message-id=<20191223095135.5A0BF40261(a)servicedesk.linaro.org> Dec 23 09:51:35 ip-10-35-194-108 postfix/smtpd[3283]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 Dec 23 09:51:35 ip-10-35-194-108 postfix/qmgr[1660]: 5A0BF40261: from=< philip.colmer(a)linaro.org>, size=702, nrcpt=1 (queue active) Dec 23 09:51:35 ip-10-35-194-108 postfix/local[3287]: 5A0BF40261: to=<local-it-support@localhost>, relay=local, delay=0.06, delays=0.04/0.02/0/0, dsn=2.0.0, status=sent (delivered to mailbox) Dec 23 09:51:35 ip-10-35-194-108 postfix/qmgr[1660]: 5A0BF40261: removed I then use this command to query the state of the mailbox: sudo doveadm mailbox status -u local-it-support all INBOX and get this response: INBOX messages=142 recent=0 uidnext=5596 uidvalidity=1455577845 unseen=0 highestmodseq=1163 vsize=11315688 guid=2a997739f55ac2560d180000e171d23e firstsaved=1577094051 What can be happening that means that Dovecot doesn't treat a newly delivered message as unseen? Installation details: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1041-aws x86_64 Ubuntu 18.04.3 LTS auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no listen = 127.0.0.1 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" ssl = no ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { driver = passwd } Note that we are not using SSL because Dovecot is only accessible locally within the server. Thank you for any suggestions or comments. Regards Philip

4 10

Sieve vacation not getting enough headers "no known (envelope) recipient address found in message headers"
by Marc Roos 24 Dec '19

24 Dec '19

I am getting these errors[1]. With fairly default setup where sendmail is delivering mail via lmtp. Adding these, do not seem to make a difference. Should I add something to the sendmail configuration? sieve_vacation_dont_check_recipient = no sieve_vacation_use_original_recipient = no [1] discarding vacation response for implicitly delivered message; no known (envelope) recipient address found in message headers

1 0

Trouble using reverse dsync backup (log in successful but almost nothing happens)
by Gerben Wierda 23 Dec '19

23 Dec '19

I am migrating an old dovecot 2.2.30 (macOS High SIerra, macO S Server) to a new server with dovecot 2.3.7 (macOS Mojave, macports). To get the data over, I’m trying to do a reverse backup with doveadm between an old and a new mail server, but failing to do so. I’m trying (from the new server, the old server is 192.168.2.67): doveadm -Dv \ -o imapc_host=192.168.2.67 \ -o imapc_user=gerben \ -o imapc_password=’[snip]' \ -o imapc_features='rfc822.size fetch-headers’ \ -o mail_prefetch_count=20 \ -o mail_fsync=never \ -o imapc_ssl=starttls \ -o imapc_ssl_verify=no \ backup -R -u gerben imapc: It seems to start to work: dsync(gerben): Debug: imapc(192.168.2.67:143): Created new connection dsync(gerben): Debug: imapc(192.168.2.67:143): Looking up IP address (reconnect_ok=true, last_connect=1577059834) dsync(gerben): Debug: imapc(192.168.2.67:143): Connecting to 192.168.2.67:143 dsync(gerben): Info: imapc(192.168.2.67:143): Connected to 192.168.2.67:143 (local 192.168.2.66:50804) dsync(gerben): Debug: imapc(192.168.2.67:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS LOGINDISABLED XAPPLEPUSHSERVICE dsync(gerben): Debug: imapc(192.168.2.67:143): Starting SSL handshake dsync(gerben): Debug: imapc(192.168.2.67:143): SSL handshake successful, ignoring invalid certificate: SSL certificate doesn't match expected host name 192.168.2.67: No match to 2 SubjectAltNames dsync(gerben): Debug: imapc(192.168.2.67:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE XAPPLEPUSHSERVICE AUTH=CRAM-MD5 AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=GSSAPI dsync(gerben): Debug: imapc(192.168.2.67:143): Authenticating as gerben dsync(gerben): Debug: imapc(192.168.2.67:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE XAPPLEPUSHSERVICE COMPRESS=DEFLATE QUOTA ACL RIGHTS=texk dsync(gerben): Debug: imapc(192.168.2.67:143): Authenticated successfully dsync(gerben): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= dsync(gerben): Debug: fts: Indexes disabled for namespace '' dsync(gerben): Debug: brain S: Namespace has location imapc: dsync(gerben): Debug: brain M: Local mailbox tree: INBOX guid=184a4c066b219a5dd73700009e3b11ac uid_validity=1570382187 uid_next=18 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1232523592 uid_next=482711 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Notspam_train guid=e0cc8c076b219a5dd73700009e3b11ac uid_validity=1570382188 uid_next=10 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old guid=c71fb29dcfd52e98ffb476033482311a uid_validity=1246525241 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Sent guid=e8c3b0076b219a5dd73700009e3b11ac uid_validity=1570382189 uid_next=17 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk guid=493c1b0ff8829799ae854dcdd35bdc49 uid_validity=1246525654 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Spam_train guid=7076d5076b219a5dd73700009e3b11ac uid_validity=1570382190 uid_next=3719 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/UitNFIMailboxen guid=1da8c05ea358b80ee1c2f3a01cc7f2cc uid_validity=1232523595 uid_next=118 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Trash guid=4810f5076b219a5dd73700009e3b11ac uid_validity=1570382191 uid_next=3 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/RvdR guid=44c6bc132d8b2818930a6bcf0d2a5706 uid_validity=1232523595 uid_next=349 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Junk guid=f8a063086b219a5dd73700009e3b11ac uid_validity=1570382194 uid_next=1 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/Nieuwe Baan guid=75a5c26e35145b08ff594eb249867d0e uid_validity=1232523595 uid_next=380 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Subfolder guid=d8d293340d2c9a5d1d3a00009e3b11ac uid_validity=1570382195 uid_next=1 subs=yes last_change=0 last_subs=1570384909 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Werk/NFI guid=3d3c4682642c7ccb58523e0726a0ecff uid_validity=1232523595 uid_next=289 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Subfolder/SUbSubFolder guid=08fb2d1a402c9a5d1d3a00009e3b11ac uid_validity=1570382196 uid_next=1 subs=yes last_change=0 last_subs=1570384960 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects guid=7843f3ba3f3bfb3c4c965c1bd59b219a uid_validity=1246525385 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Archive guid=d89d4d148903005e6b5501009e3b11ac uid_validity=1570382197 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX guid=2063d233e1533d17e6910c2d1c3d802c uid_validity=1232523594 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Local mailbox tree: Drafts guid=60cd72148903005e6b5501009e3b11ac uid_validity=1570382198 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/Word Hell guid=bbd58ddde1f98e962507f8868f2b8372 uid_validity=1232523594 uid_next=123 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/TUG2003 guid=af8b9bd0abed0f24ff41acd3e0f6cfcf uid_validity=1232523594 uid_next=202 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/TUG ADC guid=2c828ce4f978e96b8199cd3364cf831a uid_validity=1232523594 uid_next=127 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1232523592 uid_next=482711 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old guid=c71fb29dcfd52e98ffb476033482311a uid_validity=1246525241 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk guid=493c1b0ff8829799ae854dcdd35bdc49 uid_validity=1246525654 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/UitNFIMailboxen guid=1da8c05ea358b80ee1c2f3a01cc7f2cc uid_validity=1232523595 uid_next=118 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/RvdR guid=44c6bc132d8b2818930a6bcf0d2a5706 uid_validity=1232523595 uid_next=349 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/Nieuwe Baan guid=75a5c26e35145b08ff594eb249867d0e uid_validity=1232523595 uid_next=380 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Werk/NFI guid=3d3c4682642c7ccb58523e0726a0ecff uid_validity=1232523595 uid_next=289 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects guid=7843f3ba3f3bfb3c4c965c1bd59b219a uid_validity=1246525385 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX guid=2063d233e1533d17e6910c2d1c3d802c uid_validity=1232523594 uid_next=1 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/Word Hell guid=bbd58ddde1f98e962507f8868f2b8372 uid_validity=1232523594 uid_next=123 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/TUG2003 guid=af8b9bd0abed0f24ff41acd3e0f6cfcf uid_validity=1232523594 uid_next=202 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/TUG ADC guid=2c828ce4f978e96b8199cd3364cf831a uid_validity=1232523594 uid_next=127 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Local mailbox tree: zzz-Old/Projects/TeX/TUG guid=0ff5d314b54457b60c266634bca9898a uid_validity=1232523594 uid_next=242 subs=yes last_change=0 last_subs=0 dsync(gerben): Debug: brain M: Remote mailbox tree: zzz-Old/Projects/TeX/TUG guid=0ff5d314b54457b60c266634bca9898a uid_validity=1232523594 uid_next=242 subs=yes last_change=0 last_subs=0 etc. Then, at some point, it changes to: dsync(gerben): Debug: brain M: Mailbox AAA Superjunk: local=00000000000000000000000000000000/0/0, remote=3232b6d3762f0d825fa9c7a1499b292f/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox APG: local=00000000000000000000000000000000/0/0, remote=d857f802643888ecbec4214ad6b7717e/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Administrator: local=00000000000000000000000000000000/0/0, remote=8be9e36e5e0d2a6a87de584aaca0193f/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Apple: local=00000000000000000000000000000000/0/0, remote=e85a0aa21c23f5abd2975a89b6820d63/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Apple Mail To Do: local=00000000000000000000000000000000/0/0, remote=6275568b3221fc326872b07eefccd0b2/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Archive: local=d89d4d148903005e6b5501009e3b11ac/0/1, remote=51a58e1d1d5c491aac71488647b20224/0/1: GUIDs conflict - will be merged later dsync(gerben): Debug: brain M: Mailbox Bounces: local=00000000000000000000000000000000/0/0, remote=3479a3b099333fa68dd4b912625af777/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox Calendar Events: local=00000000000000000000000000000000/0/0, remote=498953ab9976b9c77b62da8cb4dd790a/0/1: mailbox not selectable yet dsync(gerben): Debug: brain M: Mailbox DMARC: local=00000000000000000000000000000000/0/0, remote=decbde7a60591d2b65d074f75f07845f/0/1: mailbox not selectable yet with lots of 'mailbox not selectable yet' After I see all the remote (old server) mailboxes being mentioned such, then I see dsync(gerben): Debug: brain M: Deleting mailbox 'Archive' (GUID d89d4d148903005e6b5501009e3b11ac): UIDVALIDITY changed (1295434254 -> 1570382197) dsync(gerben): Debug: brain M: Deleting mailbox 'Drafts' (GUID 60cd72148903005e6b5501009e3b11ac): UIDVALIDITY changed (1232523592 -> 1570382198) dsync(gerben): Debug: brain M: Deleting mailbox 'INBOX' (GUID 184a4c066b219a5dd73700009e3b11ac): UIDVALIDITY changed (1232523592 -> 1570382187) dsync(gerben): Debug: brain M: Deleting mailbox 'Junk' (GUID f8a063086b219a5dd73700009e3b11ac): UIDVALIDITY changed (1295433962 -> 1570382194) dsync(gerben): Debug: brain M: Deleting mailbox 'Notspam_train' (GUID e0cc8c076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Sent' (GUID e8c3b0076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Spam_train' (GUID 7076d5076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Subfolder/SUbSubFolder' (GUID 08fb2d1a402c9a5d1d3a00009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Subfolder' (GUID d8d293340d2c9a5d1d3a00009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: brain M: Deleting mailbox 'Trash' (GUID 4810f5076b219a5dd73700009e3b11ac): Mailbox doesn't exist dsync(gerben): Debug: doveadm-sieve: Iterating Sieve mailbox attributes dsync(gerben): Debug: sieve: Pigeonhole version 0.5.7.1 () initializing dsync(gerben): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. dsync(gerben): Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.7.1 () loaded dsync(gerben): Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.7.1 () loaded dsync(gerben): Debug: sieve: file storage: Using active Sieve script path: /private/var/mail/nl.rna.mail/rules/gerben/dovecot.sieve dsync(gerben): Debug: sieve: file storage: Using script storage path: /private/var/mail/nl.rna.mail/rules/gerben/gerben dsync(gerben): Debug: sieve: file storage: Using permissions from /private/var/mail/nl.rna.mail/rules/gerben/gerben: mode=0700 gid=-1 dsync(gerben): Debug: sieve: file storage: Relative path to sieve storage in active link: gerben/ dsync(gerben): Debug: sieve: file storage: sync: Synchronization active dsync(gerben): Debug: sieve: file storage: quota: Storage limit: 52428800 bytes dsync(gerben): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. dsync(gerben): Debug: brain S: Remote mailbox tree: INBOX guid=184a4c066b219a5dd73700009e3b11ac uid_validity=1570382187 uid_next=18 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Notspam_train guid=e0cc8c076b219a5dd73700009e3b11ac uid_validity=1570382188 uid_next=10 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Sent guid=e8c3b0076b219a5dd73700009e3b11ac uid_validity=1570382189 uid_next=17 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Remote mailbox tree: Spam_train guid=7076d5076b219a5dd73700009e3b11ac uid_validity=1570382190 uid_next=3719 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Trash guid=4810f5076b219a5dd73700009e3b11ac uid_validity=1570382191 uid_next=3 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Junk guid=f8a063086b219a5dd73700009e3b11ac uid_validity=1570382194 uid_next=1 subs=no last_change=0 last_subs=0 dsync(gerben): Debug: brain S: Remote mailbox tree: Subfolder guid=d8d293340d2c9a5d1d3a00009e3b11ac uid_validity=1570382195 uid_next=1 subs=yes last_change=0 last_subs=1570384909 dsync(gerben): Debug: brain S: Remote mailbox tree: Subfolder/SUbSubFolder guid=08fb2d1a402c9a5d1d3a00009e3b11ac uid_validity=1570382196 uid_next=1 subs=yes last_change=0 last_subs=1570384960 dsync(gerben): Debug: brain S: Remote mailbox tree: Archive guid=d89d4d148903005e6b5501009e3b11ac uid_validity=1570382197 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: brain S: Remote mailbox tree: Drafts guid=60cd72148903005e6b5501009e3b11ac uid_validity=1570382198 uid_next=1 subs=yes last_change=0 last_subs=1570382187 dsync(gerben): Debug: imapc(192.168.2.67:143): Disconnected But nothing has been copied over and while it states it has deleted local mailboxes (such as Subfolder/SUbSubFolder), they are still there. In other words: nothing happens. Well, not quite. The first time I ran this, local directory /var/mail/nl.rna.mail/rules/gerben/gerben/tmp was created. Can anyone see here what is going wrong? Gerben Wierda Chess and the Art of Enterprise Architecture <http://enterprisechess.com/> Mastering ArchiMate <http://masteringarchimate.com/> Architecture for Real Enterprises <https://www.infoworld.com/blog/architecture-for-real-enterprises/> at InfoWorld On Slippery Ice <https://eapj.org/on-slippery-ice/> at EAPJ

1 1

Is it safe to mix dovecot import/backup/sync between dovecot versions 2.2.30.2 and 2.3.7.1?
by Gerben Wierda 22 Dec '19

22 Dec '19

I am migrating a server. The old one uses dovecot 2.2.30.2 and the new one 2.3.7.1. I don’t want to use any tool that might influence flags on messages. I am using Maildir format on both ends and I have a way to let one server access the data on the other (either using an rsync or a direct access). Could I set up a sync between both to create a smooth migration? Gerben Wierda Chess and the Art of Enterprise Architecture <http://enterprisechess.com/> Mastering ArchiMate <http://masteringarchimate.com/> Architecture for Real Enterprises <https://www.infoworld.com/blog/architecture-for-real-enterprises/> at InfoWorld On Slippery Ice <https://eapj.org/on-slippery-ice/> at EAPJ

2 2

dovecot rejecting connects
by Roy 22 Dec '19

22 Dec '19

I am a newbie to dovecot but not postfix and centos I created a new VM with Centos 8 and installed dovecot and postfix. Postfix is working fine but dovecot rejects connections from anything but the local machine. Locally Trying 10.10.100.157... Connected to 10.10.100.157. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. Machine on same subnet. Windows, Linux, etc. Doesn't seem to matter telnet 10.10.100.157 143 Connecting To 10.10.100.157... Could not open connection to the host, on port 143: Connect failed I made sure the iptables are empty so it doesn't seem to be a firewall issue I put some LOG statements in the iptables and it showed the connect packet arriving and the response packet was ICMP type 3 code 13. Any ideas? Roy

3 4

unable to edit wiki 2, here's the edit:
by Steve Newcomb 19 Dec '19

19 Dec '19

In https://wiki.dovecot.org/Migration/Courier , mail_location = maildir:~/Maildir namespace { prefix = INBOX. separator = . inbox = yes } ... is wrong. Apparently it should be ... mail_location = maildir:~/INBOX ...which at least seemed to work, although (by that time?) I wound up re-downloading all mail. Steve Newcomb srn(a)coolheads.com (Unable to edit the wiki page... Mysterious question stood in the way, something like, "How do you prevent spam?" Evidently I don't know the correct answer.

1 0

slow logins over login_trusted_network
by Wojciech Puchar 18 Dec '19

18 Dec '19

i've upgraded dovecot on my server to 2.3.9 works properly but saslauthd that uses it for rimap authentication over 127.0.0.1 works SLOW. You need to wait 15-20 seconds before authentication. only imap login over 127.0.0.1 is slowed down, while over any other IP is quick. i had this problem with older version of dovecot but it was about adding login_trusted_networks = 127.0.0.1 but i already have this and logins is slow. how to disable throttling (or better - put other limits) for 127.0.0.1?

3 5

DSync replication error
by 横山航平 18 Dec '19

18 Dec '19

Please tell me about Dsync replicator. The following are set to enable the "replication" plug-in /etc/dovecot/conf.d/10-mail.conf *---mail_plugins = notify replication---* And I made the following file /etc/dovecot/conf.d/30-dsync.conf *---service replicator { process_min_avail = 1} dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%uplugin { mail_replica = remote:root@"ServerIP"} service aggregator { fifo_listener replication-notify-fifo { user = mail } unix_listener replication-notify { user = mail }} service replicator { unix_listener replicator-doveadm { mode = 0600 }} replication_max_conns = 10 plugin { # When saving a new mail via IMAP or delivering a mail via LDA/LMTP, # wait for the mail to be synced to the remote site. If it doesn't finish # in 2 seconds, return success anyway. # replication_sync_timeout = 2s}---* But replication gives an error --- *Error: open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied* --- Why is this? By the way, When 30-dsync.conf is changed as follows, it works only for one user *---service aggregator { fifo_listener replication-notify-fifo { user = "one user name" } unix_listener replication-notify { user = "one user name" }}---* However, I want to work with all mail users. Please help me what to do. My configuration is as follows *---# 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf# OS: Linux 3.10.0-1062.9.1.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) # Hostname: test1.s1.iwate-np.co.jp <http://test1.s1.iwate-np.co.jp>dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%ufirst_valid_uid = 1000mail_location = maildir:~/Maildirmail_plugins = notify replicationmbox_write_locks = fcntlnamespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = }passdb { driver = pam}plugin { mail_replica = remote:root@192.168.4.2 <remote%3Aroot(a)192.168.4.2>}service aggregator { fifo_listener replication-notify-fifo { user = mail } unix_listener replication-notify { user = mail }}service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 }}ssl = requiredssl_cert = </etc/pki/dovecot/certs/dovecot.pemssl_key = # hidden, use -P to show ituserdb { driver = passwd}---*

2 2

Local lmtp proxy on backend server
by Marc Roos 17 Dec '19

17 Dec '19

I receive a local mail when I do a 'mail test' on a backend svr1 with this[0] configuration. However when I just add only one configuration change 'lmtp_proxy = yes' I am getting these errors[1]. I would expect this email to still be delivered locally, should this be working or do I misunderstand the lmtp proxy functionality? [0] passdb { args = auth_verbose = default default_fields = proxy=y host=svr1 deny = no driver = pam [1] Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Connect from local Dec 15 23:28:48 svr1 dovecot: auth: Debug: master in: PASS#0111#011test#011service=lmtp Dec 15 23:28:48 svr1 dovecot: auth: Debug: pam(test): passdb doesn't support credential lookups Dec 15 23:28:48 svr1 dovecot: auth: Debug: passdb out: FAIL#0111#011reason=Configured passdbs don't support credentials lookups Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Debug: user test: Auth PASS lookup returned temporary failure: reason=Configured passdbs don't support credentials lookups Dec 15 23:28:48 svr1 dovecot: lmtp(9270): Debug: auth PASS input: reason=Configured passdbs don't support credentials lookups dovecot-pigeonhole-2.2.36-3.el7_7.1.x86_64 dovecot-2.2.36-3.el7_7.1.x86_64

2 10

Re: Shared namespace is empty after migration to new Dovecot installation
by Peter Reinhold 17 Dec '19

17 Dec '19

On 2019-12-09 09:42, Aki Tuomi wrote: >> That I can, here (anonymized where relevant) >> > > Config looks fine. Have you tried > > 'A1 SELECT Shared/user(a)sharer.dk'? Yields this, which is the same I got when trying to debug using doveadm acl, it seems like the shared mailboxes aren't placed in the shared namespace at all. A1 SELECT Shared/user(a)sharer.dk A1 NO Mailbox doesn't exist: Shared/user(a)sharer.dk (0.006 + 0.000 + 0.005 secs). -- Peter Reinhold

2 5

Gmail and POP3
by Yannick SIEGLER 17 Dec '19

17 Dec '19

Hi everyone, I'm new to this ML. I have some issue with GMail import settings... I run a dovecot server (2.3.4.1) on Debian10 and I try to connect to my accounts from GMail. It's work fine from thunderbird in pop3,pop3s, imap, imaps... Submission work too... But it won't work on GMail except if I set ssl=yes and disable_plaintext_auth = no... Then GMail connect without SSL or TLS... And in plaintext.... Very unsecure... I can send mail with submission from GMail and ssl=require, that's ok. If I try to connect with SSL activated I've got : pop3-login: Disconnected: Too many bad commands And If I try to connect on port 995 with SSL GMail say that I have some SSL error, and the log says : auth: Debug: auth client connected (pid=21831) pop3-login: Debug: SSL: where=0x10, ret=1: before SSL initialization pop3-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization pop3-login: Debug: SSL: where=0x2002, ret=-1: before SSL initialization pop3-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS read client hello pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write server hello pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write change cipher spec pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 write encrypted extensions pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write certificate pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 write server certificate verify pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write finished pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2002, ret=-1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2001, ret=1: TLSv1.3 early data pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS read finished pop3-login: Debug: SSL: where=0x20, ret=1: SSLv3/TLS write session ticket pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write session ticket pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3/TLS write session ticket pop3-login: Debug: SSL: where=0x2002, ret=1: SSL negotiation finished successfully pop3-login: Debug: SSL error: Connection closed But as I say, all is working fine from Thunderbird... For the SSL problem this is maybe because GMail doesn't like this configuration in debian for openssl ? [system_default_sect] MinProtocol = TLSv1.2 CipherString = DEFAULT@SECLEVEL=2 Maybe should I try to set MinProtocol = None CipherString = DEFAULT But this make a lot of security change on my opinion... Do someone have any tips or suggestion about my problem ? Thx Yannick

2 2

CentOS x64 compilation fails.
by Mart Pirita 16 Dec '19

16 Dec '19

Hello. I have problems to compile Dovecot2.2.13 with rpmbuild using options: ./configure \ --prefix=/usr \ --with-ssl=openssl \ --with-ssldir=/etc/ssl \ --sysconfdir=/etc \ --without-vpopmail \ --with-pam \ --without-bsdauth \ --without-sql \ --without-nss \ --without-ldap \ --without-pgsql \ --without-mysql \ --without-sqlite \ --with-rundir=/var/run/dovecot \ --without-deliver \ --without-gssapi make Using CentOS 5.11, option - rpmbuild -ba dovecot2.2.spec fails with error: /bin/mkdir -p '/var/tmp/dovecot-2.2.13-mp-root/usr/lib64/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c libdovecot-storage.la '/var/tmp/dovecot-2.2.13-mp-root/usr/lib64/dovecot' libtool: install: error: cannot install `libdovecot-storage.la' to a directory not ending in /usr/lib/dovecot make[4]: *** [install-pkglibLTLIBRARIES] Error 1 make[4]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[3]: *** [install-am] Error 2 make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[2]: *** [install-recursive] Error 1 make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src' make: *** [install-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.14076 (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.14076 (%install) But using CentOS 5.11with option- rpmbuild --target=i686 -ba dovecot2.2.spec works fine. However, using CentOS 6.5, with option - rpmbuild -ba dovecot2.2.spec fails with error: /bin/mkdir -p '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.x86_64/usr/lib64/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c libdovecot-storage.la '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.x86_64/usr/lib64/dovecot' libtool: install: error: cannot install `libdovecot-storage.la' to a directory not ending in /usr/lib/dovecot make[4]: *** [install-pkglibLTLIBRARIES] Error 1 make[4]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[3]: *** [install-am] Error 2 make[3]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[2]: *** [install-recursive] Error 1 make[2]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src' make: *** [install-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.HP3meN (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.HP3meN (%install) But when CentOS 5.11with option rpmbuild --target=i686 -ba dovecot2.2.spec suceeds, CentOS 6.5still fails: cpio: dovecot-2.2.13/src/lib-compression/abspath.c: Cannot stat: No such file or directory cpio: dovecot-2.2.13/src/lib-compression/compat.h: Cannot stat: No such file or directory cpio: dovecot-2.2.13/src/lib-compression/lib.h: Cannot stat: No such file or directory 18096 blocks + /usr/lib/rpm/check-buildroot /root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot/dovecot-config:LIBDOVECOT='-L/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot -ldovecot' /root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot/dovecot-config:LIBDOVECOT_INCLUDE=-I/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/include/dovecot Found '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386' in installed files; aborting error: Bad exit status from /var/tmp/rpm-tmp.69mGY0 (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.69mGY0 (%install) How to fix these errors? -- Mart

5 8

Suddenly sieve no longer working
by Heiko W. Rupp 16 Dec '19

16 Dec '19

Hey, I have a successful setup with dovecot and sieve and since a few days sieve is all of a sudden no longer working. I am on OSX and my mta is an older version of postfix (apple supplied). Has anyone gone through that and has some hints on how to best debug (and fix) that? Thanks a lot Heiko -- hwr(a)pilhuhn.de m:0179/207 4919 b:http://pilhuhn.blogspot.com

2 2

Panic: file smtp-client-connection.c: line 1212 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded)
by Hativ 16 Dec '19

16 Dec '19

Hello, after migrating from self-compiled Dovecot 2.3.3 to Dovecot 2.3.8 from the repository (Ubuntu 18.04 LTS "Bionic" packages) I have issues with the submission service. If I send an email, it will not be forwarded and I get the following error message: Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Panic: file smtp-client-connection.c: line 1212 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe7f7e) [0x7f64b1f76f7e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8021) [0x7f64b1f77021] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64b1ecfaf4] -> /usr/lib/dovecot/libdovecot.so.0(+0x50ec8) [0x7f64b1edfec8] -> /usr/lib/dovecot/libdovecot.so.0(+0x51078) [0x7f64b1ee0078] -> /usr/lib/dovecot/libdovecot.so.0(+0x541f4) [0x7f64b1ee31f4] -> /usr/lib/dovecot/libdovecot.so.0(smtp_client_command_input_reply+0x1f8) [0x7f64b1edb738] -> /usr/lib/dovecot/libdovecot.so.0(+0x54a93) [0x7f64b1ee3a93] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7f64b1f909af] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13c) [0x7f64b1f9237c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f64b1f90abc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f64b1f90cd8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f64b1eff053] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](main+0x3d1) [0x55dcc748fec1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f64b1abfb97] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](_start+0x2a) [0x55dcc749009a] Does somebody has any idea? The problem has been taking me months, now I want to finally update to the current version. Full debug log: Oct 11 09:29:00 srv2 dovecot: submission-login: Login: user=< hativ(a)example.com>, method=PLAIN, rip=fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e, lip=fec0:4f8:1c0c:8099::1, mpid=15819, TLS, session=<XFnLeJ2U0rgqAoEMwMAIoDQqhHgB7k+O> Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Loading modules from directory: /usr/lib/dovecot/modules Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_mail_crypt_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_quota_clone_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Quota root: name= backend=count args= Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Quota grace: root= bytes=0 (10%) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: initializing backend with data: vfile Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: acl username = hativ(a)example.com Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: owner = 1 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl vfile: Global ACLs disabled Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: initializing backend with data: vfile Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: acl username = hativ(a)example.com Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl: owner = 0 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: acl vfile: Global ACLs disabled Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-server: conn [fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e]:47314 [1]: Server accepted connection (fd=7) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-server: conn [fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e]:47314 [1]: Connection created Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: Connection created Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: Looking up IP address Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: DNS lookup successful; got 2 IPs Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-server: conn [fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e]:47314 [1]: Sent: 235 2.7.0 Logged in. Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 [1]: Connecting to 10.46.163.91:25 Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Connecting Oct 11 09:29:00 srv2 postfix/smtpd[15229]: connect from srv2[10.46.163.91] Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Waiting for connect (fd=8) to finish for max 0 msecs Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Client connected (fd=8) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Connected to server (from 10.46.163.91:60230) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received greeting from server: 220 mta2.example.com ESMTP Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Sending EHLO handshake Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Submitted with priority Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Sent: EHLO mda1-2.example.com Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Got reply (1/1): 250 mta2.example.com PIPELINING SIZE 51200000 ETRN STARTTLS AUTH DIGEST-MD5 CRAM-MD5 NTLM XCLIENT NAME ADDR PROTO HELO REVERSE_NAME PORT LOGIN DESTADDR DESTPORT ENHANCEDSTATUSCODES 8BITMIME SMTPUTF8 (1 commands pending, 0 commands queued) Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received handshake reply Oct 11 09:29:00 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received server capabilities Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Starting TLS Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command STARTTLS: Submitted with priority Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command EHLO: Destroy (0 commands pending, 1 commands queued) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command STARTTLS: Sent: STARTTLS Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: command STARTTLS: Got reply (1/1): 220 2.0.0 Ready to start TLS (1 commands pending, 0 commands queued) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Received STARTTLS reply: 220 2.0.0 Ready to start TLS Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: Starting SSL handshake Oct 11 09:29:01 srv2 postfix/smtpd[15229]: Anonymous TLS connection established from srv2[10.46.163.91]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Debug: smtp-client: conn mta2.example.com:25 (10.46.163.91:25) [1]: SSL handshake successful Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Panic: file smtp-client-connection.c: line 1212 (smtp_client_connection_established): assertion failed: (!conn->connect_succeeded) Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe7f7e) [0x7f64b1f76f7e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8021) [0x7f64b1f77021] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64b1ecfaf4] -> /usr/lib/dovecot/libdovecot.so.0(+0x50ec8) [0x7f64b1edfec8] -> /usr/lib/dovecot/libdovecot.so.0(+0x51078) [0x7f64b1ee0078] -> /usr/lib/dovecot/libdovecot.so.0(+0x541f4) [0x7f64b1ee31f4] -> /usr/lib/dovecot/libdovecot.so.0(smtp_client_command_input_reply+0x1f8) [0x7f64b1edb738] -> /usr/lib/dovecot/libdovecot.so.0(+0x54a93) [0x7f64b1ee3a93] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7f64b1f909af] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13c) [0x7f64b1f9237c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f64b1f90abc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f64b1f90cd8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f64b1eff053] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](main+0x3d1) [0x55dcc748fec1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f64b1abfb97] -> dovecot/submission [hativ(a)example.com fec0:810c:c0c0:8a0:342a:8478:1ee:4f8e GREETING](_start+0x2a) [0x55dcc749009a] Oct 11 09:29:01 srv2 postfix/smtpd[15229]: lost connection after STARTTLS from srv2[10.46.163.91] Oct 11 09:29:01 srv2 postfix/smtpd[15229]: disconnect from srv2[10.46.163.91] ehlo=1 starttls=1 commands=2 Oct 11 09:29:01 srv2 dovecot: submission(hativ(a)example.com)<15819><XFnL eJ2U0rgqAoEMwMAIoDQqhHgB7k+O>: Fatal: master: service(submission): child 15819 killed with signal 6 (core dumped) Best regards Hativ

3 4

FTS indexer-worker Panic
by Yarema 16 Dec '19

16 Dec '19

Set up fts_xapian over the weekend and re-indexed. https://github.com/grosjo/fts-xapian Tried to search my INBOX and got: > dovecot: indexer-worker: Panic: file charset-iconv.c: line 83 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) What could I possibly have lurking in my INBOX to cause that ?? -- Yarema

2 1

dovecot full text search
by Wojciech Puchar 16 Dec '19

16 Dec '19

what FTP module should i use instead of squat that is probably no longer supported or no longer at all? i want to upgrade my dovecot installation. it currently uses squat but i found it often crashes on FTS on large mailboxes. i found "xapian" addon for dovecot but while it works excellent AFTER database is created, i found it need like 20 or so minutes to index less than 10GB of mails and while doing this - generate many tens of megabytes/s constant write traffic on it's database files. Excellent way of killing SSD. something must be broken. my config is plugin { plugin = fts fts_xapian fts = xapian fts_xapian = partial=2 full=20 verbose=0 fts_autoindex = yes fts_enforced = yes # fts_autoindex_exclude = \Junk # fts_autoindex_exclude2 = \Trash } any ideas?

3 3

Bug: indexer-worker segfaults with fts_xapian 1.2.5
by Martynas Bendorius 16 Dec '19

16 Dec '19

Core was generated by `dovecot/indexer-worker'. Program terminated with signal 11, Segmentation fault. #0 0x00007f30f7ad056d in __exchange_and_add (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:49 49 { return __atomic_fetch_add(__mem, __val, __ATOMIC_ACQ_REL); } (gdb) bt full #0 0x00007f30f7ad056d in __exchange_and_add (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:49 No locals. #1 __exchange_and_add_dispatch (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:82 No locals. #2 std::string::_Rep::_M_dispose (this=0xffffffffffffffe8, __a=...) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/bits/basic_string.h:246 No locals. #3 0x00007f30f7b3407e in _M_dispose (__a=..., this=<optimized out>) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/bits/basic_string.tcc:254 No locals. #4 std::string::assign (this=this@entry=0x55c7b93e0168, __str="return-path") at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/bits/basic_string.tcc:250 __a = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>} #5 0x00007f30fa8776ce in operator= (__str="return-path", this=0x55c7b93e0168) at /usr/include/c++/4.8.2/bits/basic_string.h:547 No locals. #6 fts_backend_xapian_update_set_build_key (_ctx=0x55c7b93e0140, key=0x7ffc1ba2c380) at fts-backend-xapian.cpp:303 ctx = 0x55c7b93e0140 i = <optimized out> f2 = "return-path" backend = <optimized out> field = 0x55c7b943fb5f "RETURN-PATH" j = 11 #7 0x00007f30fb0b8cda in fts_backend_update_set_build_key (ctx=0x55c7b93e0140, key=key@entry=0x7ffc1ba2c380) at fts-api.c:174 __func__ = "fts_backend_update_set_build_key" #8 0x00007f30fb0ba243 in fts_build_mail_header (block=0x7ffc1ba2c340, block=0x7ffc1ba2c340, ctx=0x7ffc1ba2c3b0) at fts-build-mail.c:173 hdr = <optimized out> key = {uid = 6006200, type = FTS_BACKEND_BUILD_KEY_HDR, part = 0x55c7b935eed0, hdr_name = 0x55c7b943fb5f "RETURN-PATH", body_content_type = 0x0, body_content_disposition = 0x0} ret = <optimized out> #9 fts_build_mail_real (may_need_retry_r=0x7ffc1ba2c2f3, retriable_err_msg_r=0x7ffc1ba2c300, mail=0x55c7b93dcff8, update_ctx=0x55c7b93e0140) at fts-build-mail.c:568 block = {part = 0x55c7b935eed0, hdr = 0x55c7b93d7f18, data = 0x55c7b938b8a8 "", size = 0} ret = <optimized out> input = 0x55c7b93d78c0 raw_block = {part = 0x55c7b935eed0, hdr = 0x55c7b93d80b0, data = 0x0, size = 0} skip_body = false ctx = {mail = 0x55c7b93dcff8, update_ctx = 0x55c7b93e0140, content_type = 0x0, content_disposition = 0x0, body_parser = 0x0, word_buf = 0x0, ---Type <return> to continue, or q <return> to quit--- pending_input = 0x0, cur_user_lang = 0x0} prev_part = 0x55c7b935eed0 parser = 0x55c7b93d7b38 decoder = 0x55c7b93d7f00 parts = 0x7ffc1ba2c414 body_part = false body_added = false binary_body = <optimized out> error = 0x5ba5b8 <Address 0x5ba5b8 out of bounds> #10 fts_build_mail (update_ctx=0x55c7b93e0140, mail=mail@entry=0x55c7b93dcff8) at fts-build-mail.c:617 _data_stack_cur_id = 6 attempts = 2 retriable_err_msg = 0x11e900729 <Address 0x11e900729 out of bounds> may_need_retry = false #11 0x00007f30fb0c1102 in fts_mail_index (_mail=0x55c7b93dcff8) at fts-storage.c:550 ft = 0x55c7b9396880 flist = 0x55c7b938b8a8 pmail = 0x55c7b93dcff8 #12 fts_mail_precache (_mail=0x55c7b93dcff8) at fts-storage.c:571 _data_stack_cur_id = 5 mail = 0x55c7b93dcff8 fmail = <optimized out> ft = 0x55c7b9396880 __func__ = "fts_mail_precache" #13 0x00007f30fc1b7d64 in mail_precache (mail=0x55c7b93dcff8) at mail.c:432 _data_stack_cur_id = 4 p = 0x55c7b93dcff8 #14 0x000055c7b8b4c844 in index_mailbox_precache (conn=<optimized out>, box=0x55c7b938ef18) at master-connection.c:102 counter = 0 max = 21569 percentage_sent = 0 storage = <optimized out> status = {messages = 21569, recent = 0, unseen = 0, uidvalidity = 1462447525, uidnext = 6027769, first_unseen_seq = 0, first_recent_uid = 6027758, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, flags = 0, permanent_keywords = false, allow_new_keywords = false, nonpermanent_modseqs = false, no_modseq_tracking = false, have_guids = true, have_save_guids = true, have_only_guid128 = false} uids = <optimized out> username = 0x55c7b9385988 "msg(a)domain.com" first_uid = 6006200 ---Type <return> to continue, or q <return> to quit--- percentage_str = "\003\000\000" percentage = <optimized out> error = MAIL_ERROR_NONE trans = 0x55c7b9390480 ctx = 0x55c7b93d15f0 last_uid = 6006200 ret = 0 box_vname = 0x55c7b938f280 "INBOX.lfd.SSH login alerts" errstr = <optimized out> search_args = 0x0 mail = 0x55c7b93dcff8 metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_STREAM_HEADER | MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} seq = <optimized out> #15 index_mailbox (user=<optimized out>, user=<optimized out>, what=<optimized out>, max_recent_msgs=<optimized out>, mailbox=<optimized out>, conn=0x55c7b9370df0) at master-connection.c:205 box = 0x55c7b938ef18 status = {messages = 463652304, recent = 32764, unseen = 1, uidvalidity = 0, uidnext = 4225857431, first_unseen_seq = 32560, first_recent_uid = 4226053086, last_cached_seq = 32560, highest_modseq = 94316285707297, highest_pvt_modseq = 94316294200320, keywords = 0x7f30fbe17797 <__x86_return_thunk+5>, permanent_flags = 4226053495, flags = 32560, permanent_keywords = true, allow_new_keywords = true, nonpermanent_modseqs = true, no_modseq_tracking = false, have_guids = true, have_save_guids = false, have_only_guid128 = false} errstr = <optimized out> ret = 0 ns = <optimized out> path = 0x55c7b935e7f8 "/home/username/imap/domain.com/msg/Maildir/.INBOX.lfd.SSH login alerts" error = 21569 sync_flags = <optimized out> #16 master_connection_input_line (line=<optimized out>, conn=0x55c7b9370df0) at master-connection.c:247 str = <optimized out> max_recent_msgs = 0 ret = <optimized out> args = <optimized out> input = {parent_event = 0x0, module = 0x55c7b8b4d05f "mail", service = 0x55c7b8b4d050 "indexer-worker", username = 0x55c7b935d038 "msg(a)domain.com", session_id = 0x0, session_id_prefix = 0x55c7b935d063 "MAYmHNGX9l1rviwA+Lg9Sw", session_create_time = 0, local_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = { family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), ---Type <return> to continue, or q <return> to quit--- no_userdb_lookup = false, debug = false, conn_secured = false, conn_ssl_secured = false} service_user = 0x55c7b93732e8 user = 0x55c7b9385868 error = 0x0 #17 master_connection_input (conn=0x55c7b9370df0) at master-connection.c:287 _data_stack_cur_id = 3 line = <optimized out> #18 0x00007f30fbed69af in io_loop_call_io (io=0x55c7b9370e30) at ioloop.c:718 ioloop = 0x55c7b9365d70 t_id = 2 __func__ = "io_loop_call_io" #19 0x00007f30fbed8413 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55c7b9365d70) at ioloop-epoll.c:222 ctx = 0x55c7b9366ea0 list = 0x55c7b9370e90 io = <optimized out> tv = {tv_sec = 2147483, tv_usec = 0} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __func__ = "io_loop_handler_run_internal" #20 0x00007f30fbed6ab9 in io_loop_handler_run (ioloop=ioloop@entry=0x55c7b9365d70) at ioloop.c:770 __func__ = "io_loop_handler_run" #21 0x00007f30fbed6cf8 in io_loop_run (ioloop=0x55c7b9365d70) at ioloop.c:743 __func__ = "io_loop_run" #22 0x00007f30fbe46d83 in master_service_run (service=0x55c7b9365c00, callback=callback@entry=0x55c7b8b4c3e0 <client_connected>) at master-service.c:809 No locals. #23 0x000055c7b8b4c21e in main (argc=1, argv=0x55c7b9365960) at indexer-worker.c:77 storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT) c = <optimized out> -- Best regards, Martynas Bendorius

2 1

Dovecot v2.3.9.2 released
by aki.tuomi＠dovecot.fi 15 Dec '19

15 Dec '19

We are pleased to release v2.3.9.2 of Dovecot. Please find it from locations below https://dovecot.org/releases/2.3/dovecot-2.3.9.2.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.2.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- - Mails with empty From/To headers can also cause crash in push notification drivers. --- Aki Tuomi Open-Xchange oy

2 1

Bug: icu linking issue in fts plugin
by Martynas Bendorius 15 Dec '19

15 Dec '19

FTS plugin seems not to be linking dynamic libraries correctly: [root@server ~]# ldd /usr/lib/dovecot/lib20_fts_plugin.so linux-vdso.so.1 => (0x00007ffd2eb95000) libicui18n.so.64 => not found libicuuc.so.64 => not found libicudata.so.64 => not found libc.so.6 => /lib64/libc.so.6 (0x00007f1cb5566000) /lib64/ld-linux-x86-64.so.2 (0x00007f1cb5b73000) ICU is in custom directory /usr/local/icu, it's not set in ld.so.conf, so, the linker would need to get this added automatically (that's how it's handled in PHP, for example): -Wl,-rpath=/usr/local/icu/lib Thank you! -- Best regards, Martynas Bendorius

1 0

Solr commit and optimize: which user?
by John Gateley 15 Dec '19

15 Dec '19

Hi, I have Solr FTR working with dovecot, and need to do the commit and optimize recommended here: https://wiki.dovecot.org/Plugins/FTS/Solr Should this run as root, or as each mail user. The documentation above implies, but doesn't state, that it is root. The docs here are similar: http://grimore.org/networking/dovecot/full_text_search But the docs here say it has to be done for each user: http://www.unixsamurai.com/dovecot-full-text-search-jetty-solr/ I don't know Solr well enough to answer. Which is correct? Thanks John

2 1

Parsing variables in config files
by Eudald Valcàrcel Lacasa 15 Dec '19

15 Dec '19

Hello, I'm trying to set up a mailbox for a bunch of domains. To do so I'm running some docker containers (I know I can use multidomain set up and I'm doing so, but I need to have some domains on different containers for specific reasons). In order to keep it all clean, I want to use different PostgreSQL databases for each container, and I'm running the container with an environment file containing database parameters, such as: DB_USER DB_HOST DB_NAME I've been trying to pass these parameters to dovecot's configuration, but they don't get parsed and I end up with messages like: dovecot: auth: Error: pgsql(%{env:DB_HOST}): Connect failed to database %{env:DB_NAME} I've tried to pass variables alone, using import_environment = DB_HOST DB_NAME DB_USER, but I'm stuck at the same errors. Is there anything I could do to fix this? Thank you! Eudald

2 2

Doveadm HTTP API and CORS
by Peter Chiochetti 13 Dec '19

13 Dec '19

While toying around with Doveadmin HTTP api I noticed, there is not much hype around it. Let's change that. Doveadmin REST API so to speak provides a web server. When doing /ajax/ requests, modern browsers block that, unless the response comes with a specific CORS header. Here how to work around with a proxy: > # /etc/dovecot/local.conf > doveadm_allowed_commands = fetch > doveadm_api_key = secret > service doveadm { > inet_listener http { > port = 8084 > } > } > # secret64 = echo -n secret | base64 > # /etc/apache/.../some-site.conf > ProxyVia Block > <Location /doveadm/v1> > RequestHeader set Authorization "X-Dovecot-API secret64" > ProxyPass http://localhost:8084/doveadm/v1 retry=0 timeout=5 > ProxyPassReverse http://localhost:8084/doveadm/v1 > </Location> Intranet only this might be good enough, TLS with username/password Basic-Authentication passthrough might be used for better security. Shameless plug: taken from https://gist.github.com/hungerburg/00d582bf1a6bf3c622797bf5e759f75b -- peter

2 1

BUG: panic when using fs:posix as dict for acl_shared_dict
by Marco Giunta 13 Dec '19

13 Dec '19

Hi, I'm using Dovecot 2.2.33.2 on a RHEL 7, new installation. When I use fs:posix as dict for acl_shared_dict, like in Dovecot wiki (https://wiki.dovecot.org/SharedMailboxes/ClusterSetup) doveadm-server crash with error: # doveadm acl set -u USERNAME FOLDER user=DEST_USERNAME lookup read write-seen doveadm(USERNAME): Panic: file dict-fs.c: line 127 (fs_dict_iterate_init): assertion failed: ((flags & DICT_ITERATE_FLAG_RECURSE) == 0) doveadm(USERNAME): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9f3de) [0x7f0e4a4b23de] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f0e4a4b244a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0e4a44377c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x31688) [0x7f0e4a444688] -> /usr/lib64/dovecot/libdovecot.so.0(dict_iterate_init_multiple+0x4d) [0x7f0e4a47cadd] -> /usr/lib64/dovecot/libdovecot.so.0(dict_iterate_init+0x29) [0x7f0e4a47cb89] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_lookup_dict_rebuild+0x3e1) [0x7f0e49a40371] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_backend_vfile_acllist_rebuild+0x488) [0x7f0e49a3dd18] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_backend_vfile_object_update+0x3c7) [0x7f0e49a3e867] -> /usr/lib64/dovecot/lib01_acl_plugin.so(acl_mailbox_update_acl+0x68) [0x7f0e49a41e28] -> /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x2c11) [0x7f0e48da1c11] -> /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x3060) [0x7f0e48da2060] -> doveadm(+0x2b41c) [0x556f1280b41c] -> doveadm(+0x2c01a) [0x556f1280c01a] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x23b) [0x556f1280ce7b] -> doveadm(doveadm_cmd_run_ver2+0x50c) [0x556f1281c73c] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x556f1281c7d7] -> doveadm(main+0x1e4) [0x556f127fb944] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f0e4a071c05] -> doveadm(+0x1bd35) [0x556f127fbd35] Aborted Attached coredump and configuration. I'm not a programmer, but seems that assert is raised by 'fs_dict_iterate_init' function inside 'src/lib-dict-extra/dict-fs.c': static struct dict_iterate_context * fs_dict_iterate_init(struct dict *_dict, const char *const *paths, enum dict_iterate_flags flags) { ... /* these flags are not supported for now */ i_assert((flags & DICT_ITERATE_FLAG_RECURSE) == 0); ... because it is called by 'acl_lookup_dict_iterate_read' function in file 'src/plugins/acl/acl-lookup-dict.c' static void acl_lookup_dict_iterate_read(struct acl_lookup_dict_iter *iter) { ... dict_iter = dict_iterate_init(iter->dict->dict, prefix, DICT_ITERATE_FLAG_RECURSE); ... with DICT_ITERATE_FLAG_RECURSE set. Same problem also with Dovecot 2.3.0. Thanks, Marco -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244

4 6

Is is possible to log TLS client versions
by Götz Reinicke 13 Dec '19

13 Dec '19

Hi, is it possible to log the version of TLS a clients is using to connect to dovecot? I’v not found any switch to do that. Thanks and regards . Götz

2 2

CVE-2019-19722: Critical vulnerability in Dovecot
by Aki Tuomi 13 Dec '19

13 Dec '19

Open-Xchange Security Advisory 2019-12-13 Product: Dovecot IMAP/POP3 Server Vendor: OX Software GmbH Internal reference: DOV-3719 Vulnerability type: NULL Pointer Dereference (CWE-476) Vulnerable version: 2.3.9 Vulnerable component: push notification driver Report confidence: Confirmed Solution status: Fixed by Vendor Fixed version: 2.3.9.1 Researcher credits: Frederik Schwan, Michael Stilkerich Vendor notification: 2019-12-10 Solution date: 2019-12-12 Public disclosure: 2019-12-13 CVE reference: CVE-2019-19722 CVSS: 5.3 (CVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:L/E:F/RL:O/RC:C) Vulnerability Details: Mail with group address as sender will cause a signal 11 crash in push notification drivers. Group address as recipient can cause crash in some drivers. Risk: Repeated delivery attempts are made for the problematic mail, causing queueing in MTA. Steps to reproduce: 1. Configure dovecot with push notifications enabled, such as OX push notification driver. This can also be observed with 3rd party plugin XAPS. 2. Send mail a group address as sender Solution: Operators should update to the latest Patch Release.

2 1

Dovecot 2.3.9 - lmtp crashes with Signal 11
by Michael Stilkerich 13 Dec '19

13 Dec '19

Hello, since the upgrade from 2.3.8 to 2.3.9 (using the Ubuntu 18.04 packages from dovecot.org) lmtp crashes for me for some mails. Currently I have three pending mails in my postfix deferred queue since the upgrade a couple of days ago. I did not observe these issues with 2.3.8. The backtrace from one of the coredumps: Reading symbols from /usr/lib/dovecot/lmtp...Reading symbols from /usr/lib/debug/.build-id/f3/3a5089463b1234cbcf90bf10033d1dd5613821.debug...done. done. [New LWP 1554] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/lmtp'. Program terminated with signal SIGSEGV, Segmentation fault. #0 decode_address_header (pool=pool@entry=0x560631ad6d10, hdr=0x560631add4c8 "", address_r=address_r@entry=0x560631ad7090, name_r=name_r@entry=0x560631ad7098) at push-notification-event-message-common.c:20 20 push-notification-event-message-common.c: No such file or directory. (gdb) bt #0 decode_address_header (pool=pool@entry=0x560631ad6d10, hdr=0x560631add4c8 "", address_r=address_r@entry=0x560631ad7090, name_r=name_r@entry=0x560631ad7098) at push-notification-event-message-common.c:20 #1 0x00007f3f37955fbb in decode_address_header (name_r=0x560631ad7098, address_r=0x560631ad7090, hdr=<optimized out>, pool=0x560631ad6d10) at push-notification-event-message-common.c:62 #2 push_notification_message_fill (mail=mail@entry=0x560631adc088, pool=0x560631ad6d10, event_flags=(PUSH_NOTIFICATION_MESSAGE_HDR_FROM | PUSH_NOTIFICATION_MESSAGE_HDR_TO | PUSH_NOTIFICATION_MESSAGE_HDR_SUBJECT | PUSH_NOTIFICATION_MESSAGE_HDR_DATE | PUSH_NOTIFICATION_MESSAGE_BODY_SNIPPE$), from=<optimized out>, to=<optimized out>, subject=<optimized out>, date=0x560631ad7050, date_tz=0x560631ad7058, message_id=0x560631ad7078, flags=0x560631ad706c, flags_set=0x560631ad7068, keywords=0x560631ad7070, snippet=0x560631ad7060, ext=0x560631ad7080) at push-notification-event-message-common.c:62 #3 0x00007f3f37955a41 in push_notification_event_messagenew_event (ptxn=0x560631ad6d38, ec=0x560631ad6fe0, msg=0x560631ad7010, mail=0x560631adc088) at push-notification-event-messagenew.c:83 #4 0x00007f3f379571bd in push_notification_trigger_msg_save_new (txn=0x560631ad6d38, mail=0x560631adc088, msg=0x560631ad7010) at push-notification-triggers.c:138 #5 0x00007f3f383f52f3 in notify_contexts_mail_save (mail=0x560631adc088) at notify-plugin.c:62 #6 0x00007f3f383f65b8 in notify_copy (ctx=0x560631ad7890, mail=0x560631a98b18) at notify-storage.c:104 #7 0x00007f3f3860873d in quota_copy (ctx=0x560631ad7890, mail=0x560631a98b18) at quota-storage.c:302 #8 0x00007f3f39f91e32 in mailbox_copy_int (_ctx=<optimized out>, mail=0x560631a98b18) at mail-storage.c:2759 #9 0x00007f3f3641907f in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #10 0x00007f3f3640e64c in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #11 0x00007f3f3640f11b in sieve_result_implicit_keep () from /usr/lib/dovecot/libdovecot-sieve.so.0 #12 0x00007f3f364226e1 in sieve_multiscript_finish () from /usr/lib/dovecot/libdovecot-sieve.so.0 #13 0x00007f3f3668e488 in ?? () from /usr/lib/dovecot/modules/lib90_sieve_plugin.so #14 0x00007f3f3a2a260d in mail_do_deliver (storage_r=0x7ffedf944b40, ctx=0x7ffedf944c30) at mail-deliver.c:542 #15 mail_deliver (ctx=ctx@entry=0x7ffedf944c30, storage_r=storage_r@entry=0x7ffedf944b40) at mail-deliver.c:592 #16 0x000056063169c0e1 in lmtp_local_default_deliver (client=0x560631a5e898, lrcpt=<optimized out>, cmd=<optimized out>, trans=<optimized out>, lldctx=0x7ffedf944e70) at lmtp-local.c:593 #17 0x000056063169c8cf in lmtp_local_deliver (local=0x560631a849b0, local=0x560631a849b0, session=0x560631a9d748, src_mail=0x560631a98b18, llrcpt=0x560631a7f600, trans=0x560631a7fab8, cmd=0x560631a7f088) at lmtp-local.c:530 #18 lmtp_local_deliver_to_rcpts (session=0x560631a9d748, trans=0x560631a7fab8, cmd=0x560631a7f088, local=0x560631a849b0) at lmtp-local.c:654 #19 lmtp_local_data (client=client@entry=0x560631a5e898, cmd=cmd@entry=0x560631a7f088, trans=trans@entry=0x560631a7fab8, input=<optimized out>) at lmtp-local.c:730 #20 0x000056063169b0cf in client_default_cmd_data (client=0x560631a5e898, cmd=0x560631a7f088, trans=0x560631a7fab8, data_input=0x560631a83c00, data_size=<optimized out>) at lmtp-commands.c:275 #21 0x000056063169ae6f in cmd_data_finish (trans=0x560631a7fab8, cmd=0x560631a7f088, client=0x560631a5e898) at lmtp-commands.c:165 #22 cmd_data_continue (conn_ctx=0x560631a5e898, cmd=0x560631a7f088, trans=0x560631a7fab8) at lmtp-commands.c:213 #23 0x00007f3f39bfa2c7 in cmd_data_do_handle_input (cmd=0x560631a7f088) at smtp-server-cmd-data.c:285 #24 cmd_data_handle_input (cmd=0x560631a7f088) at smtp-server-cmd-data.c:333 #25 0x00007f3f39ca42af in io_loop_call_io (io=0x560631a7d8e0) at ioloop.c:718 #26 0x00007f3f39ca5c8c in io_loop_handler_run_internal (ioloop=ioloop@entry=0x560631a23fd0) at ioloop-epoll.c:222 #27 0x00007f3f39ca43c0 in io_loop_handler_run (ioloop=<optimized out>) at ioloop.c:770 #28 0x00007f3f39ca45e8 in io_loop_run (ioloop=0x560631a23fd0) at ioloop.c:743 #29 0x00007f3f39c124b3 in master_service_run (service=0x560631a23e60, callback=<optimized out>) at master-service.c:809 #30 0x0000560631699b45 in main (argc=<optimized out>, argv=<optimized out>) at main.c:169 I can provide one of the mails causing the crash if helpful (they are all spam). Best regards, Michael

2 7

Dovecot v2.3.9.1 released
by Aki Tuomi 13 Dec '19

13 Dec '19

Hi all! We are pleased to release v2.3.9.1 of Dovecot. Please find it from locations below https://dovecot.org/releases/2.3/dovecot-2.3.9.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.1.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- * CVE-2019-19722: Mails with group addresses in From or To fields caused crash in push notification drivers. --- Aki Tuomi Open-Xchange oy

1 0

Dovecot auth crashing??
by Odhiambo Washington 13 Dec '19

13 Dec '19

Dovecot-2.3.9 I am seeing a lot of the following on my logs: Dec 13 09:16:25 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 09:16:25 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 09:16:25 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 09:16:25 auth: Warning: Event 0x827d6e20 leaked (parent=0x827d4220): auth-request.c:878 Dec 13 09:16:25 auth: Warning: Event 0x827d6420 leaked (parent=0x827d4820): auth-request.c:878 Dec 13 09:16:25 auth: Warning: Event 0x82780c20 leaked (parent=0x827d6220): auth-request.c:878 Dec 13 09:16:25 auth: Warning: Event 0x827d6c20 leaked (parent=0x827d4220): auth-request.c:115 Dec 13 09:16:25 auth: Warning: Event 0x827d4220 leaked (parent=0x827d6a20): auth-request.c:114 Dec 13 09:16:25 auth: Warning: Event 0x827d6a20 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 09:16:25 auth: Warning: Event 0x827d4c20 leaked (parent=0x827d4820): auth-request.c:115 Dec 13 09:16:25 auth: Warning: Event 0x827d4820 leaked (parent=0x827fe620): auth-request.c:114 Dec 13 09:16:25 auth: Warning: Event 0x827fe620 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 09:16:25 auth: Warning: Event 0x827ff420 leaked (parent=0x827d6220): auth-request.c:115 Dec 13 09:16:25 auth: Warning: Event 0x827d6220 leaked (parent=0x82780e20): auth-request.c:114 Dec 13 09:16:25 auth: Warning: Event 0x82780e20 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 11:27:29 master: Warning: Killed with signal 15 (by pid=9326 uid=0 code=kill) Dec 13 11:27:37 master: Warning: Killed with signal 15 (by pid=16518 uid=0 code=kill) Dec 13 11:27:38 auth: Error: net_connect_unix(auth-worker) failed: No such file or directory Dec 13 11:27:39 auth: Error: net_connect_unix(auth-worker) failed: No such file or directory Dec 13 11:27:59 auth: Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: No such file or directory Dec 13 11:27:59 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 11:27:59 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 11:27:59 auth: Warning: Event 0x82781a20 leaked (parent=0x827d4620): auth-request.c:878 Dec 13 11:27:59 auth: Warning: Event 0x827d4220 leaked (parent=0x827d4820): auth-request.c:878 Dec 13 11:27:59 auth: Warning: Event 0x82780e20 leaked (parent=0x827d4620): auth-request.c:115 Dec 13 11:27:59 auth: Warning: Event 0x827d4620 leaked (parent=0x827d0820): auth-request.c:114 Dec 13 11:27:59 auth: Warning: Event 0x827d0820 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 11:27:59 auth: Warning: Event 0x82781220 leaked (parent=0x827d4820): auth-request.c:115 Dec 13 11:27:59 auth: Warning: Event 0x827d4820 leaked (parent=0x827d0c20): auth-request.c:114 Dec 13 11:27:59 auth: Warning: Event 0x827d0c20 leaked (parent=0x0): auth-client-connection.c:338 Dec 13 11:28:07 auth: Warning: Timeout leak: 0x105fb00 (auth-request-handler.c:584) Dec 13 11:28:07 auth: Warning: Event 0x82780c20 leaked (parent=0x82781c20): auth-request.c:878 Dec 13 11:28:07 auth: Warning: Event 0x82781e20 leaked (parent=0x82781c20): auth-request.c:115 Dec 13 11:28:07 auth: Warning: Event 0x82781c20 leaked (parent=0x82781a20): auth-request.c:114 Dec 13 11:28:07 auth: Warning: Event 0x82781a20 leaked (parent=0x0): auth-client-connection.c:338 -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

1 0

dovecot update from 2.1.16 to 2.2.36.4 but I have a trouble.
by iriya＠peach.ocn.ne.jp 13 Dec '19

13 Dec '19

Hi,I have a troble and can not resolve it. Please help me. I updated dovecot from 2.1.16 to 2.2.36.4. As a result, I had a client who could not access via imap. The client showed his logs (- folder not exists:INBOX ) I did not change dovecot config files. So I searched a difference between 2.1.16 and 2.2.36.4, I discovered . Please refer below results. [2.1.16] a03 list "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasNoChildren) "." "INBOX.Drafts" * LIST (\HasNoChildren) "." "INBOX.Sent" * LIST (\HasNoChildren) "." "INBOX.Spam" * LIST (\HasNoChildren) "." "INBOX.Trash" [2.2.36.4] a03 list "" "*" * LIST (\HasChildren) "." INBOX * LIST (\HasNoChildren) "." INBOX.Drafts * LIST (\HasNoChildren) "." INBOX.Sent * LIST (\HasNoChildren) "." INBOX.Spam * LIST (\HasNoChildren) "." INBOX.Trash For example, I noticed INBOX and "INBOX". 2.2.36.4 dovecot is no [""]. What should I do?

2 1

v2.2.36 to v2.3.8 maildirlock bug
by lty＠cndns.com 12 Dec '19

12 Dec '19

Dear all, Dovecot upgraded from v2.2.36 to v2.3.8 There is no problem with the configuration, but the lock directory seems to have an error. [root@spam dovecot]# /usr/libexec/dovecot/maildirlock /path/to/maildir 1 Panic: BUG: No IOs or timeouts set. Not waiting for infinity. 19276[root@spam dovecot]# Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xe227a) [0x7f1cb567a27a] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe2321) [0x7f1cb567a321] -> /usr/lib64/dovecot/libdovecot.so.0(+0x40f31) [0x7f1cb55d8f31] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf93b4) [>xrf1cb56913b4] -> /usr/ Lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x28) [0x7f1cb5693918] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c) [0x7f1cb5691aac] -> /usr/lib64/dovecot/libdovecot. So.0(io_loop_run+0x38) [0x7f1cb5691cc8] -> /usr/libexec/dovecot/maildirlock(main+0x242) [0x7f1cb5b522c2] -> /lib64/libc.so.6(__libc_start_main+0x100) [0x7f1cb5222d20] -> / Usr/libexec/dovecot/maildirlock(+0xfa9) [0x7f1cb5b51fa9] After google seems to be a bug, this is the address Https://bugs.gentoo.org/682498 If this is not fixed, we are temporarily unable to upgrade to use the new version. Will the next version be fixed? We are looking forward to seeing that we have returned v2.2.36

4 5

Lightweight LMTP daemon to avoid overkill MTA
by William Edwards 12 Dec '19

12 Dec '19

Hi, My situation is as follows. -An internet-facing spam filter relays email to destination mail server (Dovecot) with SMTP. - Dovecot should take email and deliver it to user's mailboxes. I guess I'd need LMTP for this. - An external SMTP relay is already in place. I am thinking of using Dovecot submission to relay to the external relaying cluster. So, both relaying and routing are done externally - the Dovecot machine should only store mail. Of course, there should also be a mechanism that takes care of local delivery to Dovecot, like LMTP. Usually, I would use an MTA like Exim to take care of local delivery. I feel like a fully-featured MTA is overkill, though, as all other roles such an MTA would fulfill - relaying and spam filtering - are fulfilled on external servers. Q: Does anyone know of a lightweight LMTP daemon that can take care of local delivery to Dovecot without the need for a full MTA? With kind regards, William Edwards T. 040 - 711 44 96 E. wedwards(a)cyberfusion.nl

3 7

Submission config being ignored
by William Edwards 12 Dec '19

12 Dec '19

I'm having trouble setting up submission with Dovecot proxy. The submission config seems to be getting ignored, but I'm probably doing something wrong. Expected behaviour: have messages sent to submission ports (25, 465) relayed to `submission_relay_host`. -- root@imapproxy1:~# cat /etc/dovecot/conf.d/20-submission.conf submission_logout_format = in=%i out=%o submission_relay_host = smtp.prorelay.nl submission_relay_port = 587 submission_relay_ssl = starttls submission_relay_ssl_verify = no service submission { } service submission-login { inet_listener submission_25 { port = 25 } inet_listener submission_465 { port = 465 ssl = yes } } -- What happens instead: Dovecot is attempting to send mail to the host specified in the passdb file: root@imapproxy1:~# cat /etc/virtual/xalys.nl/passwd test:$password.:8:8::/home/test.nl/test:/bin/false:userdb_quota_rule=*:bytes=0 proxy_maybe=y host=$ipaddr How do I get Dovecot to relay mail sent to submission ports to 'submission_relay_host'? Met vriendelijke groeten, William Edwards T. 040 - 711 44 96 E. wedwards(a)cyberfusion.nl submission_relay_host

2 2

Duplicate e-mail with Dovecot and Sieve
by Claudio Corvino 12 Dec '19

12 Dec '19

Hi everyone, we have a duplicate e-mail problem with Dovecot 2.2.13 (LMTP as MDA) on a Debian 8 server. Our users are on external LDAP. We just need to setup a vacation responder (with Sieve) for our employees with a redirect to an alias (a distribution list), let's call it /LIST(a)domain.com/, that comprehends even the user that just activated the out of office. This generates a loop: when someone write to LIST(a)domain.com every user of the aforementioned distribution list receives a duplicate e-mail generated from the sieve script of the user with vacation responder active that contains the redirect to LIST(a)domain.com. We just tried activating the duplicate extension into sieve script but the redirected e-mail has a different MSG-ID and it's not recognized as a duplicate by the server. Our dovecot conf is: /# 2.2.13: /etc/dovecot/dovecot.conf auth_mechanisms = plain login default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_fsync = never mail_location = maildir:~/Maildir mail_max_userip_connections = 50 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mmap_disable = yes passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-ldap-archive.conf driver = ldap } plugin { sieve = file:/var/www/html/ooo/%n/script sieve_dir = /var/www/html/ooo/%n/ sieve_duplicate_default_period = 1m sieve_duplicate_max_period = 1d sieve_extensions = +vnd.dovecot.duplicate +notify +imapflags +vacation-seconds sieve_global = /etc/dovecot/sieve/ sieve_max_redirects = 10 sieve_user_log = file:/var/www/html/ooo/%n/sieve_error.log sieve_vacation_default_period = 1d sieve_vacation_max_period = 90d sieve_vacation_min_period = 5s } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { process_limit = 200 } service lmtp { executable = lmtp -L process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } user = vmail } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { port = 4190 } process_min_avail = 10 service_count = 1 } service managesieve { executable = /usr/lib/dovecot/managesieve } ssl_cert = </etc/ssl/*xxxxxxxxxxxxxxxxxxxxxxxx* ssl_cipher_list = ALL:!LOW:!aNULL:!eNULL:!SSLv2:!RC4:!MD5:!DES:!EXP:!SEED:!IDEA:!3DES ssl_key = </etc/ssl/private/*xxxxxxxxxxxxxxxxxx* userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-archive.conf driver = ldap } protocol lda { auth_socket_path = /var/run/dovecot/auth-master hostname = *xxxxxxxxxxxxxxxxx* info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " autocreate sieve quota" } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " autocreate sieve quota" postmaster_address = postmaster@*xxxxxxxxxx* } protocol sieve { info_log_path = log_path = mail_max_userip_connections = 10 managesieve_implementation_string = dovecot managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 }/ An example of user sieve script is: /require ["vnd.dovecot.duplicate","copy","fileinto","vacation-seconds"]; # rule:[Outofoffice] if true { vacation :addresses "xxxxxxx(a)domain.tld" :subject "Automatic Reply" text: / /<Text here> . ; fileinto "INBOX";/ / redirect "LIST(a)domain.com";/ /}/ Please could someone give us support on the matter? Removing the redirect from sieve user script is not an option :-) Thanks Cheers -- *Claudio Corvino IT Systems Administrator* Trust Italia S.p.A. <https://www.trustitalia.it/> *DigiCert Italian Affiliate Certified Partner Platinum Elite* Via Flaminia, 497 - 00191 Roma *tel.: +39 06332287* *fax: +39 063336145* *e-mail: * ccorvino(a)trustitalia.it <mailto:ccorvino@trustitalia.it> *website: * www.trustitalia.it <https://www.trustitalia.it> Symantec Authentication Service Le modalità di trattamento dei dati a cui è stato dato il consenso e le relative finalità sono consultabili al link <https://www.trustitalia.it/archivio/legal_agreements/informativa_privacy_em…>. Qualora non desiderasse ricevere le nostre comunicazioni, potrà comunicarlo mediante il seguente link <https://www.trustitalia.it/site/info_css/05110101/revoca-del-consenso>. Inoltre, in ogni momento, potrà modificare o cancellare i dati presenti nel nostro archivio contattandoci all'indirizzo privacy(a)trustitalia.it <mailto:privacy@trustitalia.it> Se possibile non stamparmi! Se possibile, non stamparmi!

8 13

Lmtp redirection to other backend server
by Marc Roos 11 Dec '19

11 Dec '19

I have currently a working local delivery working ok on 2 backend servers. The backend servers use slapd/nslcd/nscd for local accounts. If I enable proxy=yes in the lmtp config section, I am getting this error 'auth: Debug: passdb out: FAIL#0111#011reason=Configured passdbs don't support credentials lookups' which is obvious because I do not have a passdb. I am not sure if it is possible to get this value from the system environment eg. nslcd/nscd, without the need to configure some separate ldap lookup in dovecot? Or do I really need to configure a ldap lmtp lookup just for this host attribute? What would be an efficient solution?

1 1

dkim + arc
by Aki Tuomi 11 Dec '19

11 Dec '19

If I don't get swamp of errors with this email, I'll stop the From munging starting tomorrow. There is now ARC signing done for mails. Lets see how this works, if we can stop rewriting from I'll be happy. Aki

2 2

Ban Atomia.com?
by LuKreme 11 Dec '19

11 Dec '19

Can a mail admin ban atomia.com from posting? I mean, I like the idea that every post is clogging up their support queue, but really, not that much. Sent from my iPhone

5 4

RE: lmtp delivery auth error, but successful delivery
by Marc Roos 11 Dec '19

11 Dec '19

It is a test environment, so I do not have much data. I am testing with 'mail wegjd' seems to deliver ok every time. -----Original Message----- Subject: RE: lmtp delivery auth error, but successful delivery Can you let me know if you get lots of delivery failures? Aki -------- Original message -------- From: Marc Roos <M.Roos(a)f1-outsourcing.eu> Date: 11/12/2019 22.16 (GMT+02:00) To: dovecot <dovecot(a)dovecot.org> Subject: lmtp delivery auth error, but successful delivery How to fix the auth passwd-file unknown user error? I guess I maybe have something active that I do not need? With this configuration in sendmail FEATURE(`local_lmtp',`[IPC]',`TCP [192.168.10.44] 24')dnl MAILER(local)dnl Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Connect from 192.168.10.44 Dec 11 21:04:18 mailsvr dovecot: auth: passwd-file(wegjd,192.168.10.44): unknown user Dec 11 21:04:18 mailsvr dovecot: lmtp(wegjd): msgid=<201912112004.xBBK4HoZ015358(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Disconnect from 192.168.10.44: Successful quit With this configuration in sendmail: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl MAILER(local)dnl Dec 11 21:11:50 mailsvr dovecot: lmtp(15754): Connect from local Dec 11 21:11:51 mailsvr dovecot: auth: passwd-file(wegjd): unknown user Dec 11 21:11:51 mailsvr dovecot: lmtp(wegjd): msgid=<201912112011.xBBKBoRB015751(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:11:51 mailsvr dovecot: lmtp(15754): Disconnect from local: Successful quit

1 0

lmtp delivery auth error, but successful delivery
by Marc Roos 11 Dec '19

11 Dec '19

How to fix the auth passwd-file unknown user error? I guess I maybe have something active that I do not need? With this configuration in sendmail FEATURE(`local_lmtp',`[IPC]',`TCP [192.168.10.44] 24')dnl MAILER(local)dnl Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Connect from 192.168.10.44 Dec 11 21:04:18 mailsvr dovecot: auth: passwd-file(wegjd,192.168.10.44): unknown user Dec 11 21:04:18 mailsvr dovecot: lmtp(wegjd): msgid=<201912112004.xBBK4HoZ015358(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:04:18 mailsvr dovecot: lmtp(15361): Disconnect from 192.168.10.44: Successful quit With this configuration in sendmail: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl MAILER(local)dnl Dec 11 21:11:50 mailsvr dovecot: lmtp(15754): Connect from local Dec 11 21:11:51 mailsvr dovecot: auth: passwd-file(wegjd): unknown user Dec 11 21:11:51 mailsvr dovecot: lmtp(wegjd): msgid=<201912112011.xBBKBoRB015751(a)mailsvr.xxxxxx.xxx>: saved mail to INBOX Dec 11 21:11:51 mailsvr dovecot: lmtp(15754): Disconnect from local: Successful quit

1 0

Atomia user activation
by Atomia 11 Dec '19

11 Dec '19

Hi Claudio Corvino via dovecot, A new Atomia account has been created for you. Click the url below to activate your account and select a password! https://support.atomia.com/register/KfOvGCowO4TkXeAXlMH0 If the above URL does not work try copying and pasting it into your browser. If you continue to have problems, please feel free to contact us. Regards, Atomia

1 0

Can't see a specific mail in thunderbird but with mobile mail client
by J. Echter 11 Dec '19

11 Dec '19

Hi, i've seen a strange behaviour in our system (centos 7, dovecot 2.2.36 (1f10bfa63) today. We got a mail and it got delivered. Dec 3 07:56:25 mail postfix/lmtp[4013]: 915B0CEF4C2: to=<user@domain>, relay=mail[private/dovecot-lmtp], delay=1.5, delays=1.3/0.03/0.02/0.19, dsn=2.0.0, status=sent (250 2.0.0 <user@domain> AOhCNBgH5l2vDwAAtnFApQ:2 Saved) Dec 3 07:56:25 mail dovecot: lmtp(user@domain): AOhCNBgH5l2vDwAAtnFApQ:2: sieve: msgid=<289913405.81.1575356173625.JavaMail.SYSTEM@EUWS0716>: stored mail into mailbox 'INBOX' I also see this mail on the filesystem in the users cur dir: -rw-r--r--. 1 vmail vmail 448818 3. Dez 07:56 1575356184.M937345P4015.mail,S=611100,W=619338:2,Sae But i don't see this single mail in thunderbird and not in sogo (http://www.sogo.nu) but i can see it in the mobile mail client. Does anyone have a suggfestion what may be wrong here? I paste my dovecot -n output here: # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: Linux 3.10.0-1062.4.3.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) xfs # Hostname: mail.workgroup.local auth_master_user_separator = * auth_verbose = yes base_dir = /var/run/dovecot/ default_vsz_limit = 2 G imap_id_log = * imap_id_send = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = 5000 mail_home = /DATEN/vmail/%Ld/%Ln mail_location = maildir:/DATEN/vmail/%Ld/%Ln/mail/ mail_plugins = " zlib fts fts_solr mail_log notify" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = no special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/sieve/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mailbox_alias_new = Sent Messages mailbox_alias_new2 = Sent Items mailbox_alias_new3 = Deleted Messages mailbox_alias_new4 = Papierkorb mailbox_alias_new5 = Spam mailbox_alias_old = Sent mailbox_alias_old2 = Sent mailbox_alias_old3 = Trash mailbox_alias_old4 = Trash mailbox_alias_old5 = Junk mailbox_list_index = yes recipient_delimiter = + sieve = /DATEN/vmail/%Ld/%Ln/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms zlib_save = gz zlib_save_level = 6 } protocols = sieve imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = root } service imap-login { chroot = login executable = /usr/libexec/dovecot/imap-login inet_listener imap { port = 0 } process_min_avail = 4 user = dovecot } service imap { executable = /usr/libexec/dovecot/imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { chroot = login user = dovecot } service pop3-login { chroot = login user = dovecot } ssl = required ssl_cert = </etc/pki/tls/certs/server.crt ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } valid_chroot_dirs = /var/spool/vmail protocol lda { mail_plugins = sieve postmaster_address = postmaster } protocol imap { mail_plugins = " zlib fts fts_solr mail_log notify imap_zlib imap_sieve" } protocol lmtp { mail_plugins = " zlib fts fts_solr mail_log notify quota sieve" postmaster_address = postmaster@domain } Thanks for any hints. Greetings Juergen

4 7

configured solr - question 2
by Wojciech Puchar 11 Dec '19

11 Dec '19

How to free space when say folders are removed in mail account. Or whole account is removed?

1 0

configured solr - question 1
by Wojciech Puchar 11 Dec '19

11 Dec '19

tested dovecot with solr. Works well. But it uses TCP connection between solr server and dovecot. Can it be password protected? I have other things than IMAP on the same server including remote users. i don't want them to be able to do mess.

1 0

Solr for Dovecot on Debian 9, package has correct binary?
by John Gateley 11 Dec '19

11 Dec '19

Hello, I am trying to get Solr full text searching working on Debian 9 with Dovecot, and I suspect the binary for dovecot does not have solr enabled (--with-solr). root@elephant:/etc/dovecot/conf.d# /usr/sbin/dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL driver plugins: mysql postgresql sqlite Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap(plugin) nss passwd prefetch passwd-file sql root@elephant:/etc/dovecot/conf.d# If I want to use solr, do I have to build dovecot myself? I'd prefer to use the debian package (Debian 9 for now). Thanks! John

2 1

Learning ham/spam with IMAPSieve: sa-learn-ham.sh terminated abnormally, signal 11
by Jens Rey 11 Dec '19

11 Dec '19

Hello, I am trying to get rspam to learn what is spam and what is ham. After following the IMAPSieve guide in the dovecot wiki (https://wiki2.dovecot.org/HowTo/AntispamWithSieve) the mail.log shows the following, whenever I move a mail from the Spam folder to my inbox and vice versa: sieve: Opening script 1 of 1 from `/usr/lib/dovecot/sieve/report-ham.sieve' sieve: Loading script /usr/lib/dovecot/sieve/report-ham.sieve sieve: Script binary /usr/lib/dovecot/sieve/report-ham.svbin successfully loaded sieve: binary save: not saving binary /usr/lib/dovecot/sieve/report-ham.svbin, because it is already stored sieve: Executing script from `/usr/lib/dovecot/sieve/report-ham.svbin' sieve: action pipe: running program: sa-learn-ham.sh Mailbox INBOX: Opened mail UID=2996 because: mail stream Debug: waiting for program `/usr/lib/dovecot/sieve/sa-learn-ham.sh' to finish after 0 msecs Error: program `/usr/lib/dovecot/sieve/sa-learn-ham.sh' terminated abnormally, signal 11 Error: sieve: pipe action: failed to pipe message to program `sa-learn-ham.sh': refer to server log for more information. [2019-11-17 00:39:33] Error: sieve: Execution of script /usr/lib/dovecot/sieve/report-ham.sieve failed My relevant dovecot configuration: plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-script.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } $ dovecot --version 2.2.27 (c0f36b0) $ ls -l /usr/lib/dovecot/sieve/ total 24 -rw-r--r-- 1 root root 314 Nov 17 00:25 report-ham.sieve -rw-r--r-- 1 root root 448 Nov 17 00:30 report-ham.svbin -rw-r--r-- 1 root root 199 Nov 17 00:25 report-spam.sieve -rw-r--r-- 1 root root 354 Nov 17 00:30 report-spam.svbin -rwxr-xr-x 1 root root 41 Nov 17 00:32 sa-learn-ham.sh -rwxr-xr-x 1 root root 42 Nov 17 00:32 sa-learn-spam.sh $ cat sa-learn-ham.sh #!/bin/sh exec /usr/bin/rspamc learn_ham When I execute the script manually, it seems to work: $ cat [some-mail] | /usr/lib/dovecot/sieve/sa-learn-ham.sh Results for file: stdin (0.011 seconds) success = true; filename = "stdin"; scan_time = 0.012000; Again, with the same mail: $ cat [some-mail] | /usr/lib/dovecot/sieve/sa-learn-ham.sh Results for file: stdin (0.000 seconds) error = "<some-mail> has been already learned as ham, ignore it"; filename = "stdin"; scan_time = 0.0; Any ideas what causes the abnormal temrination of the script? Regards, Jens

3 8

Re: fts_solr: Error: fts_solr: received invalid uid '0'
by Fabian Kuran 10 Dec '19

10 Dec '19

Hi, > Am 23.09.2019 um 09:36 schrieb Filip Hanes <filip.hanes(a)ringier.sk>: > > > št 19. 9. 2019 o 15:30 Fabian via dovecot <dovecot(a)dovecot.org <mailto:dovecot@dovecot.org>> napísal(a): > Are there any other hints or tips regarding this „invalid uid ‚0‘"-message? > from fts-solr source: > case SOLR_XML_CONTENT_STATE_UID: > if (uint32_parse(str, len, &ctx->uid) < 0 || ctx->uid == 0) { > i_error("fts_solr: received invalid uid '%s'", t_strndup(str, len)); > It means that plugin tries to parse '0' when in state of parsing uid in xml response from solr or there is a bug in xml response parser. > I would enable rawlog_dir in config and look there for unusual response or extra tags near usual uid in xml response. For example: > plugin { > fts = solr > fts_solr = url=... rawlog_dir=/var/log/fts-solr/ > } > Thanks for this tip! The rawlog_dir option is not yet supported in our version 2.3.4. What we could provide now would be the XML-Response from Solr. The corresponding search query sometimes causes this error. But Solr's answer seems to always remain the same - in my opinion this already indicates a bug of Dovecot? The XML response can be downloaded here: https://owncloud.eideo.de/index.php/s/8oyJaf5HBK6zdbr Kind regards, Fabian

4 6

Re: Dovecot & OAuth
by Aki Tuomi 10 Dec '19

10 Dec '19

Hi! It seems there is a bug in the oauth2 driver, it loads the cert files wrong way. I'll make an internal bug report of this. Aki > On 06/12/2019 16:42 mizuki <mizuki0621(a)gmail.com> wrote: > > > Hi, > > For troubleshooting purposes, I change the read/write permissions on the certs and confirmed 'dovecot' can read them w/o problem, but still seeing the same errors. :( > Mizuki > > > On Fri, Dec 6, 2019 at 1:35 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > Is the key/cert pair readable by dovecot user? auth process does not run as root. > > > > > > > > > > You can add > > > > > > > > > > service auth { > > > > extra_groups = ssl_cert > > > > } > > > > > > > > > > and chgrp the cert to ssl_cert to allow access to the cert. > > > > > > > > > > Aki > > > > > On 06/12/2019 04:16 mizuki via dovecot <dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > > > > > > > > > > I changed some of the tls options following the document, now config is following: > > > > > > > > > > > > > > > > > > > > > > > > tokeninfo_url = https://keycloak.com/auth/realms/mail/protocol/openid-connect/token > > > introspection_url = https://dovecot:7598e21b-ec34-481f-80d0-059bddae0923@keycloak.com/auth/real… > > > introspection_mode = post > > > debug = yes > > > rawlog_dir = /tmp/oauth2 > > > #force_introspection = yes > > > username_attribute = username > > > #active_attribute = active > > > #active_value = true > > > tls_ca_cert_file = /etc/pki/CA/certs/incommon-rsa-server-ca.crt > > > tls_cert_file = /etc/pki/dovecot/certs/dovecot.pem > > > tls_key_file = /etc/pki/dovecot/private/dovecot.pem > > > > > > > > > --------------- > > > > > > > > > > > > > > > The debug log is showing now slightly different msg ex: > > > > > > Dec 5 21:09:59 mktst4 dovecot: auth: Error: oauth2(mizuki,10.0.2.1,<29b4iv+YKuuCx5Tr>): oauth2 failed: Couldn't initialize SSL context: Can't load SSL certificate: There is no valid PEM certificate. > > > > > > > > > > > > > > > Still not able to connect to the keyclaok server. :( > > > > > > > > > > > > > > > > > > PS: Dovecot & Keycloak severs are both using the same legit cert/key pair with CA file configured. > > > > > > > > > > > > > > > Thanks! > > > > > > Mizuki > > > > > > > > > > > > > > > > > > > > > On Thu, Dec 5, 2019 at 3:06 PM Aki Tuomi < aki.tuomi(a)open-xchange.com> wrote: > > > > > > > > > > Before declaring it not ready for prime time, did you try setting > > > > > > > > tls_ca_cert_file = /etc/ssl/certs/ca-certificates.crt > > > > > > > > In the oauth2 configuration file as documented in https://doc.dovecot.org/configuration_manual/authentication/oauth2 ? > > > > > > > > Aki > > > > > > > > > On 05/12/2019 21:58 mizuki via dovecot < dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > We'd like to enable OAuth with Keycloak in Dovecot, after enabling 'OAUTHBEARER XOAUTH2' in Dovecot based on online document, I can confirm Dovecot is ready for OAuth using openssl command, however when the auth request comes in, it failed in establishing a SSL connection with Keycloak server on port 443, shown as following in debug logs. I can confirming using commands 'openssl s_client -connect <keycloak_server>:443' or 'curl -v https://<keycloak_server/' all returns normal and no errors. Altering some of the SSL options in dovecot such as 'ssl_ca = </etc/pki/CA/certs/root_ca.pem' or 'ssl_client_ca_file = </etc/pki/CA/certs/root_ca.pem' does not help either. The certificate are NOT self-signed but signed the legit authorities. So I'm not sure why dovecot could not establish the connections. > > > > > > > > >

3 4

OAuth2 mail client
by mizuki 10 Dec '19

10 Dec '19

Hi all, I'm wondering if there are any IMAP client software alternative to Thunderbird who can handle OAuth2 other than using gmail, yahoo etc (ex, talk to local auth provider)? Thunderbird does not seem to support well at the time being so I'm wondering what other choices we may have for our user communities. Thank you very much. Mizuki

1 0

Problem With Quota Dovecot
by Gter Marcelo 09 Dec '19

09 Dec '19

Hi Dears, I have one problem with Dovecot in My mailserver. Dovecot Quota setting is not working fine. plugin { quota = dict:User quota::file:MAILDIR/dovecot-quota quota_rule = *:storage=1GB } For example if i put the limit in 1GB, i have accounts in my mailbox with size of maildir in 3gb,4gb for exemple and if i running the command doveadm quota get -u ACCOUNT_MY_USER The user with 2GB should be return 100% or some number bigger , but return 45% used only, If i force running one force-resync, the quota-get return the size correct showing more than 100% Someone can Help me ?

2 4

[whishlist] new option for 'doveadm purge'
by Michael Grimm 09 Dec '19

09 Dec '19

Hi, I do store mail in mdbox format of 150m in size (dovecot 2.3.9). Once in a while I do experience mdbox files of smaller size, even after applying 'doveadm purge' and previous expunges by the users. like: -rw------- 1 vmail dovecot 104854595 Feb 9 2019 /var/mail/.maildirs/userX/storage/m.22 -rw------- 1 vmail dovecot 29088478 Mar 8 2019 /var/mail/.maildirs/userX/storage/m.31 -rw------- 1 vmail dovecot 98210890 Mar 20 2019 /var/mail/.maildirs/userX/storage/m.39 (Currently the counter is at file number 129.) Well, I never experienced missing mail or alike, but these "holes" in filesize irritates me, and yes, it is more or less a cosmetic issue. Nevertheless, I do sometimes want to get rid of these "holes" by backing up all mail and re-injecting the backup into a vanilla account of that user. And I used this approach when I wanted to store all mail messages in larger mdbox files; again, rather a cosmetic issue. BUT that takes a very, very long time contrary to the speed of 'doveadm purge'. Unfortunately, that command starts somewhere with more recent mdbox files and never from scratch (oldest mdbox file). Whishlist: Would it be much of an effort to implement an option like: 'doveadm purge -f' and '-f' standing for 'force' or 'from scratch' or 'from the very first message found' or 'you name it'? Thanks in advance and thanks for Dovecot and with kind regards, Michael

2 2

bash script hook lda_mailbox_autocreate for generate mail-crypt user encrypted private key with user password
by uxqex4efpu＠elude.in 09 Dec '19

09 Dec '19

What it is way most best for causing bash script run (as root) of time mailbox created (lda_mailbox_autocreate)? I use dovecot 2.3.4.1 in Debian 10. And I use of mail-crypt-plugin https://doc.dovecot.org/configuration_manual/mail_crypt_plugin/ I setup mail-crypt for requiring user encrypted EC key (mail_crypt_require_encrypted_user_key = yes). I want for passphrase encrypt EC key using client plaintext password. There is credential no stored on server. But for user with use password too bad, I concatenate user plaintext password with random salt. And then string to SHA512() hash and use as decryption key (mail_crypt_private_password) for EC private key. For above I have plugin config > mail_plugins = $mail_plugins mail_crypt > plugin { > mail_crypt_curve = secp256k1 > mail_crypt_require_encrypted_user_key = yes > mail_crypt_save_version = 2 > } And for returning userdb_mail_crypt_private_password, I have sql query > password_query = SELECT username, password, \ > SHA2( CONCAT('%w',salt), 512 ) AS userdb_mail_crypt_private_password \ > FROM virtual_users WHERE username='%u'; But how I generate key of user automatically? Note for generating key of user, I need user password plaintext. I never save plaintext password of user of the server. Also user of note creates in PHP of web of the server. And for security I do not allow PHP exec shell (php.ini disabled_functions). Definitely not leaving PHP doveadm access! For solving subject to generate user key encrypted, I do imap of call of the service 'imap-postlogin' the service likes document "Post-login scripting' write https://doc.dovecot.org/admin_manual/post_login_scripting/ And 'imap-postlogin' execute my custom script with 'script-login' binary https://github.com/dovecot/core/blob/8606e1abb90a1c91357b84bf547a89564d0535… Here it is config for above > service imap { > executable = imap imap-postlogin > } > service imap-postlogin { > executable = script-login /usr/local/bin/generateKeys.sh > unix_listener imap-postlogin { > } > } And generateKeys.sh it is script simple for generating keys with sha256() hash product mysql. Variable of note ${MAIL_CRYPT_PRIVATE_PASSWORD} automatically put of 'userdb_mail_crypt_private_password' return of mysql field of query when documented https://doc.dovecot.org/admin_manual/post_login_scripting/running-surroundi… > Fields returned by userdb lookup with their keys uppercased > (e.g. if userdb returned home, it's stored in HOME). Here generatekeys.sh > #!/bin/bash > if [ `/usr/bin/doveadm mailbox cryptokey list -u "${USER}" -U > /dev/null | wc -l` -lt 2 ]; then > /usr/bin/doveadm -o "plugin/mail_crypt_private_password=${MAIL_CRYPT_PRIVATE_PASSWORD}" mailbox cryptokey generate -u "${USER}" -U > /dev/null > fi > exec "$@" This work! But I want more good. By why execute each login? Possible has generateKeys.sh execute in the times only of dovecot create mailbox (lda_mailbox_autocreate) instead?

2 4

Execute a script from dovecot when authentication fails
by nb 09 Dec '19

09 Dec '19

Hello, My name is Noury, and I’m new here. I’ve been using dovecot IMAP for years, but I want to do now some extra things. I want to call a script from within dovecot, to build a suspicious IP addresses list when authentication fails. I have tried the PostLoginScripting technic. It works fine but it doesn’t suit my needs. The script executes only after a successful login. I want to execute my script only when auth fails. If I can execute a script and check into it if auth failed, I would be nice too. A kind of « PreLoginScript" Is there a way to achieve this? I’m reading now auth.log file, but I would like to have a realtime processing. Thanks in advance. Noury

2 1

Re: How do I set all my mailboxes to "subscribed"
by Aki Tuomi 09 Dec '19

09 Dec '19

2 1

Shared namespace is empty after migration to new Dovecot installation
by Peter Reinhold 09 Dec '19

09 Dec '19

Hi all, I've used most of this weekend finalizing my migration from an old server running Dovecot 2.2.22 to a brand new installation running 2.3.8. In general, the migration was painless, everything just clicked, but checking up on the finer details post migration i've found out that user shared folders does not seem to work anymore, and I simply can't get it to work. The setups are more or less identical, biggest change is probably the addition of a Solr search index, and i've done very little changes in the configuration files. The acl_shared_dict file is being created and updated when I share a folder In the user thats sharing the folder, the dovecot-acl and dovecot-acl-list files are created and look the same. But, the user that should be reading the shared folder can not see it, the Shared namespace is simply empty, which it is not on the old installation, and namespace setup is identical across the two servers. (Except for the CaSiNg of the location of the index and indexpvt) Logging in and doing an IMAP command : A1 LIST "Shared/" "*" yields this on the old server. (I've replaced the sharing users e-mail to user(a)sharer.dk and the reading users to user(a)reader.dk) A1 LIST "Shared/" "*" * LIST (\HasNoChildren) "/" Shared/user(a)sharer.dk A1 OK List completed (0.000 + 0.000 secs). and this on the new A1 LIST "Shared/" "*" A1 OK List completed (0.006 + 0.000 + 0.005 secs). Log output from the new server below (i've only included the events happening during the LIST account) -- New, non-working log start -- Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/data/mail/%d/%n/maildir:INDEX=~/maildir/shared/%u:INDEXPVT:~/maildir/shared/%u shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= fts: Indexes disabled for namespace 'Shared/%u/' acl: initializing backend with data: vfile acl: acl username = user(a)reader.dk acl: owner = 0 acl vfile: Global ACLs disabled acl vfile: file /data/mail/reader.dk/user/maildir/dovecot-acl not found acl vfile: file /data/mail/reader.dk/user/maildir/.Junk/dovecot-acl not found acl vfile: file /data/mail/reader.dk/user/maildir/.Trash/dovecot-acl not found acl vfile: file /data/mail/reader.dk/user/maildir/.Sent/dovecot-acl not found auth-master: userdb lookup(user(a)sharer.dk): Started userdb lookup auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=1636,uid=0): Client connected (fd=16) auth-master: userdb lookup(user(a)sharer.dk): auth USER input: user(a)sharer.dk uid=120 gid=129 home=/data/mail/sharer.dk/user auth-master: userdb lookup(user(a)sharer.dk): Finished userdb lookup (username=user(a)sharer.dk uid=120 gid=129 home=/data/mail/sharer.dk/user) Namespace Shared/: Using permissions from : mode=0700 gid=default -- New, non-working log end -- and here from the old, working installation -- Old, working log start -- Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/data/mail/%d/%n/maildir:INDEX=~/Maildir/shared/%u:INDEXPVT=~/Maildir/shared/%u shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= acl: initializing backend with data: vfile acl: acl username = user(a)reader.dk acl: owner = 0 acl vfile: Global ACLs disabled auth input: user(a)sharer.dk uid=118 gid=126 home=/data/mail/sharer.dk/user namespace/default/inbox=yes maildir++: root=/data/mail/sharer.dk/user/maildir, index=/data/mail/sharer.dk/user/Maildir/shared/user(a)sharer.dk, indexpvt=/data/mail/sharer.dk/user/Maildir/shared/user(a)sharer.dk, control=, inbox=/data/mail/sharer.dk/user/maildir, alt= acl: initializing backend with data: vfile acl: acl username = user(a)sharer.dk acl: owner = 1 acl vfile: Global ACLs disabled maildir++: root=/data/mail/sharer.dk/user/maildir, index=/data/mail/reader.dk/user/Maildir/shared/user(a)sharer.dk, indexpvt=/data/mail/reader.dk/user/Maildir/shared/user(a)sharer.dk, control=, inbox=/data/mail/sharer.dk/user/maildir, alt= acl: initializing backend with data: vfile acl: acl username = user(a)reader.dk acl: owner = 0 acl vfile: Global ACLs disabled acl vfile: reading file /data/mail/sharer.dk/user/maildir/dovecot-acl acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Junk acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Trash acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Sent acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Drafts acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Junk acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Trash acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Sent acl: Mailbox not in dovecot-acl-list: Shared/user(a)sharer.dk/Drafts -- Old, working log end -- The two logs are quite different, the new one seems to do user lookups via the auth socket, which the old one does not, and then just stops there. I'm not going to try and speculate more, I hope that someone here can see something from the logs, as I simply do not know how to fix this problem. -- Peter Reinhold

2 2

director option
by soumitri＠iitk.ac.in 09 Dec '19

09 Dec '19

Hi, I think option-2 below seems better or am I missing something with director concept. 1. As director and back-end in same server (broken) not recommended, I need minimum 4 servers (2 for director, 2 back-end IMAP). Indexes and mail must be in NFS shared storage(not optimal), as a user may land on any of the back-end servers (assuming no static mapping of user from pass DB). 2) Proxy_may in passDB (static mapping of users to servers makes balancing little partial but can be admin optimized) can achieve the above setup with 2 servers without director. Here indexes can be on their local disk (efficient) and mail on shared storage (NFS). Both case I can use RR DNS to get users IMAP traffic to front end. Any guidance on this is appreciated. -- Sincerely, Soumitri Mishra

1 1

Adding Size information to Maildir files
by ＠lbutlr 08 Dec '19

08 Dec '19

I searched on this, but found information only for very very old dovecot versions, and those answers didn’t quite cover what I am asking. All my current mail has the ",S=51489,W=52449:” style tag in the Maildir filename, but I have many messages in Archive mailboxes that have no size information. Is it possible to automate adding the size info to the files without mucking up the mail in various ways? (In my mail spool its about 10:1 with nearly 400,000 mails tagged with a size field and just over 40,000 not tagged, so it is definitely not something I want to do by hand). -- You know, Rick, I have many a friend in Casablanca, but somehow, just because you despise me, you are the only one I trust.

1 0

SEARCH=INTHREAD not announced in capabilities
by kael 08 Dec '19

08 Dec '19

Hello, Looking at the SEARCH=INTHREAD extension, Dovecot implements it but the server doesn't announce the extension in its capabilities (at least testing with imap://dovecot.org or looking at https://github.com/dovecot/core/blob/169b1ff42a28cdf2768391d20e8fef13aeae54… ) It does work though: a UID SEARCH INTHREAD REFS HEADER subject "Re: bash script" * SEARCH 106075 106076 106084 a OK Search completed (1.047 + 0.000 + 1.046 secs). I'd have thought that announcing THREAD=REFS would imply SEARCH=INTHREAD, but testing with Fastmail only the former is implemented. Looks like a bug in Dovecot as the client can't discover the SEARCH=INTHREAD capability. Cheers. -- kael

1 0

Accessing the -a and -d from dovecot-lda
by Aristedes Maniatis 08 Dec '19

08 Dec '19

I've got exim set up to deliver like this: command = /usr/local/libexec/dovecot/dovecot-lda -a $original_local_part@$original_domain -d $local_part@$domain -f $sender_address If an email to is bob+sales(a)ish.com.au then we should have "-a bob+sales(a)subdomain.ish.com.au -d bob(a)ish.com.au". Now in dovecot, only bob(a)ish.com.au is a real user but I want to be able to use both addresses in different places. For LDAP lookup I need to reference bob(a)ish.com.au. But in sieve, I need to see the original address with plus notation. However, dovecot appears to get the "-a" address into %u and the "-d" address can't be accessed. https://doc.dovecot.org/configuration_manual/config_file/config_variables/ Is what is the point of dovecot-lda having both -a and -d options? Can I get at both bits of data? Thanks Ari

2 1

ssl_min_protocol = TLSv1.3 does not work
by Laurens Post 08 Dec '19

08 Dec '19

Hi all, I'm trying to set up my server with support for TLS 1.3 only, but that does not seem to be supported. First off, TLS 1.3 itself does work fine, so it's not the config or ssl library, and 1.3-only works fine with Postfix. The problem is only in disabling TLS 1.2 for Dovecot. On connection, I'm getting an error that 1.3 is an "Unknown ssl_min_protocol setting". Reading the source code, it seems that `openssl_min_protocol_to_options` in `src/lib-ssl-iostream/iostream-openssl-common.c` is simply missing an entry like { SSL_TXT_TLSV1_3, TLS1_3_VERSION, SSL_OP_NO_SSLv3 | SSL_OP_NO_TLSv1 | SSL_OP_NO_TLSv1_1 | SSL_OP_NO_TLSv1_2 } Is this a bug, something intentional, or has it simply not been added yet because nobody has been crazy enough to ask for it? Kind regards, Laurens

3 2

Dovecot 2.3.8 - How to force index creation for user/mailbox?
by Tomek Lutelmowski 08 Dec '19

08 Dec '19

Hello, I'm using maildirs, and I have problems with big mailboxes (~ 20000 emails, 30-50GB) - sometimes access to such mailbox takes very long (~10 minutes), I would like to be able to create index for mailbox in background, but I couldn't find any way to do it. So far I tried: *doveadm -D -vvv index -u user 'Folder' * But even if this folder have no dovecot.index* files - I always get: doveadm(user): Info: Wersje robocze: Cache is already up to date It seems that doveadm doesn't actually checks if the index is present. The index is created only when I log with IMAP client and check the folder. So i tried: *doveadm mailbox cache purge -u user 'Folder' * No joy either: doveadm(user): Error: Cache is unusable And command below doesn't actually do anything to index: *doveadm -vvv force-resync -u user 'Folder'* Is there any way to use doveadm tool to create/fix index? Shouldn't the index be updated on each email arrival? Cheers, TomekL

5 12

lmtp proxy 'Invalid FROM: Missing domain'
by Marc Roos 06 Dec '19

06 Dec '19

Looks like I have a correct working proxy on pop3. On both backend servers I can run cat /tmp/test.msg | /usr/libexec/dovecot/lmtp Giving 250 2.1.5 OK 354 OK Info: Disconnect from local: Connection closed (in DATA) However if I run the same command on the proxy, I am getting this error 'Invalid FROM: Missing domain'. How is this FROM even relevant if message just needs to be delivered to RCPT TO.

2 2

Sieve redirect does not collect the sendmail child process correctly (Dovecot 2.3.4.1, Pigeonhole 0.5.4)
by Delian Krustev 06 Dec '19

06 Dec '19

Hi, I got this simple test Sieve config: ############################################# # Sieve Filter # Generated by Ingo (http://www.horde.org/apps/ingo/) (11/01/2019, 10:46:06 PM) # Forwards if true { redirect "krustev(a)krustev.net"; } # Forward Keep Action if true { keep; stop; } ############################################# Which used to work fine with: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-8-amd64 x86_64 Debian 9.11 Then I've tried migrating to: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.1 And started getting the following errors: # cat .dovecot.sieve.log sieve: info: started log at Nov 01 22:55:50. error: msgid=<4221584.AlbrL4BjWX@home>: failed to redirect message to <krustev(a)krustev.net>: Failed to execute sendmail (temporary failure). A google search lead me to: https://bugs.archlinux.org/task/56933 which blames systemd service changes: NoNewPrivileges=true , however I'm not running dovecot via systemd but use DJB's daemontools for service supervision . The page above suggested to change from: sendmail_path = /usr/sbin/sendmail to submission_host = localhost in "conf.d/15-lda.conf", which worked fine. But since I don't have other problems with "sendmail" execution I've decided to debug this further. I have dovecot integrated with Qmail: # apt-cache policy qmail qmail: Installed: 1.06-6+b1 Candidate: 1.06-6+b1 Version table: *** 1.06-6+b1 900 900 http://deb.debian.org/debian buster/main amd64 Packages so sendmail's implementation comes from Qmail: # ls -al `which sendmail` lrwxrwxrwx 1 root root 14 Feb 23 2015 /usr/sbin/sendmail -> qmail-sendmail I've strace-d the qmail-lspawn process which executes dovecot's LDA, which processes the Sieve rules and executes "sendmail". The sendmail process executes and returns successfully, the mail is delivered, however the Sieve code does not wait for the child process correctly and tries to kill the already exited process after 30 seconds timeout. Here are the problematic Sieve syscalls: 22:55:15.283482 execve("/usr/lib/dovecot/deliver", ["/usr/lib/dovecot/deliver", "-e", "-a", "tester(a)krustev.net"], 0x5620b4330c40 /* 61 vars */) = 0 ... 22:55:15.286845 pipe([5, 6]) = 0 22:55:15.286870 fcntl(5, F_GETFL) = 0 (flags O_RDONLY) 22:55:15.286889 fcntl(5, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 22:55:15.286909 fcntl(6, F_GETFL) = 0x1 (flags O_WRONLY) 22:55:15.286928 fcntl(6, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 22:55:15.286947 fcntl(5, F_GETFD) = 0 22:55:15.286966 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 22:55:15.286985 fcntl(6, F_GETFD) = 0 22:55:15.287003 fcntl(6, F_SETFD, FD_CLOEXEC) = 0 22:55:15.287024 epoll_create(128) = 7 22:55:15.287043 fcntl(7, F_GETFD) = 0 22:55:15.287062 fcntl(7, F_SETFD, FD_CLOEXEC) = 0 22:55:15.287084 epoll_ctl(7, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=47201248, u64=94699781110752}}) = 0 ... 22:55:15.294625 epoll_ctl(7, EPOLL_CTL_DEL, 5, 0x7ffd59156b8c) = 0 22:55:15.294647 epoll_create(128) = 12 22:55:15.294668 fcntl(12, F_GETFD) = 0 22:55:15.294687 fcntl(12, F_SETFD, FD_CLOEXEC) = 0 22:55:15.294708 epoll_ctl(12, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=47455536, u64=94699781365040}}) = 0 Dovecot/Sieve will wait for this pipe FD 5 later, but no event will arrive. 22:55:15.294740 rt_sigaction(SIGCHLD, {sa_handler=0x7f15404b3640, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO, sa_restorer=0x7f1540229840}, NULL, 8) = 0 22:55:15.294763 pipe([13, 14]) = 0 22:55:15.294788 clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7f15401ec2d0) = 6929 The sendmail child process with PID 6929 is forked here. 22:55:15.294928 close(13) = 0 22:55:15.294969 fcntl(14, F_GETFL) = 0x1 (flags O_WRONLY) 22:55:15.295006 fcntl(14, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 22:55:15.295039 lseek(14, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 22:55:15.295065 getsockname(14, 0x7ffd59156a40, [28]) = -1 ENOTSOCK (Socket operation on non-socket) 22:55:15.295109 write(14, "EDITTED LONG MESSAGE DATA\n", 1461) = 1461 22:55:15.295150 close(14) = 0 22:55:15.295175 wait4(6929, 0x562102d4fee4, WNOHANG, NULL) = 0 22:55:15.295211 epoll_wait(12, [], 1, 30000) = 0 Here's where the 30 second's timeout is requested and waited. 22:55:45.325580 kill(6929, SIGTERM) = 0 22:55:45.325769 epoll_wait(12, [], 1, 5000) = 0 22:55:50.331108 kill(6929, SIGKILL) = 0 22:55:50.332867 wait4(6929, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 6929 22:55:50.333020 epoll_ctl(12, EPOLL_CTL_DEL, 5, 0x7ffd59156b6c) = 0 22:55:50.333060 epoll_ctl(7, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=47201248, u64=94699781110752}}) = 0 22:55:50.333097 close(12) = 0 22:55:50.333240 sendto(9, "<19>Nov 1 22:55:50 dovecot: lda(krustev)<6926><IlpXEdO3vF0OGwAA4EGeoA>: Error: sieve: msgid=<4221584.AlbrL4BjWX@home>: failed to redirect message to <krustev(a)krustev.net>: Failed to execute sendmail (temporary failure)", 220, MSG_NOSIGNAL, NULL, 0) = 220 22:55:50.333321 openat(AT_FDCWD, "/home/krustev/mail/domains/krustev.net/tester/.dovecot.sieve.log", O_WRONLY|O_CREAT|O_APPEND, 0600) = 12 22:55:50.333557 fstat(12, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 22:55:50.333613 lseek(12, 0, SEEK_CUR) = 0 22:55:50.333643 fstat(12, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 22:55:50.333678 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=127, ...}) = 0 22:55:50.333726 write(12, "sieve: info: started log at Nov 01 22:55:50.\n", 45) = 45 22:55:50.333788 write(12, "error: msgid=<4221584.AlbrL4BjWX@home>: failed to redirect message to <krustev(a)krustev.net>: Failed to execute sendmail (temporary failure).\n", 141) = 141 22:55:50.333857 sendto(9, "<19>Nov 1 22:55:50 dovecot: lda(krustev)<6926><IlpXEdO3vF0OGwAA4EGeoA>: Error: sieve: Execution of script /home/krustev/mail/domains/krustev.net/tester/.dovecot.sieve was aborted due to temporary failure (user logfile /home/krustev/mail/domains/krustev.net/tester/.dovecot.sieve.log may reveal additional details)", 317, MSG_NOSIGNAL, NULL, 0) = 317 22:55:50.333941 close(10) = 0 22:55:50.333996 close(12) = 0 22:55:50.334057 lstat("/home/krustev/mail/domains/krustev.net/tester/.dovecot.lda-dupes.lock", {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 22:55:50.334095 unlink("/home/krustev/mail/domains/krustev.net/tester/.dovecot.lda-dupes.lock") = 0 22:55:50.334188 close(11) = 0 22:55:50.334245 write(2, "Execution of Sieve filters was aborted due to temporary failure\n", 64) = 64 22:55:50.334418 munmap(0x7f15401bc000, 103680) = 0 22:55:50.334481 munmap(0x7f15403b3000, 32800) = 0 22:55:50.334516 munmap(0x7f15400fb000, 788352) = 0 22:55:50.334610 epoll_ctl(7, EPOLL_CTL_DEL, 8, 0x7ffd5915706c) = 0 22:55:50.334640 close(8) = 0 22:55:50.334685 epoll_ctl(7, EPOLL_CTL_DEL, 5, 0x7ffd5915706c) = 0 22:55:50.334738 close(5) = 0 22:55:50.334785 close(6) = 0 22:55:50.334813 close(7) = 0 22:55:50.334841 close(4) = 0 22:55:50.334881 exit_group(75) = ? 22:55:50.335077 +++ exited with 75 +++ Here's the interesting part of sendmail's (PID 6929) execution with timestamps: .. 22:55:15.295268 execve("/usr/sbin/sendmail", ["/usr/sbin/sendmail", "-i", "-f", "tester(a)krustev.net", "--", "krustev(a)krustev.net"], NULL) = 0 ... 22:55:15.296024 chdir("/var/lib/qmail") = 0 22:55:15.296055 execve("bin/qmail-inject", ["bin/qmail-inject", "-a", "-f", "tester(a)krustev.net", "--", "krustev(a)krustev.net"], 0x55741b1890e0 /* 2 vars */) = 0 ... 22:55:15.297264 vfork() = 6930 .. 22:55:15.297930 wait4(6930, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 6930 22:55:15.305391 exit_group(0) = ? 22:55:15.305472 +++ exited with 0 +++ The PID 6930 is a call to the setuid qmail-queue, which also executes and returns normally. With all the above stated - It seems that the problem is in the "epoll" calls. Either it is not set-up correctly or dovecot-LDA does not receive the information it waits for. I've tried to make my way trough Dovecot's source code but have concluded that someone more familiar should be able to spot the problem much quicker than me. Let me know if you need some additional information. Sorry for the long mail. Dovecot config follows: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.1 # Hostname: pinko.livehostserver.com auth_mechanisms = plain login disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /dev/stderr log_timestamp = mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox "Deleted Items" { special_use = \Trash } mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox "Junk E-mail" { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Mail" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox sent-mail { special_use = \Sent } prefix = } passdb { args = /usr/local/sbin/vchkpw-dovecot driver = checkpassword } plugin { antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_pipe_program = /bin/sh antispam_pipe_program_notspam_args = -c;HOME=$PWD exec nice sa-learn --ham antispam_pipe_program_spam_args = -c;HOME=$PWD exec nice sa-learn --spam antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = spam;junk;junk * antispam_trash_pattern_ignorecase = trash;Deleted * quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_redirect_envelope_from = recipient } protocols = " imap sieve pop3" service anvil { client_limit = 1536 } service auth { client_limit = 1536 } service imap-login { process_limit = 512 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 } service managesieve { process_limit = 50 } service pop3-login { process_limit = 512 } service stats { client_limit = 1024 unix_listener stats-writer { mode = 0666 } } ssl_ca = </scm/deb-global/etc/ssl/intermediate-CAs.crt ssl_cert = </etc/ssl/default-fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = prefetch } protocol lda { info_log_path = log_path = mail_plugins = " quota sieve" } protocol imap { mail_max_userip_connections = 64 mail_plugins = " quota imap_quota antispam" } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_line_length = 65536 } Best regards -- Delian

2 3

Problem with sievefilter forwarding
by ratatouille 06 Dec '19

06 Dec '19

Hello! dovecot --version 2.2.36 (1f10bfa63) I defined a sievefilter require ["copy"]; # rule:[weiterleitung] if header :contains "to" "user(a)bitclusive.de" { redirect :copy "otheruser(a)gmail.com"; stop; } It doesn't work and I don't know why. I can define a vacationfilter that works fine. Can I debug this somehow and can somebody here explain what is going wrong? Kind regards Andreas

2 2

ACL hide folders
by Peter Chiochetti 06 Dec '19

06 Dec '19

After updating from 2.2.22 to 2.2.33 rsp 2.3.8 my ACLs went bust. Below line in the global acl file hides all folders except INBOX for all users > * group=ALL Next reenable certain folders, eg: > Sent group=ALL lrwsi This made anyone see "Sent" in 2.2.22, but no longer so in 2.2.33 Any ideas how to have it like before? -- peter

1 3

v2.3.9 released
by Aki Tuomi 06 Dec '19

06 Dec '19

Hi all! We are pleased to release v2.3.9 of Dovecot. Please find it from locations below --- Aki Tuomi Open-Xchange oy https://dovecot.org/releases/2.3/dovecot-2.3.9.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.9.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- * Changed several event field names for consistency and to avoid conflicts in parent-child event relationships: * SMTP server command events: Renamed "name" to "cmd_name" * Events inheriting from a mailbox: Renamed "name" to "mailbox" * Server connection events have only "remote_ip", "remote_port", "local_ip" and "local_port". * Removed duplicate "client_ip", "ip" and "port". * Mail storage events: Removed "service" field. Use "service:<name>" category instead. * HTTP client connection events: Renamed "host" to "dest_host" and "port" to "dest_port" * auth: Drop Postfix socketmap support. It hasn't been working with recent Postfix versions for a while now. * push-notification-lua: The "subject" field is now decoded to UTF8 instead of kept as MIME-encoded. + push-notification-lua: Added new "from_address", "from_display_name", "to_address" and "to_display_name" fields. The display names are decoded to UTF8. + Added various new fields to existing events. See http://doc.dovecot.net/admin_manual/list_of_events.html + Add lmtp_add_received_header setting. It can be used to prevent LMTP from adding "Received:" headers. + doveadm: Support SSL/STARTTLS for proxied doveadm connections based on doveadm_ssl setting and proxy ssl/tls settings. + Log filters support now "service:<name>", which matches all events for the given service. It can also be used as a category. + lib: Use libunwind to get abort backtraces with function names where available. + lmtp: When the LMTP proxy changes the username (from passdb lookup) add an appropriate ORCPT parameter. - lmtp: Add lmtp_client_workarounds setting to implement workarounds for clients that send MAIL and RCPT commands with additional spaces before the path and for clients that omit <> brackets around the path. See example-config/conf.d/20-lmtp.conf. - lda/lmtp: Invalid MAIL FROM addresses were rejcted too aggressively. Now mails from addresses with unicode characters are delivered, but their Return-Path header will be <> instead of the given MAIL FROM address. - lmtp: The lmtp_hdr_delivery_address setting is ignored. - imap: imap_command_finished event's "args" and "human_args" parameters were always empty. - mbox: Seeking in zlib and bzip2 compressed input streams didn't work correctly. - imap-hibernate: Process crashed when client got destroyed while it was attempted to be unhibernated, and the unhibernation fails. - *-login: Proxying may have crashed if SSL handshake to the backend failed immediately. This was unlikely to happen in normal operation. - *-login: If TLS handshake to upstream server failed during proxying, login process could crash due to invalid memory access. - *-login: v2.3 regression: Using SASL authentication without initial response may have caused SSL connections to hang. This happened often at least with PHP's IMAP library. - *-login: When login processes are flooded with authentication attempts it starts logging errors about "Authentication server sent unknown id". This is still expected. However, it also caused the login process to disconnect from auth server and potentially log some user's password in the error message. - dict-sql: SQL prepared statements were not shared between sessions. This resulted in creating a lot of prepared statements, which was especially inefficient when using Cassandra backend with a lot of Cassandra nodes. - auth: auth_request_finished event didn't have success=yes parameter set for successful authentications. - auth: userdb dict - Trying to list users crashed. - submission: Service could be configured to allow anonymous authentication mechanism and anonymous user access. - LAYOUT=index: Corrupted dovecot.list.index caused folder creation to panic. - doveadm: HTTP server crashes if request target starts with double "/". - dsync: Remote dsync started hanging if the initial doveadm "dsync-server" command was sent in the same TCP packet as the following dsync handshake. v2.3.8 regression. - lib: Several "input streams" had a bug that in some rare situations might cause it to access freed memory. This could lead to crashes or corruption. The only currently known effect of this is that using zlib plugin with external mail attachments (mail_attachment_dir) could cause fetching the mail to return a few bytes of garbage data at the beginning of the header. Note that the mail wasn't saved corrupted, but fetching it caused corrupted mail to be sent to the client. - lib-storage: If a mail only has quoted content, use the quoted text for generating message snippet (IMAP PREVIEW) instead of returning empty snippet. - lib-storage: When vsize header was rebuilt, newly calculated message sizes were added to dovecot.index.cache instead of being directly saved into vsize records in dovecot.index. - lib: JSON generator was escaping UTF-8 characters unnecessarily.

3 2

[2.3.8] possible replication issue
by Carsten Rosenberg 06 Dec '19

06 Dec '19

Hi, some of our customers have discovered a replication issue after upgraded from 2.3.7.2 to 2.3.8. Running 2.3.8 several replication connections are hanging until defined timeout. So after some seconds there are $replication_max_conns hanging connections. Other replications are running fast and successful. Also running a doveadm sync tcp:... is working fine for all users. I can't see exactly, but I haven't seen mailboxes timeouting again and again. So I would assume it's not related to the mailbox. >From the logs: server1: Oct 16 08:29:25 server1 dovecot[5715]: dsync-local(username1(a)domain.com)<FXnVDW22pl0tGAAA1cwDxA>: Error: dsync(172.16.0.1): I/O has stalled, no activity for 600 seconds (version not received) Oct 16 08:29:25 server1 dovecot[5715]: dsync-local(username1(a)domain.com)<FXnVDW22pl0tGAAA1cwDxA>: Error: Timeout during state=master_recv_handshake server2: Oct 16 08:29:25 server2 dovecot[8113]: doveadm: Error: read(server1) failed: EOF (last sent=handshake, last recv=handshake) There aren't any additional logs regarding the replication. I have tried increasing vsz_limit or reducing replication_max_conns. Nothing changed. -- Both customers have 10k+ users. Currently I couldn't reproduce this on smaller test systems. Both installation were downgraded to 2.3.7.2 to fix the issue for now -- I've attached a tcpdump showing the client showing the client stops sending any data after the mailbox_guid table headers. Any idea what could be wrong here or the debug this issue? Thanks. Carsten Rosenberg

5 5

Dovecot & OAuth
by mizuki 06 Dec '19

06 Dec '19

Hi all, We'd like to enable OAuth with Keycloak in Dovecot, after enabling 'OAUTHBEARER XOAUTH2' in Dovecot based on online document, I can confirm Dovecot is ready for OAuth using openssl command, however when the auth request comes in, it failed in establishing a SSL connection with Keycloak server on port 443, shown as following in debug logs. I can confirming using commands 'openssl s_client -connect <keycloak_server>:443' or 'curl -v https://<keycloak_server/' all returns normal and no errors. Altering some of the SSL options in dovecot such as 'ssl_ca = </etc/pki/CA/certs/root_ca.pem' or 'ssl_client_ca_file = </etc/pki/CA/certs/root_ca.pem' does not help either. The certificate are NOT self-signed but signed the legit authorities. So I'm not sure why dovecot could not establish the connections. *Debug logs:* ---------------------------------------------------- Dec 5 14:32:07 mktst4 dovecot: auth: Debug: auth client connected (pid=16554) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: client in: AUTH#0111#011OAUTHBEARER#011service=imap#011secured#011session=QPwA/fmY+tqCx5Tr#011lip=130.199.148.187#011rip=10.0.2.1#011lport=993#011rport=56058#011resp=bixhPW1penVraQFob3N0PW1rdHN0NC5zZGNjLmJubC5nb3YBcG9ydD05OTMBYXV0aD1CZWFyZXIgZXlKaGJHY2lPaUpTVXpJMU5pSXNJblI1Y0NJZ09pQWlTbGRVSWl3aWEybGtJaUE2SUNKcmRHeE5TSFZtYkc1NFZUUmlSR1pLTm5kSGRteFBNVVYxWWxWd2FreEZVVmhIY25GTU5UYzNhSEJSSW4wLmV5SnFkR2tpT2lJNE5XSmxZV05tTkMxak1tTmxMVFJtTkRJdFltUTRNUzAxTnpWaU4yRmpZV05sT1RnaUxDSmxlSEFpT2pFMU56VTJNVEF5TURnc0ltNWlaaUk2TUN3aWFXRjBJam94TlRjMU5UYzBNakE0TENKcGMzTWlPaUpvZEhSd2N6b3ZMMnRsZVdOc2IyRnJNaTV6WkdOakxtSnViQzVuYjNZdllYVjBhQzl5WldGc2JYTXZiV0ZwYkNJc0ltRjFaQ0k2SW1GalkyOTFiblFpTENKemRXSWlPaUkyTmpWa05EVTNNeTA0WVdFMUxUUmtPRFl0WW1NelppMHlaVEpqTWpOaU16WTJORFVpTENKMGVYQWlPaUpDWldGeVpYSWlMQ0poZW5BaU9pSmtiM1psWTI5MElpd2lZWFYwYUY5MGFXMWxJam93TENKelpYTnphVzl1WDNOMFlYUmxJam9pT1RNNE5XRTVOakF0TUROa1pDMDBPR05sTFdFeU4yUXRZVFkzWkdZME5tUXhaRGcxSWl3aVlXTnlJam9pTVNJc0luSmxZV3h0WDJGalkyVnpjeUk2ZXlKeWIyeGxjeUk2V3lKdlptWnNhVzVsWDJGalkyVnpjeUlzSW5WdFlWOWhkWFJvYjNKcGVtRjBhVzl1SWwxOUxDSnlaWE52ZFhKalpWOWhZMk5sYzNNaU9uc2lZV05qYjNWdWRDSTZleUp5YjJ4bGN5STZXeUp0WVc1aFoyVXRZV05qYjNWdWRDSXNJbTFoYm1GblpTMWhZMk52ZFc1MExXeHBibXR6SWl3aWRtbGxkeTF3Y205bWFXeGxJbDE5ZlN3aWMyTnZjR1VpT2lKd2NtOW1hV3hsSUdWdFlXbHNJaXdpWlcxaGFXeGZkbVZ5YVdacFpXUWlPbVpoYkhObExDSnVZVzFsSWpvaVRXbDZkV3RwSUV0aGNtRnpZWGRoSWl3aWNISmxabVZ5Y21Wa1gzVnpaWEp1WVcxbElqb2liV2w2ZFd0cElpd2laMmwyWlc1ZmJtRnRaU0k2SWsxcGVuVnJhU0lzSW1aaGJXbHNlVjl1WVcxbElqb2lTMkZ5WVhOaGQyRWlMQ0psYldGcGJDSTZJbTFwZW5WcmFVQmlibXd1WjI5MkluMC5NZTRwNkl0dmx2T0VYRTIxM2pwSnJpa3FhZGNZb0ZsMnlMVlJzQTJvQTdmWDgteEtJYTR2ckZmamwwLXRwb2JodzIyRnBvVDZ2TWoxbXphLXBWWUxzNW1vM0w5Y0xKT2hVVnV2Tm9YSm5nZlRzLXk2TWxuTXVGV1NQemtidEhhOXJTUEVqZGFZQXBDQk52MG9CWEs2bmhIM0U5ZkNvTl9TQlUycWxaSWk2M1dWOUZXSjFrbHVGT2Iwc0xja2JfWGNGZzhUZ0dXOEdVUlRYTlg4bW1VM1dNLWJ5dnJuTkFyNmFjWW1ibXRaVzRhV0NwTk5FSHRZU29LSmgydHZuQjhHNnl5eWptWWJ5Q2ZhTmwwSnVZYU52VFEzTXhCX2FnLV9Pcy04VkwtTGFLdHBGYXBMNEVNWUJaXzFnZmNhSFdUSUV1VS0wSVdjTjlEa2xxcW1MN19jNlEBAQ== (previous base64 data may contain sensitive data) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: Host created Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: Performing asynchronous DNS lookup Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO…] Submitted Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: DNS lookup successful; got 1 IPs Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Peer created Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com"443: Setting up connection to 10.0.2.2:443 (SSL= example.com) (1 requests pending) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Linked queue https://example.com:443 (1 queues linked) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Started new connection to 10.0.2.2:443 (SSL= example.com) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Creating 1 new connections to handle requests (already 0 usable, connecting to 0, closing 0) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Making new connection 1 of 1 Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: HTTPS connection created (1 parallel connections exist) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connected Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Starting SSL handshake Dec 5 14:32:22 mktst4 dovecot: auth: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Failed to make connection (connections=1, connecting=1) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Failed to set up connection to 10.0.2.2:443 (SSL= example.com) SSL handshaking with 10.0.2.2:443 failed: read(SSL 10.0.2.2:443) failed: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority (1 peers pending, 1 requests pending) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Failed to set up any connection; failing all queued requests Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: peer 10.0.2.2:443: Unlinked queue https://example.com:443 (0 queues linked) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: queue https://example.com:443: Dropping request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO… ] Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: host example.com: Host is idle (timeout = 1799992 msecs) Dec 5 14:32:22 mktst4 dovecot: auth: Error: oauth2(mizuki,10.0.2.1,<QPwA/fmY+tqCx5Tr>): oauth2 failed: SSL handshaking with 10.0.2.2:443 failed: read(SSL 10.0.2.2:443) failed: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO…] Destroy (requests left=1) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: request [Req1: GET https://example.com/auth/realms/mail/protocol/openid-connect/tokeneyJhbGciO…] Free (requests left=0) Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: SSL handshaking with 10.0.2.2:443 failed: read(SSL 10.0.2.2:443) failed: Received invalid SSL certificate: unable to get issuer certificate: /C=US/ST=New Jersey/L=Jersey City/O=The USERTRUST Network/CN=USERTrust RSA Certification Authority Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connection close Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connection disconnect Dec 5 14:32:22 mktst4 dovecot: auth: Debug: http-client: conn 10.0.2.2:443 [0]: Connection destroy ---------------------------------------------------- *#dovecot -n * ---------------------------------------------------- # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1062.4.3.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.7 (Maipo) # Hostname: mktst4.sdcc.bnl.gov auth_debug = yes auth_debug_passwords = yes auth_mechanisms = oauthbearer xoauth2 auth_verbose = yes auth_verbose_passwords = yes first_valid_uid = 1000 mail_debug = yes mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-oauth2.conf.ext driver = oauth2 mechanisms = oauthbearer xoauth2 } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = required ssl_ca = </etc/pki/CA/certs/2.pem ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = ECDH+AESGCM:ECDH+CHACHA20:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:!aNULL:!MD5:!DSS:!RSA ssl_client_ca_file = </etc/pki/CA/certs/2.pem ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_require_crl = no userdb { args = uid=vmail gid=vmail home=/var/vmail/%u driver = static } ---------------------------------------------------- *# cat /etc/dovecot/conf.d/auth-oauth2.conf.ext* ---------------------------------------------------- passdb { driver = oauth2 mechanisms = oauthbearer xoauth2 args = /etc/dovecot/dovecot-oauth2.conf.ext } userdb { driver = static args = uid=vmail gid=vmail home=/var/vmail/%u } ---------------------------------------------------- I wonder if anyone has experienced this possibly know what's going on. Thanks! Mizuki

2 3

Supporting RFC 5466 (IMAP4 Extension for Named Searches (Filters))
by Jesus Cea 06 Dec '19

06 Dec '19

I wonder if Dovecot supports RFC 5466 (IMAP4 Extension for Named Searches (Filters)) or if there is any plan about it. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

4 6

How to rewrite local_lmpt ipc to tcp port 24
by Marc Roos 05 Dec '19

05 Dec '19

How to change this line in sendmail.mc, to the tcp port 24 on eg 127.0.0.1? FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl

2 1

dovecot expunge
by soumitri＠iitk.ac.in 05 Dec '19

05 Dec '19

Hi, Do we have expunge command by UID. I have some duplicate messages (same Message-ID but different UID) to be deleted. doveadm search gives me folder GUID and file UID, I want to use this specific information to delete/expunge. E.g. Following command deletes all duplicates, but I want to keep just one. doveadm expunge -u user1 mailbox INBOX HEADER Message-ID '5de82b2d.6VWfTzsd/fEAxfV7%cytx(a)iitk.ac.in' The following does not help doveadm deduplicate -u user1 mailbox INBOX -- Sincerely, Soumitri Mishra

2 1

How do I set all my mailboxes to "subscribed"
by Steve Litt 05 Dec '19

05 Dec '19

Hi all, I've had a great deal of trouble accessing my Dovecot IMAP from most supposedly IMAP aware email clients, and have been advised that it might be because some of my email folders are not subscribed. Is there s way I can subscribe all my folders? I see no reason to have a folder not subscribed. Thanks, SteveT Steve Litt December 2019 featured book: Rapid Learning for the 21st Century http://www.troubleshooters.com/rl21

2 1

Email blocking emails
by Peter Nabbefeld 05 Dec '19

05 Dec '19

Hello, I had troubles getting emails, because this one caused a Sig 6: https://p.ip.fi/DGSP It might be important that I'm using SOLR. After I removed this mail, I could fetch emails again. Kind regards Peter

2 1

Dovecot 2.3.9 fails on FreeBSD
by Pascal Christen 04 Dec '19

04 Dec '19

Hi I've just tried to build the latest Dovecot 2.3.9 on FreeBSD 11.3. Without success...It fails on the following commit which was introduced in 2.3.9: https://github.com/dovecot/core/commit/c85f1bc3ce612c736c9d2c468cc08306db1b… Following output is the build log: https://pastebin.com/3nvSeDn8 So I guess it has to do with some changes FreeBSD made: https://reviews.freebsd.org/D18630 What do you guys think? Greetings Pascal

4 10

dovecot sieve duplicates detection
by André Rodier 04 Dec '19

04 Dec '19

Hello, I have tested the sieve duplicate script with success so far, but I have a question. I would like to know if the "duplicate" sieve flag in Dovecot is global to all folders, or specific to one folder only. For instance, if I copy an email from one folder to another, and I have a discard action on duplicate email, is this action will be applied (in this case, discard) or not. If the duplicate is global to all folders, is there a way to restrict the search in one folder only. Thanks for your help. André

3 10

About "received" header when using Dovecot proxy
by ml＠riku22.net 04 Dec '19

04 Dec '19

Hello. My name is Riku. Currently, I use Dovecot as a proxy for another SMTP server. However, this seems to cause the IP address of the "received" header to be that of the proxy server. Is it possible to change this so that the IP address of the sender is entered? The version of Dovecot is "2.3.8 (9df20d2db)". Sorry for the incomprehensible explanation. Thank you. Best regards.

4 6

Environment variables in pgsql connect string
by Eirik Rye 04 Dec '19

04 Dec '19

Hi, We are trying to set up a Dovecot Docker image with dynamic database configuration based on environment variables, however the variables do not appear to be expanded in the "connect=" string of the SQL config. The documentation states that environment variables, being listed under global variables, work "everywhere": https://doc.dovecot.org/configuration_manual/config_file/config_variables/#… However, the source code for driver-pgsql.c indicates that the connect string is never expanded: https://github.com/dovecot/core/blob/master/src/lib-sql/driver-pgsql.c#L297 For reference, this is my configuration. dovecot.conf: import_environment = PASSDB_USER PASSDB_DBNAME PASSDB_PASSWORD passdb { override_fields = proxy=y driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } /etc/dovecot/dovecot-sql.conf.ext: driver = pgsql connect = host=mail-passdb dbname=%{env:PASSDB_DBNAME} user=%{env:PASSDB_USER} password=%{env:PASSDB_PASSWORD} Does anyone have any suggestions for how to connect to a database without hardcoding the connection parameters in the Dovecot config, which does not involve patching driver-pgsql.c to make the variable expansion? Best regards, Eirik Rye

2 1

some error about dovecot when compile
by Magiczero 04 Dec '19

04 Dec '19

when i build dovecot in my computer, something has occured like below: root@2030c8624e88:/dovecot-2.3.9# ./autogen.sh --2019-12-04 10:49:53-- https://www.dovecot.org/tmp/wiki2-export.tar.gz Resolving www.dovecot.org (www.dovecot.org) 94.237.12.234, 2a04:3545:1000:720:acc1:5bff:fe5e:4e9 Connecting to www.dovecot.org (www.dovecot.org)|94.237.12.234|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 446263 (436K) [application/x-gzip] Saving to: 'wiki2-export.tar.gz' wiki2-export.tar.gz 100%[===============================>] 435.80K 152KB/s in 2.9s 2019-12-04 10:49:59 (152 KB/s) - 'wiki2-export.tar.gz' saved [446263/446263] configure.ac:298: warning: macro 'AM_ICONV' not found in library libtoolize: putting auxiliary files in '.'. libtoolize: copying file './ltmain.sh' libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. libtoolize: copying file 'm4/libtool.m4' libtoolize: copying file 'm4/ltoptions.m4' libtoolize: copying file 'm4/ltsugar.m4' libtoolize: copying file 'm4/ltversion.m4' libtoolize: copying file 'm4/lt~obsolete.m4' configure.ac:298: warning: macro 'AM_ICONV' not found in library configure.ac:22: error: possibly undefined macro: AC_DEFINE If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. configure.ac:127: error: possibly undefined macro: dnl configure.ac:298: error: possibly undefined macro: AM_ICONV configure.ac:429: error: possibly undefined macro: AC_CHECK_HEADER configure:24018: error: possibly undefined macro: AC_CHECK_LIB configure:25593: error: possibly undefined macro: AC_CHECK_FUNC autoreconf: /usr/bin/autoconf failed with exit status: 1 from the information, i think the problem is macro 'AM_ICONV', there are any problem in the setup script? i want you help me to solve this issue. Thank you. Best MagicZero Sent with [ProtonMail](https://protonmail.com) Secure Email.

2 2

Pigeonhole v0.5.9 released
by Aki Tuomi 04 Dec '19

04 Dec '19

Hi all! We are pleased to release v0.5.9 of Pigeonhole. Please find it from locations below --- Aki Tuomi Open-Xchange oy https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.9.ta… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.9.ta… Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot --- + Added events for Sieve and ManageSieve, see https://doc.dovecot.org/admin_manual/list_of_events/#pigeonhole + Pigeonhole: Implement the Sieve "special-use" extension described in RFC 8579. - duplicate: Test only compared the handles which would cause different values to be cached as the same duplicate test. Fix to also compare the actual hashes. - imap_sieve_filter: IMAP FILTER Command had various bugs in error handling. Errors may have been duplicated for each email, errors may have been missing entirely, command tag and ERRORS/WARNINGS parameters were swapped.

1 0

Fast searching from android device with Dovecot/Maildir
by John Gateley 03 Dec '19

03 Dec '19

Hello, I am using dovecot as an imap server, mail is stored in mail directories. Configuration is below. One mail directory has about 14 Gb of mail in the inbox and .Sent directories. Searching from an Android phone with gmail is slow or doesn't work (it times out). Is there a configuration for Dovecot that can improve this? A better e-mail client for Android? Thanks, John root@giraffe:~# dovecot --version 2.2.27 (c0f36b0) root@giraffe:~# doveconf -an # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 ... mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } ... protocols = " imap" ...

3 3

fts_solr and # char
by Marcio Merlone 03 Dec '19

03 Dec '19

Hi, Dovecot wiki says the solr url is something like 'solr/dovecot/' but this gives a 404, if I install solr as per the docs I have a 'solr/#/dovecot/' url: https://wiki.dovecot.org/Plugins/FTS/Solr I have installed dovecot 2.3 from https://repo.dovecot.org/ and solr 8.3 as per the wiki on a Ubuntu 18.04. The problem and the guess work I did: fts_solr = url=http://localhost:8983/solr/#/dovecot/ doveconf: Warning: Configuration file /etc/dovecot/conf.d/90-plugin.conf line 13: Ambiguous '#' character in line, treating it as comment. Add a space before it to remove this warning. fts_solr = url="http://localhost:8983/solr/#/dovecot/" Error: fts: Failed to initialize backend 'solr': fts_solr: Failed to parse HTTP url: Path component contains invalid character fts_solr = url='http://localhost:8983/solr/#/dovecot/' Error: fts: Failed to initialize backend 'solr': fts_solr: Failed to parse HTTP url: Relative HTTP URL not allowed fts_solr = url=http://localhost:8983/solr/%23/dovecot/ Error: Failed to expand plugin setting fts_solr = 'url=http://localhost:8983/solr/%23/dovecot/': Unknown variable '%/' fts_solr = 'url=http://localhost:8983/solr/#/dovecot/' fts_solr: Failed to parse HTTP url: URL fragment not allowed for HTTP URL in this context Thanks for any help. -- *Marcio Merlone=*

2 1

running dovecot under different user
by Marc Roos 02 Dec '19

02 Dec '19

Did anyone ever managed to run dovecot as a non-root user?

2 2

Running dovecot proxy as different user
by Marc Roos 02 Dec '19

02 Dec '19

I thought, I read somewhere I could prevent chroot with[1] but I am still getting chroot errors[2]. drwxrwxr-x 2 10053 101 6 Dec 2 16:54 empty drwxr-x--- 2 10053 101 73 Dec 2 17:00 login drwxr-x--- 2 10053 101 44 Dec 2 17:00 token-login [1] service anvil { chroot = } [2] Dec 2 17:07:07 c04 dovecot: stats: Fatal: chroot(/var/dovecot/empty) failed: Operation not permitted Dec 2 17:07:07 c04 dovecot: master: Error: service(stats): command startup failed, throttling for 16 secs Dec 2 17:07:07 c04 dovecot: pop3-login: Fatal: setgid(101(dovenull)) failed with euid=10053(dovecot), gid=10053(dovecot), egid=10053(dovecot): Operation not permitted (This binary should probably be called with process group set to 101(dovenull) instead of 10053(dovecot)) Dec 2 17:07:07 c04 dovecot: master: Error: service(pop3-login): command startup failed, throttling for 16 secs

1 0

Mail-crypt won't encrypt emails
by Serveria Support 02 Dec '19

02 Dec '19

Hi, (Reposting as my previous post got zero replies.) We're running Dovecot 2.2.36 and we need to set up the mail-crypt plugin to encrypt all incoming and outgoing emails. Outgoing emails seem to get encrypted fine but the incoming ones don't. We tried everything including this config: mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_plugins = $mail_plugins mail_crypt plugin { mail_crypt_global_private_key = <ecprivkey.pem mail_crypt_global_public_key = <ecpubkey.pem mail_crypt_save_version = 2 } also this one: plugin { mail_crypt_curve = prime256v1 mail_crypt_save_version = 2 } but to no avail. There are no visible errors, Dovecot restarts fine and outgoing emails get encrypted. Any ideas? -- Kind Regards, Support Team SERVERIA.COM Riga, LV-1063, Latvia US: +1 (213) 224-7938 LV: + (371) 22330032 Skype: bighostlv support(a)serveria.com www.serveria.com

3 2

Cert for ip range?
by Marc Roos 01 Dec '19

01 Dec '19

Is it possible to configure a network for a cert instead of an ip? Something like this: local 192.0.2.0 { ssl_cert = </etc/ssl/dovecot/imap-02.example.com.cert.pem ssl_key = </etc/ssl/dovecot/imap-02.example.com.key.pem } Or local 192.0.2.0/24 { ssl_cert = </etc/ssl/dovecot/imap-02.example.com.cert.pem ssl_key = </etc/ssl/dovecot/imap-02.example.com.key.pem } https://wiki.dovecot.org/SSL/DovecotConfiguration

3 5

Error: proxy: Remote returned invalid banner: 220
by Marc Roos 01 Dec '19

01 Dec '19

I had a working proxy setup added sieve to it, and out of the blue I get this Error: proxy: Remote returned invalid banner: 220 No idea what to do, nothing even in the mail list archive

2 3

dovecot: auth: Error: DNS lookup for xxx failed: Name does not resolve
by Marc Roos 01 Dec '19

01 Dec '19

I had a working container with dovecot configured as proxy. And all of a sudden I am getting these messages 'dovecot: auth: Error: DNS lookup for roosit03 failed: Name does not resolve' Pinging/nslookup these hostnames is ok

2 3

Proxy GSSAPI + PLAIN authentication
by Sam 30 Nov '19

30 Nov '19

Hi, I try to configure a proxy accepting GSSAPI and PLAIN authentication. When authenticating with Kerberos, Dovecot uses master user and password to authenticate to backends (backends can be Cyrus or Exchange servers too) When authenticating with PLAIN passwords, Dovecot sends user's login and password to the backend. For GSSAPI, I use extrafields : k5principals=principal@REALM proxy=Y pass=masterpassword login_user=principal user=masteruser host=backend For PLAIN, I use a static driver : passdb { driver = static args = proxy=y host=cyrus password=%w } I can authenticate fine with Kerberos tickets and login/password on the backend. Trouble is that if I authenticate with PLAIN login/password, with a user known from the passdb lookup made for GSSAPI, I can authenticate with any password, it is not checked. The passdb with masteruser and nopassword=y is checked. I can't restrict the passdb with the k5principals extrafield. I tried static and ldap drivers, with the same wrong behaviour. pass_attrs = \ =proxy=Y, \ =nopassword=Y, \ =pass=masterpassword, \ =login_user=%{ldap:uid}, \ =user=masteruser, \ =host=backend, \ =k5principals=%{ldap:uid}@REALM With the ldap driver, I've got auth_bind = no The user is found in the ldap, and Dovecot logs him with the masterpassword. If I don't configure an ldap passdb, but a userdb only, the proxy try passdb that comes after for PLAIN logins. With a passwd-file driver, the k5principals works fine. The user isn't found if it authenticates with PLAIN. My question is : is it possible to restrict a ldap or static passdb for GSSAPI mechanism only ? Thanks for your help, Regards, Sam

2 2

ESEARCH is announced but it doesn't work
by Jesus Cea 29 Nov '19

29 Nov '19

I am using Dovecot 2.3.4. I could upgrade if necessary. I see this capabilities after login in: """ a OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY LITERAL+ NOTIFY SPECIAL-USE] Logged in """ ESEARCH (RFC 7377) seems to be available, but the command is not recognized: """ tag1 ESEARCH IN (mailboxes "folder1" subtree "folder2") unseen tag1 BAD Error in IMAP command ESEARCH: Unknown command (0.001 + 0.000 secs). """ What am I doing wrong? Thanks for your time and expertise. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

2 2

sendmail -> lmtp 501 5.6.0 Data format error
by Marc Roos 29 Nov '19

29 Nov '19

When changing in a working setup sendmail.mc From this MAILER(smtp)dnl MAILER(procmail)dnl To this FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl MAILER(local)dnl I am getting these errors '501 5.6.0 Data format error' and ' Unrecognized host name'. What should I change in my lmtp config? Could this be related that messages are being relayed from other servers? lmtp_address_translate = lmtp_hdr_delivery_address = final lmtp_proxy = no lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lmtp_user_concurrency_limit = 0

2 3

Using dovecot Replication in a medium to large enterprise.
by Brent Clark 28 Nov '19

28 Nov '19

Good day Guys Just wanted to pick the communities brain and experience(s) for a second. At $CORP where I work. My team has inherited a single server mail solution. We need to look to building a standby / replicated solution. One of the things we were looking at is https://wiki.dovecot.org/Replication We have in excess of +/- 500 mail boxes and using just under 1TB of disk space. That is a lot of small files. Reading about this plugin / module, things that stick out and is concerning is the comments: "The replication in general is a bit resource intensive, so it's not recommended to be used in multi-million user installations." "WARNING: Shared folder replication doesn't work correctly right now –" I would like to ask the community (and anyone else in a similar enterprise) how and if this solution works and scales. In short, I am asking, is anyone else using Dovecot Replication in a medium to large enterprise? Can you please share your experiences, pitfalls and if you have any tips managing mail replication. Kindest regards and thanks in advance. Brent Clark

4 3

IMAP Migration Tools
by Julian Kippels 28 Nov '19

28 Nov '19

Hi, I am looking for tools to migrate Mails from one IMAP-Server to another. Until now I have always used imapsync, but it seems very slow. Even over a 2x10GB/s connection I only get speeds of about 600KiB/s, because the programm always pauses betweeen every single mail. Does anyone here have a suggestion for an alternative? Thanks in advance Julian

6 5

Sendmail + lmtp
by Marc Roos 28 Nov '19

28 Nov '19

Is there any guide like this https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP for configuring sendmail?

1 0

Dovecot auth
by j.emerlik 27 Nov '19

27 Nov '19

Hi, is possible to configure post-login script for Service auth ? I would like to run post script after successful login to postfix (smtp). Regards, Jack

2 1

Dovecot FINs after sending "NO Not showing other users' quota"
by Gene Smith 27 Nov '19

27 Nov '19

When I do imap getquota on a shared folder I see the NO response. That's OK but then often dovecot disconnects (sends FIN) to the client right after this. The client acks the disconnect and creates a new connection and continues on. Should dovecot disconnect after this type of imap "NO" response? -gene

2 1

Performance mdbox vs mbox
by Marc Roos 26 Nov '19

26 Nov '19

If I do the same test[1] with mbox I can store around 31k messages and mdbox 16k messages. I noticed also that cpu and disk utilization with mdbox was not very high, while disk utilization on mbox was much higher. That makes me wonder if I can tune mdbox to have better performance? [1] imaptest - append=100,0 logout=0 host=svr port=143 user=test pass=xxx seed=100 secs=240 clients=1 mbox=64kb.mbox box=inbox/test [2] mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u:CONTROL=~/mail/control:INDEX=/var/d ovecot/%u/index:LAYOUT=maildir++ mail_location = mdbox:~/mdbox:INDEX=/home/popindex/%u/index - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. F1 Outsourcing Development Sp. z o.o. Poland t: +48 (0)124466845 f: +48 (0)124466843 e: marc(a)f1-outsourcing.eu

2 1

Dovecot Master User: Access user's mailbox without owner's password
by Dav Rdrz 26 Nov '19

26 Nov '19

Hi, I hope you're all right. I describe below the scenario where the problem occurs. I'm trying to activate a master user [1] to be able to access all the boxes of all users by imap. I have configured the dovecot-master-users [2] file with the appropriate permissions. When I try to access, for example with roundcube, through user@mydomain.com*my_master_user@not-exist.com I see in the log, that it seems to ignore the master-user (*) and tries to authenticate the Active Directory but with the master user's password. Then it shows in the log the messages auth: Info: ldap(user(a)mydomain.com,127.0.0.1,<6sFGXE6XLwB/AAAB> ) invalid credentials auth: Debug: client passdb out: FAIL 1 user=user(a)mydomain.com I have other test cases, but I need to validate the master user login that way. I would appreciate any comments you can make and I am waiting to answer any questions. Regards, [1] https://doc.dovecot.org/configuration_manual/authentication/master_users/ [2] https://docs.iredmail.org/dovecot.master.user.html --------------------------------------------------------------------------------------- root@mail-01:/etc/dovecot# cat /etc/issue Ubuntu 14.04.5 LTS \n \l root@mail-01:/etc/dovecot# dpkg -l | grep dovecot | awk {'print $2" "$3'} dovecot-core 1:2.2.9-1ubuntu2.6 dovecot-imapd 1:2.2.9-1ubuntu2.6 dovecot-ldap 1:2.2.9-1ubuntu2.6 dovecot-lmtpd 1:2.2.9-1ubuntu2.6 dovecot-managesieved 1:2.2.9-1ubuntu2.6 dovecot-mysql 1:2.2.9-1ubuntu2.6 dovecot-pop3d 1:2.2.9-1ubuntu2.6 dovecot-sieve 1:2.2.9-1ubuntu2.6 root@mail-01:/etc/dovecot# cat dovecot.conf | grep -v '#' | grep -v -e '^$' | sed "s/REALDOMAIN/mydomain/g" listen = * [::] mail_plugins = quota mailbox_alias acl protocols = pop3 imap sieve lmtp mail_uid = 2000 mail_gid = 2000 first_valid_uid = 2000 last_valid_uid = 2000 log_path = /var/log/dovecot.log auth_verbose = yes auth_debug = yes ssl_protocols = !SSLv2 !SSLv3 ssl = required verbose_ssl = no ssl_ca = </etc/ssl/certs/mydomain.com.ca-bundle ssl_cert = </etc/ssl/certs/mydomain.com.crt ssl_key = </etc/ssl/private/mydomain.com.key ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:ECDHE-RSA-DES-CBC3-SHA:ECDHE-ECDSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_prefer_server_ciphers = yes disable_plaintext_auth = no mail_location = maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/ auth_default_realm = mydomain.com auth_mechanisms = PLAIN LOGIN service auth { unix_listener /var/spool/postfix/private/dovecot-auth { user = postfix group = postfix mode = 0666 } unix_listener auth-master { user = vmail group = vmail mode = 0666 } unix_listener auth-userdb { user = vmail group = vmail mode = 0660 } } service lmtp { user = vmail process_min_avail = 5 executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { user = postfix group = postfix mode = 0600 } inet_listener lmtp { address = 127.0.0.1 port = 24 } } auth_master_user_separator = * passdb { driver = passwd-file args = /etc/dovecot/dovecot-master-users master = yes } userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { auth_socket_path = /var/run/dovecot/auth-master quota = dict:user::proxy::quotadict quota_rule = *:storage=3G quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_grace = 10%% acl = vfile acl_shared_dict = proxy::acl sieve_dir = %Lh/sieve sieve = %Lh/sieve/dovecot.sieve sieve_global_dir = /var/vmail/sieve sieve_before = /var/vmail/sieve/dovecot.sieve mailbox_alias_old = Sent mailbox_alias_new = Sent Messages mailbox_alias_old2 = Sent mailbox_alias_new2 = Sent Items } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { user = vmail group = vmail mode = 0660 } } service dict { unix_listener dict { mode = 0660 user = vmail group = vmail } } dict { quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf acl = mysql:/etc/dovecot/dovecot-share-folder.conf } protocol lda { mail_plugins = $mail_plugins sieve auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-sieve.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes postmaster_address = it(a)mydomain.com } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = quota sieve postmaster_address = postmaster lmtp_save_to_detail_mailbox = yes recipient_delimiter = + } protocol imap { mail_plugins = $mail_plugins imap_quota imap_acl imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 } protocol pop3 { mail_plugins = $mail_plugins pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv mail_max_userip_connections = 30 } service imap-login { service_count = 1 process_limit = 500 } service pop3-login { service_count = 1 } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } namespace { type = private separator = / prefix = inbox = yes mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Trash { auto = subscribe special_use = \Trash } mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Spam { auto = no special_use = \Junk } mailbox "Junk E-mail" { auto = no special_use = \Junk } mailbox Archive { auto = subscribe special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } } namespace { type = shared separator = / prefix = Shared/%%u/ location = maildir:%%Lh/Maildir/:INDEX=%%Lh/Maildir/Shared/%%u subscriptions = yes list = children } root@mail-01:/etc/dovecot# cat dovecot-ldap.conf | sed "s/realdomain/mydomain/g" hosts = active-directory:389 ldap_version = 3 auth_bind = yes dn = domain\vmail dnpass = Str0ngP4ssw0rd base = ou=Organizational Unit,dc=domain,dc=com scope = subtree deref = never user_filter = (&(userPrincipalName=%n@domain.com)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_filter = (&(userPrincipalName=%n@domain.com)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) #user_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) #pass_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_attrs = userPassword=password default_pass_scheme = CRYPT user_attrs = \ #=mail=master_user, \ #mail=user, \ =user=%Ln(a)mydomain.com, \ =home=/var/vmail/vmail1/mydomain.com/%Ln/Maildir/, \ =mail=maildir:/var/vmail/vmail1/mydomain.com/%Ln/Maildir/, \ maxStorage=quota_rule=*:bytes=%$ root@mail-01:/etc/dovecot# ls -al dovecot-master-users -r-x------ 1 dovecot dovecot 120 Nov 13 14:45 dovecot-master-users

3 3

Shared Mailboxes
by Yousif Alkhateeb 26 Nov '19

26 Nov '19

Hello, I have a mail server linked to Freeipa server, so all users are UNIX users. i want to share the inbox of one user to another, but i can't figure it out how to do it. this is my dovecot -n output # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.8 (b7b03ba2) # OS: Linux 3.10.0-957.21.3.el7.x86_64 x86_64 CentOS Linux release 7.6.1810 (Core) xfs # Hostname: mail.yousifrrr.com doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem auth_default_realm = YOUSIFRR.COM auth_username_format = %n auth_worker_max_count = 60 default_client_limit = 10000 default_process_limit = 1500 disable_plaintext_auth = no first_valid_uid = 1000 login_trusted_networks = 10.1.5.0/24 mail_access_groups = sharedusers mail_location = maildir:/MailUsers/%u mail_plugins = acl mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl metric imap_select_no { event_name = imap_command_finished fields = name filter { name = SELECT tagged_reply_state = NO } } namespace { list = yes location = maildir:/MailUsers/%u:INDEXPVT=/Mailusers/%u/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { driver = pam } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db sieve = /MailUsers/%u/default.sieve sieve_before = /etc/dovecot/default.sieve sieve_default = /etc/dovecot/sieve/default.sieve sieve_dir = /MailUsers/%u/sieve/ sieve_global_dir = /etc/dovecot/default.sieve } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh protocols = imap pop3 lmtp sieve service dict { unix_listener dict { group = dovecot mode = 01402 user = dovecot } } service imap-login { inet_listener imap { port = 143 } } service imap { vsz_limit = 512 M } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { inet_listener pop3 { port = 0 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_plugins = acl imap_acl } the shared folder is not appearing in the users mailboxes. can you please help figure out why it's not working. Thanks in advance.

1 0

Health check curl example
by Marc Roos 25 Nov '19

25 Nov '19

I am not understanding how this health check[1] script should work. From the commandline it works fine when I type a PING I get a PONG. But how do I do a curl to this 5001 port? Tried something like this: bash-5.0# curl http://localhost:5001/ curl: (56) Recv failure: Connection reset by peer bash-5.0# curl http://localhost:5001/PING curl: (56) Recv failure: Connection reset by peer [1] https://doc.dovecot.org/admin_manual/health_check/

3 11