- dovecot - dovecot.org

Released Pigeonhole v0.4.22 for Dovecot v2.2.34.
by Stephan Bosch 01 Mar '18

01 Mar '18

Hello Dovecot users, Here is a new Pigeonhole release that goes with the new Dovecot v2.2.34 release. This release is not strictly necessary, as previous versions should be usable as well. This release only contains bugfixes. Changelog v0.4.22: - Fixed filesystem path handling problem: sieve plugin could have assert-crashed with specific path lengths with: "Panic: file realpath.c: line 86 (path_normalize): assertion failed: (npath_pos + 1 < npath + asize)". - Sieve extprograms plugin: Large output from "execute" command crashed delivery. Fixed buffering issue in code that handles output from the external program. - editheader extension: Extensively reworked the low-level implementation of adding and removing headers. This solves a few integer arithmetic problems reported by Clang runtime checks, but also improves code structure and reliability in general. - imapsieve: Fix assert crash occurring when selected messages are expunged concurrently by the time Sieve filter is to be applied. - imap4flags extension: Fix binary byte-code corruption occurring when the setflag, addflag, or removeflag command's flag-list is a variable. - enotify extension: mailto method: Fixed parsing of mailto URI with only a header part. - enotify extension: mailto method: Make sure "From:" header is set to a usable address and not "(null)". - Fixed writing address headers to outgoing messages. It sometimes erroneously applied another layer of MIME header encoding. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.22.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.22.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

question about quota setting with postfix and dovecot
by Masaharu Kawada 01 Mar '18

01 Mar '18

Dear dovecot-list, I have questions regarding setting up quota with postfix(Maildir format)+ dovect. My main point of the question is to know how the user password is used in quota in this case. Please see the below configuration info and my questions are in the bottom. Here are what have been done: <Postfix side configuration> /etc/postfix/main.cf: ----- myhostname = mail.example.com mydomain = example.com myorigin = $mydomain inet_interfaces = all mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain home_mailbox = Maildir/ mailbox_command = /usr/libexec/dovecot/dovecot-lda -f "$SENDER" -a "$RECIPIENT" -d "$USER" <--Add ----- <Dovecot side configuration> 1. /etc/dovecot/conf.d/10-auth.conf: #!include auth-system.conf.ext #!include auth-sql.conf.ext #!include auth-ldap.conf.ext !include auth-passwdfile.conf.ext <---Only enabled #!include auth-checkpassword.conf.ext #!include auth-vpopmail.conf.ext #!include auth-static.conf.ext 2. /etc/dovecot/conf.d/10-master.conf service auth { snip/ unix_listener auth-userdb { mode = 0666 <---The permission for userdb 666 #user = #group = snip/ 3. /etc/dovecot/conf.d/10-mail.conf: mail_location = maildir:~/Maildir snip/ mail_plugins = $mail_plugins quota <---set the plugin snip/ 4. /etc/dovecot/conf.d/15-lda.conf: snip/ postmaster_address = root(a)example.com <---Add postmaster snip/ protocol lda { mail_plugins = $mail_plugins <--set the plugin } 5. /etc/dovecot/conf.d/20-imap.conf: protocol imap { mail_plugins = $mail_plugins imap_quota <--set the plugin snip/ 6. /etc/dovecot/conf.d/20-pop3.conf: snip/ protocol pop3 { mail_plugins = $mail_plugins quota <--set the plugin snip/ 7. /etc/dovecot/conf.d/90-quota.conf: plugin { <--set global quota quota = maildir:<User quota> quota_rule = *:storage=100M quota_rule2 = Trash:storage=+100M } 8. /etc/dovecot/conf.d/auth-passwdfile.conf.ext: snip/ passdb { driver = passwd-file args = scheme=CRYPT username_format=%u /etc/dovecot/users <--Path for passwdfile } userdb { driver = passwd-file args = username_format=%u /etc/dovecot/users } snip/ 9. /etc/dovecot/users: test004:{SSHA256}hFxB8tbyZrCCcwZKDaQEiUfojbRovOq8ECU0syPHQTCY0233:18222:18222::/home/test004::userdb_quota_rule=*:storage=1M test005:{SSHA256}hFxB8tbyZrCCcwZKDaQEiUfojbRovOq8ECU0syPHQTCY0233:18223:18223::/home/test005::userdb_quota_rule=*:storage=1M test006:{SSHA256}hFxB8tbyZrCCcwZKDaQEiUfojbRovOq8ECU0syPHQTCY0233:18224:18224::/home/test006::userdb_quota_rule=*:storage=1M Note:The hashed password is created running the blow command: # doveadm pw -s ssha256 10. /etc/dovecot/dovecot.conf: snip/ protocols = imap pop3 <--Available protocols snip/ 11. # service postfix restart # service dovcot restart Question: 1./etc/dovecot/users is supposed to be seen instead of /etc/passwd for authentification of imap and pops in receiving emails, isn't it? 2.If the answer for above question 1 is 'YES', then doesn't it require to get all password in /etc/passwd hashed for each user and place all of them into /etc/dovecot/users? 3.If the answer for above question 1 is 'NO', then what the hashed-password in /etc/dovcot/users such as {SSHA256}hFX... used for? Excuse me if those are silly questions, but I am not a dovecot person and would very much appreciate it if anyone would kindly give me a hand on this. Regards, Masaharu Kawada

1 0

Using virtual folders with younger and index files
by Rob Hoelz 01 Mar '18

01 Mar '18

Hi list, I just encountered a problem while using dovecot's Virtual plugin with 2.3.0. I managed to solve the issue, but I wanted to bring it to the attention of others on the list to see if there exists a better solution, if I found a bug, or if it's just a matter of updating documentation. I have a virtual folder to get the most recent two weeks of mails; it looks something like this: > INBOX > all younger 1209600 I made this folder back in October. Lately, I started to notice that the virtual folder had a surprising amount of mail in it - I don't get 1,000 e-mails per week! After some doveadm commands, I realized that e-mails from October were still present in my virtual folder! Updating the dovecot-virtual would clear away e-mails older than two weeks (I needed to actually introduce a change, even if it was just whitespace - just touching the file didn't update things), and removing the dovecot index file also cleared things away. In then end, I ended up just telling dovecot to disable on-disk indexes for that folder. I created this folder based on the examples on https://wiki.dovecot.org/Plugins/Virtual - I'm wondering if I found a bug or if that page should be changed to recommend disabling on-disk indexes when using certain search query filters such as "younger". If the latter, I can always make the change - just let me know! -Rob

2 2

v2.3.0.1 released
by Timo Sirainen 28 Feb '18

28 Feb '18

https://dovecot.org/releases/2.3/dovecot-2.3.0.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.0.1.tar.gz.sig Small patch release to fix the worst bugs in v2.3.0. v2.3.1 is coming in about a month with a lot more changes. * CVE-2017-15130: TLS SNI config lookups may lead to excessive memory usage, causing imap-login/pop3-login VSZ limit to be reached and the process restarted. This happens only if Dovecot config has local_name { } or local { } configuration blocks and attacker uses randomly generated SNI servernames. * CVE-2017-14461: Parsing invalid email addresses may cause a crash or leak memory contents to attacker. For example, these memory contents might contain parts of an email from another user if the same imap process is reused for multiple users. First discovered by Aleksandar Nikolic of Cisco Talos. Independently also discovered by "flxflndy" via HackerOne. * CVE-2017-15132: Aborted SASL authentication leaks memory in login process. * Linux: Core dumping is no longer enabled by default via PR_SET_DUMPABLE, because this may allow attackers to bypass chroot/group restrictions. Found by cPanel Security Team. Nowadays core dumps can be safely enabled by using "sysctl -w fs.suid_dumpable=2". If the old behaviour is wanted, it can still be enabled by setting: import_environment=$import_environment PR_SET_DUMPABLE=1 - imap-login with SSL/TLS connections may end up in infinite loop

1 0

Re: Quota status to postfix in distributed environment (Karol Augustin)
by SAAHIL IFTEKHAR 28 Feb '18

28 Feb '18

Hi Karol Thanks for taking time to go through the email and replying. I'll rewrite the issue again --> For example consider there two nodes. These each having their postfix and dovecot. I am trying to implement quota status to postfix to both the below cases:- case 1) mail sent within the node case 2) mail sent across the nodes In case 1 the postfix will query the dovecot of same node white in case 2 it will query the dovecot of other node. But suppose I am sending mail within the node and dovecot in other node is down. Mail will not go within the node. Even it will not defer also. This is evident from the logs(in last sections). I'll try to work suggestions you have given in mysetup though and post the relevant output. But if you have any other suggestion regarding what i have wrote just now. please let me know. Regards On 28-Feb-2018 5:19 am, <dovecot-request(a)dovecot.org> wrote: Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit https://dovecot.org/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." Today's Topics: 1. Re: Quota status to postfix in distributed environment (@lbutlr) (SAAHIL IFTEKHAR) 2. Re: Quota status to postfix in distributed environment (Karol Augustin) 3. Re: Quota status to postfix in distributed environment (LuKreme) 4. Re: Quota status to postfix in distributed environment (Karol Augustin) ---------------------------------------------------------------------- Message: 1 Date: Tue, 27 Feb 2018 19:29:44 +0530 From: SAAHIL IFTEKHAR <response2saahil(a)gmail.com> To: dovecot(a)dovecot.org Subject: Re: Quota status to postfix in distributed environment (@lbutlr) Message-ID: <CAM5TiAQ2CT+u_BKEn0sKonirOQLD_Q0v=pVCcJBCiJfC08p7Mw(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi Actually, the requirement is such that we have to work with this version only. I want to point out that the reason from the problem can be found out from logs(the end section). The "check_policy_service" in main.cf of postfix is the problem according to me. This configuration as a part of quota staus to postfix configuration. I hope many have went through this scenario or similar. So I am hoping to get some help for the same. Regards ------------------------------ Message: 2 Date: Tue, 27 Feb 2018 14:18:31 +0000 From: Karol Augustin <karol(a)augustin.pl> To: dovecot(a)dovecot.org Subject: Re: Quota status to postfix in distributed environment Message-ID: <b50c30e1b65c3875565ca2e49efeaafd(a)augustin.pl> Content-Type: text/plain; charset=US-ASCII On 2018-02-26 16:28, SAAHIL IFTEKHAR wrote: > Hi > > I have implemented Quota status to postfix in our setup. I have an imap server (dovecot) and mail server (postfix) in every node. I am able to send quota status to postfix and mails are rejected after 100% mail quota is crossed. This rejection is happening both in across the nodes and within the nodes. > > The problem is if I am sending mails to any node and if any other node's dovecot is down, mails are not going. For example, I am sending an email within the system but if some other node's dovecot is down then email within the system also will not go. > > My dovecot version is 2.2.10. My postfix version is 2.1.10. > > doveconf -n output is below:- > [snap] > > Here "service quota status" is the concerned section in conf file. > ____________________________________________________________ ____________________________________________ > > Postfix configuration is below:- > smtpd_relay_restrictions = > check_policy_service inet:201.123.80.9:54317 > check_policy_service inet:201.123.80.23:54317 > > virtual_transport=lmtp:unix:private/dovecot-lmtp > > Here, I am querying both two nodes. 201.123.80.9 is the other node. 201.123.80.23 is the node within which, email is sent. > ____________________________________________________________ _______________________________________________ > > logs while sending mail is below:- > [snap] > > I am understanding what the logs are trying to say. But I am not able to resolve the issue even after searching solution on internet and trying different hit and trials by myself. I want that if i am sending email to any node or within node, the configuration relating to "check _policy_service" for other node does not interfere and mail goes properly. At the same time I can also fetch quota status from other nodes. > > If I can get any help regarding this it will be really appreciable as I have tried a lot of options already. > Your problem is that if the dovecot is unreachable Postfix can't check the quota for the user. http://www.postfix.org/SMTPD_POLICY_README.html explains how to resolve this problem: smtpd_policy_service_default_action (default: 451 4.3.5 Server configuration problem): The default action when an SMTPD policy service request fails. Available with Postfix 3.0 and later. The default action when an SMTPD policy service request fails. Specify "DUNNO" to behave as if the failed SMTPD policy service request was not sent, and to continue processing other access restrictions, if any. You can configure it per policy also. The issue you might encounter with this setup is that if both of your dovecot nodes are unreachable Postfix will accept the e-mail and try to deliver it. When the nodes come online it will fail if the user is over quota and generate bounce to the envelope sender of the message, which might produce backscatter. I resolved this problem by keeping quota information in Mysql table and using custom policy server to check if user is allowed to receive more e-mail. Also this approach might not work with aliases and other redirections, the e-mail address checked by smtpd policy is the one before alias expansion. You should check if it suits your environment. Best, Karol -- Karol Augustin karol(a)augustin.pl http://karolaugustin.pl/ +353 85 775 5312

1 0

compile-error on pigeonhole
by Jakobus Schürz 28 Feb '18

28 Feb '18

Hi! I try to compile pigeonhole from git-sources and get this error: libtool: link: gcc -std=gnu99 -g -O2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strfti me -Wstrict-aliasing=2 -I../.. -pie -Wl,-z -Wl,relro -Wl,-z -Wl,now -o .libs/sievec sievec-sievec.o -Wl,--export-dynamic ../../src/lib-sieve/.libs/libdovecot-sieve.so ../../src/lib-sieve-tool/.libs/libsieve-tool.a /usr/local/lib/dovecot /libdovecot-storage.so /usr/local/lib/dovecot/libdovecot-lda.so -L/usr/local/lib/dovecot /usr/local/lib/dovecot/libdovecot.so -Wl,-rpath -Wl,/usr/local/lib/dovecot ../../src/lib-sieve/.libs/libdovecot-sieve.so: undefined reference to `array_idx_get_space' collect2: error: ld returned 1 exit status I'm not able to compile pigeonhole. Jakob

2 1

dovecot.index.pvt reset, view is now inconsistent
by Rupert Gallagher 28 Feb '18

28 Feb '18

Problem solved by going in manually. The log message appears for empty "public" folders. Say, you have a folder X with subfolder Y, where X does not contain any e-mail. The log message disappears if you drop an email into X, then remove it. Puf, gone! So, there seems to be a baby bug in how dovecot manages the index in this case.

3 2

BUG: Error: dovecot.index.pvt reset, view is now inconsistent when shared folder is new and empty
by Marco Giunta 28 Feb '18

28 Feb '18

Hi, I'm using Dovecot 2.2.33.2 on a RHEL 7, new installation. My log is full of : Error: INDEX_FOLDER/dovecot.index.pvt reset, view is now inconsistent or Error: INDEX_FOLDER/dovecot.index.pvt view is inconsistent when shared folder is never touched and empty. UserA share XXXXX folder with UserB, if XXXXX folder is new (never touched) and empty every time UserB looks in that folder, an error appears in log file. If UserA copy a mail in XXXXX folder, no more errors. If UserA (or UserB) delete all mails in XXXXX folder (the folder is empty again), no more errors. So the errors appear when UserB access a new (never touched) shared empty folder; if the folder is empty, but not new (p.e. UserA has already copied and deleted mails in that folder) error is logged only once. Attached my configuration. Thanks, Marco -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244

1 0

Out of memory on lmtp vsz_limit
by Terence Lau 28 Feb '18

28 Feb '18

Hi, We've been getting these types or errors for quite a while now ... Fatal: master: service(lmtp): child 63477 returned error 83 (Out of memory (service lmtp { vsz_limit=4096 MB }, you may need to increase it) ... and these errors have been decreasing in occurrence as we increased the default_vsz_limit. Which is good but I would like to get some advice on how I could possibly eliminate the errors. We have an internal smtp server (postfix 3.1.0) that has the config "always_bcc=archive(a)company.com" over lmtp. This mailbox is on a separate dovecot server with the following config (please let me know if the full config is required): # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-109-generic x86_64 Ubuntu 16.04.1 LTS ext4 default_vsz_limit = 4 G mail_location = maildir:/home/vmail/%d/%n protocols = " imap lmtp pop3" service lmtp { inet_listener lmtp { port = 24 } } userdb { args = username_format=%u /etc/dovecot/users default_fields = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = passwd-file } protocol lmtp { mail_plugins = } Since we discovered the errors, we've been increasing the default_vsz_limit to 1G, then 2G and now 4G (Server has 6GB of memory). These errors occur whenever a large number of emails get sent around the same time to our smtp server. This causes the dovecot server to start crunching CPU and Memory. Load average goes through the roof and takes some time to come back down as the smtp queue clears itself. This mailbox is obviously very large but we have a script that runs daily to delete any emails older than a month: find /home/vmail/company.com/archive/new/ -type f -mtime +30 -exec rm {} \; find /home/vmail/company.com/archive/cur/ -type f -mtime +30 -exec rm {} \; Still, the mailbox has on average of just under 300,000 emails. No one accesses this mailbox with an email client, not until we need to dig something up. And this has only happen once. So the emails pretty much never get read/process by a user. Now that we've increased the default_vsz_limit to 4G, the occurrence of these errors has reduced considerably. But they still happen occasionally. Short of increasing the memory further, are there any other options I have? Thanks. [https://www.royhill.com.au/email/Emalisignaturecurrent.jpg]

2 3

use IMAP and POP3 simultaneously (single inbox)
by Stanislaw Findeisen 28 Feb '18

28 Feb '18

Hi Is it safe to use IMAP and POP3 simultaneously to access the same inbox (using Maildir structure)? Thanks! Stanisław

2 1

Quota status to postfix in distributed environment
by SAAHIL IFTEKHAR 27 Feb '18

27 Feb '18

Hi I have implemented Quota status to postfix in our setup. I have an imap server (dovecot) and mail server (postfix) in every node. I am able to send quota status to postfix and mails are rejected after 100% mail quota is crossed. This rejection is happening both in across the nodes and within the nodes. The problem is if I am sending mails to any node and if any other node's dovecot is down, mails are not going. For example, I am sending an email within the system but if some other node's dovecot is down then email within the system also will not go. My dovecot version is 2.2.10. My postfix version is 2.1.10. *doveconf -n output is below:-* # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.3 (Maipo) xfs auth_debug = yes base_dir = /var/run/dovecot/ first_valid_gid = 5000 first_valid_uid = 5000 hostname = CmdHQ login_greeting = ^^^^^^^^^^Dovecot ready^^^^^^^^^^ mail_debug = yes mail_gid = 6000 mail_location = Maildir:/var/mail/vmail/tcs.mil.in/%n mail_plugins = " quota" mail_uid = 6000 mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=8KB quota_rule2 = *:messages=12B quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota / mailbox is full quota_status_success = DUNNO quota_warning = storage=80%% quota-warning 80 %u } postmaster_address = postmaster(a)tcs.mil.in service auth { unix_listener auth-userdb { mode = 0600 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 54317 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = postfix mode = 0666 user = postfix } user = postfix } ssl = required ssl_ca = </etc/dovecot/certs/cacert.pem ssl_cert = </etc/dovecot/certs/1CorpHQ_IMAP_Admin(a)tcs.mil.in.pem ssl_key = </etc/dovecot/certs/1CorpHQ_IMAP_Admin(a)tcs.mil.in.key userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } verbose_ssl = yes protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = " quota" } protocol lda { info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " quota" } protocol imap { mail_plugins = " quota" } Here "service quota status" is the concerned section in conf file. ________________________________________________________________________________________________________ *Postfix configuration is below:- * smtpd_relay_restrictions = check_policy_service inet:201.123.80.9:54317 check_policy_service inet:201.123.80.23:54317 virtual_transport=lmtp:unix:private/dovecot-lmtp Here, I am querying both two nodes. 201.123.80.9 is the other node. 201.123.80.23 is the node within which, email is sent. ___________________________________________________________________________________________________________ *logs while sending mail is below:-F*eb 22 12:43:24 1CorpHQ postfix/proxymap[7327]: In dict_changed_name Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: initializing the server-side TLS engine Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: In dict_changed_name Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 1CorpHQ: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 201.123.80.23: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 1CorpHQ: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 201.123.80.23: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 220 1CorpHQserver.tcs.mil.in ESMTP Postfix Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text EHLO 1CorpHQ Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 1CorpHQ: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 201.123.80.23: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-1CorpHQserver.tcs.mil.in Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-PIPELINING Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-SIZE 10240000 Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-VRFY Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-ETRN Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-STARTTLS Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-ENHANCEDSTATUSCODES Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-8BITMIME Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250 DSN Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text STARTTLS Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 220 2.0.0 Ready to start TLS Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: setting up TLS connection from 1CorpHQ[201.123.80.23] Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: 1CorpHQ[201.123.80.23]: TLS cipher list "aNULL:-aNULL:ALL:!EXPORT:!LOW:+RC4:@STRENGTH" Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:before/accept initialization Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 read client hello A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 write server hello A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 write certificate A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 write key exchange A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 write server done A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 flush data Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 read client key exchange A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 read finished A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 write change cipher spec A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 write finished A Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: SSL_accept:SSLv3 flush data Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: Anonymous TLS connection established from 1corphq[201.123.80.23]: TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits) Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text EHLO 1CorpHQ Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 1CorpHQ: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: 201.123.80.23: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-1CorpHQserver.tcs.mil.in Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-PIPELINING Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-SIZE 10240000 Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-VRFY Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-ETRN Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-ENHANCEDSTATUSCODES Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250-8BITMIME Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250 DSN Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text MAIL FROM:< Cdr.1CorpHQ(a)tcs.mil.in> Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: transport_maps: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: transport_maps: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: In dict_changed_name Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: In valid verify sender addr Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text 250 2.1.0 Ok Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: text RCPT TO:< CO.1CorpHQ(a)tcs.mil.in> Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/trivial-rewrite[7330]: match_list_match: tcs.mil.in: no match Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: In valid verify sender addr Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: match_list_match: permit_mynetworks: no match Feb 22 12:43:24 1CorpHQ dovecot: quota-status: Debug: Loading modules from directory: /usr/lib64/dovecot Feb 22 12:43:24 1CorpHQ dovecot: quota-status: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: master in: USER#0111# 011CO.1CorpHQ(a)tcs.mil.in#011service=quota-status Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: ldap(co.1corphq(a)tcs.mil.in): user search: base=dc=tcs,dc=mil,dc=in scope=subtree filter=(&(objectClass=person)(uid=co.1corphq)) fields=homeDirectory,uidNumber,gidNumber Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: ldap(co.1corphq(a)tcs.mil.in): no fields returned by the server Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: ldap(co.1corphq(a)tcs.mil.in): result: homeDirectory missing; uidNumber missing; gidNumber missing Feb 22 12:43:24 1CorpHQ dovecot: auth: Debug: userdb out: USER#0111# 011co.1corphq(a)tcs.mil.in Feb 22 12:43:24 1CorpHQ dovecot: quota-status: Debug: auth input: co.1corphq(a)tcs.mil.in Feb 22 12:43:24 1CorpHQ dovecot: quota-status: Debug: changed username to co.1corphq(a)tcs.mil.in Feb 22 12:43:24 1CorpHQ dovecot: quota-status: Debug: Added userdb setting: plugin/=yes Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: Effective uid=6000, gid=6000, home= Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: Quota root: name=User quota backend=maildir args= Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: Quota rule: root=User quota mailbox=* bytes=8192 messages=0 Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: Quota rule: root=User quota mailbox=* bytes=8192 messages=12 Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: Quota warning: bytes=6553 (80%) messages=0 reverse=no command=quota-warning 80 co.1corphq(a)tcs.mil.in Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: Quota grace: root=User quota bytes=819 (10%) Feb 22 12:43:24 1CorpHQ dovecot: quota-status(co.1corphq(a)tcs.mil.in): Debug: maildir++: root=/var/mail/vmail/tcs.mil.in/co.1corphq, index=, indexpvt=, control=, inbox=/var/mail/vmail/tcs.mil.in/co.1corphq, alt= Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: warning: connect to 201.123.80.9:54317: Connection refused Feb 22 12:43:24 1CorpHQ postfix/smtpd[7326]: warning: problem talking to server 201.123.80.9:54317: Connection refused Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: warning: connect to 201.123.80.9:54317: Connection refused Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: warning: problem talking to server 201.123.80.9:54317: Connection refused Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: NOQUEUE: reject: RCPT from 1CorpHQ[201.123.80.23]: 451 4.3.5 Server configuration problem; from=< Cdr.1CorpHQ(a)tcs.mil.in> to=<CO.1CorpHQ(a)tcs.mil.in> proto=ESMTP helo=<1CorpHQ> Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: text 451 4.3.5 Server configuration problem Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: text RSET Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: text 250 2.0.0 Ok Feb 22 12:43:25 1CorpHQ postfix/smtpd[7326]: lost connection after RSET from 1CorpHQ[201.123.80.23] I am understanding what the logs are trying to say. But I am not able to resolve the issue even after searching solution on internet and trying different hit and trials by myself. I want that if i am sending email to any node or within node, the configuration relating to "check _policy_service" for other node does not interfere and mail goes properly. At the same time I can also fetch quota status from other nodes. If I can get any help regarding this it will be really appreciable as I have tried a lot of options already. Regards

4 4

Re: Quota status to postfix in distributed environment (@lbutlr)
by SAAHIL IFTEKHAR 27 Feb '18

27 Feb '18

Hi Actually, the requirement is such that we have to work with this version only. I want to point out that the reason from the problem can be found out from logs(the end section). The "check_policy_service" in main.cf of postfix is the problem according to me. This configuration as a part of quota staus to postfix configuration. I hope many have went through this scenario or similar. So I am hoping to get some help for the same. Regards On 27-Feb-2018 15:30, <dovecot-request(a)dovecot.org> wrote: Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit https://dovecot.org/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." Today's Topics: 1. Re: Quota status to postfix in distributed environment (@lbutlr) ---------------------------------------------------------------------- Message: 1 Date: Mon, 26 Feb 2018 08:32:43 -0800 From: "@lbutlr" <kremels(a)kreme.com> To: dovecot(a)dovecot.org Subject: Re: Quota status to postfix in distributed environment Message-ID: <D525FAB8-D208-4B6E-AFBD-104EF48A6234(a)kreme.com> Content-Type: text/plain; charset=us-ascii On Feb 26, 2018, at 08:28, SAAHIL IFTEKHAR <response2saahil(a)gmail.com> wrote: > My dovecot version is 2.2.10. > My postfix version is 2.1.10. What happens if you use current-ish versions. -- This is my signature. There are many like it, but this one is mine. ------------------------------ Subject: Digest Footer _______________________________________________ dovecot mailing list dovecot(a)dovecot.org https://dovecot.org/mailman/listinfo/dovecot ------------------------------ End of dovecot Digest, Vol 178, Issue 64 ****************************************

1 0

Really slow IMAP performance
by Neil Jerram 26 Feb '18

26 Feb '18

Please could you help me to understand and fix why my dovecot IMAP performance is so bad? I've read through a lot of the performance-related material on the website, but I don't think that any of it could account for slowness at the level that I am seeing. The simplest scenario is moving a message from my Inbox to another IMAP folder. Using Gnus as the client, the whole UI freezes for about 2 minutes (which I assume is until the move is complete), and journalctl on the dovecot server says: Feb 24 10:24:24 arudy dovecot[1712]: imap(neil): Warning: Transaction log file /home/neil/dovecot-mail/.imap/INBOX/dovecot.index.log was locked for 98 seconds (Mailbox was synchronized) or the same message with (rotating while syncing). There must be something badly wrong in my setup, or perhaps in the spec of the server that dovecot is running on. What should I look at to start understanding this better? Many thanks - Neil

6 11

move more than one subvolder doesn't works
by Arno Schneider 26 Feb '18

26 Feb '18

Our setup: 2 replicated dovecot 2.2.33.2 servers thunderbird client When I select more than one mail subfolder in thunderbird and drag & drop them to another subfolder only one subfolger is moved. In the following I can't move another mail folder to the first target. Any ideas why this happens? best regards, arno

1 0

understanding dovecot director passdb configuration
by Kalyana sundaram 26 Feb '18

26 Feb '18

Hey All I am very new to dovecot ecosystem. Found the software really robust and secure. Kudos to the team!!! We are setting up dovecot imap servers sharing a single nfs mount point. So to avoid nfs cache issues, we are setting up dovecot director. We are using dovecot version 2.2.10. While going through the documentation of dovecot director I stumbled across the following lines in passdb configuration https://wiki2.dovecot.org/Director "Note that while this is the simplest director configuration, users will be assigned to a backend before they have been authenticated. A director configured this way can be attacked by sending it a large number of unknown users. To prevent this, the director should be configured to authenticate the user and might make use of a master password to log into the backend servers." I understand on static passdb config dovecot assigns a user to a machine in the list of backends by using md5(username)%number_of_mail_servers. But other than this calculation it does not incur any other resources. It does have tcp connection with the system which is trying to do bruteforce. If we move to authenticating users directly at the director server, the director servers imap-login director service should be anyways loaded on an attack. Is it anything to do that the imap-login will contact auth process asynchronously and keep itself free? I am pretty sure I am overlooking some point on the above statement. Can somebody throw some light on that? -- Kalyanasundaram http://blogs.eskratch.com/ https://github.com/kalyanceg/

2 1

imap-login director is not restarted after each auth request
by Kalyana sundaram 26 Feb '18

26 Feb '18

Hi imap-login by default in mail server is restarted after every login request keeping security in mind to avoid leak of critical data. But in a director config, the imap-login director process is not restarted on each auth request. Can somebody explain why this design decision is taken? -- Kalyanasundaram http://blogs.eskratch.com/ https://github.com/kalyanceg/

1 0

dovecot solr and users
by David Mehler 26 Feb '18

26 Feb '18

Hello, I'm trying to get fts searching done with dovecot. I keep getting the below error. Any help appreciated? Thanks. Dave. #doveadm index -A inbox doveadm(user(a)example.com): Info: User no longer exists, skipping #doveconf -n # 2.2.33.2 (d6601f4ec): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: FreeBSD 11.1-RELEASE-p4 amd64 auth_cache_size = 10 M auth_default_realm = example.com auth_realms = example.com example2.com dict { acl = mysql:/usr/local/etc/dovecot/shared-folders.conf sqlquota = mysql:/usr/local/etc/dovecot/quota.conf } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.example.com imap_idle_notify_interval = 10 mins last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 lmtp_rcpt_check_quota = yes mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib fts fts_solr mail_privileged_group = vmail mail_server_admin = mailto:postmaster@example.com mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:~/mail/:INDEX=~/mail/shared/%%Ld/%%Ln prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = virtual:/usr/local/etc/dovecot/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } prefix = virtual/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_globals_only = yes acl_shared_dict = proxy::acl fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/home/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/home/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = proxy::lastlogin last_login_key = last-login/%u mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/bin sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/sieve/sieve_error.log trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap { executable = imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = <cert location ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256@STRENGTH ssl_dh_parameters_length = 4096 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 TLSv1.2 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib fts fts_solr quota sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib fts fts_solr sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib fts fts_solr imap_acl imap_quota imap_sieve imap_zlib last_login }

2 1

2.2.33.2 - Virtual Mailbox Issue bug maybe ?
by Matt Bryant 25 Feb '18

25 Feb '18

Been experimenting with virtual mailbox and have a question :- I have defined 2 virtual mailboxes 'all' and 'combined' as follows ... virtual/all/dovecot-virtual virtual/combined inthread refs x-mailbox INBOX virtual/combined/dovecot-virtual !INBOX INBOX/Sent INBOX/Drafts all When new mail comes I would assume that both virtual mailboxes should actually see the message but whilst an imap search command gets a result in the virtual/combined for some reason not every message is seen in virtual all - so was wondering what exactly does 'inthread refs x-mailbox INBOX' do ? I would have thought new mail to inbox would just have a thread of 1 and be seen. If i remove the indexes from virtual then the messages appear so am thinking something not quite triggering an action. Any ideas ? What can I do to try and track down where problem lies or am i misunderstanding what 'inthread refs x-mailbox INBOX' should do ???? == 8< ========== # doveconf -n # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) doveconf: Warning: service auth { client_limit=5000 } is lower than required under max. load (26096) doveconf: Warning: service anvil { client_limit=5000 } is lower than required under max. load (9715) # OS: Linux 3.10.0-693.11.6.el7.x86_64 x86_64 CentOS Linux release 7.3.1611 (Core) auth_cache_negative_ttl = 2 mins auth_cache_ttl = 3 mins auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 100 default_client_limit = 8192 default_process_limit = 8192 default_vsz_limit = 512 M disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 1 mins login_greeting = IMAP/POP3 ready - us11-001dm mail_attachment_dir = /var/mail/sis/%Ld mail_cache_min_mail_count = 5 mail_debug = yes mail_plugins = " quota virtual" mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds spamtest spamtestplus editheader mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes list = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Drafts { auto = create special_use = \Drafts } mailbox Sent { auto = create special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = create special_use = \Trash } prefix = INBOX/ separator = / type = private } namespace virtual { list = no location = virtual:/var/lib/mail/dovecot/virtual:INDEX=~/virtual prefix = virtual/ separator = / type = private } passdb { args = /etc/dovecot/sql_users.conf driver = sql } passdb { args = /etc/dovecot/sql_admin.conf driver = sql } plugin { mail_log_events = delete expunge mail_log_fields = uid box msgid size quota = dict:UserQuota::file:%h/dovecot-quota quota_rule2 = INBOX/Trash:storage=+10%% sieve = file:~/sieve/user;active=~/.dovecot.sieve sieve_default = file:/var/lib/mail/dovecot/sieve/default.sieve sieve_default_name = default sieve_editheader_max_header_size = 1k sieve_extensions = +spamtest +spamtestplus +editheader +vacation-seconds sieve_global = file:/var/lib/mail/dovecot/sieve sieve_quota_max_scripts = 5 sieve_spamtest_max_value = 200 sieve_spamtest_status_header = X-spam-score-int: -?([[:digit:]]+) sieve_spamtest_status_type = score sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1s } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes protocols = imap pop3 lmtp sieve service anvil { client_limit = 5000 } service auth-worker { user = $default_internal_user } service auth { client_limit = 5000 unix_listener auth_client { mode = 0660 user = exim } } service doveadm { client_limit = 10 inet_listener { address = * port = 4000 } process_limit = 100 process_min_avail = 10 service_count = 1 } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 500 process_min_avail = 10 service_count = 1 } service imap { executable = imap postlogin process_limit = 500 } service managesieve-login { inet_listener sieve { port = 4190 } process_limit = 20 process_min_avail = 10 service_count = 1 } service managesieve { process_limit = 1024 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 1000 process_min_avail = 5 service_count = 1 } service pop3 { process_limit = 500 } service postlogin { executable = script-login -d rawlog } shutdown_clients = no ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecotl.com.pem ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/sql_users.conf driver = sql } protocol imap { imap_capability = +SPECIAL-USE mail_max_userip_connections = 50 mail_plugins = " quota virtual imap_quota" } protocol pop3 { mail_max_userip_connections = 20 mail_plugins = " quota virtual" } protocol lmtp { auth_username_format = %Lu mail_plugins = " quota virtual sieve quota" postmaster_address = mailer-daemon } ======= 8< ========== The below were searches in performed in the two mailboxes .. showing the found/not found status. search in vritual/all ? search header Message-ID < 5A8663D6.5000704(a)the-bryants.net <mailto:5A8663D6.5000704@the-bryants.net> > * SEARCH ? OK Search completed (0.246 + 0.000 + 0.245 secs). search in virtual combined ? search header Message-ID < 5A8663D6.5000704(a)the-bryants.net <mailto:5A8663D6.5000704@the-bryants.net> > * SEARCH 29268 ? OK Search completed (0.179 + 0.000 + 0.178 secs). rgds Matt -- <https://www.postbox-inc.com/?utm_source=email&utm_medium=siglink&utm_campai…>

2 6

Dovecot With DSpam AntiSpam Plugin Replacement With Sieve
by colinh＠nxtgn.com 25 Feb '18

25 Feb '18

Hello I have recently had to rebuild my email server, it is a small server for my various email accounts and I also host the email for a clients business. Switched to Dovecot from Courier many years ago, and it has been a very reliable solution With the new rebuild I have updated it to Dovecot 2.2.33.2 with PigeonHole 4.21, it runs DSpam 3.10.2 to scan and tag all incoming mails as Spam or not then a Sieve rule to put the Spam emails into the Spam folder, I was also using the DSpam Antispam plugin to enable moving messages from one folder to another to teach failures to DSpam, this works well for my and my client. Doing the rebuild I saw that the AntiSpam plugin had been deprecated and the preferred solution now was to use Sieve Filters, so I implemented that and had struggled with it for a few hours until I finally got it working. It may be something about my setup but I am not sure it is, but the suggested way of doing it here https://wiki.dovecot.org/HowTo/AntispamWithSieve did not work for me and I don't think it was ever going to. Here are the shell scripts and sieve filters that I came up with that work for me, your mileage may vary. I use DSpam as a standalone binary not as a daemon so you may need to add the --client option on the dspam command line in the shell scripts if you run DSpam in daemon mode. === report-spam.sieve === require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables"]; if environment :matches "imap.user" "*" { set "userid" "${1}"; if header :matches "X-DSPAM-Signature" "*" { set "signature" "${1}"; } } pipe :copy "learn-spam.sh" [ "${userid}", "${signature}" ]; === report-ham.sieve === require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables"]; if environment :matches "imap.mailbox" "*" { set "mailbox" "${1}"; } if string "${mailbox}" "Trash" { stop; } if environment :matches "imap.user" "*" { set "userid" "${1}"; if header :matches "X-DSPAM-Signature" "*" { set "signature" "${1}"; } } pipe :copy "learn-ham.sh" [ "${userid}", "${signature}" ]; === learn-spam.sh === #!/bin/sh exec /usr/local/bin/dspam --user ${1} --signature=${2} --class=spam --source=error === learn-ham.sh === #!/bin/sh exec /usr/local/bin/dspam --user ${1} --signature=${2} --class=innocent --source=error I hope this saves someone some time or gives someone some tips -- Regards Colin

2 1

Remove "Duplicate" emails
by ＠lbutlr 24 Feb '18

24 Feb '18

In a quest to remove “duplicate” messages sent to both me and lists I subscribe to I came up with this, which I think should clean out my Archive folder, but I’ve been unable to get it to work for scanning all on my list-user email. $ doveadm -f table fetch -u kremels 'hdr.message-id guid uid hdr.x-listname' mailbox "Archive" | sort| awk 'cnt[$1]++{if (cnt[$1]==2) print prev[$1]; print} {prev[$1]=$0}' |grep -E "[0-9] +$" |awk '{print "doveadm expunge -u kremels MAILBOX-GUID "$2" UID "$3}’ X-listname is a header that my list user applies to each message that comes from a list, and the output is just text to the screen that I can then run manually (I am not confident enough to automatically delete the messages). I include the X-listname header at the end so that I can exclude lines that don’t end in a number, which means the copies sent directly to me are the ones expunged and the ones from the list are preserved. So far so good. But ther are issues. First, even after expunging a message and running doveadm index -u kremels “Archive”, subsequent runs still show the same duplicate messages. Second, what I really want to do is run this over ALL the mailboxes, except for Junk and Sent but if that is possible I can’t find the right syntax. -- "He has all the virtues I dislike and none of the vices I admire." Winston Churchill

2 4

Sieve
by IT 24 Feb '18

24 Feb '18

Hello, Im newbie at sieve. I have a nice script running on my boxes, and I have the following question: Using Sieve, is there a RULE to find out if String "MYTESTSTRING" is ANYWHERE inside the Email, or ANYWHERE inside the HEADER at least -- in order to trigger actions like "discard;" consequently ? Thank you so much in advance best Regards Florian -- Mit freundlichen Grüßen / best regards Florian Bojack it(a)u-eitner.de <mailto:it@u-eitner.de> logoEitner U.Eitner Formenbau, Erodier-& Kunststofftechnik GmbH Benzstraße 7 D-64807 Dieburg Geschäftsführer Ulrich und Lars Eitner Tel: +49 (0) 6071 23262 Fax: +49 (0) 6071 5562 Web: www.info@u-eitner.de Der Inhalt dieser Email und etwaiger Anhänge ist vertraulich und ausschließlich für den bezeichneten Adressaten bestimmt. Jede unbefugte Kenntnisnahme, Veröffentlichung,Vervielfältigung oder Weitergabe ist unzulässig. Sollten Sie nicht der vorgesehene Empfänger sein, bitten wir Sie, sich mit uns in Verbindung zu setzen und die Email zu löschen sowie alle Kopien zu vernichten. This e-mail is intended solely for the addressee and may contain confidential and/or privileged information. If you are not the intended recipient, please notify the sender immediately and destroy this e-mail. In this case any form of reproduction, disclosure, distribution or any action taken or refrained from in reliance on it, is strictly prohibited.

3 2

Stale mailbox lock file
by Raffaele Gambelli 24 Feb '18

24 Feb '18

Hi all, I would like to understand the meaning of "Stale mailbox lock file detected" In index-storage.c (https://mis.dopa.go.th/atmail/server_source/dovecot/src/lib-storage/index/i…) there is this notice "Stale mailbox lock file detected" ... I have a java application which connects via javamail to a dovecot server and I have some anomalies when that message comes. Thanks, bye Raffaele Gambelli

2 7

dovecot auth and horde webmail
by David Mehler 24 Feb '18

24 Feb '18

Hello, I'm not sure if this is a Dovecot-specific question, or Postfix or Horde webmail. As Dovecot is used for authenticating both Postfix as well as horde I thought i'd start here. I've got a new horde webmail install going on a FreeBSD 11.1 jail. I've got Dovecot set up so that it appends a domain name if one is not given, so that user and user(a)example.com can both log in. When I logged in with horde webmail I used for the first attempt username with no @example.com suffix. I logged in ok, but couldn't send an email, gave me a weird error no address associated with host. I logged out, logged back in using user(a)example.com the full address, and this time the message sending went through. Any ideas or if this is not a Dovecot question let me know, as that means I'll have two other places to try. Thanks. Dave. doveconf -n # 2.2.33.2 (d6601f4ec): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: FreeBSD 11.1-RELEASE-p4 amd64 auth_cache_size = 16 k auth_default_realm = example.com auth_mechanisms = plain login auth_realms = example.com example2.com dict { acl = mysql:/usr/local/etc/dovecot/shared-folders.conf sqlquota = mysql:/usr/local/etc/dovecot/quota.conf } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.example.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 xxx.xxx.xxx.xxx lmtp_rcpt_check_quota = yes mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/mail/:LAYOUT=fs:INDEX=~/mail/ mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib mail_server_admin = mailto:postmaster@example.com mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:~/mail/:INDEX=~/mail/shared/%%Ld/%%Ln prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = virtual:/usr/local/etc/dovecot/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } prefix = virtual/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_globals_only = yes acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/sieve/sieve_error.log trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap { executable = imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = <Cert Here Obscured> ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256@STRENGTH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib sieve } protocol imap { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login }

2 1

Optimizing search performance for mobile devices / web mailer / general - solr plugin config
by Götz Reinicke 23 Feb '18

23 Feb '18

Hi all, we run dovecot for a long time now with no complains from the users … until this week. Some users say, the search in mailfolders from iPhone (which only stores a few mails and search most on the server as I know) or our web mailer (SOGo, which I currently search also on the imap server) is „slow“. As this is sort of individual experience, I was thinking of ways to speed up the search and came across the fts_solr plugin. My question is, can I „just“ configure the its_solg plugin as described at the dovecot wiki? https://wiki.dovecot.org/Plugins/FTS/Solr <https://wiki.dovecot.org/Plugins/FTS/Solr> How difficult is is to set up a solr server for that purpose? As our current mail hardware is not busy at all, is it ok to install Solr on the same hardware/server? May be someone using that setup can give me some hints? And: How hard is it to switch back to the „build in“ default search if we don’t see any benefit from hosting a solr server too. Thanks for feedback and suggestions . Regards . Götz

3 2

Multiple SSL-Certificates/Domains setup not working
by Gabriel Kaufmann 23 Feb '18

23 Feb '18

I've tried setting up multiple SSL-Certificates (using letsencrypt) for dovecot on my ubuntu machine. Used dovecot version is 2.2.18. Regarding to official docs this should be working. My test-client (Thunderbird on linux) has been mentioned to be working fine with SNI here: https://wiki.dovecot.org/SSL/SNIClientSupport https://wiki.dovecot.org/SSL/DovecotConfiguration#line-89 > local_name imap.example.org { > ssl_cert = </etc/ssl/certs/imap.example.org.crt > ssl_key = </etc/ssl/private/imap.example.org.key > } > local_name imap.example2.org { > ssl_cert = </etc/ssl/certs/imap.example2.org.crt > ssl_key = </etc/ssl/private/imap.example2.org.key > } Did anyone have success on this (without using multiple IP per Domain)? -- Best regards Gabriel Kaufmann

4 5

preferred way to move an imap folder
by himbeere＠shinymail.de 23 Feb '18

23 Feb '18

Hello list. What is the preferred way to move an imap folder. Lets say an User has. .maildir/.INBOX.Junk I want to move this imap folder to: .maildir/.Junk Can i just use: mv .maildir/.INBOX.Junk .maildir/.Junk and be done with that? thanks and cheers t.

3 3

Auth SEGV on sparc64, alignment problem?
by Chris Ross 23 Feb '18

23 Feb '18

Apologies first for using two addresses, but I can’t currently read my email at distal.com. :-) I was previously running dovecot2-2.2.29.1_2 on FreeBSD 11 on sparc64. Trying to debug a problem I was having with one of my clients, I upgraded to dovecot-2.2.33.2_4 on that same server. However, I cannot connect now, log shows: Feb 20 16:55:00 westeros dovecot: master: Dovecot v2.2.33.2 (d6601f4ec) starting up for imap, pop3, lmtp Feb 20 16:55:31 westeros dovecot: auth: Fatal: master: service(auth): child 25395 killed with signal 11 (core dumped) Feb 20 16:55:31 westeros dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs Feb 20 16:55:31 westeros dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=2001::xxx, lip=2001:470:e24c:200::ae25, TLS handshaking, session=<ASDFSAFSADFSAD> Feb 20 16:55:33 westeros dovecot: auth: Fatal: master: service(auth): child 25398 killed with signal 11 (core dumped) Feb 20 16:55:33 westeros dovecot: master: Error: service(auth): command startup failed, throttling for 4 secs Feb 20 16:55:33 westeros dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 2 secs): user=<>, rip=2001::xxx, lip=2001:470:e24c:200::ae25, session=<d46tyesdy5dsyd> Feb 20 16:55:37 westeros dovecot: master: Error: service(auth): command startup failed, throttling for 8 secs Feb 20 16:55:37 westeros dovecot: auth: Fatal: master: service(auth): child 25400 killed with signal 11 (core dumped) Loading the core file, as described https://www.dovecot.org/bugreport.html , shows the error in libc somewhere: (gdb) bt full #0 __unaligned_load ( p=0x617070656e640e6d <Address 0x617070656e640e6d out of bounds>, size=4) at /usr/src/release-11.1.0/lib/libc/sparc64/sys/__sparc_utrap_align.c:45 val = 0 i = 0 #1 0x00000000109f9f6c in __unaligned_fixup (uf=0x7fdffffee40) at /usr/src/release-11.1.0/lib/libc/sparc64/sys/__sparc_utrap_align.c:78 addr = <value optimized out> val = <value optimized out> insn = 3254807616 sig = <value optimized out> #2 0x00000000109f9d50 in __sparc_utrap (uf=0x7fdffffee40) at /usr/src/release-11.1.0/lib/libc/sparc64/sys/__sparc_utrap.c:100 sig = 272013984 #3 0x000000001094a10c in __sparc_utrap_gen () from /lib/libc.so.7 No symbol table info available. #4 0x000000001094a10c in __sparc_utrap_gen () from /lib/libc.so.7 No symbol table info available. Previous frame identical to this frame (corrupt stack?) (gdb) As this is a sparc64, with 8-byte alignment requirements, I’m guessing that’s the issue. Many a piece of software has failed to respect that and crashed. But, I’m not sure. Does anyone have any suggestions? I’ve built it locally (via ports), so if there are compiler options I can/should try, I certainly can try. Thanks… - Chris

4 9

Constant IMAP timeouts/dropouts
by H.E. 23 Feb '18

23 Feb '18

Hello, I've searched and searched for a solution to this problem but continue to come up empty. I have a very generic setup. CentOS Linux 7.3.1611 running on AWS. I installed the QMail toaster from here: http://www.qmailtoaster.com/ ( I had been using Bill Shupp's Qmail Toaster for years and years, but he stopped supporting it.) As such, I did have to convert my Courier mailboxes to Dovecot (no real problem there). I'm using Thunderbird client on Windows and Mac. I have one user (me) using two vpopmail domains with a total of three mailboxes. Each mailbox has about 20 folders which I tag in Thunderbird as "When getting new messages for this account, always check this folder". I might have two or three client machines (at different locations) running at once (desktop and two notebooks) all trying to get mail. The problem is I can't go 5 minutes without Dovecot timing out on me, returning an error in Thunderbird: "Login to server failed" and asks to "enter new password, cancel, or retry" options, or just hanging. The only way to get Dovecot back is to bounce both dovecot and the network via: /bin/systemctl restart dovecot.service ; /bin/systemctl restart network Then I can resume normal activities for a while. It got so bad that I put the above restarts into a cron job running every 5 minutes. But even then the problem persists after a couple of minutes. There's nothing else running on this box. I've already increased both mail_max_userip_connections = 8000 and: protocol imap { mail_max_userip_connections = 8000 mail_plugins = " quota imap_quota" } By the way, the the identical mailbox and client setup, I never had this problem with Courier IMAP. My dovecot -n is pasted below. So I'm at a loss on how to fix this. I have tried adjusting the number of cached Thunderbird connections, and that doesn't change anything. Any help or pointers in the right direction to keep Dovecot connected would be most helpful. Thanks, -hank Here is my dovecot -n # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.3.1611 (Core) auth_cache_size = 64 M auth_debug_passwords = yes auth_mechanisms = plain login digest-md5 cram-md5 first_valid_gid = 89 first_valid_uid = 89 log_path = /var/log/dovecot.log login_greeting = Dovecot toaster ready. mail_max_userip_connections = 8000 mail_plugins = " quota" namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } protocols = imap ssl_cert = </var/qmail/control/servercert.pem ssl_dh_parameters_length = 2048 ssl_key = </var/qmail/control/servercert.pem userdb { args = cache_key=%u quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { mail_max_userip_connections = 8000 mail_plugins = " quota imap_quota" } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = yes }

1 0

Panic: data stack: Out of memory when allocating bytes
by Thomas Robers 22 Feb '18

22 Feb '18

Hello, I'm using Dovecot 2.3 and sometimes i get this: --- snip --- Jan 23 14:23:13 mail dovecot: imap(bob(a)tutech.de)<4880><PDqibHFjMvrAqG1n>: Panic: data stack: Out of memory when allocating 134217768 bytes Jan 23 14:23:13 mail dovecot: imap(bob(a)tutech.de)<4880><PDqibHFjMvrAqG1n>: Fatal: master: service(imap): child 4880 killed with signal 6 (core dumped) --- snip --- The gdb backtrace is: --- snip --- GNU gdb (GDB) Red Hat Enterprise Linux (7.2-92.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/imap...(no debugging symbols found)...done. Attaching to program: /usr/libexec/dovecot/imap, process 4880 ptrace: Kein passender Prozess gefunden. [New Thread 4880] Reading symbols from /usr/lib64/dovecot/libdovecot-storage.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/lib64/dovecot/libdovecot.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/libdovecot.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /usr/lib64/dovecot/lib01_acl_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib01_acl_plugin.so Reading symbols from /usr/lib64/dovecot/lib02_imap_acl_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib02_imap_acl_plugin.so Reading symbols from /usr/lib64/dovecot/lib15_notify_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib15_notify_plugin.so Reading symbols from /usr/lib64/dovecot/lib20_mail_log_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib20_mail_log_plugin.so Reading symbols from /usr/lib64/dovecot/lib20_zlib_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib20_zlib_plugin.so Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libbz2.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libbz2.so.1 Reading symbols from /usr/lib64/dovecot/lib30_imap_zlib_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib30_imap_zlib_plugin.so Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007f73f1386495 in raise () from /lib64/libc.so.6 --- snip --- I searched for that error message but only found some entries regarding older dovecot versions and setting "mail_process_size" but i couldn't find anything regarding Dovecot Version 2.3. Maybe it's something that is fixed already but if so i can't find it. Or is this a configuration issue or a bug? Here my Dovecot configuration: --- snip --- # 2.3.0 (c8b89eb): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 2.6.32-696.3.1.el6.x86_64 x86_64 CentOS release 6.9 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 imap_max_line_length = 2 M mail_debug = yes mail_location = maildir:/export/home/imap/%Lu/Maildir mail_plugins = acl zlib mail_log notify mailbox_idle_check_interval = 10 secs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/export/home/shared-db/shared-mailboxes mail_log_events = append delete undelete expunge copy mailbox_delete mailbox_rename flag_change mail_log_fields = uid box msgid size from flags mail_replica = tcp:mail2.tutech.de sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global = /var/lib/dovecot/sieve/global/ sieve_user_log = ~/.dovecot.sieve.log zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve sieve service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service config { unix_listener config { user = vmail } } service doveadm { inet_listener { port = 12345 } user = vmail } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_limit = 500 process_min_avail = 20 } service imap { executable = imap } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service pop3 { executable = pop3 } service replicator { unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.tutech.de.crt_chain ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl zlib mail_log notify imap_zlib imap_acl rawlog_dir = /tmp/rawlog/%u } --- snip --- Thanks for the help! Kind regards Thomas

2 7

lmtp: Couldn't parse DH parameters
by jordan.h＠startmail.com 22 Feb '18

22 Feb '18

I'm using SSL for dovecot, and dovecot kindly warned me on startup that I needed the ssl_dh parameter, which I specified: # grep -P '^ssl_dh' /etc/dovecot/conf.d/10-ssl.conf ssl_dh = </etc/dovecot/dh.pem And I generated the file, as specified in the comment: # openssl dhparam -out /etc/dovecot/dh.pem 4096 The file contains the appropriate headers: # grep -P '^\-' /etc/dovecot/dh.pem -----BEGIN DH PARAMETERS----- -----END DH PARAMETERS----- However, when I restart dovecot (`systemctl restart dovecot`) I get the following error: lmtp(8221): Error: SSL context initialization failed, disabling SSL: Couldn't parse DH parameters: error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: DH PARAMETERS This message repeats 5 times (presumably for each dovecot service?). In /var/log/dovecot/imap.log, I see the same error. I even gave permission to the `dh.pem` file for the *vmail* user and group, but that didn't seem to change anything. Any ideas? Thanks.

3 3

Authenticating pam and and sql
by ＠lbutlr 22 Feb '18

22 Feb '18

When a sql user logs in, dovecot always tries pam first (used for the local users with home directories) which generates a login failure in the log, before trying sql (virtual users) and allowing the user to login. Since all the pam users login as 'user' and all the sql users login as 'user(a)example.com' is it possible to tell dovecot which method to check based on the username pattern? It's not a big deal, but these errors show up when I am checking my maillog for problems, and I can't really exclude them since I do want to see actual login failures.

2 2

"Stale mailbox lock file detected, will override in 0 seconds"
by Raffaele Gambelli 22 Feb '18

22 Feb '18

Hi all dovecot members, I've received this notice from a dovecot server: "Stale mailbox lock file detected, will override in 0 seconds" I would like to know what it means. I've implemented a "Mail Proxy Server" in java, which connects to many accounts and folders, listening for incoming messages or deleted one, it uses the IMAP protocol. I received that message only 5 times in 60 days of logs, last time, in the same time lapse my server has not received three messages, saying differently, the listener (I'm using Javamail which works fine) has not be notified about those new threee messages. So, I would like to find a link between the above dovecot message and the "black-out" which I had, could you help me please? Thanks, bye Raffaele Gambelli WebRainbow® Software Analyst & Developer

1 0

exim dovecot sieve
by himbeere＠shinymail.de 22 Feb '18

22 Feb '18

Hello list. I have just a generic question. Exim delivers fine to dovecot-lda. My problems are the logfiles. Whenever I recieve a message Exim writes to dovecot.log as the user who recieves the mail. This forces me to have that logfile world writeable. I don't really like that. How do you guys deal with that? Here my transport: dovecot_delivery: driver = pipe # You may or may not want to add -d $local_part@$domain depending on if you need a userdb lookup done. command = /usr/libexec/dovecot/dovecot-lda -f $sender_address message_prefix = message_suffix = log_output delivery_date_add envelope_to_add return_path_add #group = mail #mode = 0660 temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 thanks and best regards t.

2 2

"Stale mailbox lock file detected, will override in 0 seconds"
by Raffaele Gambelli 20 Feb '18

20 Feb '18

1 0

Shared folders and quota
by Fabian Kuran 20 Feb '18

20 Feb '18

Hi all, we are able to observe a very strange behaviour: User A wants to copy a mail to a shared mailbox of user B. This works like a charme if the quota of user A is lower than the used space of user B. But is the used space of user B higher than the quota size of User A, "User A" is not longer able to copy the message to the shared folder of user B. His IMAP Client says something like "NO OVERQUOTA". # doveadm quota get -u UserA Quota name Type Value Limit % User quota STORAGE 20085 25600 78 User quota MESSAGE 68 - 0 # doveadm quota get -u UserB Quota name Type Value Limit % User quota STORAGE 39963 122880 32 User quota MESSAGE 160 - 0 Is this a known behaviour of dovecot? Is there a way to "disable" quota-handling for shared folders? This is my doveconf -n": # 2.2.30.2 (c0c463e): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.18 (29cc74d) # OS: SLES12SP3 auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.debug dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 480 lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_gid = vmail mail_location = maildir:/var/spool/mail/user/%n/Maildir:LAYOUT=fs mail_plugins = acl quota stats listescape notify virtual mail_privileged_group = vmail mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { hidden = yes inbox = yes list = no location = prefix = separator = / subscriptions = yes } namespace { list = children location = maildir:%%h/Maildir:INDEXPVT=~/shared/%%u:LAYOUT=fs prefix = user/%%n/ separator = / subscriptions = no type = shared } namespace Public { list = children location = maildir:/var/mail/%d/public:INDEXPVT=~/public:LAYOUT=fs prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { inbox = no location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/masteruser.%s driver = passwd-file master = yes pass = yes } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/spool/mail/%d/shared-mailboxes.db quota = dict:User quota::proxy::sqlquota quota_rule = *:storage=4G quota_rule2 = INBOX/Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota / Mailbox ist voll quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u sieve = ~/.dovecot.sieve sieve_before = /var/spool/mail/globalsieve/duplicate.sieve sieve_dir = ~/sieve sieve_duplicate_max_period = 5m stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)domain.de protocols = imap pop3 lmtp sieve service auth-worker { user = dovecot } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0660 user = dovecot } } service imap-postlogin { executable = script-login /var/mail/imapafter.sh user = $default_internal_user } service imap { executable = imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 127.0.0.1 port = 10000 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh group = vmail unix_listener quota-warning { group = vmail user = dovecot } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = dovecot } } ssl_cert = </etc/ssl/certs/domain.de.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl quota stats listescape notify virtual acl quota sieve quota_full_tempfail = yes } protocol lda { mail_plugins = acl quota stats listescape notify virtual acl sieve } protocol imap { mail_plugins = acl quota stats listescape notify virtual imap_quota imap_acl imap_stats } -- Kind regards, Fabian

1 1

[bt full included] imap-login: Panic: file client-common.c: line 272 (client_destroy): assertion failed: (client->create_finished)
by Andreas Fischer 20 Feb '18

20 Feb '18

Hi, as discussed with cmouse on freenode two days ago please find attached necessary debug information on a crashing imap-login process, that appeared after upgrading to v2.3 (+ sieve). It is a standard setup in combination with postfix and thunderbird, roundcube and K9(Android) as imap clients. Panic happens 5-6 times a day, but no influence on user experience. Unfortunately i have no idea what might be causing it. Let me know if you need more information. Andreas syslog: Feb 19 21:09:37 hafnium.d9c.eu dovecot[14324]: imap-login: Fatal: master: service(imap-login): child 30653 killed with signal 6 (core dumped) dovecot.log: Feb 19 20:57:07 imap(user(a)d9c.eu)<30655><7C/91pVl0q3CJ7cC>: Info: Connection closed (IDLE running for 0.001 + waiting input for 1109.126 secs, 2 B in + 10 B out, state=wait-input) in=699 out= Feb 19 20:57:24 imap(user(a)d9c.eu)<30656><PuD+1pVl1a3CJ7cC>: Info: Connection closed (IDLE running for 0.001 + waiting input for 1123.798 secs, 2 B in + 10 B out, state=wait-input) in=91 out=1 Feb 19 21:02:15 imap(user(a)d9c.eu)<30999><IS1w55VlKKrDJbhD>: Info: Connection closed (IDLE running for 0.001 + waiting input for 1143.235 secs, 2 B in + 10 B out, state=wait-input) in=686 out= Feb 19 21:02:23 imap(user(a)d9c.eu)<30998><5B5v55VlJqrDJbhD>: Info: Connection closed (IDLE running for 0.001 + waiting input for 1147.566 secs, 2 B in + 10 B out, state=wait-input) in=99 out=1 Feb 19 21:08:36 imap(user(a)d9c.eu)<30657><D7QC15Vl1q3CJ7cC>: Info: Disconnected for inactivity in=91 out=919 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Feb 19 21:08:37 imap(user(a)d9c.eu)<30658><n6EG15Vl163CJ7cC>: Info: Disconnected for inactivity in=719 out=5345 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 dovecot -n # 2.3.0 (c8b89eb): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 4.15.3-2-ARCH x86_64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot-debug.log info_log_path = /var/log/dovecot.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = vmail mail_home = /app/vmail/%d/%n mail_location = sdbox:%h/sdbox mail_plugins = " quota" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader mdbox_rotate_interval = 1 days mdbox_rotate_size = 8 M namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:user::file:%h/mdbox/dovecot-quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +editheader } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix-sasl/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { chroot = executable = imap-login -D inet_listener imap { port = 143 } inet_listener imaps { port = 0 } service_count = 0 } service lmtp { unix_listener /var/spool/postfix-mail/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/cert.ec.crt ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES128-GCM-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { driver = static } protocol lmtp { mail_plugins = " quota sieve" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 25 mail_plugins = " quota imap_quota" } (gdb) bt full #0 0x00007fddd9433860 in raise () from /usr/lib/libc.so.6 No symbol table info available. #1 0x00007fddd9434ec9 in abort () from /usr/lib/libc.so.6 No symbol table info available. #2 0x00007fddd987a521 in default_fatal_finish (type=LOG_TYPE_PANIC, status=status@entry=0) at failures.c:228 backtrace = 0x561a9c8612f0 "/usr/lib/dovecot/libdovecot.so.0(+0xc4567) [0x7fddd987a567] -> /usr/lib/dovecot/libdovecot.so.0(+0xc462a) [0x7fddd987a62a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fddd97e9df9] -> /usr/lib/d"... recursed = 0 #3 0x00007fddd987a62a in i_internal_fatal_handler (ctx=0x7ffdbd74cd70, format=<optimized out>, args=<optimized out>) at failures.c:718 status = 0 #4 0x00007fddd97e9df9 in i_panic (format=format@entry=0x7fddd9b35a88 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:306 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0, log_prefix = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffdbd74ce70, reg_save_area = 0x7ffdbd74cdb0}} #5 0x00007fddd9b2e2e9 in client_destroy (client=<optimized out>, reason=reason@entry=0x7fddd9b35e21 "Disconnected: Shutting down") at client-common.c:272 __func__ = "client_destroy" #6 0x00007fddd9b2e624 in clients_destroy_all_reason (reason=0x7fddd9b35e21 "Disconnected: Shutting down") at client-common.c:430 client = <optimized out> next = 0x0 #7 0x0000561a9aeeb12a in imap_login_deinit () at imap-login-client.c:764 No locals. #8 0x00007fddd9b34587 in main_deinit () at main.c:475 strp = <optimized out> strp = <optimized out> strp_end = <optimized out> #9 login_binary_run (binary=<optimized out>, argc=<optimized out>, argv=<optimized out>) at main.c:550 set_pool = 0x561a9c86b100 login_socket = 0x7fddd9b37ab9 "login" c = <optimized out> #10 0x00007fddd941ff4a in __libc_start_main () from /usr/lib/libc.so.6 No symbol table info available. #11 0x0000561a9aeeaeaa in _start () No symbol table info available. (gdb)

1 0

SASL LOGIN mechanism with nopassword
by Patrick Monnerat 18 Feb '18

18 Feb '18

Hi list, I've noticed dovecot pop3 does not request the password with 'AUTH LOGIN' when nopassword is set. dovecot-2.2.18 auth_mechanisms = plain login ssl = required auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = nopassword=yes userdb_uid=vmail userdb_gid=vmail userdb_home=/var/spool/vmail/%d/%n override_fields = password= } userdb { driver = prefetch } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=vmail gid=vmail home=/var/spool/vmail/%d/%n } Although this works perfectly well, skipping the password phase in the SASL LOGIN mechanism deviates from the draft for this mechanism at https://tools.ietf.org/html/draft-murchison-sasl-login-00 I know this document is not normative and has not made its way to a standard. However it does not mention the ability to bypass the password phase. My questions are: - Is the dovecot behavior intentional ? - If not, will you change it (i.e.: to a dummy password request) ? - Are you aware of another server considering the SASL LOGIN password phase as optional ? Please don't tell me to change the config or to use the PLAIN or EXTERNAL mechanism: the real goal of these questions is to know whether this deviance should be supported by a client (more precisely cURL) or not. Thanks in advance for you reply. Patrick

1 0

Dovecot says the message was stored into a Spam mailbox but it's not there
by Kris 18 Feb '18

18 Feb '18

Hi, I have a problem with storing messages into a Spam folder by dovecot. Log says that message was stored into Spam mailbox but when I check there is no message in users's Spam mailbox. cat /var/log/mail.log | grep sieve | grep Spam : *Feb 17 05:09:11 mailserver dovecot: lda(user@domain): sieve: msgid=<b599df639ffa4d20f6e8d2bcff791286(a)somedomain.pl>: stored mail into mailbox 'Spam'* Where are these messages if not in the Spam folder where they should be? /var/vmail/domain/user/Maildir/.Spam/cur/ * dovecot -n* # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-104-generic x86_64 Ubuntu 16.04.3 LTS ext4 auth_gssapi_hostname = mailserver.belpol.local auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = gssapi plain first_valid_gid = 117 first_valid_uid = 111 listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = ebox mail_home = /var/vmail/%d/%u mail_location = maildir:/var/vmail/%d/%u/Maildir mail_uid = ebox managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=0 sieve = /var/vmail/%Ld/%Ln/sieve-script sieve_before = /var/vmail/sieve/default.sieve sieve_default = /var/vmail/sieve/default.sieve sieve_dir = /var/vmail/%Ld/%Ln sieve_global_path = /var/vmail/sieve/default.sieve sieve_storage = /var/vmail/%Ld/%Ln } protocols = pop3 imap sieve service auth { executable = /usr/lib/dovecot/auth unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = ebox mode = 0600 user = ebox } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 } } ssl_cert = </etc/dovecot/private/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf default_fields = uid=111 gid=117 driver = ldap } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve quota postmaster_address = postmaster } *default.sieve:* require ["fileinto"]; # rule:[SPAM] if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } if header :contains "subject" ["***UNCHECKED***", "SPAM"] { fileinto "Spam"; }

2 1

FreeBSD Core dump: PAM authentication with Kerberos credentials (GSSAPI_MIT)
by Ben Woods 18 Feb '18

18 Feb '18

Hi everyone, I have a repeatable core dump when running dovecot on FreeBSD in the specific scenario described below. Dovecot is linked against MIT kerberos in /usr/local/lib/, whilst PAM is linked against Heimdal in /usr/lib/. My expectation was that dovecot authentication using GSSAPI would use MIT kerberos in /usr/local/lib, whereas PAM authentication is independent from dovecot and would therefore use Herimdal in /usr/lib/. What actually seems to occur during PAM authentication is the Heimdal code in /usr/lib/ is initially being used, but part way through it switches to using the MIT kerberos code in /usr/local/lib/. I have reported this bug on the FreeBSD bug tracker here: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=225818 Any help troubleshooting this issue would be much appreciated. I suspect it has something to do with the CFLAGS and LDFLAGS being used during the build, so I have attached the build log to the FreeBSD bug report. Thanks in advance, Ben SCENARIO: - Build mail/dovecot with option GSSAPI_MIT (link against MIT kerberos from ports rather than Heimdal in base) - Configure dovecot for PAM authentication, using PAM service "imap": $ cat /usr/local/etc/dovecot/conf.d/10-auth.conf auth_mechanisms = plain passdb { driver = pam args = %s } userdb { driver = passwd } - Configure imap pam to authenticate against kerberos (and enable debugging): $ cat /etc/pam.d/imap auth sufficient pam_krb5.so debug account required pam_krb5.so debug RESULT: This results in a crash of the dovecot authentication worker before any kerberos messages are even exchanged. DIAGNOSIS: Reviewing the log output below, my explanation of the backtrace is below (cronological order / newest item last): - Dovecot had successfully performed pam_start(), the necessary pam_set_item(), and called pam_authenticate(pamh, 0) https://github.com/dovecot/core/blob/2.2.33.2/src/auth/passdb-pam.c#L158 - PAM called pam_sm_authenticate() in /usr/lib/libpam/modules/pam_krb5/pam_krb5.c which successfully got the user, ruser, service, principal, password, checked local user, and then ran krb5_get_init_creds_opt_set_default_flags https://github.com/freebsd/freebsd/blob/master/lib/libpam/modules/pam_krb5/… - Heimdal krb5_get_init_creds_opt_set_default_flags ran the Heimdal version of krb5_appdefault_time: https://github.com/freebsd/freebsd/blob/master/crypto/heimdal/lib/krb5/init… - Heimdal function krb5_appdefault_time ran the MIT kerberos version of krb5_appdefault_string: https://github.com/freebsd/freebsd/blob/master/crypto/heimdal/lib/krb5/appd… This is where the code path cross from using the Heimdal code to the MIT kerberos code, which it should not do. I know this, because the GDB backtrace shows the krb5_appdefault_string function called strdup in file appdefault.c:165, but the Heimdal appdefault.c file only has 140 lines. Reviewing the MIT kerberos code, the strdup function is indeed called at appdefault.c:165. Why did the Heimdal appdefault.c code call the MIT kerberos version of krb5_appdefault_string, when the Heimdal version was only 50 lines higher in the same appdefault.c file? ENVIRONMENT: $ dovecot -n # 2.2.33.2 (d6601f4ec): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 12.0-CURRENT amd64 zfs auth_debug = yes auth_debug_passwords = yes auth_krb5_keytab = /usr/local/etc/dovecot/dovecot.keytab auth_mechanisms = plain login gssapi auth_realms = WOODS.AM auth_verbose = yes mail_location = mdbox:/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = failure_show_msg=yes %s driver = pam } service auth-worker { drop_priv_before_exec = yes } ssl_cert = </usr/local/etc/ssl/mail.woods.am/fullchain.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } GDB BACKTRACE OF COREDUMP: $ gdb /usr/local/libexec/dovecot/auth GNU gdb (GDB) 8.0.1 [GDB v8.0.1 for FreeBSD] Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd12.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/libexec/dovecot/auth...done. (gdb) core /tmp/auth.core [New LWP 102627] warning: Can't read pathname for load map: Unknown error: -1. warning: Can't read pathname for load map: Unknown error: -1. warning: Can't read pathname for load map: Unknown error: -1. warning: Can't read pathname for load map: Unknown error: -1. Core was generated by `dovecot/auth -w'. Program terminated with signal SIGSEGV, Segmentation fault. #0 strlen (str=0x0) at /usr/src/lib/libc/string/strlen.c:100 warning: Source file is more recent than executable. 100 */ (gdb) bt #0 strlen (str=0x0) at /usr/src/lib/libc/string/strlen.c:100 #1 0x0000000012130022 in strdup (str=0x0) at /usr/src/lib/libc/string/strdup.c:46 #2 0x0000000011b65e9d in krb5_appdefault_string (context=0x10777000, appname=0x106f0018 "imap", realm=0x0, option=0x13b1f403 "ticket_lifetime", default_value=0x0, ret_value=0x7fffffffe088) at appdefault.c:165 #3 0x0000000013af4a80 in krb5_appdefault_time (context=0x0, appname=0xffffffffaaca6003 <error: Cannot access memory at address 0xffffffffaaca6003>, realm=0x50 <error: Cannot access memory at address 0x50>, option=0x0, def_val=0, ret_val=0x7fffffffe0e0) at /usr/src/crypto/heimdal/lib/krb5/appdefault.c:130 #4 0x0000000013ae3e79 in krb5_get_init_creds_opt_set_default_flags (context=0x10777000, appname=0x106f0018 "imap", realm=0x0, opt=0x1070f3c0) at /usr/src/crypto/heimdal/lib/krb5/init_creds.c:171 #5 0x00000000138b738f in ?? () #6 0x0000000000000000 in ?? () LOG OUTPUT: $ cat /var/log/maillog: Feb 11 09:20:40 mail dovecot: auth: Error: auth worker: Aborted PASSV request for woodsb02: Worker process died unexpectedly Feb 11 09:20:40 mail dovecot: auth-worker(34874): Fatal: master: service(auth-worker): child 34874 killed with signal 11 (core dumped) Feb 11 09:20:47 mail dovecot: imap-login: Disconnected (auth failed, 1 attempts in 7 secs): user=<woodsb02>, method=PLAIN, rip=192.168.1.13, lip=192.168.1.13, TLS, session=<GRJsRuxkf17AqAEN> $ cat /var/log/debug.log: Feb 11 09:20:35 mail dovecot: auth: Debug: auth client connected (pid=34853) [34/1991] Feb 11 09:20:40 mail dovecot: auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=GRJsRuxkf17AqAEN lip=192.168.1.13 rip=192.168.1.13 lport= 993 rport=24191 resp=AHdvb2RzYjAyAHRlc3Q= (previous base64 data may contain sensitive data) Feb 11 09:20:40 mail dovecot: auth-worker(34874): Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Feb 11 09:20:40 mail dovecot: auth-worker(34874): Debug: Module loaded: /usr/local/lib/dovecot/auth/lib20_auth_var_expand_crypt.so Feb 11 09:20:40 mail dovecot: auth-worker(34874): Debug: pam(woodsb02,192.168.1.13,<GRJsRuxkf17AqAEN>): lookup service=imap Feb 11 09:20:40 mail auth: in openpam_dispatch(): calling pam_sm_authenticate() in /usr/lib/pam_krb5.so.6 Feb 11 09:20:40 mail auth: in pam_get_user(): entering Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_USER Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_get_user(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Got user: woodsb02 Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_RUSER Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Got ruser: woodsb02 Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_SERVICE Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Got service: imap Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Context initialised Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Done krb5_cc_register() Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'auth_as_self' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Created principal: woodsb02 Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Done krb5_parse_name() Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Got principal: woodsb02(a)WOODS.AM Feb 11 09:20:40 mail auth: in pam_get_authtok(): entering Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_RHOST Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_HOST Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_OLDAUTHTOK Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'try_first_pass' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'use_first_pass' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'authtok_prompt' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in openpam_subst(): entering: 'Password:' Feb 11 09:20:40 mail auth: in openpam_subst(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'echo_pass' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in pam_vprompt(): entering Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_CONV Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_vprompt(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_set_item(): entering: PAM_AUTHTOK Feb 11 09:20:40 mail dovecot: auth-worker(34874): Debug: pam(woodsb02,192.168.1.13,<GRJsRuxkf17AqAEN>): #1/1 style=1 msg=Password: Feb 11 09:20:40 mail auth: in pam_set_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_get_item(): entering: PAM_AUTHTOK Feb 11 09:20:40 mail auth: in pam_get_item(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_get_authtok(): returning PAM_SUCCESS Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Got password Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'no_user_check' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in openpam_get_option(): entering: 'no_user_check' Feb 11 09:20:40 mail auth: in openpam_get_option(): returning NULL Feb 11 09:20:40 mail auth: in pam_sm_authenticate(): Done getpwnam() Feb 11 09:20:40 mail dovecot: auth-worker(34875): Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Feb 11 09:20:40 mail dovecot: auth-worker(34875): Debug: Module loaded: /usr/local/lib/dovecot/auth/lib20_auth_var_expand_crypt.so $ ldd /usr/local/libexec/dovecot/auth /usr/local/libexec/dovecot/auth: libstats_auth.so => /usr/local/lib/dovecot/stats/libstats_auth.so (0x80089a000) libdovecot.so.0 => /usr/local/lib/dovecot/libdovecot.so.0 (0x800a9c000) libcrypt.so.5 => /lib/libcrypt.so.5 (0x800e3a000) libpam.so.6 => /usr/lib/libpam.so.6 (0x801058000) libk5crypto.so.3.1 => /usr/local/lib/libk5crypto.so.3.1 (0x801265000) libcom_err.so.3.0 => /usr/local/lib/libcom_err.so.3.0 (0x8014b3000) libldap-2.4.so.2 => /usr/local/lib/libldap-2.4.so.2 (0x8016b6000) liblber-2.4.so.2 => /usr/local/lib/liblber-2.4.so.2 (0x8018fc000) libkrb5.so.3.3 => /usr/local/lib/libkrb5.so.3.3 (0x801b0b000) libgssapi_krb5.so.2.2 => /usr/local/lib/libgssapi_krb5.so.2.2 (0x801e27000) libc.so.7 => /lib/libc.so.7 (0x802090000) libkrb5support.so.0.1 => /usr/local/lib/libkrb5support.so.0.1 (0x802679000) libintl.so.8 => /usr/local/lib/libintl.so.8 (0x802888000) libssl.so.44 => /usr/local/lib/libssl.so.44 (0x802a93000) libcrypto.so.42 => /usr/local/lib/libcrypto.so.42 (0x802ce7000) $ ldd /usr/lib/pam_krb5.so.6 /usr/lib/pam_krb5.so.6: libkrb5.so.11 => /usr/lib/libkrb5.so.11 (0x801614000) libpam.so.6 => /usr/lib/libpam.so.6 (0x801892000) libc.so.7 => /lib/libc.so.7 (0x800826000) libasn1.so.11 => /usr/lib/libasn1.so.11 (0x801a9f000) libcom_err.so.5 => /usr/lib/libcom_err.so.5 (0x801d40000) libcrypt.so.5 => /lib/libcrypt.so.5 (0x801f42000) libcrypto.so.8 => /lib/libcrypto.so.8 (0x802200000) libhx509.so.11 => /usr/lib/libhx509.so.11 (0x80266e000) libroken.so.11 => /usr/lib/libroken.so.11 (0x8028bb000) libwind.so.11 => /usr/lib/libwind.so.11 (0x802ace000) libheimbase.so.11 => /usr/lib/libheimbase.so.11 (0x802cf6000) libprivateheimipcc.so.11 => /usr/lib/libprivateheimipcc.so.11 (0x802efa000) libthr.so.3 => /lib/libthr.so.3 (0x8030fc000) -- From: Benjamin Woods woodsb02(a)gmail.com

2 3

Using director but stick user to a fixed backend
by pw＠wk-serv.de 17 Feb '18

17 Feb '18

Hi everyone, I am using dovecot with a director setup for two backends. I want to add a third backend for use with the apple imap push plugin. Is there a way I can stick some users to this third backend and not using the director feature? Regards Patrick

2 1

Sieve to process list mail based on list-ID
by ＠lbutlr 17 Feb '18

17 Feb '18

Before I spend a lot of time trying to replicate a procmail script that automatically sorts list mail into mailboxes based on the List-ID header (and possibly some other data) I thought I'd check if someone had already done this for sieve. Basically, what I do now in procmail is 1. Get the listname from the List-ID header (or List-post/List-owner if no ID) 2. check against a list of list-ids and if the ID is not on the list, send it to spamc and put the message (if not spam) in the INBOX but mark it as seen, otherwise put it in Junk. 3. have some list specific rules (like rewriting reply-to, stripping subjected tags, etc. 4. Drop message in mailbox based no the ID. (so, dovecot mail goes into .dovecot/new but RandomFakelist gets scanned for spam and if it passes, marked read and put in the inbox). I've seen things like: if exists "List-Id" { if header :contains "List-Id" "dovecot.dovecot.org" { fileinto "dovecot"; } elsif header :contains "List-Id" "others-list.example.com" { fileinto "other-list"; } But I am looking for something more generic, along the lines of $myLists = {"dovecot", "postfix", "other-list") if header :contains "List-ID" "<([^\.])+." { $myID $1; } if $myList :contains $myID { if { $myID is other-list { set $myID to Olist; set header "reply-to" to "moderator@users+other@foo.example.net"; } fileinto $myID; } else { send message to spamc and await results; if spam {fileinto "Junk";} else {fileinto "INBOX";} (obviously that's not the code, but it should give an idea of the sorts of things I want to do and would rather not entirely duplicate. Obviously, I don't know if sieve does variables at all (none of the few example scripts I've looked at have them, but then again most procamil scripts don't have them either). Does sieve support that sort of matching?

4 4

trying to enable sieve
by Mathieu R. 17 Feb '18

17 Feb '18

i'm trying to enable sieve on my dovecot installation, but it seems i'm missing something. Managesieve is ok, i can mange script, but they have no effect at all i've got no error in logs, but no filter is applied here is my dovecot conf : # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.3 ext4 dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = onjase.org mail_location = maildir:/srv/vmail/%d/%n:INDEX=/srv/vmail/%d/%n/indexes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_allow_append_to_spam = no antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/bin/sa-learn antispam_pipe_program_args = --no-sync antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_spam = Junk antispam_trash = Trash antispam_verbose_debug = 1 quota = dict:%u::proxy::quota quota_rule = *:storage=10M:messages=1000 quota_warning = storage=99%% quota-warning 99 %u quota_warning2 = storage=97%% quota-warning 97 %u quota_warning3 = storage=95%% quota-warning 95 %u quota_warning4 = storage=90%% quota-warning 90 %u quota_warning5 = storage=85%% quota-warning 85 %u quota_warning6 = storage=80%% quota-warning 80 %u quota_warning7 = storage=75%% quota-warning 75 %u sieve = ~/dovecot.sieve sieve_before = /srv/vmail/global_sieve/ sieve_dir = ~/sieve } postmaster_address = postmaster(a)onjase.org protocols = " imap sieve pop3" quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { mode = 0666 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/letsencrypt/live/mail.onjase.org-0001/fullchain.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { mail_plugins = " sieve quota" } protocol imap { mail_max_userip_connections = 10 mail_plugins = " quota imap_quota antispam" }

2 1

`mail_crypt` Doesn't Appear to be Working
by jordan.h＠startmail.com 17 Feb '18

17 Feb '18

Dovecot version: 2.2.22 (fe789d2) I generated an EC key from the page https://wiki2.dovecot.org/Plugins/. For reference here's my /etc/dovecot/conf.d/10-mail-crypt.conf file: ---- mail_plugins = $mail_plugins mail_crypt plugin { # mail_crypt_global_private_key = </etc/dovecot/ecprivkey.pem mail_crypt_global_public_key = </etc/dovecot/ecpubkey.pem mail_crypt_save_version = 2 } ---- I saw in a previous message on this mailing list that messages can be encrypted without the private key, so it's stored elsewhere. :-) After restarting dovecot and sending myself a message I found that the message was still unencrypted. Nothing in /var/log/dovecot/*.log files or syslog indicated any problem loading the plugin (I even made some mistakes with the filename beforehand, and errors indicated it was trying to find the plugin). In case in matters dovecot was installed as part of the automated iredmail install (https://iredmail.org) I didn't modify the dovecot.conf file after installation (except for thinking I needed to add `mail_crypt` to `plugins`, then figuring I didn't). Any help is appreciated. Thank you.

2 1

Director & Master Users
by Travis Dolan 16 Feb '18

16 Feb '18

Hello, I have Director setup to proxy requests to backend servers. This works fine when using "standard" username/passwords. I am not try to enable the use of the Dovecot Master user through Director into the backend servers. a.) username is being sent as masteruser*username b.) request hits the proxy and authenticates, and then is passed to the backend servers and fails auth. - logs from proxy/Director point of view. auth: Info: passwd-file(masteruser,172.31.33.224,master,<z2eYD0Rl6P+sHyHg>): Master user logging in as devteam imap-login: Info: proxy(devteam): Login failed to backend.servers:143 (master masteruser): [AUTHENTICATIONFAILED] Authentication failed.: user=<devteam>, method=PLAIN, rip=172.31.33.224, lip=192.168.71.20, session=<z2eYD0R l6P+sHyHg> - logs from backend server point of view. imap-login: Info: Disconnected (auth failed, 1 attempts in 2 secs): user=<masterusername>, method=PLAIN, rip=192.168.71.20, lip=192.168.71.99, session=<O8QN8kNlloXAqEcU> Proxy/Director Configs (hopefully this is enough) auth_master_user_separator = * passdb { driver = passwd-file args = /etc/dovecot/conf.d/master-user-password master = yes pass = yes } passdb { driver = static args = proxy=y nopassword=y } Please let me know if I can provide any further details. Thanks in advance.

3 5

Selective authentication mechanism
by Brian Topping 16 Feb '18

16 Feb '18

Hi all! I have been using GSSAPI authentication method for all my externally reachable endpoints for some time under the theory that they cannot be hit with a dictionary attack. Unfortunately, this means iOS devices cannot log in since they (oddly) cannot use GSSAPI. I say “oddly” because desktop Mac mail can use GSSAPI just fine and https://samuelyates.wordpress.com/2013/10/11/kerberos-single-sign-on-in-ios… goes through how to set it up for web pages. In any event, what I’m looking to do is use a filter (https://wiki.dovecot.org/ConfigFile#Filters) around the auth_mechanisms such that it will allow plain authentication when the client is on a local network or the VPN. Unfortunately, the fine print on filters says "These filters work for most of the settings, but most importantly auth settings currently only support the protocol filter”. I guess it’s kind of academic, but I thought I’d ask why this is a limitation? If there is not a profound security reason to not support this, is this a good enough use case to consider it? Thanks! Brian

2 1

ACLs, shared, public, virtual mailboxes not working
by David Mehler 15 Feb '18

15 Feb '18

Hello, I'm running Dovecot 2.2.3, and am having issues with my public folders, shared folders, and virtual/ALl folders apparently ACLs are on that list as well. I was debugging an unrelated problem with my smtp server and got the following dovecot debug log output. Below is also a doveconf -n output as well as my shared-folder definition file and my global-acls file. What I'm trying to accomplish is: 1. Have a public folder that any user on the system can put messages into and respond to. 2. Have a shared folder in which user1(a)example.com and user1(a)example2.com can exchange messages. 3. For each user on the system give them a Virtual/All folder for *all of their messages. I'd appreciate any help. As an aside if anyone sees an issue with my SSL ciphers list i'd appreciate knowing that as well, in brief I'm trying to get the most secure list, pfs, and not worrying about backware compatibility. If it's not TLS 1.2 I don't touch it. Thanks. Dave. Feb 12 08:48:40 imap(user(a)example.com): Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so Feb 12 08:48:40 imap(user(a)example.com): Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so Feb 12 08:48:40 imap(user(a)example.com): Debug: Effective uid=999, gid=999, home=/home/vmail/example.com/user Feb 12 08:48:40 imap(user(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail/:LAYOUT=fs:INDEX=~/mail/ Feb 12 08:48:40 imap(user(a)example.com): Debug: fs: root=/home/vmail/example.com/user/mail, index=, indexpvt=, control=, inbox=/home/vmail/example.com/user/mail, alt= Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: initializing backend with data: vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: acl username = user(a)example.com Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: owner = 1 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: Global ACL file: /usr/local/etc/dovecot/global-acls Feb 12 08:48:40 imap(user(a)example.com): Debug: Namespace : type=public, prefix=public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public Feb 12 08:48:40 imap(user(a)example.com): Debug: fs: root=/home/vmail/public, index=/home/vmail/example.com/user/mail/public, indexpvt=/home/vmail/example.com/user/mail/public, control=/home/vmail/example.com/user/mail/public, inbox=, alt= Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: initializing backend with data: vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: acl username = user(a)example.com Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: owner = 0 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: Global ACL file: /usr/local/etc/dovecot/global-acls Feb 12 08:48:40 imap(user(a)example.com): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail/:INDEX=~/mail/shared/%Ld/%Ln Feb 12 08:48:40 imap(user(a)example.com): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: initializing backend with data: vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: acl username = user(a)example.com Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: owner = 0 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: Global ACL file: /usr/local/etc/dovecot/global-acls Feb 12 08:48:40 imap(user(a)example.com): Debug: Namespace : type=private, prefix=virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/usr/local/etc/dovecot/virtual Feb 12 08:48:40 imap(user(a)example.com): Debug: fs: root=/usr/local/etc/dovecot/virtual, index=, indexpvt=, control=, inbox=, alt= Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: initializing backend with data: vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: acl username = user(a)example.com Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: owner = 1 Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: Global ACL file: /usr/local/etc/dovecot/global-acls Feb 12 08:48:40 imap(user(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Drafts/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Spam/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Trash/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Sent/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Archives/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/logcheck/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/public/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: Mailbox 'public/TestFolder' matches global ACL pattern 'public/TestFolder' Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/public/TestFolder/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/virtual/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/.Junk/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/ham/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/fail2ban/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/.Sent/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/.Trash/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Maildir/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Maildir/public/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Maildir/public/.TestFolder/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Deleted Items/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Archive/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /home/vmail/example.com/user/mail/Junk/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: Mailbox 'public/TestFolder' matches global ACL pattern 'public/TestFolder' Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: reading file /home/vmail/public/TestFolder/dovecot-acl Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: reading file /home/vmail/public/TestFolder1/dovecot-acl Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: reading file /home/vmail/public/dovecot-acl Feb 12 08:48:40 imap(user(a)example.com): Debug: acl: No lookup right to mailbox: public/TestFolder1 Feb 12 08:48:40 imap(user(a)example.com): Debug: Namespace shared/: Using permissions from : mode=0700 gid=default Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /usr/local/etc/dovecot/virtual/dovecot-acl not found Feb 12 08:48:40 imap(user(a)example.com): Debug: acl vfile: file /usr/local/etc/dovecot/virtual/All/dovecot-acl not found doveconf -n # 2.2.33.2 (d6601f4ec): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: FreeBSD 11.1-RELEASE-p4 amd64 auth_default_realm = example.com auth_mechanisms = plain login auth_realms = example.com example2.com dict { acl = mysql:/usr/local/etc/dovecot/shared-folders.conf sqlquota = mysql:/usr/local/etc/dovecot/quota.conf } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.example.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 xxx.xxx.xxx.xxx lmtp_rcpt_check_quota = yes mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/mail/:LAYOUT=fs:INDEX=~/mail/ mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib mail_server_admin = mailto:postmaster@example.com mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:~/mail/:INDEX=~/mail/shared/%%Ld/%%Ln prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = virtual:/usr/local/etc/dovecot/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } prefix = virtual/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/sieve/sieve_error.log trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap { executable = imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ssl/acme/example.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256@STRENGTH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib sieve } protocol imap { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login } shared-folders.conf connect = DatabaseConnectionParameters # For shared mailboxes map { pattern = shared/shared-boxes/user/$to/$from table = user_shares value_field = dummy fields { from_user = $from to_user = $to } } # To share mailbox to anyone uncomment acl_anyone=allow in # 90-acl.conf map { pattern = shared/shared-boxes/anyone/$from table = anyone_shares value_field = dummy fields { from_user = $from } } global-acls public/TestFolder user=user lrwstipekxa

2 4

Segfault on selecting mailbox twice in a row
by John van der Kamp 15 Feb '18

15 Feb '18

Hi, I was doing some testing with new 2.2 changes. I’m using commit 15d5b8a from origin/master-2.2. The setup is using imapc to connect to a different imap server. If I use the following commands, dovecot will crash every time: A login username password B select inbox C select inbox The logfile snippit is at the end of the mail. Let me know if you need more information. John ---- Feb 15 15:43:06 imap(user1(a)domain.com): Debug: imapc: root=/tmp/tmpVuVTYr/dovecot1/users/user1(a)domain.com/imapc, index=, indexpvt=, control=, inbox=, alt= Feb 15 15:43:06 imap(user1(a)domain.com): Debug: maildir++: root=/tmp/tmpVuVTYr/dovecot1/users/user1(a)domain.com/imapc, index=, indexpvt=, control=, inbox=, alt= Feb 15 15:43:09 imap(user1(a)domain.com): Debug: INBOX: Mailbox opened because: SELECT Feb 15 15:43:12 imap(user1(a)domain.com): Debug: INBOX: Mailbox opened because: SELECT Feb 15 15:43:14 imap(user1(a)domain.com): Error: Log synchronization error at seq=2,offset=80372 for /tmp/tmpVuVTYr/dovecot1/users/user1(a)domain.com/imapc/.INBOX/dovecot.index: Append with UID 10, but next_uid = 10421 Feb 15 15:43:14 imap(user1(a)domain.com): Warning: fscking index file /tmp/tmpVuVTYr/dovecot1/users/user1(a)domain.com/imapc/.INBOX/dovecot.index Feb 15 15:43:14 imap(user1(a)domain.com): Warning: imapc(127.0.0.1:31513): Mailbox 'INBOX' state corrupted: Expunged message uid=10 reappeared - reconnecting (delay 0 ms) Feb 15 15:43:14 imap(user1(a)domain.com): Debug: imapc(127.0.0.1:31513): Disconnected Feb 15 15:43:14 imap(user1(a)domain.com): Debug: imapc(127.0.0.1:31513): Looking up IP address (reconnect_ok=false, last_connect=1518705794) Feb 15 15:43:14 imap(user1(a)domain.com): Debug: imapc(127.0.0.1:31513): Connecting to 127.0.0.1:31513 Feb 15 15:43:14 imap(user1(a)domain.com): Panic: file imapc-client.c: line 410 (imapc_client_mailbox_reconnect): assertion failed: (!box->reconnecting) Feb 15 15:43:14 imap(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x9fe12) [0x7f2a05301e12] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x9fefd) [0x7f2a05301efd] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f2a052924d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x99704) [0x7f2a0562f704] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(imapc_mailbox_set_corrupted+0xe3) [0x7f2a05628e63] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x97cf5) [0x7f2a0562dcf5] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x97d70) [0x7f2a0562dd70] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(imapc_mailbox_sync_init+0x8bd) [0x7f2a0562e89d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x44) [0x7f2a055e1c14] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f2a055e1cb7] -> dovecot/imap(cmd_select_full+0x171) [0x413e51] -> dovecot/imap(command_exec+0x5c) [0x41b06c] -> dovecot/imap() [0x419662] -> dovecot/imap() [0x4196ec] -> dovecot/imap(client_handle_input+0x155) [0x419a85] -> dovecot/imap(client_input+0x82) [0x419ff2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2a053180d2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f2a053197c9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0x7f2a0531816c] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f2a05318318] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f2a0529cd93] -> dovecot/imap(main+0x302) [0x40cb92] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f2a04eb8830] -> dovecot/imap(_start+0x29) [0x40cd19] Feb 15 15:43:14 imap(user1(a)domain.com): Fatal: master: service(imap): child 9496 killed with signal 6 (core dumped)

2 1

Re: Problem with CentOS package for 2.3.0 and old dependency in systemd with clean install
by TG Servers 15 Feb '18

15 Feb '18

Ok thanks, for the moment : can I just delete the lines in the dovecot-init.service file or what is proposed here? It's no problem for me to make the necessary changes I just need to know which of them because I don't know if you just need this fiel internally or not. Thanks Am 14.02.2018 um 21:28 schrieb Aki Tuomi: > We are planning to fix this for 2.3.1 release. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: TG Servers <srvrs(a)prvtmail.net> > Date: 14/02/2018 22:10 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Problem with CentOS package for 2.3.0 and old dependency in > systemd with clean install > > Hi, > > are there any news on this? > Or do we have to go the way install old dovecot/remove it or upgrade > instead of clean install? > Because as the ssl-params executaböe is missing in 2.3.0 I don't know > how else I should create it. If this file isn't even needed for 2.3.0 > can it be a file with any content eg 'touch > /var/lib/dovecot/ssl-parameters.dat' so that the file is just there and > dovecot-init.servive doesn't want to call the > /usr/libexec/dovecot/ssl-params executable? > > Thanks, > Thomas > > Am 02.02.2018 um 09:26 schrieb Aki Tuomi: >> >>> On February 2, 2018 at 5:09 AM TG Servers wrote: >>> >>> >>> Hi, >>> >>> you definitely have a problem with the packages out of your own repo for >>> version 2.3.0 and CentOS. >>> And this is only if you do a clean install, meaning there was no lower >>> dovecot version ever running on the system. >>> >>> If you want to 'systemctl start dovecot' it breaks with a dependency >>> error which comes from dovecot-init.service. >>> >>> dovecot-init.service : >>> [Unit] >>> Description=One-time Dovecot init service >>> ConditionPathExists=|!/var/lib/dovecot/ssl-parameters.dat >>> ConditionPathExists=|!/etc/pki/dovecot/certs/dovecot.pem >>> >>> [Service] >>> Type=oneshot >>> RemainAfterExit=no >>> ExecStart=/bin/sh -c '\ >>> if [ ! -f /etc/pki/dovecot/certs/dovecot.pem ]; \ >>> then\ >>> SSLDIR=/etc/pki/dovecot/ >>> OPENSSLCONFIG=/etc/pki/dovecot/dovecot-openssl.cnf >>> /usr/libexec/dovecot/mkcert.sh /dev/null 2>&1;\ >>> fi;\ >>> if [ ! -f /var/lib/dovecot/ssl-parameters.dat ]; \ >>> then\ >>> /usr/libexec/dovecot/ssl-params >/dev/null 2>&1; \ >>> fi' >>> >>> It wants to call /usr/libexec/dovecot/ssl-params if >>> /var/lib/dovecot/ssl-parameters.dat (which is deprecated now as I >>> understood) is not existing. >>> The problem is in 2.3.0 /usr/libexec/dovecot/ssl-params is not existent >>> anymore. >>> >>> This error does not occur if you for instance install 2.2.x from the >>> base repo, start it once, and then update the version from your repo. >>> This is because the ssl-parameters.dat was created with the old version >>> then. >>> >>> But this should not be the expected behaviour I think. It should be >>> possible to do a fresh install of 2.3.0 on a fresh system. >>> >>> Can you please get back to me on that? >>> >>> Thanks, >>> Thomas >> >> >> Thank you for reporting this, we'll look into it. >> >> --- >> Aki Tuomi >> >> Dovecot oy >>

2 1

doveadm with wildcard users?
by ＠lbutlr 15 Feb '18

15 Feb '18

# 2.2.33.2 (d6601f4ec): If I do doveadm index -u user "*" for a local user, it works fine, but if I do doveadm -u "*(a)sqldomain.tld" "*" or doveadm -u "*(a)localaliasdomain.tld" "*" or doveadm -u "*(a)localdomain.tld" "*" or doveadm -u "user(a)localdomain.tld" "*" it fails, … -u "user(a)sqldomain.tld" Seems to work <https://wiki2.dovecot.org/Tools/Doveadm/Index> -u user/mask Run the command only for the given user. It's also possible to use '*' and '?' wildcards (e.g. -u *(a)example.org)

2 4

Problem with CentOS package for 2.3.0 and old dependency in systemd with clean install
by TG Servers 14 Feb '18

14 Feb '18

Hi, you definitely have a problem with the packages out of your own repo for version 2.3.0 and CentOS. And this is only if you do a clean install, meaning there was no lower dovecot version ever running on the system. If you want to 'systemctl start dovecot' it breaks with a dependency error which comes from dovecot-init.service. dovecot-init.service : [Unit] Description=One-time Dovecot init service ConditionPathExists=|!/var/lib/dovecot/ssl-parameters.dat ConditionPathExists=|!/etc/pki/dovecot/certs/dovecot.pem [Service] Type=oneshot RemainAfterExit=no ExecStart=/bin/sh -c '\ if [ ! -f /etc/pki/dovecot/certs/dovecot.pem ]; \ then\ SSLDIR=/etc/pki/dovecot/ OPENSSLCONFIG=/etc/pki/dovecot/dovecot-openssl.cnf /usr/libexec/dovecot/mkcert.sh /dev/null 2>&1;\ fi;\ if [ ! -f /var/lib/dovecot/ssl-parameters.dat ]; \ then\ /usr/libexec/dovecot/ssl-params >/dev/null 2>&1; \ fi' It wants to call /usr/libexec/dovecot/ssl-params if /var/lib/dovecot/ssl-parameters.dat (which is deprecated now as I understood) is not existing. The problem is in 2.3.0 /usr/libexec/dovecot/ssl-params is not existent anymore. This error does not occur if you for instance install 2.2.x from the base repo, start it once, and then update the version from your repo. This is because the ssl-parameters.dat was created with the old version then. But this should not be the expected behaviour I think. It should be possible to do a fresh install of 2.3.0 on a fresh system. Can you please get back to me on that? Thanks, Thomas

2 3

Documentation Bug
by Andrew Beck 13 Feb '18

13 Feb '18

In https://wiki2.dovecot.org/Tools/Doveadm/Sync#section_arguments the destination list 5 possible options for the destination but in the page on migration https://wiki2.dovecot.org/Migration/Dsync it seems to use a sixth undocumented "imapc:" option for destination e.g. doveadm -o mail_fsync=never backup -R -u user@domain imapc: "imapc:" is also referenced on https://wiki2.dovecot.org/Migration/Gmail Is https://wiki2.dovecot.org/Tools/Doveadm/Sync#section_arguments missing this option? Andrew

3 2

deny passdb match messages logged only with auth_verbose=yes
by Marco Giunta 13 Feb '18

13 Feb '18

Hi at all, using deny passwd to restrict IMAP/POP3 access (https://wiki.dovecot.org/Authentication/RestrictAccess) I get deny passdb match messages: Feb 13 16:09:33 server-02 dovecot: auth: passwd-file(USERNAME,10.10.10.46,<9hzaYRllbsCTehgu>): User found from deny passdb only with auth_verbose=yes, sets global or defined in passdb block. But if I set auth_verbose=yes, for every user not present in passwd-file, Dovecot logs: Feb 13 16:09:57 server-02 dovecot: auth: passwd-file(USERNAME,10.10.10.46,<9hzaYRllbsCTehgu>): unknown user I know that if the account does not exist in the first passdb (deny passdb), then the error occur, even if it exists in the other passdb. This is normal, but auth_verbose shouldn't be used only to " Log unsuccessful authentication attempts and the reasons why they failed." ?? Again, I'm not a programmer, but 'auth_request_log_info' function in 'https://github.com/dovecot/core/blob/release-2.2.33/src/auth/auth-request.c' seems to log events only when 'auth_verbose=yes'. Is there another way to get deny passdb match messages, without enable verbose log ? Thanks, Marco -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244

1 0

Certificate of package repository expired
by Marc Weustink 13 Feb '18

13 Feb '18

Hi, I just happened to do an apt update and got a notice that repo.dovecot.org was disabled. According to firefox: repo.dovecot.org uses an invalid security certificate. The certificate expired on dinsdag 13 februari 2018 12:48. The current time is dinsdag 13 februari 2018 16:39. Thanks, Marc

2 2

dovecot: master: Panic: kevent() failed: Invalid argument
by Adrian Gonzalez 13 Feb '18

13 Feb '18

Hello I've been seeing these panics with dovecot 2.2.31 (and older versions) under FreeBSD about once every 2-3 months or so. I know it's been discussed here in the list, but I didn't see a definitive fix. If it's been fixed, please ignore this post (sorry!). I finally managed to observe the bug on a server that has the patch that prints out the kevent() timespec values and got: Nov 29 16:46:27 mail dovecot: master: Panic: kevent(events=74, ts=59.1000000000) failed: Invalid argument Looking through the code, the panic is triggered in io_loop_handler_run_internal(). The timeout values for the kevent() call are obtained by calling io_loop_get_wait_time(), which in turn calls timeout_get_wait_time() (both in ioloop.c). The timeout is computed by subtracting the value returned by gettimeofday() from timeout->next_run, and it looks like in very rare cases the result in tv_r->tv_usec is 1000000uS (1 second). So, it seems that if gettimeofday() returns exactly 0 microseconds, and timeout->next_run has exactly 1000000 microseconds, the kevent() call will fail (1 in 1e12 chance?). I'm not entirely sure where timeout->next_run is computed, but looking at timeout_update_next(), it adjusts the seconds only if the microseconds are greater than 1000000: (ioloop.c, line 235) if (timeout->next_run.tv_usec > 1000000) { timeout->next_run.tv_sec++; timeout->next_run.tv_usec -= 1000000; } It seems like the comparison here should be greater or equal, but I'm not familiar enough with the code to say with absolute certainty. I added more debug error messages to the code in timeout_update_next(), and although I do see next_run->tv_usec at 1000000 several times a day, I haven't seen a panic since early December on any of our servers, so I decided to post this to see if this analysis makes sense.

2 1

Setting up sieve with spam learning
by ＠lbutlr 13 Feb '18

13 Feb '18

Cribbing from the dovecot site I recently added the following lines to my dovecot.conf: managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocol imap { mail_plugins = " virtual imap_sieve" } Now, should I see the report-spam or report-ham sieve's logged anywhere? Because I am not seeing them.

2 4

"search return (min)" is very inefficient
by Jesus Cea 13 Feb '18

13 Feb '18

RFC 4731: " IMAP4 Extension to SEARCH Command for Controlling What Kind of Information Is Returned" https://tools.ietf.org/html/rfc4731 I do this (telnet session): """ a select proveedores/TUHS * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 8330 EXISTS * 0 RECENT * OK [UNSEEN 6085] First unseen. * OK [UIDVALIDITY 1395814416] UIDs valid * OK [UIDNEXT 8358] Predicted next UID * OK [HIGHESTMODSEQ 3149] Highest a OK [READ-WRITE] Select completed (0.264 + 0.000 + 0.263 secs). a search return (min) since 01-Feb-2018 * ESEARCH (TAG "a") MIN 8156 a OK Search completed (59.451 + 0.000 + 59.450 secs). """ Note that it needs 59 seconds to locate the first message matching the "since" criteria. This is really slow and unusable in practice. Things are worse with bigger mailboxes, of course. Am I missing some performance trick?. I am trying to locate the first message received after a particular date. I don't use the "date" header because it can be falsified and because I care about the receiving date and not the actual sending date. I guess dovecot is scanning every message in the folder (mailbox). Wouldn't those messages be stored in ascending "received" order?. Could that be used for bisection search to locate the right message?. Could that break if I copy/move/edit messages?. Is that the reason for such a awful performance?. Suggestions?. Thanks for your time and knowledge!. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 0

mailbox_list_index documentation?
by tai74＠vfemail.net 12 Feb '18

12 Feb '18

I find mailbox_list_index on some doc pages, but not explaination to find what precisely it does? Would someone care to mind explain? Thank you! ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

2 1

New mail notification
by Matthew Allen 12 Feb '18

12 Feb '18

Hi, So I'm running dovecot 1.2.17 on Mac OSX using maildir in ~/Mail. After using getmail for a while to download my POP3 email and store it in the right place it started not working so I replaced it with a python script that I wrote. All was good for a while and then I stopped getting new mail notifications in my IMAP client. If I close the connection and restart the new mail shows up as !seen but no amount of re-selecting the folder will show the new mail while the connection is active. There is no untagged responses about new mail while the client is IDLEing. The client is InScribe (http://memecode.com/inscribe.php) but I doubt it's client specific. Seems to be server related. Now the python script in question just puts the .eml file in ~/Mail/tmp and then renames it to the ~/Mail/new folder. Does it need to do something else as well to make the notifications work? There aren't any error messages in the log. Just normal login history. If you can point me in the right direction that'd be appreciated. Regards

2 1

Best mail encryption solution for per-user
by tai74＠vfemail.net 11 Feb '18

11 Feb '18

Hai, Do you have advice about Dovecot plugins for mail encryption: https://wiki2.dovecot.org/Plugins/MailCrypt https://0xacab.org/riseuplabs/trees I like NaCL based encryption but the MailCrypt plugin is better because it's maintained by Dovecot developers (is this correct?) Hard to understand MailCrypt docs so may I ask, may I provide per user encryption? I don't like global because I want every user to have different encryption based on their password. But I don't see the useful of per-folder encryption. Docs for TREES are easier to understand it will work on a per-user encryption using the user password to decrypt the needed keys. How about indexing? Does native fast Dovecot indexing must be turned off for one of these or both? Is this a big performance hit? And how to turn off indexing on a per-user basis? Thank you so very mcuh ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

2 5

LDAP userdb and dovecot LDA/LMTP - different requirements
by Franta Hanzlík 10 Feb '18

10 Feb '18

Hi, I want to use Dovecot LDA (or rather LMTP) use as local deliver with Postfix MTA. Users are in LDAP DB with structure as: dn: cn=username, ou=rank, o=myorg cn: username objectClass: Person gidNumber: uNNN uidNumber: gNNN userPassword: (somehow hashed, can only bind verification) homeDirectory: /Home/$rank/$username mailActive: 0/1 mail: usera@OneDomain mail: userb@SecDomain (not all users have 2+ addresses] uid: username groupMembership: group DN (can be multiple times for different groups) ... where: - cn = uid = expected IMAP login username (which hasn't @domain part) - user1 (and user2) isn't always same as username Now I not know, how to solve IMO diferent requirements to userdb: - LDA/LMTP need LDAP userdb unit, that can retrieve the name from an email address (ie for "usera@myDomain" returns cn/uid (as dovecot "username"). - IMAP server need LDAP userdb unit, that will have the user login (username) as the input parameter, and which returns information whether or not the user exists. Can be these different requirements solved in one userdb unit? Or is it possible to have one userdb unit for LDA/LMTP, and another one for IMAP and other Dovecot components? I have also encountered entries getting the values from LDAP userdb in the form as: user_attrs = \ =user=%{ldap:uid}, \ @mail=base(%{ldap:mailDN}), \ =uid=%{ldap:uidNumber@mail}, \ =gid=%{ldap:gidNumber@mail}, \ =home=%{ldap:rootPath@mail}/%d/%n or user_attrs = \ =home=%{ldap:homeDirectory}, \ =uid=%{ldap:uidNumber}, =gid=%{ldap:gidNumber}, =quota_rule=*:bytes=%{ldap:quotaBytes}, =namespace/default/separator=%{ldap:mailSeparator} Can anyone explain how these constructions work? And what do mean attribute notations in the form '=attr=' or '@attr=' or 'quota_rule=*:storage=100M' ? Nowhere have I found a sufficiently comprehensible description of these constructions... Help very much appreciated. Thanks, Franta Hanzlik

2 2

doveadm mailbox delete: Wrong docs or bug?
by MRob 09 Feb '18

09 Feb '18

Uhhhhh?? doveadm mailbox delete -u myuser -r -s foldername mailbox: invalid option -- 'r' Docs say -r is recursive. So how do I delete recursive mailbox?? https://wiki2.dovecot.org/Tools/Doveadm/Mailbox

1 0

VarExpandCrypt plugin usecase
by tai74＠vfemail.net 09 Feb '18

09 Feb '18

Hai, I found VarExpandCrypt plugin but not sure the usecase? Somewhere is more documentation for it? https://wiki2.dovecot.org/Plugins/VarExpandCrypt ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

2 1

Bounced message after update
by Michael A. Peters 09 Feb '18

09 Feb '18

Hi - Updated from 2.2.27 to 2.3.0 server is webmail (roundcube) Sending worked before after update. Now it receives, but trying to send - this is the bounce in the log Feb 9 01:37:45 {hostname} postfix/pipe[22891]: 931FD2577: to=<{user}(a){hostname}.{tld}>, relay=dovecot, delay=0.01, delays=0/0/0/0, dsn=5.3.0, status=bounced (command line usage error. Command output: lda: Fatal: Invalid -f parameter: Missing domain ) Feb 9 01:37:45 deviant postfix/qmgr[16492]: 931FD2577: removed {hostname}, {user}, {tld} are substitutions. Here's my lda config: protocol lda { log_path = /home/{hostname}/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster(a){hostname}.{tld} } Any suggestions (other than reverting) ? This worked just before the update. If it matters, Roundcube 1.3.4

1 1

How to grant user access to his .dovecot.sieve.log?
by Sergey Ivanov 08 Feb '18

08 Feb '18

Hi, What are the recommended ways to give access to their .dovecot.sieve.log messages to the users? I am thinking about placing this file into users Maildir/new, or piping to dovecot-lda. -- Regards, Sergey Ivanov

3 6

Dovecot 2.3.0 assertion failure on LMTP delivery
by J. Nick Koston 08 Feb '18

08 Feb '18

Hi, We are seeing a frequent assertion failure on LMTP delivery with 2.3.0. This only appears to happen on CentOS/RHEL 7. Jan 24 08:30:58 smoker-devautomerge-c7-1 dovecot: lmtp(29540): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 08:30:58 smoker-devautomerge-c7-1 dovecot: lmtp(29540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xc8ec4) [0x7f226d036ec4] -> /usr/lib64/dovecot/libdovecot.so.0(+0xc8f7e) [0x7f226d036f7e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f226cfaa190] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe469b) [0x7f226d05269b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_service_user_unref+0xb4) [0x7f226d334b64] -> dovecot/lmtp(+0x63fa) [0x56438f3673fa] -> dovecot/lmtp(lmtp_local_deinit+0x5c) [0x56438f3678dc] -> dovecot/lmtp(client_state_reset+0x1a) [0x56438f366a5a] -> /usr/lib64/dovecot/libdovecot.so.0(smtp_server_connection_reset_state+0x3c) [0x7f226cfc196c] -> /usr/lib64/dovecot/libdovecot.so.0(smtp_server_command_completed+0x4d) [0x7f226cfbf31d] -> /usr/lib64/dovecot/libdovecot.so.0(+0x54848) [0x7f226cfc2848] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf0970) [0x7f226d05e970] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f226d04e4b5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7f226d04fd8f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f226d04e5b2] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f226d04e7d8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f226cfccbb3] -> dovecot/lmtp(main+0x226) [0x56438f3661a6] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f226cbccc05] -> dovecot/lmtp(+0x52d5) [0x56438f3662d5] Jan 24 08:30:58 smoker-devautomerge-c7-1 dovecot: lmtp(29540): Fatal: master: service(lmtp): child 29540 killed with signal 6 (core dumps disabled) From the exim log: 'LOG: MAIN cwd=/usr/local/cpanel 3 args: /usr/sbin/sendmail -v bob(a)l56ob1nf.cptestLOG: MAIN <= root(a)smoker-devautomerge-c7-2.dev.cpanel.net U=root P=local S=3146285 T="Ignore this test from Cpanel-Email-Message-Retrieve.t"LOG: MAIN cwd=/var/spool/exim 4 args: /usr/sbin/exim -v -Mc 1eemjH-0006uB-C2delivering 1eemjH-0006uB-C2 LMTP<< 220 smoker-devautomerge-c7-2.dev.cpanel.net Dovecot ready. LMTP>> LHLO smoker-devautomerge-c7-2.dev.cpanel.net LMTP<< 250-smoker-devautomerge-c7-2.dev.cpanel.net LMTP<< 250-8BITMIME LMTP<< 250-CHUNKING LMTP<< 250-ENHANCEDSTATUSCODES LMTP<< 250-PIPELINING LMTP<< 250-STARTTLS LMTP<< 250-VRFY LMTP<< 250 XCLIENT ADDR PORT PROTO HELO LOGIN TTL TIMEOUT LMTP>> MAIL FROM:<root(a)smoker-devautomerge-c7-2.dev.cpanel.net> LMTP<< 250 2.1.0 OK LMTP>> RCPT TO:<bob(a)l56ob1nf.cptest> LMTP<< 250 2.1.5 OK LMTP>> DATA LMTP<< 354 OK LMTP>> writing message and terminating "." LMTP>> QUIT LOG: MAIN == bob(a)l56ob1nf.cptest R=virtual_user T=dovecot_virtual_delivery defer (-1): LMTP connection closed after end of data’, Jan 24 10:00:55 smoker-devautomerge-c7-1 dovecot: lmtp(30217): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:00:55 smoker-devautomerge-c7-1 dovecot: lmtp(30233): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:15 smoker-devautomerge-c7-1 dovecot: lmtp(32618): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(375): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(403): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(424): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(430): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:32:16 smoker-devautomerge-c7-1 dovecot: lmtp(4435): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:54:53 smoker-devautomerge-c7-1 dovecot: lmtp(15232): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:54:53 smoker-devautomerge-c7-1 dovecot: lmtp(15238): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:54:53 smoker-devautomerge-c7-1 dovecot: lmtp(15244): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) doveconf -n: # 2.3.0 (c8b89eb): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.2.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_cache_size = 1 M auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes lmtp_user_concurrency_limit = 4 mail_access_groups = dovecot mail_plugins = quota quota_clone zlib mail_prefetch_count = 20 maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = create special_use = \Junk } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict result_failure = return-fail } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword skip = authenticated } plugin { acl = vfile:cache_secs=86400 quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded } protocols = lmtp imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 500 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u/sent prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u/spam prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota quota quota_clone virtual zlib namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u/sent prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u/spam prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } local_name smoker-devautomerge-c7-1.dev.cpanel.net { ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_key = # hidden, use -P to show it }

3 3

stats-writer failed: Permission denied
by Jakobus Schürz 08 Feb '18

08 Feb '18

Hi there! Since i compile my own dovecot (not using dovecot from debian), i get this error on each startup dovecot with systemd Feb 07 11:16:35 aldebaran dovecot[7455]: imap: Error: net_connect_unix(/usr/local/var/run/dovecot/stats-writer) failed: Permission denied Feb 07 11:16:35 aldebaran dovecot[7455]: imap: Error: net_connect_unix(/usr/local/var/run/dovecot/stats-writer) failed: Permission denied I can change the owner and/or permissions of the file, than it works till the next reboot. How can i set this correctly in my configs? Some googling didn't give me results for this error. jakob

2 1

Cannot delete IMAP Mail-Folder in Trash
by Gabriel Kaufmann 08 Feb '18

08 Feb '18

Hello, I've noticed an annoying problem. Trying to delete a folder that has been deleted on IMAP and is moved to trash has problems being deleted. Thunderbird reports: "Folder contains children" and stops there. Folder at first disappears. But after restarting Thunderbird they are still there and on Dovecot-Mailbox folder on the server the folders are also still present. I'm using Dovecot 2.2.18 + Thunderbird + FS-Layout. I already tried this workaround-mode: > /protocol imap { //imap_client_workarounds = tb-extra-mailbox-sep //}/ best regards Gabriel Kaufmann _____________________________ TYPOWORX ΝΞШ.ΜΞDIΑ Gabriel Kaufmann Siegfriedstraße 38 | 38106 Braunschweig USt.Id Nr. DE-268606152 *T*elefon:0531-2521800*F*ax:0531-2326411 + Internetseiten | Web-Entwicklung | PHP | CMS | TYPO3 | Microsites* +* Webhosting | Linux-Systemadministration www.typoworx.de <http://www.typoworx.de/> Facebook <http://www.facebook.com/pages/Typoworx-New-Media/134047336639842> XING <https://www.xing.com/profile/Gabriel_Kaufmann> Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

6 8

Re: Cannot delete IMAP Mail-Folder in Trash
by Gabriel Kaufmann 08 Feb '18

08 Feb '18

> I have the same Problem with thunderbird on Linux. > > It looks like thunderbirds imap-implementation is a little bit broken. > Even if thunderbird tried once to get a mailbox, it persists in the > profile. > > I have FS-Layout in dovecot. Thunderbird somtimes try to get a > submailbox with INBOX/firstlevel^secondlevel^thirdlevel > > Then it doesn't find this mailbox on the server (for sure, it's > INBOX/firstlevel/secondlevel/thirdlevel) tb tries to get next > > INBOX/firstlevel^^secondlevel^^thirdlevel > > and then INBOX/firstlevel^^^^secondlevel^^^^thirdlevel and so on. And > on each first login, tb tries to get all of them again and again... > > > Go to $TB-profilefolder/ImapMail/ and delete all of the *.msf files > and search for the wrong mailboxes, described above... you will finde > them. > > And they are probably also in some config-files in the profile. > user.prefs i think, and panacea.dat i could find them. > > Delete all of the entries (be careful). Close and restart firefox. > Good look, the phantom-folders are gone. > > > jakob I tried that. In addition to that I did Trash -> Context-Menu -> Settings and "Repair". I also deleted Trash.sdb and Trash.msf in ImapMail-Dir of given Mailbox (after closing Thunderbird of course and restart afterwards). I think the repair-button does more or less the same than deleting msf-files. Trash was rebuilding... but the Folders are still there. I was able to get rid of some other "Junk folders" (that not even where shown in my Thunderbird-Trash inside Trash.sdb folder). But the folders causing current issue are still present after sync! And on server-side (vmail Mailbox on imap-server) these folders are also there! I'm still not able to delete them in Thunderbird. Still getting error Folder contains children, delete them first". Obviously this isn't possible as those sub-folders are not shown in Thunderbird! On server-side of imap (vmail Mailbox) there are in fact sub-folders in those folders. Best regards Gabriel Kaufmann

1 0

2.3.1/0.5.1?
by Larry Rosenman 07 Feb '18

07 Feb '18

Timo & Company, There have been a ton of fixes since 2.3.0. Is there a 2.3.1 of Dovecot and 0.5.1 of pigeonhole on the near horizon? Thanks! (Your FreeBSD Port Maintainer for Pigeonhole) -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

2 1

dovecot-2.22.33.2, segfault on empty emails
by Marcin Mirosław 07 Feb '18

07 Feb '18

Hello! I'm using maildir format with zlib_save=bz2. Here is the way how I generate empty mails and this leads to segfault: create empty message: # echo -n "" | /usr/libexec/dovecot/dovecot-lda -d marcin(a)mejor.pl this creates empy email in maildir (size 14B): # ls -l 1518011524.M96165P15900.jowisz\,S\=0\,W\=0\:2\, -rwxrw----+ 1 mail mail 14 Feb 7 14:52 '1518011524.M96165P15900.jowisz,S=0,W=0:2,' # file 1518011524.M96165P15900.jowisz\,S\=0\,W\=0\:2\, 1518011524.M96165P15900.jowisz,S=0,W=0:2,: bzip2 compressed data, block size = 200k next I'm accesing to Inbox, deleting mail using Thunderbird. Since message is moved to Trash I'm getting segfaults, backtrace: Reading symbols from /usr/libexec/dovecot/imap...Reading symbols from /usr/lib64/debug//usr/libexec/dovecot/imap.debug...done. done. [New LWP 16520] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal SIGABRT, Aborted. #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51 } (gdb) #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007f744769e12a in __GI_abort () at abort.c:89 #2 0x00007f7447adab79 in default_fatal_finish (type=LOG_TYPE_PANIC, status=status@entry=0) at failures.c:201 #3 0x00007f7447adacd3 in i_internal_fatal_handler (ctx=0x7ffc16d911e0, format=<optimized out>, args=<optimized out>) at failures.c:670 #4 0x00007f7447a5108c in i_panic (format=format@entry=0x7f7447e9ed40 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 #5 0x00007f7447e85108 in mail_index_transaction_get_uid (t=t@entry=0x55a2a17c3c30, seq=<optimized out>) at mail-index-transaction-finish.c:185 #6 0x00007f7447e8517a in mail_index_convert_to_uids (t=t@entry=0x55a2a17c3c30, array=array@entry=0x55a2a17e2c90) at mail-index-transaction-finish.c:205 #7 0x00007f7447e858df in mail_index_transaction_convert_to_uids (t=0x55a2a17c3c30) at mail-index-transaction-finish.c:313 #8 mail_index_transaction_finish (t=t@entry=0x55a2a17c3c30) at mail-index-transaction-finish.c:345 #9 0x00007f7447e8b783 in mail_index_transaction_commit_real (commit_size_r=0x7ffc16d91490, t=0x55a2a17c3c30) at mail-index-transaction.c:197 #10 mail_index_transaction_commit_v (t=<optimized out>, result_r=0x7ffc16d91480) at mail-index-transaction.c:239 #11 0x00007f7447e8be4e in mail_index_transaction_commit_full (_t=_t@entry=0x7ffc16d914d0, result_r=result_r@entry=0x7ffc16d91480) at mail-index-transaction.c:298 #12 0x00007f7447e8bf0b in mail_index_transaction_commit (t=t@entry=0x7ffc16d914d0) at mail-index-transaction.c:272 #13 0x00007f7447e71bef in mail_cache_set_seq_corrupted_reason (cache_view=cache_view@entry=0x55a2a17cf140, seq=362, reason=<optimized out>) at mail-cache.c:71 #14 0x00007f7447dd0d34 in mail_set_mail_cache_corrupted (mail=0x55a2a17d7118, fmt=0x7f7447eb1bab "Broken %s in mailbox %s: %s") at mail-storage.c:2828 #15 0x00007f7447dfb88a in maildir_mail_set_cache_corrupted_reason (_mail=0x55a2a17d7118, field=MAIL_FETCH_PHYSICAL_SIZE, reason=0x55a2a1706678 "read(/dane/domeny/mejor.pl/mail/marcin/.maildir/.Trash/tmp/1518011650.M572516P16520.jowisz) failed: Cached message size smaller than expected (0 < 14, box=Trash, UID=0)") at maildir-mail.c:770 #16 0x00007f7447e6ac52 in i_stream_mail_set_size_corrupted (mstream=mstream@entry=0x55a2a18014f0, size=size@entry=14) at istream-mail.c:95 #17 0x00007f7447e6ae5b in i_stream_mail_read (stream=0x55a2a18014f0) at istream-mail.c:121 #18 0x00007f7447ae9c84 in i_stream_read (stream=stream@entry=0x55a2a1801560) at istream.c:174 #19 0x00007f7447aeaa3d in i_stream_read_data (stream=0x55a2a1801560, data_r=data_r@entry=0x7ffc16d917a8, size_r=size_r@entry=0x7ffc16d917b0, threshold=threshold@entry=1) at istream.c:569 #20 0x00007f7447abc27f in message_parse_header_next (ctx=0x55a2a17c04c0, hdr_r=hdr_r@entry=0x7ffc16d91810) at message-header-parser.c:84 #21 0x00007f7447abcc9f in message_parse_header (input=<optimized out>, hdr_size=hdr_size@entry=0x55a2a17d7398, flags=flags@entry=(MESSAGE_HEADER_PARSER_FLAG_SKIP_INITIAL_LWSP | MESSAGE_HEADER_PARSER_FLAG_DROP_CR), callback=callback@entry=0x7f7447e50210 <index_mail_parse_header_cb>, context=context@entry=0x55a2a17d7118) at message-header-parser.c:391 #22 0x00007f7447e504f4 in index_mail_parse_headers (mail=mail@entry=0x55a2a17d7118, headers=0x55a2a1800f08, reason=reason@entry=0x55a2a1706618 "header Message-ID (Mail not cached, highest cached seq=361 uid=289064: reset_id=1312894688)") at index-mail-headers.c:460 #23 0x00007f7447e50b10 in index_mail_get_raw_headers (mail=mail@entry=0x55a2a17d7118, field=field@entry=0x7f744476ba33 "Message-ID", value_r=value_r@entry=0x7ffc16d91960) at index-mail-headers.c:659 #25 0x00007f7447dbc1ac in mail_get_first_header (mail=mail@entry=0x55a2a17d7118, field=field@entry=0x7f744476ba33 "Message-ID", value_r=value_r@entry=0x7ffc16d919e0) at mail.c:191 #26 0x00007f744476aaf9 in mail_log_append_mail_header (str=str@entry=0x55a2a17064f8, mail=mail@entry=0x55a2a17d7118, name=name@entry=0x7f744476ba5c "msgid", header=header@entry=0x7f744476ba33 "Message-ID") at mail-log-plugin.c:189 #27 0x00007f744476b501 in mail_log_append_mail_message_real (desc=0x55a2a17064d0 "copy from INBOX", event=MAIL_LOG_EVENT_COPY, mail=0x55a2a17d7118, ctx=0x55a2a17cf6e8) at mail-log-plugin.c:275 #28 mail_log_append_mail_message (ctx=0x55a2a17cf6e8, mail=0x55a2a17d7118, event=MAIL_LOG_EVENT_COPY, desc=0x55a2a17064d0 "copy from INBOX") at mail-log-plugin.c:344 #29 0x00007f7446e414db in notify_contexts_mail_copy (src=src@entry=0x55a2a17d18e8, dst=0x55a2a17d7118) at notify-plugin.c:75 #30 0x00007f7446e42cb5 in notify_copy (ctx=0x55a2a17d6108, mail=0x55a2a17d18e8) at notify-storage.c:106 #31 0x00007f7447259794 in quota_copy (ctx=0x55a2a17d6108, mail=0x55a2a17d18e8) at quota-storage.c:283 #32 0x00007f7447dceb40 in mailbox_copy_int (_ctx=<optimized out>, mail=mail@entry=0x55a2a17d18e8) at mail-storage.c:2477 #33 0x00007f7447dcedac in mailbox_move (_ctx=<optimized out>, mail=0x55a2a17d18e8) at mail-storage.c:2515 #34 0x000055a2a002668d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7ffc16d91c48, t=0x55a2a17ce880, move=true, cmd=0x55a2a17488c8) at cmd-copy.c:69 #35 cmd_copy_full (cmd=0x55a2a17488c8, move=true) at cmd-copy.c:139 #36 0x000055a2a003569c in command_exec (cmd=cmd@entry=0x55a2a17488c8) at imap-commands.c:200 #37 0x000055a2a0033751 in client_command_input (cmd=<optimized out>, cmd@entry=0x55a2a17488c8) at imap-client.c:1088 #38 0x000055a2a003388f in client_command_input (cmd=<optimized out>) at imap-client.c:1148 #39 0x000055a2a0033c85 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x55a2a1746908) at imap-client.c:1190 #40 client_handle_input (client=0x55a2a1746908) at imap-client.c:1202 #41 0x000055a2a0034245 in client_input (client=0x55a2a1746908) at imap-client.c:1249 #42 0x00007f7447af74e9 in io_loop_call_io (io=0x55a2a17487c0) at ioloop.c:600 #43 0x00007f7447af9297 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55a2a170e990) at ioloop-epoll.c:223 #44 0x00007f7447af75e3 in io_loop_handler_run (ioloop=ioloop@entry=0x55a2a170e990) at ioloop.c:649 #45 0x00007f7447af77e0 in io_loop_run (ioloop=0x55a2a170e990) at ioloop.c:624 #46 0x00007f7447a5e426 in master_service_run (service=0x55a2a170e830, callback=<optimized out>) at master-service.c:719 #47 0x00005 Marcin

1 0

Bug in dovecot 2.3 virtual plugin
by Jakobus Schürz 07 Feb '18

07 Feb '18

Hi there! I compiled dovecot 2.3 from git. Because there is already a bug in virtual-plugin, and i hoped, it get fixed... but it doesn't. So this is the error-message from the log Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>: Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion failed: (uni_is_valid_ucs4(chr)) Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8299eec481] -> /usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0) [0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0) [0x7f8299f5b5e0] -> /usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5) [0x7f8299f5b775] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27) [0x7f82990aeca7] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9) [0x7f82990acc39] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a) [0x7f82958e316a] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a) [0x7f82958e316a] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7f829a2641be] -> dovecot/indexer-worker [jakob Synoptic/AKTUELL](+0x2533) [0x562227882533] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f8299f91bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f8299f93499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f8299f91d02] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8299f91f18] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8299f0f1e3] -> dovecot/indexer-worker [jakob Synoptic/AKTUELL](main+0xe7) [0x562227881f47] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f8299b352b1] -> dovecot/indexer-worker [jakob Synoptic/AKTUELL](_start+0x2a) [0x56222788201a] Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer worker disconnected, discarding 1 requests for jakob Jän 03 16:27:08 aldebaran dovecot[26460]: imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Error: indexer failed to index mailbox Synoptic/AKTUELL Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>: Fatal: master: service(indexer-worker): child 26476 killed with signal 6 (core dumps disabled) Jän 03 16:27:09 aldebaran dovecot[26460]: indexer-worker(jakob)<26484><qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g>: Error: lucene index /var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out Jän 03 16:27:10 aldebaran dovecot[26460]: indexer-worker(jakob)<26484><qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g>: Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG: Unknown internal error (attempted to index 1488 messages (UIDs 15214..16775)) Jän 03 16:27:10 aldebaran dovecot[26460]: imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index mailbox Synoptic/AKTUELL Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Panic: file mail-index.c: line 793 (mail_index_close): assertion failed: (index->open_count > 0) Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8) [0x7fb0fc0d99a8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1) [0x7fb0fc0bf2d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363) [0x7fb0fc0bf363] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9) [0x7fb0fc0b0f39] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4) [0x7fb0fc0b65a4] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19) [0x7fb0fc030c99] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7fb0f729bbdc] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fb0f729bcb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fb0fc030c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fb0f729bc60] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fb0f729bcb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fb0fc030c0a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7fb0fc030c93] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](imap_client_close_mailbox+0x5b) [0x56514d31305b] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](cmd_logout+0x35) [0x56514d309485] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](command_exec+0x64) [0x56514d312ca4] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](+0x1b0b2) [0x56514d3110b2] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](+0x1b13c) [0x56514d31113c] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](client_handle_input+0x1a5) [0x56514d311565] -> dovecot/imap [jakob 192.168.0.14 LOGOUT](client_input+0x82) [0x56514d311be2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fb0fbd51bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7fb0fbd53499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7fb0fbd51d02] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb0fbd51f18] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb0fbccf1e3] Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Fatal: master: service(imap): child 26472 killed with signal 6 (core dumps disabled) I get this errors when i open or search in a virtual folder. i have enabled fts_lucene. My config is: # dovecot -n # 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.rc1 (d68c23a1) # OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs auth_mechanisms = plain login cram-md5 digest-md5 auth_socket_path = /usr/local/var/run/dovecot/auth-userdb first_valid_uid = 1000 imap_capability = +XDOVECOT imap_client_workarounds = tb-extra-mailbox-sep lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = *, ::1 login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24 172.17.0.0/24 172.18.0.0/24 mail_gid = vmail mail_home = /var/mail/%u mail_location = maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene mail_privileged_group = vmail mail_server_admin = mailto:jakob@xundeenergie.at mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u prefix = Roseggergasse/ separator = / subscriptions = no type = public } namespace Geteilt { hidden = no inbox = no list = children location = maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u prefix = Geteilt/%%n/ separator = / subscriptions = no type = shared } namespace Mailarchiv { hidden = no inbox = no list = children location = maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u mailbox incoming { auto = create } mailbox outgoing { auto = create } prefix = Mailarchiv/ separator = / subscriptions = no type = private } namespace Real { hidden = yes list = no location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no } namespace Synoptic { hidden = no list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no } namespace inbox { hidden = no inbox = yes location = mailbox Archiv { auto = no special_use = \Archive } mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox "Gelöschte Elemente" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox "Gelöschte Objekte" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Gesendet { auto = no special_use = \Sent } mailbox "Gesendete Elemente" { auto = no special_use = \Sent } mailbox "Gesendete Objekte" { auto = no special_use = \Sent } mailbox Important { auto = no } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Mistkübel { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Papierkorb { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Synoptic/Alle { auto = no comment = All my messages special_use = \All } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Wichtig { auto = create } prefix = INBOX/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users driver = passwd-file } plugin { acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90s fts_lucene = whitespace_chars=@. normalize no_snowball mail_home = /var/mail/%u setting_name = sieve, managedsieve sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service auth { unix_listener auth-client { group = vmail mode = 0666 user = Debian-exim } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { executable = imap postlogin process_limit = 1024 vsz_limit = 400 M } service lmtp { executable = lmtp -L user = vmail vsz_limit = 400 M } service postlogin { executable = script-login -d rawlog } ssl = required ssl_cert = </usr/local/etc/dovecot/dovecot.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /usr/local/etc/dovecot/users default_fields = home=/var/mail/%u driver = passwd-file } verbose_proctitle = yes protocol lmtp { auth_username_format = %n mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene quota sieve acl } protocol lda { mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene quota sieve acl } protocol imap { mail_max_userip_connections = 10 mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene imap_quota imap_acl } The virtual Folder-definitions are: # find /var/mail/virtual/ /var/mail/real/ /var/mail/virtual/ /var/mail/virtual/GINBOX /var/mail/virtual/GINBOX/dovecot-virtual /var/mail/virtual/Neue /var/mail/virtual/Neue/dovecot-virtual /var/mail/virtual/Markierte /var/mail/virtual/Markierte/dovecot-virtual /var/mail/virtual/Ungelesene /var/mail/virtual/Ungelesene/dovecot-virtual /var/mail/virtual/Sent /var/mail/virtual/Sent/dovecot-virtual /var/mail/virtual/Drafts /var/mail/virtual/Drafts/dovecot-virtual /var/mail/virtual/Trash /var/mail/virtual/Trash/dovecot-virtual /var/mail/virtual/AKTUELL /var/mail/virtual/AKTUELL/dovecot-virtual /var/mail/virtual/Archives /var/mail/virtual/Archives/dovecot-virtual /var/mail/virtual/dovecot-acl-list /var/mail/virtual/WICHTIG /var/mail/virtual/WICHTIG/dovecot-virtual /var/mail/real/ /var/mail/real/Alle /var/mail/real/Alle/dovecot-virtual /var/mail/real/dovecot-acl-list /var/mail/real/einjahr /var/mail/real/einjahr/dovecot-virtual /var/mail/real/zweijahr /var/mail/real/zweijahr/dovecot-virtual /var/mail/real/dreijahr /var/mail/real/dreijahr/dovecot-virtual # cat /var/mail/virtual/AKTUELL/dovecot-virtual Real/Alle inthread refs younger 2592000 # cat /var/mail/real/Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all The others are similar. Greez Jakob

5 12

Segmentation fault in "make check" test_istream_multiplex for 2.3.0 on Solaris Sparc
by Rainer Jung 07 Feb '18

07 Feb '18

Hi there, I get a crash when doing "make check" for version 2.3.0 on Solaris Sparc. The build was done with gcc 7.3.0. The crash happens in ioloop-poll.c line 181 when running test_istream_multiplex.c: #0 io_loop_handler_run_internal (ioloop=ioloop@entry=0x130dd0) at ioloop-poll.c:181 181 if (pollfd->revents != 0) { Due to the code 180 pollfd = &ctx->fds[ctx->fd_index[io->fd]]; 181 if (pollfd->revents != 0) { I can see in gdb, that io->fd is "-1", so using it as an array index doesn't make much sense: (gdb) print io->fd $2 = -1 and the resulting address of pollfd is not valid. The full io struct is: (gdb) print *io $3 = {io = {condition = IO_READ, source_filename = 0x8c680 "test-multiplex.c", source_linenum = 84, pending = false, callback = 0x33c14 <test_istream_multiplex_stream_read>, context = 0xc4b80 <test_channel+48>, ioloop = 0x130dd0, ctx = 0x0}, prev = 0xecfc0, next = 0xd3548, refcount = 1, fd = -1, istream = 0xd31e8} Full stack: [Current thread is 2 (Thread 1 (LWP 1))] (gdb) bt full #0 io_loop_handler_run_internal (ioloop=ioloop@entry=0x130dd0) at ioloop-poll.c:181 ctx = 0xd05b8 pollfd = 0x526cd8b0 tv = {tv_sec = 2147483, tv_usec = 0} io = 0xecd50 msecs = <optimized out> ret = 1 call = <optimized out> #1 0x000574a8 in io_loop_handler_run (ioloop=<optimized out>) at ioloop.c:666 No locals. #2 0x0005779c in io_loop_run (ioloop=0x130dd0) at ioloop.c:639 __func__ = "io_loop_run" #3 0x00033f7c in test_multiplex_stream () at test-multiplex.c:147 ioloop = 0x130dd0 fds = {6, 7} os = 0x0 is = 0x0 ichan1 = 0xd31e8 ochan1 = 0xd3470 io = 0xd34c8 ichan0 = 0x1b10e8 ochan0 = 0x1b1290 #4 test_multiplex () at test-multiplex.c:164 No locals. #5 0x0003e3d4 in test_run_named_funcs (tests=tests@entry=0x80444 <test_functions>, match=match@entry=0x7fd38 "") at test-common.c:255 _data_stack_cur_id = 2 i = <optimized out> #6 0x0003f1d8 in test_run_named_with_fatals (match=0x7fd38 "", tests=0x80444 <test_functions>, fatals=0x7fde0 <fatal_functions>) at test-common.c:337 No locals. #7 0x0001e024 in _start () I unfortunately don't know, why the fd field is "-1". Regards and thanks Rainer

2 1

New mail notification
by Matthew Allen 07 Feb '18

07 Feb '18

Hi, So I'm running dovecot 1.2.17 on Mac OSX using maildir in ~/Mail. After using getmail for a while to download my POP3 email and store it in the right place it started not working so I replaced it with a python script that I wrote. All was good for a while and then I stopped getting new mail notifications in my IMAP client. If I close the connection and restart the new mail shows up as !seen but no amount of re-selecting the folder will show the new mail while the connection is active. There is no untagged responses about new mail while the client is IDLEing. The client is InScribe (http://memecode.com/inscribe.php) but I doubt it's client specific. Seems to be server related. Now the python script in question just puts the .eml file in ~/Mail/tmp and then renames it to the ~/Mail/new folder. Does it need to do something else as well to make the notifications work? There aren't any error messages in the log. Just normal login history. If you can point me in the right direction that'd be appreciated. Regards Matthew Allen

1 0

Dovecot on GlusterFS via NFS is... strange.
by Frank Wall 07 Feb '18

07 Feb '18

Hi, I've discovered some interesting behaviour when running Dovecot on a GlusterFS volume (3.10) that is mounted via NFS 4.1 (ganesha NFS). First of all, using the usual settings for NFS storage seemed like an obvious choice for my setup (Dovecot 2.2.33.2, CentOS 7.4): mail_nfs_storage = yes mail_nfs_index = yes mail_fsync = always maildir_copy_with_hardlinks = yes mmap_disable = yes lock_method = dotlock (FWIW, I've been using these settings for many years on different NFS storages without any issues. Another instance of Dovecot 2.2.33 on FreeBSD 11.1 with a more traditional NFS storage is rock-solid.) SPOILER: These settings caused terrible issues. For example, when trying to clone a mailbox from an old server to this new Dovecot-on-GlusterFS setup (using imapsync), the following errors would show up frequently: Feb 6 16:44:53 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 1262 (maildir_uidlist_write_fd): assertion failed: (first_idx == 0) Feb 6 16:44:53 dovecot: IMAP(user(a)example.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9f3de) [0x7f7b6b44f3de] -> /usr/lib64/dovecot/libdovecot.so.0(+0x9f4be) [0x7f7b6b44f4be] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7b6b3e077c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x79605) [0x7f7b6b75b605] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_uidlist_sync_finish+0x1ac) [0x7f7b6b75d61c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_uidlist_sync_deinit+0x98) [0x7f7b6b75da48] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_transaction_save_commit_pre+0x41f) [0x7f7b6b75483f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xcccd0) [0x7f7b6b7aecd0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f7b6b7cb3cd] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x107) [0x7f7b6b7af217] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xe17c) [0x7f7b6a9ca17c] -> /usr/lib64/dovecot/lib01_acl_plugin.so(+0xda0a) [0x7f7b6abe0a0a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x51) [0x7f7b6b72c161] -> dovecot/imap [user(a)example.com 10.0.0.1 APPEND](+0xf255) [0x55ca8238f255] -> dovecot/imap [user(a)example.com 10.0.0.1 APPEND](command_exec+0x5c) [0x55ca8239cf0c] -> dovecot/imap [user(a)example.com 10.0.0.1 APPEND](+0xe771) [0x55ca8238e771] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f7b6b464cd2] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7f7b6b4663bf] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0x7f7b6b464d6c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f7b6b464f28] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7b6b3eafa3] -> dovecot/imap [user(a)example.com 10.0.0.1 APPEND](main+0x333) [0x55ca8238e2e3] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f7b6b00ec05] -> dovecot/imap [user(a)example.com 10.0.0.1 APPEND](+0xe476) [0x55ca8238e476] Feb 6 16:44:53 dovecot: IMAP(user(a)example.com): Fatal: master: service(imap): child 84782 killed with signal 6 (core dumps disabled) Feb 6 16:44:56 dovecot: IMAP(user(a)example.com): Error: readdir(/data/mail/abc/default/.Foldername 01_ Foo 1234/new) failed: Unknown error 523 Yes, the folder name is "special" in this example. (I'm not sure if this readdir() error is actually related to the other issue.) So, this caused the imap process to die repeatedly and the user got disconnected many many times. In this state the mail services were not really usable. Side note: The NFS share was mounted by using the most conservative moint options I could think of: vers=4.1,rsize=131072,wsize=131072,nosharecache,noac,nordirplus,proto=tcp And if you're wondering: Yes, I'm using Dovecot director for IMAP and LMTP (currently running 3 VMs for Dovecot director and 3 VMs for Dovecot IMAP). Then the fun began... I've decided to change the following settings: mail_nfs_storage = no mail_nfs_index = no Re-created the maildir and restarted the imapsync copy process. Out of sudden the errors are gone! Now Dovecot is performing pretty well on my GlusterFS volume. Does this make any sense to anyone? Ciao - Frank

1 0

"make check" test-hash-method bus error (Sparc alignment)
by Rainer Jung 06 Feb '18

06 Feb '18

Hi there, when doing "make check" for a 2.3.0 build on Solaris Sparc I get a bus error due to an alignment issue. It seems the error is only happening during testing, because in the official API it was fixed in https://github.com/dovecot/core/commit/d8361cc8576d9ede93a037f9b96f2a3f9b7e… But the tests use hand written test vectors, that are not correctly aligned: ... hash method md4 (test vectors) ....................................... : ok hash method md5 (test vectors) ....................................... : ok /bin/ksh[2]: 24287 Bus Error(coredump) make[4]: *** [Makefile:2655: check-local] Error 1 gdb output: Program terminated with signal SIGBUS, Bus error. #0 sha1_loop (ctxt=0xffbff724, input=0x83908, len=3) at sha1.c:224 224 ctxt->c.b64[0] += copysiz * 8; (gdb) print &ctxt->c.b64[0] $1 = (uint64_t *) 0xffbff73c So the address of the 8 byte type is not divisible by 8 (Sparc alignment requirement). Full stack: (gdb) bt full #0 sha1_loop (ctxt=0xffbff724, input=0x83908, len=3) at sha1.c:224 input_c = 0x83908 "abc" gaplen = <optimized out> gapstart = <optimized out> off = 0 copysiz = 3 #1 0x00024eb0 in test_hash_methods_fips () at test-hash-method.c:338 n = 0 method = 0xc4e68 <hash_method_sha1> context = 0xffbff724 "gE#\001▒ͫ\211\230▒▒▒\020\062Tv▒▒▒▒" result = "▒9▒▒^kK\r2U▒▒\225`\030\220▒▒\a\t" i = 7 last_method = 0x839d0 "sha1" test_vectors = {{method = 0x838e0 "md4", input = 0x838e8, ilen = 0, rounds = 1, output = 0x838f0, olen = 16}, {method = 0x838e0 "md4", input = 0x83908, ilen = 3, rounds = 1, output = 0x83910, olen = 16}, {method = 0x838e0 "md4", input = 0x83928, ilen = 62, rounds = 1, output = 0x83968, olen = 16}, {method = 0x83980 "md5", input = 0x838e8, ilen = 0, rounds = 1, output = 0x83988, olen = 16}, {method = 0x83980 "md5", input = 0x83908, ilen = 3, rounds = 1, output = 0x839a0, olen = 16}, { method = 0x83980 "md5", input = 0x83928, ilen = 62, rounds = 1, output = 0x839b8, olen = 16}, {method = 0x839d0 "sha1", input = 0x838e8, ilen = 0, rounds = 1, output = 0x839d8, olen = 20}, {method = 0x839d0 "sha1", input = 0x83908, ilen = 3, rounds = 1, output = 0x839f0, olen = 20}, {method = 0x839d0 "sha1", input = 0x83a08, ilen = 56, rounds = 1, output = 0x83a48, olen = 20}, {method = 0x83a60 "sha3-256", input = 0x838e8, ilen = 0, rounds = 1, output = 0x83a70, olen = 32}, {method = 0x83a60 "sha3-256", input = 0x83a98, ilen = 135, rounds = 1, output = 0x83b20, olen = 32}, {method = 0x83a60 "sha3-256", input = 0x83b48, ilen = 200, rounds = 1, output = 0x83c18, olen = 32}, {method = 0x83a60 "sha3-256", input = 0x83c40, ilen = 1, rounds = 200, output = 0x83c18, olen = 32}, { method = 0x83c48 "sha3-512", input = 0x838e8, ilen = 0, rounds = 1, output = 0x83c58, olen = 64}, {method = 0x83c48 "sha3-512", input = 0x83a98, ilen = 135, rounds = 1, output = 0x83ca0, olen = 64}, {method = 0x83c48 "sha3-512", input = 0x83b48, ilen = 200, rounds = 1, output = 0x83ce8, olen = 64}, { method = 0x83c48 "sha3-512", input = 0x83c40, ilen = 1, rounds = 200, output = 0x83ce8, olen = 64}} #2 0x0003e3e0 in test_run_named_funcs (tests=tests@entry=0x80434 <test_functions>, match=match@entry=0x7fd40 "") at test-common.c:255 _data_stack_cur_id = 2 i = <optimized out> #3 0x0003f1e4 in test_run_named_with_fatals (match=0x7fd40 "", tests=0x80434 <test_functions>, fatals=0x7fde8 <fatal_functions>) at test-common.c:337 No locals. #4 0x0001e024 in _start () Unaligned data comes from file src/lib/test-hash-method.c: ... 53 static void test_hash_methods_fips() { 54 const char *last_method = NULL; 55 56 struct { 57 const char *method; 58 const void *input; 59 size_t ilen; 60 size_t rounds; 61 const void *output; 62 size_t olen; 63 } test_vectors[] = 64 { ... 115 { "sha1", 116 "", 117 0, 118 1, 119 "\xda\x39\xa3\xee\x5e\x6b\x4b\x0d" 120 "\x32\x55\xbf\xef\x95\x60\x18\x90" 121 "\xaf\xd8\x07\x09", 122 160 / 8 123 }, ... etc. The input data needs to be 8 byte aligned but is just a void *. Thanks and regards, Rainer

1 0

Dovecot and /dev/rand
by Michael A. Peters 06 Feb '18

06 Feb '18

There's a (2014 I think) patch in dovecot rpm for Red Hat / Fedora ecosystem that was last update with 2.2.9 (patch last updated for that release) I want to know if the problem it solves still exists in 2.3.x branch. The patch is called "dovecot-2.2.9-nodevrand.patch" and is attached. It allegedly addresses an issue with installation in chroot that does not have /dev/random Red Hat bugzilla 1026790 I am apparently not authorized to see that bug so I don't know much about it, but with many code changes in 2.3.0 from 2.2.x I am wondering if the alleged issue was solved a different way or if the patch should be ported to 2.3.0 when packaged for people who might trigger it. Thanks.

1 0

Does Dovecot LDAP auth support LDAP referral
by Xuan Jia 06 Feb '18

06 Feb '18

We using Dovecot with LDAP. From the beginning, we using GC LDAP query with port 3268 for email accounts. For example, user1(a)our-organization.org (in the USA) with "base = dc=our-organization, dc=org" works fine. But refer to this document: https://wiki2.dovecot.org/AuthDatabase/LDAP When we change the LDAP from 3268 to 389 and with TLS, the base should be changed like this: "base = ou=usa, dc=our-organization, dc=org" But if the user (user2) located in United Kingdom (ou=gbr), the user can not login. When we debug with ldapsearch: ldapsearch -ZZ -v -h dc.our-organization.org -p 389 -D 'cn=auth_user,ou=usa,dc=our-organization,dc=org' -W -b 'dc=our-organization, dc=org' '(userPrincipalName=user2(a)our-organization.org)' It can return user2 information with some "numReferences". But in Dovecot, if "base = dc=our-organization, dc=org" it only reported auth error with timeout. Here are the config: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 9.3 auth_verbose = yes dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} imap_id_send = imapc_user = %u import_environment = TZ listen = * login_log_format_elements = user=u> method=%m rip=%r lip=%l mpid=%e %c mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve" service managesieve-login { inet_listener sieve { port = 4190 } service_count = 0 } ssl_ca = /etc/ssl/certs/ca.pem ssl_cert = </etc/ssl/gameloft/our-organization.org.crt ssl_key = # hidden, use -P to show it ssl_parameters_regenerate = 1 weeks userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } So my question is: does Dovecot LDAP auth support LDAP referral? If Dovecot relies on OpenLDAP, it should be support. If not, why and what is the walkthrough? Xuan Jia

2 2

Dovecot 2.3.0, Panic: file mailbox-attribute.c: line 362 (mailbox_attribute_get_stream): assertion failed: (value_r->value != NULL || value_r->value_stream != NULL)
by Marco Giunta 05 Feb '18

05 Feb '18

Hi at all, I have a RHEL7 server with Dovecot 2.3.0 (new installation). I've a problem when trying to dsync from a Dovecot 2.2.24 server. If I try to sync any user with a folder with ACL, dsycn crash with panic: Source server: dsync-local(USERNAME): Debug: sieve: file storage: sync: Synchronization active dovecot: dsync-local(USERNAME): Debug: acl vfile: reading file /var/spool/mail/U/USERNAME/dovecot-acl dsync-local(USERNAME): Error: read(DEST_SERVER.example.com) failed: EOF (last sent=mail_change (EOL), last recv=mailbox) Destination server: Feb 2 14:15:23 DEST_SERVER dovecot: dsync-server(USERNAME): Panic: file mailbox-attribute.c: line 362 (mailbox_attribute_get_stream): assertion failed: (value_r->value != NULL || value_r->value_stream != NULL) Feb 2 14:15:23 DEST_SERVER dovecot: dsync-server(USERNAME): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xc8cc4) [0x7fa861bc0cc4] -> /usr/lib64/dovecot/libdovecot.so.0(+0xc8d7e) [0x7fa861bc0d7e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7fa861b34190] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x55cbc) [0x7fa861ec1cbc] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](dsync_mailbox_import_attribute+0x4d) [0x55b9d4ce215d] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](dsync_brain_sync_mails+0x2ef) [0x55b9d4cddbdf] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](dsync_brain_run+0x2b0) [0x55b9d4cd93e0] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](+0x43a10) [0x55b9d4cd9a10] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](+0x5837f) [0x55b9d4cee37f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7fa861bd82b5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7fa861bd9b5f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7fa861bd83b2] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fa861bd85d8] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](+0x28369) [0x55b9d4cbe369] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](+0x29c07) [0x55b9d4cbfc07] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](+0x3f969) [0x55b9d4cd5969] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7fa861bd82b5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7fa861bd9b5f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7fa861bd83b2] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fa861bd85d8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fa861b56b23] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](main+0x1b6) [0x55b9d4cb0536] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7fa861756c05] -> dovecot/doveadm-server [10.0.11.137 USERNAME INBOX send:mail_requests recv:attributes](+0x1a5f5) [0x55b9d4cb05f5] Feb 2 14:15:23 DEST_SERVER dovecot: dsync-server(USERNAME): Fatal: master: service(doveadm): child 2149 killed with signal 6 (core dumped) Coredump and configuration attached. On source server I run this command: # doveadm -D backup -f -u USERNAME -x 'Archives*' tcp:DEST_SERVER.example.com but same panic if try to sync from destination server: # doveadm -D backup -fR -u USERNAME -x 'Archives*' tcp:SOURCE_SERVER.example.com Same panic also syncing any user with acl and using different acl_shared_dict (file or fs:posix) in dovecot configuration. Thanks, Marco -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244

1 1

Re: How to grant user access to his .dovecot.sieve.log?
by Sergey Ivanov 04 Feb '18

04 Feb '18

Hi Gabriel, I'm trying to implement what you suggested using apache mod_userdir with === UserDir /srv/dovecot <DirectoryMatch "^/srv/dovecot/(?<WHICHUSER>[^/]+)"> Require user %{env:MATCH_WHICHUSER} DirectoryIndex .dovecot.sieve.log ... </DirectoryMatch> === I still need to find how to set up right permissions for these logs without too much brute force. It looks like this way I can get what I want, but I really hoped to find some better way: my Roundcube installation is on the load-balanced web farm and there is no and should not be a file access to these logs. I think such a feature as Sieve compiler must have some standard way to say what is wrong to the author of the Sieve script. -- Sergey. On Fri, Feb 2, 2018 at 2:29 PM, Gabriel Kaufmann <mailings(a)typoworx.com> wrote: > Alternatively use a web-interface with read-only access to the log? > > best regards > > Gabriel Kaufmann > >

1 0

Dual Dovecot setup
by dovecot.dirk＠o.banes.ch 03 Feb '18

03 Feb '18

Hi all, I´m using dovecot successfully since some years. My current setup is postfix and dovecot on one vserver. This works great so far. +--------------------+ eMail in | VSERVER1 | +---------->+ MX 1 (Master) | | POSTFIX MTA | | DOVECOT ALL Folders| +-----^--------------+ | |eMail Backup | | +------+---------+ | VSERVER2 | eMail in | MX 2 (Backup) | Backup | POSTFIX MTA | +---------> | +----------------+ However now I want to change this setup to have on box in my home which holds all eMails and Folders which are not in the Inbox. This is due to disk space and privacy concerns. Even if the home connection is very very stable for the case something fails while on vacation the content of the inbox of every user should always stay on the VSERVER1 as well - until it is moved to one subfolder. +---------------+ +-------------+ eMail in | VSERVER1 | | HOMEBOX | +---------->+ MX 1 (Master) | ?SYNC? | DOVECOT | | POSTFIX MTA +--------------> ALL FOLDERS | | DOVECOT INBOX | | | +-----^---------+ +-------------+ | |eMail Backup | | +------+---------+ | VSERVER2 | eMail in | MX 2 (Backup) | Backup | POSTFIX MTA | +---------> | +----------------+ I read into documentation and also did a fair share of googeling but I could only identify possible solutions which I´m not sure they will work. a) dsync - Can dsync only sync the Inbox ? b) fetchmail - Unsure how an eMail moved from Inbox (Homebox) to another folder would get removed from the inbox of the vserver1 Therefore I hope maybe someone of you has an idea how this can be archived. Thank you best regards Dirk

1 0

dovecot-lda won't cause mail to be filtered by sieve
by Volker Wysk 03 Feb '18

03 Feb '18

Hi I'm changing from fetchmail to getmail, in order to fetch my mail from several mail servers and deliver it to my local dovecot server. Fetchmail supports LMTP, getmail doesn't. So I'm making getmail call dovecot-lda for delivering the mail. But now, the incoming mail doesn't get filtered through sieve any longer. However, this command works: sieve-filter -v -u v ~v/.dovecot.sieve INBOX -e -W expunge Any ideas? Greetings V.W.

2 2

AuthDatabase CheckPassword broken?
by Mark Foley 02 Feb '18

02 Feb '18

I had been using the CheckPassword authentication interface with dovecot 2.2.15, https://wiki2.dovecot.org/AuthDatabase/CheckPassword, and it was working. After upgrading to 2.2.33.2 CheckPassword no longer works. The referenced wiki page says, Checkpassword Interface Read <username> NUL <password> NUL from fd 3. I've checked the information read from fd 3 with 2.2.33.2 and I get <username> followed by 3 nulls. I'm guessing the 2nd null is supposed to be the password. Why is this no longer working? How can I fix it? THX --Mark

3 4

Dovecot 2.3 on CentOS 7.
by Reio Remma 02 Feb '18

02 Feb '18

Greetings! I'm having a bit of trouble trying out Dovecot 2.3 on CentOS 7. Dovecot 2.2.33 works fine on the same system (same config as well, minus the SSL changes) but after upgrading to 2.3 I'm getting the following errors: Feb 1 21:30:18 localhost dovecot: imap(reio(a)bwo.mrstuudio.ee)<3566><FoOsnStkXt4KAAgC>: Debug: INBOX.Templates: Mailbox opened because: STATUS Feb 1 21:30:18 localhost dovecot: Error: imap(reio(a)bwo.mrstuudio.ee)<3566><FoOsnStkXt4KAAgC>: open() failed with file /home/dovecot/bwo.mrstuudio.ee/reio/Maildir/.Templates/dovecot.index.log: Read-only file system Feb 1 21:30:18 localhost dovecot: imap(reio(a)bwo.mrstuudio.ee)<3566><FoOsnStkXt4KAAgC>: Error: open(/home/dovecot/bwo.mrstuudio.ee/reio/Maildir/.Templates/dovecot-uidlist.lock) failed: Read-only file system Feb 1 21:30:18 localhost dovecot: Error: imap(reio(a)bwo.mrstuudio.ee)<3566><FoOsnStkXt4KAAgC>: Mailbox INBOX.Templates: file_dotlock_create(/home/dovecot/bwo.mrstuudio.ee/reio/Maildir/.Templates/dovecot-uidlist) failed: Read-only file system Feb 1 21:30:18 localhost dovecot: Error: imap(reio(a)bwo.mrstuudio.ee)<3566><FoOsnStkXt4KAAgC>: Mailbox INBOX.Templates: open(/home/dovecot/bwo.mrstuudio.ee/reio/Maildir/.Templates/dovecot-uidlist) failed: Read-only file system So far I've tried running it with SELinux enforce off and giving the directories 777 permissions to no avail. Is anyone else running 2.3 on CentOS 7? Thanks and good luck! Reio

4 4

Live Import of IMAP
by Sergio Belkin 01 Feb '18

01 Feb '18

Hi, I have the mailbox of jon.doe(a)example.com just migrated only with mails after migration, is it ok to run: doveadm -o mail_fsync=never sync -1 -R -u joe(a)example.com imapc: wiil that import all mails missing mails to the new server? I don't want that delete any current mail, is that right the command above? thanks in advance! -- -- Sergio Belkin LPIC-2 Certified - http://www.lpi.org

2 3

lda: Warning: Failed to parse return-path header: Invalid character in localpart
by Christian Authmann 01 Feb '18

01 Feb '18

Hello, Sometimes, when delivering mails, this warning appears in my syslog: > lda(...): Warning: Failed to parse return-path header: Invalid character in localpart dovecot-lda still exits with 0 and the mail is inserted into my inbox. Looking at the mails in question, I determined that the error is caused by a multiline Return-Path header. Here's a testcase: --- snip --- Return-Path: <nowhere(a)example.com> From: "Nowhere" <nowhere(a)example.com> To: redacted(a)example.com Subject: Testcase for lda warnings Date: Wed, 31 Jan 2018 12:00:00 +0000 This is a message body. --- snap --- Copy into a file, with \r\n line endings, then run something like this: > cat testcase.txt | /usr/lib/dovecot/dovecot-lda -e -d '<username>' with a username recognized by your running dovecot installation. The header is 'Return-Path:', \r\n, two spaces, '<...>', \r\n According to rfc2822 folding rules, that should be valid - the Return-Path header allows CFWS at that location. The error message originates in lib-lda/mail-deliver.c in mail_deliver_get_return_address(), while the invalid character message seems to originate from one of several places in lib-lda/mail-deliver.c Ciao, Christian Authmann

2 4

Error in virtual mailbox dovecot 2.3-devel maybe in mailcount
by Jakobus Schürz 01 Feb '18

01 Feb '18

Hi there! I splitted my Mailarchiv to an extra namespace. Because i have some Problems with the Archiv. I can open all Folders from Mailarchiv with dovecot. But i want to have a "all archives" Mailbox to search in all messages in only one virtual mailbox. Trying to open this virtual folder from thunderbird, I get in a big archiv this error in logs from dovecot: Jän 12 10:54:41 aldebaran dovecot[839]: imap(jakob)<11302><9ILYQJFipPlcPAkS>: Error: virtual index /var/mail/virtual/ARCHIV: Broken mailbox_count header Jän 12 10:54:41 aldebaran dovecot[839]: imap(jakob)<11302><9ILYQJFipPlcPAkS>: Error: virtual index /var/mail/virtual/ARCHIV: Broken mailbox_count header Jän 12 10:54:41 aldebaran dovecot[839]: imap(jakob)<11302><9ILYQJFipPlcPAkS>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/archiv/jakob/Archiv/2016/Mailinglisten/stvkr-a/dovecot.index: Opened in index-storage.c:336 Jän 12 10:54:41 aldebaran dovecot[839]: imap(jakob)<11302><9ILYQJFipPlcPAkS>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f391bf02021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f391bf020ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f391be74481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f391c2a1942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f391c278ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f391c1f8c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f39174637e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f391746397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f3917466926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f391c1fb05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f391c1fb117] -> dovecot/imap [jakob 92.60.9.18 select](cmd_select_full+0x171) [0x55759e0911a1] -> dovecot/imap [jakob 92.60.9.18 select](command_exec+0x64) [0x55759e098ca4] -> dovecot/imap [jakob 92.60.9.18 select](+0x1b0b2) [0x55759e0970b2] -> dovecot/imap [jakob 92.60.9.18 select](+0x1b13c) [0x55759e09713c] -> dovecot/imap [jakob 92.60.9.18 select](client_handle_input+0x1a5) [0x55759e097565] -> dovecot/imap [jakob 92.60.9.18 select](client_input+0x82) [0x55759e097be2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f391bf19c09] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f391bf1b4a9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f391bf19d12] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f391bf19f28] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f391be971e3] -> dovecot/imap [jakob 92.60.9.18 select](main+0x328) [0x55759e089768] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f391babd2b1] -> dovecot/imap [jakob 92.60.9.18 select](_start+0x2a) [0x55759e08994a] Jän 12 10:54:41 aldebaran dovecot[839]: imap(jakob)<11302><9ILYQJFipPlcPAkS>: Fatal: master: service(imap): child 11302 killed with signal 6 (core not dumped) and if i search the virtual mailbox with doveadm i get almost the same error. The "Broken mailbox_count_header" is missing there. The full amount of emails in archiv is about 28000 # ulimit -n 256000 # doveadm search -u jakob mailbox Real/Archiv all doveadm(jakob): Panic: Leaked view for index /var/lib/dovecot/db/indexes/archiv/jakob/Archiv/2016/Diverses/Standard-foren/dovecot.index: Opened in index-storage.c:336 doveadm(jakob): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f8259fe6021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6079) [0x7f8259fe6079] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8259f58481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f825a385942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f825a35cec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f825a2dcc0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f82559507e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f825595097b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f8255953926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f825a2df05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f825a2df117] -> doveadm(doveadm_mail_iter_init+0x94) [0x56303334be94] -> doveadm(+0x33715) [0x56303334f715] -> doveadm(+0x29a88) [0x563033345a88] -> doveadm(+0x2a702) [0x563033346702] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x230) [0x563033347570] -> doveadm(doveadm_cmd_run_ver2+0x575) [0x563033357155] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5630333571a7] -> doveadm(main+0x1d2) [0x5630333360c2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f8259ba12b1] -> doveadm(_start+0x2a) [0x5630333364ca] Abgebrochen Thanks Jakob

1 1

Why does dovecot reject password when authorizing by a certificate?
by yuryb 01 Feb '18

01 Feb '18

We have FreeBSD-server with dovecot installed on it as IMAP-server. My user and password database is a text file with plaintext passwords. Clients connect to imap-server via TLS protocol and plaintext password. All works fine. But I want to configure ability to authorize with a client certificates. I have generated a client certificate and imported it to email-client. Also I have configured dovecot to verify client certificates. But email-client cannot authorize: Password mismatch. Why dovecot reject my password in this case? Please help! My log:dovecot: imap-login: Valid certificate: /C=UA/ST=Kyiv/L=Kyiv/O=Contoso Ltd: user=<>, rip=10.1.1.59, lip=10.1.1.99, TLS handshaking, session=<fp5P5SBkhtMKAQE7> dovecot: imap-login: Valid certificate: /C=UA/ST=Kyiv/O=Contoso Ltd/OU=IT/CN=sysadmin/emailAddress=sysadmin(a)contoso.ua: user=<>, rip=10.1.1.59, lip=10.1.1.99, TLS handshaking, session=<fp5P5SBkhtMKAQE7> dovecot: auth: passwd-file(sysadmin,10.1.1.59,<fp5P5SBkhtMKAQE7>): Password mismatch dovecot: imap-login: Disconnected (auth failed, 1 attempts in 6 secs): user=<sysadmin>, method=EXTERNAL, rip=10.1.1.59, lip=10.1.1.99, TLS, session=<fp5P5SBkhtMKAQE7> My configuration: # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.2-RELEASE-p20 amd64 ufs auth_debug = yes auth_mechanisms = plain login external auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes auth_username_format = %Ln auth_verbose = yes disable_plaintext_auth = no lda_mailbox_autocreate = yes mail_debug = yes mail_gid = 999 mail_location = maildir:/mnt/mail/%n mail_uid = 999 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/users driver = passwd-file } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imaps { ssl = yes } } ssl_ca = </etc/ssl/cacert.pem ssl_cert = </etc/ssl/certs/dovecot.pem ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/dovecot.pem ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 ssl_require_crl = no ssl_verify_client_cert = yes userdb { args = /usr/local/etc/dovecot/users driver = passwd-file } verbose_ssl = yes

2 4

test-net.c failure
by Rupert Gallagher 31 Jan '18

31 Jan '18

test-net.c:79: Assert failed: strcmp(net_ip2addr(&ip), "::5") == 0 test-net.c:83: Assert failed: strcmp(net_ip2addr(&ip), "::5") == 0 net_ip2addr() ........................................................ : FAILED Hello, Is it possible to disable DOVECOT_IPV6? We do not use IPv6 (and hope we shall never do on e-mails).

3 3

2.3.0 on 10.13.3 (macos): all testing errors
by Rupert Gallagher 30 Jan '18

30 Jan '18

Enclosed.

1 0

send specific NDR message for users in certain OU
by lists 30 Jan '18

30 Jan '18

Hi, The question can perhaps be made more generic like this: Can dovecot generate a *specific* NDR (or an autoreply) for accounts that meet a specific criterium, such as: - user account was found under OU=to-delete,CN=company... contrary to the regular location CN=Users,CN=company... We would like to move to-be-deleted users to this container, before actually deleting them. That gives us an easy way to revert, if the deletion turns out to be erroneous. We could do that with via a sieve config for those accounts, but if dovecot could send a "delivery failure"-type specific for those accounts (with instructions who to contact to revert the situation) it would be very easy: only move the user to the specific OU, and have the system do the rest. Can this be done? (dovecot 2.1.17 on wheezy, yes we know we should upgrade, and we also will, but it runs rock solid...) MJ

2 2

2 panics, 1 segmentation fault in dovecot 2.3.0 (fts)
by Infoomatic 30 Jan '18

30 Jan '18

Hi, While testing our migration to dovecot 2.3.0, we encountered 2 panics, 1 segmentation fault while we wanted to rebuild the solr indizes. Problem [1] was encountered while rebuilding the indizes, and now I don't know how many mails/documents are indexed or where it got stuck. [2] and [3] encountered while just playing around, since I did not know of "tokenize" and did not find a lot of information about it. This is a ubuntu 16.04 machine, dovecot 2.3.0 compiled from source ( + the patch for the recent zlib problem). "doveadm index" runs on a ~ 4GB mdbox-zipped-mailbox for about 3-4 minutes before aborting with the message above, beforehand I did a "/opt/dovecot/bin/doveadm fts rescan -A". When I repeat "doveadm index" it aborts after about 4 seconds, after a "/opt/dovecot/bin/doveadm fts rescan -A" it runs again for 3-4 minutes. Apache tika logs, but those are probably not related to the problem, however, the devs might want investigate the last line: WARN Parse exception Expected ';', got "," determining content disposition javax.mail.internet.ParseException: Expected ';', got "," and org.apache.tika.exception.ZeroByteFileException: InputStream must have > 0 bytes I would be happy if you could have a look at this, please, and of course just tell me what further information you need. Thanks, infoomatic [1] /opt/dovecot/bin/doveadm index -u user1 '*' doveadm(user1): Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion failed: (uni_is_valid_ucs4(chr)) doveadm(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xc5eea) [0x7ff27755beea] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xc5f59) [0x7ff27755bf59] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff2774ce5e1] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0) [0x7ff277593300] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xa74f9) [0x7ff27753d4f9] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5) [0x7ff27753d705] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xcf5c) [0x7ff276460f5c] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27) [0x7ff276460c37] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x511) [0x7ff27645eb51] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x110a6) [0x7ff2764650a6] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7ff27784618e] -> /opt/dovecot/bin/doveadm(+0x2f697) [0x55dd2f912697] -> /opt/dovecot/bin/doveadm(+0x29827) [0x55dd2f90c827] -> /opt/dovecot/bin/doveadm(+0x2a4bb) [0x55dd2f90d4bb] -> /opt/dovecot/bin/doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x21d) [0x55dd2f90e2cd] -> /opt/dovecot/bin/doveadm(doveadm_cmd_run_ver2+0x575) [0x55dd2f91deb5] -> /opt/dovecot/bin/doveadm(doveadm_cmd_try_run_ver2+0x37) [0x55dd2f91df07] -> /opt/dovecot/bin/doveadm(main+0x1d2) [0x55dd2f8fd032] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7ff2770ec830] -> /opt/dovecot/bin/doveadm(_start+0x29) [0x55dd2f8fd439] Aborted (core dumped) [2] This was just about my curiosity since I haven't used "tokenize" and did not find too much info about it: /opt/dovecot/bin/doveadm fts tokenize -A '*' Panic: file doveadm-print.c: line 142: unreached Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xc5eea) [0x7f38ac5c2eea] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0xc5f59) [0x7f38ac5c2f59] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f38ac5355e1] -> /opt/dovecot/bin/doveadm(+0x3b3d3) [0x55c728e8b3d3] -> /opt/dovecot/bin/doveadm(+0x2a63a) [0x55c728e7a63a] -> /opt/dovecot/bin/doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x21d) [0x55c728e7b2cd] -> /opt/dovecot/bin/doveadm(doveadm_cmd_run_ver2+0x575) [0x55c728e8aeb5] -> /opt/dovecot/bin/doveadm(doveadm_cmd_try_run_ver2+0x37) [0x55c728e8af07] -> /opt/dovecot/bin/doveadm(main+0x1d2) [0x55c728e6a032] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f38ac153830] -> /opt/dovecot/bin/doveadm(_start+0x29) [0x55c728e6a439] Aborted (core dumped) [3] /opt/dovecot/bin/doveadm fts tokenize -u user1 "@" Segmentation fault (core dumped)

2 2

Dovecot 2.2.33.2 doveadm log reopen don't work
by Айхэд 30 Jan '18

30 Jan '18

dovecot -n # 2.2.33.2 (d6601f4ec): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: FreeBSD 11.1-RELEASE-p1 amd64 zfs from logrotate.conf: /var/log/dovecot/dovecot.log { rotate 180 missingok nomail noolddir compress create 0600 nobody nobody postrotate # /usr/local/bin/doveadm log reopen /usr/sbin/service dovecot reload endscript } After upgrade to 2.2.33.2 (prev version was 2.2.29.1) there are only messages from sieve in /var/log/dovecot/dovecot.log like this: Jan 29 00:00:12 lda(***): Info: sieve: msgid=<20180128210012.3A9A11138B8E@***>: stored mail into mailbox 'INBOX.' (INBOX) Messages from pop3, pop3-login, imap, imap-login are absent. If i replace /usr/local/bin/doveadm log reopen with /usr/sbin/service dovecot reload all works fine. Before upgrade all worked fine.

1 0

Change destination of dsync
by Sergio Belkin 29 Jan '18

29 Jan '18

Hi, I have the following command for retrieving mails from another IMAP mail server dsync -D -v backup -R -u jon.doe imapc: I't ok and works, but I'd want to copy messages outside of /var directory, is there a way to do that? Thanks in advance! -- -- Sergio Belkin LPIC-2 Certified - http://www.lpi.org

2 1

problem with lda
by Infoomatic 27 Jan '18

27 Jan '18

Hello, I am currently testing the upgrade from our dovecot v2.2.23 to 2.3.0. I have a strange problem with lda. We use bounce mails for internal users if they try to send virus/spammails. The exact same config works with 2.2.23, but not with 2.3.0. The relevant postfix/master.cf part: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/opt/dovecot/libexec/dovecot/deliver -d ${recipient} -f ${sender} On the same machine, with 2.2.23 I get a bounce mail when trying to send a virus, with the subject "VIRUS in message apparently from you (Eicar-Test-Signature)", to both the users inbox as well as to the mailbox of virusalert(a)ourdomain.internal With 2.3.0, in the logs I get an error: relay=dovecot, delay=0.01, delays=0/0/0/0, dsn=5.3.0, status=bounced (command line usage error. Command output: lda: Fatal: Invalid -f parameter: Missing domain and the alert message is only sent to virusalert(a)ourdomain.internal, but not to the user who tried to send the mail. The relevant part of our dovecot.conf: protocol lda { mail_plugins = " quota zlib sieve acl mail_log notify" postmaster_address = postmaster(a)ourdomain.internal } Does anyone know how to solve this problem? Or is there a workaround via postfix/amavis/spamassassin? Any hints are highly appreciated, thanks! Regards, infoomatic

3 6

Send full X.509 client certificate to custom authentication policy server
by Jaime Hablutzel Egoavil 26 Jan '18

26 Jan '18

I'm working with Dovecot 2.3 and I'm wondering if I could send the full X.509 client certificate to my custom authentication policy server. I'm actually aware that I can send the client certificate validity status with something like: auth_policy_request_attributes = ... cert=%{cert} But I want the full X.509 certificate to be able to decide over the basis of certificate extensions, e.g. Certificate Policies extension. Is it currently possible?, what about Lua based authentication?, does Lua currently receive the full client certificate?. -- Jaime Hablutzel - RPC 994690880

2 1

exited on signal 6 (core dumped) when searching folder
by Kristjan Eentsalu 26 Jan '18

26 Jan '18

Hey, I'm getting messages exited on signal 6 (core dumped) when doing imap command "a UID SORT (DATE) UTF-8 BODY someword" message log file Jan 26 13:57:20 mail dovecot: imap(kristjan.eentsalu(a)yyy.yy): Panic: file charset-iconv.c: line 87 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) Jan 26 13:57:20 mail dovecot: imap(kristjan.eentsalu(a)yyy.yy): Fatal: master: service(imap): child 6410 killed with signal 6 (core dumped) Problem seems to to be with one old mail. OS: FreeBSD 11.1-RELEASE-p4 Dovecot 2.2.33.2 , pigenhole 0.4.21 trace, conf and email available https://pastebin.com/7X6fZPPd Kristjan

2 1

disable deflate compression in rawlog files
by Daniel Betz 26 Jan '18

26 Jan '18

Hello list, is there an way to disable the deflate compression ( imap_zlib ) in the rawlog files, e.g. via postlogin script when dovecot.rawlog folder exists ? Rawlog shown at the moment like: 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE COMPRESS=DEFLATE QUOTA] Logged in * NAMESPACE (("INBOX." ".")) NIL NIL 2 OK Namespace completed (0.001 + 0.000 secs). 3 OK Begin compression (0.001 + 0.000 secs). <D2>R<F0>tQ<D0>P<CA>K<CC>MURPr<C9>/KM<CE>/........ Regards, Daniel Betz System Design Engineer / Senior Systemadministration ___________________________________ domainfactory GmbH Oskar-Messter-Str. 33 85737 Ismaning Germany Telefon: +49 (0)89 / 55266-364 Telefax: +49 (0)89 / 55266-222 E-Mail: dbetz(a)df.eu Internet: www.df.eu Registergericht: Amtsgericht München HRB-Nummer 150294, Geschäftsführer: Dr. Claus Boyens, Tobias Mohr

1 0

Quota plugin creates IMAP folder
by Thorsten Hater 25 Jan '18

25 Jan '18

Hi everyone, I have noticed recently that Dovecot creates lock directories under users' Maildirs which look like IMAP folders. This is bad since users will see IMAP folders that are not supposed to be there. In my logs I see dovecot: imap(...): Error: file_create_locked(/.../Maildir/.vsize.lock) failed: Is a directory The directory in question # ls /.../Maildir/.vsize.lock/ cur/ dovecot.index.log dovecot-uidlist maildirfolder new/ tmp/ so Dovecot seems to think this to be an IMAP folder. I am using Dovecot 2.2.27 under Debian, built from source, the lock_method is set to fnctl, and the quota plugin uses the maildir method. Can somebody advice me on how to fix this? Best regards, Thorsten

3 7

Single mailbox optimizations
by Alex Shishkin 25 Jan '18

25 Jan '18

Hello, I have unconventional load profile for my email server and I would like to ask if someone can suggest optimizations in my case. I have only one mailbox on the server for collecting emails from variety of external mail servers. I use Postfix for collecting emails and Dovecot to provide IMAP for downloading emails from this mailbox. Currently Postfix configured to use LMTP for transferring emails to Dovecot. Dovecot mail storage format is mdbox. Everything was in order (no incoming and active queues in Postfix) when daily incoming email count was up to 1 million emails. But now I have to process up to 2 million incoming emails and I faced bottleneck of 10 emails per second for saving emails from Postfix active queue to mdbox using LMTP. Currently Postfix receives about 20 emails per second, incoming and active queues in Postfix are growing and I have to find the way to speed up transferring process from Postfix to mdbox. This setup is running on the virtual machine with 8 CPU and 8 GB RAM. CPU loaded only by dovecot/lmtp process but not more than 20% per core. I/O wait is 2-3%. Disk load is about 200 wMB/sec and 300 rKB/sec (and this sounds quite a bit for our storage capacity) . Postfix has destination concurrency limit 20 for default and virtual transport (I’m using virtual transport due to virtual domains configuration). Strace showed up that dovecot/lmtp processes have some delays only on waiting for write lock on truncation log file dovecot.index.log. I have temporary moved all index files including truncation log to tmpfs, but this did not help. The only thing that helped me to increase speed up to 20 emails per second is removing almost all emails from the mailbox (with empty Inbox I got even 30 emails per second). But I have to keep all incoming emails in the mailbox at least for one week so this way is unacceptable. So I would like to ask for suggestions, because I can’t find the root cause of this bottleneck. Dovecot version 2.2.31 Postfix version 2.10.1 ------------------------------------------------Dovecot conf ------------------------------------------------ mail_location = mdbox:~/mdbox mdbox_rotate_interval = 1 days mdbox_rotate_size = 200MB mail_plugins = " zlib” plugin { zlib_save = gz zlib_save_level = 6 } userdb { args = /etc/dovecot/passwd default_fields = uid=vmail gid=vmail home=/opt/vmail/%u driver = passwd-file } passdb { args = /etc/dovecot/passwd driver = passwd-file } service lmtp { process_min_avail = 8 service_count = 0 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } vsz_limit = 0 } ------------------------------------------------------------------------------------------------ --------------------------------------Postfix conf------------------------------------------- virtual_alias_maps = hash:/etc/postfix/virtual virtual_mailbox_domains = test.com, example.com virtual_mailbox_maps = hash:/etc/postfix/vmailbox virtual_transport = lmtp:unix:private/dovecot-lmtp default_destination_concurrency_limit = 20 virtual_destination_concurrency_limit = 20 ------------------------------------------------------------------------------------------------

1 0

Re: dovecot Digest, Vol 177, Issue 55
by Matthew Brown 25 Jan '18

25 Jan '18

No reason to tell me about security, I just need chmod for my tests. Where to change it ? On Thu, Jan 25, 2018 at 12:00 PM, <dovecot-request(a)dovecot.org> wrote: > Send dovecot mailing list submissions to > dovecot(a)dovecot.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://dovecot.org/mailman/listinfo/dovecot > or, via email, send a message with subject or body 'help' to > dovecot-request(a)dovecot.org > > You can reach the person managing the list at > dovecot-owner(a)dovecot.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of dovecot digest..." > > > Today's Topics: > > 1. Re: Panic: data stack: Out of memory when allocating bytes > (Josef 'Jeff' Sipek) > 2. Re: 777 permissions on mailbox, subfolders subfiles new > emails (Nikolai Lusan) > 3. Re: problem with lda (Stephan Bosch) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 24 Jan 2018 17:39:36 -0500 > From: Josef 'Jeff' Sipek <jeff.sipek(a)dovecot.fi> > To: Thomas Robers <robers(a)tutech.de> > Cc: dovecot(a)dovecot.org > Subject: Re: Panic: data stack: Out of memory when allocating bytes > Message-ID: <20180124223936.GE14966@meili> > Content-Type: text/plain; charset=us-ascii > > On Wed, Jan 24, 2018 at 18:55:47 +0100, Thomas Robers wrote: > > Am 23.01.2018 um 20:07 schrieb Josef 'Jeff' Sipek: > > > On Tue, Jan 23, 2018 at 14:03:27 -0500, Josef 'Jeff' Sipek wrote: > > > > On Tue, Jan 23, 2018 at 18:21:38 +0100, Thomas Robers wrote: > ... > > > > 1. Do you have any idea what the imap process was doing at the time > of the > > > > allocation failure? > > > > Yes perhaps. We use shared mailboxes and at the time of failure the > > imap process is reading acl files in a shared mailbox (and subfolder). > > This shared mailbox has about 2800 subfolder and the acl files are read > > in about 10sec and and during this reading the imap process dies with > > the already mentioned error. It seems it has something to do with the > > shared mailbox, because since yesterday morning 5 core dumps have been > > created, 4 of them by one user accessing the shared mailbox and 1 > > by the user who is the owner of the shared mailbox. No other mailboxes > > are affected until now. > > Based on the stack trace, the client was creating a new mailbox, which > caused an acl list rebuild, which ended up triggering this oddly sized > allocation. > > > > > 2. You snipped all the important parts of the back trace. :) It > *starts* on > > > > the line: > > > > #0 0x00007f73f1386495 in raise () from /lib64/libc.so.6 > > > > > > In case you haven't used gdb before... after starting up gdb, run "bt > full" > > > at the gdb prompt. That'll print out a very detailed backtrace. (You > might > > > want to sanity check it to make sure there aren't any user passwords > in it > > > before posting it here...) > > > > Yes, sorry I'm not very familiar in using gdb, but here is the full > > backtrace: > > It looks like the binaries are stripped. There should be a "debug" package > you can install with symbol information. Then, the backtrace should be > much > more helpful. > > > > > Having the backtrace should help answer question number 1. > > > > 3. How big is this process when it dies? > > > > I don't know which imap process dies beforehand so how do i get this > > information? > > The size of the core file will give you an general idea. gdb can also > print > out lots of info via "maintenance info sections", but I don't think that'll > help figuring out why things blow up. > > Jeff. > > -- > Keyboard not found! > Press F1 to enter Setup > > > ------------------------------ > > Message: 2 > Date: Thu, 25 Jan 2018 13:09:40 +1000 > From: Nikolai Lusan <nikolai(a)lusan.id.au> > To: dovecot(a)dovecot.org > Subject: Re: 777 permissions on mailbox, subfolders subfiles new > emails > Message-ID: <1516849780.4714.5.camel(a)lusan.id.au> > Content-Type: text/plain; charset="UTF-8" > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA512 > > Hi, > > On Thu, 2018-01-25 at 00:35 +0200, Matthew Brown wrote: > > What I have to change, so dovecot on new email create, sets chmod 777 on > > Mailbox and all subfolders subfiles all new emails/sent emails etc. > > This is a really bad idea. It is possible to setup in dovecot if you're > using dovecot as your LDA. The only reason I can think of for anything > close to this is virtual mailboxes ... and even then I set things up with a > specific user to own the files and set them as 770 for the directories and > 660 for the files. With that setup dovecot limits users to their own mail > directories with values returned via the passdb/userdb. > > As a general rule anything on a *nix system that is chmod 777 is to be > avoided - it's a massive security risk. > > - -- > Nikolai Lusan <nikolai(a)lusan.id.au> > -----BEGIN PGP SIGNATURE----- > > iQIzBAEBCgAdFiEEVfd4GW6z4nsBxdLo4ZaDRV2VL6QFAlppSnQACgkQ4ZaDRV2V > L6To/BAAjKeTi6reaRrcSClKm6PEbgewtF1KvHgO1zr+hv9T2XOnVGFSajeFwSXR > rDSXGQ/H9s97KDGZB4VKxuSKZsDRFkF9u7ILttuXOgj8kG8XZl4sqg/w0FIrTC1K > GD8T0TZWSJGFIzrLXTpgzoO1LeQXIuXgnZIMbcaneCHKZc1do/GwQ4DEFVdUnxRJ > n+76nbs8RdQwZKGXYGGTU/BXPniTSW1pmTFxnlruxE7fuWBYeEyQGQRke/CT2rFF > ET+d7LlV4Nds6eGjalyf7m5tCNS87Zm78xegANuMNaMdzPI8NlbnFO82bAlC7kP/ > WkCFSfhJL3s9daEnMWT/dxY2lNKy3kTyOZssXM6ROkNhOFRipNwRr77tO6qzu8l9 > pvaVxr8a0pMVQwxGAyW84vS9GWmeMNMMiY0k7XdPSBS/6CVlQm8eUhnDo6GFZoH9 > Tbn4XNkEKysbZEjImjXb6eQpRwQLniIULjeyoX8aqmN2sh4kDndLJwjxpz7Jd6v2 > j2tuS7+79G9qU8dqpCSwzvWYTteOLJeqJLy6s5F+zf8FHGLcHdNasoo+/Sdzg4+E > tZm31wp7iQdzKMwbOnRk9FceYXbb9WjxI1QY+7U11Rx25y44UDPzUYYOL+ZoWOXJ > zAr/F9fhUP/u8AubOgOn6BLaguiWcFK0g6HhCqDkVAUibEMzC+0= > =YUek > -----END PGP SIGNATURE----- > > > > ------------------------------ > > Message: 3 > Date: Thu, 25 Jan 2018 09:35:57 +0100 > From: Stephan Bosch <stephan(a)rename-it.nl> > To: Infoomatic <infoomatic(a)gmx.at>, dovecot(a)dovecot.org > Subject: Re: problem with lda > Message-ID: <2544728b-5441-c163-34fd-bd155e28f591(a)rename-it.nl> > Content-Type: text/plain; charset=utf-8 > > Op 1/24/2018 om 5:30 PM schreef Infoomatic: > > Hello, > > > > I am currently testing the upgrade from our dovecot v2.2.23 to 2.3.0. I > have a strange problem with lda. > > We use bounce mails for internal users if they try to send > virus/spammails. The exact same config works with 2.2.23, but not with > 2.3.0. > > > > The relevant postfix/master.cf part: > > dovecot unix - n n - - pipe > > flags=DRhu user=vmail:vmail argv=/opt/dovecot/libexec/dovecot/deliver > -d ${recipient} -f ${sender} > > > > On the same machine, with 2.2.23 I get a bounce mail when trying to send > a virus, with the subject "VIRUS in message apparently from you > (Eicar-Test-Signature)", to both the users inbox as well as to the mailbox > of virusalert(a)ourdomain.internal > > > > With 2.3.0, in the logs I get an error: > > > > relay=dovecot, delay=0.01, delays=0/0/0/0, dsn=5.3.0, status=bounced > (command line usage error. Command output: lda: Fatal: Invalid -f > parameter: Missing domain > > > > and the alert message is only sent to virusalert(a)ourdomain.internal, > but not to the user who tried to send the mail. > > > > The relevant part of our dovecot.conf: > > protocol lda { > > mail_plugins = " quota zlib sieve acl mail_log notify" > > postmaster_address = postmaster(a)ourdomain.internal > > } > > > > Does anyone know how to solve this problem? Or is there a workaround via > postfix/amavis/spamassassin? Any hints are highly appreciated, thanks! > > Apparently, the ${sender} has no @domain part. Why? > > Regards, > > Stephan. > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot(a)dovecot.org > https://dovecot.org/mailman/listinfo/dovecot > > ------------------------------ > > End of dovecot Digest, Vol 177, Issue 55 > **************************************** > -- zxzzzzzzzzzzzzz

1 1