- dovecot - dovecot.org

mdbox + director + nfs
by Matt Bryant 17 Oct '17

17 Oct '17

Anyone had any experience they can share using a director setup with NFS and using the mdbox format instead of maildir. Is locking an issue on index files ?? rgds Matt -- <https://www.postbox-inc.com/?utm_source=email&utm_medium=siglink&utm_campai…>

3 2

Trash plugin unexpected results
by Stephan Herker 16 Oct '17

16 Oct '17

I have the trash plugin enabled and testing it out I had an account with a 30MB quota. In the accounts trash it had an email with a large attachment. I sent the same email again to the account expecting the trash plugin to purge the message from trash to make space for the new message in the inbox. However I got an error saying it couldn't remove enough trash to make space. This behavior seems unexpected because it seems like the trash plugin didn't account for the quota and size available. Debug logs and dovecot -n output below. Oct 07 17:33:13 lmtp(31543): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:33:13 lmtp(31543): Info: Connect from local Oct 07 17:33:13 lmtp(31543): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib11_trash_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=30000 Oct 07 17:33:13 lmtp(31543): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543): Debug: Added userdb setting: plugin/quota_rule=*:storage=30000 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=30720000 messages=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=3072000 (10%) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Added 'Spam' with priority 1 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Added 'Trash' with priority 2 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin successfully loaded Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: binary save: not saving binary /home/vmail/testdo.com/123/.dovecot.svbin, because it is already stored Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.svbin Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Failed to remove enough messages (needed 17035766 bytes, expunged only 16803594 bytes) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Info: uFHMBEly2Vk3ewAAobcTNA: sieve: msgid=<c5189e27-b2e3-bcc2-b34f-ecffa9d614cc(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Info: uFHMBEly2Vk3ewAAobcTNA: sieve: execution of script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script failed with unsuccessful implicit keep (user logfile /home/vmail/testdo.com/123/.dovecot.sieve.log may reveal additional details) Oct 07 17:33:13 lmtp(31543): Info: Disconnect from local: Successful quit # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

3 5

SSL overview...
by SH Development 16 Oct '17

16 Oct '17

Can someone help me understand the overall picture of SSL certificates in this scenario? I have a working dovecot/postfix/mysql server. It has a certificate. I now want to create a second, essentially duplicate configured server for use with replication. What is the relationship between the certificate and the hostname, or the DNS entry since the certs are created using the server’s domain name? mail.serverA.mydomain has a certificate that was created using mail.serverA.mydomain. The server's hostname is mail.serverA.mydomain. Now enter the new server. It would probably be: mailserverB.mydomain and a certificate created using mail.serverB.mydomain. The server’s hostname would be mail.serverB.mydomain. My questions: 1. Can I use the same certificate on both servers since they are serving email for the same domain? 2. Does the hostname have to be the same as the domain name, and thus the name used to create the cert? Sorry if I’m muddled about this. It was never really an issue until I wanted to add a secondary server into the mix. Ethon B.

2 3

Convert from mbox to Maildir
by Josef Wolf 16 Oct '17

16 Oct '17

Hello everybody, I am in the process to install dovecot as an IMAP server. Currently, this system runs postfix and uses procmail for local (mbox style) delivery. Procmail ist started by postfix like this: /etc/postfix/main.cf: mailbox_command = /usr/bin/procmail ~/.forward: "|IFS=' ' && exec /usr/bin/procmail -f- || exit 75 # jw" Before going into IMAP details, I decided to convert the system to Maildir as a first step. So I created a procmail-entryrecipe to populate a test folder: ~/.procmailrc: :0 * ^Subject:.*dovecot-test { ORGMAIL="${HOME}/Maildir/" DEFAULT=${ORGMAIL} DELIVER="/usr/lib/dovecot/deliver -o mail_location=maildir:~/Maildir -o lda_mailbox_autocreate=yes" :0 | $DELIVER -m dovecot-test } This setup seems to work. But there is one point that bugs me: in the first tests, dovecot was mis-configured (the two -o options were missing) and the test mails were silently lost. No errors in the procmail logfile. Only dovecot reports errors in its logfile. But the error seems not to be noticed by procmail. Therefore procmail assumes deliver could store the mail successfully and won't keep a backup of it. I am sure, I'm doing something stupid here. I have never seen such behavior from procmail before. Normally procmail would report failure of sub-commands. Now I hesitate to go forward in this conversion process. I don't want to loose mails if something is wrong with the dovcot setup. Besides: I wonder whether the setting DEFAULT=${ORGMAIL} is a good idea. Wouldn't it be better to have DEFAULT=/var/spool/mail/$USER so there would be a fallback in case there are delivery problems to ${ORGMAIL} Any thougths? -- Josef Wolf jw(a)raven.inka.de

4 5

Question about ITERINDEX in 2.2.32
by María Arrea 16 Oct '17

16 Oct '17

Hello I have a question about the new setting ITERINDEX. This is my filesystem layout /indices_dovecot : 8 x Fast SSD drives /buzones : 32x SAS 10k rpm disks /buzones/alternativo : 24 x SAS 7.2k rpm slow disks This is my mail_location: mail_location = mdbox:/buzones/domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n:ALT=/buzones/alternativo/domain/%2.26Hn/%2.200Hn/%n What should I write in mail_location with the new ITERINDEX setting? Regards María

2 6

Locking Errors
by List 16 Oct '17

16 Oct '17

We recently upgraded to version 2.2.10-8 on Centos 7 (from 2.2.10-7) and immediately started experiencing errors in the log file that look like this: Error: Broken file /mail/user/Maildir/dovecot-uidlist line 891: Invalid data: Error: Timeout (180s) while waiting for lock for transaction log file /mail/user/Maildir/dovecot.index.log Error: /mail/user/Maildir/.Trash/dovecot-uidlist: next_uid was lowered (421 -> 419, hdr=418) Error: Corrupted index cache file /mail/user/Maildir/dovecot.index.cache: invalid record size Error: Broken file /mail/user/Maildir/.Trash/dovecot-uidlist line 156: Invalid data: Error: Corrupted index cache file /mail/user/Maildir/dovecot.index.cache: invalid record size Error: Index /mail/user/Maildir/dovecot.index: Lost log for seq=2 offset=2392 Error: fcntl(write-lock) locking failed for file /mail/user/Maildir/dovecot.index.log: Stale file handle We are not sure what might be causing this, can anyone help illuminate what’s going on?

3 5

Setting up replication - First steps...
by SH Development 16 Oct '17

16 Oct '17

Just had my first (non-Dovecot) server failure due to dried out caps on the motherboard. Got me to thinking about my single-point-of-failure mail server. Currently running Dovecot and Postfix with no issues, but want to start taking steps just to be safe. I currently run a filesystem backup every 24 hours to a tar file over NFS to another server in our rack. I am backing up: /home/vmail /etc/dovecot /etc/postfix Unfortunately, the vmail directory has grown to 27GB and takes around 7 hours now to backup as described above. Which leads me to start thinking about how quickly I could restore the server from a backup if need be, and that time is at least 7 hours just to copy and untar the files onto another hard drive. I’m sure I could hook up a HD up directly to the backup server, then I could considerably reduce the time, but I’m making the assumption that I won’t always have quick physical access to the location. So I believe my first step is to set up another server, on another IP, different hostname, with Dovecot and Postfix, and simply use the files from the /etc directories of the existing server to configure it (changing the IP and hostname of course). Am I on the right track so far? Next steps involve setting up replication with dsync? If I have successfully setup replication between the two servers, does this mean users can then actually log into either server and have their “stuff” intact? So I could set up DNS failover in case the primary server fails? Would this make the setup acceptable for secondary MX as everything should sync to the primary server when it comes back online? Sorry for thinking out loud, but I want to make sure I’m understanding the bigger picture here. Jeff

4 3

Re: Newbie question...
by SH Development 16 Oct '17

16 Oct '17

I see you haven’t received an answer. Sorry people here don’t seem to have time or inclination to answer basic questions. I’ve tried. You’re better to search elsewhere. Ethon > On Oct 11, 2017, at 12:17 PM, Michael Segel <dovecot_mjs(a)hotmail.com <mailto:dovecot_mjs@hotmail.com>> wrote: > > Hi, > > I’ve downloaded and built dovecot from the source. > Now I’ve run in to a couple of issues. > Like namespaces. > > Is there an example of the namespaces settings? Nothing fancy, just the basics… > > These are private mailboxes, but still need to know what I have to do to set this correctly. > > Thanks In Advance, > > -Mike >

3 4

Filtering by country
by Anvar Kuchkartaev 16 Oct '17

16 Oct '17

Is it possible to filter out logins by country (I would like to limit dovecot instance users to log in only from specific countries)?‎‎ Anvar Kuchkartaev anvar(a)anvartay.com

3 2

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 15 Oct '17

15 Oct '17

We'll take a look ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 12/10/2017 07:50 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi> Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) Hi Aki, I think I posted a bt full of this in the original email I sent to the list: https://www.dovecot.org/pipermail/dovecot/2017-October/109583.html I've got heaps of coredumps if we need to pick apart one specific one now though. Reuben On 12/10/2017 3:36 PM, Aki Tuomi wrote: > can you provide bt full output from core? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > Date: 12/10/2017 06:22 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi>, dovecot(a)dovecot.org > Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) > > Hi, > > Just to confirm this is still a major problem for me with the 2.2.33.1 > release (did not exist in previous releases). > > Reuben > > > On 8/10/2017 6:30 AM, Aki Tuomi wrote: >> Thanks! We'll look into it. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Reuben Farrelly <reuben-dovecot(a)reub.net> >> Date: 07/10/2017 13:08 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) >> >> This appears to be breaking dsync at the moment and is caused by >> something committed in the last week or so. This is with the current >> -git of dovecot-2.2 (eaf276b33). >> >> The crash happens all the time - the logs are full of this message. >> >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O >> leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file >> ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != >> NULL) >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw >> backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] >> -> /usr/lib64/dovecot/li >> bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> >> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> >> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 >> 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) >> [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) >> [0x7f8bb65815f8] -> /usr/lib64/dovec >> ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> >> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] >> -> /usr/lib64/dovecot/libssl_iost >> ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> >> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) >> [0x7f8bb12da52e] -> / >> usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] >> -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) >> [0x7f8bb657e765] -> >> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] >> -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> >> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> >> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] >> -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) >> [0x7f8bb657e93f] -> >> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] >> -> dovecot/doveadm-server() [0x444a35] -> >> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> >> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) >> [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> >> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() >> [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) >> [0x7f8bb656d241] -> >> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) >> [0x7f8bb656fe58] -> >> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) >> [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) >> [0x7f8bb656d345] >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: >> service(doveadm): child 27186 killed with signal 6 (core dumped) >> >> >> thunderstorm reuben # file core >> core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, >> from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: >> 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', >> platform: 'x86_64' >> >> thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core >> GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 >> Copyright (C) 2017 Free Software Foundation, Inc. >> License GPLv3+: GNU GPL version 3 or later >> <http://gnu.org/licenses/gpl.html> >> This is free software: you are free to change and redistribute it. >> There is NO WARRANTY, to the extent permitted by law. Type "show copying" >> and "show warranty" for details. >> This GDB was configured as "x86_64-pc-linux-gnu". >> Type "show configuration" for configuration details. >> For bug reporting instructions, please see: >> <https://bugs.gentoo.org/>. >> Find the GDB manual and other documentation resources online at: >> <http://www.gnu.org/software/gdb/documentation/>. >> For help, type "help". >> Type "apropos word" to search for commands related to "word"... >> Reading symbols from /usr/libexec/dovecot/doveadm-server...done. >> [New LWP 27186] >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib64/libthread_db.so.1". >> Core was generated by `dovecot/doveadm-server'. >> Program terminated with signal SIGABRT, Aborted. >> #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 >> (gdb) bt full >> #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 >> No symbol table info available. >> #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 >> No symbol table info available. >> #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, >> status=0) at failures.c:201 >> backtrace = 0x228e4d8 >> "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> >> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> >> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... >> #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, >> format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", >> args=0x7ffef81daa70) >> at failures.c:670 >> status = 0 >> #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line >> %d (%s): assertion failed: (%s)") at failures.c:275 >> ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, >> timestamp_usecs = 0} >> args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = >> 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} >

3 6

Updating keywords on copy/move
by Daniele Ricci 14 Oct '17

14 Oct '17

Hello, I'm working on my virtual keywords plugin [1] to add an apparently simple feature: add a keyword to a message when it is moved or copied into a virtual folder (let's forget about what keyword to add, I'm starting with a hard-coded one to understand Dovecot plugin development). So I've added a mail_copy hook by the notify plugin [2] and did a simple call to mail_update_keywords [3]. The current source code shows a call to mail_get_backend_mail, this is me experimenting, I've also tried calling mail_update_keywords directly on "dst" mail. The result is an imap crash: Oct 14 21:22:26 notebook dovecot: imap(daniele): Panic: file mail-log-plugin.c: line 461 (mail_log_mail_transaction_commit): assertion failed: (msg->pretext == NULL) Oct 14 21:22:26 notebook dovecot: imap(daniele): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f81af52f0a2] -> /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f81af52f19a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f81af4bfcf8] -> /usr/lib/dovecot/modules/lib20_mail_log_plugin.so(+0x19e8) [0x7f81aeae89e8] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(notify_contexts_mail_transaction_commit+0x58) [0x7f81aecec548] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x2105) [0x7f81aeced105] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) [0x7f81af807ca2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0x21) [0x7f81af807d71] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_transaction_commit+0x78) [0x7f81ae8e2fb8] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x20ec) [0x7f81aeced0ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) [0x7f81af807ca2] -> dovecot/imap(+0x10084) [0x563d0ff2b084] -> dovecot/imap(command_exec+0x5c) [0x563d0ff37d9c] -> dovecot/imap(+0x1b322) [0x563d0ff36322] -> dovecot/imap(+0x1b3bc) [0x563d0ff363bc] -> dovecot/imap(client_handle_input+0x18d) [0x563d0ff3677d] -> dovecot/imap(client_input+0xac) [0x563d0ff36ccc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f81af544742] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7f81af545d8e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) [0x7f81af5447d6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f81af544988] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f81af4ca353] -> dovecot/imap(main+0x329) [0x563d0ff29139] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f81af1132e1] -> dovecot/imap(_start+0x2a) [0x563d0ff292ca] This happens after my hook returns. Now, before activating core dumps and starting to do some serious debugging and reverse engineering, I ask: do I have to do something extra such as opening a transaction or something? Isn't the notify plugin supposed to do that already? Thanks for your help! [1] http://github.com/daniele-athome/dovecot-virtual-keywords-plugin [2] https://github.com/daniele-athome/dovecot-virtual-keywords-plugin/blob/keyw… [3] https://github.com/daniele-athome/dovecot-virtual-keywords-plugin/blob/keyw… -- Daniele

1 0

Last Login example
by Jorge Bastos 14 Oct '17

14 Oct '17

Howdy, Where can i find a configuration example for the last login plugin, that fits for latest dovecot version? Thanks in advanced! Jorge,

1 0

Re: Solr/Basic Auth?
by Aki Tuomi 14 Oct '17

14 Oct '17

You can include it in the url, like http://user:pass@host/---Aki TuomiDovecot oy -------- Original message --------From: Larry Rosenman <larryrtx(a)gmail.com> Date: 13/10/2017 23:32 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Solr/Basic Auth? Does the fts-solr plugin support solr's basic auth plugin? If not, can it? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Solr/Basic Auth?
by Larry Rosenman 13 Oct '17

13 Oct '17

Does the fts-solr plugin support solr's basic auth plugin? If not, can it? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Re: Convert from mbox to Maildir
by Joseph Tam 13 Oct '17

13 Oct '17

Nikolai Lusan <nikolai(a)lusan.id.au> writes: >> Just went through this one recently using CentOS with SendMail, Procmail >> and IMAP conversion from mbox to Maildir - I needed to make sure I could >> run both formats while I migrated users one-by-one. > > When I have migrated solutions from mbox to maildir (I have done more than > one) I found it easier to get a mail client to do the hard work for me (if > you're on a LAN with the server it's faster). I created new usernames with > maildir as their base, and copied the folder over. Reading over David's and various schemes, the tricky part is consistency: avoiding race conditions where you have the user manipulating their mailboxes and your MTA/LDA delivering mail, while simultaneously doing mbox->Maildir conversion. To guarantee consistency, it's necessary to lock out other avenues of mbox changes while the conversion takes place. Otherwise, you'll have the situation where mail can get duplicated, or worse, deleted. For example, think of this sequence: convert B, user moves message A->B, convert A. I think the safest is method is 1) Deny the user access to IMAP/POP: deny userdb/passdb, or lock their password and flush their auth cache entry. 2) TEMPFAIL MTA delivery to user during conversion 3) Kick the user 4) Do the conversion 5) Undo 1+2 If you have a smart conversion script (one that recognizes changes and only do delta updates) you can greatly speed up step 4 and minimize outage time. 0) Do an initial conversion that will do the bulk of the work but does not guranatee consistency. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: v2.2.33 released
by Aki Tuomi 13 Oct '17

13 Oct '17

try with 2.2.33.1 ---Aki TuomiDovecot oy -------- Original message --------From: Odhiambo Washington <odhiambo(a)gmail.com> Date: 13/10/2017 10:42 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Cc: dovecot-news(a)dovecot.org Subject: Re: v2.2.33 released On 10 October 2017 at 18:28, Timo Sirainen <tss(a)iki.fi> wrote: > https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz > https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz.sig > > We're getting close to the last v2.2.x releases. Hopefully we'll have the > first v2.3 beta releases out soon. > Something is wrong with 2.2.33, but I haven't found time to catch it. I have been running 2.2.32 without issues. I use dovecot-lda with Exim. The moment I installed 2.2.33, it was all failures - mail somehow gets delivered, but a failure too is generated. I have backed off from 2.2.33 for now. Maybe I will find time to debug later. Maybe someone already found a way around, but I missed the post? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 3

v2.2.33 released
by Timo Sirainen 13 Oct '17

13 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz.sig We're getting close to the last v2.2.x releases. Hopefully we'll have the first v2.3 beta releases out soon. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. + auth: Added %{ldap_dn} variable for passdb/userdb ldap - acl: The "create" (k) permission in global acl-file was sometimes ignored, allowing users to create mailboxes when they shouldn't have. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails. - pop3: rawlog_dir setting didn't work

2 1

Released Pigeonhole v0.4.21 for Dovecot v2.2.33.1.
by Stephan Bosch 13 Oct '17

13 Oct '17

Hello Dovecot users, Here's the definitive 0.4.21 release. There were no changes since the release candidate. Changelog v0.4.21: * redirect action: Always set the X-Sieve-Redirected-From header to sieve_user_email if configured. Before, it would use the envelope recipient instead if available, which makes no sense if the primary e-mail address is available. + vacation extension: Allow ignoring the envelope sender while composing the "To:" header for the reply. Normally, the "To:" header is composed from the address found in the "Sender", "Resent-From" or "From" headers that is equal to the envelope sender. If none is then found, the bare envelope sender is used. This change adds a new setting "sieve_vacation_to_header_ignore_envelope". With this setting enabled, the "To:" header is always composed from those headers in the source message. The new setting thus allows ignoring the envelope, which is useful e.g. when SRS is used. + vacation extension: Compose the "To:" header from the full sender address found in the first "Sender:", "From:" or "Resent-From:" header. Before, it would create a "To:" header without a phrase part. The new behavior is nicer, since the reply will be addressed to the sender by name if possible. - LDA Sieve plugin: Fixed sequential execution of LDAP-based scripts. A missing LDAP-based script could cause the script sequence to exit earlier. - sieve-filter: Removed the (now) duplicate utf8 to mutf7 mailbox name conversion. This caused problems with mailbox names containing UTF-8 characters. The Dovecot API was changed years ago, but apparently sieve-filter was never updated. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.21.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.21.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Solr 7
by Ricardo Branco 12 Oct '17

12 Oct '17

Before I go down the route of upgrading our main Solr instance from 6 to 7, just checking if anyone is using Solr 7 with Dovecot.

4 4

Re: Mail Alias Stores in mySQL Not working - SOLVED
by jason hirsh 12 Oct '17

12 Oct '17

"You have the alias abuse(a)kasdivi.com <mailto:abuse@kasdivi.com> for the address admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> in your db and all mail to these aliases should go the the admin@ mailbox. Address mapping should be done in postfix so that the recipient address that gets used on the lmtp connection to dovecot is admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> You probably disabled address mapping in postfix. -- Christian Kivalo” You nailed that .. I had completely forgotten about that.. I am changing a system from hash to SQL I actually feel kind of stupid I knew Postfix was supposed to do the acceptance.. and it should have been common sense that it need to rewrite.. The logs kept reminding me I had the following line in master,cf -o receive_override_options=no_address_mappings,no_header_body_checks,no_unknown_recipient_checks changed to -o receive_override_options=no_header_body_checks,no_unknown_recipient_checks and system works great.. Thanls!!

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"So abuse(a)kasdivi.com <mailto:abuse@kasdivi.com> is an alias, not a user.? You can't login with an alias because your user_query is looking at the`mailbox` table. Have your tried logging in as: admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> OR you could put an entry forabuse(a)kasdivi.com <mailto:forabuse@kasdivi.com> in your `mailbox` table. Bill” Bill Excuse me I must have some where mi-stated myself. Yes abuse(a)variousdoamns.com is an alias going back to my admin account The issue was iin my master.cf where I had at some time disabled remapping Fixed that and all is good Thanks for your time and effort.. You helped tremendously and actually had me discover some other issues Jason

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

3 2

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"In an earlier post you said your user_query was: user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=?1' Last post you said: mail is stored at /var/mail/vhosts and: mail_location = maildir:/var/mail/vhosts/%d/%n These don't agree with your user_query.” Probably my mis-statement "Run a MySQL query: SELECT `username`, `domain`, `maildir` FROM `mailbox` LIMIT 5; Let's see the value of maildir” mysql> SELECT `username`, `domain`, `maildir` FROM `mailbox` LIMIT 5; +--------------------------+--------------------+---------------------------+ | username | domain | maildir | +--------------------------+--------------------+---------------------------+ | jason(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/jason/ | | admin(a)gcsbonaire.com | gcsbonaire.com | gcsbonaire.com/admin/ | | admin(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/admin/ | | test(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/test/ | | lin(a)grapestreet.com | grapestreet.com | grapestreet.com/lin/ | +--------------------------+--------------------+---------------------------+ 5 rows in set (0.00 sec) "Also, lets see the output of: ls -l /var/mail/vhosts/*” drwxrwxr-x 4 1003 vmail 512 Jun 25 2016 camantonewfashion.com drwxrwxr-x 4 1003 vmail 512 Sep 6 2016 filmusfamily.com drwxrwxr-x 8 1003 vmail 512 Oct 8 13:44 gcs-bonaire.com drwxrwxr-x 4 1003 vmail 512 Oct 5 07:40 gcsbonaire.com drwxrwxr-x 3 1003 vmail 512 Jun 25 2016 grapestreet.com drwxrwxr-x 5 1003 vmail 512 Jun 25 2016 grapestreetgen.com drwxrwxr-x 5 1003 vmail 512 Jun 25 2016 grapestreetvoice.com drwxrwxr-x 11 1003 vmail 512 Oct 11 13:37 kasdivi.com drwx------ 3 1003 vmail 512 Oct 11 13:25 test.com drwxrwxr-x 7 1003 vmail 512 Oct 11 13:42 theoceanwindow.com It seems that the correct information is stored in the correct place but i get dovecot: auth-worker(21961): sql(abuse(a)kasdivi.com): unknown user Its seems like there is a simple config thing I am not getting right Jason

2 1

v2.2.33.1 released
by Timo Sirainen 12 Oct '17

12 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.1.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.1.tar.gz.sig Oops, one a bit too bad bug was left in the release, so fixing it here. - dovecot-lda was logging to stderr instead of to the log file.

2 1

Connection closed reason
by Miloslav Hůla 12 Oct '17

12 Oct '17

Hi, we have one user using the old Alpine client with IMAP. Time to time (3 times per day or 3 times per week) he get error: "MAIL FOLDER INBOX CLOSED DUE TO ACCESS ERROR" and he complains, that inbox stops to refresh with new emails. I don't know Alpine but I can imagine, that Alpine creates TCP connection to IMAPS and uses IDLE. I read wiki page about Timeouts [1] and it seems OK. Alpine is connected 5 or more hours without interrupt. But I found 'Connection closed' at approximate times of user reports in mail.log. Am'I undestand it correctly, that 'Connection closed' is some kind of incorrect connection end? I can find 'Logged out' messages which seems to me as correct ones. I can imagine that such situations may happend for moving clients, such a smartphone with losing signal. But mentioned user is on local network connected by cable. I'm interested, what exactly 'Connection closed' in mail log means. We have following lines in log: dovecot: imap(username): Connection closed in=63 out=288442 dovecot: imap(username): Connection closed (IDLE running for 0.001 + waiting input for 0.001 secs, 2 B in + 10+0 B out, state=wait-input) in=9668 out=17375 imap(username): Connection closed: read(size=3751) failed: Connection reset by peer in=4441 out=51431 dovecot: imap(username): Connection closed (UID fetch running for 0.008 + waiting input for 0.001 secs, 0.001 in locks, 101 B in + 202+202 B out, state=wait-input) in=3330 out=436043 Could it be problem in our network or Dovecot configuration issue? Can I somehow debug all connections for single client? Thank you, Milo [1] https://wiki.dovecot.org/Timeouts

2 2

Re: Connection closed reason
by Joseph Tam 12 Oct '17

12 Oct '17

Miloslav H?la <miloslav.hula(a)gmail.com> > we have one user using the old Alpine client with IMAP. Time to time (3 > times per day or 3 times per week) he get error: "MAIL FOLDER INBOX > CLOSED DUE TO ACCESS ERROR" and he complains, that inbox stops to > refresh with new emails. Hmm, I see when using direct file access, but not when using IMAP, but I don't often connect this way with alpine). > Am'I undestand it correctly, that 'Connection closed' is some kind of > incorrect connection end? I can find 'Logged out' messages which seems > to me as correct ones. > ... > dovecot: imap(username): Connection closed in=63 out=288442 > dovecot: imap(username): Connection closed (IDLE running for 0.001 + > waiting input for 0.001 secs, 2 B in + 10+0 B out, state=wait-input) > in=9668 out=17375 I was able to simulate this using netcat -- this log message comes when the client closes the connection during IDLE. > imap(username): Connection closed: read(size=3751) failed: Connection > reset by peer in=4441 out=51431 I couldn't recreate this, but this happens when the client sends an immediate TCP RST connection teardown packet, rather than the usual FIN/ACK/RST orderly shutdown. I don't know what would cause this -- maybe some firewall state session timeout? Joseph Tam <jtam.home(a)gmail.com>

2 1

How to map email addresses to usernames?
by Andreas Born 12 Oct '17

12 Oct '17

Hello, I have a general question about userdb and passdb lookups, in my case related to driver=sql. The documentation and most examples in the internet seem to assume that a user's login username to access a mailbox is identical to his email-address, or at least to the local-part of this email-address. This setup works fine. But I don't understand how to setup dovecot, when login username and email adresses differ. Or to say it in other words, how to map email-adresses to mailbox users. I need a sql password_query for passdb to validate the password for a given login name during SMTP or SASL authentication. Lets say the credentials are "user-1"/"anypassword", then the query is similar to "select password from mailboxes where username='%u'". The next step, user_query for userdb is executed to get storage information for user "user-1". This query must also search for the username "user-1", not for an email-adress: "select home, mail from mailboxes where username='%u'". So far, so good. But: For incoming mails via LMTP, my user_query from userdb is being executed with the email-address as search parameter (instead of the login name), so it fails. I miss a third query that maps one user to each email address for delivery, prior to the userdb lookup. For Example: bob(a)example.org => user-1 eve(a)example.org => user-1 ted(a)example.org => user-2 @catchall.org => user-3 "select username from addr_maps where addr='%n@%d'". What is the correct setup for this szenario? I've found two solutions that seem to work, but i'm not sure if they are really failsafe. I) I use driver=prefetch as a first userdb, so for authentication, only the password_query from passdb is relevant and returns all mailbox details. A second userdb does a user_query lookup against email-addresses and is only called for incoming mails. passdb { driver = sql args = /etc/dovecot/sql-check-user.conf } userdb { driver = prefetch } userdb { driver = sql args = /etc/dovecot/sql-check-addr.conf } II) The second userdb performs lookups against usernames (as in the passwd query), but I place a third userdb {} within the lmtp's protocol section, which does a address lookup instead of a username lookup: protocol lmtp { userdb { driver = sql args = /etc/dovecot/sql-check-addr.conf } } passdb { driver = sql args = /etc/dovecot/sql-check-user.conf } userdb { driver = sql args = /etc/dovecot/sql-check-user.conf } What do you think, is there a better solution? - greetings Andreas Dovecot Version: 2.2.27 (c0f36b0)

2 1

Newbie question...
by Michael Segel 12 Oct '17

12 Oct '17

Hi, I’ve downloaded and built dovecot from the source. Now I’ve run in to a couple of issues. Like namespaces. Is there an example of the namespaces settings? Nothing fancy, just the basics… These are private mailboxes, but still need to know what I have to do to set this correctly. Thanks In Advance, -Mike

2 1

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 12 Oct '17

12 Oct '17

can you provide bt full output from core? ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 12/10/2017 06:22 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi>, dovecot(a)dovecot.org Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) Hi, Just to confirm this is still a major problem for me with the 2.2.33.1 release (did not exist in previous releases). Reuben On 8/10/2017 6:30 AM, Aki Tuomi wrote: Thanks! We'll look into it. --- Aki Tuomi Dovecot oy -------- Original message -------- From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 07/10/2017 13:08 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}}

1 0

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Reuben Farrelly 12 Oct '17

12 Oct '17

Hi, Just to confirm this is still a major problem for me with the 2.2.33.1 release (did not exist in previous releases). Reuben On 8/10/2017 6:30 AM, Aki Tuomi wrote: > Thanks! We'll look into it. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > Date: 07/10/2017 13:08 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) > > This appears to be breaking dsync at the moment and is caused by > something committed in the last week or so. This is with the current > -git of dovecot-2.2 (eaf276b33). > > The crash happens all the time - the logs are full of this message. > > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O > leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file > ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != > NULL) > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw > backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] > -> /usr/lib64/dovecot/li > bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> > /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 > 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) > [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) > [0x7f8bb65815f8] -> /usr/lib64/dovec > ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> > /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] > -> /usr/lib64/dovecot/libssl_iost > ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> > /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) > [0x7f8bb12da52e] -> / > usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] > -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) > [0x7f8bb657e765] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] > -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] > -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) > [0x7f8bb657e93f] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] > -> dovecot/doveadm-server() [0x444a35] -> > /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) > [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> > dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() > [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) > [0x7f8bb656d241] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) > [0x7f8bb656fe58] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) > [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) > [0x7f8bb656d345] > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: > service(doveadm): child 27186 killed with signal 6 (core dumped) > > > thunderstorm reuben # file core > core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, > from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: > 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', > platform: 'x86_64' > > thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core > GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 > Copyright (C) 2017 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-pc-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <https://bugs.gentoo.org/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > For help, type "help". > Type "apropos word" to search for commands related to "word"... > Reading symbols from /usr/libexec/dovecot/doveadm-server...done. > [New LWP 27186] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib64/libthread_db.so.1". > Core was generated by `dovecot/doveadm-server'. > Program terminated with signal SIGABRT, Aborted. > #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 > (gdb) bt full > #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 > No symbol table info available. > #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 > No symbol table info available. > #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, > status=0) at failures.c:201 > backtrace = 0x228e4d8 > "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> > /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... > #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, > format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", > args=0x7ffef81daa70) > at failures.c:670 > status = 0 > #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line > %d (%s): assertion failed: (%s)") at failures.c:275 > ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, > timestamp_usecs = 0} > args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = > 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}}

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"With that query, it appears everyone is sharing the same mail directory.? It, of course, depends on the value of `maildir`.? It doesn't look right.” stored by domain or at least it was until i started messing with mysql "Have you checked your MySQL log file to see the actual query?” hmm found out i had never enabled that log…. another tangent I need to follow "We don't know your mailbox format.? Post your 'doveconf -n’.” My bad # OS: FreeBSD 11.0-RELEASE-p9 amd64 ufs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } pop3_uidl_format = %v.%u postmaster_address = postmaster(a)theoceanwindow.com service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service director { unix_listener director-userdb { mode = 0600 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = </usr/local/etc/keys/certs/ca.crt ssl_cert = </usr/local/etc/keys/certs/domain.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_max_userip_connections = 30 } We don't know what your table layout looks like.? Post your 'SHOW COLUMNS FROM `mailbox`’. +------------+--------------+------+-----+---------------------+-------+ | Field | Type | Null | Key | Default | Extra | +------------+--------------+------+-----+---------------------+-------+ | username | varchar(255) | NO | PRI | NULL | | | password | varchar(255) | NO | | NULL | | | name | varchar(255) | NO | | NULL | | | maildir | varchar(255) | NO | | NULL | | | quota | bigint(20) | NO | | 0 | | | local_part | varchar(255) | NO | | NULL | | | domain | varchar(255) | NO | MUL | NULL | | | created | datetime | NO | | 2000-01-01 00:00:00 | | | modified | datetime | NO | | 2000-01-01 00:00:00 | | | active | tinyint(1) | NO | | 1 | | +------------+--------------+------+-----+---------------------+-------+ What is the on-disk directory layout for mail? mail is stored at /var/mail/vhosts

2 1

Aborted dsync backup and resulting fallout
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I am in the middle of setting up a dovecot imap server to replace an aging cyrus imapd. The new server is using mdbox storage for better filesystem performance and is running dovecot-2.2.32. To migrate email over and keep UIDs etc. intact I used the backup feature of doveadm. During testing this generally worked fine. So thanks for that functionality, it really makes migration much easier. I did another sync yesterday which was unintentionally aborted in the middle which left some corrupted files around. Not a problem generally, that's what doveadm force-resync should fix. It did move a m.2 to m.2.broken mailbox file, so that is good. But it seemed to have issues with the m.3 file, which was an empty file of 0 bytes. Even running force-resync a repeatedly always showed the same message: # doveadm force-resync -u cd INBOX doveadm(cd): Warning: fscking index file /var/spool/imap/user/cd/storage/dovecot.map.index doveadm(cd): Warning: mdbox /var/spool/imap/user/cd/storage: rebuilding indexes doveadm(cd): Error: Corrupted dbox file /var/spool/imap/user/cd/storage/m.3 (around offset=0): EOF while reading file header doveadm(cd): Error: mdbox rebuild: Failed to fix file /var/spool/imap/user/cd/storage/m.3 This looks like incorrect behavior. If the file header on a file expected to be a mailbox header is absent, I would expect it to be either best-effort parsed and the header added or at least be moved out of the way as e.g. m.3.broken. After fixing the m.3 storage manually I encountered another kind of error running dsync again: dsync(cd): Error: lucene index /var/spool/imap/user/cd/lucene-indexes: IndexReader::open() failed (#1): IndexInput read past EOF Lucene index broken should be easily fixed by running doveadm fts rescan. Is that correct? The other error thought had to do with the single instance store for attachments. There were a bunch of errors about a broken pipe and three errors stating success instead: dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/c3/0c/hashes/c30cb535927c8bcecb0d45d374624942d0f4e56e: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/0f/0b/hashes/0f0b5351e09ebb487660f23c9b617568093b93d1: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/10/f9/hashes/10f9a4ffd14a5c31f9938c9d8a3ce3f2095fab36: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/9b/9a/hashes/9b9a449477882dfca86e80157616cadbb21bb3b8: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/df/69/hashes/df698a8bda301a7a474ae2b11414c6f532f4461e: Broken pipe As with the m.3 storage file, all these files had 0 byte size. What is the best way of fixing these up? Delete and be done? Thanks, Andreas

1 0

FTS Dealing badly with Tika failures
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I've seen that latest Dovecot has the ability to use the Apache Tika Server to extract metadata from attachments. That is a pretty useful feature and looks to be an improvement over piping the attachment through a shellscript as done with fts_decoder. Having this feature enabled though I sometimes do see the situation that the tika service does not reply in time and it looks like the whole FTS transaction gets aborted: dovecot: indexer-worker(eggs@localhost): Error: fts_tika: PUT http://localhost:9998/tika/ failed: Request timed out (Request queued 60.145 secs ago, 1 attempts in 60.134 secs, 60.034 in http ioloop, 0.000 in other ioloops, connected 1739.235 secs ago) dovecot: indexer-worker(eggs@localhost): Error: Mailbox INBOX.junk: Mail search failed: Internal error occurred. Refer to server log for more information. [2017-10-09 03:46:09] dovecot: indexer-worker(eggs(a)bawue.de): Error: Mailbox INBOX.junk: Transaction commit failed: FTS transaction commit failed: transaction context (attempted to index 12084 messages (UIDs 2..17850)) Is that actually sensible behavior? I would consider attachment metadata to be nice to have, but not necessarily mandatory. So if the attachment indexing fails, I would hope that at least the mailtext got indexed. But it seems like we abort the whole transaction. Am I reading the error log correctly? cheers, Andreas

1 0

dovecot-2.2.33 bug report
by David Binderman 11 Oct '17

11 Oct '17

Hello there, dovecot-2.2.33/src/lib/str-find.c:86]: (warning) Calling 'sizeof' on 'sizeof' Source code is ctx = p_malloc(pool, MALLOC_ADD(sizeof(struct str_find_context), MALLOC_MULTIPLY(sizeof(ctx->goodtab[0]), key_len))); Regards David Binderman

2 1

Re: My sub-folder with Outlook work-around to date - update 201710111315 - Final
by David.M.Clark 11 Oct '17

11 Oct '17

Hi All, After over a week of stuffing around in /etc/dovecot/conf.d files and lots of trial and error, I now have a controlled setup to migrate one user at a time to Maildir without affecting the other mbox based users. For the sake of not posting an essay, if you go to this web page: http://dmc1961.id.au/howto_17101101.php you will see what I have done (moderators please let me know if this is the correct or allowable practice to post links rather than massive e-mails to the group?). My sincere thanks to all who contributed and helped steer me in the right direction - I got a little lost on-line for a while but eventually got back to the right setup (our beloved Linux does have a few different file locations and setup based on the releases out there, so these were a little confusing). Working well now on my test environment and on a test user on the client's box we need to convert, so if there are any more gotchas I will add them to the how-to web page and update you all. Was a battle at times but it was a war worth winning. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

Issue with mailbox conversion using dsync in v2.2.32 (maildir <-> mdbox)
by Jason Kiniry 11 Oct '17

11 Oct '17

Hi all, I've run into an issue with in-place mailbox format conversions between mdbox and maildir and wondered if someone could assist. When using dsync to convert a mailbox, the conversion loses a mailbox GUID and produces a warning. This behavior seems to have been introduced between version 2.2.31 and 2.2.32. See below for the full debug output from both versions followed by the dovecot configuration used for both attempts. When I run the following: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/blahmail/mail -u _mainaccount(a)blahmail.tld -v mirror maildir:/home/blahmail/mail On version 2.2.32, I get the following with the warning included on the last line of the output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)blahmail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_gid=1081 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_uid=1137 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_user=blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Effective uid=1137, gid=1081, home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: fs: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)blahmail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/INBOX doesn't exist yet, using default permissions doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: Effective uid=1137, gid=1081, home=/home/blahmail dsync(blahmail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(blahmail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(blahmail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(blahmail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(blahmail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/blahmail/mail dsync(blahmail): Debug: maildir++: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=/home/blahmail/mail, alt= dsync(blahmail): Debug: fs quota add mailbox dir = /home/blahmail/mail dsync(blahmail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(blahmail): Debug: fs quota mount point = / dsync(blahmail): Debug: fs quota mount type = xfs dsync(blahmail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(blahmail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(blahmail): Debug: fts: Indexes disabled for namespace '' dsync(blahmail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(blahmail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: brain M: Local mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Mailbox INBOX: local=60f6d91a25fddb5983040000a19766e2/0/1, remote=e6191d3644fddb59e2040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=61f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=62f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=63f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=64f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: brain S: Remote mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Mailbox INBOX: local=e6191d3644fddb59e2040000a19766e2/0/1, remote=60f6d91a25fddb5983040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain S: Mailbox INBOX.Drafts: local=61f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Junk: local=62f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Sent: local=63f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Trash: local=64f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Change during sync: Mailbox GUID e6191d3644fddb59e2040000a19766e2 was lost dsync(blahmail): Debug: brain S: We don't have mailbox e6191d3644fddb59e2040000a19766e2 dsync(blahmail): Debug: brain M: Change during sync: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) -------------------------------------------------------------------------------------------------------------------------------------------- Previously, on 2.2.31 I ran: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/mymail/mail -u _mainaccount(a)mymail.tld -v mirror maildir:/home/mymail/mail And got the following successful conversion output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)mymail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_gid=1077 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_uid=1134 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_user=mymail doveadm(_mainaccount(a)mymail.tld): Debug: Effective uid=1134, gid=1077, home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: fs: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default doveadm(_mainaccount(a)mymail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)mymail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Effective uid=1134, gid=1077, home=/home/mymail dsync(mymail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(mymail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(mymail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(mymail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(mymail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mymail/mail dsync(mymail): Debug: maildir++: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=/home/mymail/mail, alt= dsync(mymail): Debug: fs quota add mailbox dir = /home/mymail/mail dsync(mymail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(mymail): Debug: fs quota mount point = / dsync(mymail): Debug: fs quota mount type = xfs dsync(mymail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(mymail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(mymail): Debug: fts: Indexes disabled for namespace '' dsync(mymail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(mymail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: brain M: Local mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Mailbox INBOX: local=00000000000000000000000000000000/0/0, remote=a884611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=a984611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=aa84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=ab84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=ac84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/INBOX doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: brain S: Remote mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Mailbox INBOX: local=a884611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Drafts: local=a984611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Junk: local=aa84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Sent: local=ab84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Trash: local=ac84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Import change type=save GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=1 hdr_hash= result=Mail's UID is above local UIDNEXT - No more local mails found dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: prefetch dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: access dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain M: import mail uid 0 guid 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 dsync(mymail): Debug: brain M: Import INBOX: Import mail body for GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: copying dsync(mymail): Debug: /home/mymail/mail/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Compressed, file_seq changed 0 -> 1507586868, size=32, max_uid=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain S: Import INBOX: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Warning: quota: Namespace 'INBOX.' is not Maildir, skipping for Maildir++ quota dsync(mymail): Debug: brain M: Import INBOX: Saved UIDs: 1 dsync(mymail): Debug: brain M: Import INBOX: Finish update: min_next_uid=2 min_first_recent_uid=1 min_highest_modseq=2 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 -------------------------------------------------------------------------------------------------------------------------------------------- dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.6.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_cache_size = 819 M auth_mechanisms = plain login auth_policy_hash_mech = sha512 auth_policy_hash_nonce = 85979662 auth_policy_hash_truncate = 64 auth_policy_request_attributes = auth_database=mail database=mail service=dovecot username=%{orig_user} authtoken_hash=$0$0$%{hashed_password} local_host=%{real_lip} local_port=%{real_lport} remote_host=%{real_rip} remote_port=%{real_rport} auth_policy_server_api_header = X-API-Key:dovecot:4FR0BN8IWTpSnB42 auth_policy_server_timeout_msecs = 3000 auth_policy_server_url = http://127.0.0.1:579/dovecot-auth-policy auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes lmtp_user_concurrency_limit = 4 mail_access_groups = dovecot mail_plugins = quota quota_clone zlib fts fts_solr mail_prefetch_count = 20 mailbox_list_index = yes maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = create special_use = \Junk } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict-domain_owner_mail_pass.conf driver = dict result_failure = return-fail skip = authenticated } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword skip = authenticated } plugin { acl = vfile:cache_secs=86400 fts = solr fts_solr = url= http://WVJMEK57hc3cg712:9v9W13cT8fTYaXkQ@127.0.0.1:8984/solr/dovecot/ quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded } protocols = lmtp imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 565 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual fts fts_solr namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota quota quota_clone virtual zlib namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } local_name jason64.dev.cpanel.net { ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_key = # hidden, use -P to show it } local_name adomain.tld www.adomain.tld mail.adomain.tld webmail.adomain.tld cpanel.adomain.tld autodiscover.adomain.tld webdisk.adomain.tld { ssl_cert = </var/cpanel/ssl/domain_tls/adomain.tld/combined ssl_key = # hidden, use -P to show it } local_name argon.tld www.argon.tld mail.argon.tld xenon.tld carbon.tld helium.tld oxygen.tld chlorine.tld hydrogen.tld www.xenon.tld www.carbon.tld www.helium.tld www.oxygen.tld www.chlorine.tld www.hydrogen.tld mail.xenon.tld mail.carbon.tld mail.helium.tld mail.oxygen.tld mail.chlorine.tld mail.hydrogen.tld webmail.argon.tld cpanel.argon.tld autodiscover.argon.tld webdisk.argon.tld www.mail.argon.tld { ssl_cert = </var/cpanel/ssl/domain_tls/argon.tld/combined ssl_key = # hidden, use -P to show it } -------------------------------------------------------------------------------------------------------------------------------------------- I'm starting to narrow down on which commit introduced the problem, but that'll take some time. If anyone knows which commit caused this or knows of a fix, please let me know. Thank you very much! Regards, Jason

2 2

Parallel build problems with dovecot 2.2.32
by Craig Leres 10 Oct '17

10 Oct '17

I use dovecot under FreeBSD 10.3 and build using poudriere. My build server has 12 cores builds typically happen in parallel and I find software that is not parallel make friendly will fail once every month or so. Attached is a build log from this afternoon that failed because doveadm-util.o had not finished building when the attempt to link test-doveadm-util happened. Looking in src/doveadm/Makefile* in the build tree the only place I see doveadm-util.o is in a make variable: test_doveadm_util_LDADD = doveadm-util.o $(test_libs) $(MODULE_LIBS) This is only used in the test-doveadm-util rule: test-doveadm-util$(EXEEXT): $(test_doveadm_util_OBJECTS) $(test_doveadm_util_DEPENDENCIES) $(EXTRA_test_doveadm_util_DEPENDENCIES) @rm -f test-doveadm-util$(EXEEXT) $(AM_V_CCLD)$(LINK) $(test_doveadm_util_OBJECTS) $(test_doveadm_util_LDADD) $(LIBS) So the problem is that doveadm-util.o needs to be an explicit dependency for test-doveadm-util. I believe one possible fix would be to add doveadm-util.o to test_doveadm_util_DEPENDENCIES: test_doveadm_util_DEPENDENCIES = $(test_deps) bug this isn't something that can easily tested. Craig

2 2

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

First of all excuse.. I am having an issue getting maillist responses so I may be responding to this worng No on topic I commented out the first user_quesry The second query was not copied correctly , reads user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=‘1' still have the same error I did a comparison between the data contained in the sql file and my mail directory and found that they are not consistent Apparently postfixadmin, which I have been using, does not update the maildir I am surprised I am getting any mail at all. I think I have to take this back to ground zero "I see two problems: 1) you have two user_querys, there should only be one 2) your 2nd user_query is not limiting the SQL search with a WHERE clause"

3 2

Sieve rules not processing
by Stephan Herker 10 Oct '17

10 Oct '17

I'm new to dovecot altogether and I have a working dovecot system. I'm trying to setup sieve for mail filtering. If I run the debug program sieve-test I get a positive result that it would have sorted the mail appropriately, but the logs for lmtp don't appear to be processing the rule. Below is output of dovecot -n. Any help is appreciated. Thanks # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login first_valid_uid = 2000 last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = administrator(a)keagaming.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota autocreate sieve quota" postmaster_address = postmaster(a)keagaming.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota quota" }

2 3

Trash quota issue
by Stephan Herker 10 Oct '17

10 Oct '17

I have quotas setup on a test domain to try everything out before I move my domains email over to dovecot. I have a trash quota rule that should have added 100M to trash folder specifically, but mail was denied due to quota being full even though the only mail in the test account was in trash. Below are debug log lines and dovecot -n output. Oct 07 17:16:03 lmtp(26801): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:16:03 lmtp(26801): Info: Connect from local Oct 07 17:16:03 lmtp(26801): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: plugin/quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=20480000 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=2048000 (10%) Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin is not up-to-date Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script `main script' from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script successfully compiled Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Info: OFqmG0Nu2VmxaAAAobcTNA: sieve: msgid=<3a1e5ba2-f0a7-4cec-e7fb-bf5202c2152d(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

1 0

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

This apparently was a problem that i was not aware since i redid my mail server configuration to make use of Postfixadmin. I have update the conf files using the postfix document fromthe down load. The download document seems to be fpr an early version of dovecot (I am using 2.2.4) as it focuse of dovecot.conf which is now broken into file in the conf.d subdirectory I get "dovecot: auth-worker(30555): sql(abuse(a)examplei.com): unknown user " I imagine this is a conf problem and deals with reading the sql daya I have confirmed the dayta is there The major file apperas to be dovecot-sql.conf.ext Mine reads as follows driver = mysql connect = host=127.0.0.1 dbname=postfix user=postfix password=postfixadmin password_query = SELECT username, password FROM mailbox WHERE username='%u' and active =" default_pass_scheme = MD5-CRYPT user_query = SELECT maildir, 5000 AS uid, 5000 AS gid FROM mailbox WHERE username = '%u' user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid Since normal mail is habdled by dovecoy It would see somthing is wrong wihh the first user_query since it appears to be the one that should fine the alias user Any hellp or suggestions would be appreciate

2 1

Error: file_preallocate in logs
by Ricardo Branco 10 Oct '17

10 Oct '17

I am getting lots of these messages in my imapd.log or while I am doing mailbox operations on the terminal. All my mailboxes are stored on NFS and ive set the nfs locking params in the config, only one mailserver accessing this share. Any ideas why this would be happening? doveadm(ops): Error: file_preallocate(/var/vmail/ops/mdbox/storage/.temp.1507551663.P21424Q109M878872.posti2.dc1.wenn.com) failed: Operation not supported

2 3

Re: ACL permission: give permission to move email into different folder
by Davide Marchi 10 Oct '17

10 Oct '17

On 06.10.2017 12:42:22, Aki Tuomi wrote: [..] >> >> Maybe it is not possible with Dovecot? >> >> Many Thanks >> >> Davide > > Just give the relevant permissions to the user, and it also requires > that the target directory is writable by source user. > > Aki Oh, excuse me for the (most probably) silly question, but where I could give to my *virtual user* the directory write permission, if not from the Dovecot ACL? Actually on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip Many thanks Aki for you help! :-) Davide

2 3

Re: My sub-folder with Outlook work-around to date - update 201710091046
by David.M.Clark 09 Oct '17

09 Oct '17

Hi Mike, I haven't seen your messages come through the feed so something is not working for your e-mail address there? No I am not using Sieve - the server has a third party handling spam etc so the Linux box is very basic SendMail, Dovecot and RoundCube setup (along with my own procmail based web interface for e-mail forwarding and away message responses). I struggle on. On 09/10/17 12:30, Mike wrote: > > Mr. Clark, > > I would post this question to the maillist, but for some unknown reason, > it will not post my messages. > > Are you currently using Sieve with your mbox setup? > > If so, would you be willing to share your configuration of that? > > If not, I guess I'll just convert to maildir like you are doing. > > I'd be willing to help in any way you feel needed. > > Thanks. > > Mike Barsalou > > Quoting "David.M.Clark" <david(a)davrom.com>: > >> Hi All, >> >> Will start using an "update" tag in my subject just to not cause >> confusion (mainly for yours truly). >> >> Pursuant to my victory in finding Maildir and mbox being used if >> either exist (and if both still seems to favour Maildir - a mistake my >> end: "rmdir -f mail" fixed it), I have found one issue with not >> declaring the mailbox location: it won't import your new e-mail from >> your Inbox (/var/spool/mail/user in my case). If I run the conversion >> script mb2md with a '-m', I get duplicate entries in Outlook's Inbox - >> I understand why, just a shame it doesn't sync with what 'isn't' >> already there. >> >> So yesterday and today I have done additional testing as the customer >> uses RoundCube and mobile devices - so attacking the same Linux server >> I have Thunderbird and a couple of Android e-mail clients. Outlook is >> the only stick in the mud with needing to manually subscribe to >> folders when I create them on other devices - again could be me as I >> don't use Outlook. (Thunderbird and other e-mail clients, all good >> with immediate auto-sync). >> >> I looked at the wiki to try and run both mail_location settings with >> the wiki suggested: >> >> ##namespace { >> ## separator = / >> ## prefix = "#mbox/" >> ## location = mbox:~/mail:INBOX=/var/mail/%u >> ## inbox = yes >> ## hidden = yes >> ## list = no >> ##} >> ##namespace { >> ## separator = / >> ## prefix = "Maildir/" >> ## location = maildir:~/Maildir >> ## list = yes >> ##} >> >> in 10-mail.conf but as you can see, I have commented it out now as it >> introduced some more layers of errors which I have to get back to - >> "Duplicate namespace prefix" was one issue. >> >> The goal is to run the server with the existing mbox users blissfully >> unaware they are being converted one-by-one so it looks like I 'can' >> run both formats but just need to get the configs right. Was hoping >> the mb2md would just sync new stuff so I could cron script the Inbox >> check for the users that are converted to Maildir until I can throw >> the switch and be done with the cut-over..... or I could be dangerous >> and remove and import each time.... but that could lead to more dramas >> at the user end. >> >> Looks like more R&D is needed so will persevere - annoying to get so >> close though, might see if I can just sync in the Inbox items that are >> 'new' - that means I am ready to roll on the customer site...... >> >> On 09/10/17 00:12, David.M.Clark wrote: >>> Wow excellent feedback Joseph, Philon and Aki, >>> >>> You have all pointed me in the right direction. Tonight I have tested >>> Dovecot with just the minor configs I do for Dovecot setup and I have >>> commented out the mbox/Maildir lines in 10-mail.conf from my testing: >>> >>> #mail_location = >>> #mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u >>> #mail_location = maildir:~/Maildir >>> >>> I had run up some test files (folders) under mbox using >>> "/u/home/user/mail_test" and then renamed this to 'mail' (so >>> /u/home/user/mail). >>> Ran some tests with sends/receives, created folders - all good. >>> Created mbox text folders. >>> >>> Then had my initial test 'Maildir_test' populated with test folders >>> which I renamed to /u/home/user/Maildir - and each time I restarted >>> Outlook it was obeying the folder 'format' based on whether I had >>> 'mail' or 'Maildir' in place. >>> >>> I did see in the posts and docs on-line somewhere that someone >>> mentioned the later implementations of Dovecot, without hard-setting >>> either mbox or Maildir in the 10-mail.conf file, Dovecot, based on >>> the presence of the particular directory in the user's $HOME >>> directory obeys the rules based on mbox/Maildir respectively. >>> >>> I haven't needed to touch the namespace rules as per: >>> >>> https://wiki2.dovecot.org/Namespaces >>> >>> so the only files that bear any changes from the installed config in >>> conf.d are: >>> >>> -rw-r--r-- 1 root root 14531 Oct 8 23:28 10-mail.conf >>> -rw-r--r-- 1 root root 2965 Oct 7 08:49 10-master.conf >>> -rw-r--r-- 1 root root 1728 Oct 7 08:52 10-ssl.conf >>> >>> This will make migration so much easier with converting one user at a >>> time and then getting them to start Outlook and re-sync things again. >>> >>> This will save a massive job from being just that and can be done in >>> batches of users to suit time constraints. >>> >>> I will post here once again to let you all know how I fare but just >>> proves to me over and over again the power of the Linux e-mail server >>> with Dovecot for IMAP and being able to keep with the older SendMail >>> MTA (been working with Sendmail since 1996 so....). >>> >>> Thank you all so much for taking time to respond. >>> >>> On 08/10/17 20:32, Aki Tuomi wrote: >>>> You can give mail location and home directory from userdb or passdb. >>>> >>>> For userdb, return mail=something:~/something and for home use >>>> home=/path/to/home >>>> >>>> For passdb, you can return userdb_mail and userdb_home >>>> >>>> Aki >>>> >>>>> On October 8, 2017 at 1:14 PM Philon <bytesplit(a)gmail.com> wrote: >>>>> >>>>> >>>>> Hi David, >>>>> >>>>> I somehow remember that there is a way to get the mail_location >>>>> from per-user-settings. I had this once when migrating from maildir >>>>> to mdbox. >>>>> >>>>> You might want to use Google and the mailing list archives for the >>>>> details but in summary it went like this: >>>>> >>>>> - set Dovecot to grab the mail_location from user-settings (I think >>>>> we used MySQL db field - or check docs for auto:) >>>>> - have login script which converts maildir from setup A to B and >>>>> update the user setting >>>>> - kick the user once again to apply the setting (I’m not sure about >>>>> this) >>>>> >>>>> This then automates the conversion process to happen on next user >>>>> login. >>>>> >>>>> Be warned though that today with all the idle phones, probably many >>>>> users will re-login after you restart the server. Perhaps the >>>>> scripting could handle a timer which randomizes this a little. >>>>> >>>>> >>>>> Philon >>>>> >>>>> >>>>>> Am 07.10.2017 um 02:22 schrieb David.M.Clark <david(a)davrom.com>: >>>>>> >>>>>> Hi All, >>>>>> >>>>>> Thanks to MJ for the suggestion as my only hope, and I have tested >>>>>> this with Outlook 2016 and Thunderbird today - seamless creation >>>>>> of folders. >>>>>> >>>>>> Now the mammoth task of converting customers with masses of mbox >>>>>> folders to MailDir format using the on-line perl script: >>>>>> mb2md-3.20.pl >>>>>> >>>>>> Works nicely and will be what gets us out of trouble. My only >>>>>> sadness is that Outlook then has to be 're-subscribed' to the >>>>>> folders again.... which makes sense or maybe I didn't give it long >>>>>> enough - its IMAP folder syncs are extremely slow compared to >>>>>> Thunderbird which I also tested in parallel. Thunderbird didn't >>>>>> need any re-sync, it just found the new subscription setup and was >>>>>> ready to go. But in all fairness, Outlook is still really only an >>>>>> Exchange compatible product for the most part. >>>>>> >>>>>> Would be great to run both mbox and MailDir at the same time so we >>>>>> can do the slow user-by-user process rather than having them all >>>>>> down at some point completely - might look at running Dovecot on a >>>>>> different port maybe with a different ".conf" but thinking this >>>>>> may not work anyway or cause issues.... back to my server tests to >>>>>> see :-) >>>>>> >>>>>> I use additional ports to 143 for external IMAP restrictions >>>>>> anyway so might be able to do this method somehow. >>>>>> >>>>>> Anyway, for those interested in where I got to in my testing so >>>>>> far... >>>>>> >>>>>> 1. Download perl script "mb2md-3.20.pl" from: >>>>>> >>>>>> http://batleth.sapienti-sat.org/projects/mb2md >>>>>> >>>>>> 2. Changed Dovecot /etc/dovecot/conf.d/10-mail.conf mbox entry to >>>>>> MailDir: >>>>>> >>>>>> #mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u >>>>>> mail_location = maildir:~/Maildir >>>>>> >>>>>> 3. Restarted Dovecot >>>>>> >>>>>> 4. su as user and in their home (/u/home/user on my setup): >>>>>> >>>>>> /u/packages/mb2md-3.20.pl -m >>>>>> >>>>>> then: >>>>>> >>>>>> mv mail mail_old >>>>>> >>>>>> then: >>>>>> >>>>>> /u/packages/mb2md-3.20.pl -s mail_old -R >>>>>> >>>>>> then: >>>>>> >>>>>> Login with Outlook and subscribe to IMAP folders again. >>>>>> >>>>>> Not a big fan of gazillions of little eml based text mail files in >>>>>> directories but hey, if it fixes our issues, maybe I need to stop >>>>>> wambulancing about it all and do as I am told :-) >>>>>> >>>>>> Hope this helps - will keep this e-mail updated on findings if >>>>>> anything else comes to light. >>> >> >> -- >> >> As always, I remain at your service. >> >> Kindest Regards, >> David.M.Clark (Director - Senior Linux/UNIX Consultant) >> =--------------------------------------------------------------------------= >> >> Davrom Consulting Pty Ltd Mobile: 0418763124 >> PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com >> ABN: 81 096 990 804 E-mail (Priv): >> dmc1961(a)dmc1961.id.au >> Website: http://davrom.com Skype: dmc1961 >> Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com >> =--------------------------------------------------------------------------= >> >> Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, >> Networking/Internet, E-mail/Web Technologies >> =--------------------------------------------------------------------------= >> >> Please note: Any e-mail communication bearing this signature is for >> the exclusive purpose of the sender and is not for publication >> without the expressed permission of the sender or respective >> sender's organisation. >> =--------------------------------------------------------------------------= >> > > -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

My sub-folder with Outlook work-around to date
by David.M.Clark 09 Oct '17

09 Oct '17

Hi All, please be kind, this is my first e-mail to the list :-) I actively support CentOS based e-mail servers running Dovecot, Sendmail, Spammassassin and 3 x SOGo based setups. Dovecot is my goto IMAP server and have used it and modifications to it to net excellent results for years. Then we have people who insist on only using Outlook (and in some instances the MS Live Messenger thingy). Some shenanigans in recent years have arose with using sub-folders in the Outlook clients (2013 and 2016). Traditionally, placing a "/" after the name of a newly desired e-mail folder has netted the result of something like: "Rentals/" creating: /u/home/someuser/mail/Rentals/ Under which users then create actual e-mail folders under the "Rentals" Linux directory as such. With Outlook 2013 and 2016 this seems to have stopped working and so I implemented a work-around where the user creates a normal folder, example "Rentals++", and I have written a cron script that trawls the $HOMEs each minute and if it finds a folder with a "++" at the end, it creates the folder as a directory, so: /u/home/someuser/mail/Rentals++ becomes: /u/home/someuser/mail/Rentals/ and adds this new subscription to their .subscription folder. It also sends an e-mail to the user advising that the new folder is created and they can proceed to use the "Rentals" folder for adding sub-folders (as in real text based mail folders). The script was a quick work-around one weekend in a mad flurry to get things working and to date works but is not 'user-proof'. So I am now looking at developing an internal web interface to do the same thing and hoping with more controls, has no or far less margin for user error. Long times of Outlook folder refreshes don't help and users sometimes end up with issues that require my Linux command line help. I have been trawling e-mail forums for some time now and have not seen any other work-arounds (or perhaps I am living under a rock) but before I embark on this web interface adventure, I just wanted to make sure I had not missed some fundamental 'bit' that I should be observing. All servers are either CentOS 6.9 (or slightly less) and CentOS 7 with the latest updates and for things like Thunderbird and Roundcube and SOGo, work well. I need to experiment with the whole "/" for these but I am currently driven by the enforced Outlook chains. Any input from you guys on whether this is my best approach or 'hey mate, just do this', would be much appreciated. I am happy to share my travels script/web-wise if this is the only option to date. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) E-mail: david(a)davrom.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------=

4 7

Released Pigeonhole v0.4.21.rc1 for Dovecot v2.2.33.rc1.
by Stephan Bosch 09 Oct '17

09 Oct '17

Hello Dovecot users, Here is the Pigeonhole hole release candidate that goes with the Dovecot release candidate. Nothing really special going on, just a few changes and fixes that accumulated over the last few months. Changelog v0.4.21: * redirect action: Always set the X-Sieve-Redirected-From header to sieve_user_email if configured. Before, it would use the envelope recipient instead if available, which makes no sense if the primary e-mail address is available. + vacation extension: Allow ignoring the envelope sender while composing the "To:" header for the reply. Normally, the "To:" header is composed from the address found in the "Sender", "Resent-From" or "From" headers that is equal to the envelope sender. If none is then found, the bare envelope sender is used. This change adds a new setting "sieve_vacation_to_header_ignore_envelope". With this setting enabled, the "To:" header is always composed from those headers in the source message. The new setting thus allows ignoring the envelope, which is useful e.g. when SRS is used. + vacation extension: Compose the "To:" header from the full sender address found in the first "Sender:", "From:" or "Resent-From:" header. Before, it would create a "To:" header without a phrase part. The new behavior is nicer, since the reply will be addressed to the sender by name if possible. - LDA Sieve plugin: Fixed sequential execution of LDAP-based scripts. A missing LDAP-based script could cause the script sequence to exit earlier. - sieve-filter: Removed the (now) duplicate utf8 to mutf7 mailbox name conversion. This caused problems with mailbox names containing UTF-8 characters. The Dovecot API was changed years ago, but apparently sieve-filter was never updated. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.21… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.21… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Permission denied error on private key...
by SH Development 08 Oct '17

08 Oct '17

I have a working dovecot/postfix/mysql server running and was trying to set up another one for replication purposes. If I copy my certificates from the working server, everything works fine. However, I purchased another updated certificate for the replication server, and I cannot get dovecot to start up. Keep getting: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 31: ssl_key: Can't open file /etc/pki/dovecot/private/mailserver.crt: Permission denied Different permissions on the mailserver.crt have no effect on the error. Maybe something I did in creating the file? I’m a little fuzzy when it comes to how you’re supposed to create the whole thing. Here are the steps I took: openssl genrsa -out mailserverkey.crt 2048 I then took the CSR, submitted it to Comodo, a certificate was generated and emailed back to me. I placed the certs in the appropriately referenced places on the server… And that is where I’m at. I’ve spent quite a bit of time comparing my working server’s configuration files to the new server and cannot find any differences in the SSL configuration, OTHER than the certs themselves. Is dovecot looking for something I didn’t do correctly in the creation maybe? Jeff J. Starion Technologies, LLC 816-331-0030

2 4

Re: My sub-folder with Outlook work-around to date
by Joseph Tam 08 Oct '17

08 Oct '17

"David.M.Clark" <david(a)davrom.com> writes: > Would be great to run both mbox and MailDir at the same time so we can > do the slow user-by-user process rather than having them all down at > some point completely ... - might look at running Dovecot on a different I believe you can do this by using a userdb that can accommodate extra fields. In particular, supplying a mail field will overwrite the global mail_location. You can iterate through your users, convert them one at a time, then update the mail field as you go. At the end, update mail_location to your new default and remove the extra fields. https://wiki.dovecot.org/UserDatabase/ExtraFields Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 07 Oct '17

07 Oct '17

Thanks! We'll look into it. ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 07/10/2017 13:08 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} #5 0x00007f8bb656bcb0 in io_remove_full (_io=0x220a100, closed=false) at ioloop.c:126 io = 0x22694a0 __FUNCTION__ = "io_remove_full" #6 0x00007f8bb656be31 in io_remove (io=0x220a100) at ioloop.c:169 No locals. #7 0x00007f8bb65815f8 in o_stream_file_cork (stream=0x220a010, set=true) at ostream-file.c:342 fstream = 0x220a010 ret = 32766 __FUNCTION__ = "o_stream_file_cork" #8 0x00007f8bb657e289 in o_stream_cork (stream=0x220a0a0) at ostream.c:146 _stream = 0x220a010 #9 0x00007f8bb12d6406 in openssl_iostream_bio_output (ssl_io=0x220aa00) at iostream-openssl.c:325 bytes = 140238036407941 max_bytes = 18446742978492891135 sent = 35692560 buffer = "\027\003\003\000\001\000\000\000\020\240 \002\000\000\000\000\200\254\035\370\376\177\000\000\022\343W\266\213\177\000\000`\214\033\002\000\000\000\000\240\240 \002\000\000\000\000`\214\033\002\000\000\000\000\020\240 \002\000\000\000\000\320\314\035\370\376\177\000\000\236f-\261\213\177\000\000\025\071\260fK\247\000\000\000\252 \002\000\000\000\000`\214\033", '\000' <repeats 14 times>, "\315\035\370\376\177\000\000\236f-\261\213\177\000\000\225\305^\001?\236,,\000\252 \002\000\000\000\000=$h\000\272Å«\033\000\000\000\000\000\000\000\000\221\371Í¦f\237\035\224\335-\365\214l\333\347|\005\310\345\035/\200r\242\222}\313I\226G\313*\223\364\312\310\313j\263\260/\245"... bytes_sent = false ret = 32766 __FUNCTION__ = "openssl_iostream_bio_output" #10 0x00007f8bb12d6af6 in openssl_iostream_bio_sync (ssl_io=0x220aa00) at iostream-openssl.c:459 ret = false #11 0x00007f8bb12da52e in o_stream_ssl_flush_buffer (sstream=0x220aca0) at ostream-openssl.c:110 pos = 6 ret = 6 #12 0x00007f8bb12da6ef in o_stream_ssl_sendv (stream=0x220aca0, iov=0x7ffef81dcd70, iov_count=1) at ostream-openssl.c:155 sstream = 0x220aca0 bytes_sent = 6 #13 0x00007f8bb657e765 in o_stream_sendv (stream=0x220ad30, iov=0x7ffef81dcd70, iov_count=1) at ostream.c:260 _stream = 0x220aca0 i = 1 total_size = 6 ret = 35771392 __FUNCTION__ = "o_stream_sendv" #14 0x00007f8bb657e688 in o_stream_send (stream=0x220ad30, data=0x2308850, size=6) at ostream.c:239 iov = {iov_base = 0x2308850, iov_len = 6} #15 0x00007f8bb6583c2c in o_stream_multiplex_sendv (mstream=0x221d270) at ostream-multiplex.c:90 channel = 0x0 ret = 0 #16 0x00007f8bb6583dd4 in o_stream_multiplex_ochannel_sendv (stream=0x221d720, iov=0x7ffef81dcef0, iov_count=1) at ostream-multiplex.c:124 channel = 0x221d720 ret = 7354428521 total = 1 #17 0x00007f8bb657e765 in o_stream_sendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:260 _stream = 0x221d720 i = 1 total_size = 1 ret = 36233296 __FUNCTION__ = "o_stream_sendv" #18 0x00007f8bb657e93f in o_stream_nsendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:295 No locals. #19 0x00007f8bb657e8d3 in o_stream_nsend (stream=0x221d7b0, data=0x7ffef81dcf42, size=1) at ostream.c:287 iov = {iov_base = 0x7ffef81dcf42, iov_len = 1} #20 0x0000000000444a35 in doveadm_server_log_handler (ctx=0x7f8bb6805bd0 <failure_ctx_warning>, format=0x7f8bb65bac69 "Raw backtrace for leaks: %s", args=0x7ffef81dcfb0) at client-connection.c:64 c = 3 '\003' corked = false str = 0x228e050 ptr = 0x0 start = 0x228e088 "Raw backtrace for leaks: /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-ser"... va = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} _data_stack_cur_id = 4 #21 0x00007f8bb654afdc in i_warning (format=0x7f8bb65bac69 "Raw backtrace for leaks: %s") at failures.c:325 old_errno = 0 args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} #22 0x00007f8bb656d8cd in io_loop_destroy (_ioloop=0x7ffef81dd138) at ioloop.c:766 backtrace = 0x228dc38 "/usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/"... ioloop = 0x221ddc0 to_idx = 0x221dfe0 item = 0x0 leaks = true __FUNCTION__ = "io_loop_destroy" #23 0x00000000004454d1 in doveadm_cmd_handle (conn=0x22059d8, cmd_name=0x21b8c20 "dsync-server", argc=3, argv=0x21b8c50, cctx=0x7ffef81dd1b0) at client-connection.c:337 ioloop = 0x0 prev_ioloop = 0x21bfc40 cmd = 0x0 mail_cmd = 0x21c65e8 mctx = 0x221d9f8 cmd_ver2 = 0x0 #24 0x0000000000445793 in client_handle_command (conn=0x22059d8, args=0x21b8c40) at client-connection.c:399 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x21b8c19 "reuben", cli = false, tcp_server = true, local_ip = {family = 10, u = {ip6 = {__in6_u = { ---Type <return> to continue, or q <return> to quit--- Reuben

1 0

Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Reuben Farrelly 07 Oct '17

07 Oct '17

This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} #5 0x00007f8bb656bcb0 in io_remove_full (_io=0x220a100, closed=false) at ioloop.c:126 io = 0x22694a0 __FUNCTION__ = "io_remove_full" #6 0x00007f8bb656be31 in io_remove (io=0x220a100) at ioloop.c:169 No locals. #7 0x00007f8bb65815f8 in o_stream_file_cork (stream=0x220a010, set=true) at ostream-file.c:342 fstream = 0x220a010 ret = 32766 __FUNCTION__ = "o_stream_file_cork" #8 0x00007f8bb657e289 in o_stream_cork (stream=0x220a0a0) at ostream.c:146 _stream = 0x220a010 #9 0x00007f8bb12d6406 in openssl_iostream_bio_output (ssl_io=0x220aa00) at iostream-openssl.c:325 bytes = 140238036407941 max_bytes = 18446742978492891135 sent = 35692560 buffer = "\027\003\003\000\001\000\000\000\020\240 \002\000\000\000\000\200\254\035\370\376\177\000\000\022\343W\266\213\177\000\000`\214\033\002\000\000\000\000\240\240 \002\000\000\000\000`\214\033\002\000\000\000\000\020\240 \002\000\000\000\000\320\314\035\370\376\177\000\000\236f-\261\213\177\000\000\025\071\260fK\247\000\000\000\252 \002\000\000\000\000`\214\033", '\000' <repeats 14 times>, "\315\035\370\376\177\000\000\236f-\261\213\177\000\000\225\305^\001?\236,,\000\252 \002\000\000\000\000=$h\000\272Å«\033\000\000\000\000\000\000\000\000\221\371Í¦f\237\035\224\335-\365\214l\333\347|\005\310\345\035/\200r\242\222}\313I\226G\313*\223\364\312\310\313j\263\260/\245"... bytes_sent = false ret = 32766 __FUNCTION__ = "openssl_iostream_bio_output" #10 0x00007f8bb12d6af6 in openssl_iostream_bio_sync (ssl_io=0x220aa00) at iostream-openssl.c:459 ret = false #11 0x00007f8bb12da52e in o_stream_ssl_flush_buffer (sstream=0x220aca0) at ostream-openssl.c:110 pos = 6 ret = 6 #12 0x00007f8bb12da6ef in o_stream_ssl_sendv (stream=0x220aca0, iov=0x7ffef81dcd70, iov_count=1) at ostream-openssl.c:155 sstream = 0x220aca0 bytes_sent = 6 #13 0x00007f8bb657e765 in o_stream_sendv (stream=0x220ad30, iov=0x7ffef81dcd70, iov_count=1) at ostream.c:260 _stream = 0x220aca0 i = 1 total_size = 6 ret = 35771392 __FUNCTION__ = "o_stream_sendv" #14 0x00007f8bb657e688 in o_stream_send (stream=0x220ad30, data=0x2308850, size=6) at ostream.c:239 iov = {iov_base = 0x2308850, iov_len = 6} #15 0x00007f8bb6583c2c in o_stream_multiplex_sendv (mstream=0x221d270) at ostream-multiplex.c:90 channel = 0x0 ret = 0 #16 0x00007f8bb6583dd4 in o_stream_multiplex_ochannel_sendv (stream=0x221d720, iov=0x7ffef81dcef0, iov_count=1) at ostream-multiplex.c:124 channel = 0x221d720 ret = 7354428521 total = 1 #17 0x00007f8bb657e765 in o_stream_sendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:260 _stream = 0x221d720 i = 1 total_size = 1 ret = 36233296 __FUNCTION__ = "o_stream_sendv" #18 0x00007f8bb657e93f in o_stream_nsendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:295 No locals. #19 0x00007f8bb657e8d3 in o_stream_nsend (stream=0x221d7b0, data=0x7ffef81dcf42, size=1) at ostream.c:287 iov = {iov_base = 0x7ffef81dcf42, iov_len = 1} #20 0x0000000000444a35 in doveadm_server_log_handler (ctx=0x7f8bb6805bd0 <failure_ctx_warning>, format=0x7f8bb65bac69 "Raw backtrace for leaks: %s", args=0x7ffef81dcfb0) at client-connection.c:64 c = 3 '\003' corked = false str = 0x228e050 ptr = 0x0 start = 0x228e088 "Raw backtrace for leaks: /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-ser"... va = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} _data_stack_cur_id = 4 #21 0x00007f8bb654afdc in i_warning (format=0x7f8bb65bac69 "Raw backtrace for leaks: %s") at failures.c:325 old_errno = 0 args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} #22 0x00007f8bb656d8cd in io_loop_destroy (_ioloop=0x7ffef81dd138) at ioloop.c:766 backtrace = 0x228dc38 "/usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/"... ioloop = 0x221ddc0 to_idx = 0x221dfe0 item = 0x0 leaks = true __FUNCTION__ = "io_loop_destroy" #23 0x00000000004454d1 in doveadm_cmd_handle (conn=0x22059d8, cmd_name=0x21b8c20 "dsync-server", argc=3, argv=0x21b8c50, cctx=0x7ffef81dd1b0) at client-connection.c:337 ioloop = 0x0 prev_ioloop = 0x21bfc40 cmd = 0x0 mail_cmd = 0x21c65e8 mctx = 0x221d9f8 cmd_ver2 = 0x0 #24 0x0000000000445793 in client_handle_command (conn=0x22059d8, args=0x21b8c40) at client-connection.c:399 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x21b8c19 "reuben", cli = false, tcp_server = true, local_ip = {family = 10, u = {ip6 = {__in6_u = { ---Type <return> to continue, or q <return> to quit--- Reuben

1 0

dovecot: master: Warning: Sent SIGKILL to 100 imap-login processes
by absolutely_free＠libero.it 07 Oct '17

07 Oct '17

Hi, I am using Dovecot 2.2.32 (dfbe293d4) I noticed lots of messages like: dovecot: master: Warning: Sent SIGKILL to 100 imap-login processes in /var/log/maillog I commented out "process_limit" service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = $default_vsz_limit # Max. number of IMAP processes (connections) process_limit = 1024 } but it seems that value doesn't change (still 100). Any suggestions? Thank you very much!

2 2

Re: moving from mysql to pgsql
by Joseph Tam 06 Oct '17

06 Oct '17

mws(a)alpenjodel.de writes: > 1) select digest('testing123','sha512'); > result: > ?\x4120117b3190ba5e24044732b0b09aa9ed50eb1567705abcbfa78431a4e0a96b1152ed7f4925966b1c82325e186a8100e692e6d2fcb6702572765820d25c7e9e > login fails I think 2 problems here: 1) the encoding should be some modified base64; and 2) this appears to compute the SHA512 hash, *not* the SHA512-Crypt hash, which is different. It involves adding a salt and doing many iterations of SHA512. A totally different algorithm. Perusing the PostgreSQL man pages, I think you need something like crypt(password,gen_salt('sha512')) I made the 'sha512' up -- I can't find PostgresSQL docs stating whether it supports this value. The docs I found support the older SHA1 ($5$) crypt hashes. If your version doesn't support creating SHA512 ($6$) salts, you can create your own by replacing gen_salt() with "$6$" + base64(long random value), and feed that to crypt(). Just as long as PostgreSQL uses the system crypt() and not its own implementation, it should produce a usable hash. Joseph Tam <jtam.home(a)gmail.com>

1 0

How to require client SSL certificate, except for local connections
by Evan Martin 06 Oct '17

06 Oct '17

Is there any way to make Dovecot 2.2.22 not require a client SSL certificate for a local IMAP connection, but require it for any remote IMAP connection? My server is configured to require client certificates: ssl = required ... auth_ssl_require_client_cert = yes I tried adding the following to create an exception for localhost: remote 127.0.0.1 { ssl = no auth_ssl_require_client_cert = no disable_plaintext_auth = no } But Dovecot fails to start with: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 81: Auth settings not supported inside local/remote blocks: Is there any other way to do this? I don't need to override any other auth settings, just that one. I could probably use a Unix socket, if that would help. Thanks, Evan

1 0

Director DNS
by Travis Dolan 06 Oct '17

06 Oct '17

Hello, I am currently running 2.2.31. I have a cluster of dovecot instances running in AWS. - Two instances running Director/Proxy - Two instances running Dovecot. -- Storage for the Dovecot instances is EFS. My setup works, requests for 143 hit my Director cluster and are proxied to an appropriate dovecot backend. My question is how often if at all the Director service looks up the addresses for the following setting... *director_servers = mailproxy.internal* I have created a Lambda to continually update the values for the A records found in the *.internal* zone since EC2 instances can come and go for a variety of reasons. If those values changes will the Director service "notice" or will a "service dovecot restart" be needed? Thank in advance.

2 1

Re: ACL permission: give permission to move email into different folder
by Davide Marchi 06 Oct '17

06 Oct '17

> I've set ACL for two user (two primary email address, no alias), where > these users must not be able to delete email from imap server. > Now I would like to add (from the client) the ability to move any > incoming mail into different directory, if possible into an existing > directory chosen by me. Maybe it is not possible with Dovecot? Many Thanks Davide

2 1

seccomp filter for dovecot
by Phoenix Krypt 06 Oct '17

06 Oct '17

Hi, I would like to contribute to dovecot by adding seccomp system call filtering. Is this something you would like to merge into the dovecot codebase? If so, I can put up a PR on github once I complete it. Thanks, Archana

2 2

Dovecot Performance Issues on VMWARE Esxi
by Holger 06 Oct '17

06 Oct '17

Hello, I'm new to dovcot, but have serious issues with dovecot and IMAP. I'm struggling with low IMAP performance but have no glue, where to start my search. It is a small office setup. 10 Mailaccounts. Mine is the biggest with 4GB in size. But searching for mail takes several seconds... Zu switch to specific folder also takes some seconds. To long in my opinion. I use esxi 6.0 with local datastorage lenovo megaraid raid5 3x2TB SAS 7.2K. On the dovecot appliance i see high iowait. Some issues dovecot or the VM config? Any help i would appreciate... -- Sent from: http://dovecot.2317879.n4.nabble.com/

3 2

moving from mysql to pgsql
by Magnus 06 Oct '17

06 Oct '17

Hello, I hope that this mailing list is "alive", since I am looking for a solution for my problem for a long time. I would like to migrate my existing dovecot installation from mysql to pgsql. But I have problems with the passwords when using pgsql. The existing and working mysql-based installation looks like this: dovecot-sql.conf.ext: driver = mysql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,ENCRYPT('Test'),'mws(a)alpenjodel.de'); This setup is working, which I can verify like this: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test OK Now let's take a look at the pgsql version of the setup: dovecot-sql.conf.ext: driver = pgsql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,crypt('Test',gen_salt('des')),'mws(a)alpenjodel.de'); This setup is not working: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test a NO [AUTHENTICATIONFAILED] Authentication failed. Assumptions: - I believe that the mysql encrypt function uses the crypt system call, which in turn uses the DES algorithm with a random salt. - I believe that the same is done with the pgsql function call crypt('Test',gen_salt('des')). But obviously some of these assumptions must be wrong. Besides that, the variable "default_pass_scheme" is set to "SHA512-CRYPT" in both cases. But obviously, not SHA but DES is used by the working mysql-based setup. I don't understand that. Could someone please explain the relationship between the default_pass_scheme variable and the encryption/hashing algorithm used to store the user passwords? And finally: What can I do to migrate to pgsql? Thank you Magnus

4 3

v2.2.33 release candidate released
by Timo Sirainen 05 Oct '17

05 Oct '17

https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz.sig There are a couple more small changes still coming, but this should be very close to the final release. I'm especially interested in hearing if there are any problems with doveadm log proxying or with director. We've improved our automated director tests quite a lot now, and fixed some rarely occurring bugs. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails.

1 0

Issue with imap folder structure
by absolutely_free＠libero.it 05 Oct '17

05 Oct '17

Hi, I use Dovecot 2.2.32 I just migrated spool from another server (by copying filesystem, I use maildir), this is an example of mailbox's content: drwx------ 20 postfix postfix 30 Oct 4 18:38 . drwx------ 3 postfix postfix 3 Nov 16 2012 .. drwx------ 5 postfix postfix 11 Jun 19 18:22 .Deleted Items drwx------ 5 postfix postfix 11 Sep 29 09:27 .Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Sent drwx------ 5 postfix postfix 9 Oct 3 18:01 .INBOX.Trash drwx------ 5 postfix postfix 12 Sep 29 09:27 .Junk drwx------ 5 postfix postfix 8 Dec 9 2014 .Junk E-mail drwx------ 5 postfix postfix 8 Nov 11 2015 .Archive drwx------ 5 postfix postfix 9 Oct 2 14:18 .Posta indesiderata drwx------ 5 postfix postfix 9 Jun 19 18:22 .Posta inviata drwx------ 5 postfix postfix 10 Oct 4 12:27 .Sent drwx------ 5 postfix postfix 10 Oct 4 18:01 .Trash drwx------ 2 postfix postfix 215 Oct 4 18:00 cur -rw------- 1 postfix postfix 53 Feb 16 2017 dovecot-keywords -rw------- 1 postfix postfix 13963 Oct 4 16:45 dovecot-uidlist -rw------- 1 postfix postfix 8 Oct 3 18:01 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Nov 27 2015 dovecot-uidvalidity.5658162a -r--r--r-- 1 postfix postfix 0 Sep 27 18:18 dovecot-uidvalidity.59cbcf5c -rw------- 1 postfix postfix 7200 Sep 29 01:19 dovecot.index -rw------- 1 postfix postfix 63336 Oct 4 18:00 dovecot.index.cache -rw------- 1 postfix postfix 6436 Oct 4 18:38 dovecot.index.log -rw------- 1 postfix postfix 216 Oct 3 18:01 dovecot.mailbox.log drwx------ 2 postfix postfix 2 Oct 4 16:45 new -rw------- 1 postfix postfix 96 Oct 3 18:01 subscriptions drwx------ 2 postfix postfix 2 Oct 4 16:12 tmp and this is my Dovecot's conf: auth_mechanisms = plain login digest-md5 cram-md5 disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 mail_gid = 1003 mail_location = maildir:/var/spool/virtual/domains mail_privileged_group = postfix mail_uid = 1003 namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/wildcard.domain.net_bundle.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql It seems I have duplicate folder (for example during webmail access, I use Roundcube). What is wrong with my setup? Thank you

3 4

STAT command error
by Andrew Charnley 04 Oct '17

04 Oct '17

Hi, Unsure if my previous message made it through as didn't see it on a digest. I'm using Claws Email and 3 of 4 email accounts keep giving; [10:50:45] POP< +OK Dovecot ready. [10:50:45] POP> USER sales [10:50:45] POP< +OK [10:50:45] POP> PASS ******** [10:50:45] POP< +OK Logged in. [10:50:45] POP> STAT [10:50:45] POP< -ERR Unknown command: *** error occurred on POP session *** Error occurred while processing mail. I've turned on as much logging as I can find in Dovecot but nothing useful is coming out, it honestly does believe STAT is invalid - I can see the connection close rather than disconnect. It's strange how it works for one account but not others, the settings are identical - I went through them with a fine tooth comb. Any suggestions appreciated. Regards, Andrew

2 1

ACL permission: give permission to move email into different folder
by Davide Marchi 03 Oct '17

03 Oct '17

Hi friends, I've set ACL for two user (two primary email address, no alias), where these users must not be able to delete email from imap server. Now I would like to add (from the client) the ability to move any incoming mail into different directory, if possible into an existing directory chosen by me. These are the settings on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip is it possible? I've read https://wiki2.dovecot.org/ACL but I've not found a solution. many many thanks! Davide

1 0

Postfix + saslauthd SASL With Kerberos (FreeIPA) unable to send mail
by Anvar Kuchkartaev 03 Oct '17

03 Oct '17

Hello I just finished setting up FreeIPA with Dovecot + Postfix + Saslauthd. I can easily access to mails using imap via dovecot with gssapi authentication and postfix also delivering mails very well. But I cannot send email from postfix using gssapi authentication (plain and login authentication working fine) because saslauthd is not specifying realm when requesting service from freeipa domain. warning: SASL authentication failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (No key table entry found matching smtp/mx0.aegisnet.eu@) right form of request is smtp/mx0.aegisnet.eu(a)AEGISNET.EU I googled alot but couldn't find any solution to solve this problem. How to configure saslauthd well that it will use realm to contact with freeipa. Best Regards...

2 3

file-solr
by Siarhei Chystsiakou 02 Oct '17

02 Oct '17

Hi, I have installed dovecot 2.2.31 and settings fts-solr, when I run command doveadm -v index -A "*" sometimes in logs I see information: doveadm(user(a)domain.com): Warning: fts-solr(user(a)domain.com): Mailbox INBOX UID=2028 header size is huge, truncating Does it influence the work of plugin and its functions?

1 0

dovecot listening imaps external interface
by David Mehler 02 Oct '17

02 Oct '17

Hello, I'm trying to get dovecot to listen on specific interfaces. On the server itself I've got webmail going so am needing imap on 143. I do not want this on the external server interface, so I am wanting imaps port 993 external only. The configuration looks right, but Dovecot isn't showing anything listening on port 993 at all. Unrelated, my public and shared folders are not working. Can anyone suggest fixes for either of these issues? Thanks. Dave. # 2.2.32 (dfbe293d4): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: FreeBSD 10.3-RELEASE-p20 amd64 auth_default_realm = domain.com auth_mechanisms = plain login auth_realms = domain.com domain2.com dict { acl = mysql:/usr/local/etc/dovecot/shared-folders.conf sqlquota = mysql:/usr/local/etc/dovecot/quota.conf } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.domain.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 xxx.xxx.xxx.xxx lmtp_rcpt_check_quota = yes mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/mail/:LAYOUT=fs:INDEX=~/mail/ mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib mail_server_admin = mailto:postmaster@domain.com mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:~/mail/:INDEX=~/mail/shared/%%Ld/%%Ln prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = virtual:/usr/local/etc/dovecot/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } prefix = virtual/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/sieve/sieve_error.log trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)domain.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap-postlogin { executable = script-login /usr/local/etc/dovecot/last_login_imap.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = no ssl_cert = </usr/local/etc/ssl/acme/domain.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256@STRENGTH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib sieve } protocol imap { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login }

2 1

Quota - frustrated trying to configure ...
by Garry Glendown 02 Oct '17

02 Oct '17

Hi, after fighting Dovecot almost every step of the way, I have finally gotten most of the functions configured on a customer box (used Cyrus on a previous install, but it was dropped from SLES 12 ...) The mail server setup uses LDAP for user authentication, has a central maildir tree (.../dovecot/maildir/<USER>/...) that is used for all users' mail, sieve is also running well. The users themselves are just virtual users, they do not have a local home directory or anything. I was now trying to get Quota to work ... Looking at the Wiki more or less showed the same "spotty" results of the rest of the Wiki. Fine for anybody that needs the documentation just as a reference, but somewhat lacking for someone that does not have experience in setting up Dovecot. I tried following the wiki, as well as checking on other web pages I came across. In order to keep the setup simple, and not have to jump through hoops to set up any SQL backup etc., I tried using a file-based storage of the quota entries, as in: dict { quota = file:/data/dovecot/db/quota.db } I also added quota entries in the other places I believe are necessary, and set up a rule like this: plugin { quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M } I got through dovecot restart without errors, and IMAP still answers. But attempting to do a recalculation of the current quota usage ends up with this error: doveadm(root): Error: chdir(/root/) failed: Permission denied (euid=479(dovecot) egid=478(dovecot) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(root): Error: chdir(/root) failed: Permission denied It looks like dovecot doesn't actually attempt to look at the central maildir, but instead seems to attempt to enter the current user's homedir (which, in this case, is root). What am I (possibly) missing here? Is this way of setting it up even viable? While I need a general per-user-quota, I also need the ability to overwrite each user's default quota ... is there any recommendable more detailed documentation on how to set up quota? Thanks, -garry

3 6

[PATCH] lib-mail: Set missing invalid_syntax to TRUE
by Pali Rohár 02 Oct '17

02 Oct '17

route is already set to "INVALID_ROUTE" when fill_missing is true, but setting invalid_syntax was not done yet. --- src/lib-mail/message-address.c | 1 + 1 file changed, 1 insertion(+) diff --git a/src/lib-mail/message-address.c b/src/lib-mail/message-address.c index 29cac2b..96584e2 100644 --- a/src/lib-mail/message-address.c +++ b/src/lib-mail/message-address.c @@ -153,6 +153,7 @@ static int parse_angle_addr(struct message_address_parser_context *ctx) if (parse_domain_list(ctx) <= 0 || *ctx->parser.data != ':') { if (ctx->fill_missing) ctx->addr.route = "INVALID_ROUTE"; + ctx->addr.invalid_syntax = TRUE; if (ctx->parser.data == ctx->parser.end) return -1; /* try to continue anyway */ -- 1.7.9.5

1 1

[PLUGIN] Virtual keywords (aka Gmail-like labels)
by Daniele Ricci 02 Oct '17

02 Oct '17

Hello list, I'm new here and since I've been working on a plugin lately I though I'd post it here. It's GPL licensed, hosted on GitHub: https://github.com/daniele-athome/dovecot-virtual-keywords-plugin I've been trying to find a replacement for Gmail and I already have my own mailserver. What I'm missing very much is labels. Since folders don't really match labels, I had to implement something that at least resembles them. I decided to use IMAP keywords since it's probably the closest thing to labels. The README in the repository pretty much describes what this plugin do, but basically it creates virtual mailboxes with predefined rules to match for labeled messages. E.g. if you set a "Urgent" keyword on any message, the plugin will create a "Virtual/Urgent" virtual mailbox that will have the message you just labeled. I'm a bit out of practice on C but I believe I managed. I've tested the plugin locally but I've not deployed it on my production mail server yet. I'd like to hear your opinions (reviews and comments are very welcome) and possibly find other people interested in this approach to discuss about it. Thanks! -- Daniele

2 6

sieve script not executed?
by Roberto Nunnari 02 Oct '17

02 Oct '17

Hello. I'm trying to set up a vacation autoresponder but up to now, no success. I'm using dovecot managedsieve to set up the new filter and to my understanding it works correctly and it creates in the user's home the link .dovecot.sieve that points to sieve/managesieve.sieve ~$ cat .dovecot.sieve require ["date","relational","vacation"]; # rule:[Vacanza] if allof (currentdate :zone "+0200" :value "ge" "date" "2017-09-29", currentdate :zone "+0200" :value "le" "date" "2017-10-09") { vacation :days 7 :addresses ["robi@hidden1","robi@hiden2"] "eccoci a dopo"; } Problem is that apparently this filter is completely ignored.. that is, when a new email is delivered to those addresses, no autoresponse is sent back to the sender. I also, followed the troubleshooting guide here: https://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting and everything works as expected. What is the problem? What am I missing? Thank you and best regards. Roberto # dovecot --version 2.2.22 (fe789d2) # dovecot -n # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-96-generic x86_64 Ubuntu 16.04.3 LTS mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap sieve pop3 sieve" ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.key userdb { driver = passwd } protocol sieve { mail_debug = yes }

2 1

POP3 STAT command broken (race condition?)
by Andrew Charnley 01 Oct '17

01 Oct '17

Hi, 4x POP3 over SSL. I login manually using SSL client and issue STAT command - all work. Claws-mail works for one account persistently, the other three always fail. There are no differences between the accounts other than username/pass so I have been unable to determine why this occurs. Also, Evolution works as it uses LIST not STAT. Claws reports: [12:30:40] POP< +OK [12:30:40] POP> PASS ******** [12:30:40] POP< +OK Logged in. [12:30:40] POP> STAT [12:30:40] POP< -ERR Unknown command: *** error occurred on POP session *** Error occurred while processing mail. Perhaps there's a race between logging in and issuing commands? Andrew

2 1

Doveadm / dsync: mirror?
by Larry Rosenman 01 Oct '17

01 Oct '17

On https://wiki.dovecot.org/Migration/MailFormat we see: mbox -> maildir migration. Set mail_location=maildir:~/Maildir and run dsync -u username mirror mbox:~/mail:INBOX=/var/mail/username but NOWHERE that I can find is the “mirror” command documented on the wiki. What are ALL the options here? (and it’s interesting to note that dsync is a symlink to doveadm). Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106

1 0

imapc and masteruser
by Computerisms Corporation 30 Sep '17

30 Sep '17

Hi, My end goal is to set up shared mailboxes on a cluster as per: https://wiki.dovecot.org/SharedMailboxes/ClusterSetup I was having very little luck with it, so I had been trying to break down into pieces and get individual components working. So I have things setup on a single server, with a working dovecot instance. I have no director or any thing else running yet, and I am just trying to get the imapc portion of things working. Eventually I came across a post from Sven Hartge: https://www.dovecot.org/list/dovecot/2012-November/087046.html This is from several years ago, but I set up a separate dovecot instance on port 9993 specifically to run the shared folders as he describes, and copied his configuration suggestions pretty much verbatim. The only signficant difference is that I needed to not configure the imapc_user as he had done, and instead as the wiki suggests remove that config option entirely. With this, the imapc connection is being made from the primary instance on port 993 to the shared instance on port 9993. My problem is that it doesn't appear that the imapc_master_user is being fully acknowledged. The imapc connection must be made with the original user logging in as the master user to the shared user's account, else the ACLs can't do what they are supposed to do. It does appear the original user is being used to authenticate, maybe, at the very least it is being offered in the imapc connection, but not as a master user. To illustrate, I have two snippets of logs below. The first is from the shared folders instance on port 9993 after logging into the primary server on port 993, which triggers the imapc connection. This shows the user bob.test, who is the imapc_master_user as defined by %u, being acknowledged and then having the username changed to that of my shared user, in this case authapps. Further down, we can see that the auth_user is bob.test, but there is no master user, and the acl username at the bottom of the snipped remains that of my shared user. Below that, I have the same snippet of log, as obtained by connecting with openssl s_client to the shared instance on port 9993, with the string: a login authapps*bob.test XXXXXXX In order to get this working, I need to add to the shared instance's config file a static userdb like so: userdb { driver = static } this snippet shows the masteruser working as expected, and the acl username being that of the master user. Unfortunately, it has no apparent effect on the imapc login. So it seems master user logins work, just not through imapc. I note at the top of the first snippet, before the change in username, it appears the imapc connection is being directed to the static passdb, which I think is triggering the username change, where as the second snippet, the connection is starting with the ldap passdb. but no amount of playing "configuration file options" chairs has led me to a working solution. I am hoping someone can provide some insight as to what I am missing here. doveconf -n for both instances are pasted below the log snippets. If you are still reading, you have my gratitude for your attention this far... 2017-09-27 13:20:13.725943500 Sep 27 13:20:13 auth: Debug: static(bob.test,192.168.120.70,<y0vvhDFaYqDAqHhG>): lookup 2017-09-27 13:20:13.725960500 Sep 27 13:20:13 auth: Debug: static(bob.test,192.168.120.70,<y0vvhDFaYqDAqHhG>): username changed bob.test -> authapps 2017-09-27 13:20:13.726011500 Sep 27 13:20:13 auth: Debug: client passdb out: OK 1 user=authapps original_user=bob.test 2017-09-27 13:20:13.728299500 Sep 27 13:20:13 auth: Debug: master in: REQUEST 2523398145 13259 1 ba830ae1c199401e5dbee28e31025ac1 session_pid=13335 request_auth_token 2017-09-27 13:20:13.728344500 Sep 27 13:20:13 auth: Debug: master userdb out: USER 2523398145 authapps uid=509 gid=509 home=/CTFN/SharedMailboxes/CTFN/ auth_token=5e3d02714e82441cbbb3de8ff80f35bc3dc4b291 auth_user=bob.test 2017-09-27 13:20:13.728459500 Sep 27 13:20:13 imap-login: Info: Login: user=<authapps>, method=PLAIN, rip=192.168.120.70, lip=192.168.120.70, mpid=13335, TLS, session=<y0vvhDFaYqDAqHhG> 2017-09-27 13:20:13.729092500 Sep 27 13:20:13 imap(authapps): Debug: Loading modules from directory: /usr/local/lib/dovecot 2017-09-27 13:20:13.729781500 Sep 27 13:20:13 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so 2017-09-27 13:20:13.729841500 Sep 27 13:20:13 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so 2017-09-27 13:20:13.730026500 Sep 27 13:20:13 imap(authapps): Debug: Effective uid=509, gid=509, home=/CTFN/SharedMailboxes/CTFN/ 2017-09-27 13:20:13.732014500 Sep 27 13:20:13 imap(authapps): Debug: Namespace CTFN: type=public, prefix=CTFN/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/CTFN/SharedMailboxes/ 2017-09-27 13:20:13.732050500 Sep 27 13:20:13 imap(authapps): Debug: maildir++: root=/CTFN/SharedMailboxes, index=, indexpvt=, control=, inbox=/CTFN/SharedMailboxes, alt= 2017-09-27 13:20:13.732053500 Sep 27 13:20:13 imap(authapps): Debug: acl: initializing backend with data: vfile 2017-09-27 13:20:13.732055500 Sep 27 13:20:13 imap(authapps): Debug: acl: acl username = authapps 2017-09-27 18:33:37.008636500 Sep 27 18:33:37 auth: Debug: ldap(bob.test,192.168.120.50,master,<y56y5TVaAYHAqHgy>): Master user lookup for login: authapps 2017-09-27 18:33:37.021400500 Sep 27 18:33:37 auth: Info: ldap(bob.test,192.168.120.50,master,<y56y5TVaAYHAqHgy>): Master user logging in as authapps 2017-09-27 18:33:37.021425500 Sep 27 18:33:37 auth: Debug: client passdb out: OK 1 user=authapps original_user=bob.test auth_user=bob.test 2017-09-27 18:33:37.023658500 Sep 27 18:33:37 auth: Debug: master in: REQUEST 2776498177 9162 1 2d247ac65c17769575edb6c9db86fdee session_pid=27552 request_auth_token 2017-09-27 18:33:37.023703500 Sep 27 18:33:37 auth: Debug: ldap(authapps,192.168.120.50,<y56y5TVaAYHAqHgy>): user search: base=CN=Users,dn=ctfn,dn=ca scope=onelevel filter=(&(sAMAccountName=authapps)) fields=homeDirectory,uidNumber,gidNumber 2017-09-27 18:33:37.026953500 Sep 27 18:33:37 auth: Error: ldap(authapps,192.168.120.50,<y56y5TVaAYHAqHgy>): ldap_search(base=CN=Users,dn=ctfn,dn=ca filter=(&(sAMAccountName=authapps))) failed: Operations error 2017-09-27 18:33:37.026984500 Sep 27 18:33:37 auth: Debug: master userdb out: USER 2776498177 authapps uid=509 gid=509 home=/CTFN/SharedMailboxes/CTFN/ master_user=bob.test auth_token=12961a562e9ef0698b363714d758d95cea9ff3f2 auth_user=bob.test 2017-09-27 18:33:37.027163500 Sep 27 18:33:37 imap-login: Info: Login: user=<authapps>, method=PLAIN, rip=192.168.120.50, lip=192.168.120.70, mpid=27552, TLS, session=<y56y5TVaAYHAqHgy> 2017-09-27 18:33:37.027826500 Sep 27 18:33:37 imap(authapps): Debug: Loading modules from directory: /usr/local/lib/dovecot 2017-09-27 18:33:37.028479500 Sep 27 18:33:37 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so 2017-09-27 18:33:37.028561500 Sep 27 18:33:37 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so 2017-09-27 18:33:37.028607500 Sep 27 18:33:37 imap(authapps): Debug: Added userdb setting: plugin/master_user=bob.test 2017-09-27 18:33:37.028685500 Sep 27 18:33:37 imap(authapps): Debug: Effective uid=509, gid=509, home=/CTFN/SharedMailboxes/CTFN/ 2017-09-27 18:33:37.030993500 Sep 27 18:33:37 imap(authapps): Debug: Namespace CTFN: type=public, prefix=CTFN/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/CTFN/SharedMailboxes/CTFN 2017-09-27 18:33:37.031019500 Sep 27 18:33:37 imap(authapps): Debug: maildir++: root=/CTFN/SharedMailboxes/CTFN, index=, indexpvt=, control=, inbox=/CTFN/SharedMailboxes/CTFN, alt= 2017-09-27 18:33:37.031040500 Sep 27 18:33:37 imap(authapps): Debug: acl: initializing backend with data: vfile 2017-09-27 18:33:37.031047500 Sep 27 18:33:37 imap(authapps): Debug: acl: acl username = bob.test PRIMARY SERVER ON PORT 993: doveconf -i dovecotserver -n # 2.2.31 (65cde28): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.19 (e5c7051) # OS: Linux 4.9.0-3-amd64 x86_64 Debian 9.1 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose_passwords = plain hostname = imap.ctfn.ca imapc_host = masterchieflian.ctfn.ca imapc_master_user = %u imapc_password = # hidden, use -P to show it imapc_port = 9993 imapc_ssl = imaps instance_name = dovecotserver lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 192.168.120.70 log_path = /dev/stderr login_greeting = CTFN IMAP server mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = stats quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds mmap_disable = yes namespace CTFN { list = yes location = imapc:/CTFN/mail/CTFN:INDEXPVT=/CTFN/mail/%n/Maildir/CTFN prefix = CTFN/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox LearnAsSpam { auto = subscribe } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap master = yes } plugin { acl_shared_dict = fs:posix:prefix=/CTFN/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject flags sieve = ~/.dovecot.sieve sieve_default = /usr/local/lib/dovecot/default.sieve sieve_dir = ~/sieve sieve_extensions = +vacation +vacation-seconds sieve_max_actions = 92 sieve_max_redirects = 24 sieve_max_script_size = 10M sieve_quota_max_scripts = 20 sieve_quota_max_storage = 200000 } protocols = imap sieve service auth { client_limit = 1024 unix_listener auth-userdb { group = vmail mode = 0660 user = dovecot } } service doveadm { inet_listener { address = 192.168.120.70 port = 9092 } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 ssl = no } inet_listener imaps { address = 192.168.120.70 port = 993 ssl = yes } process_min_avail = 5 service_count = 0 } service managesieve-login { inet_listener sieve-local { address = 127.0.0.1 port = 4190 } inet_listener sieve { address = 192.168.120.70 port = 4190 } process_min_avail = 5 service_count = 1 vsz_limit = 64 M } ssl = required ssl_ca = /var/CA/ctfn.ca/RapidSSLWildcard/2017/geotrust.intermediate.pem ssl_cert = <//var/CA/ctfn.ca/RapidSSLWildcard/2017/ctfn.ca.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=vmail gid=vmail imapc_password=%w home=/CTFN/mail/%Ln driver = ldap } userdb { args = uid=vmail gid=vmail home=/CTFN/mail/%n driver = static } verbose_proctitle = yes protocol imap { imap_id_log = * } protocol lda { mail_plugins = stats quota sieve submission_host = 127.0.0.1:25 } protocol sieve { mail_max_userip_connections = 10 mail_plugins = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = managesieve_sieve_capability = } SHARED SERVER ON PORT 9993 doveconf -i dovshare -n # 2.2.31 (65cde28): /usr/local/etc/dovecot/dovshare.conf # Pigeonhole version 0.4.19 (e5c7051) # OS: Linux 4.9.0-3-amd64 x86_64 Debian 9.1 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose_passwords = plain base_dir = /usr/local/var/run/dovshare/ hostname = imapshare.ctfn.ca instance_name = dovshare listen = 192.168.120.70 log_path = /dev/stderr login_greeting = CTFN IMAP Shared Mailboxes mail_debug = yes mail_fsync = always mail_gid = vmail mail_location = maildir:~ mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = stats quota acl mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace CTFN { inbox = yes location = maildir:/CTFN/SharedMailboxes/CTFN prefix = CTFN/ separator = / type = public } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap master = yes } passdb { args = user=authapps password=XXXXXXXXXX driver = static } plugin { acl = vfile acl_shared_dict = fs:posix:prefix=/CTFN/Config/dovecot/dovecot.acls/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject flags } protocols = imap service auth { client_limit = 1024 unix_listener auth-userdb { group = vmail mode = 0660 user = dovecot } } service imap-login { inet_listener imaps { address = 192.168.120.70 port = 9993 ssl = yes } process_min_avail = 5 service_count = 0 } ssl = required ssl_ca = </var/CA/ctfn.ca/RapidSSLWildcard/2017/geotrust.intermediate.pem ssl_cert = <//var/CA/ctfn.ca/RapidSSLWildcard/2017/ctfn.ca.pem ssl_client_ca_file = </var/CA/ctfn.ca/RapidSSLWildcard/2017/geotrust.intermediate.pem ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { driver = static } verbose_proctitle = yes protocol imap { imap_id_log = * mail_plugins = acl imap_acl } -- Bob Miller Cell: 867-334-7117 Office: 867-633-3760 www.computerisms.ca

2 4

2.2.32 'doveadm replicator replicate -f' segfault
by Robert Giles 29 Sep '17

29 Sep '17

Very minor bug; not specifying the user mask with 'doveadm replicator replicate -f' causes a segfault: server:~# doveadm replicator replicate -f Segmentation fault server:~# doveadm replicator replicate -f '*' 123 users updated server:~# gdb /usr/bin/doveadm core.2418 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-100.el7 This GDB was configured as "x86_64-redhat-linux-gnu". Reading symbols from /usr/bin/doveadm...Reading symbols from /usr/lib/debug/usr/bin/doveadm.debug...done. done. [New LWP 2418] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `doveadm replicator replicate -f'. Program terminated with signal 11, Segmentation fault. #0 0x00007fd2c059f921 in __strlen_sse2_pminub () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.6-13.el7.x86_64 glibc-2.17-196.el7.x86_64 nss-softokn-freebl-3.28.3-8.el7_4.x86_64 xz-libs-5.2.2-1.el7.x86_64 zlib-1.2.7-17.el7.x86_64 (gdb) bt full #0 0x00007fd2c059f921 in __strlen_sse2_pminub () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd2c08c68f4 in str_append_tabescaped (dest=dest@entry=0x5578cd69f668, src=0x0) at strescape.c:136 No locals. #2 0x00005578cb5a2731 in cmd_replicator_replicate (argc=1, argv=0x5578cd6a75f8) at doveadm-replicator.c:245 ctx = 0x5578cd69f608 str = 0x5578cd69f668 line = <optimized out> #3 0x00005578cb5999d8 in doveadm_try_run (argv=0x5578cd6a75f0, argc=2, cmd_name=0x5578cd6a7610 "replicator") at doveadm.c:223 cmd = <optimized out> #4 main (argc=3, argv=0x5578cd6a75e8) at doveadm.c:383 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x5578cd6a77cf "root", cli = true, tcp_server = false, local_ip = { family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, conn = 0x0} cmd_name = 0x5578cd6a7610 "replicator" quick_init = false c = <optimized out> (gdb) frame 4 #4 main (argc=3, argv=0x5578cd6a75e8) at doveadm.c:383 383 !doveadm_try_run(cmd_name, argc, (const char **)argv) && dovecot -n: --------------------- # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 3.10.0-693.2.2.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) auth_master_user_separator = * auth_username_format = %Ln auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_uid = 30000 imapc_features = rfc822.size fetch-headers imapc_host = some-imap-server imapc_user = %u last_valid_uid = 30000 mail_location = mdbox:~/mdbox mail_plugins = " zlib acl notify replication" mail_prefetch_count = 20 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus vnd.dovecot.duplicate mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /master-file driver = passwd-file master = yes } passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:server2:1109 sieve = ~/.dovecot.sieve sieve_before = /some-path/global.sieve sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +vnd.dovecot.duplicate sieve_spamtest_max_value = 100 sieve_spamtest_status_header = X-PerlMx-Spam: Gauge=[[:alnum:]]+, Probability=(-?[[:digit:]]+)%.* sieve_spamtest_status_type = score zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve replication_max_conns = 30 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 1109 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " zlib acl notify replication sieve" } protocol lda { mail_plugins = " zlib acl notify replication sieve" }

2 1

Securing postfix to dovecot (SASL) auth
by Raymond Sellars 29 Sep '17

29 Sep '17

Hi Is it possible to secure the Dovecot SASL auth provider for postfix? https://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL I'm currently using the inet option to provide SASL auth to postfix for dovecot. Both installs are on different hosts hence the use of inet rather than unix socket. I'm looking for the best way to secure this channel (rather than just assuming the VLAN is secure ) ,e.g. TLS. It would seem even the latest versions of dovecot/postfix3 don't support encrypting this channel? Has anyone managed to implement a secure internal approach they can share? I'm wondering if Postfix with Cyrus against IMAP using STARTTLS is my best alternative. Thanks Raymond

5 8

Conditionally disabling auth policy
by Mark Moseley 29 Sep '17

29 Sep '17

I've been digging into the auth policy stuff with weakforced lately. There are cases (IP ranges, so could be wrapped up in remote {} blocks) where it'd be nice to skip the auth policy (internal hosts that I can trust, but that are hitting the same servers as the outside world). Is there any way to disable auth policy, possibly inside a remote{}? auth_policy_server_url complains that it can't be used inside a remote block, so no dice there. Anything I'm missing?

3 7

doveadm backup panic, dsync-ibc.c, dsync_ibc_send_mailbox_tree_node, assertion failed: (*name != NULL)
by Robert Giles 28 Sep '17

28 Sep '17

Hi folks, Not sure how much extra information I'll be able to provide on this, but I'm experiencing a consistent, reproducible dsync backup error with a single, specific account I'm trying to migrate from UW-IMAP / Panda (mix mailbox) to a Dovecot 2.2.32 cluster. Didn't spot any core files laying around. Doveadm backup output, dovecot --version and dovecot -n below: server:~# doveadm -Dv -o imapc_user=username-dc -o imapc_password=password backup -R -u username -x .mailboxlist -x .procmailrc -x vacation.msg -x .bash_history -x .Xauthority -x remote_pinerc imapc: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_replication_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(username): Debug: Effective uid=35000, gid=35000, home=/storagedisk/username doveadm(username): Debug: acl: No acl setting - ACLs are disabled doveadm(username): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox doveadm(username): Debug: fs: root=/storagedisk/username/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(username): Debug: Namespace : Using permissions from /storagedisk/username/mdbox: mode=0700 gid=default dsync(username): Debug: Effective uid=35000, gid=35000, home=/storagedisk/username dsync(username): Debug: acl: No acl setting - ACLs are disabled dsync(username): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Created new connection dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Looking up IP address (reconnect_ok=true, last_connect=1506608870) dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Connecting to 192.168.0.100:143 dsync(username): Info: imapc(panda-imap-server.contoso.com:143): Connected to 192.168.0.100:143 (local 192.168.0.200:33630) dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Server capabilities: IMAP4REV1 I18NLEVEL=1 LITERAL+ SASL-IR LOGIN-REFERRALS STARTTLS dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Authenticating as username-dc dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Server capabilities: IMAP4REV1 I18NLEVEL=1 LITERAL+ IDLE UIDPLUS NAMESPACE CHILDREN MAILBOX-REFERRALS BINARY UNSELECT WITHIN SORT THREAD=REFERENCES THREAD=ORDEREDSUBJECT MULTIAPPEND SCAN dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Authenticated successfully dsync(username): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= dsync(username): Debug: brain S: Local mailbox tree: guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(username): Panic: file dsync-ibc.c: line 72 (dsync_ibc_send_mailbox_tree_node): assertion failed: (*name != NULL) dsync(username): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9edee) [0x7f7d4fbfcdee] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f7d4fbfce5a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7d4fb8e2cc] -> doveadm(+0x5332b) [0x563357a0032b] -> doveadm(dsync_brain_send_mailbox_tree+0x6e) [0x5633579f12be] -> doveadm(dsync_brain_run+0x49d) [0x5633579ee56d] -> doveadm(+0x290dc) [0x5633579d60dc] -> doveadm(+0x2b21c) [0x5633579d821c] -> doveadm(+0x2be1a) [0x5633579d8e1a] -> doveadm(doveadm_mail_try_run+0x215) [0x5633579d9775] -> doveadm(main+0x46a) [0x5633579c8a9a] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f7d4f7bcc05] -> doveadm(+0x1bc05) [0x5633579c8c05] Aborted dovecot --version 2.2.32 (dfbe293d4) dovecot -n: ----------------------------------------------- # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 3.10.0-693.2.2.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) auth_master_user_separator = * auth_username_format = %Ln disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_uid = 35000 imapc_features = rfc822.size fetch-headers imapc_host = panda-imap-server.contoso.com imapc_user = %u last_valid_uid = 35000 mail_location = mdbox:~/mdbox mail_plugins = " zlib acl notify replication" mail_prefetch_count = 20 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus vnd.dovecot.duplicate mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:otherserver.contoso.com:1109 sieve = ~/.dovecot.sieve sieve_before = /etc/sieve.before sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +vnd.dovecot.duplicate sieve_spamtest_max_value = 100 sieve_spamtest_status_header = X-PerlMx-Spam: Gauge=[[:alnum:]]+, Probability=(-?[[:digit:]]+)%.* sieve_spamtest_status_type = score zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 1109 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " zlib acl notify replication sieve" } protocol lda { mail_plugins = " zlib acl notify replication sieve" }

1 1

questions about maildir to mdbox migration
by Dave McGuire 28 Sep '17

28 Sep '17

Hi folks! I converted some of the spools on my mail server from maildir to mdbox. It went smoothly and the performance has been great. However, I have two questions regarding the process. First, I failed to notice the fairly low default mdbox_rotate_size, and I changed it in dovecot.conf after the migration. Is it possible to somehow make that change retroactive, to coalesce the couple thousand "storage/m.*" files that are anywhere from a few hundred bytes up to a few megabytes, into a smaller number of larger files, without re-doing the migration? Second, I'd like to delete the old maildir files and directories to reclaim the space in the filesystem, but it's not clear to me which ones I can safely delete, i.e. ones upon which my new mdbox-based spools no longer depend. I know maildir uses new, tmp, and cur directories, but in the spool directory there are also files like dovecot-uidlist, dovecot-uidvalidity, dovecot.index.cache, dovecot.index.log, dovecot.mailbox.log, as well as separate directories for each of my mail folders containing their own new, tmp, and cur directories and their own dovecot* files. Can someone offer some guidance regarding which ones I can safely remove? Thanks, -Dave -- Dave McGuire, AK4HZ New Kensington, PA

2 2

Panic
by Matthijs Kooijman 28 Sep '17

28 Sep '17

(I'm not subscribed, please keep me CC'd) Hi, since a few months I'm experiencing repeated dovecot crashes. I mostly see them in the logs, I haven't had any users complain, so I haven't looked closely until now. I was originally using an older version fro mDebian and hoped that a newer future version would already fix this, but I just upgraded to version 1:2.2.32-2 from Debian testing, and the problem persists. This crash sometimes happens occasionally, but often happens repeatedly for some time (presumably a client keeps retrying) but can also be gone for hours or days (presumably the client no longer connects). I haven't been able to definitively figure out what client causes this, but based on the user ID I suspect it is Mail.app on OSX. I managed to get a core dump, which gave me the stacktrace below. I've also attached my config file. If any other details are relevant, just ask and I can squeeze them out of the core dump (but I'd rather not publicly share the file). I can probably set up rawlog to capture the actual IMAP session if needed, though I have no time for that right now. Gr. Matthijs 51 ../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007fc5eed9c3fa in __GI_abort () at abort.c:89 #2 0x00007fc5ef1a609a in default_fatal_finish (type=LOG_TYPE_PANIC, status=status@entry=0) at failures.c:201 #3 0x00007fc5ef1a619a in i_internal_fatal_handler (ctx=0x7ffc553b38d0, format=<optimized out>, args=<optimized out>) at failures.c:670 #4 0x00007fc5ef136cf8 in i_panic (format=format@entry=0x7fc5ef52e880 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 #5 0x00007fc5ef47f998 in mailbox_copy_int (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2473 #6 0x00007fc5ef47f9ff in mailbox_copy (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2489 #7 0x000055bae72a2f5f in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7ffc553b3a88, t=<optimized out>, move=<optimized out>, cmd=0x55bae816d5e8) at cmd-copy.c:72 #8 cmd_copy_full (cmd=0x55bae816d5e8, move=false) at cmd-copy.c:139 #9 0x000055bae72afd9c in command_exec (cmd=cmd@entry=0x55bae816d5e8) at imap-commands.c:200 #10 0x000055bae72ae322 in client_command_input (cmd=<optimized out>, cmd@entry=0x55bae816d5e8) at imap-client.c:1088 #11 0x000055bae72ae3bc in client_command_input (cmd=<optimized out>) at imap-client.c:1148 #12 0x000055bae72ae77d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x55bae816bcf8) at imap-client.c:1190 #13 client_handle_input (client=0x55bae816bcf8) at imap-client.c:1202 #14 0x000055bae72aeccc in client_input (client=0x55bae816bcf8) at imap-client.c:1249 #15 0x00007fc5ef1bb742 in io_loop_call_io (io=0x55bae816d4e0) at ioloop.c:599 #16 0x00007fc5ef1bcd8e in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55bae8153990) at ioloop-epoll.c:223 #17 0x00007fc5ef1bb7d6 in io_loop_handler_run (ioloop=ioloop@entry=0x55bae8153990) at ioloop.c:648 #18 0x00007fc5ef1bb988 in io_loop_run (ioloop=0x55bae8153990) at ioloop.c:623 #19 0x00007fc5ef141353 in master_service_run (service=0x55bae8153830, callback=<optimized out>) at master-service.c:666 #20 0x000055bae72a1139 in main (argc=<optimized out>, argv=<optimized out>) at main.c:491 (gdb) up 9 #9 0x000055bae72afd9c in command_exec (cmd=cmd@entry=0x55bae816d5e8) at imap-commands.c:200 200 finished = cmd->func(cmd); (gdb) p *cmd $14 = {prev = 0x0, next = 0x0, client = 0x55bae816bcf8, pool = 0x55bae816d5c0, tag = 0x55bae816d750 "7.119309", name = 0x55bae816d760 "UID COPY", args = 0x55bae816d770 "20004 INBOX", human_args = 0x55bae816d780 "20004 INBOX", cmd_flags = COMMAND_FLAG_BREAKS_SEQS, tagline_reply = 0x0, func = 0x55bae72a33e0 <cmd_copy>, context = 0x0, module_contexts = {arr = {buffer = 0x55bae816d6e8, element_size = 8}, v = 0x55bae816d6e8, v_modifiable = 0x55bae816d6e8}, parser = 0x55bae8157aa0, state = CLIENT_COMMAND_STATE_WAIT_INPUT, stats = {start_time = {tv_sec = 1506507612, tv_usec = 777163}, last_run_timeval = {tv_sec = 1506507612, tv_usec = 777163}, start_ioloop_wait_usecs = 46340, running_usecs = 0, lock_wait_usecs = 0, bytes_in = 0, bytes_out = 0}, stats_start = {timeval = { tv_sec = 1506507612, tv_usec = 777241}, lock_wait_usecs = 0, bytes_in = 91, bytes_out = 852}, sync = 0x0, uid = 1, cancel = 0, param_error = 0, search_save_result = 0, search_save_result_used = 0, temp_executed = 0, tagline_sent = 0, executing = 1} (gdb) down #8 cmd_copy_full (cmd=0x55bae816d5e8, move=false) at cmd-copy.c:139 139 ret = fetch_and_copy(cmd, move, t, &src_trans, search_args, (gdb) #7 0x000055bae72a2f5f in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7ffc553b3a88, t=<optimized out>, move=<optimized out>, cmd=0x55bae816d5e8) at cmd-copy.c:72 72 if (mailbox_copy(&save_ctx, mail) < 0) (gdb) #6 0x00007fc5ef47f9ff in mailbox_copy (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2489 2489 return mailbox_copy_int(_ctx, mail); (gdb) #5 0x00007fc5ef47f998 in mailbox_copy_int (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2473 2473 i_assert(!ctx->unfinished); (gdb) #4 0x00007fc5ef136cf8 in i_panic (format=format@entry=0x7fc5ef52e880 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 275 fatal_handler(&ctx, format, args);

3 7

Dovecot and Self-signed issue
by Michael A. Peters 28 Sep '17

28 Sep '17

I use dovecot on several servers. One of them uses a self-signed cert, it's just me. It worked fine until yesterday when I upgraded my desktop (NOT the server) to CentOS 7.4 Now thunderbird complains when it starts up, and won't let me confirm the security exception. On the server the following error occurs in the log: Sep 25 20:17:49 librelamp dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=2600:1010:b064:f260:e83e:562d:2316:18df, lip=2600:3c01::f03c:91ff:fee4:310c, TLS handshaking: SSL_accept() failed: error:14094418:SSL routines:SSL3_READ_BYTES:tlsv1 alert unknown ca: SSL alert number 48, session=<u7agQAlasK8mABAQsGTyYOg+Vi0jFhjf> I believe this is a client issue, as it worked just fine in CentOS 7.3 client, but I am hoping this has been seen and fixed before.

3 6

dsync: assert panic on mbox // no INBOX sync on hybrid mbox/maildir
by David Gardner 27 Sep '17

27 Sep '17

Hi, This (hopefully!) might be a case of user error, as I'm new to dovecot... Alternatively it might be some confusion in an index, since I've been mucking about trying different things in my configuration files and had frequent crashes. I'm trying to sync 2 (LAN) hosts, ideally to have full automatic replication happening. They both have hybrid mbox INBOX and maildir++ folders, using namespaces, as suggested in the wiki. I might have deviated the config from the wiki version, in trying to get things working. Both hosts communicate perfectly with an external IMAP client (thunderbird). Replication is working, but only partially - it is syncing the folders but not INBOX. I've thus been trying various things to try to get the INBOX to sync. The crash is only happening one of the 2 hosts which I've named crashhost for this report. The process crashes no matter which host starts the sync. With a second user, the crash happens on the other host crashhost: Ubuntu 16.04, x86_64, laptop, Dovecot 2.2.22, and Dovecot 2.2.32 (from debian sid package, locally compiled) otherhost: Ubuntu 16.04, x86_64, desktop, Dovecot 2.2.22, and Dovecot 2.2.32 (from debian sid package, locally compiled) RESULTS: 1) doveadm sync -f -u david tcp:otherhost synchronises the folders, but does not touch INBOXes. 2) doveadm sync -f -m INBOX -u david tcp:otherhost Does not touch INBOXes 3) doveadm sync -n '#mbox/' -f -u david tcp:otherhost dsync-local(david): Panic: file mbox-lock.c: line 800 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) I added some debug code, the assertion failure is being triggered by a call to mbox-lock() with: locktype=F_WRCLK mbox->mbox_lock_type=F_RDLCK, mbox->external_transactions=1 The config files on the 2 hosts only differ by the hostnames they're supposed to be syncing to. $ dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 4.10.0-35-generic x86_64 Ubuntu 16.04.3 LTS doveadm_password = # hidden, use -P to show it doveadm_port = 12346 imapc_host = crashhost imapc_password = # hidden, use -P to show it imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no imapc_user = %u mail_location = maildir:~/mail mail_plugins = " notify replication" mail_privileged_group = mail namespace { inbox = no list = yes location = prefix = separator = / subscriptions = yes } namespace inbox { hidden = yes inbox = yes list = no location = mbox:~/nomail:INBOX=/var/mail/%u:INDEX=/var/spool/mailindex/%u mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = "#mbox/" separator = / type = private } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { mail_replica = tcp:otherhost:12346 } protocols = " imap" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service config { unix_listener config { user = vmail } } service doveadm { inet_listener { port = 12346 } user = root } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/dovecot/dovecot.pem ssl_client_ca_dir = /etc/ssl ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } gdb) bt #0 0x00007f37f426e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 #1 0x00007f37f427002a in __GI_abort () at abort.c:89 #2 0x00007f37f469f7aa in ?? () from /usr/lib/dovecot/libdovecot.so.0 #3 0x00007f37f469f829 in default_fatal_handler () from /usr/lib/dovecot/libdovecot.so.0 #4 0x00007f37f46302a1 in i_panic () from /usr/lib/dovecot/libdovecot.so.0 #5 0x00007f37f49ac235 in mbox_lock () from /usr/lib/dovecot/libdovecot-storage.so.0 #6 0x00007f37f49adb11 in mbox_save_begin () from /usr/lib/dovecot/libdovecot-storage.so.0 #7 0x00007f37f49769a1 in mailbox_save_begin () from /usr/lib/dovecot/libdovecot-storage.so.0 #8 0x00007f37f496a2e8 in mail_storage_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 #9 0x00007f37f3e332a5 in ?? () from /usr/lib/dovecot/modules/lib15_notify_plugin.so #10 0x00007f37f4976b73 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #11 0x00007f37f4976d89 in mailbox_move () from /usr/lib/dovecot/libdovecot-storage.so.0 #12 0x000055b45f0da448 in ?? () #13 0x000055b45f0db35a in ?? () #14 0x000055b45f0ddbc0 in dsync_mailbox_import_changes_finish () #15 0x000055b45f0d8645 in dsync_brain_sync_mails () #16 0x000055b45f0d3df8 in dsync_brain_run () #17 0x000055b45f0d4140 in ?? () #18 0x000055b45f0ea3ff in ?? () #19 0x00007f37f46b4c82 in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 #20 0x00007f37f46b6309 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 #21 0x00007f37f46b4d1c in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 #22 0x00007f37f46b4ec8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 #23 0x000055b45f0bb4c2 in ?? () #24 0x000055b45f0bd91c in ?? () #25 0x000055b45f0be5aa in ?? () #26 0x000055b45f0beeda in doveadm_mail_try_run () #27 0x000055b45f0ae47c in main ()

3 3

Quota-status service on Director
by Michael Kliewe 27 Sep '17

27 Sep '17

Hello, I'm trying to configure the quota-status service, but it seems I'm not successful with my director setup (2.2.9). I activate the quota-status service like this on my director server: $ cat 91-quota-status.conf ## ## Quota-Status configuration. ## # Load Module quota-status and listen on TCP/IP Port for connections. service quota-status { executable = quota-status -p postfix inet_listener { address = 10.0.1.44 port = 12340 } client_limit = 1 } # Plugin configuration. # Return messages for requests by quota status: success, nouser and overquota. plugin { quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is over quota" } After restarting the director service I try to query the quota status service: printf "recipient=user(a)domain.de\nsize=100000\n\n" | nc 10.0.1.44 12340 The output is: action=DEFER_IF_PERMIT Invalid user settings. Refer to server log for more information. In the debug log of the director I see this: Feb 23 03:03:09 director01 dovecot: auth: Debug: userdb out: USER 1 user(a)domain.de mail=mdbox:/mnt/data01/domain.de/user/maildir home=/mnt/data01/domain.de/user proxy=Y master=<hidden> pass=<hidden> uid=5000 gid=1 quota_rule=*:storage=60593 quota_rule2=*:messages=100000 Feb 23 03:03:09 director01 dovecot: quota-status(user(a)domain.de): Error: user user(a)domain.de: Initialization failed: Namespace '': mkdir(/mnt/data01/domain.de/user/maildir/mailboxes) failed: Permission denied (euid=5000(vmail) egid=1(daemon) missing +w perm: /mnt, dir owned by 0:0 mode=0755) So the quota status service tries to access the mailbox of the user ON THE DIRECTOR. But the director has not mounted the mailboxes of the users, that's what the backend dovecots are for (proxy=Y). So the quota-status query is not proxied to the dovecot backend server I would assume. Does that mean I have to start the quota-status service on the dovecot backend servers and access it from the Postfix server directly? Currently the Postfixes can only reach the directors, not the backend servers. Is it possible to use the quota-status service on the director? Thanks for any hints and help Michael

3 4

librmb: Mail storage on RADOS with Dovecot
by mj 25 Sep '17

25 Sep '17

Hi ceph-ers, The email below was posted on the ceph mailinglist yesterday by Wido den Hollander. I guess this could be interesting for user here as well. MJ -------- Forwarded Message -------- Subject: [ceph-users] librmb: Mail storage on RADOS with Dovecot Date: Thu, 21 Sep 2017 10:40:03 +0200 (CEST) From: Wido den Hollander <wido(a)42on.com> To: ceph-users(a)ceph.com Hi, A tracker issue has been out there for a while: http://tracker.ceph.com/issues/12430 Storing e-mail in RADOS with Dovecot, the IMAP/POP3/LDA server with a huge marketshare. It took a while, but last year Deutsche Telekom took on the heavy work and started a project to develop librmb: LibRadosMailBox Together with Deutsche Telekom and Tallence GmbH (DE) this project came to life. First, the Github link: https://github.com/ceph-dovecot/dovecot-ceph-plugin I am not going to repeat everything which is on Github, put a short summary: - CephFS is used for storing Mailbox Indexes - E-Mails are stored directly as RADOS objects - It's a Dovecot plugin We would like everybody to test librmb and report back issues on Github so that further development can be done. It's not finalized yet, but all the help is welcome to make librmb the best solution for storing your e-mails on Ceph with Dovecot. Danny Al-Gaaf has written a small blogpost about it and a presentation: - https://dalgaaf.github.io/CephMeetUpBerlin20170918-librmb/ - http://blog.bisect.de/2017/09/ceph-meetup-berlin-followup-librmb.html To get a idea of the scale: 4,7PB of RAW storage over 1.200 OSDs is the final goal (last slide in presentation). That will provide roughly 1,2PB of usable storage capacity for storing e-mail, a lot of e-mail. To see this project finally go into the Open Source world excites me a lot :-) A very, very big thanks to Deutsche Telekom for funding this awesome project! A big thanks as well to Tallence as they did an awesome job in developing librmb in such a short time. Wido

4 3

Different users having same home/mail_location?
by Tapio Sokura 24 Sep '17

24 Sep '17

Hello, Will I be breaking something if I have two users share the same home and/or mail_location (maildir format) in dovecot? Mail will only be delivered to the primary user, the other would be used every now and then to login via imap (webmail). This would be on a CentOS 7 box running dovecot from the packaging system, i.e. dovecot-2.2.10-8.el7 currently. The reason I'd like to do this is to have two ways to login to the same mailbox, one using username + password and the other otherusername + otherpassword + otp-token. Basically this "otherusername" would be for cases where I don't trust the client computer to not have a keylogger etc badness in it, but still need to see my mail. I have this kind of a dual-login setup via PAM for regular system user authentication and it's working ok. I'm just wondering about the dovecot part, whether dovecot will do Unexpected Things if more than one user have the same home and mail_location? If it makes any difference, the users can have separate homes, but the mailbox should be the same for usability. Tapio

4 6

Sieve vacation and srs
by azurit＠pobox.sk 23 Sep '17

23 Sep '17

Hi, is this already fixed? https://www.dovecot.org/pipermail/dovecot/2017-July/108688.html If so, which version of Dovecot includes fix for this? Thanks for info. azur

2 1

Panic: file dict-fs.c:
by Computerisms Corporation 22 Sep '17

22 Sep '17

Hi, Am I doing something wrong here, or is this an actual problem? I am trying to get the top level of a public Mailbox to be an actual mailbox, instead of just storing subfolders. I get what looks to be an identical error when running doveadm acl recalc as well doveadm acl debug Departments2/IT doveadm(root): Info: Mailbox 'IT' is in namespace 'Departments2/' doveadm(root): Info: Mailbox path: /mail/Departments2/.IT doveadm(root): Info: Per-user private flags in mailbox: \Seen doveadm(root): Info: User root has rights: lookup read write write-seen write-deleted insert post expunge doveadm(root): Info: Mailbox found from dovecot-acl-list doveadm(root): Info: Mailbox is in public namespace doveadm(root): Info: Mailbox Departments2/IT is visible in LIST doveadm acl debug Departments2 doveadm(root): Info: Mailbox '' is in namespace 'Departments2/' doveadm(root): Info: Mailbox path: /mail/Departments2 doveadm(root): Info: Per-user private flags in mailbox: \Seen doveadm(root): Info: User root has rights: lookup read write write-seen write-deleted insert post expunge doveadm(root): Error: Mailbox not found from dovecot-acl-list, rebuilding doveadm(root): Panic: file dict-fs.c: line 127 (fs_dict_iterate_init): assertion failed: ((flags & DICT_ITERATE_FLAG_RECURSE) == 0) doveadm(root): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x9a954) [0x7f36a1627954] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x9a9d9) [0x7f36a16279d9] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f36a15bc9a0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x30438) [0x7f36a15bd438] -> /usr/local/lib/dovecot/libdovecot.so.0(dict_iterate_init_multiple+0x74) [0x7f36a15f3bf4] -> /usr/local/lib/dovecot/libdovecot.so.0(dict_iterate_init+0x19) [0x7f36a15f3c69] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_lookup_dict_rebuild+0x392) [0x7f36a0de1ab2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xa695) [0x7f36a0ddf695] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_backend_vfile_acllist_rebuild+0xd) [0x7f36a0ddf7cd] -> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x2552) [0x7f36a07b4552] -> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x27ff) [0x7f36a07b47ff] -> doveadm(+0x2a14d) [0x5624042e714d] -> doveadm(+0x2ac20) [0x5624042e7c20] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x22a) [0x5624042e89ea] -> doveadm(doveadm_cmd_run_ver2+0x515) [0x5624042f7125] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5624042f7177] -> doveadm(main+0x1ca) [0x5624042d85ba] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f36a120e2b1] -> doveadm(_start+0x2a) [0x5624042d897a] Aborted -- Bob Miller Cell: 867-334-7117 Office: 867-633-3760 www.computerisms.ca

1 0

Very high load
by absolutely_free＠libero.it 22 Sep '17

22 Sep '17

Hi, I am using dovecot 2.0.9 (official CentOS rpm), I am experiencing very high load issue. I think it is something related to my storage (/var/spool is about 3 TB and it is almost full). I noticed those kind of messages in /var/log/maillog: Warning: Maildir: Scanning /var/spool/pop/domains/domain.it/username/Maildir/cur took 100 seconds (14281 readdir()s, 0 rename()s to cur/) Warning: Maildir /var/spool/pop/domains/domain.it/username/Maildir: Synchronization took 103 seconds (0 new msgs, 0 flag change attempts, 0 expunge attempts) I wondering if there is something to try, at configuration level, to "mitigate" this.. I use Maildir format, MTA is postfix, I have many users (> 10000) with pop3/imap/webmail access. Physical server with 8 GB RAM and two CPU (Intel(R) Pentium(R) D CPU 3.00GHz) This is my dovecot's conf: auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain login digest-md5 cram-md5 auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = /var/log/dovecot.log default_client_limit = 1000 default_idle_kill = 60 default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins disable_plaintext_auth = no dotlock_use_excl = no doveadm_socket_path = doveadm-server doveadm_worker_count = 0 first_valid_gid = 89 first_valid_uid = 89 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k info_log_path = last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/libexec/dovecot listen = *, :: lmtp_proxy = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = 89 mail_home = mail_location = maildir:/coraid-s2l2/domains mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib64/dovecot mail_plugins = mail_privileged_group = mail_save_crlf = no mail_temp_dir = /tmp mail_uid = 89 mailbox_idle_check_interval = 30 secs mailbox_list_index_disable = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext deny = no driver = sql master = no pass = no } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext deny = no driver = sql master = no pass = no } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_script_size = 1M } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv postmaster_address = protocols = imap pop3 lmtp sieve quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s sendmail_path = /usr/sbin/sendmail service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 4096 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0600 user = } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 0 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 0 } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = port = 4190 ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } unix_listener ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service tcpwrap { chroot = client_limit = 1 drop_priv_before_exec = no executable = tcpwrap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = </etc/nginx/ssl/wildcard.domain.net_bundle.crt ssl_cert_username_field = commonName ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_dh_parameters_length = 1024 ssl_key = </etc/nginx/ssl/wildcard.domain.net.key ssl_key_password = ssl_parameters_file = ssl-parameters.dat ssl_parameters_regenerate = 0 ssl_protocols = !SSLv2 !SSLv3 ssl_verify_client_cert = no syslog_facility = mail userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = verbose_auth = no verbose_proctitle = no verbose_ssl = no version_ignore = no protocol lmtp { mail_plugins = } protocol lda { mail_plugins = } protocol imap { imap_id_log = * } Thank you!

2 2

Migrating maildirs - Courier to Dovecot
by Stroller 22 Sep '17

22 Sep '17

I apologise, because I'm sure this subject has been done to death, but I want to migrate from Courier to Dovecot. I think my main question is whether there's any reason I shouldn't just rsync the maildirs across from the old mail server to the new one? There aren't many clients using this server, so I don't care if clients have to redownload all their messages (in fact, I expect they'll probably end up doing so anyway). I'd like to preserve read/unread status of each message, but can't think of anything else important. It doesn't matter if there's a few hours of downtime, but I thought to use rsync because I figured I copy the maildirs a day or two ahead of time, and then a sync immediately before going live will be quicker. Using imapsync [1] looks pretty good, and I'm happy to use that if it'll be "cleaner" or help Dovecot to create its hierarchy more neatly. It looks like Courier creates a courierimapuiddb, courierimapkeywords and courierimapacl in each folder - can I not just delete these, and hand Dovecot a bunch of maildir directories and files to reindex for itself? There are probably only a few hundred thousand messages on the server, a few GB worth, although some of them are many years old. Some of the messages on the old server have the wrong "received" date on them, having the wrong file creation / modification date on the server's filesystem, having been copied there previously (years ago) without using cp's --archive flag. I've always thought I should one day write a script to fix this, perhaps using mboxgrep. Thanks in advance for any of your thoughts, Stroller. [1] https://wiki2.dovecot.org/Migration#IMAP_.3C-.3E_IMAP_copying

4 4

Fwd: Bug#876364: dovecot-sieve: Just discovered imap_sieve/sieve_imapsieve is not set up to work with virtual mailboxes.
by Thurgood Angelou 22 Sep '17

22 Sep '17

Hi... The output of my doveconf -n is as folllows. # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) doveconf: Warning: /etc/dovecot/dovecot.conf line 105: Global setting mail_plugins won't change the setting inside an earlier filter at /etc/dovecot/conf.d/15-lda.conf line 47 (if this is intentional, avoid this warning by moving the global setting before /etc/dovecot/conf.d/15-lda.conf line 47) doveconf: Warning: /etc/dovecot/dovecot.conf line 105: Global setting mail_plugins won't change the setting inside an earlier filter at /etc/dovecot/conf.d/15-lda.conf line 47 (if this is intentional, avoid this warning by moving the global setting before /etc/dovecot/conf.d/15-lda.conf line 47) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 ext4 auth_default_realm = othersider92.com auth_mechanisms = plain login first_valid_uid = 100 log_path = /var/log/dovecot.log mail_location = maildir:/var/mail/%d/%n mail_plugins = " virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create autoexpunge = 1 weeks special_use = \Junk } mailbox Promotions { auto = subscribe } mailbox Sent { auto = create special_use = \Sent } mailbox Trash { auto = create autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } namespace virtual { disabled = yes hidden = yes list = no location = virtual:/var/mail/virtual prefix = virtual/ separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/etc/sieve/report-spam-promo.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Promotions imapsieve_mailbox4_before = file:/etc/sieve/report-ham-promo.sieve imapsieve_mailbox4_causes = COPY imapsieve_mailbox4_from = Promotions imapsieve_mailbox4_name = * sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/sieve/conf.d/after sieve_before = /etc/sieve/conf.d/before sieve_global_extensions = +editheader +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/local/bin sieve_plugins = sieve_extprograms sieve_imapsieve } protocols = imap lmtp service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/ssl/mail/ssl.cert ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail home=/var/mail/%d/%n driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = " virtual" } protocol lda { mail_plugins = " sieve virtual" } protocol imap { mail_plugins = " virtual imap_sieve" } I hope this helps. On Thu, Sep 21, 2017 at 4:47 AM, Apollon Oikonomopoulos <apoikos(a)debian.org> wrote: > Control: tags -1 + moreinfo upstream > > [Forwarding this to the Dovecot mailing list, just in case someone can > help] > > Hi, > > Thanks for the report! See my comments inline. > > On 11:56 Thu 21 Sep , Thurgood Angelou wrote: > > Package: dovecot-core > > Version: 1:2.2.32-2 > > > > I've just discovered a bug where the sieve plugin (especially IMAP) > > will not work with a virtual mailbox. I recently found this out when > > testing a virtual mailbox setup and I use imap_sieve for SPAM > > filtering so to lose that would be painful. > > > > This is what is reported in dovecot's debug log... > > > > Sep 21 10:53:01 imap(personal(a)othersider92.com): Panic: file > mail-index-map.c: line 549 (mail_index_map_lookup_seq_range): assertion > failed: (first_uid > 0) > > Sep 21 10:53:01 imap(personal(a)othersider92.com): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f4226fd50a2] -> > /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f4226fd519a] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4226f65cf8] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map_lookup_seq_range+0x120) > [0x7f422733dae0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xe8d1d) > [0x7f422734cd1d] -> /usr/lib/dovecot/libdovecot-st > orage.so.0(mail_index_lookup_seq+0xf) [0x7f4227350e9f] -> > /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x82aa) > [0x7f422678a2aa] -> /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so(+0x708c) > [0x7f422657d08c] -> /usr/lib/dovecot/libdovecot-st > orage.so.0(mailbox_transaction_commit_get_changes+0x52) [0x7f42272adca2] > -> dovecot/imap(+0x10084) [0x556502adb084] -> dovecot/imap(command_exec+0x5c) > [0x556502ae7d9c] -> dovecot/imap(+0x1b322) [0x556502ae6322] -> > dovecot/imap(+0x1b3bc) [0x556502ae63bc] -> dovecot/imap(client_handle_inp > ut > > +0x18d) [0x556502ae677d] -> dovecot/imap(client_input+0xac) > [0x556502ae6ccc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) > [0x7f4226fea742] -> /usr/lib/dovecot/libdovecot.so > .0(io_loop_handler_run_internal+0x12e) [0x7f4226febd8e] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) > [0x7f4226fea7d6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) > [0x7f4226fea988] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f4226f70353] -> dovecot/imap(main+0x329) [0x556502ad9139] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f4226bb92e1] > -> dovecot/imap(_start+0x2a) [0x556502ad92ca] > > After mixing in the debug symbols, this backtrace becomes: > > /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f4226fd50a2] > default_fatal_finish at ./src/lib/failures.c:195 > /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f4226fd519a] > ?? at ./src/lib/failures.c:670 > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4226f65cf8] > i_fatal at ./src/lib/failures.c:280 > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map_lookup_seq_range+0x120) > [0x7f422733dae0] > mail_index_map_lookup_seq_range at ./src/lib-index/mail-index-map > .c:550 > /usr/lib/dovecot/libdovecot-storage.so.0(+0xe8d1d) [0x7f422734cd1d] > tview_lookup_seq_range at ./src/lib-index/mail-index-tra > nsaction-view.c:178 > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq+0xf) > [0x7f4227350e9f] > mail_index_lookup_seq at ./src/lib-index/mail-index-view.c:522 > /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x82aa) [0x7f422678a2aa] > virtual_mail_set_uid at ./src/plugins/virtual/virtual-mail.c:213 > /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so(+0x708c) > [0x7f422657d08c] > imap_sieve_mailbox_transaction_run at ./pigeonhole/src/plugins/imapsieve/imap-sieve-storage.c:752 > (inlined by: imap_sieve_mailbox_transaction_commit at > ./pigeonhole/src/plugins/imapsieve/imap-sieve-storage.c:807) > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) > [0x7f42272adca2] > mailbox_transaction_commit_get_changes at > ./src/lib-storage/mail-storage.c:2083 > dovecot/imap(+0x10084) [0x556502adb084] > cmd_copy_full at ./src/imap/cmd-copy.c:146 > dovecot/imap(command_exec+0x5c) [0x556502ae7d9c] > command_exec at ./src/imap/imap-commands.c:200 > dovecot/imap(+0x1b322) [0x556502ae6322] > client_command_input at ./src/imap/imap-client.c:1088 > dovecot/imap(+0x1b3bc) [0x556502ae63bc] > client_command_input at ./src/imap/imap-client.c:1150 > dovecot/imap(client_handle_input+0x18d) [0x556502ae677d] > client_handle_input at ./src/imap/imap-client.c:1203 > dovecot/imap(client_input+0xac) [0x556502ae6ccc] > client_input at ./src/imap/imap-client.c:1249 > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f4226fea742] > io_loop_call_io at ./src/lib/ioloop.c:600 > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) > [0x7f4226febd8e] > io_loop_handler_run_internal at ./src/lib/ioloop-epoll.c:223 > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) > [0x7f4226fea7d6] > io_loop_handler_run at ./src/lib/ioloop.c:648 > /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f4226fea988] > io_loop_run at ./src/lib/ioloop.c:622 > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f4226f70353] > master_service_run at ./src/lib-master/master-service.c:667 > dovecot/imap(main+0x329) [0x556502ad9139] > main at ./src/imap/main.c:491 > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f4226bb92e1] > __libc_start_main at ../csu/libc-start.c:325 > dovecot/imap(_start+0x2a) [0x556502ad92ca] > start at ??:0 > > > -- System Information: > > Debian Release: 8.2 > > APT prefers oldstable-updates > > APT policy: (500, 'oldstable-updates'), (500, 'unstable'), (500, > 'testing'), (500, 'oldstable') > > Architecture: amd64 (x86_64) > > > > Kernel: Linux 3.16.0-4-amd64 (SMP w/2 CPU cores) > > Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8), > LANGUAGE=en_GB:en (charmap=UTF-8) > > Shell: /bin/sh linked to /bin/dash > > Init: systemd (via /run/systemd/system) > > > > Versions of packages dovecot-sieve depends on: > > ii dovecot-core 1:2.2.32-2 > > ii libc6 2.24-17 > > ii ucf 3.0030 > > > > dovecot-sieve recommends no packages. > > > > dovecot-sieve suggests no packages. > > > > Versions of packages dovecot-sieve is related to: > > ii dovecot-core [dovecot-common] 1:2.2.32-2 > > pn dovecot-dbg <none> > > pn dovecot-dev <none> > > ii dovecot-gssapi 1:2.2.32-2 > > ii dovecot-imapd 1:2.2.32-2 > > ii dovecot-ldap 1:2.2.32-2 > > ii dovecot-lmtpd 1:2.2.32-2 > > ii dovecot-managesieved 1:2.2.32-2 > > ii dovecot-mysql 1:2.2.32-2 > > pn dovecot-pgsql <none> > > pn dovecot-pop3d <none> > > ii dovecot-sieve 1:2.2.32-2 > > pn dovecot-sqlite <none> > > Could you also include the output of doveconf -n? > > Regards, > Apollon >

1 0

Re: JMAP support in Dovecot
by Aki Tuomi 21 Sep '17

21 Sep '17

answer is not yet. we are going to implement it when we get free resources to do it. ---Aki TuomiDovecot oy -------- Original message --------From: Steinar Bang <sb(a)dod.no> Date: 21/09/2017 17:28 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Re: JMAP support in Dovecot >>>>> Aki Tuomi <aki.tuomi(a)dovecot.fi>: > We are working on including JMAP support to Dovecot. At this moment I > cannot give any promise for exact version, but hopefully it will be > part of v2.3 Any updates on jmap support in dovecot? I tried searching the git repo for "jmap" yesterday, so I'm guessing the answer is "no" or "not yet"...?

1 0

Dovecot 2.1.17 and Solr 6.6.1
by Siarhei Chystsiakou 21 Sep '17

21 Sep '17

Hello. I'm trying to set fts plugin for working with Apache Solr 6.6.1, but after the setting I get the following error .... o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Bad contentType for search handler :text/xml request={q=from:"test"&fl=uid,score&sort=uid+asc&fq=%2Bbox:a8012d2edac165591d3c000043730d65+%2Buser:" user(a)example.com"&rows=5543} I've set everything according to the guide on the site as well as taking into consideration such conversation in maillist in February 2017 ( https://dovecot.org/list/dovecot/2017-February/107255.html) The current dovecot configuration:... #cat /etc/dovecot/conf.d/90-fts.conf plugin { fts = solr fts_solr = debug break-imap-search url= http://127.0.0.1:8983/solr/dovecot/ } full config the dovecot: https://hastebin.com/awuwohanoz.makefile I also enclose the screen from wireshark https://itmag.es/6mWng Thanks!

2 5

Inexplicable missing permissions issue
by Nelson Crosby 21 Sep '17

21 Sep '17

Greetings all. I've been having great difficulty getting Dovecot working. I'm getting stuck with using mbox directories outside of /home. Dovecot keeps giving me this message: imap(ncrosby): Namespace '': stat(/var/logmail/mbox/ncrosby) failed: Permis sion denied (euid=1001(ncrosby) egid=1001(ncrosby) missing +w perm: /var/lo gmail/mbox/ncrosby stat(/var/logmail/mbox/ncrosby) failed: Permission denie d, dir owned by 0:0 mode=0755) in=0 out=340 I've tried letting Dovecot create this directory, I've tried creating this directory manually and giving it any permission I can think of, I've tried playing about with the permissions throughout the entire /var/logmail tree, but to no avail. Below is my setup. I appreciate any input. Here's `tree -apug /var/logmail`: /var/logmail ├── [drwx------ root root ] lost+found ├── [drwxr-xr-x root root ] mbox └── [drwxrwxr-x root mail ] spool ├── [-rw-rw---- fedora mail ] fedora └── [-rw-rw---- ncrosby mail ] ncrosby 3 directories, 2 files And permissions for `/var/logmail` itself: drwxr-xr-x. 5 root root 4096 Sep 19 01:52 . And now `doveconf -n`: # 2.2.31 (65cde28): /etc/dovecot/dovecot.conf # OS: Linux 4.11.8-300.fc26.x86_64 x86_64 Fedora release 26 (Twenty Six) ext4 disable_plaintext_auth = no mail_location = mbox:/var/logmail/mbox/%n:INBOX=/var/logmail/spool/%n mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = dovecot driver = pam } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd } -- // Nelson Crosby /* nc(a)sourcecomb.com */

3 3

sieve stopped working and doveadm mailbox list without -s shows less folders then with
by Ralf Becker 20 Sep '17

20 Sep '17

Dovecot 2.2.31 with mailboxes in mdbox format. Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows: sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz(a)somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser. When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX I already tried doveadm force-resync -u <user>@<domain> INBOX, but it did not change anything. I also moved the mailbox in filesystem to an other name and tried to restore it from there, which helped with most broken mailbox problems in the pre 2.2.31 aftermath, but that failed completly: /var/dovecot/imap/<domain> # mv <user> <user>.broken /var/dovecot/imap/<domain> # doveadm force-resync -u <user>@<domain> INBOX /var/dovecot/imap/<domain> # sudo -u dovecot doveadm -Dv import -u <user>@<domain> -s mdbox:$(pwd)/<user>.broken/mdbox INBOX all Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/master_user=<user>@<domain> doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/userdb_acl_groups=admins@<domain>,hts büro@<domain>,hts@<domain> doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=10485760000 doveadm(<user>@<domain>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<user>@<domain>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<user>@<domain>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<user>@<domain>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<user>@<domain>): Debug: dict quota: user=<user>@<domain>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<user>@<domain>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<user>@<domain>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/master_user=<user>@<domain> doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/userdb_acl_groups=admins@<domain>,hts büro@<domain>,hts@<domain> doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=10485760000 doveadm(<user>@<domain>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<user>@<domain>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<user>@<domain>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<user>@<domain>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<user>@<domain>): Debug: dict quota: user=<user>@<domain>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>.broken/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Error: quota: Unknown namespace: INBOX/ doveadm(<user>@<domain>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>.broken/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>.broken/mdbox/mailboxes/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl: Mailbox not in dovecot-acl-list: MailboxA doveadm(<user>@<domain>): Debug: acl: Mailbox not in dovecot-acl-list: MailboxB <skiped many more mailboxes/> doveadm(<user>@<domain>): Debug: INBOX: Mailbox opened because: import doveadm(<user>@<domain>): Debug: Namespace : Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<user>@<domain>): Debug: replication: Replication requested by 'mailbox subscribe', priority=1 doveadm(<user>@<domain>): Debug: INBOX/INBOX: Mailbox opened because: import doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/dovecot-acl not found doveadm(<user>@<domain>): Error: Opening INBOX failed: Mailbox doesn't exist: INBOX/INBOX doveadm(<user>@<domain>): Error: Syncing mailbox INBOX/INBOX failed: Opening INBOX failed: Mailbox doesn't exist: INBOX/INBOX Any ideas what the problem could be and how to fix it? Or what other information I can supply to help diagnose the problem. Ralf -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

3 15

Re: Inexplicable missing permissions issue
by Nelson Crosby 20 Sep '17

20 Sep '17

Thanks for taking a look. > this is owned by root, and it's complaining about > /var/logmail/**mbox**/ncrosby > and dovecot cannot create this because mbox is only writable by root That's definitely not the issue. As I explained, I've played with permissions through the entire /var/logmail tree (including the /var/logmail/mbox directory). Another configuration in which the exact same message occurs (including the exact same statement about being owned by 0:0): /var/logmail |-- [drwx------ root root ] lost+found |-- [drwxrwxr-x root mail ] mbox | `-- [drwxr-xr-x ncrosby ncrosby ] ncrosby `-- [drwxrwxr-x root mail ] spool |-- [-rw-rw---- fedora mail ] fedora `-- [-rw-rw---- ncrosby mail ] ncrosby 4 directories, 2 files Your time is appreciated; // Nelson -- // Nelson Crosby /* nelsonc(a)sourcecomb.com */

1 0

lazy_expunge doesn't work since upgrade 2.2.30 to 2.2.32
by Harald Leithner 19 Sep '17

19 Sep '17

Hi, it seams that the lazy_expunge plugin doesn't work for me after the upgrade... 2.2.32 cry's about plugin { lazy_expunge_only_last_instance=no } is most likely handled as 'yes' - remove the setting completely to disable it. If this is intentional, add quotes around the value: lazy_expunge_only_last_instance="no" I changed it to lazy_expunge_only_last_instance="no" and tried to remove it but doesn't change the problem. dovecot -n # 2.2.devel (5af0c9f): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (6c95b56) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.9 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore1(a)itronic.at imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins imap_logout_format = bytes=%i/%o instance_name = mailstore1 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = x.y.z.0/24 mail_attachment_dir = /srv/storage1/vmail_sis mail_attachment_hash = %{sha512} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 5 mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib lazy_expunge stats acl quota mail_log notify mail_prefetch_count = 100 mail_server_admin = mailto:postmaster@itronic.at mail_server_comment = ITronic Mail System mail_shared_explicit_inbox = yes mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = last-login/%u lazy_expunge = "#EXPUNGED/" mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid size flags vsize from subject quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+1024M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +vacation-seconds sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M sieve_vacation_default_period = 1d sieve_vacation_min_period = 1h stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = x.y.z.b port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = </etc/dovecot/private/STAR.itronic.at.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 submission_host = x.y.z.a syslog_facility = local0 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = /srv/storage1/vmail verbose_proctitle = yes protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib lazy_expunge stats imap_stats quota imap_quota acl imap_acl last_login mail_log notify } protocol lda { mail_plugins = zlib lazy_expunge stats acl sieve quota mail_log notify } protocol lmtp { mail_plugins = zlib lazy_expunge stats acl sieve quota mail_log notify } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib lazy_expunge stats acl last_login mail_log notify } regards -- Harald Leithner ITronic Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner(a)itronic.at | itronic.at

4 7

dsync panic in mbox_lock
by manu＠netbsd.org 18 Sep '17

18 Sep '17

Hello I am trying to setup replication with dovecot-2.2.29.1, and for some users, I get a reproductible panic: # doveadm -v -o plugin/mail_replica=remoteprefix:root@mail2.example.net sync -d -u jdoe dsync-local(jdoe): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Abort User is not overquota, and filesystem permissions are correct. kernel trace shows it happens just after a stat() on INBOX/dovecot.ind ex.log. Here is doveadm backtrace: #0 0x00007f7ff650e6fa in _lwp_kill () from /lib/libc.so.12 #1 0x00007f7ff650e385 in abort () from /lib/libc.so.12 #2 0x00007f7ff6c91acc in default_fatal_finish () from /usr/pkg/lib/dovecot/libdovecot.so.0 #3 0x00007f7ff6c91b4a in default_fatal_handler () from /usr/pkg/lib/dovecot/libdovecot.so.0 #4 0x00007f7ff6cbcb9b in i_panic () from /usr/pkg/lib/dovecot/libdovecot.so.0 #5 0x00007f7ff7076721 in mbox_lock () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #6 0x00007f7ff7077da7 in mbox_save_begin () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #7 0x00007f7ff580c3f8 in quota_save_begin () from /usr/pkg/lib/dovecot/lib10_quota_plugin.so #8 0x00007f7ff7047f63 in mailbox_save_begin () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #9 0x00007f7ff703d983 in mail_storage_copy () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #10 0x00007f7ff5401f10 in notify_copy () from /usr/pkg/lib/dovecot/lib15_notify_plugin.so #11 0x00007f7ff580c259 in quota_copy () from /usr/pkg/lib/dovecot/lib10_quota_plugin.so #12 0x00007f7ff70480f8 in mailbox_copy_int () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #13 0x00007f7ff70482a5 in mailbox_move () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #14 0x000000000043a118 in ?? () #15 0x000000000043b465 in ?? () #16 0x000000000043db03 in dsync_mailbox_import_changes_finish () #17 0x000000000043906c in dsync_brain_sync_mails () #18 0x0000000000434e4d in dsync_brain_run () #19 0x000000000043514b in ?? () #20 0x0000000000447ca9 in ?? () #21 0x00007f7ff6ca3e65 in io_loop_call_io () from /usr/pkg/lib/dovecot/libdovecot.so.0 #22 0x00007f7ff6ca5179 in io_loop_handler_run_internal () from /usr/pkg/lib/dovecot/libdovecot.so.0 #23 0x00007f7ff6ca3efa in io_loop_handler_run () from /usr/pkg/lib/dovecot/libdovecot.so.0 #24 0x00007f7ff6ca4099 in io_loop_run () from /usr/pkg/lib/dovecot/libdovecot.so.0 #25 0x00000000004205b2 in ?? () #26 0x0000000000422754 in ?? () #27 0x0000000000423074 in ?? () #28 0x00000000004238d1 in doveadm_mail_try_run () #29 0x000000000045182a in main () Any hint? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu(a)netbsd.org

2 3

hidden shared/public Trash and Junk folders
by Rupert Gallagher 17 Sep '17

17 Sep '17

We need ideas on how to do this reliably and efficiently for a specific client with unfaithful employees. --- We could do this using client-side configuration tied to windows GPO, but prefer a server-side solution. Sent from ProtonMail Mobile

1 1

logins fail for virtual users (permission denied, we're not in group 5000)
by Paul Schreiber 17 Sep '17

17 Sep '17

I have: - Ubuntu 17.04 - Dovecot 2.2.27 (c0f36b0) - Postfix 3.1.4 - regular unix users with mail in /home/bob/Maildir - virtual users with mail in /var/mail/vhosts/domain.com/bob/ The regular users can receive mail as expected. When virtual users try to log in, it fails. The log shows an error like this: 2017-09-14 22:44:55 auth: Error: passwd-file(travler(a)travler.net,54.210.254.169,<EYwzYDFZWoY20v6p>): stat(/var/mail/vhosts/travler.net/shadow) failed: Permission denied (euid=114(dovecot) egid=121(dovecot) missing +x perm: /var/mail/vhosts, we're not in group 5000(vmail), dir owned by 5000:5000 mode=0750) A previous user had a similar problem in 2015: https://dovecot.org/list/dovecot/2015-July/101469.html He was advised to look at https://wiki2.dovecot.org/UserIds … without being given more specific advice. I looked at the page. I tried adding mail_uid and mail_gid. No luck. In my case, I see: # sudo -u dovecot groups dovecot vmail # sudo -u dovecot cat /var/mail/vhosts/travler.net/shadow <file contents> I have a vmail user: # id vmail uid=5000(vmail) gid=5000(vmail) groups=5000(vmail) # ls -la /var/mail/vhosts total 0 drwxr-s--- 1 vmail vmail 246 Jun 30 11:23 . drwxrwsrwt 1 mail mail 26 Dec 5 2016 .. drwxr-s--- 1 vmail vmail 66 Sep 14 23:11 travler.net # ls -l /var/mail/vhosts/travler.net/ total 8 -rwxr-s--- 1 vmail vmail 174 Dec 5 2016 passwd -rwxr-s--- 1 vmail vmail 173 Dec 5 2016 shadow drwxr-s--- 1 vmail vmail 450 Sep 9 13:16 travis.belmont drwxr-s--- 1 vmail vmail 750 Sep 13 14:14 travler I've set mail_gid and mail_uid # doveconf -n|grep id mail_gid = 5000 mail_uid = 5000 Here's my full config: # doveconf -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.10.0-33-generic x86_64 Ubuntu 17.04 btrfs log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = 5000 mail_location = maildir:/home/%u/Maildir mail_privileged_group = mail mail_uid = 5000 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = username_format=%n /var/mail/vhosts/%d/shadow driver = passwd-file } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imap { port = 0 } } ssl_cert = [snip] ssl_cipher_list = [snip] ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !SSLv2 userdb { driver = passwd } userdb { args = username_format=%n /var/mail/vhosts/%d/passwd driver = passwd-file } What do I need to set to get dovecot to run as vmail / fix this error? Paul

2 4

What INTERNALDATE does dovecot with mbox storage set on a COPY'd message?
by Steinar Bang 15 Sep '17

15 Sep '17

When a message is copied to a folder on dovecot with mbox storage, is the mtime of the saved mbox file set to the time of the save? Or is the mtime set to the Date: field of the source message that is saved? If there is a difference in the behaviour, do someone know the dovecot version number where the change happened? The reason I'm asking is a problem reported on the Gnus imap client in August 2016, where messaged moved by Gnus showed up with the wrong order and/or wrong date in other imap clients. (The reason for the different message ordering was that the other clients use the INTERNALDATE and that was changed to the time of message move when Gnus was used. Gnus use the Date of the source message) Thanks! - Steinar (Gnus user)

2 4

[RFC master-2.2 0/1] Support OpenSSL 1.1 API for setting allowed TLS versions
by Apollon Oikonomopoulos 14 Sep '17

14 Sep '17

Hi, I came up with the following patch while trying to figure out a good solution for the situation described in Debian bug #871987[1]. In short, OpenSSL in Debian unstable has disabled TLSv1.0 and TLSv1.1 *by default*. That means that unless an application requests otherwise, only TLSv1.2 is supported. In the world of e-mail this is seemingly an issue, as there are still way too many old clients out there supporting only TLSv1 or TLSv1.1. Now, traditionally OpenSSL 0.9.8/1.0 used SSL_CTX_set_options() to allow *disabling* specific protocols, without offering a way to enable previously disabled protocols. OpenSSL 1.1 introduced a dedicated API[2] to set allowed protocol versions, taking a linear version approach: the application may request a minimum and a maximum allowed version (inclusive), allowing all versions inbetween as well. Dovecot's existing ssl_protocols option is probably not ideal to use with this new "linear" model. Instead, I introduced two new options, ssl_min_proto_version and ssl_max_proto_version, that map directly to OpenSSL 1.1 concepts. I have tested the patch with both OpenSSL 1.0 and OpenSSL 1.1. With OpenSSL 1.1 it works as expected; with OpenSSL 1.0 it doesn't seem to break anything. Other than that, this is a first version; I'm sure there are still things to improve, so comments are welcome :) Regards, Apollon [1] https://bugs.debian.org/871987 [2] https://www.openssl.org/docs/man1.1.0/ssl/SSL_CTX_set_min_proto_version.html Apollon Oikonomopoulos (1): Support setting min/max SSL protocol version doc/example-config/conf.d/10-ssl.conf | 4 ++++ src/config/config-parser.c | 25 +++++++++++++++++++++ src/lib-master/master-service-ssl-settings.c | 4 ++++ src/lib-master/master-service-ssl-settings.h | 2 ++ src/lib-master/master-service-ssl.c | 2 ++ src/lib-ssl-iostream/iostream-openssl-common.c | 12 +++++++++++ src/lib-ssl-iostream/iostream-openssl.h | 1 + src/lib-ssl-iostream/iostream-ssl.h | 2 ++ src/login-common/ssl-proxy-openssl.c | 30 ++++++++++++++++++++++++++ 9 files changed, 82 insertions(+) -- 2.14.1

2 2

disable imap for ldap user
by Markus Rosjat 13 Sep '17

13 Sep '17

hi there, I have a LDAP dir with an attribute set to 0 or 1 and in my old setup (a courier server) I used this attribute to map it to an authoption called disableimap. This prevent users to access the mailbox with imap protocol. So the question is what should I set in dovecot to get the same behaviour? I looked at the docs but the part with the pass_ilter and service doesn't really fit. Some advice would be appreciated regards -- Markus Rosjat fon: +49 351 8107223 mail: rosjat(a)ghweb.de G+H Webservice GbR Gorzolla, Herrmann Königsbrücker Str. 70, 01099 Dresden http://www.ghweb.de fon: +49 351 8107220 fax: +49 351 8107227 Bitte prüfen Sie, ob diese Mail wirklich ausgedruckt werden muss! Before you print it, think about your responsibility and commitment to the ENVIRONMENT

3 4