- dovecot - dovecot.org

Re: Solr/Basic Auth?
by Aki Tuomi 14 Oct '17

14 Oct '17

You can include it in the url, like http://user:pass@host/---Aki TuomiDovecot oy -------- Original message --------From: Larry Rosenman <larryrtx(a)gmail.com> Date: 13/10/2017 23:32 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Solr/Basic Auth? Does the fts-solr plugin support solr's basic auth plugin? If not, can it? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Solr/Basic Auth?
by Larry Rosenman 13 Oct '17

13 Oct '17

Does the fts-solr plugin support solr's basic auth plugin? If not, can it? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Re: Convert from mbox to Maildir
by Joseph Tam 13 Oct '17

13 Oct '17

Nikolai Lusan <nikolai(a)lusan.id.au> writes: >> Just went through this one recently using CentOS with SendMail, Procmail >> and IMAP conversion from mbox to Maildir - I needed to make sure I could >> run both formats while I migrated users one-by-one. > > When I have migrated solutions from mbox to maildir (I have done more than > one) I found it easier to get a mail client to do the hard work for me (if > you're on a LAN with the server it's faster). I created new usernames with > maildir as their base, and copied the folder over. Reading over David's and various schemes, the tricky part is consistency: avoiding race conditions where you have the user manipulating their mailboxes and your MTA/LDA delivering mail, while simultaneously doing mbox->Maildir conversion. To guarantee consistency, it's necessary to lock out other avenues of mbox changes while the conversion takes place. Otherwise, you'll have the situation where mail can get duplicated, or worse, deleted. For example, think of this sequence: convert B, user moves message A->B, convert A. I think the safest is method is 1) Deny the user access to IMAP/POP: deny userdb/passdb, or lock their password and flush their auth cache entry. 2) TEMPFAIL MTA delivery to user during conversion 3) Kick the user 4) Do the conversion 5) Undo 1+2 If you have a smart conversion script (one that recognizes changes and only do delta updates) you can greatly speed up step 4 and minimize outage time. 0) Do an initial conversion that will do the bulk of the work but does not guranatee consistency. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: v2.2.33 released
by Aki Tuomi 13 Oct '17

13 Oct '17

try with 2.2.33.1 ---Aki TuomiDovecot oy -------- Original message --------From: Odhiambo Washington <odhiambo(a)gmail.com> Date: 13/10/2017 10:42 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Cc: dovecot-news(a)dovecot.org Subject: Re: v2.2.33 released On 10 October 2017 at 18:28, Timo Sirainen <tss(a)iki.fi> wrote: > https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz > https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz.sig > > We're getting close to the last v2.2.x releases. Hopefully we'll have the > first v2.3 beta releases out soon. > Something is wrong with 2.2.33, but I haven't found time to catch it. I have been running 2.2.32 without issues. I use dovecot-lda with Exim. The moment I installed 2.2.33, it was all failures - mail somehow gets delivered, but a failure too is generated. I have backed off from 2.2.33 for now. Maybe I will find time to debug later. Maybe someone already found a way around, but I missed the post? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 3

v2.2.33 released
by Timo Sirainen 13 Oct '17

13 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz.sig We're getting close to the last v2.2.x releases. Hopefully we'll have the first v2.3 beta releases out soon. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. + auth: Added %{ldap_dn} variable for passdb/userdb ldap - acl: The "create" (k) permission in global acl-file was sometimes ignored, allowing users to create mailboxes when they shouldn't have. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails. - pop3: rawlog_dir setting didn't work

2 1

Released Pigeonhole v0.4.21 for Dovecot v2.2.33.1.
by Stephan Bosch 13 Oct '17

13 Oct '17

Hello Dovecot users, Here's the definitive 0.4.21 release. There were no changes since the release candidate. Changelog v0.4.21: * redirect action: Always set the X-Sieve-Redirected-From header to sieve_user_email if configured. Before, it would use the envelope recipient instead if available, which makes no sense if the primary e-mail address is available. + vacation extension: Allow ignoring the envelope sender while composing the "To:" header for the reply. Normally, the "To:" header is composed from the address found in the "Sender", "Resent-From" or "From" headers that is equal to the envelope sender. If none is then found, the bare envelope sender is used. This change adds a new setting "sieve_vacation_to_header_ignore_envelope". With this setting enabled, the "To:" header is always composed from those headers in the source message. The new setting thus allows ignoring the envelope, which is useful e.g. when SRS is used. + vacation extension: Compose the "To:" header from the full sender address found in the first "Sender:", "From:" or "Resent-From:" header. Before, it would create a "To:" header without a phrase part. The new behavior is nicer, since the reply will be addressed to the sender by name if possible. - LDA Sieve plugin: Fixed sequential execution of LDAP-based scripts. A missing LDAP-based script could cause the script sequence to exit earlier. - sieve-filter: Removed the (now) duplicate utf8 to mutf7 mailbox name conversion. This caused problems with mailbox names containing UTF-8 characters. The Dovecot API was changed years ago, but apparently sieve-filter was never updated. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.21.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.21.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Solr 7
by Ricardo Branco 12 Oct '17

12 Oct '17

Before I go down the route of upgrading our main Solr instance from 6 to 7, just checking if anyone is using Solr 7 with Dovecot.

4 4

Re: Mail Alias Stores in mySQL Not working - SOLVED
by jason hirsh 12 Oct '17

12 Oct '17

"You have the alias abuse(a)kasdivi.com <mailto:abuse@kasdivi.com> for the address admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> in your db and all mail to these aliases should go the the admin@ mailbox. Address mapping should be done in postfix so that the recipient address that gets used on the lmtp connection to dovecot is admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> You probably disabled address mapping in postfix. -- Christian Kivalo” You nailed that .. I had completely forgotten about that.. I am changing a system from hash to SQL I actually feel kind of stupid I knew Postfix was supposed to do the acceptance.. and it should have been common sense that it need to rewrite.. The logs kept reminding me I had the following line in master,cf -o receive_override_options=no_address_mappings,no_header_body_checks,no_unknown_recipient_checks changed to -o receive_override_options=no_header_body_checks,no_unknown_recipient_checks and system works great.. Thanls!!

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"So abuse(a)kasdivi.com <mailto:abuse@kasdivi.com> is an alias, not a user.? You can't login with an alias because your user_query is looking at the`mailbox` table. Have your tried logging in as: admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> OR you could put an entry forabuse(a)kasdivi.com <mailto:forabuse@kasdivi.com> in your `mailbox` table. Bill” Bill Excuse me I must have some where mi-stated myself. Yes abuse(a)variousdoamns.com is an alias going back to my admin account The issue was iin my master.cf where I had at some time disabled remapping Fixed that and all is good Thanks for your time and effort.. You helped tremendously and actually had me discover some other issues Jason

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

3 2

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"In an earlier post you said your user_query was: user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=?1' Last post you said: mail is stored at /var/mail/vhosts and: mail_location = maildir:/var/mail/vhosts/%d/%n These don't agree with your user_query.” Probably my mis-statement "Run a MySQL query: SELECT `username`, `domain`, `maildir` FROM `mailbox` LIMIT 5; Let's see the value of maildir” mysql> SELECT `username`, `domain`, `maildir` FROM `mailbox` LIMIT 5; +--------------------------+--------------------+---------------------------+ | username | domain | maildir | +--------------------------+--------------------+---------------------------+ | jason(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/jason/ | | admin(a)gcsbonaire.com | gcsbonaire.com | gcsbonaire.com/admin/ | | admin(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/admin/ | | test(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/test/ | | lin(a)grapestreet.com | grapestreet.com | grapestreet.com/lin/ | +--------------------------+--------------------+---------------------------+ 5 rows in set (0.00 sec) "Also, lets see the output of: ls -l /var/mail/vhosts/*” drwxrwxr-x 4 1003 vmail 512 Jun 25 2016 camantonewfashion.com drwxrwxr-x 4 1003 vmail 512 Sep 6 2016 filmusfamily.com drwxrwxr-x 8 1003 vmail 512 Oct 8 13:44 gcs-bonaire.com drwxrwxr-x 4 1003 vmail 512 Oct 5 07:40 gcsbonaire.com drwxrwxr-x 3 1003 vmail 512 Jun 25 2016 grapestreet.com drwxrwxr-x 5 1003 vmail 512 Jun 25 2016 grapestreetgen.com drwxrwxr-x 5 1003 vmail 512 Jun 25 2016 grapestreetvoice.com drwxrwxr-x 11 1003 vmail 512 Oct 11 13:37 kasdivi.com drwx------ 3 1003 vmail 512 Oct 11 13:25 test.com drwxrwxr-x 7 1003 vmail 512 Oct 11 13:42 theoceanwindow.com It seems that the correct information is stored in the correct place but i get dovecot: auth-worker(21961): sql(abuse(a)kasdivi.com): unknown user Its seems like there is a simple config thing I am not getting right Jason

2 1

v2.2.33.1 released
by Timo Sirainen 12 Oct '17

12 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.1.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.1.tar.gz.sig Oops, one a bit too bad bug was left in the release, so fixing it here. - dovecot-lda was logging to stderr instead of to the log file.

2 1

Connection closed reason
by Miloslav Hůla 12 Oct '17

12 Oct '17

Hi, we have one user using the old Alpine client with IMAP. Time to time (3 times per day or 3 times per week) he get error: "MAIL FOLDER INBOX CLOSED DUE TO ACCESS ERROR" and he complains, that inbox stops to refresh with new emails. I don't know Alpine but I can imagine, that Alpine creates TCP connection to IMAPS and uses IDLE. I read wiki page about Timeouts [1] and it seems OK. Alpine is connected 5 or more hours without interrupt. But I found 'Connection closed' at approximate times of user reports in mail.log. Am'I undestand it correctly, that 'Connection closed' is some kind of incorrect connection end? I can find 'Logged out' messages which seems to me as correct ones. I can imagine that such situations may happend for moving clients, such a smartphone with losing signal. But mentioned user is on local network connected by cable. I'm interested, what exactly 'Connection closed' in mail log means. We have following lines in log: dovecot: imap(username): Connection closed in=63 out=288442 dovecot: imap(username): Connection closed (IDLE running for 0.001 + waiting input for 0.001 secs, 2 B in + 10+0 B out, state=wait-input) in=9668 out=17375 imap(username): Connection closed: read(size=3751) failed: Connection reset by peer in=4441 out=51431 dovecot: imap(username): Connection closed (UID fetch running for 0.008 + waiting input for 0.001 secs, 0.001 in locks, 101 B in + 202+202 B out, state=wait-input) in=3330 out=436043 Could it be problem in our network or Dovecot configuration issue? Can I somehow debug all connections for single client? Thank you, Milo [1] https://wiki.dovecot.org/Timeouts

2 2

Re: Connection closed reason
by Joseph Tam 12 Oct '17

12 Oct '17

Miloslav H?la <miloslav.hula(a)gmail.com> > we have one user using the old Alpine client with IMAP. Time to time (3 > times per day or 3 times per week) he get error: "MAIL FOLDER INBOX > CLOSED DUE TO ACCESS ERROR" and he complains, that inbox stops to > refresh with new emails. Hmm, I see when using direct file access, but not when using IMAP, but I don't often connect this way with alpine). > Am'I undestand it correctly, that 'Connection closed' is some kind of > incorrect connection end? I can find 'Logged out' messages which seems > to me as correct ones. > ... > dovecot: imap(username): Connection closed in=63 out=288442 > dovecot: imap(username): Connection closed (IDLE running for 0.001 + > waiting input for 0.001 secs, 2 B in + 10+0 B out, state=wait-input) > in=9668 out=17375 I was able to simulate this using netcat -- this log message comes when the client closes the connection during IDLE. > imap(username): Connection closed: read(size=3751) failed: Connection > reset by peer in=4441 out=51431 I couldn't recreate this, but this happens when the client sends an immediate TCP RST connection teardown packet, rather than the usual FIN/ACK/RST orderly shutdown. I don't know what would cause this -- maybe some firewall state session timeout? Joseph Tam <jtam.home(a)gmail.com>

2 1

How to map email addresses to usernames?
by Andreas Born 12 Oct '17

12 Oct '17

Hello, I have a general question about userdb and passdb lookups, in my case related to driver=sql. The documentation and most examples in the internet seem to assume that a user's login username to access a mailbox is identical to his email-address, or at least to the local-part of this email-address. This setup works fine. But I don't understand how to setup dovecot, when login username and email adresses differ. Or to say it in other words, how to map email-adresses to mailbox users. I need a sql password_query for passdb to validate the password for a given login name during SMTP or SASL authentication. Lets say the credentials are "user-1"/"anypassword", then the query is similar to "select password from mailboxes where username='%u'". The next step, user_query for userdb is executed to get storage information for user "user-1". This query must also search for the username "user-1", not for an email-adress: "select home, mail from mailboxes where username='%u'". So far, so good. But: For incoming mails via LMTP, my user_query from userdb is being executed with the email-address as search parameter (instead of the login name), so it fails. I miss a third query that maps one user to each email address for delivery, prior to the userdb lookup. For Example: bob(a)example.org => user-1 eve(a)example.org => user-1 ted(a)example.org => user-2 @catchall.org => user-3 "select username from addr_maps where addr='%n@%d'". What is the correct setup for this szenario? I've found two solutions that seem to work, but i'm not sure if they are really failsafe. I) I use driver=prefetch as a first userdb, so for authentication, only the password_query from passdb is relevant and returns all mailbox details. A second userdb does a user_query lookup against email-addresses and is only called for incoming mails. passdb { driver = sql args = /etc/dovecot/sql-check-user.conf } userdb { driver = prefetch } userdb { driver = sql args = /etc/dovecot/sql-check-addr.conf } II) The second userdb performs lookups against usernames (as in the passwd query), but I place a third userdb {} within the lmtp's protocol section, which does a address lookup instead of a username lookup: protocol lmtp { userdb { driver = sql args = /etc/dovecot/sql-check-addr.conf } } passdb { driver = sql args = /etc/dovecot/sql-check-user.conf } userdb { driver = sql args = /etc/dovecot/sql-check-user.conf } What do you think, is there a better solution? - greetings Andreas Dovecot Version: 2.2.27 (c0f36b0)

2 1

Newbie question...
by Michael Segel 12 Oct '17

12 Oct '17

Hi, I’ve downloaded and built dovecot from the source. Now I’ve run in to a couple of issues. Like namespaces. Is there an example of the namespaces settings? Nothing fancy, just the basics… These are private mailboxes, but still need to know what I have to do to set this correctly. Thanks In Advance, -Mike

2 1

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 12 Oct '17

12 Oct '17

can you provide bt full output from core? ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 12/10/2017 06:22 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi>, dovecot(a)dovecot.org Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) Hi, Just to confirm this is still a major problem for me with the 2.2.33.1 release (did not exist in previous releases). Reuben On 8/10/2017 6:30 AM, Aki Tuomi wrote: Thanks! We'll look into it. --- Aki Tuomi Dovecot oy -------- Original message -------- From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 07/10/2017 13:08 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}}

1 0

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Reuben Farrelly 12 Oct '17

12 Oct '17

Hi, Just to confirm this is still a major problem for me with the 2.2.33.1 release (did not exist in previous releases). Reuben On 8/10/2017 6:30 AM, Aki Tuomi wrote: > Thanks! We'll look into it. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > Date: 07/10/2017 13:08 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) > > This appears to be breaking dsync at the moment and is caused by > something committed in the last week or so. This is with the current > -git of dovecot-2.2 (eaf276b33). > > The crash happens all the time - the logs are full of this message. > > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O > leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file > ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != > NULL) > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw > backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] > -> /usr/lib64/dovecot/li > bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> > /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 > 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) > [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) > [0x7f8bb65815f8] -> /usr/lib64/dovec > ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> > /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] > -> /usr/lib64/dovecot/libssl_iost > ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> > /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) > [0x7f8bb12da52e] -> / > usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] > -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) > [0x7f8bb657e765] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] > -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] > -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) > [0x7f8bb657e93f] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] > -> dovecot/doveadm-server() [0x444a35] -> > /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) > [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> > dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() > [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) > [0x7f8bb656d241] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) > [0x7f8bb656fe58] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) > [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) > [0x7f8bb656d345] > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: > service(doveadm): child 27186 killed with signal 6 (core dumped) > > > thunderstorm reuben # file core > core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, > from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: > 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', > platform: 'x86_64' > > thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core > GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 > Copyright (C) 2017 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-pc-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <https://bugs.gentoo.org/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > For help, type "help". > Type "apropos word" to search for commands related to "word"... > Reading symbols from /usr/libexec/dovecot/doveadm-server...done. > [New LWP 27186] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib64/libthread_db.so.1". > Core was generated by `dovecot/doveadm-server'. > Program terminated with signal SIGABRT, Aborted. > #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 > (gdb) bt full > #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 > No symbol table info available. > #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 > No symbol table info available. > #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, > status=0) at failures.c:201 > backtrace = 0x228e4d8 > "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> > /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... > #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, > format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", > args=0x7ffef81daa70) > at failures.c:670 > status = 0 > #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line > %d (%s): assertion failed: (%s)") at failures.c:275 > ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, > timestamp_usecs = 0} > args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = > 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}}

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"With that query, it appears everyone is sharing the same mail directory.? It, of course, depends on the value of `maildir`.? It doesn't look right.” stored by domain or at least it was until i started messing with mysql "Have you checked your MySQL log file to see the actual query?” hmm found out i had never enabled that log…. another tangent I need to follow "We don't know your mailbox format.? Post your 'doveconf -n’.” My bad # OS: FreeBSD 11.0-RELEASE-p9 amd64 ufs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } pop3_uidl_format = %v.%u postmaster_address = postmaster(a)theoceanwindow.com service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service director { unix_listener director-userdb { mode = 0600 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = </usr/local/etc/keys/certs/ca.crt ssl_cert = </usr/local/etc/keys/certs/domain.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_max_userip_connections = 30 } We don't know what your table layout looks like.? Post your 'SHOW COLUMNS FROM `mailbox`’. +------------+--------------+------+-----+---------------------+-------+ | Field | Type | Null | Key | Default | Extra | +------------+--------------+------+-----+---------------------+-------+ | username | varchar(255) | NO | PRI | NULL | | | password | varchar(255) | NO | | NULL | | | name | varchar(255) | NO | | NULL | | | maildir | varchar(255) | NO | | NULL | | | quota | bigint(20) | NO | | 0 | | | local_part | varchar(255) | NO | | NULL | | | domain | varchar(255) | NO | MUL | NULL | | | created | datetime | NO | | 2000-01-01 00:00:00 | | | modified | datetime | NO | | 2000-01-01 00:00:00 | | | active | tinyint(1) | NO | | 1 | | +------------+--------------+------+-----+---------------------+-------+ What is the on-disk directory layout for mail? mail is stored at /var/mail/vhosts

2 1

Aborted dsync backup and resulting fallout
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I am in the middle of setting up a dovecot imap server to replace an aging cyrus imapd. The new server is using mdbox storage for better filesystem performance and is running dovecot-2.2.32. To migrate email over and keep UIDs etc. intact I used the backup feature of doveadm. During testing this generally worked fine. So thanks for that functionality, it really makes migration much easier. I did another sync yesterday which was unintentionally aborted in the middle which left some corrupted files around. Not a problem generally, that's what doveadm force-resync should fix. It did move a m.2 to m.2.broken mailbox file, so that is good. But it seemed to have issues with the m.3 file, which was an empty file of 0 bytes. Even running force-resync a repeatedly always showed the same message: # doveadm force-resync -u cd INBOX doveadm(cd): Warning: fscking index file /var/spool/imap/user/cd/storage/dovecot.map.index doveadm(cd): Warning: mdbox /var/spool/imap/user/cd/storage: rebuilding indexes doveadm(cd): Error: Corrupted dbox file /var/spool/imap/user/cd/storage/m.3 (around offset=0): EOF while reading file header doveadm(cd): Error: mdbox rebuild: Failed to fix file /var/spool/imap/user/cd/storage/m.3 This looks like incorrect behavior. If the file header on a file expected to be a mailbox header is absent, I would expect it to be either best-effort parsed and the header added or at least be moved out of the way as e.g. m.3.broken. After fixing the m.3 storage manually I encountered another kind of error running dsync again: dsync(cd): Error: lucene index /var/spool/imap/user/cd/lucene-indexes: IndexReader::open() failed (#1): IndexInput read past EOF Lucene index broken should be easily fixed by running doveadm fts rescan. Is that correct? The other error thought had to do with the single instance store for attachments. There were a bunch of errors about a broken pipe and three errors stating success instead: dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/c3/0c/hashes/c30cb535927c8bcecb0d45d374624942d0f4e56e: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/0f/0b/hashes/0f0b5351e09ebb487660f23c9b617568093b93d1: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/10/f9/hashes/10f9a4ffd14a5c31f9938c9d8a3ce3f2095fab36: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/9b/9a/hashes/9b9a449477882dfca86e80157616cadbb21bb3b8: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/df/69/hashes/df698a8bda301a7a474ae2b11414c6f532f4461e: Broken pipe As with the m.3 storage file, all these files had 0 byte size. What is the best way of fixing these up? Delete and be done? Thanks, Andreas

1 0

FTS Dealing badly with Tika failures
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I've seen that latest Dovecot has the ability to use the Apache Tika Server to extract metadata from attachments. That is a pretty useful feature and looks to be an improvement over piping the attachment through a shellscript as done with fts_decoder. Having this feature enabled though I sometimes do see the situation that the tika service does not reply in time and it looks like the whole FTS transaction gets aborted: dovecot: indexer-worker(eggs@localhost): Error: fts_tika: PUT http://localhost:9998/tika/ failed: Request timed out (Request queued 60.145 secs ago, 1 attempts in 60.134 secs, 60.034 in http ioloop, 0.000 in other ioloops, connected 1739.235 secs ago) dovecot: indexer-worker(eggs@localhost): Error: Mailbox INBOX.junk: Mail search failed: Internal error occurred. Refer to server log for more information. [2017-10-09 03:46:09] dovecot: indexer-worker(eggs(a)bawue.de): Error: Mailbox INBOX.junk: Transaction commit failed: FTS transaction commit failed: transaction context (attempted to index 12084 messages (UIDs 2..17850)) Is that actually sensible behavior? I would consider attachment metadata to be nice to have, but not necessarily mandatory. So if the attachment indexing fails, I would hope that at least the mailtext got indexed. But it seems like we abort the whole transaction. Am I reading the error log correctly? cheers, Andreas

1 0

dovecot-2.2.33 bug report
by David Binderman 11 Oct '17

11 Oct '17

Hello there, dovecot-2.2.33/src/lib/str-find.c:86]: (warning) Calling 'sizeof' on 'sizeof' Source code is ctx = p_malloc(pool, MALLOC_ADD(sizeof(struct str_find_context), MALLOC_MULTIPLY(sizeof(ctx->goodtab[0]), key_len))); Regards David Binderman

2 1

Re: My sub-folder with Outlook work-around to date - update 201710111315 - Final
by David.M.Clark 11 Oct '17

11 Oct '17

Hi All, After over a week of stuffing around in /etc/dovecot/conf.d files and lots of trial and error, I now have a controlled setup to migrate one user at a time to Maildir without affecting the other mbox based users. For the sake of not posting an essay, if you go to this web page: http://dmc1961.id.au/howto_17101101.php you will see what I have done (moderators please let me know if this is the correct or allowable practice to post links rather than massive e-mails to the group?). My sincere thanks to all who contributed and helped steer me in the right direction - I got a little lost on-line for a while but eventually got back to the right setup (our beloved Linux does have a few different file locations and setup based on the releases out there, so these were a little confusing). Working well now on my test environment and on a test user on the client's box we need to convert, so if there are any more gotchas I will add them to the how-to web page and update you all. Was a battle at times but it was a war worth winning. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

Issue with mailbox conversion using dsync in v2.2.32 (maildir <-> mdbox)
by Jason Kiniry 11 Oct '17

11 Oct '17

Hi all, I've run into an issue with in-place mailbox format conversions between mdbox and maildir and wondered if someone could assist. When using dsync to convert a mailbox, the conversion loses a mailbox GUID and produces a warning. This behavior seems to have been introduced between version 2.2.31 and 2.2.32. See below for the full debug output from both versions followed by the dovecot configuration used for both attempts. When I run the following: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/blahmail/mail -u _mainaccount(a)blahmail.tld -v mirror maildir:/home/blahmail/mail On version 2.2.32, I get the following with the warning included on the last line of the output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)blahmail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_gid=1081 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_uid=1137 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_user=blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Effective uid=1137, gid=1081, home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: fs: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)blahmail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/INBOX doesn't exist yet, using default permissions doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: Effective uid=1137, gid=1081, home=/home/blahmail dsync(blahmail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(blahmail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(blahmail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(blahmail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(blahmail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/blahmail/mail dsync(blahmail): Debug: maildir++: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=/home/blahmail/mail, alt= dsync(blahmail): Debug: fs quota add mailbox dir = /home/blahmail/mail dsync(blahmail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(blahmail): Debug: fs quota mount point = / dsync(blahmail): Debug: fs quota mount type = xfs dsync(blahmail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(blahmail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(blahmail): Debug: fts: Indexes disabled for namespace '' dsync(blahmail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(blahmail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: brain M: Local mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Mailbox INBOX: local=60f6d91a25fddb5983040000a19766e2/0/1, remote=e6191d3644fddb59e2040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=61f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=62f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=63f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=64f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: brain S: Remote mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Mailbox INBOX: local=e6191d3644fddb59e2040000a19766e2/0/1, remote=60f6d91a25fddb5983040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain S: Mailbox INBOX.Drafts: local=61f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Junk: local=62f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Sent: local=63f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Trash: local=64f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Change during sync: Mailbox GUID e6191d3644fddb59e2040000a19766e2 was lost dsync(blahmail): Debug: brain S: We don't have mailbox e6191d3644fddb59e2040000a19766e2 dsync(blahmail): Debug: brain M: Change during sync: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) -------------------------------------------------------------------------------------------------------------------------------------------- Previously, on 2.2.31 I ran: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/mymail/mail -u _mainaccount(a)mymail.tld -v mirror maildir:/home/mymail/mail And got the following successful conversion output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)mymail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_gid=1077 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_uid=1134 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_user=mymail doveadm(_mainaccount(a)mymail.tld): Debug: Effective uid=1134, gid=1077, home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: fs: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default doveadm(_mainaccount(a)mymail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)mymail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Effective uid=1134, gid=1077, home=/home/mymail dsync(mymail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(mymail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(mymail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(mymail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(mymail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mymail/mail dsync(mymail): Debug: maildir++: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=/home/mymail/mail, alt= dsync(mymail): Debug: fs quota add mailbox dir = /home/mymail/mail dsync(mymail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(mymail): Debug: fs quota mount point = / dsync(mymail): Debug: fs quota mount type = xfs dsync(mymail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(mymail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(mymail): Debug: fts: Indexes disabled for namespace '' dsync(mymail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(mymail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: brain M: Local mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Mailbox INBOX: local=00000000000000000000000000000000/0/0, remote=a884611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=a984611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=aa84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=ab84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=ac84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/INBOX doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: brain S: Remote mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Mailbox INBOX: local=a884611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Drafts: local=a984611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Junk: local=aa84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Sent: local=ab84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Trash: local=ac84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Import change type=save GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=1 hdr_hash= result=Mail's UID is above local UIDNEXT - No more local mails found dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: prefetch dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: access dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain M: import mail uid 0 guid 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 dsync(mymail): Debug: brain M: Import INBOX: Import mail body for GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: copying dsync(mymail): Debug: /home/mymail/mail/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Compressed, file_seq changed 0 -> 1507586868, size=32, max_uid=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain S: Import INBOX: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Warning: quota: Namespace 'INBOX.' is not Maildir, skipping for Maildir++ quota dsync(mymail): Debug: brain M: Import INBOX: Saved UIDs: 1 dsync(mymail): Debug: brain M: Import INBOX: Finish update: min_next_uid=2 min_first_recent_uid=1 min_highest_modseq=2 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 -------------------------------------------------------------------------------------------------------------------------------------------- dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.6.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_cache_size = 819 M auth_mechanisms = plain login auth_policy_hash_mech = sha512 auth_policy_hash_nonce = 85979662 auth_policy_hash_truncate = 64 auth_policy_request_attributes = auth_database=mail database=mail service=dovecot username=%{orig_user} authtoken_hash=$0$0$%{hashed_password} local_host=%{real_lip} local_port=%{real_lport} remote_host=%{real_rip} remote_port=%{real_rport} auth_policy_server_api_header = X-API-Key:dovecot:4FR0BN8IWTpSnB42 auth_policy_server_timeout_msecs = 3000 auth_policy_server_url = http://127.0.0.1:579/dovecot-auth-policy auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes lmtp_user_concurrency_limit = 4 mail_access_groups = dovecot mail_plugins = quota quota_clone zlib fts fts_solr mail_prefetch_count = 20 mailbox_list_index = yes maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = create special_use = \Junk } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict-domain_owner_mail_pass.conf driver = dict result_failure = return-fail skip = authenticated } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword skip = authenticated } plugin { acl = vfile:cache_secs=86400 fts = solr fts_solr = url= http://WVJMEK57hc3cg712:9v9W13cT8fTYaXkQ@127.0.0.1:8984/solr/dovecot/ quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded } protocols = lmtp imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 565 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual fts fts_solr namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota quota quota_clone virtual zlib namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } local_name jason64.dev.cpanel.net { ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_key = # hidden, use -P to show it } local_name adomain.tld www.adomain.tld mail.adomain.tld webmail.adomain.tld cpanel.adomain.tld autodiscover.adomain.tld webdisk.adomain.tld { ssl_cert = </var/cpanel/ssl/domain_tls/adomain.tld/combined ssl_key = # hidden, use -P to show it } local_name argon.tld www.argon.tld mail.argon.tld xenon.tld carbon.tld helium.tld oxygen.tld chlorine.tld hydrogen.tld www.xenon.tld www.carbon.tld www.helium.tld www.oxygen.tld www.chlorine.tld www.hydrogen.tld mail.xenon.tld mail.carbon.tld mail.helium.tld mail.oxygen.tld mail.chlorine.tld mail.hydrogen.tld webmail.argon.tld cpanel.argon.tld autodiscover.argon.tld webdisk.argon.tld www.mail.argon.tld { ssl_cert = </var/cpanel/ssl/domain_tls/argon.tld/combined ssl_key = # hidden, use -P to show it } -------------------------------------------------------------------------------------------------------------------------------------------- I'm starting to narrow down on which commit introduced the problem, but that'll take some time. If anyone knows which commit caused this or knows of a fix, please let me know. Thank you very much! Regards, Jason

2 2

Parallel build problems with dovecot 2.2.32
by Craig Leres 10 Oct '17

10 Oct '17

I use dovecot under FreeBSD 10.3 and build using poudriere. My build server has 12 cores builds typically happen in parallel and I find software that is not parallel make friendly will fail once every month or so. Attached is a build log from this afternoon that failed because doveadm-util.o had not finished building when the attempt to link test-doveadm-util happened. Looking in src/doveadm/Makefile* in the build tree the only place I see doveadm-util.o is in a make variable: test_doveadm_util_LDADD = doveadm-util.o $(test_libs) $(MODULE_LIBS) This is only used in the test-doveadm-util rule: test-doveadm-util$(EXEEXT): $(test_doveadm_util_OBJECTS) $(test_doveadm_util_DEPENDENCIES) $(EXTRA_test_doveadm_util_DEPENDENCIES) @rm -f test-doveadm-util$(EXEEXT) $(AM_V_CCLD)$(LINK) $(test_doveadm_util_OBJECTS) $(test_doveadm_util_LDADD) $(LIBS) So the problem is that doveadm-util.o needs to be an explicit dependency for test-doveadm-util. I believe one possible fix would be to add doveadm-util.o to test_doveadm_util_DEPENDENCIES: test_doveadm_util_DEPENDENCIES = $(test_deps) bug this isn't something that can easily tested. Craig

2 2

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

First of all excuse.. I am having an issue getting maillist responses so I may be responding to this worng No on topic I commented out the first user_quesry The second query was not copied correctly , reads user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=‘1' still have the same error I did a comparison between the data contained in the sql file and my mail directory and found that they are not consistent Apparently postfixadmin, which I have been using, does not update the maildir I am surprised I am getting any mail at all. I think I have to take this back to ground zero "I see two problems: 1) you have two user_querys, there should only be one 2) your 2nd user_query is not limiting the SQL search with a WHERE clause"

3 2

Sieve rules not processing
by Stephan Herker 10 Oct '17

10 Oct '17

I'm new to dovecot altogether and I have a working dovecot system. I'm trying to setup sieve for mail filtering. If I run the debug program sieve-test I get a positive result that it would have sorted the mail appropriately, but the logs for lmtp don't appear to be processing the rule. Below is output of dovecot -n. Any help is appreciated. Thanks # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login first_valid_uid = 2000 last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = administrator(a)keagaming.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota autocreate sieve quota" postmaster_address = postmaster(a)keagaming.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota quota" }

2 3

Trash quota issue
by Stephan Herker 10 Oct '17

10 Oct '17

I have quotas setup on a test domain to try everything out before I move my domains email over to dovecot. I have a trash quota rule that should have added 100M to trash folder specifically, but mail was denied due to quota being full even though the only mail in the test account was in trash. Below are debug log lines and dovecot -n output. Oct 07 17:16:03 lmtp(26801): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:16:03 lmtp(26801): Info: Connect from local Oct 07 17:16:03 lmtp(26801): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: plugin/quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=20480000 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=2048000 (10%) Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin is not up-to-date Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script `main script' from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script successfully compiled Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Info: OFqmG0Nu2VmxaAAAobcTNA: sieve: msgid=<3a1e5ba2-f0a7-4cec-e7fb-bf5202c2152d(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

1 0

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

This apparently was a problem that i was not aware since i redid my mail server configuration to make use of Postfixadmin. I have update the conf files using the postfix document fromthe down load. The download document seems to be fpr an early version of dovecot (I am using 2.2.4) as it focuse of dovecot.conf which is now broken into file in the conf.d subdirectory I get "dovecot: auth-worker(30555): sql(abuse(a)examplei.com): unknown user " I imagine this is a conf problem and deals with reading the sql daya I have confirmed the dayta is there The major file apperas to be dovecot-sql.conf.ext Mine reads as follows driver = mysql connect = host=127.0.0.1 dbname=postfix user=postfix password=postfixadmin password_query = SELECT username, password FROM mailbox WHERE username='%u' and active =" default_pass_scheme = MD5-CRYPT user_query = SELECT maildir, 5000 AS uid, 5000 AS gid FROM mailbox WHERE username = '%u' user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid Since normal mail is habdled by dovecoy It would see somthing is wrong wihh the first user_query since it appears to be the one that should fine the alias user Any hellp or suggestions would be appreciate

2 1

Error: file_preallocate in logs
by Ricardo Branco 10 Oct '17

10 Oct '17

I am getting lots of these messages in my imapd.log or while I am doing mailbox operations on the terminal. All my mailboxes are stored on NFS and ive set the nfs locking params in the config, only one mailserver accessing this share. Any ideas why this would be happening? doveadm(ops): Error: file_preallocate(/var/vmail/ops/mdbox/storage/.temp.1507551663.P21424Q109M878872.posti2.dc1.wenn.com) failed: Operation not supported

2 3

Re: ACL permission: give permission to move email into different folder
by Davide Marchi 10 Oct '17

10 Oct '17

On 06.10.2017 12:42:22, Aki Tuomi wrote: [..] >> >> Maybe it is not possible with Dovecot? >> >> Many Thanks >> >> Davide > > Just give the relevant permissions to the user, and it also requires > that the target directory is writable by source user. > > Aki Oh, excuse me for the (most probably) silly question, but where I could give to my *virtual user* the directory write permission, if not from the Dovecot ACL? Actually on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip Many thanks Aki for you help! :-) Davide

2 3

Re: My sub-folder with Outlook work-around to date - update 201710091046
by David.M.Clark 09 Oct '17

09 Oct '17

Hi Mike, I haven't seen your messages come through the feed so something is not working for your e-mail address there? No I am not using Sieve - the server has a third party handling spam etc so the Linux box is very basic SendMail, Dovecot and RoundCube setup (along with my own procmail based web interface for e-mail forwarding and away message responses). I struggle on. On 09/10/17 12:30, Mike wrote: > > Mr. Clark, > > I would post this question to the maillist, but for some unknown reason, > it will not post my messages. > > Are you currently using Sieve with your mbox setup? > > If so, would you be willing to share your configuration of that? > > If not, I guess I'll just convert to maildir like you are doing. > > I'd be willing to help in any way you feel needed. > > Thanks. > > Mike Barsalou > > Quoting "David.M.Clark" <david(a)davrom.com>: > >> Hi All, >> >> Will start using an "update" tag in my subject just to not cause >> confusion (mainly for yours truly). >> >> Pursuant to my victory in finding Maildir and mbox being used if >> either exist (and if both still seems to favour Maildir - a mistake my >> end: "rmdir -f mail" fixed it), I have found one issue with not >> declaring the mailbox location: it won't import your new e-mail from >> your Inbox (/var/spool/mail/user in my case). If I run the conversion >> script mb2md with a '-m', I get duplicate entries in Outlook's Inbox - >> I understand why, just a shame it doesn't sync with what 'isn't' >> already there. >> >> So yesterday and today I have done additional testing as the customer >> uses RoundCube and mobile devices - so attacking the same Linux server >> I have Thunderbird and a couple of Android e-mail clients. Outlook is >> the only stick in the mud with needing to manually subscribe to >> folders when I create them on other devices - again could be me as I >> don't use Outlook. (Thunderbird and other e-mail clients, all good >> with immediate auto-sync). >> >> I looked at the wiki to try and run both mail_location settings with >> the wiki suggested: >> >> ##namespace { >> ## separator = / >> ## prefix = "#mbox/" >> ## location = mbox:~/mail:INBOX=/var/mail/%u >> ## inbox = yes >> ## hidden = yes >> ## list = no >> ##} >> ##namespace { >> ## separator = / >> ## prefix = "Maildir/" >> ## location = maildir:~/Maildir >> ## list = yes >> ##} >> >> in 10-mail.conf but as you can see, I have commented it out now as it >> introduced some more layers of errors which I have to get back to - >> "Duplicate namespace prefix" was one issue. >> >> The goal is to run the server with the existing mbox users blissfully >> unaware they are being converted one-by-one so it looks like I 'can' >> run both formats but just need to get the configs right. Was hoping >> the mb2md would just sync new stuff so I could cron script the Inbox >> check for the users that are converted to Maildir until I can throw >> the switch and be done with the cut-over..... or I could be dangerous >> and remove and import each time.... but that could lead to more dramas >> at the user end. >> >> Looks like more R&D is needed so will persevere - annoying to get so >> close though, might see if I can just sync in the Inbox items that are >> 'new' - that means I am ready to roll on the customer site...... >> >> On 09/10/17 00:12, David.M.Clark wrote: >>> Wow excellent feedback Joseph, Philon and Aki, >>> >>> You have all pointed me in the right direction. Tonight I have tested >>> Dovecot with just the minor configs I do for Dovecot setup and I have >>> commented out the mbox/Maildir lines in 10-mail.conf from my testing: >>> >>> #mail_location = >>> #mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u >>> #mail_location = maildir:~/Maildir >>> >>> I had run up some test files (folders) under mbox using >>> "/u/home/user/mail_test" and then renamed this to 'mail' (so >>> /u/home/user/mail). >>> Ran some tests with sends/receives, created folders - all good. >>> Created mbox text folders. >>> >>> Then had my initial test 'Maildir_test' populated with test folders >>> which I renamed to /u/home/user/Maildir - and each time I restarted >>> Outlook it was obeying the folder 'format' based on whether I had >>> 'mail' or 'Maildir' in place. >>> >>> I did see in the posts and docs on-line somewhere that someone >>> mentioned the later implementations of Dovecot, without hard-setting >>> either mbox or Maildir in the 10-mail.conf file, Dovecot, based on >>> the presence of the particular directory in the user's $HOME >>> directory obeys the rules based on mbox/Maildir respectively. >>> >>> I haven't needed to touch the namespace rules as per: >>> >>> https://wiki2.dovecot.org/Namespaces >>> >>> so the only files that bear any changes from the installed config in >>> conf.d are: >>> >>> -rw-r--r-- 1 root root 14531 Oct 8 23:28 10-mail.conf >>> -rw-r--r-- 1 root root 2965 Oct 7 08:49 10-master.conf >>> -rw-r--r-- 1 root root 1728 Oct 7 08:52 10-ssl.conf >>> >>> This will make migration so much easier with converting one user at a >>> time and then getting them to start Outlook and re-sync things again. >>> >>> This will save a massive job from being just that and can be done in >>> batches of users to suit time constraints. >>> >>> I will post here once again to let you all know how I fare but just >>> proves to me over and over again the power of the Linux e-mail server >>> with Dovecot for IMAP and being able to keep with the older SendMail >>> MTA (been working with Sendmail since 1996 so....). >>> >>> Thank you all so much for taking time to respond. >>> >>> On 08/10/17 20:32, Aki Tuomi wrote: >>>> You can give mail location and home directory from userdb or passdb. >>>> >>>> For userdb, return mail=something:~/something and for home use >>>> home=/path/to/home >>>> >>>> For passdb, you can return userdb_mail and userdb_home >>>> >>>> Aki >>>> >>>>> On October 8, 2017 at 1:14 PM Philon <bytesplit(a)gmail.com> wrote: >>>>> >>>>> >>>>> Hi David, >>>>> >>>>> I somehow remember that there is a way to get the mail_location >>>>> from per-user-settings. I had this once when migrating from maildir >>>>> to mdbox. >>>>> >>>>> You might want to use Google and the mailing list archives for the >>>>> details but in summary it went like this: >>>>> >>>>> - set Dovecot to grab the mail_location from user-settings (I think >>>>> we used MySQL db field - or check docs for auto:) >>>>> - have login script which converts maildir from setup A to B and >>>>> update the user setting >>>>> - kick the user once again to apply the setting (I’m not sure about >>>>> this) >>>>> >>>>> This then automates the conversion process to happen on next user >>>>> login. >>>>> >>>>> Be warned though that today with all the idle phones, probably many >>>>> users will re-login after you restart the server. Perhaps the >>>>> scripting could handle a timer which randomizes this a little. >>>>> >>>>> >>>>> Philon >>>>> >>>>> >>>>>> Am 07.10.2017 um 02:22 schrieb David.M.Clark <david(a)davrom.com>: >>>>>> >>>>>> Hi All, >>>>>> >>>>>> Thanks to MJ for the suggestion as my only hope, and I have tested >>>>>> this with Outlook 2016 and Thunderbird today - seamless creation >>>>>> of folders. >>>>>> >>>>>> Now the mammoth task of converting customers with masses of mbox >>>>>> folders to MailDir format using the on-line perl script: >>>>>> mb2md-3.20.pl >>>>>> >>>>>> Works nicely and will be what gets us out of trouble. My only >>>>>> sadness is that Outlook then has to be 're-subscribed' to the >>>>>> folders again.... which makes sense or maybe I didn't give it long >>>>>> enough - its IMAP folder syncs are extremely slow compared to >>>>>> Thunderbird which I also tested in parallel. Thunderbird didn't >>>>>> need any re-sync, it just found the new subscription setup and was >>>>>> ready to go. But in all fairness, Outlook is still really only an >>>>>> Exchange compatible product for the most part. >>>>>> >>>>>> Would be great to run both mbox and MailDir at the same time so we >>>>>> can do the slow user-by-user process rather than having them all >>>>>> down at some point completely - might look at running Dovecot on a >>>>>> different port maybe with a different ".conf" but thinking this >>>>>> may not work anyway or cause issues.... back to my server tests to >>>>>> see :-) >>>>>> >>>>>> I use additional ports to 143 for external IMAP restrictions >>>>>> anyway so might be able to do this method somehow. >>>>>> >>>>>> Anyway, for those interested in where I got to in my testing so >>>>>> far... >>>>>> >>>>>> 1. Download perl script "mb2md-3.20.pl" from: >>>>>> >>>>>> http://batleth.sapienti-sat.org/projects/mb2md >>>>>> >>>>>> 2. Changed Dovecot /etc/dovecot/conf.d/10-mail.conf mbox entry to >>>>>> MailDir: >>>>>> >>>>>> #mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u >>>>>> mail_location = maildir:~/Maildir >>>>>> >>>>>> 3. Restarted Dovecot >>>>>> >>>>>> 4. su as user and in their home (/u/home/user on my setup): >>>>>> >>>>>> /u/packages/mb2md-3.20.pl -m >>>>>> >>>>>> then: >>>>>> >>>>>> mv mail mail_old >>>>>> >>>>>> then: >>>>>> >>>>>> /u/packages/mb2md-3.20.pl -s mail_old -R >>>>>> >>>>>> then: >>>>>> >>>>>> Login with Outlook and subscribe to IMAP folders again. >>>>>> >>>>>> Not a big fan of gazillions of little eml based text mail files in >>>>>> directories but hey, if it fixes our issues, maybe I need to stop >>>>>> wambulancing about it all and do as I am told :-) >>>>>> >>>>>> Hope this helps - will keep this e-mail updated on findings if >>>>>> anything else comes to light. >>> >> >> -- >> >> As always, I remain at your service. >> >> Kindest Regards, >> David.M.Clark (Director - Senior Linux/UNIX Consultant) >> =--------------------------------------------------------------------------= >> >> Davrom Consulting Pty Ltd Mobile: 0418763124 >> PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com >> ABN: 81 096 990 804 E-mail (Priv): >> dmc1961(a)dmc1961.id.au >> Website: http://davrom.com Skype: dmc1961 >> Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com >> =--------------------------------------------------------------------------= >> >> Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, >> Networking/Internet, E-mail/Web Technologies >> =--------------------------------------------------------------------------= >> >> Please note: Any e-mail communication bearing this signature is for >> the exclusive purpose of the sender and is not for publication >> without the expressed permission of the sender or respective >> sender's organisation. >> =--------------------------------------------------------------------------= >> > > -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

My sub-folder with Outlook work-around to date
by David.M.Clark 09 Oct '17

09 Oct '17

Hi All, please be kind, this is my first e-mail to the list :-) I actively support CentOS based e-mail servers running Dovecot, Sendmail, Spammassassin and 3 x SOGo based setups. Dovecot is my goto IMAP server and have used it and modifications to it to net excellent results for years. Then we have people who insist on only using Outlook (and in some instances the MS Live Messenger thingy). Some shenanigans in recent years have arose with using sub-folders in the Outlook clients (2013 and 2016). Traditionally, placing a "/" after the name of a newly desired e-mail folder has netted the result of something like: "Rentals/" creating: /u/home/someuser/mail/Rentals/ Under which users then create actual e-mail folders under the "Rentals" Linux directory as such. With Outlook 2013 and 2016 this seems to have stopped working and so I implemented a work-around where the user creates a normal folder, example "Rentals++", and I have written a cron script that trawls the $HOMEs each minute and if it finds a folder with a "++" at the end, it creates the folder as a directory, so: /u/home/someuser/mail/Rentals++ becomes: /u/home/someuser/mail/Rentals/ and adds this new subscription to their .subscription folder. It also sends an e-mail to the user advising that the new folder is created and they can proceed to use the "Rentals" folder for adding sub-folders (as in real text based mail folders). The script was a quick work-around one weekend in a mad flurry to get things working and to date works but is not 'user-proof'. So I am now looking at developing an internal web interface to do the same thing and hoping with more controls, has no or far less margin for user error. Long times of Outlook folder refreshes don't help and users sometimes end up with issues that require my Linux command line help. I have been trawling e-mail forums for some time now and have not seen any other work-arounds (or perhaps I am living under a rock) but before I embark on this web interface adventure, I just wanted to make sure I had not missed some fundamental 'bit' that I should be observing. All servers are either CentOS 6.9 (or slightly less) and CentOS 7 with the latest updates and for things like Thunderbird and Roundcube and SOGo, work well. I need to experiment with the whole "/" for these but I am currently driven by the enforced Outlook chains. Any input from you guys on whether this is my best approach or 'hey mate, just do this', would be much appreciated. I am happy to share my travels script/web-wise if this is the only option to date. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) E-mail: david(a)davrom.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------=

4 7

Released Pigeonhole v0.4.21.rc1 for Dovecot v2.2.33.rc1.
by Stephan Bosch 09 Oct '17

09 Oct '17

Hello Dovecot users, Here is the Pigeonhole hole release candidate that goes with the Dovecot release candidate. Nothing really special going on, just a few changes and fixes that accumulated over the last few months. Changelog v0.4.21: * redirect action: Always set the X-Sieve-Redirected-From header to sieve_user_email if configured. Before, it would use the envelope recipient instead if available, which makes no sense if the primary e-mail address is available. + vacation extension: Allow ignoring the envelope sender while composing the "To:" header for the reply. Normally, the "To:" header is composed from the address found in the "Sender", "Resent-From" or "From" headers that is equal to the envelope sender. If none is then found, the bare envelope sender is used. This change adds a new setting "sieve_vacation_to_header_ignore_envelope". With this setting enabled, the "To:" header is always composed from those headers in the source message. The new setting thus allows ignoring the envelope, which is useful e.g. when SRS is used. + vacation extension: Compose the "To:" header from the full sender address found in the first "Sender:", "From:" or "Resent-From:" header. Before, it would create a "To:" header without a phrase part. The new behavior is nicer, since the reply will be addressed to the sender by name if possible. - LDA Sieve plugin: Fixed sequential execution of LDAP-based scripts. A missing LDAP-based script could cause the script sequence to exit earlier. - sieve-filter: Removed the (now) duplicate utf8 to mutf7 mailbox name conversion. This caused problems with mailbox names containing UTF-8 characters. The Dovecot API was changed years ago, but apparently sieve-filter was never updated. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.21… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.21… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Permission denied error on private key...
by SH Development 08 Oct '17

08 Oct '17

I have a working dovecot/postfix/mysql server running and was trying to set up another one for replication purposes. If I copy my certificates from the working server, everything works fine. However, I purchased another updated certificate for the replication server, and I cannot get dovecot to start up. Keep getting: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 31: ssl_key: Can't open file /etc/pki/dovecot/private/mailserver.crt: Permission denied Different permissions on the mailserver.crt have no effect on the error. Maybe something I did in creating the file? I’m a little fuzzy when it comes to how you’re supposed to create the whole thing. Here are the steps I took: openssl genrsa -out mailserverkey.crt 2048 I then took the CSR, submitted it to Comodo, a certificate was generated and emailed back to me. I placed the certs in the appropriately referenced places on the server… And that is where I’m at. I’ve spent quite a bit of time comparing my working server’s configuration files to the new server and cannot find any differences in the SSL configuration, OTHER than the certs themselves. Is dovecot looking for something I didn’t do correctly in the creation maybe? Jeff J. Starion Technologies, LLC 816-331-0030

2 4

Re: My sub-folder with Outlook work-around to date
by Joseph Tam 08 Oct '17

08 Oct '17

"David.M.Clark" <david(a)davrom.com> writes: > Would be great to run both mbox and MailDir at the same time so we can > do the slow user-by-user process rather than having them all down at > some point completely ... - might look at running Dovecot on a different I believe you can do this by using a userdb that can accommodate extra fields. In particular, supplying a mail field will overwrite the global mail_location. You can iterate through your users, convert them one at a time, then update the mail field as you go. At the end, update mail_location to your new default and remove the extra fields. https://wiki.dovecot.org/UserDatabase/ExtraFields Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 07 Oct '17

07 Oct '17

Thanks! We'll look into it. ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 07/10/2017 13:08 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} #5 0x00007f8bb656bcb0 in io_remove_full (_io=0x220a100, closed=false) at ioloop.c:126 io = 0x22694a0 __FUNCTION__ = "io_remove_full" #6 0x00007f8bb656be31 in io_remove (io=0x220a100) at ioloop.c:169 No locals. #7 0x00007f8bb65815f8 in o_stream_file_cork (stream=0x220a010, set=true) at ostream-file.c:342 fstream = 0x220a010 ret = 32766 __FUNCTION__ = "o_stream_file_cork" #8 0x00007f8bb657e289 in o_stream_cork (stream=0x220a0a0) at ostream.c:146 _stream = 0x220a010 #9 0x00007f8bb12d6406 in openssl_iostream_bio_output (ssl_io=0x220aa00) at iostream-openssl.c:325 bytes = 140238036407941 max_bytes = 18446742978492891135 sent = 35692560 buffer = "\027\003\003\000\001\000\000\000\020\240 \002\000\000\000\000\200\254\035\370\376\177\000\000\022\343W\266\213\177\000\000`\214\033\002\000\000\000\000\240\240 \002\000\000\000\000`\214\033\002\000\000\000\000\020\240 \002\000\000\000\000\320\314\035\370\376\177\000\000\236f-\261\213\177\000\000\025\071\260fK\247\000\000\000\252 \002\000\000\000\000`\214\033", '\000' <repeats 14 times>, "\315\035\370\376\177\000\000\236f-\261\213\177\000\000\225\305^\001?\236,,\000\252 \002\000\000\000\000=$h\000\272Å«\033\000\000\000\000\000\000\000\000\221\371Í¦f\237\035\224\335-\365\214l\333\347|\005\310\345\035/\200r\242\222}\313I\226G\313*\223\364\312\310\313j\263\260/\245"... bytes_sent = false ret = 32766 __FUNCTION__ = "openssl_iostream_bio_output" #10 0x00007f8bb12d6af6 in openssl_iostream_bio_sync (ssl_io=0x220aa00) at iostream-openssl.c:459 ret = false #11 0x00007f8bb12da52e in o_stream_ssl_flush_buffer (sstream=0x220aca0) at ostream-openssl.c:110 pos = 6 ret = 6 #12 0x00007f8bb12da6ef in o_stream_ssl_sendv (stream=0x220aca0, iov=0x7ffef81dcd70, iov_count=1) at ostream-openssl.c:155 sstream = 0x220aca0 bytes_sent = 6 #13 0x00007f8bb657e765 in o_stream_sendv (stream=0x220ad30, iov=0x7ffef81dcd70, iov_count=1) at ostream.c:260 _stream = 0x220aca0 i = 1 total_size = 6 ret = 35771392 __FUNCTION__ = "o_stream_sendv" #14 0x00007f8bb657e688 in o_stream_send (stream=0x220ad30, data=0x2308850, size=6) at ostream.c:239 iov = {iov_base = 0x2308850, iov_len = 6} #15 0x00007f8bb6583c2c in o_stream_multiplex_sendv (mstream=0x221d270) at ostream-multiplex.c:90 channel = 0x0 ret = 0 #16 0x00007f8bb6583dd4 in o_stream_multiplex_ochannel_sendv (stream=0x221d720, iov=0x7ffef81dcef0, iov_count=1) at ostream-multiplex.c:124 channel = 0x221d720 ret = 7354428521 total = 1 #17 0x00007f8bb657e765 in o_stream_sendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:260 _stream = 0x221d720 i = 1 total_size = 1 ret = 36233296 __FUNCTION__ = "o_stream_sendv" #18 0x00007f8bb657e93f in o_stream_nsendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:295 No locals. #19 0x00007f8bb657e8d3 in o_stream_nsend (stream=0x221d7b0, data=0x7ffef81dcf42, size=1) at ostream.c:287 iov = {iov_base = 0x7ffef81dcf42, iov_len = 1} #20 0x0000000000444a35 in doveadm_server_log_handler (ctx=0x7f8bb6805bd0 <failure_ctx_warning>, format=0x7f8bb65bac69 "Raw backtrace for leaks: %s", args=0x7ffef81dcfb0) at client-connection.c:64 c = 3 '\003' corked = false str = 0x228e050 ptr = 0x0 start = 0x228e088 "Raw backtrace for leaks: /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-ser"... va = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} _data_stack_cur_id = 4 #21 0x00007f8bb654afdc in i_warning (format=0x7f8bb65bac69 "Raw backtrace for leaks: %s") at failures.c:325 old_errno = 0 args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} #22 0x00007f8bb656d8cd in io_loop_destroy (_ioloop=0x7ffef81dd138) at ioloop.c:766 backtrace = 0x228dc38 "/usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/"... ioloop = 0x221ddc0 to_idx = 0x221dfe0 item = 0x0 leaks = true __FUNCTION__ = "io_loop_destroy" #23 0x00000000004454d1 in doveadm_cmd_handle (conn=0x22059d8, cmd_name=0x21b8c20 "dsync-server", argc=3, argv=0x21b8c50, cctx=0x7ffef81dd1b0) at client-connection.c:337 ioloop = 0x0 prev_ioloop = 0x21bfc40 cmd = 0x0 mail_cmd = 0x21c65e8 mctx = 0x221d9f8 cmd_ver2 = 0x0 #24 0x0000000000445793 in client_handle_command (conn=0x22059d8, args=0x21b8c40) at client-connection.c:399 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x21b8c19 "reuben", cli = false, tcp_server = true, local_ip = {family = 10, u = {ip6 = {__in6_u = { ---Type <return> to continue, or q <return> to quit--- Reuben

1 0

Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Reuben Farrelly 07 Oct '17

07 Oct '17

This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} #5 0x00007f8bb656bcb0 in io_remove_full (_io=0x220a100, closed=false) at ioloop.c:126 io = 0x22694a0 __FUNCTION__ = "io_remove_full" #6 0x00007f8bb656be31 in io_remove (io=0x220a100) at ioloop.c:169 No locals. #7 0x00007f8bb65815f8 in o_stream_file_cork (stream=0x220a010, set=true) at ostream-file.c:342 fstream = 0x220a010 ret = 32766 __FUNCTION__ = "o_stream_file_cork" #8 0x00007f8bb657e289 in o_stream_cork (stream=0x220a0a0) at ostream.c:146 _stream = 0x220a010 #9 0x00007f8bb12d6406 in openssl_iostream_bio_output (ssl_io=0x220aa00) at iostream-openssl.c:325 bytes = 140238036407941 max_bytes = 18446742978492891135 sent = 35692560 buffer = "\027\003\003\000\001\000\000\000\020\240 \002\000\000\000\000\200\254\035\370\376\177\000\000\022\343W\266\213\177\000\000`\214\033\002\000\000\000\000\240\240 \002\000\000\000\000`\214\033\002\000\000\000\000\020\240 \002\000\000\000\000\320\314\035\370\376\177\000\000\236f-\261\213\177\000\000\025\071\260fK\247\000\000\000\252 \002\000\000\000\000`\214\033", '\000' <repeats 14 times>, "\315\035\370\376\177\000\000\236f-\261\213\177\000\000\225\305^\001?\236,,\000\252 \002\000\000\000\000=$h\000\272Å«\033\000\000\000\000\000\000\000\000\221\371Í¦f\237\035\224\335-\365\214l\333\347|\005\310\345\035/\200r\242\222}\313I\226G\313*\223\364\312\310\313j\263\260/\245"... bytes_sent = false ret = 32766 __FUNCTION__ = "openssl_iostream_bio_output" #10 0x00007f8bb12d6af6 in openssl_iostream_bio_sync (ssl_io=0x220aa00) at iostream-openssl.c:459 ret = false #11 0x00007f8bb12da52e in o_stream_ssl_flush_buffer (sstream=0x220aca0) at ostream-openssl.c:110 pos = 6 ret = 6 #12 0x00007f8bb12da6ef in o_stream_ssl_sendv (stream=0x220aca0, iov=0x7ffef81dcd70, iov_count=1) at ostream-openssl.c:155 sstream = 0x220aca0 bytes_sent = 6 #13 0x00007f8bb657e765 in o_stream_sendv (stream=0x220ad30, iov=0x7ffef81dcd70, iov_count=1) at ostream.c:260 _stream = 0x220aca0 i = 1 total_size = 6 ret = 35771392 __FUNCTION__ = "o_stream_sendv" #14 0x00007f8bb657e688 in o_stream_send (stream=0x220ad30, data=0x2308850, size=6) at ostream.c:239 iov = {iov_base = 0x2308850, iov_len = 6} #15 0x00007f8bb6583c2c in o_stream_multiplex_sendv (mstream=0x221d270) at ostream-multiplex.c:90 channel = 0x0 ret = 0 #16 0x00007f8bb6583dd4 in o_stream_multiplex_ochannel_sendv (stream=0x221d720, iov=0x7ffef81dcef0, iov_count=1) at ostream-multiplex.c:124 channel = 0x221d720 ret = 7354428521 total = 1 #17 0x00007f8bb657e765 in o_stream_sendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:260 _stream = 0x221d720 i = 1 total_size = 1 ret = 36233296 __FUNCTION__ = "o_stream_sendv" #18 0x00007f8bb657e93f in o_stream_nsendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:295 No locals. #19 0x00007f8bb657e8d3 in o_stream_nsend (stream=0x221d7b0, data=0x7ffef81dcf42, size=1) at ostream.c:287 iov = {iov_base = 0x7ffef81dcf42, iov_len = 1} #20 0x0000000000444a35 in doveadm_server_log_handler (ctx=0x7f8bb6805bd0 <failure_ctx_warning>, format=0x7f8bb65bac69 "Raw backtrace for leaks: %s", args=0x7ffef81dcfb0) at client-connection.c:64 c = 3 '\003' corked = false str = 0x228e050 ptr = 0x0 start = 0x228e088 "Raw backtrace for leaks: /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-ser"... va = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} _data_stack_cur_id = 4 #21 0x00007f8bb654afdc in i_warning (format=0x7f8bb65bac69 "Raw backtrace for leaks: %s") at failures.c:325 old_errno = 0 args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} #22 0x00007f8bb656d8cd in io_loop_destroy (_ioloop=0x7ffef81dd138) at ioloop.c:766 backtrace = 0x228dc38 "/usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/"... ioloop = 0x221ddc0 to_idx = 0x221dfe0 item = 0x0 leaks = true __FUNCTION__ = "io_loop_destroy" #23 0x00000000004454d1 in doveadm_cmd_handle (conn=0x22059d8, cmd_name=0x21b8c20 "dsync-server", argc=3, argv=0x21b8c50, cctx=0x7ffef81dd1b0) at client-connection.c:337 ioloop = 0x0 prev_ioloop = 0x21bfc40 cmd = 0x0 mail_cmd = 0x21c65e8 mctx = 0x221d9f8 cmd_ver2 = 0x0 #24 0x0000000000445793 in client_handle_command (conn=0x22059d8, args=0x21b8c40) at client-connection.c:399 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x21b8c19 "reuben", cli = false, tcp_server = true, local_ip = {family = 10, u = {ip6 = {__in6_u = { ---Type <return> to continue, or q <return> to quit--- Reuben

1 0

dovecot: master: Warning: Sent SIGKILL to 100 imap-login processes
by absolutely_free＠libero.it 07 Oct '17

07 Oct '17

Hi, I am using Dovecot 2.2.32 (dfbe293d4) I noticed lots of messages like: dovecot: master: Warning: Sent SIGKILL to 100 imap-login processes in /var/log/maillog I commented out "process_limit" service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = $default_vsz_limit # Max. number of IMAP processes (connections) process_limit = 1024 } but it seems that value doesn't change (still 100). Any suggestions? Thank you very much!

2 2

Re: moving from mysql to pgsql
by Joseph Tam 06 Oct '17

06 Oct '17

mws(a)alpenjodel.de writes: > 1) select digest('testing123','sha512'); > result: > ?\x4120117b3190ba5e24044732b0b09aa9ed50eb1567705abcbfa78431a4e0a96b1152ed7f4925966b1c82325e186a8100e692e6d2fcb6702572765820d25c7e9e > login fails I think 2 problems here: 1) the encoding should be some modified base64; and 2) this appears to compute the SHA512 hash, *not* the SHA512-Crypt hash, which is different. It involves adding a salt and doing many iterations of SHA512. A totally different algorithm. Perusing the PostgreSQL man pages, I think you need something like crypt(password,gen_salt('sha512')) I made the 'sha512' up -- I can't find PostgresSQL docs stating whether it supports this value. The docs I found support the older SHA1 ($5$) crypt hashes. If your version doesn't support creating SHA512 ($6$) salts, you can create your own by replacing gen_salt() with "$6$" + base64(long random value), and feed that to crypt(). Just as long as PostgreSQL uses the system crypt() and not its own implementation, it should produce a usable hash. Joseph Tam <jtam.home(a)gmail.com>

1 0

How to require client SSL certificate, except for local connections
by Evan Martin 06 Oct '17

06 Oct '17

Is there any way to make Dovecot 2.2.22 not require a client SSL certificate for a local IMAP connection, but require it for any remote IMAP connection? My server is configured to require client certificates: ssl = required ... auth_ssl_require_client_cert = yes I tried adding the following to create an exception for localhost: remote 127.0.0.1 { ssl = no auth_ssl_require_client_cert = no disable_plaintext_auth = no } But Dovecot fails to start with: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 81: Auth settings not supported inside local/remote blocks: Is there any other way to do this? I don't need to override any other auth settings, just that one. I could probably use a Unix socket, if that would help. Thanks, Evan

1 0

Director DNS
by Travis Dolan 06 Oct '17

06 Oct '17

Hello, I am currently running 2.2.31. I have a cluster of dovecot instances running in AWS. - Two instances running Director/Proxy - Two instances running Dovecot. -- Storage for the Dovecot instances is EFS. My setup works, requests for 143 hit my Director cluster and are proxied to an appropriate dovecot backend. My question is how often if at all the Director service looks up the addresses for the following setting... *director_servers = mailproxy.internal* I have created a Lambda to continually update the values for the A records found in the *.internal* zone since EC2 instances can come and go for a variety of reasons. If those values changes will the Director service "notice" or will a "service dovecot restart" be needed? Thank in advance.

2 1

Re: ACL permission: give permission to move email into different folder
by Davide Marchi 06 Oct '17

06 Oct '17

> I've set ACL for two user (two primary email address, no alias), where > these users must not be able to delete email from imap server. > Now I would like to add (from the client) the ability to move any > incoming mail into different directory, if possible into an existing > directory chosen by me. Maybe it is not possible with Dovecot? Many Thanks Davide

2 1

seccomp filter for dovecot
by Phoenix Krypt 06 Oct '17

06 Oct '17

Hi, I would like to contribute to dovecot by adding seccomp system call filtering. Is this something you would like to merge into the dovecot codebase? If so, I can put up a PR on github once I complete it. Thanks, Archana

2 2

Dovecot Performance Issues on VMWARE Esxi
by Holger 06 Oct '17

06 Oct '17

Hello, I'm new to dovcot, but have serious issues with dovecot and IMAP. I'm struggling with low IMAP performance but have no glue, where to start my search. It is a small office setup. 10 Mailaccounts. Mine is the biggest with 4GB in size. But searching for mail takes several seconds... Zu switch to specific folder also takes some seconds. To long in my opinion. I use esxi 6.0 with local datastorage lenovo megaraid raid5 3x2TB SAS 7.2K. On the dovecot appliance i see high iowait. Some issues dovecot or the VM config? Any help i would appreciate... -- Sent from: http://dovecot.2317879.n4.nabble.com/

3 2

moving from mysql to pgsql
by Magnus 06 Oct '17

06 Oct '17

Hello, I hope that this mailing list is "alive", since I am looking for a solution for my problem for a long time. I would like to migrate my existing dovecot installation from mysql to pgsql. But I have problems with the passwords when using pgsql. The existing and working mysql-based installation looks like this: dovecot-sql.conf.ext: driver = mysql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,ENCRYPT('Test'),'mws(a)alpenjodel.de'); This setup is working, which I can verify like this: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test OK Now let's take a look at the pgsql version of the setup: dovecot-sql.conf.ext: driver = pgsql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,crypt('Test',gen_salt('des')),'mws(a)alpenjodel.de'); This setup is not working: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test a NO [AUTHENTICATIONFAILED] Authentication failed. Assumptions: - I believe that the mysql encrypt function uses the crypt system call, which in turn uses the DES algorithm with a random salt. - I believe that the same is done with the pgsql function call crypt('Test',gen_salt('des')). But obviously some of these assumptions must be wrong. Besides that, the variable "default_pass_scheme" is set to "SHA512-CRYPT" in both cases. But obviously, not SHA but DES is used by the working mysql-based setup. I don't understand that. Could someone please explain the relationship between the default_pass_scheme variable and the encryption/hashing algorithm used to store the user passwords? And finally: What can I do to migrate to pgsql? Thank you Magnus

4 3

v2.2.33 release candidate released
by Timo Sirainen 05 Oct '17

05 Oct '17

https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz.sig There are a couple more small changes still coming, but this should be very close to the final release. I'm especially interested in hearing if there are any problems with doveadm log proxying or with director. We've improved our automated director tests quite a lot now, and fixed some rarely occurring bugs. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails.

1 0

Issue with imap folder structure
by absolutely_free＠libero.it 05 Oct '17

05 Oct '17

Hi, I use Dovecot 2.2.32 I just migrated spool from another server (by copying filesystem, I use maildir), this is an example of mailbox's content: drwx------ 20 postfix postfix 30 Oct 4 18:38 . drwx------ 3 postfix postfix 3 Nov 16 2012 .. drwx------ 5 postfix postfix 11 Jun 19 18:22 .Deleted Items drwx------ 5 postfix postfix 11 Sep 29 09:27 .Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Sent drwx------ 5 postfix postfix 9 Oct 3 18:01 .INBOX.Trash drwx------ 5 postfix postfix 12 Sep 29 09:27 .Junk drwx------ 5 postfix postfix 8 Dec 9 2014 .Junk E-mail drwx------ 5 postfix postfix 8 Nov 11 2015 .Archive drwx------ 5 postfix postfix 9 Oct 2 14:18 .Posta indesiderata drwx------ 5 postfix postfix 9 Jun 19 18:22 .Posta inviata drwx------ 5 postfix postfix 10 Oct 4 12:27 .Sent drwx------ 5 postfix postfix 10 Oct 4 18:01 .Trash drwx------ 2 postfix postfix 215 Oct 4 18:00 cur -rw------- 1 postfix postfix 53 Feb 16 2017 dovecot-keywords -rw------- 1 postfix postfix 13963 Oct 4 16:45 dovecot-uidlist -rw------- 1 postfix postfix 8 Oct 3 18:01 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Nov 27 2015 dovecot-uidvalidity.5658162a -r--r--r-- 1 postfix postfix 0 Sep 27 18:18 dovecot-uidvalidity.59cbcf5c -rw------- 1 postfix postfix 7200 Sep 29 01:19 dovecot.index -rw------- 1 postfix postfix 63336 Oct 4 18:00 dovecot.index.cache -rw------- 1 postfix postfix 6436 Oct 4 18:38 dovecot.index.log -rw------- 1 postfix postfix 216 Oct 3 18:01 dovecot.mailbox.log drwx------ 2 postfix postfix 2 Oct 4 16:45 new -rw------- 1 postfix postfix 96 Oct 3 18:01 subscriptions drwx------ 2 postfix postfix 2 Oct 4 16:12 tmp and this is my Dovecot's conf: auth_mechanisms = plain login digest-md5 cram-md5 disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 mail_gid = 1003 mail_location = maildir:/var/spool/virtual/domains mail_privileged_group = postfix mail_uid = 1003 namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/wildcard.domain.net_bundle.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql It seems I have duplicate folder (for example during webmail access, I use Roundcube). What is wrong with my setup? Thank you

3 4

STAT command error
by Andrew Charnley 04 Oct '17

04 Oct '17

Hi, Unsure if my previous message made it through as didn't see it on a digest. I'm using Claws Email and 3 of 4 email accounts keep giving; [10:50:45] POP< +OK Dovecot ready. [10:50:45] POP> USER sales [10:50:45] POP< +OK [10:50:45] POP> PASS ******** [10:50:45] POP< +OK Logged in. [10:50:45] POP> STAT [10:50:45] POP< -ERR Unknown command: *** error occurred on POP session *** Error occurred while processing mail. I've turned on as much logging as I can find in Dovecot but nothing useful is coming out, it honestly does believe STAT is invalid - I can see the connection close rather than disconnect. It's strange how it works for one account but not others, the settings are identical - I went through them with a fine tooth comb. Any suggestions appreciated. Regards, Andrew

2 1

ACL permission: give permission to move email into different folder
by Davide Marchi 03 Oct '17

03 Oct '17

Hi friends, I've set ACL for two user (two primary email address, no alias), where these users must not be able to delete email from imap server. Now I would like to add (from the client) the ability to move any incoming mail into different directory, if possible into an existing directory chosen by me. These are the settings on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip is it possible? I've read https://wiki2.dovecot.org/ACL but I've not found a solution. many many thanks! Davide

1 0