- dovecot - dovecot.org

Aborted dsync backup and resulting fallout
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I am in the middle of setting up a dovecot imap server to replace an aging cyrus imapd. The new server is using mdbox storage for better filesystem performance and is running dovecot-2.2.32. To migrate email over and keep UIDs etc. intact I used the backup feature of doveadm. During testing this generally worked fine. So thanks for that functionality, it really makes migration much easier. I did another sync yesterday which was unintentionally aborted in the middle which left some corrupted files around. Not a problem generally, that's what doveadm force-resync should fix. It did move a m.2 to m.2.broken mailbox file, so that is good. But it seemed to have issues with the m.3 file, which was an empty file of 0 bytes. Even running force-resync a repeatedly always showed the same message: # doveadm force-resync -u cd INBOX doveadm(cd): Warning: fscking index file /var/spool/imap/user/cd/storage/dovecot.map.index doveadm(cd): Warning: mdbox /var/spool/imap/user/cd/storage: rebuilding indexes doveadm(cd): Error: Corrupted dbox file /var/spool/imap/user/cd/storage/m.3 (around offset=0): EOF while reading file header doveadm(cd): Error: mdbox rebuild: Failed to fix file /var/spool/imap/user/cd/storage/m.3 This looks like incorrect behavior. If the file header on a file expected to be a mailbox header is absent, I would expect it to be either best-effort parsed and the header added or at least be moved out of the way as e.g. m.3.broken. After fixing the m.3 storage manually I encountered another kind of error running dsync again: dsync(cd): Error: lucene index /var/spool/imap/user/cd/lucene-indexes: IndexReader::open() failed (#1): IndexInput read past EOF Lucene index broken should be easily fixed by running doveadm fts rescan. Is that correct? The other error thought had to do with the single instance store for attachments. There were a bunch of errors about a broken pipe and three errors stating success instead: dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/c3/0c/hashes/c30cb535927c8bcecb0d45d374624942d0f4e56e: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/0f/0b/hashes/0f0b5351e09ebb487660f23c9b617568093b93d1: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/10/f9/hashes/10f9a4ffd14a5c31f9938c9d8a3ce3f2095fab36: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/9b/9a/hashes/9b9a449477882dfca86e80157616cadbb21bb3b8: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/df/69/hashes/df698a8bda301a7a474ae2b11414c6f532f4461e: Broken pipe As with the m.3 storage file, all these files had 0 byte size. What is the best way of fixing these up? Delete and be done? Thanks, Andreas

1 0

FTS Dealing badly with Tika failures
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I've seen that latest Dovecot has the ability to use the Apache Tika Server to extract metadata from attachments. That is a pretty useful feature and looks to be an improvement over piping the attachment through a shellscript as done with fts_decoder. Having this feature enabled though I sometimes do see the situation that the tika service does not reply in time and it looks like the whole FTS transaction gets aborted: dovecot: indexer-worker(eggs@localhost): Error: fts_tika: PUT http://localhost:9998/tika/ failed: Request timed out (Request queued 60.145 secs ago, 1 attempts in 60.134 secs, 60.034 in http ioloop, 0.000 in other ioloops, connected 1739.235 secs ago) dovecot: indexer-worker(eggs@localhost): Error: Mailbox INBOX.junk: Mail search failed: Internal error occurred. Refer to server log for more information. [2017-10-09 03:46:09] dovecot: indexer-worker(eggs(a)bawue.de): Error: Mailbox INBOX.junk: Transaction commit failed: FTS transaction commit failed: transaction context (attempted to index 12084 messages (UIDs 2..17850)) Is that actually sensible behavior? I would consider attachment metadata to be nice to have, but not necessarily mandatory. So if the attachment indexing fails, I would hope that at least the mailtext got indexed. But it seems like we abort the whole transaction. Am I reading the error log correctly? cheers, Andreas

1 0

dovecot-2.2.33 bug report
by David Binderman 11 Oct '17

11 Oct '17

Hello there, dovecot-2.2.33/src/lib/str-find.c:86]: (warning) Calling 'sizeof' on 'sizeof' Source code is ctx = p_malloc(pool, MALLOC_ADD(sizeof(struct str_find_context), MALLOC_MULTIPLY(sizeof(ctx->goodtab[0]), key_len))); Regards David Binderman

2 1

Re: My sub-folder with Outlook work-around to date - update 201710111315 - Final
by David.M.Clark 11 Oct '17

11 Oct '17

Hi All, After over a week of stuffing around in /etc/dovecot/conf.d files and lots of trial and error, I now have a controlled setup to migrate one user at a time to Maildir without affecting the other mbox based users. For the sake of not posting an essay, if you go to this web page: http://dmc1961.id.au/howto_17101101.php you will see what I have done (moderators please let me know if this is the correct or allowable practice to post links rather than massive e-mails to the group?). My sincere thanks to all who contributed and helped steer me in the right direction - I got a little lost on-line for a while but eventually got back to the right setup (our beloved Linux does have a few different file locations and setup based on the releases out there, so these were a little confusing). Working well now on my test environment and on a test user on the client's box we need to convert, so if there are any more gotchas I will add them to the how-to web page and update you all. Was a battle at times but it was a war worth winning. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

Issue with mailbox conversion using dsync in v2.2.32 (maildir <-> mdbox)
by Jason Kiniry 11 Oct '17

11 Oct '17

Hi all, I've run into an issue with in-place mailbox format conversions between mdbox and maildir and wondered if someone could assist. When using dsync to convert a mailbox, the conversion loses a mailbox GUID and produces a warning. This behavior seems to have been introduced between version 2.2.31 and 2.2.32. See below for the full debug output from both versions followed by the dovecot configuration used for both attempts. When I run the following: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/blahmail/mail -u _mainaccount(a)blahmail.tld -v mirror maildir:/home/blahmail/mail On version 2.2.32, I get the following with the warning included on the last line of the output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)blahmail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_gid=1081 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_uid=1137 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_user=blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Effective uid=1137, gid=1081, home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: fs: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)blahmail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/INBOX doesn't exist yet, using default permissions doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: Effective uid=1137, gid=1081, home=/home/blahmail dsync(blahmail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(blahmail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(blahmail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(blahmail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(blahmail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/blahmail/mail dsync(blahmail): Debug: maildir++: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=/home/blahmail/mail, alt= dsync(blahmail): Debug: fs quota add mailbox dir = /home/blahmail/mail dsync(blahmail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(blahmail): Debug: fs quota mount point = / dsync(blahmail): Debug: fs quota mount type = xfs dsync(blahmail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(blahmail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(blahmail): Debug: fts: Indexes disabled for namespace '' dsync(blahmail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(blahmail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: brain M: Local mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Mailbox INBOX: local=60f6d91a25fddb5983040000a19766e2/0/1, remote=e6191d3644fddb59e2040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=61f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=62f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=63f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=64f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: brain S: Remote mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Mailbox INBOX: local=e6191d3644fddb59e2040000a19766e2/0/1, remote=60f6d91a25fddb5983040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain S: Mailbox INBOX.Drafts: local=61f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Junk: local=62f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Sent: local=63f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Trash: local=64f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Change during sync: Mailbox GUID e6191d3644fddb59e2040000a19766e2 was lost dsync(blahmail): Debug: brain S: We don't have mailbox e6191d3644fddb59e2040000a19766e2 dsync(blahmail): Debug: brain M: Change during sync: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) -------------------------------------------------------------------------------------------------------------------------------------------- Previously, on 2.2.31 I ran: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/mymail/mail -u _mainaccount(a)mymail.tld -v mirror maildir:/home/mymail/mail And got the following successful conversion output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)mymail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_gid=1077 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_uid=1134 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_user=mymail doveadm(_mainaccount(a)mymail.tld): Debug: Effective uid=1134, gid=1077, home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: fs: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default doveadm(_mainaccount(a)mymail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)mymail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Effective uid=1134, gid=1077, home=/home/mymail dsync(mymail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(mymail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(mymail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(mymail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(mymail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mymail/mail dsync(mymail): Debug: maildir++: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=/home/mymail/mail, alt= dsync(mymail): Debug: fs quota add mailbox dir = /home/mymail/mail dsync(mymail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(mymail): Debug: fs quota mount point = / dsync(mymail): Debug: fs quota mount type = xfs dsync(mymail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(mymail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(mymail): Debug: fts: Indexes disabled for namespace '' dsync(mymail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(mymail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: brain M: Local mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Mailbox INBOX: local=00000000000000000000000000000000/0/0, remote=a884611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=a984611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=aa84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=ab84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=ac84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/INBOX doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: brain S: Remote mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Mailbox INBOX: local=a884611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Drafts: local=a984611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Junk: local=aa84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Sent: local=ab84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Trash: local=ac84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Import change type=save GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=1 hdr_hash= result=Mail's UID is above local UIDNEXT - No more local mails found dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: prefetch dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: access dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain M: import mail uid 0 guid 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 dsync(mymail): Debug: brain M: Import INBOX: Import mail body for GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: copying dsync(mymail): Debug: /home/mymail/mail/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Compressed, file_seq changed 0 -> 1507586868, size=32, max_uid=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain S: Import INBOX: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Warning: quota: Namespace 'INBOX.' is not Maildir, skipping for Maildir++ quota dsync(mymail): Debug: brain M: Import INBOX: Saved UIDs: 1 dsync(mymail): Debug: brain M: Import INBOX: Finish update: min_next_uid=2 min_first_recent_uid=1 min_highest_modseq=2 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 -------------------------------------------------------------------------------------------------------------------------------------------- dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.6.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_cache_size = 819 M auth_mechanisms = plain login auth_policy_hash_mech = sha512 auth_policy_hash_nonce = 85979662 auth_policy_hash_truncate = 64 auth_policy_request_attributes = auth_database=mail database=mail service=dovecot username=%{orig_user} authtoken_hash=$0$0$%{hashed_password} local_host=%{real_lip} local_port=%{real_lport} remote_host=%{real_rip} remote_port=%{real_rport} auth_policy_server_api_header = X-API-Key:dovecot:4FR0BN8IWTpSnB42 auth_policy_server_timeout_msecs = 3000 auth_policy_server_url = http://127.0.0.1:579/dovecot-auth-policy auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes lmtp_user_concurrency_limit = 4 mail_access_groups = dovecot mail_plugins = quota quota_clone zlib fts fts_solr mail_prefetch_count = 20 mailbox_list_index = yes maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = create special_use = \Junk } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict-domain_owner_mail_pass.conf driver = dict result_failure = return-fail skip = authenticated } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword skip = authenticated } plugin { acl = vfile:cache_secs=86400 fts = solr fts_solr = url= http://WVJMEK57hc3cg712:9v9W13cT8fTYaXkQ@127.0.0.1:8984/solr/dovecot/ quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded } protocols = lmtp imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 565 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual fts fts_solr namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota quota quota_clone virtual zlib namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } local_name jason64.dev.cpanel.net { ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_key = # hidden, use -P to show it } local_name adomain.tld www.adomain.tld mail.adomain.tld webmail.adomain.tld cpanel.adomain.tld autodiscover.adomain.tld webdisk.adomain.tld { ssl_cert = </var/cpanel/ssl/domain_tls/adomain.tld/combined ssl_key = # hidden, use -P to show it } local_name argon.tld www.argon.tld mail.argon.tld xenon.tld carbon.tld helium.tld oxygen.tld chlorine.tld hydrogen.tld www.xenon.tld www.carbon.tld www.helium.tld www.oxygen.tld www.chlorine.tld www.hydrogen.tld mail.xenon.tld mail.carbon.tld mail.helium.tld mail.oxygen.tld mail.chlorine.tld mail.hydrogen.tld webmail.argon.tld cpanel.argon.tld autodiscover.argon.tld webdisk.argon.tld www.mail.argon.tld { ssl_cert = </var/cpanel/ssl/domain_tls/argon.tld/combined ssl_key = # hidden, use -P to show it } -------------------------------------------------------------------------------------------------------------------------------------------- I'm starting to narrow down on which commit introduced the problem, but that'll take some time. If anyone knows which commit caused this or knows of a fix, please let me know. Thank you very much! Regards, Jason

2 2

Parallel build problems with dovecot 2.2.32
by Craig Leres 10 Oct '17

10 Oct '17

I use dovecot under FreeBSD 10.3 and build using poudriere. My build server has 12 cores builds typically happen in parallel and I find software that is not parallel make friendly will fail once every month or so. Attached is a build log from this afternoon that failed because doveadm-util.o had not finished building when the attempt to link test-doveadm-util happened. Looking in src/doveadm/Makefile* in the build tree the only place I see doveadm-util.o is in a make variable: test_doveadm_util_LDADD = doveadm-util.o $(test_libs) $(MODULE_LIBS) This is only used in the test-doveadm-util rule: test-doveadm-util$(EXEEXT): $(test_doveadm_util_OBJECTS) $(test_doveadm_util_DEPENDENCIES) $(EXTRA_test_doveadm_util_DEPENDENCIES) @rm -f test-doveadm-util$(EXEEXT) $(AM_V_CCLD)$(LINK) $(test_doveadm_util_OBJECTS) $(test_doveadm_util_LDADD) $(LIBS) So the problem is that doveadm-util.o needs to be an explicit dependency for test-doveadm-util. I believe one possible fix would be to add doveadm-util.o to test_doveadm_util_DEPENDENCIES: test_doveadm_util_DEPENDENCIES = $(test_deps) bug this isn't something that can easily tested. Craig

2 2

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

First of all excuse.. I am having an issue getting maillist responses so I may be responding to this worng No on topic I commented out the first user_quesry The second query was not copied correctly , reads user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=‘1' still have the same error I did a comparison between the data contained in the sql file and my mail directory and found that they are not consistent Apparently postfixadmin, which I have been using, does not update the maildir I am surprised I am getting any mail at all. I think I have to take this back to ground zero "I see two problems: 1) you have two user_querys, there should only be one 2) your 2nd user_query is not limiting the SQL search with a WHERE clause"

3 2

Sieve rules not processing
by Stephan Herker 10 Oct '17

10 Oct '17

I'm new to dovecot altogether and I have a working dovecot system. I'm trying to setup sieve for mail filtering. If I run the debug program sieve-test I get a positive result that it would have sorted the mail appropriately, but the logs for lmtp don't appear to be processing the rule. Below is output of dovecot -n. Any help is appreciated. Thanks # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login first_valid_uid = 2000 last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = administrator(a)keagaming.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota autocreate sieve quota" postmaster_address = postmaster(a)keagaming.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota quota" }

2 3

Trash quota issue
by Stephan Herker 10 Oct '17

10 Oct '17

I have quotas setup on a test domain to try everything out before I move my domains email over to dovecot. I have a trash quota rule that should have added 100M to trash folder specifically, but mail was denied due to quota being full even though the only mail in the test account was in trash. Below are debug log lines and dovecot -n output. Oct 07 17:16:03 lmtp(26801): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:16:03 lmtp(26801): Info: Connect from local Oct 07 17:16:03 lmtp(26801): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: plugin/quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=20480000 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=2048000 (10%) Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin is not up-to-date Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script `main script' from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script successfully compiled Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Info: OFqmG0Nu2VmxaAAAobcTNA: sieve: msgid=<3a1e5ba2-f0a7-4cec-e7fb-bf5202c2152d(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

1 0

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

This apparently was a problem that i was not aware since i redid my mail server configuration to make use of Postfixadmin. I have update the conf files using the postfix document fromthe down load. The download document seems to be fpr an early version of dovecot (I am using 2.2.4) as it focuse of dovecot.conf which is now broken into file in the conf.d subdirectory I get "dovecot: auth-worker(30555): sql(abuse(a)examplei.com): unknown user " I imagine this is a conf problem and deals with reading the sql daya I have confirmed the dayta is there The major file apperas to be dovecot-sql.conf.ext Mine reads as follows driver = mysql connect = host=127.0.0.1 dbname=postfix user=postfix password=postfixadmin password_query = SELECT username, password FROM mailbox WHERE username='%u' and active =" default_pass_scheme = MD5-CRYPT user_query = SELECT maildir, 5000 AS uid, 5000 AS gid FROM mailbox WHERE username = '%u' user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid Since normal mail is habdled by dovecoy It would see somthing is wrong wihh the first user_query since it appears to be the one that should fine the alias user Any hellp or suggestions would be appreciate

2 1