Issue with mailbox conversion using dsync in v2.2.32 (maildir <-> mdbox)
Hi all,
I've run into an issue with in-place mailbox format conversions between mdbox and maildir and wondered if someone could assist. When using dsync to convert a mailbox, the conversion loses a mailbox GUID and produces a warning. This behavior seems to have been introduced between version 2.2.31 and 2.2.32. See below for the full debug output from both versions followed by the dovecot configuration used for both attempts.
When I run the following:
/usr/bin/dsync -f -D -o mail_location=mdbox:/home/blahmail/mail -u _mainaccount@blahmail.tld -v mirror maildir:/home/blahmail/mail
On version 2.2.32, I get the following with the warning included on the last line of the output:
Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount@blahmail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_gid=1081 doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/blahmail doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/blahmail/mail doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_uid=1137 doveadm(_mainaccount@blahmail.tld): Debug: Added userdb setting: plugin/userdb_user=blahmail doveadm(_mainaccount@blahmail.tld): Debug: Effective uid=1137, gid=1081, home=/home/blahmail doveadm(_mainaccount@blahmail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount@blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount@blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount@blahmail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount@blahmail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount@blahmail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount@blahmail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/blahmail/mail doveadm(_mainaccount@blahmail.tld): Debug: fs: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount@blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default doveadm(_mainaccount@blahmail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount@blahmail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount@blahmail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount@blahmail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount@blahmail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping doveadm(_mainaccount@blahmail.tld): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/INBOX doesn't exist yet, using default permissions doveadm(_mainaccount@blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: Effective uid=1137, gid=1081, home=/home/blahmail dsync(blahmail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(blahmail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(blahmail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(blahmail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(blahmail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/blahmail/mail dsync(blahmail): Debug: maildir++: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=/home/blahmail/mail, alt= dsync(blahmail): Debug: fs quota add mailbox dir = /home/blahmail/mail dsync(blahmail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(blahmail): Debug: fs quota mount point = / dsync(blahmail): Debug: fs quota mount type = xfs dsync(blahmail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(blahmail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(blahmail): Debug: fts: Indexes disabled for namespace '' dsync(blahmail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(blahmail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: brain M: Local mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Mailbox INBOX: local=60f6d91a25fddb5983040000a19766e2/0/1, remote=e6191d3644fddb59e2040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=61f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=62f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=63f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=64f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: brain S: Remote mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Mailbox INBOX: local=e6191d3644fddb59e2040000a19766e2/0/1, remote=60f6d91a25fddb5983040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain S: Mailbox INBOX.Drafts: local=61f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Junk: local=62f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Sent: local=63f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Trash: local=64f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Change during sync: Mailbox GUID e6191d3644fddb59e2040000a19766e2 was lost dsync(blahmail): Debug: brain S: We don't have mailbox e6191d3644fddb59e2040000a19766e2 dsync(blahmail): Debug: brain M: Change during sync: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?)
Previously, on 2.2.31 I ran:
/usr/bin/dsync -f -D -o mail_location=mdbox:/home/mymail/mail -u _mainaccount@mymail.tld -v mirror maildir:/home/mymail/mail
And got the following successful conversion output:
Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount@mymail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_gid=1077 doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/mymail doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/mymail/mail doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_uid=1134 doveadm(_mainaccount@mymail.tld): Debug: Added userdb setting: plugin/userdb_user=mymail doveadm(_mainaccount@mymail.tld): Debug: Effective uid=1134, gid=1077, home=/home/mymail doveadm(_mainaccount@mymail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount@mymail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount@mymail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount@mymail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount@mymail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount@mymail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount@mymail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/mymail/mail doveadm(_mainaccount@mymail.tld): Debug: fs: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount@mymail.tld): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default doveadm(_mainaccount@mymail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount@mymail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount@mymail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount@mymail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount@mymail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Effective uid=1134, gid=1077, home=/home/mymail dsync(mymail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(mymail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(mymail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(mymail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(mymail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mymail/mail dsync(mymail): Debug: maildir++: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=/home/mymail/mail, alt= dsync(mymail): Debug: fs quota add mailbox dir = /home/mymail/mail dsync(mymail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(mymail): Debug: fs quota mount point = / dsync(mymail): Debug: fs quota mount type = xfs dsync(mymail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(mymail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(mymail): Debug: fts: Indexes disabled for namespace '' dsync(mymail): Debug: quota: quota_over_flag check: quota_over_script unset
- skipping dsync(mymail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: brain M: Local mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Mailbox INBOX: local=00000000000000000000000000000000/0/0, remote=a884611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=a984611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=aa84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=ab84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=ac84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/INBOX doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: brain S: Remote mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Mailbox INBOX: local=a884611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Drafts: local=a984611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Junk: local=aa84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Sent: local=ab84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Trash: local=ac84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Import change type=save GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=1 hdr_hash= result=Mail's UID is above local UIDNEXT - No more local mails found dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: prefetch dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: access dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain M: import mail uid 0 guid 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 dsync(mymail): Debug: brain M: Import INBOX: Import mail body for GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: copying dsync(mymail): Debug: /home/mymail/mail/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Compressed, file_seq changed 0 -> 1507586868, size=32, max_uid=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain S: Import INBOX: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Warning: quota: Namespace 'INBOX.' is not Maildir, skipping for Maildir++ quota dsync(mymail): Debug: brain M: Import INBOX: Saved UIDs: 1 dsync(mymail): Debug: brain M: Import INBOX: Finish update: min_next_uid=2 min_first_recent_uid=1 min_highest_modseq=2 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0
dovecot -n
2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf
OS: Linux 3.10.0-514.6.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708
(Core)
auth_cache_size = 819 M
auth_mechanisms = plain login
auth_policy_hash_mech = sha512
auth_policy_hash_nonce = 85979662
auth_policy_hash_truncate = 64
auth_policy_request_attributes = auth_database=mail database=mail service=dovecot username=%{orig_user} authtoken_hash=$0$0$%{hashed_password} local_host=%{real_lip} local_port=%{real_lport} remote_host=%{real_rip} remote_port=%{real_rport}
auth_policy_server_api_header = X-API-Key:dovecot:4FR0BN8IWTpSnB42
auth_policy_server_timeout_msecs = 3000
auth_policy_server_url = http://127.0.0.1:579/dovecot-auth-policy
auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%"
disable_plaintext_auth = no
first_valid_uid = 201
lda_mailbox_autocreate = yes
lmtp_save_to_detail_mailbox = yes
lmtp_user_concurrency_limit = 4
mail_access_groups = dovecot
mail_plugins = quota quota_clone zlib fts fts_solr
mail_prefetch_count = 20
mailbox_list_index = yes
maildir_very_dirty_syncs = yes
namespace inbox {
inbox = yes
location =
mailbox Archive {
auto = create
special_use = \Archive}
mailbox Archives {
auto = no
special_use = \Archive}
mailbox Drafts {
auto = subscribe
special_use = \Drafts}
mailbox Junk {
auto = create
special_use = \Junk}
mailbox Sent {
auto = subscribe
special_use = \Sent}
mailbox "Sent Messages" {
auto = no
special_use = \Sent}
mailbox Trash {
auto = subscribe
special_use = \Trash}
mailbox spam {
auto = create
special_use = \Junk}
prefix = INBOX.
separator = .
type = private
}
passdb {
args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf
driver = dict
}
passdb {
args = /usr/local/cpanel/etc/dovecot/cpauthd-dict-domain_owner_mail_pass.conf
driver = dict
result_failure = return-fail
skip = authenticated
}
passdb {
args = /usr/local/cpanel/bin/dovecot-wrap
driver = checkpassword
skip = authenticated
}
plugin {
acl = vfile:cache_secs=86400
fts = solr
fts_solr = url= http://WVJMEK57hc3cg712:9v9W13cT8fTYaXkQ@127.0.0.1:8984/solr/dovecot/
quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded
}
protocols = lmtp imap pop3
service auth {
unix_listener auth-client {
mode = 0666}
}
service config {
vsz_limit = 2 G
}
service dict {
unix_listener dict {
group = dovecot
mode = 0660}
}
service imap-login {
client_limit = 500
inet_listener imap {
address = *,::}
inet_listener imaps {
address = *,::}
process_limit = 50
process_min_avail = 2
service_count = 0
vsz_limit = 128 M
}
service imap {
process_limit = 512
vsz_limit = 512 M
}
service lmtp {
client_limit = 1
process_limit = 565
unix_listener lmtp {
group = mail
mode = 0660
user = mailnull}
vsz_limit = 512 M
}
service managesieve-login {
client_limit = 500
process_limit = 50
process_min_avail = 2
service_count = 0
vsz_limit = 128 M
}
service managesieve {
process_limit = 512
vsz_limit = 512 M
}
service pop3-login {
client_limit = 500
inet_listener pop3 {
address = *,::}
inet_listener pop3s {
address = *,::}
process_limit = 50
process_min_avail = 2
service_count = 0
vsz_limit = 128 M
}
service pop3 {
process_limit = 512
vsz_limit = 512 M
}
service quota-status {
executable = quota-status -p postfix
unix_listener quota-status {
mode = 0666}
}
ssl_cert = </etc/dovecot/ssl/dovecot.crt
ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS
ssl_key = # hidden, use -P to show it
ssl_protocols = !SSLv2 !SSLv3
userdb {
driver = prefetch
}
userdb {
args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf
driver = dict
}
userdb {
args = /usr/local/cpanel/bin/dovecot-wrap
driver = checkpassword
}
protocol imap {
imap_capability = +NAMESPACE
imap_idle_notify_interval = 24 mins
imap_logout_format = in=%i, out=%o, bytes=%i/%o
mail_max_userip_connections = 20
mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual fts fts_solr
namespace sent {
hidden = yes
list = no
location =virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u
prefix = sent
separator = .}
namespace spam {
hidden = yes
list = no
location =virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u
prefix = spam
separator = .}
}
protocol pop3 {
mail_max_userip_connections = 3
mail_plugins = quota quota quota_clone virtual zlib
namespace sent {
hidden = yes
list = no
location =virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u
prefix = sent
separator = .}
namespace spam {
hidden = yes
list = no
location =virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u
prefix = spam
separator = .}
pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o
pop3_uidl_format = UID%u-%v
}
protocol lmtp {
mail_plugins = quota quota_clone zlib
postmaster_address = root
quota_full_tempfail = no
}
protocol lda {
mail_plugins = quota quota_clone zlib
postmaster_address = root
quota_full_tempfail = no
}
local_name jason64.dev.cpanel.net {
ssl_cert = </etc/dovecot/ssl/dovecot.crt
ssl_key = # hidden, use -P to show it
}
local_name adomain.tld www.adomain.tld mail.adomain.tld webmail.adomain.tld cpanel.adomain.tld autodiscover.adomain.tld webdisk.adomain.tld {
ssl_cert = </var/cpanel/ssl/domain_tls/adomain.tld/combined
ssl_key = # hidden, use -P to show it
}
local_name argon.tld www.argon.tld mail.argon.tld xenon.tld carbon.tld helium.tld oxygen.tld chlorine.tld hydrogen.tld www.xenon.tld www.carbon.tld www.helium.tld www.oxygen.tld www.chlorine.tld www.hydrogen.tld mail.xenon.tld mail.carbon.tld mail.helium.tld mail.oxygen.tld mail.chlorine.tld mail.hydrogen.tld webmail.argon.tld cpanel.argon.tld autodiscover.argon.tld webdisk.argon.tld www.mail.argon.tld {
ssl_cert = </var/cpanel/ssl/domain_tls/argon.tld/combined
ssl_key = # hidden, use -P to show it
}
I'm starting to narrow down on which commit introduced the problem, but that'll take some time. If anyone knows which commit caused this or knows of a fix, please let me know.
Thank you very much!
Regards,
Jason
On 10 Oct 2017, at 3.36, Jason Kiniry <jason.kiniry@gmail.com> wrote:
Where is the Maildir coming from? Has it been used by Dovecot earlier, or is it something else?
So mdbox apparently didn't exist before you ran dsync.
But here the INBOXes already have conflicting UIDVALIDITYs. One of these was created too early.
I think one of these helps:
- disable quota
- disable quota_clone
- disable mailbox_list_index
Hello Timo,
Thank you for the quick reply! My answers are inline:
On Tue, Oct 10, 2017 at 8:52 AM, Timo Sirainen <tss@iki.fi> wrote:
The maildir is already in use by Dovecot and has received mail. Then we do the conversion in-place to mdbox (or vice versa).
That's correct. We're changing from the maildir format to the mdbox format in-place.
Disabling mailbox_list_index seems to resolve the issue. Unfortunately though, I'm fairly sure we need that setting though for our environment, but mayhap we can just disable it during the sync. Thank you for the suggestion!
Regards,
Jason
participants (2)
-
Jason Kiniry
-
Timo Sirainen