Hello Alan,
thank you very much for your help. You were right about the version issue. I hadn't realized that I wasn't running the latest version of dovecot. Now the dsync migration of my mails was successful.
Thanks again for your assistance.
Helge
Am 22.09.2014 um 15:21 schrieb Alan McGinlay:
On 2014-09-22 13:01, Helge Kraak wrote:
No one? Am 19.09.2014 um 00:57 schrieb Helge Kraak: Hello, I'm aware of these two threads http://www.dovecot.org/pipermail/dovecot/2012-March/thread.html#134311 http://dovecot.org/pipermail/dovecot/2012-June/thread.html#136488 but unfortunately I wasn't successful with my dsync mailbox migration attempt despite the information I could find there. I'm using iRedMail setup for the dovecot server. I made sure that the dovecot mailbox for the mail import had been freshly created and untouched before I tried to run the following command. Running this command: sudo doveadm -vvv -o imapc_host=xxx.de -o imapc_user=username -o imapc_password=password -o mail_fsync=never -o mail_prefetch_count=20 -o imapc_features=rfc822.size -o imapc_features=fetch-headers -o imapc_port=993 -o imapc_ssl=imaps -o imapc_ssl_ca_dir=/etc/ssl -o imapc_ssl_verify=no -o imapc_features=rfc822.size -o mailbox_list_index=no -D backup -R -u michael@domain.com imapc: I get the following output (I took out some lines obviously not relevant): doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(michael@domain.com): Debug: Added userdb setting: plugin/master_user=michael@domain.com doveadm(michael@domain.com): Debug: Added userdb setting: plugin/quota_rule=*:bytes=41943040000 doveadm(michael@domain.com): Debug: Effective uid=2000, gid=2000, home=/var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59/ doveadm(michael@domain.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir/:INDEX=//var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir/ doveadm(michael@domain.com): Debug: maildir++: root=//var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir, index=, control=, inbox=//var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir, alt= doveadm(michael@domain.com): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/Shared/%u doveadm(michael@domain.com): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= dsync(michael@domain.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(michael@domain.com): Debug: imapc: root=, index=, control=, inbox=, alt= dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Looking up IP address dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Connecting to 78.138.89.136:993 dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Starting SSL handshake dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Authenticating as username dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Authenticated successfully dsync(michael@domain.com): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/Shared/%u dsync(michael@domain.com): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= dsync(michael@domain.com): Debug: Namespace : Using permissions from //var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir: mode=0700 gid=-1 dsync(michael@domain.com): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync(michael@domain.com): Info: Amazon: uidnext changed: 1056 != 1 dsync(michael@domain.com): Info: INBOX: only in dest (guid=3c68c835800a07547d45000029cbe4c2)= 1 dsync(michael@domain.com): Info: Deleted Messages: uidnext changed: 109 != 1 dsync(michael@domain.com): Info: MBA Mails: uidnext changed: 444 != 1 dsync(michael@domain.com): Info: Archive: highest_modseq changed: 0 != 1 dsync(michael@domain.com): Info: Spam: uidnext changed: 3 != 1 dsync(michael@domain.com): Info: Apple Mail To Do: highest_modseq changed: 0 != 1 dsync(michael@domain.com): Info: Jobsuche: uidnext changed: 22436 != 1 dsync(michael@domain.com): Info: Trash (Messages): uidnext changed: 697 != 1 dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Looking up IP address dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Connecting to IP-Adress:993 dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Starting SSL handshake dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Authenticating as username dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Authenticated successfully dsync(michael@domain.com): Error: Trying to open a non-listed mailbox with guid=3c68c835800a07547d45000029cbe4c2 dsync(michael@domain.com): Error: msg iteration failed: Couldn't open mailbox 3c68c835800a07547d45000029cbe4c2 dsync(michael@domain.com): Error: Trying to open a non-listed mailbox with guid=3c68c835800a07547d45000029cbe4c2 dsync(michael@domain.com): Debug: imapc(s04.xxx.de:993): Disconnected sudo dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.6 auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 last_valid_uid = 2000 listen = * log_path = /var/log/dovecot.log mail_gid = 2000 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_plugins = quota mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } namespace { list = children location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-master-users-password driver = passwd-file master = yes } plugin { acl = vfile acl_shared_dict = proxy::acl auth_socket_path = /var/run/dovecot/auth-master quota = dict:user::proxy::quotadict quota_rule = *:storage=1G quota_warning = storage=85%% quota-warning 85 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=95%% quota-warning 95 %u sieve = /%Lh/sieve/dovecot.sieve sieve_default = /var/vmail/sieve/dovecot.sieve sieve_dir = /%Lh/sieve sieve_global_dir = /var/vmail/sieve } protocols = pop3 imap sieve lmtp service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service lmtp { executable = lmtp -L inet_listener lmtp { port = 24 } process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service pop3-login { service_count = 1 } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } ssl = required ssl_cert =
I seem to remember having similar issues with dsync on that dovecot version. I am not 100% sure as it was a while ago now.
Currently using very similar settings to migrate from a cyrus box on solaris 10 and dsync works well. I use Dovecot 2.2.13 from the following ubuntu ppa:
https://launchpad.net/~bigmichi1/+archive/ubuntu/dovecot
(the ppa owner is on this list I think)
There have been a lot of fixes to dsync since 2.2.7 so it might be worth upgrading.
/A