[Dovecot] dsync not copying all mail

[Nick Rosier]

Tobias Daucher wrote:
> Am 10.01.2011 14:59, schrieb Nick Rosier:
>> Hi,
>>
>> I'm still trying to migrate from Dovecot 1.2.16 to 2.0.7 on FreeBSD. 
>> Previous attempts have failed
>> with mails not being visible after the upgrade. Version 1.2.16 was 
>> migrated from maildir to dbox
>> about a year ago via the convert-plugin. After previous attempts to 
>> "clean" the hybrid maildir-dbox
>> situation I used imapsync to copy all mails from the old account to a 
>> new account. I would assume in
>> this case I get a clean dbox-mailmap. I tried to run dsync on this 
>> new map but noticed a lot of
>> mails are not syncing:
>>
>> [vmail at mail ~]$ find /vmail2/new/bunbun.be/nick | wc -l
>> 5329
>> [vmail at mail ~]$ find /vmail2/old/bunbun.be/nick | wc -l
>> 6134
>>
>> Any ideas?
>> N.
>>
>
> deleted mails on old server... do expunge or purge befor syncing. 
> imapsync will not copy deleted messages i think...
>
>
The problem is not imapsync but dsync.

I created a new account nick2 and synced, with imapsync all mails from 
nick to nick2. I moved the old maildir (nick) to nick.old and renamed 
nick2 to nick. I checked the new mail and all mails were there (with the 
exception of 23 mails which according to imapsync were duplicates). So 
at this point I have a new "clean" mailmap; there are no mails missing.

I copied this new mailmap (nick) to a new filesystem (/vmail2/new) to do 
some migration tests and ran dsync to sync these mails.
[vmail at mail ~]$ ./dsync -D -o 
mail_location=dbox:/vmail2/old/bunbun.be/nick mirror 
dbox:/vmail2/new/bunbun.be/nick

When I compare the 2 maildirs there are about 800 files missing:

[vmail at mail ~]$ find /vmail2/new/bunbun.be/nick | wc -l
5329
[vmail at mail ~]$ find /vmail2/old/bunbun.be/nick | wc -l
6134

If I do a diff on the missing files there are maps that are empty and 
where the source contains valid, non-deleted mails.

N.