<html><head><title>Re: doveadm sync backup from old to new server</title>
<meta charset="utf-8" http-equiv="X-UA-Compatible" content="IE=9; IE=8; IE=7; IE=EDGE" />
</head>
<body>
<span style=" font-family:'Courier New'; font-size: 9pt;">So that was really helpful for me to understand that a lot more clearly.<br>
Thanks! [Many, many thanks @Plutocrat!!]<br>
<br>
But I'm still getting a similar failure.<br>
Let me give the command I'm using.<br>
<br>
doveadm backup -D -u user@abc.net \<br>
ssh root@po.abc.net \<br>
docker exec b3093cxxxxxx doveadm sync -D -u user@abc</span><a style=" font-family:'Courier New'; font-size: 9pt;" href=".net">.net</a><br>
<br>
<span style=" font-family:'Courier New'; font-size: 9pt;">The "local" server is where the data/mail currently is.<br>
The remote or docker container/volume is where dovecot is installed. (The data is in a different docker container.)<br>
<br>
So, I think I'm "backing up" the data from the local machine and pushing that "backed up" data via SSH to the dovecot install in docker and attempting to "sync" that data to the remote dovecot install.<br>
<br>
However, I immediately get<br>
"Error: read(remote) failed: EOF (version not received)"<br>
<br>
The connection hangs. If I wait a while - perhaps 30-60s, it kills the SSH connection and aborts the process.<br>
<br>
Is there a way I can test the remote end's ability to accept the data.<br>
[i.e. Can I do something like<br>
ssh root@po.abc.net \<br>
docker exec b3093cxxxxxx doveadm sync -D -u user@abc</span><a style=" font-family:'courier new'; font-size: 9pt;" href=".net">.net</a><br>
<br>
<span style=" font-family:'Courier New'; font-size: 9pt;">And see if it would accept the data. [In short, do I have a local end problem or a remote end problem - and being able to test both parts individually would probably help me figure out what's broken. That still won't fix it, but at least I'll know which end I need to concentrate on.]<br>
<br>
I'd guess this will all seem pretty obvious in retrospect, but for the life of me, I'm completely lost and really don't have any idea where to start to break it down better so I can see how each piece is working or not.<br>
<br>
TIA<br>
-Greg<br>
<br>
<br>
<span style=" color: #800000;"><b>P> I struggled with this at one time, and with the lack of examples<br>
P> around the internet. In fact, I might have written this very post<br>
P> myself at one point! In the end, the penny dropped when I saw that the format was<br>
<br>
P> (command on local server) + (stuff you need to connect over ssh) + (command on remote server)<br>
<br>
P> So what worked for me was:<br>
<br>
P> doveadm backup -u </b></span></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user@domain.com">user@domain.com</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> \<br>
P> ssh -p 2222 (+ other ssh options) </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:root@remoteserver.com">root@remoteserver.com</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> \<br>
P> doveadm dsync-server -u </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user2@domain2.com">user2@domain2.com</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> <br>
<br>
P> If you get<br>
P> dsync-remote(</b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user2@domain2.com">user2@domain2.com</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b>): Error: Mailbox INBOX sync:<br>
P> mailbox_delete failed: INBOX can't be deleted<br>
P> ... you'll need to clear the remote directory first! Or maybe try sync instead of backup?<br>
<br>
P> I found that running as root on the remote server was necessary in<br>
P> my case, due to the permissions on the remote directory. You might<br>
P> want to check permissions on remote directory are writable by the user in your ssh command.<br>
<br>
P> If still no joy you can run<br>
P> doveadm user </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user@domain.com">user@domain.com</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> on your local server and<br>
P> doveadm user </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user2@domain2.com">user2@domain2.com</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> on your remote server<br>
P> and dovecot will tell you where its synching from and to.<br>
<br>
P> Finally, this solution is a 'push' from source server to target.<br>
P> You may 'pull' the other way if that makes more sense in your environment with -R<br>
<br>
P> Those pieces were enough for me to get it to work ...<br>
<br>
P> P.<br>
<br>
P> PS. For the record, on the original job I was under time pressure,<br>
P> and yes, I did use imapsync to get it done in the end. I got this<br>
P> to work later on when I had more time to tinker.<br>
<br>
P> On 14/05/2020 09.09, Gregory Sloop wrote:<br>
>> So I've done quite a lot of searching on the list and on the web - and perhaps my google-fu is really bad - but I can't find any real recipes on how to sync mail from the old server to the new.<br>
<br>
>> As an FYI - the old server is a CPanel/WHM setup on a VPS.<br>
>> The new is mailcow - which uses docker.<br>
<br>
>> However, I don't think either of these platforms is what's causing the issue - but I'm certainly not sure of that.<br>
<br>
>> ---<br>
>> I've tried several things - but have lost track of all the things I've tried.<br>
>> This seemed like the best of all the things I've tried.<br>
<br>
>> This particular mailbox/user+domain is setup on both servers.<br>
<br>
>> doveadm backup -D -u </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:mc-user@abc.net">mc-user@abc.net</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> ssh </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:root@abc.net">root@abc.net</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> -p2200 doveadm dsync-server -u </b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:cp-user@abc.net">cp-user@abc.net</a><br>
<br>
<a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:mc-user@abc.net">>> mc-user@abc.net</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> is the MC/NEW mailbox/domain<br>
</b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:cp-user@abc.net">>> cp-user@abc.net</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b> is the CPanel/OLD user/domain account<br>
>> The SSH server of the remote system is running on port 2200.<br>
<br>
>> However when I try this, I get:<br>
>> WARNING: The WATCHDOG_NOTIFY_EMAIL variable is not set. Defaulting to a blank string.<br>
>> dsync-local(</b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user@abc.net">user@abc.net</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b>)<v44NFyRWvF5efgAAb6OASA>: Error: read(remote) failed: EOF (version not received)<br>
>> doveadm(</b></span><a style=" font-family:'courier new'; font-size: 9pt;" href="mailto:user@abc.net">user@abc.net</a><span style=" font-family:'courier new'; font-size: 9pt; color: #800000;"><b>): Fatal: execvp(ssh) failed: No such file or directory<br>
<br>
>> The process appears to hang, and a Ctrl+C stops it.<br>
<br>
>> I'd love to get pointed at a reasonable recipe on how to make this work.<br>
<br>
>> I don't really get/understand the docs much at all.<br>
>> [And either everyone else understands it just fine, and never thinks to write a document on how to do it - or, and I think this is a lot more likely - they're using something like imapsync to do it. I found numerous places where others were, essentially, "Dovecot's tool is way too complicated and I can't get it to work right, so I used imapsync." I suppose I should probably just do that too, but it does seem a shame to do that when the dovecot tool is almost certainly the best tool for the job, but I can't figure out how to use it.]<br>
<br>
>> If someone can help me grok what's going on, I'm glad to write it up for the list and or a blog entry so it's more accessible.<br>
<br>
>> TIA<br>
>> -Greg<br>
<br>
</b><span style=" font-family:'arial'; font-size: 8pt; color: #c0c0c0;"><i>--<br>
Gregory Sloop, Principal: Sloop Network & Computer Consulting<br>
Voice: 503.251.0452 x121<br>
EMail: </i></span></span><a style=" font-family:'arial';" href="mailto:gregs@sloop.net">gregs@sloop.net</a><br>
<a style=" font-family:'arial';" href="http://www.sloop.net">http://www.sloop.net</a><br>
<span style=" font-family:'arial'; color: #c0c0c0;"><i>---</body></html>