<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle18
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1122501689;
mso-list-type:hybrid;
mso-list-template-ids:-1313072198 631777878 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-start-at:0;
mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-font-family:Calibri;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Sorry, first time sent using the wrong mail address.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Hello<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Short version:<o:p></o:p></p><p class=MsoNormal>Dovecot’s dsync from release 2.3.7.2 (default install from focal repository) running under Ubuntu 20.04.6 LTS server is not deleting mails on the identical remote server. <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Background:<o:p></o:p></p><p class=MsoNormal>I have installed this configuration using automated scripts several times for customers. Functionally identical installations done on Ubuntu LTS Servers 14.04, 16.04 and 18.04 are running for years without problem. Now I have tried several times to do the same with Ubuntu 20.04 and can’t get dsync to work properly. Last year I could fall back onto Ubuntu 18.04. This time I can’t and must install the latest versions.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Setup:<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Two VM’s on ESXI 6.7U3 with 36 GB of disk space and 8 GB ram, 10k spinning disks or SSD with HW RAID1<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Mariadb for mail users (master – master synched)<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Postfixadmin to manage the users<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Postfix<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Dovecot<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Some with Roundcube <o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>The clients can connect to either one server and connect SMTPS (465 or 587) or POPS (995) to the servers.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>The two servers connect on a dedicated network without routing (SSL, port > 49000). The synchronization network has no mail traffic except the one that synchronizes the servers.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Additionally the two servers are ntp peers within a few ms - but that is only relevant to know when we start comparing logs from the machines<o:p></o:p></p><p class=MsoNormal style='margin-left:18.0pt'><o:p> </o:p></p><p class=MsoNormal>Problem description:<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>When I send one mail to one account, it is immediately synched to the other server. This is also seen in the dovecot log and I can connect to any one of the two servers to download it.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>When I read and delete the mail on one server, it is NOT deleted on the other server. I do not see a trigger in the dovecot log that kicks on the synchronization (like I do when sending mails). As a result, the mail can be downloaded and deleted from both servers.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>When I send a new mail to one of the two servers, the synchronization takes place and the mail that I read and deleted is also gone on the remote (backup) server.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Changing users, rights in dsynch.conf , SSL on or off, or connecting to PLAIN ports 25, 110 or 143 is never improved it. Iptables or ufw are not in use.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]> In my case I have systems using the server that’ don’t like duplicate mails and the servers fail the acceptance test criteria.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>This causes duplicate mail if one client is connecting to the other server. Since a new mail fixes that duplicate mail problem, it is likely that up to now nobody detects it and complains about this. Especially if the servers would run in a primary – backup mode. I assume that’s why I could not find reportings on the web until now.<o:p></o:p></p><p class=MsoListParagraph><o:p> </o:p></p><p class=MsoNormal>Dovecot –n:<o:p></o:p></p><p class=MsoNormal>See attachments<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Log from my automated test system using Ubuntu 20.01 and focal default dovecot package from repository (dovecot 2.3.7.2):<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:06.30 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:06.81 - SMTP Server: mail-pri Port 465 TLS - User: user@test.ch - To: user@test.ch - Subject: Test 2021-11-22 18:20:06, Msg 00001<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:14.90 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:15.37 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:06, Msg 00001 (retr no delete)<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:17.32 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:17.77 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:06, Msg 00001 (retr no delete) -> synchronization worked when sending mails<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:27.52 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:27.96 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:06, Msg 00001 (retr and delete)<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:30.72 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:31.17 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:06, Msg 00001 (retr and delete) -> synchronization failed after POP3 connection with delete<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:53.06 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:53.66 - SMTP Server: mail-sec Port 465 TLS - User: user@test.ch - To: user@test.ch - Subject: Test 2021-11-22 18:20:53, Msg 00002<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:57.91 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:20:58.33 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:53, Msg 00002 (retr no delete)<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:00.82 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:01.27 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:53, Msg 00002 (retr no delete)<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:04.65 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:05.11 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:53, Msg 00002 (retr and delete)<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:08.95 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:09.40 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-22 18:20:53, Msg 00002 (retr and delete)<o:p></o:p></p><p class=MsoNormal>2021-11-22 18:21:39.50 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Reference log with the same installation using Ubuntu 18.04 and bionic default package form repository (dovecot 1:2.2.33.2-1ubuntu4.7):<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:06.93 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:54:49.86 - SMTP Server: mail-pri Port 465 TLS - User: user@test.ch - To: user@test.ch - Subject: Test 2021-11-23 13:54:49, Msg 00001<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:06.93 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:07.47 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-23 13:54:49, Msg 00001 (retr no delete)<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:13.10 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:13.66 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-23 13:54:49, Msg 00001 (retr no delete) -> synchronization OK for sending mails<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:22.32 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:22.87 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-23 13:54:49, Msg 00001 (retr and delete)<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:27.91 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:28.35 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - no mails found -> synchronization OK for deleting mails<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:36.48 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:37.00 - SMTP Server: mail-sec Port 465 TLS - User: user@test.ch - To: user@test.ch - Subject: Test 2021-11-23 13:55:36, Msg 00002<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:45.94 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:46.48 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-23 13:55:36, Msg 00002 (retr no delete)<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:55.59 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:55:56.14 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-23 13:55:36, Msg 00002 (retr no delete)<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:56:05.70 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:56:06.26 - POP3 Server: mail-pri Port 995 TLS - User: user@test.ch - From: user@test.ch - Subject: Test 2021-11-23 13:55:36, Msg 00002 (retr and delete)<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:56:38.70 - --------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p><p class=MsoNormal>2021-11-23 13:56:39.12 - POP3 Server: mail-sec Port 995 TLS - User: user@test.ch - no mails found<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>P.S. I compared the dovecot and postfix config files between these two versions and both servers and they are functionally identical except where they need to be different.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I would appreciate any help here. If needed I can create log files that show that nothing is triggered as well as produce wireshark captures (port 25 and 110) or the link for the synch (currently with ssl but I could change that if needed). <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Thanks in advance <o:p></o:p></p><p class=MsoNormal>Otto<o:p></o:p></p></div><div id="DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br />
<table style="border-top: 1px solid #D3D4DE;">
<tr>
<td style="width: 55px; padding-top: 13px;"><a href="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" target="_blank"><img src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-green-avg-v1.png" alt="" width="46" height="29" style="width: 46px; height: 29px;" /></a></td>
<td style="width: 470px; padding-top: 12px; color: #41424e; font-size: 13px; font-family: Arial, Helvetica, sans-serif; line-height: 18px;">Virus-free. <a href="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" target="_blank" style="color: #4453ea;">www.avg.com</a>
</td>
</tr>
</table><a href="#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"> </a></div></body></html>