i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Alex schrieb:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.
Hi @ll just tested rc15 with outlook 2003 pop3 no failures, no doubles
Mit freundlichen Gruessen Best Regards Robert Schetterer
robert_at_schetterer_dot_org Munich / Bavaria / Germany https://www.schetterer.org https://www.schetterer.com/public-gpg-robert-schetterer.key -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (MingW32)
iD8DBQFFYYU2NxddAhXBw7QRAg8NAJsHpG3vfCIYjCq+BW/ih1zrzKYtywCfUILP BeZciG9QxEF8BcUIOcoGvac= =vqRp -----END PGP SIGNATURE-----
-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.
On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.
-- Gerard
And always remember, when life hands you lemons, ask for tequila
and salt.-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Gerard Seibert schrieb:
On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.
No Problems here with short plain text messages and outlook 2003 ( german latest patchlevel ) with dovecot 1rc15 on suse 10.1
Mit freundlichen Gruessen Best Regards Robert Schetterer
robert_at_schetterer_dot_org Munich / Bavaria / Germany https://www.schetterer.org https://www.schetterer.com/public-gpg-robert-schetterer.key -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (MingW32)
iD8DBQFFYZUGNxddAhXBw7QRAuYAAKCN06pjfLZyxqwifsBVIVZJwpSgegCfd8df GaK8bqF5jSrur1L9cxel43k= =tW8m -----END PGP SIGNATURE-----
-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.
I have an account with 41 emils.
When i push the receive button, i reveive the same mesage * 41
2006/11/20, Robert Schetterer <robert@schetterer.org>:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Gerard Seibert schrieb:
On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.
No Problems here with short plain text messages and outlook 2003 ( german latest patchlevel ) with dovecot 1rc15 on suse 10.1
Mit freundlichen Gruessen Best Regards Robert Schetterer
robert_at_schetterer_dot_org Munich / Bavaria / Germany https://www.schetterer.org https://www.schetterer.com/public-gpg-robert-schetterer.key -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (MingW32)
iD8DBQFFYZUGNxddAhXBw7QRAuYAAKCN06pjfLZyxqwifsBVIVZJwpSgegCfd8df GaK8bqF5jSrur1L9cxel43k= =tW8m -----END PGP SIGNATURE-----
-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.
2006/11/20, Gerard Seibert <gerard@seibercom.net>:
On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.
-- Gerard
And always remember, when life hands you lemons, ask for tequila and salt.
I have same problem with duplicating. I download my mail with The Bat! from FreeBSD 5.4 server with Dovecot-1.0.r13. Problem is with mail with attach (~1MB)
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
veejar schrieb:
2006/11/20, Gerard Seibert <gerard@seibercom.net>:
On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.
-- Gerard
And always remember, when life hands you lemons, ask for tequila and salt.I have same problem with duplicating. I download my mail with The Bat! from FreeBSD 5.4 server with Dovecot-1.0.r13. Problem is with mail with attach (~1MB)
-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.
Just tested attachs over 1 MB with imap thunderbird, pop outlook 2003 plain text with dovecot 1rc15 suse 10.1 no doubles no problems
Mit freundlichen Gruessen Best Regards Robert Schetterer
robert_at_schetterer_dot_org Munich / Bavaria / Germany https://www.schetterer.org https://www.schetterer.com/public-gpg-robert-schetterer.key -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (MingW32)
iD8DBQFFYapYNxddAhXBw7QRAjQAAJ9ezFfdeIXLQDE8fVLqE8NR2GjeLACfZuKM 3DmuG84LD/SWTnHIhbD1u2I= =jfg5 -----END PGP SIGNATURE-----
-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.
On Mon, 2006-11-20 at 10:56 +0100, Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
What do you have in pop3_uidl_format? That's the only thing that I can think of what could be configured wrong.
What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?
Hi,
On Mon Nov 20, 2006 at 18:31:48 +0200, Timo Sirainen wrote:
On Mon, 2006-11-20 at 10:56 +0100, Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
One of my users is seeing duplicate mails occasionally too. Client is Sylpheed with POP3. It is quite seldom, maybe twice a month, using POP3 several hours a day. We've been seeing this for some time now, including up to rc13. Haven't tried rc15 yet. We haven't found a way to reproduce this behaviour. Mailbox format is mbox. The mbox file is on a local filesystem, the index files are on NFS (actually, ~/Mail/INBOX points to /var/mail/$user). I have "mmap_disable = yes" and default locking. Client and server are recent Linux kernels. Server is running 32 bit userland with 64 bit kernel on a BE machine. Client is standard 32 bit kernel and user.
What do you have in pop3_uidl_format? That's the only thing that I can think of what could be configured wrong.
pop3_uidl_format = %08Xu%08Xv
What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?
Nothing exciting in the logs, everything looks normal.
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
On Tue, 2006-11-21 at 09:48 +0100, Adam Lackorzynski wrote:
One of my users is seeing duplicate mails occasionally too. Client is Sylpheed with POP3. It is quite seldom, maybe twice a month, using POP3 several hours a day. We've been seeing this for some time now, including up to rc13.
Is the client configured to keep the mails in the server or delete them?
What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?
Nothing exciting in the logs, everything looks normal.
If the client is configured to delete the mails, I think the only possible reason is that the connection dies before the mails have been deleted. So when that happens, it would be useful to know what exactly the log says was the reason. Possible reasons are:
- Logged out: A normal logout with QUIT command. Should have worked correctly.
- Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.
- Disconnected: The client disconnected. Probably a network problem.
Then there are also some other reasons which could be Dovecot problems.
I'm having similar problems (and have, off and on, for a long time,
including with other mail servers).
On Dec 3, 2006, at 9:42 AM, Timo Sirainen wrote:
On Tue, 2006-11-21 at 09:48 +0100, Adam Lackorzynski wrote:
One of my users is seeing duplicate mails occasionally too. Client is Sylpheed with POP3. It is quite seldom, maybe twice a month, using POP3 several hours a day. We've been seeing this for some time now, including up to rc13.
Is the client configured to keep the mails in the server or delete
them?
In my case, yes. I mean both. ;-)
What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?
Nothing exciting in the logs, everything looks normal.
If the client is configured to delete the mails, I think the only possible reason is that the connection dies before the mails have been deleted. So when that happens, it would be useful to know what exactly the log says was the reason. Possible reasons are:
- Logged out: A normal logout with QUIT command. Should have worked correctly.
- Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.
I recently got a set of duplicate emails (including this one). I did
have some connectivity problems late last night, and this I saw in
the log file:
Dec 1 10:42:04 stove dovecot: [ID 107833 mail.info] IMAP(kamath):
Disconnected for inactivity
Dec 1 10:42:07 stove dovecot: [ID 107833 mail.error] IMAP(kamath): X-
IMAPbase uid-last unexpectedly lost in mbox file /var/mail/kamath
Sean
On Sun, 2006-12-03 at 14:53 -0500, Sean Kamath wrote:
- Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.
I recently got a set of duplicate emails (including this one). I did
have some connectivity problems late last night, and this I saw in
the log file:
And you delete mails from server after downloading?
Dec 1 10:42:04 stove dovecot: [ID 107833 mail.info] IMAP(kamath):
Disconnected for inactivity
So, possibly network problem..
Dec 1 10:42:07 stove dovecot: [ID 107833 mail.error] IMAP(kamath): X- IMAPbase uid-last unexpectedly lost in mbox file /var/mail/kamath
But why did this happen? Is this 1.0.rc15? Is something else modifying the mbox files also?
If the problem isn't disconnection, then it could be that the UIDs changed, and that could be related to the above error.
On Dec 3, 2006, at 3:06 PM, Timo Sirainen wrote:
On Sun, 2006-12-03 at 14:53 -0500, Sean Kamath wrote:
- Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.
I recently got a set of duplicate emails (including this one). I did have some connectivity problems late last night, and this I saw in the log file:
And you delete mails from server after downloading?
I'm not. I mean, that's sort of the point of imap, right? :-) :-)
Dec 1 10:42:04 stove dovecot: [ID 107833 mail.info] IMAP(kamath): Disconnected for inactivity
So, possibly network problem..
Most definately. With UW Imap (used prior to dovecot), having mail
on the slow NFS link (10 Meg link) would occasionally timeout on
logins and you'd also get duplicate email. Moving to local storage
*mostly* fixed that. Dovecot has been MUCH better, but it's still
happening.
Still and all, I'm curious how any sort of network problem could
cause this. With UW, we'd move mail out of the spool file to the
mbox in the home dir, and if the network connection died (because it
took too long to copy the spool file), you'd end up with mail in the
spool file and the mbox. But now we're using the spool file directly.
The next time I notice it, I'll confirm (again) that it's actually
duplicated *on the server* and *in the mail spool file* (we use mbox).
Dec 1 10:42:07 stove dovecot: [ID 107833 mail.error] IMAP (kamath): X- IMAPbase uid-last unexpectedly lost in mbox file /var/mail/kamath
But why did this happen? Is this 1.0.rc15? Is something else modifying the mbox files also?
Aside from sendmail and the LDA, no, nothing should be modifying the
mbox file.
If the problem isn't disconnection, then it could be that the UIDs changed, and that could be related to the above error.
Gack. rc7. I guess I haven't upgraded in a while. Frankly, rc7 has
been working so well, and what with the recent spate of activity,
I've been waiting for things to settle down a bit -- but I didn't
think I was that far back.
Sean
On 3.12.2006, at 23.42, Sean Kamath wrote:
On Sun, 2006-12-03 at 14:53 -0500, Sean Kamath wrote:
- Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could
also just be a network problem.I recently got a set of duplicate emails (including this one). I
did have some connectivity problems late last night, and this I saw in the log file:And you delete mails from server after downloading?
I'm not. I mean, that's sort of the point of imap, right? :-) :-)
Uh. I was thinking all the time that you're using pop3 since that's
what started this thread :)
Now, you're having duplicate mails with IMAP? There's really no good
reason for why that would happen, unless the mail is actually
delivered to the mailbox twice, or if the client did something weird,
such as copying the mail elsewhere (eg. Trash) and back..
The next time I notice it, I'll confirm (again) that it's actually
duplicated *on the server* and *in the mail spool file* (we use mbox).
It most likely is.
Dec 1 10:42:07 stove dovecot: [ID 107833 mail.error] IMAP (kamath): X- IMAPbase uid-last unexpectedly lost in mbox file /var/mail/kamath
But why did this happen? Is this 1.0.rc15? Is something else
modifying the mbox files also?Aside from sendmail and the LDA, no, nothing should be modifying
the mbox file.
Dovecot LDA?
If the problem isn't disconnection, then it could be that the UIDs changed, and that could be related to the above error.
Gack. rc7. I guess I haven't upgraded in a while. Frankly, rc7
has been working so well, and what with the recent spate of
activity, I've been waiting for things to settle down a bit -- but
I didn't think I was that far back.
rc9 had this fix:
- mbox: Fixed a bug causing "X-IMAPbase uid-last unexpectedly lost in mbox file" errors, and possibly others.
On Dec 3, 2006, at 5:04 PM, Timo Sirainen wrote:
On 3.12.2006, at 23.42, Sean Kamath wrote: Uh. I was thinking all the time that you're using pop3 since that's
what started this thread :)
My bad. The wonders of threaded newsreaders. I came into the middle
off the discussion, too.
Now, you're having duplicate mails with IMAP? There's really no
good reason for why that would happen, unless the mail is actually
delivered to the mailbox twice, or if the client did something
weird, such as copying the mail elsewhere (eg. Trash) and back..
No, it happens to a whole session of mail. The way my wife most
notices it is when she deletes mail, and then it comes back. I
thought it was a marking issue. . . Who knows. I'll do a little
digging. . .
Dovecot LDA?
Stock Solaris 9 LDA.
rc9 had this fix:
- mbox: Fixed a bug causing "X-IMAPbase uid-lastunexpectedly lost in mbox file" errors, and possibly others.
I believe I shall update and then dig. :-)
Sean
Hi,
I now have a second user that is seeing this. Client is thunderbird.
On Sun Dec 03, 2006 at 16:42:49 +0200, Timo Sirainen wrote:
On Tue, 2006-11-21 at 09:48 +0100, Adam Lackorzynski wrote:
One of my users is seeing duplicate mails occasionally too. Client is Sylpheed with POP3. It is quite seldom, maybe twice a month, using POP3 several hours a day. We've been seeing this for some time now, including up to rc13.
Is the client configured to keep the mails in the server or delete them?
Both delete the mails.
I've attached a log from the sylpheed user that hopefully shows something.
What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?
Nothing exciting in the logs, everything looks normal.
If the client is configured to delete the mails, I think the only possible reason is that the connection dies before the mails have been deleted. So when that happens, it would be useful to know what exactly the log says was the reason. Possible reasons are:
- Logged out: A normal logout with QUIT command. Should have worked correctly.
- Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.
- Disconnected: The client disconnected. Probably a network problem.
Then there are also some other reasons which could be Dovecot problems.
I'd say for sure that there's no network problem involved. The log file shows a normal QUIT, and hopefully shows more.
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
On 4.12.2006, at 0.11, Adam Lackorzynski wrote:
I'd say for sure that there's no network problem involved. The log
file shows a normal QUIT, and hopefully shows more.
Do you still have Dovecot's logs? What do they say about the user
quitting at the 16:17:20 session? Did it say del=5/5? It does looks
like Dovecot expunged only the first message, but I don't really see
why it wouldn't have expunged the rest. Well, except if the mbox
changed in ways that made Dovecot give the mails new UIDs.
Unfortunately the Sylpheed log didn't show UIDL's output.
The mbox file is on a local filesystem, the index files are on NFS (actually, ~/Mail/INBOX points to /var/mail/$user).
Does Dovecot access it as ~/Mail/INBOX or /var/mail/$user? What
delivers mails to the mbox? Just wondering if there could be some
problem related to locking.
On Tue Jan 09, 2007 at 22:40:03 +0200, Timo Sirainen wrote:
On 4.12.2006, at 0.11, Adam Lackorzynski wrote:
I'd say for sure that there's no network problem involved. The log
file shows a normal QUIT, and hopefully shows more.Do you still have Dovecot's logs? What do they say about the user
quitting at the 16:17:20 session? Did it say del=5/5?
Yes: Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=4/63032, del=4/4, size=62963
It does looks
like Dovecot expunged only the first message, but I don't really see
why it wouldn't have expunged the rest. Well, except if the mbox
changed in ways that made Dovecot give the mails new UIDs.
Unfortunately the Sylpheed log didn't show UIDL's output.The mbox file is on a local filesystem, the index files are on NFS (actually, ~/Mail/INBOX points to /var/mail/$user).
Does Dovecot access it as ~/Mail/INBOX or /var/mail/$user? What
As ~/Mail/INBOX. mail_location is this: mbox:~/Mail:INBOX=/home/%u/Mail/INBOX
For some time I had a readlink in the code so that dovecot would definitely use /var/mail/$user but that didn't make a difference, at least it happened again.
delivers mails to the mbox? Just wondering if there could be some
problem related to locking.
procmail in one case and exim directly in the other.
Checking the exim log, I see a mail being delivered to the user at 16:17:17, should be the 5th mail in the log . The next one is about 90 seconds later. This is the user with procmail. I don't have a log of the one who's not using procmail. Also, concerning the timestamps, this is all on the same host.
Thanks, Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
On 10.1.2007, at 0.52, Adam Lackorzynski wrote:
Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963
So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?
On Wed Jan 10, 2007 at 04:00:00 +0200, Timo Sirainen wrote:
On 10.1.2007, at 0.52, Adam Lackorzynski wrote:
Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?
Applied to rc17, and waiting to happen.
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
Hi,
On Wed Jan 10, 2007 at 04:00:00 +0200, Timo Sirainen wrote:
On 10.1.2007, at 0.52, Adam Lackorzynski wrote:
Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?
It happened again for one user but the patch didn't log anything. Running rc17.
The sequence is as follows:
2007-01-31 11:50:11 1HCD2Z-0007vm-PS <= xxx 2007-01-31 11:50:18 1HCD2Z-0007vm-PS => user9 <user9@> R=procmail T=procmail_pipe
Jan 31 11:50:31 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:51:33 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=1773/13208190, del=1773/1773, size=13177735
2007-01-31 11:51:38 1HCD3y-00081t-D3 <= xxx 2007-01-31 11:51:41 1HCD41-00081t-4W <= xxx 2007-01-31 11:51:43 1HCD3y-00081t-D3 => user9 <user9@> R=procmail T=procmail_pipe 2007-01-31 11:51:44 1HCD41-00081t-4W => user9 <user9@> R=procmail T=procmail_pipe 2007-01-31 11:51:44 1HCD43-00081t-Ri <= xxx 2007-01-31 11:51:46 1HCD46-00081t-2Y <= xxx 2007-01-31 11:51:47 1HCD43-00081t-Ri => user9 <user9@> R=procmail T=procmail_pipe 2007-01-31 11:51:48 1HCD48-00081t-CZ <= xxx 2007-01-31 11:51:50 1HCD46-00081t-2Y => user9 <user9@> R=procmail T=procmail_pipe 2007-01-31 11:51:51 1HCD48-00081t-CZ => user9 <user9@> R=procmail T=procmail_pipe
2007-01-31 11:55:37 1HCD7p-0008IU-Qo <= user9@ 2007-01-31 11:55:40 1HCD7p-0008IU-Qo => user4 <user4@> R=procmail T=procmail_pipe
2007-01-31 11:55:55 1HCD87-0008Is-Db <= xxx 2007-01-31 11:56:38 1HCD87-0008Is-Db => user9 <user9@> R=procmail T=procmail_pipe
Jan 31 11:57:27 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:57:57 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=989/6527068, del=989/989, size=6510123
2007-01-31 11:59:26 1HCDBV-0008Qb-JB <= xxx 2007-01-31 11:59:29 1HCDBV-0008Qb-JB => user9 <user9@> R=procmail T=procmail_pipe
Jan 31 11:59:34 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:59:34 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=1/16816, del=1/1, size=16798
The user was getting several mails between the two polls but none while the pop3 download. The second pop3 connect again downloaded 989 mails where most of the mails should have been deleted by the previous pop3 download. The third connect was fine again.
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
On Thu Feb 01, 2007 at 11:22:25 +0100, Adam Lackorzynski wrote:
On Wed Jan 10, 2007 at 04:00:00 +0200, Timo Sirainen wrote:
On 10.1.2007, at 0.52, Adam Lackorzynski wrote:
Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?It happened again for one user but the patch didn't log anything. Running rc17.
Happened again with rc17, basically the same sequence, fetch mail and delete all mails, MDA delivers new mails, fetch gets some mails from the first fetch again. I've now updated to rc21 (with the patch).
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
Hi Adam, I have the same issue of duplicate email. The environment: pop3_uidl_format = %v-%u
- dovecot rc7, maildir, procmail, sendmail
- maildir directories migrated from courrier-imap 3
- dovecot config: imap_client_workarounds = outlook-idle tb-extra-mailbox-sep default_mail_env = maildir:~/Maildir/:INBOX=/var/mail/Maildir/%u/
- client: outlook express, outlook 2003, pop3 only, "don't leave a copy"
- I see no "logout" in /var/log/maillog from the user that has the problem
Do you have a similiar config? Is your issue resolved?
Thanks Oliver
Adam Lackorzynski wrote:
I've now updated to rc21 (with the patch).
-- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver
On Mon Feb 05, 2007 at 13:10:44 -0300, Oliver Schulze L. wrote:
Hi Adam, I have the same issue of duplicate email. The environment: pop3_uidl_format = %v-%u
- dovecot rc7, maildir, procmail, sendmail
- maildir directories migrated from courrier-imap 3
- dovecot config: imap_client_workarounds = outlook-idle tb-extra-mailbox-sep default_mail_env = maildir:~/Maildir/:INBOX=/var/mail/Maildir/%u/
- client: outlook express, outlook 2003, pop3 only, "don't leave a copy"
- I see no "logout" in /var/log/maillog from the user that has the problem
Do you have a similiar config? Is your issue resolved?
Not really (as explained somewhere else in the thread). Please retry with rc22 and see if that fixes anything.
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
Will try when atrpms's rpm are available ;)
What worries me is that the issue is from rc7 until rc21. Will post in a couple if hours.
Will it help to delete all index files for the user? Since the user is downloading all his emails using pop3, it will be lije creating a new user account and starting to receive emails.
Thanks Oliver
Adam Lackorzynski wrote:
Not really (as explained somewhere else in the thread). Please retry with rc22 and see if that fixes anything.
Adam
-- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver
Hi, I solved my issue by deleting all dovecot indexes. Is not the best think to do, but is better downloading 700+ emails just once than in every "check-mail"
Some pop3 users had the problem of duplicate emails, but from now on it will wotk with no issue.
Notes about this issue: linked from the wiki
- now I can see the Logout string in the lgo files
- I was migrating courrier-imap to dovecot, both in imap
- I renamed courrier files as stated in the wiki and used the tools
- I think the problem was the "pop3_uidl_format = %v-%u" I was using
HTH Oliver
-- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver
Timo,
I just found the error message in another logfile :(
On Thu Feb 01, 2007 at 11:22:25 +0100, Adam Lackorzynski wrote:
Hi,
On Wed Jan 10, 2007 at 04:00:00 +0200, Timo Sirainen wrote:
On 10.1.2007, at 0.52, Adam Lackorzynski wrote:
Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?It happened again for one user but the patch didn't log anything. Running rc17.
The sequence is as follows:
2007-01-31 11:50:11 1HCD2Z-0007vm-PS <= xxx 2007-01-31 11:50:18 1HCD2Z-0007vm-PS => user9 <user9@> R=procmail T=procmail_pipe
Jan 31 11:50:31 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:51:33 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=1773/13208190, del=1773/1773, size=13177735
Jan 31 11:51:32 dovecot: POP3(user9): mbox sync: UID inserted in the middle of mailbox /home/user9/Mail/INBOX (416529 > 154, seq=792, idx_msgs=1773) Jan 31 11:51:32 dovecot: POP3(user9): Broken header: X-UID:
Now, does that tell anything?
Thanks, Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
On 4.2.2007, at 14.13, Adam Lackorzynski wrote:
Jan 31 11:51:32 dovecot: POP3(user9): mbox sync: UID inserted in
the middle of mailbox /home/user9/Mail/INBOX (416529 > 154,
seq=792, idx_msgs=1773)
This explains the duplicate emails. My answer to this is pretty much
the same as http://dovecot.org/list/dovecot/2007-February/019272.html
Jan 31 11:51:32 dovecot: POP3(user9): Broken header: X-UID:
This is a bit interesting though. Apparently you got a mail with an
empty X-UID header which caused it to break? That itself shouldn't
cause it though, but I'll see if I could get it reproduced. Anyway
you can probably fix the problem by filtering out the X-UID headers
in the SMTP server or in your LDA.
On Mon, 2007-02-05 at 20:00 +0200, Timo Sirainen wrote:
On 4.2.2007, at 14.13, Adam Lackorzynski wrote:
Jan 31 11:51:32 dovecot: POP3(user9): mbox sync: UID inserted in
the middle of mailbox /home/user9/Mail/INBOX (416529 > 154,
seq=792, idx_msgs=1773)This explains the duplicate emails. My answer to this is pretty much
the same as http://dovecot.org/list/dovecot/2007-February/019272.html
Does rc22 fix this problem?
On Tue Feb 06, 2007 at 18:19:03 +0200, Timo Sirainen wrote:
On Mon, 2007-02-05 at 20:00 +0200, Timo Sirainen wrote:
On 4.2.2007, at 14.13, Adam Lackorzynski wrote:
Jan 31 11:51:32 dovecot: POP3(user9): mbox sync: UID inserted in
the middle of mailbox /home/user9/Mail/INBOX (416529 > 154,
seq=792, idx_msgs=1773)This explains the duplicate emails. My answer to this is pretty much
the same as http://dovecot.org/list/dovecot/2007-February/019272.htmlDoes rc22 fix this problem?
Installed, we'll see.
Adam
Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.
-- Knute Johnson Molon Labe...
pop3_uidl_format = %v
2006/11/20, Knute Johnson <knute@frazmtn.com>:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.
-- Knute Johnson Molon Labe...
# Note that Outlook 2003 seems to have problems with %v.%u format which was # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.
Where i can change this
2006/11/20, Alex <abusquets@gmail.com>:
pop3_uidl_format = %v
2006/11/20, Knute Johnson <knute@frazmtn.com>:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.
-- Knute Johnson Molon Labe...
i solved with this, i think
pop3_uidl_format = %08Xu%08Xv
2006/11/20, Alex <abusquets@gmail.com>:
# Note that Outlook 2003 seems to have problems with %v.%u format which was # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.
Where i can change this
2006/11/20, Alex <abusquets@gmail.com>:
pop3_uidl_format = %v
2006/11/20, Knute Johnson <knute@frazmtn.com>:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.
-- Knute Johnson Molon Labe...
I think that is the default on mine.
i solved with this, i think
pop3_uidl_format = %08Xu%08Xv
2006/11/20, Alex <abusquets@gmail.com>:
# Note that Outlook 2003 seems to have problems with %v.%u format which was # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.
Where i can change this
2006/11/20, Alex <abusquets@gmail.com>:
pop3_uidl_format = %v
2006/11/20, Knute Johnson <knute@frazmtn.com>:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.
-- Knute Johnson Molon Labe...
-- Knute Johnson Molon Labe...
Hello,
On Mon, 20 Nov 2006, Knute Johnson wrote:
I think that is the default on mine.
i solved with this, i think
pop3_uidl_format = %08Xu%08Xv
I also notice this problem from time to time. I am on rc7. Yesterday in the evening I sent an email to exim mailing list. I got the copy of it. Today after I logged in and out a couple of times I saw a new email from exim mailing list which was the copy I sent yesterday. Although both emails look identical, they are not. The first one has full headers from the mailing list, the second one only has a few local headers and that's all.
I can send them offlist if it helps spot the problem. It is not a first situation like that. As for MUA I use pine.
Thank you!
-- Zbigniew Szalbot
I'm getting reportes from a user that has a duplicate emails too. I have dovecot 1.0rc7 running, will try to debug as explained in this post
Oliver
Alex wrote:
i'm working with dovecot-1.0.rc15
I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3
-- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver
participants (10)
-
Adam Lackorzynski
-
Alex
-
Gerard Seibert
-
Knute Johnson
-
Oliver Schulze L.
-
Robert Schetterer
-
Sean Kamath
-
Timo Sirainen
-
veejar
-
Zbigniew Szalbot