I have an account with 41 emils.

When i push the receive button, i reveive the same mesage * 41

2006/11/20, Robert Schetterer robert@schetterer.org:

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

Gerard Seibert schrieb:

...

On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:

...

i'm working with dovecot-1.0.rc15

I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3

I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.

No Problems here with short plain text messages and outlook 2003 ( german latest patchlevel ) with dovecot 1rc15 on suse 10.1

---

Mit freundlichen Gruessen Best Regards Robert Schetterer

robert_at_schetterer_dot_org Munich / Bavaria / Germany https://www.schetterer.org https://www.schetterer.com/public-gpg-robert-schetterer.key -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (MingW32)

iD8DBQFFYZUGNxddAhXBw7QRAuYAAKCN06pjfLZyxqwifsBVIVZJwpSgegCfd8df GaK8bqF5jSrur1L9cxel43k= =tW8m -----END PGP SIGNATURE-----

-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

veejar schrieb:

2006/11/20, Gerard Seibert gerard@seibercom.net:

...

On Monday November 20, 2006 at 04:56:26 (AM) Alex wrote:

...

i'm working with dovecot-1.0.rc15

I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3

I have been experiencing that phenomena too for quite awhile. There doesn't appear to be any pattern to the problem either. Usually the duplicates are short text based messages. There does not appear to be an discernable pattern with regards to the MUA.

-- Gerard

 And always remember, when life hands you lemons, ask for tequila
 and salt.

I have same problem with duplicating. I download my mail with The Bat! from FreeBSD 5.4 server with Dovecot-1.0.r13. Problem is with mail with attach (~1MB)

-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.

Just tested attachs over 1 MB with imap thunderbird, pop outlook 2003 plain text with dovecot 1rc15 suse 10.1 no doubles no problems

Mit freundlichen Gruessen Best Regards Robert Schetterer

robert_at_schetterer_dot_org Munich / Bavaria / Germany https://www.schetterer.org https://www.schetterer.com/public-gpg-robert-schetterer.key -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (MingW32)

iD8DBQFFYapYNxddAhXBw7QRAjQAAJ9ezFfdeIXLQDE8fVLqE8NR2GjeLACfZuKM 3DmuG84LD/SWTnHIhbD1u2I= =jfg5 -----END PGP SIGNATURE-----

-- Diese Nachricht wurde auf Viren und andere gefährliche Inhalte untersucht und ist - aktuelle Virenscanner vorausgesetzt - sauber.

Hi,

On Mon Nov 20, 2006 at 18:31:48 +0200, Timo Sirainen wrote:

On Mon, 2006-11-20 at 10:56 +0100, Alex wrote:

...

i'm working with dovecot-1.0.rc15

I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3

One of my users is seeing duplicate mails occasionally too. Client is Sylpheed with POP3. It is quite seldom, maybe twice a month, using POP3 several hours a day. We've been seeing this for some time now, including up to rc13. Haven't tried rc15 yet. We haven't found a way to reproduce this behaviour. Mailbox format is mbox. The mbox file is on a local filesystem, the index files are on NFS (actually, ~/Mail/INBOX points to /var/mail/$user). I have "mmap_disable = yes" and default locking. Client and server are recent Linux kernels. Server is running 32 bit userland with 64 bit kernel on a BE machine. Client is standard 32 bit kernel and user.

What do you have in pop3_uidl_format? That's the only thing that I can think of what could be configured wrong.

pop3_uidl_format = %08Xu%08Xv

What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?

Nothing exciting in the logs, everything looks normal.

Adam

Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/

I'm having similar problems (and have, off and on, for a long time,
including with other mail servers).

On Dec 3, 2006, at 9:42 AM, Timo Sirainen wrote:

On Tue, 2006-11-21 at 09:48 +0100, Adam Lackorzynski wrote:

...

One of my users is seeing duplicate mails occasionally too. Client is Sylpheed with POP3. It is quite seldom, maybe twice a month, using POP3 several hours a day. We've been seeing this for some time now, including up to rc13.

Is the client configured to keep the mails in the server or delete
them?

In my case, yes. I mean both. ;-)

...

...

What do you see in logs? Does the client disconnect normally, or is there a timeout, crash or something?

Nothing exciting in the logs, everything looks normal.

If the client is configured to delete the mails, I think the only possible reason is that the connection dies before the mails have been deleted. So when that happens, it would be useful to know what exactly the log says was the reason. Possible reasons are:

• Logged out: A normal logout with QUIT command. Should have worked correctly.
• Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.

I recently got a set of duplicate emails (including this one). I did
have some connectivity problems late last night, and this I saw in
the log file:

Dec 1 10:42:04 stove dovecot: [ID 107833 mail.info] IMAP(kamath):
Disconnected for inactivity Dec 1 10:42:07 stove dovecot: [ID 107833 mail.error] IMAP(kamath): X- IMAPbase uid-last unexpectedly lost in mbox file /var/mail/kamath

Sean

On Dec 3, 2006, at 3:06 PM, Timo Sirainen wrote:

On Sun, 2006-12-03 at 14:53 -0500, Sean Kamath wrote:

...

...

• Disconnected for inactivity: This has sometimes been a bug in Dovecot, but I'm not aware of any such bugs currently. It could also just be a network problem.

I recently got a set of duplicate emails (including this one). I did have some connectivity problems late last night, and this I saw in the log file:

And you delete mails from server after downloading?

I'm not. I mean, that's sort of the point of imap, right? :-) :-)

...

Dec 1 10:42:04 stove dovecot: [ID 107833 mail.info] IMAP(kamath): Disconnected for inactivity

So, possibly network problem..

Most definately. With UW Imap (used prior to dovecot), having mail
on the slow NFS link (10 Meg link) would occasionally timeout on
logins and you'd also get duplicate email. Moving to local storage
*mostly* fixed that. Dovecot has been MUCH better, but it's still
happening.

Still and all, I'm curious how any sort of network problem could
cause this. With UW, we'd move mail out of the spool file to the
mbox in the home dir, and if the network connection died (because it
took too long to copy the spool file), you'd end up with mail in the
spool file and the mbox. But now we're using the spool file directly.

The next time I notice it, I'll confirm (again) that it's actually
duplicated *on the server* and *in the mail spool file* (we use mbox).

...

Dec 1 10:42:07 stove dovecot: [ID 107833 mail.error] IMAP (kamath): X- IMAPbase uid-last unexpectedly lost in mbox file /var/mail/kamath

But why did this happen? Is this 1.0.rc15? Is something else modifying the mbox files also?

Aside from sendmail and the LDA, no, nothing should be modifying the
mbox file.

If the problem isn't disconnection, then it could be that the UIDs changed, and that could be related to the above error.

Gack. rc7. I guess I haven't upgraded in a while. Frankly, rc7 has
been working so well, and what with the recent spate of activity,
I've been waiting for things to settle down a bit -- but I didn't
think I was that far back.

Sean

On Dec 3, 2006, at 5:04 PM, Timo Sirainen wrote:

On 3.12.2006, at 23.42, Sean Kamath wrote: Uh. I was thinking all the time that you're using pop3 since that's
what started this thread :)

My bad. The wonders of threaded newsreaders. I came into the middle
off the discussion, too.

Now, you're having duplicate mails with IMAP? There's really no
good reason for why that would happen, unless the mail is actually
delivered to the mailbox twice, or if the client did something
weird, such as copying the mail elsewhere (eg. Trash) and back..

No, it happens to a whole session of mail. The way my wife most
notices it is when she deletes mail, and then it comes back. I
thought it was a marking issue. . . Who knows. I'll do a little
digging. . .

Dovecot LDA?

Stock Solaris 9 LDA.

rc9 had this fix:

    - mbox: Fixed a bug causing "X-IMAPbase uid-last  

unexpectedly lost in mbox file" errors, and possibly others.

I believe I shall update and then dig. :-)

Sean

On 4.12.2006, at 0.11, Adam Lackorzynski wrote:

I'd say for sure that there's no network problem involved. The log
file shows a normal QUIT, and hopefully shows more.

Do you still have Dovecot's logs? What do they say about the user
quitting at the 16:17:20 session? Did it say del=5/5? It does looks
like Dovecot expunged only the first message, but I don't really see
why it wouldn't have expunged the rest. Well, except if the mbox
changed in ways that made Dovecot give the mails new UIDs.
Unfortunately the Sylpheed log didn't show UIDL's output.

The mbox file is on a local filesystem, the index files are on NFS (actually, ~/Mail/INBOX points to /var/mail/$user).

Does Dovecot access it as ~/Mail/INBOX or /var/mail/$user? What
delivers mails to the mbox? Just wondering if there could be some
problem related to locking.

On 10.1.2007, at 0.52, Adam Lackorzynski wrote:

Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963

So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?

Hi,

On Wed Jan 10, 2007 at 04:00:00 +0200, Timo Sirainen wrote:

On 10.1.2007, at 0.52, Adam Lackorzynski wrote:

...

Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963

So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?

It happened again for one user but the patch didn't log anything. Running rc17.

The sequence is as follows:

2007-01-31 11:50:11 1HCD2Z-0007vm-PS <= xxx 2007-01-31 11:50:18 1HCD2Z-0007vm-PS => user9 R=procmail T=procmail_pipe

Jan 31 11:50:31 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:51:33 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=1773/13208190, del=1773/1773, size=13177735

2007-01-31 11:51:38 1HCD3y-00081t-D3 <= xxx 2007-01-31 11:51:41 1HCD41-00081t-4W <= xxx 2007-01-31 11:51:43 1HCD3y-00081t-D3 => user9 R=procmail T=procmail_pipe 2007-01-31 11:51:44 1HCD41-00081t-4W => user9 R=procmail T=procmail_pipe 2007-01-31 11:51:44 1HCD43-00081t-Ri <= xxx 2007-01-31 11:51:46 1HCD46-00081t-2Y <= xxx 2007-01-31 11:51:47 1HCD43-00081t-Ri => user9 R=procmail T=procmail_pipe 2007-01-31 11:51:48 1HCD48-00081t-CZ <= xxx 2007-01-31 11:51:50 1HCD46-00081t-2Y => user9 R=procmail T=procmail_pipe 2007-01-31 11:51:51 1HCD48-00081t-CZ => user9 R=procmail T=procmail_pipe

2007-01-31 11:55:37 1HCD7p-0008IU-Qo <= user9@ 2007-01-31 11:55:40 1HCD7p-0008IU-Qo => user4 R=procmail T=procmail_pipe

2007-01-31 11:55:55 1HCD87-0008Is-Db <= xxx 2007-01-31 11:56:38 1HCD87-0008Is-Db => user9 R=procmail T=procmail_pipe

Jan 31 11:57:27 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:57:57 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=989/6527068, del=989/989, size=6510123

2007-01-31 11:59:26 1HCDBV-0008Qb-JB <= xxx 2007-01-31 11:59:29 1HCDBV-0008Qb-JB => user9 R=procmail T=procmail_pipe

Jan 31 11:59:34 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:59:34 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=1/16816, del=1/1, size=16798

The user was getting several mails between the two polls but none while the pop3 download. The second pop3 connect again downloaded 989 mails where most of the mails should have been deleted by the previous pop3 download. The third connect was fine again.

Adam

Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/

Hi Adam, I have the same issue of duplicate email. The environment: pop3_uidl_format = %v-%u

• dovecot rc7, maildir, procmail, sendmail
• maildir directories migrated from courrier-imap 3
• dovecot config: imap_client_workarounds = outlook-idle tb-extra-mailbox-sep default_mail_env = maildir:~/Maildir/:INBOX=/var/mail/Maildir/%u/

• client: outlook express, outlook 2003, pop3 only, "don't leave a copy"
• I see no "logout" in /var/log/maillog from the user that has the problem

Do you have a similiar config? Is your issue resolved?

Thanks Oliver

Adam Lackorzynski wrote:

I've now updated to rc21 (with the patch).

-- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver

Will try when atrpms's rpm are available ;)

What worries me is that the issue is from rc7 until rc21. Will post in a couple if hours.

Will it help to delete all index files for the user? Since the user is downloading all his emails using pop3, it will be lije creating a new user account and starting to receive emails.

Thanks Oliver

Adam Lackorzynski wrote:

Not really (as explained somewhere else in the thread). Please retry with rc22 and see if that fixes anything.

Adam

-- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver

Timo,

I just found the error message in another logfile :(

On Thu Feb 01, 2007 at 11:22:25 +0100, Adam Lackorzynski wrote:

Hi,

On Wed Jan 10, 2007 at 04:00:00 +0200, Timo Sirainen wrote:

...

On 10.1.2007, at 0.52, Adam Lackorzynski wrote:

...

Nov 15 16:17:20 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:21 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=5/84611, del=5/5, size=84524 Nov 15 16:17:39 Info: pop3-login: Login: user=<user9>,
method=PLAIN, rip=x, lip=x, TLS Nov 15 16:17:39 Info: POP3(user9): Disconnected: Logged out
top=0/0, retr=4/63032, del=4/4, size=62963

So it all looks ok.. Could you try if the attached patch logs
anything when the duplication happens?

It happened again for one user but the patch didn't log anything. Running rc17.

The sequence is as follows:

2007-01-31 11:50:11 1HCD2Z-0007vm-PS <= xxx 2007-01-31 11:50:18 1HCD2Z-0007vm-PS => user9 R=procmail T=procmail_pipe

Jan 31 11:50:31 Info: pop3-login: Login: user=<user9>, method=PLAIN, rip=x, lip=x, TLS Jan 31 11:51:33 Info: POP3(user9): Disconnected: Logged out top=0/0, retr=1773/13208190, del=1773/1773, size=13177735

Jan 31 11:51:32 dovecot: POP3(user9): mbox sync: UID inserted in the middle of mailbox /home/user9/Mail/INBOX (416529 > 154, seq=792, idx_msgs=1773) Jan 31 11:51:32 dovecot: POP3(user9): Broken header: X-UID:

Now, does that tell anything?

Thanks, Adam

Adam adam@os.inf.tu-dresden.de Lackorzynski http://os.inf.tu-dresden.de/~adam/

On Mon, 2007-02-05 at 20:00 +0200, Timo Sirainen wrote:

On 4.2.2007, at 14.13, Adam Lackorzynski wrote:

...

Jan 31 11:51:32 dovecot: POP3(user9): mbox sync: UID inserted in
the middle of mailbox /home/user9/Mail/INBOX (416529 > 154,
seq=792, idx_msgs=1773)

This explains the duplicate emails. My answer to this is pretty much
the same as http://dovecot.org/list/dovecot/2007-February/019272.html

Does rc22 fix this problem?

# Note that Outlook 2003 seems to have problems with %v.%u format which was # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.

Where i can change this

2006/11/20, Alex abusquets@gmail.com:

pop3_uidl_format = %v

2006/11/20, Knute Johnson knute@frazmtn.com:

...

...

i'm working with dovecot-1.0.rc15

I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3

I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.

-- Knute Johnson Molon Labe...

I think that is the default on mine.

i solved with this, i think

pop3_uidl_format = %08Xu%08Xv

2006/11/20, Alex abusquets@gmail.com:

...

# Note that Outlook 2003 seems to have problems with %v.%u format which was # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.

Where i can change this

2006/11/20, Alex abusquets@gmail.com:

...

pop3_uidl_format = %v

2006/11/20, Knute Johnson knute@frazmtn.com:

...

...

i'm working with dovecot-1.0.rc15

I have receive a lot of duplicate emails with microsoft outlook, i don't have this problem with outlook express This is in pop3

I have seen this occaisionally too. I cannot make it happen. I'm running version dovecot-1.0-0.beta8.2.fc5 on my FC5 box. The client is Pegasus Mail 4.41 running on Windows XP. I have Popfile and Avast in between and I am retrieving the mail from the POP3S.

-- Knute Johnson Molon Labe...

-- Knute Johnson Molon Labe...