[Dovecot] Reproducible duplicate messages bug with Mail.app+Dovecot
Hey guys,
I am not sure if this is a Mail.app bug or a dovecot bug. I can
reproduce it 100% of the time using dovecot and Mail.app. I cannot
reproduce it with other imap clients, which at first made me think it
was Mail.app, but then I tried Mail.app with other imap servers and
couldn't reproduce it either, so it's definitely the combination of
the two. So I thought I'd try you guys first before submitting a
bug to Apple.
The problem: If I move multiple messages (set "A") from one imap
folder to another, then delete those messages, and then move another
set into that same folder (set "B"), then all the messages in set B
show up as duplicates until I relaunch Mail.app.
My configuration: Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1 Client: Mail.app 2.1 on OS X 10.4.8
Steps to reproduce: (these steps involve trashing messages, so it's
best to test this on email you are going to toss anyway)
- Create a new imap folder (let's say "bar")
- Drag more than one message (let's say 3 or 4) from existing imap
folder "foo" to new folder "bar". - Click on new folder "bar" and see messages in there.
- Select messages and delete them (Delete key). Messages are gone
as expected. - Go back to original folder "foo" and drag a few more messages into
new folder "bar" - Click on bar.
- You will notice that all the second set of messages show up twice.
Relaunching Mail.app at this point makes the problem disappear. I'm
guessing this has something to do with the deleted messages from Set
A being purged until the close of imap connection.
Any help narrowing this down would be appreciated.
Thank you,
--Andy
Andrew Moran schrieb:
Hey guys,
I am not sure if this is a Mail.app bug or a dovecot bug. I can reproduce it 100% of the time using dovecot and Mail.app. I cannot reproduce it with other imap clients, which at first made me think it was Mail.app, but then I tried Mail.app with other imap servers and couldn't reproduce it either, so it's definitely the combination of the two. So I thought I'd try you guys first before submitting a bug to Apple.
The problem: If I move multiple messages (set "A") from one imap folder to another, then delete those messages, and then move another set into that same folder (set "B"), then all the messages in set B show up as duplicates until I relaunch Mail.app.
My configuration: Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1 Client: Mail.app 2.1 on OS X 10.4.8
Steps to reproduce: (these steps involve trashing messages, so it's best to test this on email you are going to toss anyway)
- Create a new imap folder (let's say "bar")
- Drag more than one message (let's say 3 or 4) from existing imap folder "foo" to new folder "bar".
- Click on new folder "bar" and see messages in there.
- Select messages and delete them (Delete key). Messages are gone as expected.
- Go back to original folder "foo" and drag a few more messages into new folder "bar"
- Click on bar.
- You will notice that all the second set of messages show up twice.
Relaunching Mail.app at this point makes the problem disappear. I'm guessing this has something to do with the deleted messages from Set A being purged until the close of imap connection. Any help narrowing this down would be appreciated.
Thank you,
--Andy
Hi Andrew,
i have some reports for double mails with a courier server imap with apple mail too ( which i cant found in the mail log, and have no real idea where they come from, i was nearly sure users double them with some filters in the client over some other server, but hearing your problem i get awake that this might be a general apple mail bug), so are sure that is not a apple bug, have you asked at some apple mail list for clearing? I hadnt the chance to inspect some of that so called double mail, cause the users delete them always at once ( i told them to leave me examples in imap , but as users are they ignore what i said but cry on if the failure comes again ) So iam really unsure if there is any relations between your failure and mine, but a broken client might be also a answer. I am sorry to have no apple at my own to make tests with my dovecot or courier setups
After all i sometimes see likely behavior in thunderbird too with imap dovecot and courier for short times, its a caching thing, if i click on the meant to be double mails, imap syncs and they disapear, ( so there is no double in fact ) so i simple ignore this, i think this comes up with many mails and choosen option folders for offline usage.
-- Mit freundlichen Gruessen Best Regards
Robert Schetterer
https://www.schetterer.org Munich/Bavaria/Germany
On Sat, 2007-02-10 at 12:00 -0800, Andrew Moran wrote:
Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1
Linux here.
Client: Mail.app 2.1 on OS X 10.4.8
Same here. Says 2.1 (752/752.2).
- Create a new imap folder (let's say "bar")
- Drag more than one message (let's say 3 or 4) from existing imap
folder "foo" to new folder "bar".
By this I suppose you mean the move operation, which does internally COPY + STORE \Deleted for the selected messages.
- Click on new folder "bar" and see messages in there.
- Select messages and delete them (Delete key). Messages are gone
as expected.
So just mark them deleted, no expunge?
- Go back to original folder "foo" and drag a few more messages into
new folder "bar"- Click on bar.
- You will notice that all the second set of messages show up twice.
The first set is still gone?
I couldn't reproduce it. What Trash settings do you have? Anyway like others suggested looking at rawlog output would be helpful in showing what goes wrong.
Also have you tried recreating your Dovecot account in Mail.app? That alone might fix it..
Hey Timo,
Thanks for the response.
Yes, the original set is still gone, which is the odd thing about
this. It's only the new set that show up duplicates. And as for
my Trash settings, I have it "Move deleted messages to the Trash
mailbox" and "Store deleted messages on the server" checked.
I'm surprised you aren't seeing the same behavior as myself as we
have very similar setups. I have tried using different machines,
and different accounts, and I always get the same behavior --
messages show up twice after moving messages if other messages were
deleted (but not expunged) in that folder.
Someone else suggested I use dovecot logging, so I'll look into that.
--Andy
On Feb 12, 2007, at 9:00 AM, Timo Sirainen wrote:
On Sat, 2007-02-10 at 12:00 -0800, Andrew Moran wrote:
Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1
Linux here.
Client: Mail.app 2.1 on OS X 10.4.8
Same here. Says 2.1 (752/752.2).
- Create a new imap folder (let's say "bar")
- Drag more than one message (let's say 3 or 4) from existing imap folder "foo" to new folder "bar".
By this I suppose you mean the move operation, which does internally COPY + STORE \Deleted for the selected messages.
- Click on new folder "bar" and see messages in there.
- Select messages and delete them (Delete key). Messages are gone as expected.
So just mark them deleted, no expunge?
- Go back to original folder "foo" and drag a few more messages into new folder "bar"
- Click on bar.
- You will notice that all the second set of messages show up twice.
The first set is still gone?
I couldn't reproduce it. What Trash settings do you have? Anyway like others suggested looking at rawlog output would be helpful in showing what goes wrong.
Also have you tried recreating your Dovecot account in Mail.app? That alone might fix it..
Just a final followup on this issue. I tried a beta build of the
Mail.app that comes in Leopard and I couldn't reproduce the problem,
so I'm just going to chalk this up to Mail.app weirdness.
One difference I do notice is that in Mail.app 2.1, when I delete
messages, the messages don't actually get removed from the server
until I quit Mail.app. (I'm not an expert in IMAP but I think that
means its marking it as deleted but not expunging until quitting,
which I think is normal behavior for an imap client?) In the
Mail.app, the messages disappear from the server as soon as I click
on another folder. I'm going to guess this has something to do with
the duplicated messages issue.
Anyway, since it's not that annoying and it seems to be fixed in
future versions, I'm going to lay this one to rest. Thanks for
everyone's help on it.
--Andy
On Feb 12, 2007, at 10:44 AM, Andrew Moran wrote:
Hey Timo,
Thanks for the response.
Yes, the original set is still gone, which is the odd thing about
this. It's only the new set that show up duplicates. And as for
my Trash settings, I have it "Move deleted messages to the Trash
mailbox" and "Store deleted messages on the server" checked.I'm surprised you aren't seeing the same behavior as myself as we
have very similar setups. I have tried using different machines,
and different accounts, and I always get the same behavior --
messages show up twice after moving messages if other messages
were deleted (but not expunged) in that folder.Someone else suggested I use dovecot logging, so I'll look into that.
--Andy
On Feb 12, 2007, at 9:00 AM, Timo Sirainen wrote:
On Sat, 2007-02-10 at 12:00 -0800, Andrew Moran wrote:
Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1
Linux here.
Client: Mail.app 2.1 on OS X 10.4.8
Same here. Says 2.1 (752/752.2).
- Create a new imap folder (let's say "bar")
- Drag more than one message (let's say 3 or 4) from existing imap folder "foo" to new folder "bar".
By this I suppose you mean the move operation, which does internally COPY + STORE \Deleted for the selected messages.
- Click on new folder "bar" and see messages in there.
- Select messages and delete them (Delete key). Messages are gone as expected.
So just mark them deleted, no expunge?
- Go back to original folder "foo" and drag a few more messages
into new folder "bar"- Click on bar.
- You will notice that all the second set of messages show up
twice.The first set is still gone?
I couldn't reproduce it. What Trash settings do you have? Anyway like others suggested looking at rawlog output would be helpful in showing what goes wrong.
Also have you tried recreating your Dovecot account in Mail.app? That alone might fix it..
participants (3)
-
Andrew Moran
-
Robert Schetterer
-
Timo Sirainen