[Dovecot] UID confusion
Hi,
2 or 3 customers have reported that they are having problems downloading their mail via. POP3. I have attached the rawlogs of their transactions and the UID list at the time. Is this because I am using an incompatible UID format or is something else at fault? Deleting the UID list and indexes fixes the problem. I am using Test72.
Regards Andrew
-- Andrew Hutchings (A-Wing) - Linux Guru Netserve Consultants - http://www.domaincity.co.uk/ A-Wing Internet Services - http://www.a-wing.co.uk/ Random quote 148: "We had planned to integrate a Web browser with our operating system as far back as 1993" - Microsoft (27 Jul 1998, filing its first court responses to federal antitrust)
STAT UIDL DELE 12 DELE 13 DELE 14 DELE 15 DELE 16 DELE 17 DELE 18 DELE 19 DELE 20 DELE 21 DELE 22 DELE 23 DELE 24 DELE 25 DELE 26 DELE 27 DELE 28 DELE 29 DELE 30 DELE 31 DELE 32 DELE 33 DELE 34 DELE 12 DELE 31 DELE 20 DELE 14 DELE 32 DELE 19 DELE 21 DELE 33 DELE 23 DELE 28 DELE 22 DELE 34 DELE 27 DELE 30 DELE 24 DELE 18 DELE 17 DELE 29 DELE 26 DELE 25 DELE 15
+OK 37 3133628 +OK 1 1102086912.6586 2 1102086912.6604 3 1102086912.6606 4 1102086912.6607 5 1102086912.6613 6 1102086912.6614 7 1102086912.6624 8 1102086912.6627 9 1102086912.6628 10 1102086912.6637 11 1102086912.6638 12 1102086912.6642 13 1102086912.6643 14 1102086912.6644 15 1102086912.6645 16 1102086912.6646 17 1102086912.6647 18 1102086912.6649 19 1102086912.6650 20 1102086912.6651 21 1102086912.6652 22 1102086912.6653 23 1102086912.6655 24 1102086912.6656 25 1102086912.6657 26 1102086912.6658 27 1102086912.6659 28 1102086912.6660 29 1102086912.6661 30 1102086912.6662 31 1102086912.6663 32 1102086912.6664 33 1102086912.6665 34 1102086912.6666 35 1102086912.6668 36 1102086912.6669 37 1102086912.6670 . +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. +OK Marked to be deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Too many bad commands.
1 1102086912 6671 6586 1119365297.H428351P22768.svr34.nsnoc.com:2,S 6604 1119430792.H16069P15059.svr34.nsnoc.com:2,S 6606 1119435803.H269574P27211.svr34.nsnoc.com:2,S 6607 1119438782.H651475P11876.svr34.nsnoc.com:2,S 6613 1119444180.H435092P3752.svr34.nsnoc.com:2,S 6614 1119446623.H168979P14147.svr34.nsnoc.com:2,S 6624 1119519980.H840253P23730.svr34.nsnoc.com:2,S 6627 1119534126.H915877P9542.svr34.nsnoc.com:2,S 6628 1119534129.H58338P9545.svr34.nsnoc.com:2,S 6637 1119590807.H77202P16581.svr34.nsnoc.com:2,S 6638 1119594010.H314838P14558.svr34.nsnoc.com:2,S 6642 1119631309.H826676P15985.svr34.nsnoc.com:2,S 6643 1119634096.H108358P8422.svr34.nsnoc.com:2,S 6644 1119651249.H740483P15403.svr34.nsnoc.com:2,S 6645 1119652382.H85165P25444.svr34.nsnoc.com:2,S 6646 1119662861.H891233P15682.svr34.nsnoc.com:2,S 6647 1119666011.H343203P9515.svr34.nsnoc.com:2,S 6648 1119678421.H726408P9343.svr34.nsnoc.com:2,S 6649 1119682873.H656272P7774.svr34.nsnoc.com:2,S 6650 1119709610.H933163P23969.svr34.nsnoc.com:2,S 6651 1119711088.H95605P27225.svr34.nsnoc.com:2,S 6652 1119717756.H183955P3515.svr34.nsnoc.com:2,S 6653 1119726592.H247339P1807.svr34.nsnoc.com:2,S 6654 1119727779.H102401P8785.svr34.nsnoc.com:2,S 6655 1119749596.H731030P9216.svr34.nsnoc.com:2,S 6656 1119760115.H508676P14834.svr34.nsnoc.com:2,S 6657 1119761702.H762025P27895.svr34.nsnoc.com:2,S 6658 1119774991.H8003P28710.svr34.nsnoc.com:2,S 6659 1119780623.H432714P11671.svr34.nsnoc.com:2,S 6660 1119797027.H333204P330.svr34.nsnoc.com:2,S 6661 1119799332.H700308P15617.svr34.nsnoc.com:2,S 6662 1119800637.H600428P30602.svr34.nsnoc.com:2,S 6663 1119807991.H64209P14572.svr34.nsnoc.com:2,S 6664 1119808834.H473596P22065.svr34.nsnoc.com:2,S 6665 1119838893.H830072P23165.svr34.nsnoc.com:2,S 6666 1119838934.H873217P23186.svr34.nsnoc.com:2,S 6667 1119860409.H899984P26859.svr34.nsnoc.com:2, 6668 1119860596.H249033P27907.svr34.nsnoc.com 6669 1119867953.H904781P22645.svr34.nsnoc.com 6670 1119867978.H374439P22691.svr34.nsnoc.com
On 28.6.2005, at 11:39, Andrew Hutchings wrote:
2 or 3 customers have reported that they are having problems downloading their mail via. POP3. I have attached the rawlogs of their transactions and the UID list at the time. Is this because I am using an incompatible UID format or is something else at fault? Deleting the UID list and indexes fixes the problem. I am using Test72.
Sounds a bit like the Thunderbird problem.. ..
-ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Too many bad commands.
But this is why it really fails. Dovecot disconnects the client here. Hmm. I'll make the disconnection happen only when sending enough (20) unknown commands, not when sending known commands but with invalid parameters. This should fix it: Index: client.c =================================================================== RCS file: /var/lib/cvs/dovecot/src/pop3/client.c,v retrieving revision 1.55 diff -u -r1.55 client.c --- client.c 28 May 2005 11:20:49 -0000 1.55 +++ client.c 28 Jun 2005 09:52:24 -0000 @@ -351,7 +351,7 @@ else *args++ = '\0'; - if (client_command_execute(client, line, args)) { + if (client_command_execute(client, line, args) >= 0) { client->bad_counter = 0; if (client->cmd != NULL) { o_stream_set_flush_pending(client->output, Index: commands.c =================================================================== RCS file: /var/lib/cvs/dovecot/src/pop3/commands.c,v retrieving revision 1.44 diff -u -r1.44 commands.c --- commands.c 23 May 2005 19:46:27 -0000 1.44 +++ commands.c 28 Jun 2005 09:52:24 -0000 @@ -688,5 +688,5 @@ } client_send_line(client, "-ERR Unknown command: %s", name); - return FALSE; + return -1; }
Timo Sirainen wrote:
On 28.6.2005, at 11:39, Andrew Hutchings wrote:
2 or 3 customers have reported that they are having problems downloading their mail via. POP3. I have attached the rawlogs of their transactions and the UID list at the time. Is this because I am using an incompatible UID format or is something else at fault?
Deleting the UID list and indexes fixes the problem. I am using Test72.Sounds a bit like the Thunderbird problem..
..
Sounds like it, but that client was Outlook 2003, and I have had a client using entourage with the same problem last week, it isn't a very common problem.
-ERR Message is deleted. -ERR Message is deleted. -ERR Message is deleted. -ERR Too many bad commands.
But this is why it really fails. Dovecot disconnects the client here. Hmm. I'll make the disconnection happen only when sending enough (20) unknown commands, not when sending known commands but with invalid parameters. This should fix it:
Thanks, I shall patch up and let you know of any other strange goings on, getting harder to find problems though, you may have to beta soon at this rate.
Regards Andrew
Andrew Hutchings (A-Wing) - Linux Guru Netserve Consultants - http://www.domaincity.co.uk/ A-Wing Internet Services - http://www.a-wing.co.uk/ Random quote 159: "If you want to travel around the world and be invited to speak at a lot of different places, just write a Unix operating system." - (By Linus Torvalds)
On 28.6.2005, at 13:05, Andrew Hutchings wrote:
Timo Sirainen wrote:
On 28.6.2005, at 11:39, Andrew Hutchings wrote:
2 or 3 customers have reported that they are having problems downloading their mail via. POP3. I have attached the rawlogs of their transactions and the UID list at the time. Is this because I am using an incompatible UID format or is something else at fault?
Deleting the UID list and indexes fixes the problem. I am using Test72. Sounds a bit like the Thunderbird problem.. ..Sounds like it, but that client was Outlook 2003, and I have had a client using entourage with the same problem last week, it isn't a very common problem.
Outlook 2003 (and I suppose Entourage too) doesn't handle Dovecot's default POP3 UIDLs well. You should probably change them if you can. That may have caused this bug as well.
# Note that Outlook 2003 seems to have problems with %v.%u format which is # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.
Timo Sirainen wrote:
On 28.6.2005, at 13:05, Andrew Hutchings wrote:
Timo Sirainen wrote:
On 28.6.2005, at 11:39, Andrew Hutchings wrote:
2 or 3 customers have reported that they are having problems downloading their mail via. POP3. I have attached the rawlogs of their transactions and the UID list at the time. Is this because I am using an incompatible UID format or is something else at fault?
Deleting the UID list and indexes fixes the problem. I am using Test72.Sounds a bit like the Thunderbird problem.. ..
Sounds like it, but that client was Outlook 2003, and I have had a client using entourage with the same problem last week, it isn't a very common problem.
Outlook 2003 (and I suppose Entourage too) doesn't handle Dovecot's default POP3 UIDLs well. You should probably change them if you can. That may have caused this bug as well.
# Note that Outlook 2003 seems to have problems with %v.%u format which is # Dovecot's default, so if you're building a new server it would be a good # idea to change this. %08Xu%08Xv should be pretty fail-safe.
I was thinking of doing that and I'm sure there is a very good reason why I didn't. Sod the users if they want to store mail they should use IMAP, change of UID time I think. Quick question though, will a UID format change break anything considering there are 6000 mailboxes in use (apart from mail storing users)?
Regards Andrew
-- Andrew Hutchings (A-Wing) - Linux Guru Netserve Consultants - http://www.domaincity.co.uk/ A-Wing Internet Services - http://www.a-wing.co.uk/ Random quote 219: "Windoze NT is to the Unix community what Compu$erve is to the Internet" - Donal K. Fellows
participants (2)
-
Andrew Hutchings
-
Timo Sirainen