[Dovecot] FETCH for mailbox INBOX UID 39641 got too little data: 4823 vs 4825
Whenever I try to access an e-mail in the middle (rather than at the end) of the mailbox, my mail-client (KMail) gets an error a message like this is logged in the maillog:
IMAP(mi): FETCH for mailbox INBOX UID 39641 got too little data: 4823 vs 4825 IMAP(mi): Disconnected: Disconnected
The actual numbers vary, but it is always X vs X+2
The problem started when I upgraded to 1.0.8. Unfortunately, it is still here with 1.0.9. The mailbox in question is the standard Unix mbox (/var/mail/mi in my case).
The server runs FreeBSD/amd64. Please, advise. Thanks!
-mi
On Mon, 2007-12-17 at 16:24 -0500, Mikhail Teterin wrote:
Whenever I try to access an e-mail in the middle (rather than at the end) of the mailbox, my mail-client (KMail) gets an error a message like this is logged in the maillog:
IMAP(mi): FETCH for mailbox INBOX UID 39641 got too little data: 4823 vs 4825 IMAP(mi): Disconnected: Disconnected
The actual numbers vary, but it is always X vs X+2
Do you have CR characters in the mbox file? Does the patch below fix it? It makes it work the same way as before 1.0.8, but it's slower.. diff -r 2cedab21cd6d src/lib-storage/index/mbox/mbox-mail.c --- a/src/lib-storage/index/mbox/mbox-mail.c Thu Dec 20 23:01:04 2007 +0200 +++ b/src/lib-storage/index/mbox/mbox-mail.c Thu Dec 20 23:11:39 2007 +0200 @@ -191,6 +191,7 @@ static uoff_t mbox_mail_get_physical_siz } else { body_size = (uoff_t)-1; } + body_size = (uoff_t)-1; /* verify that the calculated body size is correct */ body_size = istream_raw_mbox_get_body_size(stream, body_size);
Have you tried to clear your index and cache files for this mailbox?
(dovecot. Files)
Mark.
On 17 Dec 2007, at 21:24, Mikhail Teterin <mi+mill@aldan.algebra.com>
wrote:
Whenever I try to access an e-mail in the middle (rather than at the
end) of the mailbox, my mail-client (KMail) gets an error a message like
this is logged in the maillog:IMAP(mi): FETCH for mailbox INBOX UID 39641 got too little data:
4823 vs 4825 IMAP(mi): Disconnected: DisconnectedThe actual numbers vary, but it is always X vs X+2
The problem started when I upgraded to 1.0.8. Unfortunately, it is
still here with 1.0.9. The mailbox in question is the standard Unix mbox (/var/ mail/mi in my case).The server runs FreeBSD/amd64. Please, advise. Thanks!
-mi
Mark Adams wrote:
Have you tried to clear your index and cache files for this mailbox? (dovecot. Files)
Mark.
On 17 Dec 2007, at 21:24, Mikhail Teterin <mi+mill@aldan.algebra.com> wrote:
Whenever I try to access an e-mail in the middle (rather than at the end) of the mailbox, my mail-client (KMail) gets an error a message like this is logged in the maillog:
IMAP(mi): FETCH for mailbox INBOX UID 39641 got too little data: 4823 vs 4825 IMAP(mi): Disconnected: Disconnected
The actual numbers vary, but it is always X vs X+2
The problem started when I upgraded to 1.0.8. Unfortunately, it is still here with 1.0.9. The mailbox in question is the standard Unix mbox (/var/mail/mi in my case).
The server runs FreeBSD/amd64. Please, advise. Thanks!
-mi I have dovecot-1.0.9, with recent patches up to hg changeset 5498:fc5f6bbbf4c0. Dovecot configuration is the following:
# dovecot -n # 1.0.9: /etc/dovecot/dovecot.conf protocols: imap imaps pop3 pop3s ssl_cert_file: /var/lib/ssl/certs/dovecot.pem ssl_key_file: /var/lib/ssl/private/dovecot.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_extra_groups: mail mbox_write_locks: fcntl mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384
And I have the same problem with 'got too little data' in logs, and mail client (Thunderbird@MacOS) can not fetch messages. I have tried to remove all dovecot.index* files in .imap directory, seems it helped to open first messages, but then the problem reappears. snippet from the log:
Dec 27 23:05:17 dovecot dovecot: IMAP(seriv): FETCH for mailbox xen-discuss-opensolaris-org UID 3 got too little data: 4427 vs 4430 Dec 27 23:05:17 dovecot dovecot: IMAP(seriv): Disconnected: DisconnectedDec 27 23:05:17 dovecot dovecot: imap-login: Login: user=<seriv>, method=PLAIN, rip=192.168.10.10, lip=192.168.10.110, TLS
This does not happen for INBOX. These 3 lines appears repeating about 5-10 times in a second in the log. About the numbers:
grep 'got too litt' /var/log/maillog | sed 's/.*got too little data: //' | sort -u -n 1688 vs 1693 4427 vs 4430 4552 vs 4558 5119 vs 5120 8567 vs 8570 9527 vs 9543 54605 vs 54608
-- Sergey Ivanov.
With these changes I can't break it anymore:
http://hg.dovecot.org/dovecot-1.0/rev/0713de760c5f http://hg.dovecot.org/dovecot-1.0/rev/fc5f6bbbf4c0 http://hg.dovecot.org/dovecot-1.0/rev/0a4f86976f50
Timo Sirainen wrote:
With these changes I can't break it anymore:
http://hg.dovecot.org/dovecot-1.0/rev/0713de760c5f http://hg.dovecot.org/dovecot-1.0/rev/fc5f6bbbf4c0 http://hg.dovecot.org/dovecot-1.0/rev/0a4f86976f50
Yes, thanks Timo, it seems to be fixed!
Sergey Ivanov.On Mon, 2007-12-17 at 16:24 -0500, Mikhail Teterin wrote:
IMAP(mi): FETCH for mailbox INBOX UID 39641 got too little data: 4823 vs 4825
See if this helps: http://hg.dovecot.org/dovecot-1.0/rev/0713de760c5f
On Sat, 2007-12-22 at 06:55 +0200, Timo Sirainen wrote:
On Mon, 2007-12-17 at 16:24 -0500, Mikhail Teterin wrote:
IMAP(mi): FETCH for mailbox INBOX UID 39641 got too little data: 4823 vs 4825
See if this helps: http://hg.dovecot.org/dovecot-1.0/rev/0713de760c5f
No, sorry, I was accidentally testing it with maildir. That seems to just make it break more easily. I'll continue tomorrow.
The troubles continue with the version 1.0.10. I sort-of patched it up with the attached hack just to get by, because the situation was terrible with A LOT of messages causing the sudden disconnect of the dovecot server.
It is always off by exactly two bytes:
Jan 3 18:08:28 bonkers dovecot: IMAP(mi): FETCH for mailbox INBOX UID 40703 got too little data: 4916 vs 4918 Jan 3 18:08:28 bonkers dovecot: IMAP(mi): Local patch: pretending, sent-size matches virtual Jan 3 18:08:29 bonkers dovecot: IMAP(mi): FETCH for mailbox INBOX UID 40615 got too little data: 4452 vs 4454 Jan 3 18:08:29 bonkers dovecot: IMAP(mi): Local patch: pretending, sent-size matches virtual Jan 3 18:08:30 bonkers dovecot: IMAP(mi): FETCH for mailbox INBOX UID 40703 got too little data: 4916 vs 4918 Jan 3 18:08:30 bonkers dovecot: IMAP(mi): Local patch: pretending, sent-size matches virtual
If you'd like, I can upload a sample mbox for your testing -- there is nothing particularly private in it, and it is all in Russian anyway :)
But something needs to be done -- urgently... Thanks! Yours,
-mi
On Fri, 2008-01-04 at 12:27 -0500, Mikhail Teterin wrote:
Jan 3 18:08:28 bonkers dovecot: IMAP(mi): FETCH for mailbox INBOX UID 40703 got too little data: 4916 vs 4918 .. If you'd like, I can upload a sample mbox for your testing -- there is nothing particularly private in it, and it is all in Russian anyway :)
I can't reproduce it myself anymore, so sure a sample mbox would help, and maybe its index files. Or does it help if you just delete the dovecot.index.cache files? Could you also show your dovecot -n output?
п'ятниця 04 січень 2008 03:37 по, Timo Sirainen Ви написали:
I can't reproduce it myself anymore, so sure a sample mbox would help,
Where can I upload it?
and maybe its index files. Or does it help if you just delete the dovecot.index.cache files?
I don't think, I have any... Do they exist with mbox-type mailboxes? Where would they be?
Could you also show your dovecot -n output?
root@bonkers:/usr/ports (101) dovecot -n # 1.0.10: /opt/etc/dovecot.conf protocols: imap imaps pop3s pop3 ssl_cert_file: /opt/certs/imapd.pem ssl_key_file: /opt/certs/imapd.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /opt/libexec/dovecot/imap-login login_executable(imap): /opt/libexec/dovecot/imap-login login_executable(pop3): /opt/libexec/dovecot/pop3-login login_processes_count: 2 login_max_processes_count: 17 valid_chroot_dirs: /var/mail verbose_proctitle: yes first_valid_uid: 100 first_valid_gid: 0 mail_location: mbox:~/Mail/:INBOX=/var/mail/%u:mbox:/home/smirnov/Mail/mks/INBOX mmap_disable: yes maildir_copy_with_hardlinks: yes mbox_write_locks: fcntl mail_executable(default): /opt/libexec/dovecot/imap mail_executable(imap): /opt/libexec/dovecot/imap mail_executable(pop3): /opt/libexec/dovecot/pop3 mail_plugin_dir(default): /opt/lib/dovecot/imap mail_plugin_dir(imap): /opt/lib/dovecot/imap mail_plugin_dir(pop3): /opt/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls auth default: verbose: yes passdb: driver: passwd userdb: driver: passwd
Yours,
-mi
On Fri, 2008-01-04 at 15:46 -0500, Mikhail Teterin wrote:
п'ятниця 04 січень 2008 03:37 по, Timo Sirainen Ви написали:
I can't reproduce it myself anymore, so sure a sample mbox would help,
Where can I upload it?
You could send it to tss@dovecot.org. It accepts max. 100MB mails (temporarily).
and maybe its index files. Or does it help if you just delete the dovecot.index.cache files?
I don't think, I have any... Do they exist with mbox-type mailboxes? Where would they be?
~/mail/.imap/<mailbox>/
It's possible that those are just broken cached values from older versions and deleting the cache files would fix the problem.
Of course some day I should have Dovecot fix those itself automatically.
mbox:~/Mail/:INBOX=/var/mail/%u:mbox:/home/smirnov/Mail/mks/INBOX
":mbox:/home/smirnov/Mail/mks/INBOX" looks broken, but I think it's just ignored.
mmap_disable: yes
Why? Do you use NFS?
participants (5)
-
Mark Adams
-
Mikhail Teterin
-
Sergey Ivanov
-
sergey ivanov
-
Timo Sirainen