[Dovecot] dovecot-1.0.rc2 hangs while copying to Sent
Hello,
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's copying outbound mail to the Sent folder. Running beta8 and earlier I never saw this problem. Anyone know what's up and how to fix it?
Thanks, Jack
-- http://banners.wunderground.com/banner/gizmotimetemp/US/CA/San_Diego.gif
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's copying outbound mail to the Sent folder. Running beta8 and earlier I never saw this problem. Anyone know what's up and how to fix it?
With SSL?
Now that you mention it, yes. I always use SSL. But the config is the same AFAICT.
Jack
On Jul 7, 2006, at 2:14 AM, Jack Bailey wrote:
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's
copying outbound mail to the Sent folder. Running beta8 and
earlier I never saw this problem. Anyone know what's up and how
to fix it?With SSL?
Now that you mention it, yes. I always use SSL. But the config is
the same AFAICT.
Well, I guess it's this:
* SSL code rewrite which hopefully makes it work better than before.
Seems to work correctly, but if you suddently have trouble with SSL
connections this is likely the reason.Could you try if using src/login-common/ssl-proxy-openssl.c from rc1
fixes this? The older Dovecot releases can be got from http://
dovecot.org/releases/
On Jul 6, 2006, at 4:18 PM, Timo Sirainen wrote:
On Jul 7, 2006, at 2:14 AM, Jack Bailey wrote:
Since running dovecot-1.0.rc2, tbird occasionally hangs when
it's copying outbound mail to the Sent folder. Running beta8
and earlier I never saw this problem. Anyone know what's up and
how to fix it?With SSL?
Now that you mention it, yes. I always use SSL. But the config
is the same AFAICT.Well, I guess it's this:
- SSL code rewrite which hopefully makes it work better than before. Seems to work correctly, but if you suddently have trouble with SSL connections this is likely the reason.
Could you try if using src/login-common/ssl-proxy-openssl.c from
rc1 fixes this? The older Dovecot releases can be got from http:// dovecot.org/releases/
We're using beta7 for our IMAP testing and have seen this too.
Thunderbird 1.5.0.4 using SSL occasionally hangs on "Sending
authenticate information" when moving a message into Sent or Deleted
items (although usually the message does actually get moved). We
figured this might be a client issue.
Rich
On Jul 7, 2006, at 2:14 AM, Jack Bailey wrote:
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's copying outbound mail to the Sent folder. Running beta8 and earlier I never saw this problem. Anyone know what's up and how to fix it?
With SSL?
Now that you mention it, yes. I always use SSL. But the config is the same AFAICT.
Well, I guess it's this:
* SSL code rewrite which hopefully makes it work better than before. Seems to work correctly, but if you suddently have trouble with SSL connections this is likely the reason.Could you try if using src/login-common/ssl-proxy-openssl.c from rc1 fixes this? The older Dovecot releases can be got from http://dovecot.org/releases/ Replacing ssl-proxy-openssl.c in rc2 with the one from rc1 did not fix
Timo Sirainen wrote: this problem for us. [thunderbird stalling when trying to save message to sent folder using IMAP SSL to dovecot. Reproducible each time for me if two moderate sized text files were attached to a new message]
All our Thunderbird problems with save to sent folder have been fixed in Thunderbird 1.5.0.5 - both Windows and Mac.
We have always had very occasional Thunderbird "save to sent folder" problems (with IMAP over SSL, typically with an attachment) ... as of Thunderbird 1.5.0.4 this became frequent and repeatable. I could reproduce the problem with specific test messages in Thunderbird 1.5.0.4 against Dovecot's beta7, beta9, rc1 and rc2 (i.e. all the Dovecot releases I tried when looking at this issue).
While the problem may have become more frequent with the combo of Dovecot rc2 and Thunderbird 1.5.0.4, the bug had always been in Thunderbird to some extent. The Thunderbird bug seems fixed in 1.5.0.5.
Rob.
On Mon, 2006-07-31 at 00:57 +1000, Rob Middleton wrote:
Well, I guess it's this:
* SSL code rewrite which hopefully makes it work better than before. Seems to work correctly, but if you suddently have trouble with SSL connections this is likely the reason.Could you try if using src/login-common/ssl-proxy-openssl.c from rc1 fixes this? The older Dovecot releases can be got from http://dovecot.org/releases/ Replacing ssl-proxy-openssl.c in rc2 with the one from rc1 did not fix this problem for us. [thunderbird stalling when trying to save message to sent folder using IMAP SSL to dovecot. Reproducible each time for me if two moderate sized text files were attached to a new message]
And that's why I did the rewrite, trying to fix this properly :) I heard that these patches should fix it:
http://dovecot.org/list/dovecot-cvs/2006-July/006096.html http://dovecot.org/list/dovecot-cvs/2006-July/006098.html
Hi,
Jack Bailey wrote:
Hello,
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's copying outbound mail to the Sent folder. Running beta8 and earlier I never saw this problem. Anyone know what's up and how to fix it?
Thanks, Jack
See http://dovecot.org/list/dovecot/2006-July/014757.html
Regards, Dumitru
I also see the same issue using Pine 4.64 with rc2. It didn't happen with rc1 or earlier. It generally happens with the first sent message of the day and then things are fine after that.
Jeff Earickson Colby College
On Tue, 11 Jul 2006, Dumitru Negara wrote:
Date: Tue, 11 Jul 2006 13:06:03 +0300 From: Dumitru Negara dumitru@itcnetworks.ro To: Jack Bailey jjb@bcc.com Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.0.rc2 hangs while copying to Sent
Hi,
Jack Bailey wrote:
Hello,
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's copying outbound mail to the Sent folder. Running beta8 and earlier I never saw this problem. Anyone know what's up and how to fix it?
Thanks, Jack
See http://dovecot.org/list/dovecot/2006-July/014757.html
Regards, Dumitru
Am 11.07.2006 um 13:06 Uhr +0300 schrieb Dumitru Negara:
Jack Bailey wrote:
Since running dovecot-1.0.rc2, tbird occasionally hangs when it's copying outbound mail to the Sent folder. Running beta8 and earlier I never saw this problem. Anyone know what's up and how to fix it?
Just FTR, while this appears to stop the blind copies into the outbox from stalling, I also got user reports about (site local) mails being delayed for several hours that are not related to smtp transport. When the user in question set the number of cached connections to something like 50, he got a load of mails at once that had all been delayed.
One of the groups here still uses uw-imap, and they do not see this quirk, so it cannot be just Thunderbird's fault.
The stalled copies or outgoing mail happpen with Mozilla, too, btw.
hauke-- /~\ The ASCII Ribbon Campaign Hauke Fath \ / No HTML/RTF in email Institut für Nachrichtentechnik X No Word docs in email TU Darmstadt / \ Respect for open standards Ruf +49-6151-16-3281
On 2006-07-25 10:11:15 +0200, Hauke Fath wrote:
One of the groups here still uses uw-imap, and they do not see this quirk, so it cannot be just Thunderbird's fault.
The stalled copies or outgoing mail happpen with Mozilla, too, btw.
could it just be that mozilla mail and mozilla thunderbird share a fair amound of code?
darix
Marcus Rueckert wrote:
On 2006-07-25 10:11:15 +0200, Hauke Fath wrote:
One of the groups here still uses uw-imap, and they do not see this quirk, so it cannot be just Thunderbird's fault.
The stalled copies or outgoing mail happpen with Mozilla, too, btw.
could it just be that mozilla mail and mozilla thunderbird share a fair amound of code?
darix
Here is an example that I can get to fail every time. I have an IMAP account here locally and an IMAP account at another ISP. When I move messages from folders at the other ISP to folders on my local IMAP server, Tbird hangs indefinitely. Tbird works perfectly with beta8, and this is with the same dovecot.conf file that I use with rc2 and see fail.
Locally I am using NFS-mounted mail and home directories. Both client and server are running CentOS 4.3.
Jack
Jack Bailey wrote:
Marcus Rueckert wrote:
On 2006-07-25 10:11:15 +0200, Hauke Fath wrote:
One of the groups here still uses uw-imap, and they do not see this quirk, so it cannot be just Thunderbird's fault.
The stalled copies or outgoing mail happpen with Mozilla, too, btw.
could it just be that mozilla mail and mozilla thunderbird share a fair amound of code?
darix
Here is an example that I can get to fail every time. I have an IMAP account here locally and an IMAP account at another ISP. When I move messages from folders at the other ISP to folders on my local IMAP server, Tbird hangs indefinitely. Tbird works perfectly with beta8, and this is with the same dovecot.conf file that I use with rc2 and see fail.
Locally I am using NFS-mounted mail and home directories. Both client and server are running CentOS 4.3.
Jack
Whoa, wha happen!?
I just upgraded from beta8 to rc2, and dovecot has gone from being fast and responsive to being nearly unusably slow and hanging Thunderbird every few operations. (I made no configuration changes.)
I am running dovecot on a FreeBSD 6.1-RELEASE-p2 server, and Thunderbird 1.5.0.4 (20060605) on client machines running both FreeBSD 6.1 and Windows XP SP2.
I already set the maximum cached connections to 1 and restarted Thunderbird; it didn't help. I still get a hang on copying to "Sent" files.
Pete
Pete Slagle wrote:
Jack Bailey wrote:
Marcus Rueckert wrote:
On 2006-07-25 10:11:15 +0200, Hauke Fath wrote:
One of the groups here still uses uw-imap, and they do not see this quirk, so it cannot be just Thunderbird's fault.
The stalled copies or outgoing mail happpen with Mozilla, too, btw.
could it just be that mozilla mail and mozilla thunderbird share a fair amound of code?
darix
Here is an example that I can get to fail every time. I have an IMAP account here locally and an IMAP account at another ISP. When I move messages from folders at the other ISP to folders on my local IMAP server, Tbird hangs indefinitely. Tbird works perfectly with beta8, and this is with the same dovecot.conf file that I use with rc2 and see fail.
Locally I am using NFS-mounted mail and home directories. Both client and server are running CentOS 4.3.
Jack
Whoa, wha happen!?
I just upgraded from beta8 to rc2, and dovecot has gone from being fast and responsive to being nearly unusably slow and hanging Thunderbird every few operations. (I made no configuration changes.)
I am running dovecot on a FreeBSD 6.1-RELEASE-p2 server, and Thunderbird 1.5.0.4 (20060605) on client machines running both FreeBSD 6.1 and Windows XP SP2.
I already set the maximum cached connections to 1 and restarted Thunderbird; it didn't help. I still get a hang on copying to "Sent" files.
Pete
Forgot to mention:
auth_cache_size=0 (or whatever the default is when you don't set it)
and it's not an SSL issue:
auth default { mechanisms = plain passdb pam { args = session=yes * } userdb passwd { } user = root }
The problems are much worse for the Thunderbird clients running on FreeBSD than for those on XP, although they are all running 1.5.0.4.
All was well in beta8 - what changed?
Am 25.07.2006 um 16:26 Uhr -0700 schrieb Pete Slagle:
I already set the maximum cached connections to 1 and restarted Thunderbird; it didn't help. I still get a hang on copying to "Sent" files.
I can confirm that.
I set the number of cached connections to 1 for a few users (Thunderbird 1.5.0.4, both XP, and NetBSD 3), and they all report that the stalling of blind copies to outbox after an smtp transfer happens less frequently, but it still happens.
hauke-- /~\ The ASCII Ribbon Campaign Hauke Fath \ / No HTML/RTF in email Institut für Nachrichtentechnik X No Word docs in email TU Darmstadt / \ Respect for open standards Ruf +49-6151-16-3281
I posted about this previously, but for whatever reason there hasn't been much of a response.
I upgraded from beta8 to rc2, and dovecot IMAP went from being fast and responsive to being painfully slow and often hanging Thunderbird. (I made no configuration changes to my dovecot configuration file which is here: http:/x15.us/dovecot.conf)
The main issue seems to be about deleting messages (or moving them). Delete operations often, but not always, hang for many seconds or minutes.
Dovecot is running on a FreeBSD 6.1-RELEASE-p2 box where it has been stable for a couple months. Beta8 worked great! When I upgraded to rc2 from ports I made no configuration changes of any kind. rc2 is a pain to use here because of the constant hangs and delays.
Clients are Thunderbird 1.5.0.4 and 1.5.0.5 on FreeBSD 6.1, Ubuntu 6.06, and Windows XP SP2. All clients see the same problems, but they are most frequent on FreeBSD, even though that Thunderbird installation is identical (via rsync) to the one on Ubuntu. Changing Tbird's number of cached connections has no effect on the problems.
I did a little experimentation and found a sure work around: I stop the dovecot server, run 'rm ~/Maildir/dov*' on my server home directory, and restart dovecot. The problems are immediately gone, for a while, then they gradually return. This seems to indicate there is some kind of index problem or corruption on the server side, but I'm not certain.
A few other posters on this list reported similar problems, but I haven't seen any progress or resolution. Are others still having trouble? Does anyone know what was changed between dovecot versions that might have this affect? Any ideas for making it work well again?
Pete
Am 30.07.2006 um 18:48 Uhr -0700 schrieb Pete Slagle:
I posted about this previously, but for whatever reason there hasn't been much of a response.
I upgraded from beta8 to rc2, and dovecot IMAP went from being fast and responsive to being painfully slow and often hanging Thunderbird. (I made no configuration changes to my dovecot configuration file which is here: http:/x15.us/dovecot.conf)
[...]
Thanks for your comments.
As I am preparing for holiday, I have just downgraded the local installation to 1.0beta8. Let's see if that brings any help to the "stalled Sent-folder transfer" issue.
hauke-- /~\ The ASCII Ribbon Campaign Hauke Fath \ / No HTML/RTF in email Institut für Nachrichtentechnik X No Word docs in email TU Darmstadt / \ Respect for open standards Ruf +49-6151-16-3281
On 2006-07-31 12:01:33 +0200, Hauke Fath wrote:
Thanks for your comments.
As I am preparing for holiday, I have just downgraded the local installation to 1.0beta8. Let's see if that brings any help to the "stalled Sent-folder transfer" issue.
didnt some other mail on the ml say that the sent-folder problem is fixed in thunderbird 1.5.0.5?
darix
Marcus Rueckert wrote:
On 2006-07-31 12:01:33 +0200, Hauke Fath wrote:
Thanks for your comments.
As I am preparing for holiday, I have just downgraded the local installation to 1.0beta8. Let's see if that brings any help to the "stalled Sent-folder transfer" issue.
didnt some other mail on the ml say that the sent-folder problem is fixed in thunderbird 1.5.0.5?
I have not seen any change in behavior in this regard between Thunderbird 1.5.0.4 and 1.5.0.5.
On Sun, 2006-07-30 at 18:48 -0700, Pete Slagle wrote:
I posted about this previously, but for whatever reason there hasn't been much of a response.
I upgraded from beta8 to rc2, and dovecot IMAP went from being fast and responsive to being painfully slow and often hanging Thunderbird. (I made no configuration changes to my dovecot configuration file which is here: http:/x15.us/dovecot.conf)
The main issue seems to be about deleting messages (or moving them). Delete operations often, but not always, hang for many seconds or minutes.
Could you start tracing the imap process when it happens, stop it when it's over and show me the results? Also is the process at the time eating all the CPU? Is the memory usage growing?
See http://wiki.dovecot.org/Debugging/ProcessTracing
I did a little experimentation and found a sure work around: I stop the dovecot server, run 'rm ~/Maildir/dov*' on my server home directory, and restart dovecot. The problems are immediately gone, for a while, then they gradually return. This seems to indicate there is some kind of index problem or corruption on the server side, but I'm not certain.
Well, that removed both the index files and dovecot-uidlist file. If you only remove dovecot.index* does it fix it? What if you remove only dovecot.index.cache?
How large are those dovecot* files when it's running slow?
Timo Sirainen wrote:
On Sun, 2006-07-30 at 18:48 -0700, Pete Slagle wrote:
I posted about this previously, but for whatever reason there hasn't been much of a response.
I upgraded from beta8 to rc2, and dovecot IMAP went from being fast and responsive to being painfully slow and often hanging Thunderbird. (I made no configuration changes to my dovecot configuration file which is here: http:/x15.us/dovecot.conf)
The main issue seems to be about deleting messages (or moving them). Delete operations often, but not always, hang for many seconds or minutes.
Could you start tracing the imap process when it happens, stop it when it's over and show me the results? Also is the process at the time eating all the CPU? Is the memory usage growing?
See http://wiki.dovecot.org/Debugging/ProcessTracing
I did a little experimentation and found a sure work around: I stop the dovecot server, run 'rm ~/Maildir/dov*' on my server home directory, and restart dovecot. The problems are immediately gone, for a while, then they gradually return. This seems to indicate there is some kind of index problem or corruption on the server side, but I'm not certain.
Well, that removed both the index files and dovecot-uidlist file. If you only remove dovecot.index* does it fix it? What if you remove only dovecot.index.cache?
How large are those dovecot* files when it's running slow?
I'll do some testing as suggested over the next few days and report back. Here are the answers to your questions that I can tell you now:
During hangs the there is no significant CPU utilization (less than 1%) by dovecot processes on the server. On the client, usually Thunderbird uses no CPU, but sometimes it uses all available.
I recently cleared the dovecot files in my top Maildir directory, so I don't know how indicative the files sizes are. The whole Maildir directory tree contains about 70,000 messages in about 1000 nested subfolders. The dovecot files in the top directory are:
65 Jul 31 09:34 Maildir/dovecot-keywords1622 Jul 31 15:13 Maildir/dovecot-uidlist 896 Jul 31 15:13 Maildir/dovecot.index 58368 Jul 31 15:08 Maildir/dovecot.index.cache 15752 Jul 31 15:13 Maildir/dovecot.index.log
Just now I got the first error message (ever!) during a hang. A Thunderbird message box reported a server error. The server log, full of connect and disconnect messages, showed only these two errors, in this order, at the end:
dovecot: 2006-07-31 15:07:38 PDT Error: IMAP(pete): Fixed index file /home/pete/Maildir/.In - lists.dovecot/dovecot.index: first_recent_uid_lowwater 1516 -> 1515 dovecot: 2006-07-31 15:07:38 PDT Error: IMAP(pete): Corrupted index file /home/pete/Maildir/.In - lists.dovecot/dovecot.index: Duplicate header extension keywords
The sizes of the files in the directory that had the error are as so:
17 May 25 09:04 dovecot-keywords
202 Jul 31 12:44 dovecot-uidlist
1200 Jul 31 15:07 dovecot.index53248 Jul 31 12:23 dovecot.index.cache 12972 Jul 31 15:07 dovecot.index.log 131088 Jul 22 13:36 dovecot.index.log.2
Pete
participants (9)
-
Dumitru Negara
-
Hauke Fath
-
Jack Bailey
-
Jeff A. Earickson
-
Marcus Rueckert
-
Pete Slagle
-
richs＠whidbey.net
-
Rob Middleton
-
Timo Sirainen