[Dovecot] Feature request
Hello Timo, and all.
Preface: From time to time we have problems with thunderbird. The problem is that mail client begin to sync users inbox (or other folder) and this process didn't stop. Last time we have this situation - our monitoring system shows unusual amount of imap traffic send to one of local hosts. This host was - terminal server and 20 users worked with their mailboxes that time. But normal 20 imap session can't fork that amount of traffic (5.2Gb). After measuring local thunderbird's cached mailboxes we find out that one user have local INBOX about 19Gb and size is rising. On server side - this mailbox was 89Mb. And after killing thunderbird in logs appear: Dec 10 17:35:53 IMAP(user@domain 192.168.2.92): Info: Disconnected: Logged out bytes=1133593/1175103 Dec 10 17:35:53 IMAP(user@domain 192.168.2.92): Info: Disconnected: Logged out bytes=15964/44364 Dec 10 17:35:53 IMAP(user@domain 192.168.2.92): Info: Disconnected: Logged out bytes=54758/944989 Dec 10 17:35:53 IMAP(user@domain 192.168.2.92): Info: Disconnected: Logged out bytes=6532/43930 Dec 10 17:35:53 IMAP(domain@domain 192.168.2.92): Info: Connection closed bytes=235408/4797272694
As you can see - 4.8Gb of data was send to this client - and who knows - what was that. So we have 5.2Gb send to host with 20 active sessions and 4.8Gb send to one user. Of course lifetime of this connection can be much more than last day, but problem disappeared after killing it.
This is not single accident. But this one was hard to find out because of 20-25 users working at the same time from 1 server.
So it will be great if dovecot has feature to limit the amount of data send per connection. For example:
service imap { bytes_per_connection = 100Mb }
And after limit reached - close connection and log warning. This will much simplify fights with sometimes become crazy imap clients.
That do you think?
On 2010-12-11 3:00 AM, Nikita Koshikov wrote:
Hello Timo, and all.
Preface: From time to time we have problems with thunderbird. The problem is that mail client begin to sync users inbox (or other folder) and this process didn't stop. Last time we have this situation - our monitoring system shows unusual amount of imap traffic send to one of local hosts. This host was - terminal server and 20 users worked with their mailboxes that time. But normal 20 imap session can't fork that amount of traffic (5.2Gb). After measuring local thunderbird's cached mailboxes we find out that one user have local INBOX about 19Gb and size is rising. On server side - this mailbox was 89Mb. And after killing thunderbird in logs appear:
Did you already try deleting the local copy of the Inbox?
Also...
Dovecot version/doveconf -n output?
--
Best regards,
Charles
On Sat, 11 Dec 2010 10:23:43 -0500 Charles Marcus wrote:
On 2010-12-11 3:00 AM, Nikita Koshikov wrote:
Hello Timo, and all.
Preface: From time to time we have problems with thunderbird. The problem is that mail client begin to sync users inbox (or other folder) and this process didn't stop. Last time we have this situation - our monitoring system shows unusual amount of imap traffic send to one of local hosts. This host was - terminal server and 20 users worked with their mailboxes that time. But normal 20 imap session can't fork that amount of traffic (5.2Gb). After measuring local thunderbird's cached mailboxes we find out that one user have local INBOX about 19Gb and size is rising. On server side - this mailbox was 89Mb. And after killing thunderbird in logs appear:
Did you already try deleting the local copy of the Inbox?
Also...
Dovecot version/doveconf -n output?
The problem has solved. User account was recreated - that helped. Also, we have this problem with various dovecot(starting from 1.2x branch) and various thunderbird releases. I don't think this is dovecot issue. Dovecot works very well.
dovecot -n:
# 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r4 i686 Gentoo Base System release 1.12.14 log_path: /var/log/dovecot/dovecot-error.log info_log_path: /var/log/dovecot/dovecot.log protocols: imaps pop3s managesieve ssl_cert_file: /etc/ssl/dovecot/imaps.crt ssl_key_file: /etc/ssl/dovecot/imaps.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_greeting: Server ready. login_processes_count(default): 50 login_processes_count(imap): 50 login_processes_count(pop3): 5 login_processes_count(managesieve): 5 login_max_processes_count: 2048 max_mail_processes: 2048 mail_max_userip_connections(default): 25 mail_max_userip_connections(imap): 25 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_uid: 8 mail_gid: 12 mail_drop_priv_before_exec: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota trash expire zlib autocreate virtual antispam mail_plugins(imap): quota imap_quota trash expire zlib autocreate virtual antispam mail_plugins(pop3): quota virtual mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/managesieve mail_log_prefix: %Us(%u %r): imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): namespace: type: private separator: / location: maildir:~/data inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: Company/ location: virtual:/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ hidden: yes list: yes lda: postmaster_address: postmaster@agromat.ua hostname: mail.agromat.ua mail_plugins: quota trash expire sieve virtual quota_full_tempfail: yes sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/dovecot/dovecot-deliver.log info_log_path: /var/log/dovecot/dovecot-deliver.log auth default: mechanisms: plain login default_realm: agromat.ua cache_size: 5120 cache_ttl: 900 cache_negative_ttl: 0 user: dovecot_auth username_format: %Lu master_user_separator: * worker_max_count: 50 passdb: driver: passwd-file args: /etc/dovecot/passdb/master.pwd master: yes passdb: driver: passwd-file args: /etc/dovecot/passdb/users.pwd passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: passwd-file args: /etc/dovecot/passdb/users.pwd userdb: driver: ldap args: /etc/dovecot/dovecot-userdb-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: mail group: dovecot_auth master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota_warning: storage=90%% /etc/dovecot/plugins/quota_warning.sh 90 quota: maildir:Mailbox quota quota_rule: *:storage=750M quota_rule2: Trash:storage=10%% trash: /etc/dovecot/plugins/dovecot-trash.conf expire: Trash 30 Spam 30 expire_dict: proxy::expire autocreate: Drafts autocreate2: Sent autocreate3: Spam autocreate4: Trash autosubscribe: Drafts autosubscribe2: Sent autosubscribe3: Spam autosubscribe4: Trash sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_after: /etc/dovecot/sieve/default-after.sieve sieve_extensions: +notify +spamtest sieve_spamtest_status_type: score sieve_spamtest_status_header: X-Spam-Scan-Score sieve_spamtest_max_value: 10 antispam_trash: Trash antispam_spam: Spam antispam_allow_append_to_spam: no antispam_mail_sendmail: /etc/dovecot/plugins/spam.sh antispam_mail_sendmail_args: -u mail antispam_mail_spam: --spam antispam_mail_notspam: --ham antispam_mail_tmpdir: /tmp dict: expire: sqlite:/etc/dovecot/plugins/expire.conf
On 2010-12-13 2:45 AM, Nikita Koshikov wrote:
On Sat, 11 Dec 2010 10:23:43 -0500, Charles Marcus wrote:
Did you already try deleting the local copy of the Inbox?
The problem has solved. User account was recreated - that helped. Also, we have this problem with various dovecot (starting from 1.2x branch) and various thunderbird releases. I don't think this is dovecot issue. Dovecot works very well.
When you say you recreated the user account - you mean in Thunderbird?
And you never said whether or not you actually did try just deleting the local cached copy of the Inbox?
Also - what version of Thunderbird is this?
--
Best regards,
Charles
Charles Marcus wrote:
Also - what version of Thunderbird is this?
I'm going to guess that it's Thunderbird 3.x. It has an issue where sometimes it (somehow) decides that it needs to keep downloading all the messages over and over again until it fills the user's hard drive.
I had it happen to a few of my users, but we were never really able to nail down what would make it start running away like that.
On 2010-12-13 6:24 AM, Willie Gillespie wrote:
I'm going to guess that it's Thunderbird 3.x. It has an issue where sometimes it (somehow) decides that it needs to keep downloading all the messages over and over again until it fills the user's hard drive.
Bug Number please? Never had that particular problem, and never heard of this bug, been using Thunderbird since about version 0.8 with anywhere from 25-75 users over that time...
--
Best regards,
Charles
On 12/13/2010 04:36 AM, Charles Marcus wrote:
On 2010-12-13 6:24 AM, Willie Gillespie wrote:
I'm going to guess that it's Thunderbird 3.x. It has an issue where sometimes it (somehow) decides that it needs to keep downloading all the messages over and over again until it fills the user's hard drive.
Bug Number please? Never had that particular problem, and never heard of this bug, been using Thunderbird since about version 0.8 with anywhere from 25-75 users over that time...
Not entirely sure. A Google search just shows a lot of people complaining about it. Any bugs I find shows that it should be fixed in 3.1 though.
Perhaps these: https://bugzilla.mozilla.org/show_bug.cgi?id=537498 https://bugzilla.mozilla.org/show_bug.cgi?id=517466 https://bugzilla.mozilla.org/show_bug.cgi?id=532323 https://bugzilla.mozilla.org/show_bug.cgi?id=534297
On Mon, 13 Dec 2010 06:16:56 -0500 Charles Marcus wrote:
On 2010-12-13 2:45 AM, Nikita Koshikov wrote:
On Sat, 11 Dec 2010 10:23:43 -0500, Charles Marcus wrote:
Did you already try deleting the local copy of the Inbox?
The problem has solved. User account was recreated - that helped. Also, we have this problem with various dovecot (starting from 1.2x branch) and various thunderbird releases. I don't think this is dovecot issue. Dovecot works very well.
When you say you recreated the user account - you mean in Thunderbird?
Yes, account was recreated on client side(in thunderbird).
And you never said whether or not you actually did try just deleting the local cached copy of the Inbox?
This also helped with other acoounts, I mean deleting stuck syncing mailfolder. And after restarting thunderbird - problem disappeared.
Also - what version of Thunderbird is this?
This time it was thunderbird 3.0.2 . Few times this situation happened with thunderbird 3.1.x - latest version on that moment.
participants (3)
-
Charles Marcus
-
Nikita Koshikov
-
Willie Gillespie