- dovecot - dovecot.org

[Dovecot] Degeneration of CPU Performance
by Thiago Monaco Papageorgiou 11 May '09

11 May '09

Hello everybody! We have a interesting issue about dovecot behavior here. First, the scenario: We have 2 server running with the same load, one with our old pop3 solution (out of date) and other with Dovecot. We realized that dovecot are comsuming more CPU, and this consumption is growing day by day. When we starts dovecot, it runs between 40%-45% of CPU consumption and our old solution runs on 30-35%. This is quite acceptable, so no problem here. The problem is one day after it jumps to 45%-55% of cpu comsunption while the old pop3 solution runs on the same CPU consumption of one day before (30%-35). I attached a graph with this information. In this graph the green line is dovecot CPU consumption and the blue line is the old solution. In this graph we restart dovecot at monday morning. This restart is noticed as a big fall of CPU consumption(green line) in the graph. After that, it stay between 40%-45%, one day after it runs on 45%-55% and next day, it reaches 50%-60%! You can notice that the blue line (old pop3 solution) runs with the same behavior, so we have the same load. We have other monitoring informations that confirm it. I looked for some bugs about this, but I didn't find anything. The question is: Is there any dovecot problem or wrong configuration that could cause this degeneration of CPU performance? Any sugestion about what can be the cause of this? I attached dovecot -n output. Two important information: we store the mailboxes in NFS and we are only using pop3 protocol. Thanks in advance! -- Thiago Monaco Papageorgiou <thiago.monaco(a)corp.terra.com.br> ________________________ Terra Networks Brasil S/A Tel: +55 (51) 3284-4274 # 1.1.6: /usr/local/dovecot/etc/dovecot.conf # OS: Linux 2.6.9-78.0.1.ELsmp i686 CentOS release 4.7 (Final) syslog_facility: local2 protocols: pop3 listen: *:1110 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_user: nobody login_log_format_elements: user=<%u> idperm=<%i> command=%t method=%m rip=%r lip=%l %c login_process_per_connection: no login_process_size: 32 login_processes_count: 100 login_max_processes_count: 500 login_max_connections: 100 mail_uid: popmgr mail_gid: popmgr mail_cache_min_mail_count: 100 mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: hashdir mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 mail_log_prefix: %Us: user %u (%e): pop3_uidl_format: %f pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain trrproxy_v1 worker_max_count: 64 passdb: driver: trrpam args: extra_fields=short_name,quota_caixa,mail_folders_limit,id_perm,mail_imap %s_dovecot userdb: driver: prefetch plugin: quota: trrquota uidlist_create_form: 1

6 8

[Dovecot] Unit testing
by Timo Sirainen 10 May '09

10 May '09

Unit testing is slowly going forward in Dovecot. In v2.0 tree all the unit tests are now run when you do "make check". They're also run on "make distcheck", which is what I use when building releases or nightly snapshots. So as soon as I start building nightly v2.0 snapshots I should start getting mails every night if the unit tests fail. And I can no longer make a release if a unit test fails. (Unit tests never get run manually - I once fixed a unit test that had been failing for months.) Besides that, I started trying to add unit tests to lib-index. After some hours of refactoring the code I finally managed to get mail-transaction-log-view and mail-index-transaction to a condition where unit tests could be added to them without too much pain. I didn't really add that many unit tests there yet though. I'll probably slowly continue adding more tests and refactoring the code more to allow more unit tests, but if anyone else finds they have nothing better to do, now's a good time to add more tests :) Especially lib/, lib-mail/ and lib-imap/ should already be easily testable and they're missing a lot of tests.

1 0

[Dovecot] dovecot slowing down
by P.A 08 May '09

08 May '09

Hi, not really a dovecot issue but, im running dovecot 1.0.10 with no issues for awhile now J. However I ran into an issue today where postfix didn't have enough processes to handle incoming smtp connections. This for whatever reason was causing pop/imap (dovecot) to take a long time to respond on the appropriate port. After looking at server and finding nothing wrong I stopped postfix which got rid of the delay on port 110/143. I then turned on postfix again and saw the delay for port 25/110/143. What I then did was adjust/increase the default_process_limit in postfix which took care of the problem. Question is why would not enough processes in postfix slow other services down like dovecot 110/143? There was plenty of bandwith/mem/cpu left.

1 0

[Dovecot] Problem with IMAP (rename and delete non existent folder).
by Lenthir 08 May '09

08 May '09

I don't know if this problem exists only in my version of dovecot, or in all... To reproduce BUG do this (use gdb): telnet localhost 143 o login addr(a)email.sth verystrong_pass o delete "kj-test-folder" o rename "kj-test-folder" o rename "kj-test-folder" "other-folder" SIGABRT Of course kj-test-folder is not exist. BT: #31 0xb7da0022 in free () from /lib/tls/libc.so.6 #32 0x0813313a in pool_system_free (pool=0x8169060, mem=0x8146161) at mempool-system.c:92 #33 0x080de02f in mailbox_list_clear_error (list=0x81885e8) at mailbox-list.c:762 #34 0x080dd5ae in mailbox_list_get_mailbox_name_status (list=0x81885e8, name=0x81a4258 "other-folder", status=0xbfe9cae0) at mailbox-list.c:394 My version of Dovecot is 1.2beta1. Do you know anything about this bug? Please help. -- Konrad

2 5

[Dovecot] Problem with IMAP (rename and delete non existent folder).
by Lenthir 08 May '09

08 May '09

I don't know if this problem exists only in my version of dovecot, or in all... To reproduce BUG do this (use gdb): telnet localhost 143 o login addr(a)email.sth verystrong_pass o delete "kj-test-folder" o rename "kj-test-folder" o rename "kj-test-folder" "other-folder" SIGABRT Of course kj-test-folder is not exist. BT: #31 0xb7da0022 in free () from /lib/tls/libc.so.6 #32 0x0813313a in pool_system_free (pool=0x8169060, mem=0x8146161) at mempool-system.c:92 #33 0x080de02f in mailbox_list_clear_error (list=0x81885e8) at mailbox-list.c:762 #34 0x080dd5ae in mailbox_list_get_mailbox_name_status (list=0x81885e8, name=0x81a4258 "other-folder", status=0xbfe9cae0) at mailbox-list.c:394 My version of Dovecot is 1.2beta1. Do you know anything about this bug? Please help. -- Konrad

3 6

[Dovecot] mailutil?
by Timo Sirainen 08 May '09

08 May '09

dbox format needs at least two tools: 1. Expunging only marks the message having refcount=0. The actual disk space is freed only after calling a tool pointing to the user's dbox dir. 2. Ability to force index resync/rebuild in case it doesn't figure out itself that there's something wrong. I'm starting to think about building a more generic mailutil tool, maybe something similar to what UW-IMAP has. So two questions: - What should the tool be called? Probably not mailutil to avoid confusion. doveutil? dovemail? dovetool? mailtool? - Is there any functionality you'd like it to do?

10 15

[Dovecot] Imap notifications in IDLE
by Jarosław Przybyłowicz 07 May '09

07 May '09

Hi, could you please tell me if there is a way, to make dovecot notify my mail client of new messages in inbox subfolders? I'm using fdm to fetch mails into maildir and proper subfolders. So far, when idleing mozilla gets a notification when new message arrives in INBOX, but if mail is fetched into other folder I have to click on it to see if there is a new message. I've checked thunderbird imap log to check if this is dovecot or TB issue. Is there any way to force dovecot to monitor other folders? Regards, V

5 6

Re: [Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

Hi Daniel, What version of dovecot supports this feature ? I am using dovecot-0.99.11-8.EL4 and gives error : - Starting Dovecot Imap: Fatal: Error in configuration file /etc/dovecot.conf line 495: Unknown setting: master_user_separator Here is what i added : auth_master_user_separator = * auth default { passdb passwd-file { args = /root/passwd.masterusers master = yes } passdb shadow { } userdb passwd { } } Regards, Punit

3 2

[Dovecot] Exim And Dovecot SASL
by Andrew Holway 07 May '09

07 May '09

Hi all, I have been trying to get this to work a couple of ways, please take a look at the links below.http://wiki.dovecot.org/HowTo/EximAndDovecotSASLhttp://rafb.net/p/ipH… rejects every time but if I uncomment;auth_executable = /usr/lib/dovecot/dovecot-auth then thunderbird will ask me for a password but does not agree with me on it.I have dovecot set up to use the unix usernames and passwordsThanks,Andrew  

2 2

[Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

HI All, Is there a way to do admin authentication for a normal user in dovecot IMAP ? I have a user using PAM to store password in /etc/shadow file. I need to authenticate the user in IMAP using that password. I tried using : - I tried all combinations as below [root@mail ~]# cat /etc/shadow| grep -i ajay ajay.lal:CM730q8foSA9A:13545:0:99999:7::: [root@mail ~]# telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK dovecot ready. a1 login ajay.lal CM730q8foSA9A a1 NO Authentication failed. a1 login ajay.lal "{crypt}CM730q8foSA9A" a1 NO Authentication failed. Also i tried [root@mail ~]# perl -MMIME::Base64 -e 'print encode_base64("\0ajay.lal\0{crypt}CM730q8foSA9A");' AGFqYXkubGFsAHtjcnlwdH1DTTczMHE4Zm9TQTlB [root@mail ~]# telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK dovecot ready. a1 AUTHENTICATE PLAIN + AGFqYXkubGFsAHtjcnlwdH1DTTczMHE4Zm9TQTlB a1 NO Authentication failed. My dovecot server does PLAIN authentication as can auth_mechanisms = plain Is there a way to do PLAIN auth with crypt password or any means of doing admin authentication on behalf of normal user ? Regards, Punit

2 1