- dovecot - dovecot.org

[Dovecot] imap processes eating IO
by Ryan Rawdon 02 Nov '08

02 Nov '08

[Ignore the previous e-mail, I somehow sent it when I was trying to paste from clipboard] I recently migrated my dovecot/postfix setup to a new machine. After doing so, I have encountered a problem where imap processes get stuck in a loop eating loads of IO on the machine. Looking at the trace (snippet below), it looks like they are sitting and reading the inbox and other folders of certain users repeatedly. This seems to be triggered by the delivery of a new e-mail to the user's mailbox while they have an IMAP client connected, though I cannot say for sure. This had never happened before on the old machine. I'm certain more information would be useful, please let me know what I can provide to help! Trace of process 22342 - imap lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203440140.P6242Q0M41485.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=3079, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203446630.P7458Q0M562949.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=27769, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203454830.P9042Q0M402016.scarecrow:2,RSe", {st_mode=S_IFREG|0600, st_size=730534, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203460967.P10096Q0M631472.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=2690, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203463833.P10601Q0M946162.scarecrow:2,Sbc", {st_mode=S_IFREG|0600, st_size=2319, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203468449.P11425Q0M422185.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2650, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203469387.P11575Q0M276926.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1317, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203472851.P12516Q0M604824.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2491, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203474105.P12705Q0M450957.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=1489, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203474330.P12758Q0M302789.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=1483, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203474352.P12765Q0M853382.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=1520, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203475497.P12947Q0M759098.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=1554, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203476420.P13131Q0M140164.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1011, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203477055.P13350Q0M324248.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=1511, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203485834.P14664Q0M678604.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=2153, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203555290.P27989Q0M937789.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=2017, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203566780.P29789Q0M486178.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1570, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1216416810.P17960Q0M786183.tinman:2,S", {st_mode=S_IFREG|0600, st_size=1447, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203567387.P29984Q0M463701.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1560, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203568156.P30125Q0M174453.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1570, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203568755.P30222Q0M271021.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1555, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203578404.P31535Q0M370292.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1125, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203581122.P31861Q0M954508.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2108, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203596470.P3307Q0M326986.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=2738, ...}) = 0 getdents64(12, /* 64 entries */, 4096) = 4096 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203615744.P6582Q0M282341.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2027, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203619209.P7288Q0M583007.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=8739, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203629165.P9049Q0M921642.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=3049, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203638438.P10774Q0M313047.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=8889, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203639137.P10877Q0M554068.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=9549, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203679395.P16427Q0M89616.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1364, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203689732.P20116Q0M93680.scarecrow:2,Sbc", {st_mode=S_IFREG|0600, st_size=2440, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203690022.P20155Q0M909689.scarecrow:2,Sbc", {st_mode=S_IFREG|0600, st_size=2303, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203693712.P20948Q0M30023.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=3991, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203693933.P20990Q0M934746.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2371, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203695416.P21386Q0M135204.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=6992, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203698879.P21995Q0M135839.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1691, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203700228.P22234Q0M28365.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1013, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203703239.P23143Q0M571200.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2122, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203704119.P23375Q0M653158.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2256, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203713490.P25274Q0M840767.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=19577, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203736413.P29935Q0M732560.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=3143, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203802545.P10420Q0M281614.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2620, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203803404.P10616Q0M912757.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=2622, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203804020.P10721Q0M538580.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=3003, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203805331.P10980Q0M701431.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=2361, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203809386.P25318Q0M128371.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=4004, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203809725.P27021Q0M447783.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=3679, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203813058.P6051Q0M690481.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=816, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203874686.P31025Q0M52827.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=2933, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203892798.P6675Q0M22252.scarecrow:2,RSc", {st_mode=S_IFREG|0600, st_size=2357, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203892996.P6750Q0M114883.scarecrow:2,Sc", {st_mode=S_IFREG|0600, st_size=1561, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203896197.P7621Q0M934348.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=616, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203896810.P8108Q0M440868.scarecrow:2,RS", {st_mode=S_IFREG|0600, st_size=3620, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203900525.P10657Q0M868027.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=6304, ...}) = 0 lstat64("/home/vmail/u13.net/ryan/Maildir/cur/1203902148.P10984Q0M386235.scarecrow:2,S", {st_mode=S_IFREG|0600, st_size=3086, ...}) = 0

3 6

[Dovecot] antispam plugin problem
by Eugene 01 Nov '08

01 Nov '08

Hi people! (Especially Johannes, probably =) I recently switched to DSPAM + antispam plugin combination. Mostly I am happy but there is a problem with calling dspam-exec in order to relearn the messages. Moving messages to spam folder does not work, giving the error message 'Failed to call dspam' to client. I tried to add some debug output and here are the results: This is the output of debug("calling dspam: %s %s %s %s %s %s %s", argv[0], argv[1], argv[2], argv[3], argv[4], argv[5], argv[6]); (debugv(argv) does not produce any output for some reason) Oct 26 02:37:12 qqqqq imap: antispam: calling dspam: /usr/contrib/bin/dspam --source=error --class=spam --signature=490387db858421194018847 --user genie (null) This is the captured output of forked process Oct 26 02:37:12 qsar imap: antispam: dspam returned: ^APdata stack: Out of memory when allocating 1073741840 bytes If I understand correctly, this message is produced by dovecot before it should have launched dspam executable. I don't know why it needs 1GB of stack space for that. Changing dspam to dspamc does not help. Interestingly enough, launching 'sendmail' in mailtrain mode works ok. Do you have any ideas about what is wrong? Best wishes Eugene

2 2

Re: [Dovecot] dovecot behind loadbalancers
by Robert Schetterer 01 Nov '08

01 Nov '08

Brandon Lamb schrieb: > On Fri, Oct 31, 2008 at 5:37 AM, Robert Schetterer > <robert(a)schetterer.org> wrote: >> Hi @ll, >> has anbody experience with >> dovecot behind load balancers >> im planning to test >> ha-proxy >> pen >> balance(ng) on ubuntu hardy in a HA-Cluster >> in front of dovecot servers >> >> -- >> Best Regards >> >> MfG Robert Schetterer >> >> Germany/Munich/Bavaria > > We use Linux Virtual Server as a frontend to almost all of our ISP > services (dns, smtp, pop3, imap, http). This gives you a single point > of failure so you should probably make sure you have two directors > (one as a backup). Hi Brandon HA means 2 Load Balancer with failover so no single point of failure -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 0

[Dovecot] imap dump-capability fails Dovecot 1.1.6
by Thorsten Vollmer 31 Oct '08

31 Oct '08

Hi Timo, Dovecot fails to start after upgrading from 1.1.4 to 1.1.6: Fatal: userdb didn't return a home directory, but mail location used it (%h): %h/mail:CONTROL=%h/control:INDEX=%h/index Error: imap dump-capability process returned 89 Fatal: Invalid configuration in /etc/dovecot/dovecot.conf Adding a fake home directory to args in master-settings.c:get_imap_capability solved the problem for me, but there may be a more correct fix. Regards, Thorsten # 1.1.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.9-023stab048.4-enterprise i686 Gentoo Base System version 1.6.14 protocols: imaps ssl_ca_file: /etc/dovecot/ca.crt ssl_cert_file: /etc/dovecot/server.crt ssl_key_file: /etc/dovecot/server.key ssl_parameters_regenerate: 48 login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_process_size: 32 login_processes_count: 4 login_max_processes_count: 32 max_mail_processes: 32 mail_location: maildir:%h/mail:CONTROL=%h/control:INDEX=%h/index mail_process_size: 128 mail_plugins: expire antispam auth default: mechanisms: plain login user: nobody worker_max_count: 8 process_size: 128 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: static args: uid=vmail gid=vmail home=/var/userdata/%Lu socket: type: listen client: path: /var/run/dovecot/auth-client mode: 384 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: expire: SPAM 30 expire_dict: proxy:/var/run/dovecot/dict-server:expire auth_socket_path: /var/run/dovecot/auth-master antispam_dspam_binary: /usr/bin/dspam antispam_dspam_args: --user;%Lu antispam_signature: X-DSPAM-Signature antispam_spam: SPAM dict: expire: mysql:/etc/dovecot/dovecot-dict.conf

4 4

[Dovecot] Dovecot+PostfixAdmin+PostgreSQL on FreeBSD 7
by Erdenebat Gantumur 31 Oct '08

31 Oct '08

Hi dear All, Currently I'm configuring Dovecot+PostfixAdmin+PostgreSQL on FreeBSD 7 Stable and using Dovecot v1.1.3. I hope I've configured everything. But when I run /usr/local/etc/rc.d/dovecot start then dovecot doesn't seems to running. /var/log/maillog is only showing following. Oct 22 13:37:10 mail dovecot: Dovecot v1.1.3 starting up Oct 22 13:37:10 mail dovecot: auth(default): pgsql: Connected to postfix Oct 22 13:37:10 mail dovecot: auth-worker(default): pgsql: Connected to postfix Here is my current dovecot configuration. Please someone help me. What did I do wrong and what is the problem is? Thank you. mail# dovecot -n # 1.1.3: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot_info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 listen(default): x.x.x.x:143 listen(imap): x.x.x.x:143 listen(pop3): x.x.x.x:110 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 1983 first_valid_gid: 1983 mail_privileged_group: vmail mail_location: maildir:/var/vmail/%d/%n maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login username_format: %Lu passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384

4 6

[Dovecot] dovecot expire doesn't work (?)
by LÉVAI Dániel 31 Oct '08

31 Oct '08

Hi! I'm using dovecot-1.1.5 and trying to make the expire plugin work. What I've configured in dovecot.conf is the following: protocol imap,pop3,lda { mail_plugins = [...] expire } dict { expire = db:/var/dovecot/expire/expire.db } plugin { expire = spamassassin/SPAM 2 spamassassin/HAM 2 expire_dict = proxy::expire } I have a sieve rule, to copy certain messages to my "spamassassin/SPAM" folder. Then I want to expire those messages after 2 days (I think I've configured that under the plugin{} section in dovecot.conf). So the actual message saving is done by the dovecot's deliver, but I have the plugin loaded under the "protocol lda {}" section too. So I thought now I just have to wait 2 days, and run the expire-tool, and then it will expire the messages. Now I have three messages dated back to 10.25, but running the expire-tool outputs nothing. # dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Nothing in the logfiles, and nothing on the console. I have the /var/dovecot/expire directory: # ls -la /var/dovecot/expire/ total 1640 drwx------ 2 root wheel 512 Oct 26 19:47:53 2008 ./ drwxr-x--- 3 root wheel 512 Oct 27 07:57:42 2008 ../ -rw------- 1 root wheel 24576 Oct 27 13:00:01 2008 __db.001 -rw------- 1 root wheel 57344 Oct 27 13:00:01 2008 __db.002 -rw------- 1 root wheel 270336 Oct 27 13:00:01 2008 __db.003 -rw------- 1 root wheel 98304 Oct 27 13:00:01 2008 __db.004 -rw------- 1 root wheel 49152 Oct 27 13:00:01 2008 __db.005 -rw------- 1 root wheel 32768 Oct 26 19:47:37 2008 expire.db -rw------- 1 root wheel 10485760 Oct 27 14:22:08 2008 log.0000000001 It contains the familiar BDB files, so I think it works, although the expire.db's modify time is yesterday, but deliver saved some messages also today to the spamassassin/SPAM folder. What could be the problem? Am I missing something? Thanks! Daniel -- LEVAI Daniel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

3 11

[Dovecot] Problem with Dovecot 1.1.4 and dovecot-antispam 20080829
by Guillaume Hilt 31 Oct '08

31 Oct '08

Hi there, I'm running a server under Gentoo 64 with postfix 2.5.5, Dovecot 1.1.4-r1 and Dovecot-antispam 20080829 (all are the lastest versions availables under Portage). I ran into a problem when I log in to my mailbox : Oct 30 10:39:23 ks29138 dovecot: IMAP(hiltg): Loading modules from directory: /usr/lib64/dovecot/imap Oct 30 10:39:23 ks29138 dovecot: IMAP(hiltg): Module is for different version 1.1.1: /usr/lib64/dovecot/imap/lib90_antispam_plugin.so Oct 30 10:39:23 ks29138 dovecot: Fatal: IMAP(hiltg): Couldn't load required plugins Is there another version for Dovecot 1.1.4 out there or must I go back to 1.1.1 ? Thanks, Guillaume

3 3

[Dovecot] dovecot behind loadbalancers
by Robert Schetterer 31 Oct '08

31 Oct '08

Hi @ll, has anbody experience with dovecot behind load balancers im planning to test ha-proxy pen balance(ng) on ubuntu hardy in a HA-Cluster in front of dovecot servers -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 0

[Dovecot] Dovecot read only for users
by JC 31 Oct '08

31 Oct '08

All, I have hopefully a base question. How do you give users only read access to their inbox and folders? If I use chmod 600 they have full access. If I do a 400 they have read access but cannot access their inbox. The config file is the out of the box config other than advertising IMAP and IMAPS. Any help will be appreciated. Thanks.

10 20

[Dovecot] Startup info message
by Athan Dimoy 31 Oct '08

31 Oct '08

Hi folks, I'm using the latest Dovecot 1.16 with Postfix for my FreeBSD box. Since v1.1.4 (if i remember correctly), the following message is displayed whenever starting Dovecot. "Info: If you have trouble with authentication failures, enable auth_debug setting. See http://wiki.dovecot.org/WhyDoesItNotWork" Besides that, Dovecot works great but I wonder what this message is all about. I've searched wiki and mailing list but didn't find anything related. PS: I removed Dovecot removing all stalled files and directories and reinstalled it from scratch. Still the message is displayed whenever it starts. Any idea? Athan

4 6