- dovecot - dovecot.org

[Dovecot] 2.0, hourly performance stats
by Ralf Hildebrandt 08 Nov '10

08 Nov '10

I'm getting constantly high numbers of page reclaims & involuntary context switches for dovecot/auth. page reclaims = minor faults = cpu switching back to system-mode, But why is the auth process doing that so excessively? Same for the large number of involuntary context switches... Attached is my "dovecot -n" output. Date: Sun, 07 Nov 2010 20:40:34 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 205.93 1.32 2.76 25280 0 0 0 0 0 261 1425 ssl-params 288.71 0.40 0.48 468 0 0 8 0 0 8 1 pop3 0.59 0.80 0.20 651 0 0 48 16 0 12 13 managesieve 0.51 0.00 0.28 576 0 0 416 0 0 13 7 imap 4677.82 0.19 0.89 1480 0 0 488 16 0 23550 136 pop3-login 181.77 0.32 0.28 780 0 0 8 0 0 46 9 Date: Sun, 07 Nov 2010 21:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 303.62 1.10 2.20 26208 0 0 0 0 0 235 1362 ssl-params 301.12 0.00 0.12 467 0 0 8 0 0 7 1 pop3 0.26 0.40 0.36 618 0 0 0 8 0 5 18 managesieve 0.53 0.00 0.28 576 0 0 352 0 0 13 7 imap 2856.91 0.12 0.46 655 0 0 0 0 0 13465 105 pop3-login 228.84 0.76 0.24 779 0 0 0 0 0 90 14 Date: Sun, 07 Nov 2010 22:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 243.12 0.99 4.56 23762 0 0 0 0 0 222 1419 ssl-params 301.25 0.40 0.80 471 0 0 8 0 0 6 4 pop3 0.43 0.40 0.80 623 0 0 0 8 0 6 4 managesieve 0.43 0.00 0.20 577 0 0 536 0 0 14 7 imap 3.63 0.16 0.36 669 1 0 856 0 0 63 93 pop3-login 181.81 0.60 0.40 782 0 0 0 0 0 52 53 Date: Sun, 07 Nov 2010 23:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 232.83 1.72 2.26 25613 0 0 0 0 0 254 1175 ssl-params 149.63 0.00 0.16 469 0 0 40 0 0 10 1 pop3 25.68 0.28 0.12 741 0 0 9696 16 0 109 14 managesieve 0.25 0.40 0.28 576 0 0 8 0 0 11 2 imap 0.32 0.00 0.16 625 0 0 0 0 0 11 11 pop3-login 69.88 0.48 0.24 779 0 0 0 0 0 27 6 Date: Mon, 08 Nov 2010 00:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs managesieve 0.29 0.00 0.36 576 0 0 8 0 0 7 16 imap 0.58 0.80 0.36 637 0 0 0 0 0 10 9 Date: Mon, 08 Nov 2010 01:00:01 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 421.98 1.32 1.66 24216 0 0 0 0 0 267 723 ssl-params 538.47 0.00 0.16 470 0 0 8 0 0 7 1 pop3 0.19 0.80 0.96 671 1 0 760 8 0 22 221 managesieve 0.63 0.40 0.13 578 0 0 192 0 0 9 11 managesieve-lo 18616.9 86.77 32.49 319768 1 0 168 0 0 63448 48838 imap 42.28 0.00 0.52 676 0 0 0 0 0 182 63 pop3-login 361.68 0.76 0.40 780 0 0 0 0 0 52 2 Date: Mon, 08 Nov 2010 02:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 592.76 0.97 1.40 23640 8 0 8272 0 0 307 321 ssl-params 676.93 0.00 0.24 468 0 0 136 0 0 18 10 pop3 6.10 0.24 0.44 672 1 0 1688 8 0 35 40 managesieve 0.71 0.12 0.14 572 5 0 1632 0 0 17 38 managesieve-lo 1023.50 1.45 0.46 6066 1 0 184 0 0 1104 317 imap 0.87 0.80 0.44 674 1 0 640 0 0 18 25 pop3-login 361.79 0.72 0.32 780 0 0 112 0 0 56 11 Date: Mon, 08 Nov 2010 03:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 600.71 0.96 1.18 22902 0 0 56 0 0 235 212 ssl-params 242.66 0.00 0.16 471 0 0 136 0 0 15 6 pop3 0.20 0.16 0.28 675 1 0 1312 8 0 32 15 managesieve 0.46 0.00 0.36 580 1 0 480 0 0 11 12 managesieve-lo 286.21 0.60 0.44 1048 1 0 184 0 0 50 88 imap 0.34 0.80 0.28 675 0 0 0 0 0 9 20 pop3-login 361.43 0.84 0.32 780 0 0 112 0 0 55 13 Date: Mon, 08 Nov 2010 04:00:01 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 587.34 0.90 1.52 22075 14 0 14288 0 0 443 375 ssl-params 275.27 0.00 0.12 469 0 0 136 0 0 14 15 pop3 23.90 0.37 0.80 2906 5 0 36856 24 0 3885 136 managesieve 0.45 0.12 0.16 577 1 0 472 0 0 10 20 managesieve-lo 357.38 0.14 0.52 1271 1 0 184 0 0 100 28 imap 0.42 0.00 0.40 671 0 0 0 0 0 9 56 pop3-login 363.16 0.12 0.64 782 0 0 112 0 0 263 23 Date: Mon, 08 Nov 2010 05:00:01 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 1005.53 0.91 1.60 21583 0 0 0 0 0 238 92 ssl-params 172.31 0.40 0.80 469 0 0 0 0 0 6 3 pop3 0.11 0.16 0.28 667 0 0 0 8 0 11 18 managesieve 0.42 0.80 0.20 577 0 0 520 0 0 13 4 managesieve-lo 84.84 0.80 0.52 1049 0 0 0 0 0 45 11 imap 0.51 0.12 0.76 664 0 0 0 0 0 10 11 pop3-login 361.78 0.64 0.28 773 0 0 0 0 0 13 2 Date: Mon, 08 Nov 2010 06:00:01 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 467.35 0.16 0.17 797 0 0 0 0 0 8 9 ssl-params 273.33 0.00 0.16 470 0 0 0 0 0 5 3 pop3 0.14 0.12 0.36 667 0 0 0 8 0 14 1 managesieve 0.20 0.00 0.28 576 0 0 0 0 0 10 1 managesieve-lo 640.83 0.13 0.44 1272 0 0 0 0 0 87 17 imap 0.33 0.40 0.32 665 0 0 0 0 0 10 47 pop3-login 362.87 0.60 0.24 774 0 0 0 0 0 13 3 Date: Mon, 08 Nov 2010 07:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 468.95 0.96 1.34 21628 0 0 0 0 0 243 218 ssl-params 83.87 0.00 0.12 469 0 0 0 0 0 7 1 pop3 0.11 0.16 0.24 667 0 0 0 8 0 11 6 managesieve 0.83 0.00 0.88 577 0 0 536 0 0 9 12 managesieve-lo 231.47 0.18 0.96 1381 0 0 0 0 0 106 17 imap 0.71 0.12 0.80 665 0 0 0 0 0 10 47 pop3-login 292.13 0.56 0.28 779 0 0 0 0 0 46 7 Date: Mon, 08 Nov 2010 08:00:02 +0100 type real user sys reclaim faults swaps bin bout signals volcs involcs auth 452.63 0.83 1.44 20188 0 0 16 0 0 286 121 ssl-params 289.68 0.00 0.80 470 0 0 136 0 0 14 6 pop3 1.37 0.80 0.17 681 1 0 1936 16 0 55 28 managesieve 0.24 0.40 0.20 580 0 0 256 0 0 14 5 managesieve-lo 1952.41 4.93 1.58 18647 0 0 8 0 0 3673 1339 imap 0.17 0.40 0.19 665 0 0 0 0 0 6 48 pop3-login 96.75 0.60 0.28 777 0 0 112 0 0 41 14 -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

4 9

[Dovecot] Expunge -A cannot find users
by Kilburn Abrahams 08 Nov '10

08 Nov '10

Hi List, If I use doveadm expunge in this format expunge will delete the email doveadm expunge -u test(a)planetseafood.com mailbox Archive ON '8-Nov-2010' But in this format doveadm expunge -A mailbox Archive ON '8-Nov-2010', it will list all the users in the database and display the following and no messages are expunged. doveadm(test@planetseafood.com@planetseafood.com): Info: User no longer exists, skipping. The iterate_query = SELECT username AS username, domain FROM mailbox which is correct for the DB layout. I am not using the expire plugin. Is this a permissions issue? Thanks Kilburn

2 2

[Dovecot] Estimación de horas del cambio a Dovecot 2.0
by Antonio Perez-Aranda 08 Nov '10

08 Nov '10

Actualmente tenemos dovecot 1.2.15 que ha demostrado ser bastante estable, pero con el que podemos tener problemas de corrupción en ficheros de índices de Dovecot (dovecot-uidlist). Este problema, podría llegar a ocasionar la descarga de todos los correos desde el cliente del usuario. En Dovecot 2.0 tenemos una mejor gestión sobre NFS mediante un nuevo sistema llamado director. Con este director se consigue que dovecot haga a su vez de proxy/balanceador e intente direccionar las conexiones de un usuario a un mismo servidor si este permite conexiones. En resumen, conseguimos evitar escrituras "concurrentes" sobre cachés de NFS que podrían ocasionar corrupción en determinados índices de dovecot. Para este cambio básicamente deberíamos repetir ciertas pruebas que hemos realizado para dovecot 1.2 así como ciertas tareas. 1. Actualizar configuración 2. Actualizar plugin TrataSPAM (MarcaSPAM/DesmarcaSPAM) Usando skel creado por Timo durante las sesiones de Málaga. 3. Pruebas de tiempos de indexado con SQUAT 4. Búsquedas concurrentes. 5. Pruebas de IMAP IDLE. 6. Migración { Keywords, suscriptions, flags, status...} 7. Condiciones de estrés. 8. Actualizar Doc. En una primera estimación. El total de estas tareas no debería superar las 45-50 horas. A cambio obtendríamos: 1. Un mejor soporte por parte de Timo. 2. doveadm para realizar búsquedas, gestión del director, pruebas de depuración... 3. Mejoras en el comportamiento ante storage en NFS. 4. Mejoras en la coordinación con SOLR para cuando comencemos con el buscador avanzado con ficheros adjuntos. 5. Mejoras para conexiones concurrentes. La razón por la que no empezamos directamente con dovecot 2.0 es porque no preveíamos que fuera relativamente estable en poco tiempo. Observando la lista de correos y después de la conversación con Timo, la última release de dovecot 2.0 es lo suficientemente estable como para usarse en sistemas de producción. Si lo creéis necesario, podemos organizar una reunión para tomar la decisión, aunque sí que esta reunión debería ser para esta semana o a principios de la siguiente.

2 2

[Dovecot] dovecot + sieve
by maximatt 08 Nov '10

08 Nov '10

Hi, In ower mail system we use postfix and dovecot v1.2.10 with sieve plugin and i think is work fine but..... i need to have access to variables values like in these test script require ["enotify", "variables", "envelope"]; keep; notify :importance "1" :message "TEST SIEVE ${from}: ${subject}" "mailto:i_not_exist@hotmail.com"; but when i receive message, the values for "${from}" and "${subject}" are empty. i don't know the reasons about these (i'm some lost with these issue).. if help ... i put in master.cf (postfix) these value for dovecot delivery: dovecot unix - n n - - pipe flags=DRhu user=mail:mail argv=/etc/dovecot/libexec/deliver -f ${sender} -d ${recipient} ¿is here the problem or what could be? thanks in advance! *Salu2 ;)*

2 1

Re: [Dovecot] dovecot Digest, Vol 91, Issue 18
by Alan Brown 08 Nov '10

08 Nov '10

> From: Timo Sirainen <tss(a)iki.fi> > Subject: Re: [Dovecot] emails getting mangled when dragging from > Exchange account to IMAP shared folders > On Wed, 2010-11-03 at 16:18 -0700, Scott Goodwin wrote: >> FYI, I got rawlog working and it shows the same break in the raw logs as in >> the broken headers. >> Below is a snippet from the rawlog (names and other identifiers redacted). >> The offending sequence is always in the References headers section, and you >> can see the line breaks there that show this. So it sounds like this can't >> be an issue with Dovecot, am I right? > > Yeah, sounds like Outlook breaks with huge headers. That's one huge > References header you have. Summarising mail standards (WRT headers) There is a limit of 4096 characters per line. If Outlook is breaking at less than that it's a bug. If the References: line is longer than that then it should have been truncated by the sending MUA - there's no provision for multiline References headers (which are a non-standardised import from Usenet anyway).

2 2

[Dovecot] Sieve not working
by Christoph Pleger 07 Nov '10

07 Nov '10

Hello, I installed dovecot 2.0.6 and pigeonhole 0.2.1 on my system, but I guess that sieve is not working, because netstat does not show that anything is listening to ports 2000 and 4190. Regards Christoph # 2.0.6 (601065674f74): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-bpo.5-amd64 x86_64 Debian 5.0.6 auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 122 last_valid_uid = 122 mail_gid = vmail mail_location = mdbox:~/mdbox mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = scheme=MD5-CRYPT username_format=%Ln /etc/dovecot/users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = username_format=%Ln /etc/dovecot/users driver = passwd-file } protocol lmtp { mail_plugins = " sieve" }

2 2

[Dovecot] Last login tracking with login_executable
by Denny Lin 07 Nov '10

07 Nov '10

Hi, I'm using Dovecot 1.2.14, and I've read PostLoginScripting on the wiki. Is there any way to make Dovecot use the same username/password for database access as userdb and passdb queries? Specifying the password with -p doesn't seem like a good idea, so I'm wondering if it can be handled by Dovecot directly. Or is it possible to track last logins with a plugin similar to quota? -- Denny Lin

3 6

[Dovecot] Keep a copy of email.
by Henrique Fernandes 07 Nov '10

07 Nov '10

Can dovecot-lda, keep a copy of any email that it receives in a diferente folder ? Like if user(a)domain.com get an email. It goes to user(a)domain.com inbox and goes to other folder..diferente that his mailboxes ? I want this with all users. Can it be done ? If not, does any one have any ideia how could it be done ? We are having serius problems with backups, with this we gona be able to at least save one or two days of each emails, than rotate them again. I though about using postfix always_bcc, but would be everyones emails only in one account. Though in migh use sieve for filter this acount and separete it for each folder.. but i don't guess sieve could get a parameter from the email to make a filter.. or can it ? like, if email from user2(a)domain.com it goes to user2 folder, but this user2 would be variable, otherwise i have to create a sieve too bigm and would work i guess. Well, i am open to ideas. Thanks! []'sf.rique

3 2

[Dovecot] anti-spam+anti-malware suggestions
by Jose Luis Faria 05 Nov '10

05 Nov '10

Hello people, I am using now qmail in cluster with LDAP + Interscan Messaging Security Suite from Trendmicro. I need to develop a new solution with: - postfix - dovecot - anti-spam - anti-malware. I am thankful any help or suggestion for anti-spam and anti-malware. Thanks in advance! -- :) cumprimentos ---------------------- José Luís Faria Network Eng./Administrador de Sistemas Departamento de Informática Universidade do Minho Braga, Portugal

16 22

[Dovecot] Getting plugin config by user
by Alex Baule 05 Nov '10

05 Nov '10

There is a native way to set/get a configuration to one plugin, to various users ? Like this: my_plugin{ user_a=configurations user_b=configurations user_...... user_z=configurations } I Have plugin and it can be enable/disabled by user. And i have a lot of users, like 10 m. i think if i do like this: my_plugin { configurations=user_a,user_b,user....,user_z } Can get much memory to read every line of configuration... Tks !

2 3