June 2011 - dovecot - dovecot.org

[Dovecot] Performance settings for 500-1000User/per day
by Denny Schierz 22 Jun '11

22 Jun '11

hi, we have 2.0.13 running and most works well, but today we had some minor problems: The IMAP login process takes sometimes to much time. Over webmail (Roundcube 0.5.0.3) login wasn't sometimes possible, the normal clients hasn't any problems, until they login. We had only ~ 20-30 active accounts, but 50-60 sessions. The most are Apple products (Ip*/Mac/. ..)because they have 4 sessions or more open. Also we had ~212 processes with: dovenull 2065 4364 0 14:50:32 ? 0:00 dovecot/imap-login vmail 2403 4364 0 14:58:31 ? 0:00 dovecot/imap So, maybe, it's a miss configuration .... Any suggestions are welcome for 500-1000User per day. Our System is a Sun Sunfire X4250 with 16GB memory on Raidz1 Most settings are defaults, so I posting only my changes: # doveadm -N # 2.0.13: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: SunOS 5.10 i86pc zfs auth_cache_negative_ttl = 1 hours auth_cache_ttl = 1 hours auth_debug = yes auth_mechanisms = plain auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_verbose = yes auth_verbose_passwords = no base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot-debug.log default_login_user = dovenull default_process_limit = 100 disable_plaintext_auth = no hostname = hostname.fomain.foo info_log_path = /var/log/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = no lda_original_recipient_header = login_greeting = I'm alive mail_debug = yes mail_gid = vmail mail_home = /imap/spool/%d/%1n/%n mail_location = maildir:/imap/spool/%d/%1n/%n:INDEX=/imap/spool/% d/indexes/%1n/%n mail_plugin_dir = /usr/local/dovecot/dovecot2/lib/dovecot/ mail_plugins = acl quota fts fts_squat mail_privileged_group = vmail mail_temp_dir = /imap/spool/tmp mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags namespace { hidden = no inbox = yes location = prefix = separator = / subscriptions = yes type = private } namespace { inbox = no location = maildir:/imap/spool/public prefix = public/ separator = / subscriptions = no type = public } passdb { args = /usr/local/dovecot/etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } passdb { args = scheme=plain-md5 username_format=% Lu /usr/local/dovecot/etc/dovecot/other-users driver = passwd-file } plugin { acl = vfile:/imap/spool/%d/acl autocreate = Sent autocreate2 = Drafts autocreate3 = Trash autocreate4 = Spam autosubscribe = Sent autosubscribe2 = Drafts autosubscribe3 = Trash autosubscribe4 = Spam fts = squat fts_squat = partial=4 full=10 quota = maildir:User quota quota_rule2 = Trash:storage=+10%% quota_rule3 = Spam:storage=+20%% quota_warning = storage=80% % /usr/local/dovecot/dovecot2/bin/quota-warning.sh 80 quota_warning2 = storage=90% % /usr/local/dovecot/dovecot2/bin/quota-warning.sh 90 quota_warning3 = storage=95% % /usr/local/dovecot/dovecot2/bin/quota-warning.sh 95 sieve = /imap/spool/%d/%1n/%n/sieve/default.sieve sieve_dir = /imap/spool/%d/%1n/%n/sieve sieve_extensions = +imapflags trash = /usr/local/dovecot/etc/dovecot/conf.d/dovecot-trash.conf } postmaster_address = postmaster(a)domain.foo protocols = imap pop3 lmtp sieve recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s service auth { unix_listener /var/spool/postfix/private/auth { group = postdrop mode = 0600 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 vsz_limit = 1 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postdrop mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2001 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </usr/local/dovecot/etc/dovecot/ssl/imapd.pem ssl_key = </usr/local/dovecot/etc/dovecot/ssl/imapd.pem syslog_facility = mail userdb { args = /usr/local/dovecot/etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } userdb { args = username_format=%Lu /usr/local/dovecot/etc/dovecot/other-users driver = passwd-file } verbose_proctitle = yes verbose_ssl = yes protocol imap { imap_idle_notify_interval = 2 mins mail_max_userip_connections = 10 mail_plugins = acl quota fts fts_squat imap_acl imap_quota mail_log notify autocreate trash listescape fts fts_squat zlib ssl_cert = </usr/local/dovecot/etc-testinstanz/dovecot/ssl/imapd.pem ssl_key = </usr/local/dovecot/etc-testinstanz/dovecot/ssl/imapd.pem } protocol lda { mail_plugins = acl quota fts fts_squat sieve quota fts fts_squat } protocol pop3 { mail_plugins = acl quota fts fts_squat quota fts fts_squat pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_reuse_xuidl = yes ssl_cert = </usr/local/dovecot/etc-testinstanz/dovecot/ssl/pop3d.pem ssl_key = </usr/local/dovecot/etc-testinstanz/dovecot/ssl/pop3d.pem } protocol lmtp { mail_plugins = acl quota fts fts_squat sieve }

3 3

[Dovecot] Question about "Storage keeps breaking" in logs
by Maria Arrea 22 Jun '11

22 Jun '11

Hello I have found this entries in my log /var/log/maillog.13.xz:Jun 6 17:03:26 buzon dovecot: imap(juanan): Error: mdbox /buzones//18/66/juanan/mailboxes/P7.Bielorrusia/cd-eslpod-enviado/dbox-Mails: Storage keeps breaking /var/log/maillog.108.xz:Mar 4 01:42:09 buzon dovecot: imap(lbandera): Error: mdbox /buzones/0b/11/lbandera/mailboxes/Sent/dbox-Mails: Storage keeps breaking /var/log/maillog.3.xz:Jun 16 11:48:29 buzon dovecot: imap(fjvalderrama): Error: mdbox /buzones/0f/99/fjvalderrama/mailboxes/Asignaturas 08-09/Calculo/dbox-Mails: Storage keeps breaking I have "rebuilt" those mdboxes with doveadm force-resync && doveadm quota recalc. Should I be worried? Why is this happening? Regards Maria Arrea

2 1

[Dovecot] high number of processes
by Egbert Jan van den Bussche 22 Jun '11

22 Jun '11

Hi, Sometimes a script kiddie tries to guess passwords on our mailserver (Ubuntu 10.04.2 LTS, postfix, dovecot 1.2.9, scanners, the standard stuff). That leads to a nagios message about the high number of processes. The number goes above 500. Nagios threshold is set to 250, which is more than enough for normal operation of this server. When are these processes supposed to die again? They seem to stay at the high count quite long. Is there a way to limit the generation of extra login processes? Can I tune the login_process... params a bit? I have then all on default. dovecot - n below: root@mail-dev:/etc/dovecot# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-32-server x86_64 Ubuntu 10.04.2 LTS log_path: /var/log/dovecot/error.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 imaps pop3s listen: *, [::] ssl_cert_file: /disk/site/etc/ssl/hobby.nl/hobby.nl.crt ssl_key_file: /disk/site/etc/ssl/hobby.nl/hobby.nl.key ssl_cipher_list: ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login first_valid_uid: 200 mail_privileged_group: vmail mail_location: maildir:~/Maildir mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap-wrapper.sh mail_executable(imap): /usr/lib/dovecot/imap-wrapper.sh mail_executable(pop3): /usr/lib/dovecot/pop3-wrapper.sh mail_plugins: convert autocreate mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster deliver_log_format: msgid=%m: %$ rejection_subject: Rejected: %s rejection_reason: Your message to <%t> was automatically rejected:%n%r auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login realms: kader.hcc.nl hobby.nl default_realm: kader.hcc.nl cache_size: 1024 cache_ttl: 10 passdb: driver: pam args: failure_show_msg=yes cache_key=%u dovecot passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/dovecot-auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: convert_mail: mbox:/disk/mail/convert/%n autocreate: Trash autocreate2: Sent autocreate3: Drafts autocreate4: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Drafts autosubscribe4: Spam login_process defaults: #login_user = dovecot #login_process_size = 64 #login_process_per_connection = yes #login_processes_count = 3 #login_max_processes_count = 128 #login_max_connections = 256 lsof -n output (part of long list): dovecot-a 12941 root 17u unix 0xffff88012a457300 0t0 13606994 /var/run/dovecot/login/default dovecot-a 12941 root 18u unix 0xffff8800272bd800 0t0 13565904 /var/run/dovecot/login/default dovecot-a 12941 root 19u unix 0xffff8800a68a9800 0t0 13610586 /var/run/dovecot/login/default TNX for any advise! Egbert Jan HCC!Hobbynet, NL

2 1

[Dovecot] Waiting for authentication process to respond..
by Peter Eriksson 22 Jun '11

22 Jun '11

Hmm... I'm seeing a lot of: > * OK Waiting for authentication process to respond.. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=GSSAPI AUTH=GSS-SPNEGO] Welcome to the IFM Dovecot Mail Server. when IMAP clients connect to our server (ie that "Waiting for.." message before the login OK message). Now, most clients seems to handle this extra information message just fine, but it still is annoying me. It doesn't appear all the time, but pretty often... What can I adjust/fix in order to make it go away? System: Sun Fire X4240, 32GB RAM, 2 Quad-Core Opteron 2356 Solaris 10 Update 9 Dovecot 2.0.13 Maildir on local (ZFS) storage Normally about 200-300 unique users connected, around 400-600 mail processes. -- Peter Eriksson <peter(a)ifm.liu.se> Phone: +46-705-18 27 86 Computer Systems Manager, IFM, Linköping University, Sweden

2 1

[Dovecot] ACL's from userdb
by Daniel L. Miller 22 Jun '11

22 Jun '11

Using LDAP userdb/passdb. Is it possible to define a default set of ACL's at the userdb level, to provide access to shared mailboxes? How? -- Daniel

3 3

[Dovecot] Dovecot 2.0.13 and sieve
by Claudio Prono 22 Jun '11

22 Jun '11

Hello all, I am testing Dovecot 2.0.13, with sieve for the vacation. I have some problems with the :regex as i can see... An example: # Sieve Filter # Generato da Ingo (http://www.horde.org/ingo/) (10/06/2011, 04:45:07) require ["vacation", "regex"]; # Vacanze if allof ( not exists ["list-help", "list-unsubscribe", "list-subscribe", "list-owner", "list-post", "list-archive", "list-id", "Mailing-List"], not header :comparator "i;ascii-casemap" :is "Precedence" ["list", "bulk", "junk"], not header :comparator "i;ascii-casemap" :matches "To" "Multiple recipients of*" ) { if header :regex "Received" "^.*(2011) (\$.*\$ )?..:..:.. (\$.*\$ )?(\\+|\\-)....( \$.*\$)?$" { if header :regex "Received" "^.*(Jun) (\$.*\$ )?.... (\$.*\$ )?..:..:.. (\$.*\$ )?(\\+|\\-)....( \$.*\$)?$" { if header :regex "Received" "^.*(10) (\$.*\$ )?... (\$.*\$ )?.... (\$.*\$ )?..:..:.. (\$.*\$ )?(\\+|\\-)....( \$.*\$)?$" { vacation :days 7 :addresses "claudio(a)mediaservice.net" :subject "Test autoresponder" "test autoresponder 22"; } } } } If i test this script with sieve-test, the result is the following: sieve-test .dovecot.sieve new/1307715082.M173915P16839.mail2\,S\=1138\,W\=1168 sieve-test(root): Debug: Effective uid=0, gid=0, home=/root sieve-test(root): Debug: Namespace : type=private, prefix=INBOX., sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/virtual//root sieve-test(root): Debug: maildir++: root=/var/mail/virtual//root, index=, control=, inbox=/var/mail/virtual//root sieve-test(root): Debug: none: root=, index=, control=, inbox= Performed actions: (none) Implicit keep: * store message in folder: INBOX sieve-test(root): Info: final result: success No vacation is performed..... Then, if i modify the script commenting all the regex for the date, the result is the following: sieve-test .dovecot.sieve new/1307715082.M173915P16839.mail2\,S\=1138\,W\=1168 sieve-test(root): Debug: Effective uid=0, gid=0, home=/root sieve-test(root): Debug: Namespace : type=private, prefix=INBOX., sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/virtual//root sieve-test(root): Debug: maildir++: root=/var/mail/virtual//root, index=, control=, inbox=/var/mail/virtual//root sieve-test(root): Debug: none: root=, index=, control=, inbox= Performed actions: * send vacation message: => seconds : 604800 => subject: Test autoresponder => handle : test autoresponder 22Test autoresponder<default-from><NO-MIME> START MESSAGE test autoresponder 22 END MESSAGE Implicit keep: * store message in folder: INBOX sieve-test(root): Info: final result: success But the date is right: date Fri Jun 10 17:22:14 CEST 2011 So, what is wrong? Any help is well accepted, that script with dovecot 1.x is working correctly.... So, what is changed in dovecot 2.0 sieve? Cordially, Claudio Prono. -- -------------------------------------------------------------------------------- Claudio Prono OPST System Developer Gsm: +39-349-54.33.258 @PSS Srl Tel: +39-011-32.72.100 Via San Bernardino, 17 Fax: +39-011-32.46.497 10141 Torino - ITALY http://atpss.net/disclaimer -------------------------------------------------------------------------------- PGP Key - http://keys.atpss.net/c_prono.asc

2 8

[Dovecot] Interrupted system call in imap-login
by Giovanni Mancuso 22 Jun '11

22 Jun '11

Hi, We have some problems with dovecot 1.2.11 that we can't resolve yet The problem is that we have in maillog: imap-login: Error: Can't connect to auth server at default: Interrupted system call The operating system is Solaris 9, and sometimes dovecot works fine. Dovecot is configured to use ldap. The dovecot -n : log_path: /var/log/maillog info_log_path: /var/log/maillog log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 imaps pop3s listen(default): xxx.xxx.xxx.xxx:143 listen(imap): xxx.xxx.xxx.xxx:143 listen(pop3): xxx.xxx.xxx.xxx:110 ssl_listen(default): xxx.xxx.xxx.xxx:993 ssl_listen(imap): xxx.xxx.xxx.xxx:993 ssl_listen(pop3): xxx.xxx.xxx.xxx:995 ssl_cert_file: /opt/dovecot/certs/imapd.pem ssl_key_file: /opt/dovecot/certs/imapd.pem disable_plaintext_auth: no login_dir: /opt/dovecot/var/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login max_mail_processes: 1024 first_valid_uid: 102 first_valid_gid: 101 mail_uid: 102 mail_gid: 101 mail_location: maildir:%h/Maildir mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock mbox_write_locks: fcntl mail_drop_priv_before_exec: yes mail_executable(default): /opt/dovecot/libexec/dovecot/imap mail_executable(imap): /opt/dovecot/libexec/dovecot/imap mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: master_user_separator: * debug: yes worker_max_count: 50 passdb: driver: passwd-file args: /opt/dovecot/etc/passwd.masterusers master: yes passdb: driver: ldap args: /opt/dovecot/etc/dovecot-ldap.conf userdb: driver: ldap args: /opt/dovecot/etc/dovecot-ldap.conf plugin: quota: maildir quota_rule2: Trash:storage=100M I try to chage nsswitch.conf, I see the ldap logs, ecc... But I don't find anything I really don't know what to do now, can you help us please? I tried to update dovecot with 1.2.17 version, but the problem is the same. Thanks

1 0

[Dovecot] LIST-EXTENDED support?
by fusionstream 22 Jun '11

22 Jun '11

Hi there. Can I check if LIST-EXTENDED refers to RFC 6154 (http://tools.ietf.org/html/rfc6154) rfc for special use mailboxes. I'd like to specify a designated folder as \Spam and etc. Googling "dovecot list-extended" and "dovecot special use" suggests that dovecot supports this feature (via patch logs and 1 bug report for Mozilla Thunderbird which suggests that dovecot supports this). However when trying to test this feature via thunderbird, it would seem to suggest that it is not currently possible. (Moving folders that Thunderbird has created forces thunderbird to recreate said folder in it's original location) # dovecot --version 1.2.17 Any help/pointers appreciated. Cheers.

2 1

[Dovecot] sieve problem email silently discard
by ml＠smtp.fakessh.eu 22 Jun '11

22 Jun '11

hello folks hello Timo hello all the guru I met a few times the problem or an email that passes through a sieve script is silently discard after delivery but never returned to the inbox all testimonials are welcome -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7 gpg --keyserver pgp.mit.edu --recv-key 092164A7

2 4

[Dovecot] DoveCot LDA/Postfix deliver by address
by Zhou, Yan 21 Jun '11

21 Jun '11

Hi there, I am using DoveCot 1.0.7 and virtual users. We want to integrate with Postfix 2.3.3 to use DoveCot LDA to deliver messages to user mailbox. All users are stored in LDAP. DoveCot looks up user by LDAP access. Our user name is not necessarily part of the address. For instance, address "zhouy@xxxx" may be with user "yzhou", thus all messages to "zhouy@xxxx" should go to /home/vmail/yzhou/Maildir I do not see how LDA can support a two-step lookup: 1. Look up user from the given address, 2. Lookup user mail directory from the user in step 1. My understanding is that /etc/dove-ldap.conf is a one-step lookup, it only does user lookup (without password lookup). Any suggestions? Thanks, Yan Confidentiality Notice: The information contained in this electronic transmission is confidential and may be legally privileged. It is intended only for the addressee(s) named above. If you are not an intended recipient, be aware that any disclosure, copying, distribution or use of the information contained in this transmission is prohibited and may be unlawful. If you have received this transmission in error, please notify us by telephone (513) 229-5500 or by email (postmaster(a)MedPlus.com) After replying, please erase it from your computer system.

4 3