- dovecot - dovecot.org

[Dovecot] New log entries with 2.0.19?
by Knute Johnson 02 Sep '12

02 Sep '12

I just upgraded my Ubuntu server from 11.10 to 12.04.1 and that upgraded Dovecot to 2.0.19. For some reason I'm getting a lot more (5 times) disconnect in IDLE and inactivity time outs. I'm using only IMAP with two users. Both users access the server from multiple devices, phone, tablet and desktop computer. I had previously set the max_userip_connections to 20 and rarely got the following limits exceeded message. That's probably being triggered when we are both home and using all of our devices on the same network. I've now changed it to 40 and we'll see how that does. The other is the IDLE and inactivity timeouts. I don't really understand how IDLE works and I couldn't find an inactivity timeout setting to play with. There are at this second 32 imap or imap-login processes running with only two phones and one desktop running. That's a few more than before the upgrade but not a lot. --------------------- Dovecot Begin ------------------------ Dovecot limits exceeded: max_userip_connections: penny from 216.240.58.138 to 216.240.58.140: 56 Time(s) Dovecot disconnects: Disconnected in IDLE: 485 Time(s) Inactivity: 343 Time(s) no auth attempts: 14 Time(s) no reason: 21 Time(s) Everything seems to be working OK so maybe I should just not worry about it? Thanks, knute... # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-29-generic x86_64 Ubuntu 12.04.1 LTS auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain login auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 60 default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins disable_plaintext_auth = yes dotlock_use_excl = yes doveadm_allowed_commands = doveadm_password = doveadm_proxy_port = 0 doveadm_socket_path = doveadm-server doveadm_worker_count = 0 first_valid_gid = 1 first_valid_uid = 500 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k import_environment = TZ info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/lib/dovecot listen = *, :: lmtp_proxy = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = mail_privileged_group = mail_save_crlf = no mail_temp_dir = /tmp mail_uid = mailbox_idle_check_interval = 30 secs mailbox_list_index_disable = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no passdb { args = deny = no driver = pam master = no pass = no } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv postmaster_address = protocols = " imap" quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s sendmail_path = /usr/sbin/sendmail service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 4096 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0600 user = } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 0 ssl = no } inet_listener pop3s { address = port = 0 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cert_username_field = commonName ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_client_cert = ssl_client_key = ssl_key = </etc/ssl/private/dovecot.pem ssl_key_password = ssl_parameters_regenerate = 168 ssl_verify_client_cert = no submission_host = syslog_facility = mail userdb { args = driver = passwd } valid_chroot_dirs = verbose_proctitle = no verbose_ssl = no version_ignore = no protocol imap { imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS mail_max_userip_connections = 40 } -- Knute Johnson

1 1

[Dovecot] Strange messages?
by Knute Johnson 02 Sep '12

02 Sep '12

The following messages show up in the output of a script that does some backup. This too is new with the upgrade to Ubuntu server 12.04.1 and dovecot 2.0.19. Anybody know what would generate these sorts of messages? Where or what would cause them? WARN: Duplicate profile 'Dovecot POP3', using last found WARN: Duplicate profile 'Dovecot Secure POP3', using last found WARN: Duplicate profile 'Dovecot IMAP', using last found WARN: Duplicate profile 'Dovecot Secure IMAP', using last found Thanks, -- Knute Johnson

1 0

[Dovecot] How Converting/Using courier-userdb Files ?
by Dirk Caspari 02 Sep '12

02 Sep '12

Hello, how can i convert/use the Original userdb-Files from courier Installation ? The files are looking like a "Special"-DB-Format and are not readable. ----------------- #file /etc/courier/userdb.dat /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian ----------------- /etc/courier/userdb.dat /etc/courier/userdbshadow.dat These Files was created with the following scripts (Part of "courier-authlib-userdb" Package). ......... /usr/sbin/makeuserdb /usr/sbin/pw2userdb /usr/sbin/userdb .......... Regards D I R K

3 2

Re: [Dovecot] Alerts when process limits are met
by David Anderson 01 Sep '12

01 Sep '12

Hi, Thanks. I used monit, and will code something up of that kind - but I was curious as to whether dovecot had something built in; external monitoring is a somewhat blunter tool, as you don't get to know exactly why there was a problem unless you also parse the logs. Tricky to investigate this kind of issue - it has only happened once, and I had a few hundred people trying to log in, so no time to start debugging! But if it recurs I'll be back to ask for guidance... Many thanks, David -- WordShell - WordPress fast from the CLI - www.wordshell.net On 01/09/12 12:15, Noel Butler wrote: > Seen similar, we use mon¹ for network monitoring, our mon pop3 script > is modified to not only connect, but login, if it cant the trigger > becomes active and if fails again at next check, it alerts engineers > by sms. > > Though, I would investigate the core issue, Timo "apparently" fixed > that hung session stuff in 2.0, it was common in 0.x and 1.x series. > > Cheers > > 1: ( <http://sourceforge.net/projects/mon/files/mon/> > http://sourceforge.net/projects/mon/files/mon/ ) > > >

1 0

[Dovecot] Testing process?
by leam hall 01 Sep '12

01 Sep '12

Morning all! Total newbie question. I'm learning Dovecot and will be plugging in a few things and testing it end to end. What test structures or tools are available for making sure the install is correct and the parameters are taken? Thanks! Leam -- Mind on a Mission <http://leamhall.blogspot.com/>

3 3

[Dovecot] Dovecot generate file when over quota detected
by Dominic Malolepszy 31 Aug '12

31 Aug '12

Hi, I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. This means that an MTA can efficiently check for the existence of this 'overquota' file and return a "user(a)domain.com Mailbox full" TEMPFAIL error early during the SMTP transaction prior to accepting any data. Dominic

2 3

[Dovecot] LDAP auth and multiple attributes to construct the mail path
by Anatoly Ivanov 31 Aug '12

31 Aug '12

Hello, So I am trying to construct mail path for my LDAP user lookups, and i need to use two attributes instead of one. For examle, my LDAP directory has two attributes: departmentAttr and userIDAttr, and I want the maildir to reside in /home/${departmentAttr}/${userIDAttr} Unfortunately, I cannot seem to find a way to configure dovecot this way. Right now, I have something like user_attrs = departmentAttr=mail=maildir:/home/%$/%u But %u is the username (which in my environment can easily change, so I cannot use this for maildir location). Any ideas on how to achieve that? So far I have just one brute-force solution - to create an attribute MailDirAttr, and populate it with concatenation of departmentAttr+'/'+userIDAttr by means of a scheduled task. This sounds like unnecessary information duplication, which is usually a very bad practice. So, again - any ideas? Thank you, Anatoly.

2 1

[Dovecot] segfault in mail_user_get_home()
by Lazy 31 Aug '12

31 Aug '12

gdb ./src/imap/.libs/imap Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. (gdb) run Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7ffff7ffa000 [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/local/dovecot/bin/doveconf [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Program received signal SIGSEGV, Segmentation fault. 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 310 if (user->home_looked_up) { (gdb) bt #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at mdbox-storage.c:90 #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mdbox-storage.c:113 #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mail-storage.c:105 #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:180 #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, ns_p=0x645380, error_r=0x7fffffffe6e8) at mail-namespace.c:126 #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, error_r=0x7fffffffe6e8) at mail-namespace.c:289 #8 0x00007ffff7b34a64 in mail_storage_service_init_post (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe6e8) at mail-storage-service.c:641 #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, user=0x633e08, mail_user_r=0x7fffffffe7b8) at mail-storage-service.c:1114 #10 0x00007ffff7b35efa in mail_storage_service_lookup_next (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe808) at mail-storage-service.c:1149 #11 0x000000000041f61c in client_create_from_input (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, input_buf=0x0, error_r=0x7fffffffe808) at main.c:202 #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 /usr/local/dovecot/bin/doveconf -n # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32 x86_64 Debian wheezy/sid namespace test { list = children location = maildir:/root/test prefix = test. subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = subscriptions = yes } passdb { driver = pam } ssl = no userdb { driver = passwd } without type = shared there is no segfault, I understand this config might not work (invoking imap directly) but it should't segfault. Regards, Michal Grzedzicki

2 2

[Dovecot] Variables in LDAP userdb
by Alex Crow 31 Aug '12

31 Aug '12

Hi Timo, Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n and those % variables will still be expanded by dovecot? Or would I be required to replace them in the LDAP directory with their actual values? Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856)

2 3

[Dovecot] Merge multiple doveadm commands
by Ralf Hildebrandt 31 Aug '12

31 Aug '12

Can I merge these three commands into one? doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW doveadm expunge -u %s mailbox INBOX.Trash NOT NEW doveadm expunge -u %s mailbox INBOX deleted -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 1