- dovecot - dovecot.org

[Dovecot] migrate machines and upgrade
by Donny Brooks 08 Oct '10

08 Oct '10

I am about to be migrating mail servers and have a few questions. First a little background: Old mail server: Fedora 11 dovecot-1.2.11-3.fc11.x86_64 installed from yum repo mbox mail format OpenLDAP authentication 250+ users New mail server: Fedora 13 dovecot-2.0.1-1_118.fc13.x86_64 installed from atrpm rpm file Maildir mail format OpenLDAP authentication 250+ users I plan to use dsync on the new machine to migrate the mail off the old machine and mbox format to the new machine and Maildir. I think I read where I can do the migration without interfering with normal mail delivery and then when i get ready to do the final move I just kill dovecot on the old machine, dsync once more, and start the service on the new machine. What would be the best way to accomplish this? And as for the configuration changed between 1.2.11 and 2.0.1, where to start? I see there is now a conf.d directory for 2.0.1. How will this tie in to the 1.2.11 config? Any pointers there? Other option is to move the mbox mail as it sits to the new machine, install 1.2.X branch dovecot on new machine, and let the convert plugin do all the work. However I like the idea of the dsync doing the sync with minimal downtime. Thanks in advance. -- Donny B.

5 12

[Dovecot] 2.0.5: dovecot/auth crash upon reload (with backtrace)
by Ralf Hildebrandt 08 Oct '10

08 Oct '10

I can reproduce this by simply issuing: doveadm reload GNU gdb (GDB) 7.0.1-debian Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/dovecot-2/libexec/dovecot/auth...done. Reading symbols from /usr/dovecot-2/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/dovecot-2/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/i686/cmov/libcrypt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libcrypt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libcrypt.so.1 Reading symbols from /lib/libpam.so.0...(no debugging symbols found)...done. Loaded symbols for /lib/libpam.so.0 Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/i686/cmov/librt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/librt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/librt.so.1 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/i686/cmov/libpthread-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libpthread.so.0 Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `dovecot/auth'. Program terminated with signal 6, Aborted. #0 0xb772e430 in __kernel_vsyscall () #0 0xb772e430 in __kernel_vsyscall () No symbol table info available. #1 0xb7556751 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1217994764 selftid = 22112 #2 0xb7559b82 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0xbfdc3ed0, sa_sigaction = 0xbfdc3ed0}, sa_mask = {__val = {3077757632, 3218882212, 3077800674, 3218882196, 3077323828, 3218882184, 3077880404, 0, 3075510304, 1, 0, 1, 3077757192, 3218882108, 3218882104, 3077532336, 3077526747, 3077739624, 3218882188, 166684304, 0, 3218882256, 3218882184, 3218882196, 3077532029, 3077757192, 0, 725, 3218882216, 3077348830, 3218882188, 10}}, sa_flags = -1076084988, sa_restorer = 0xb772a70c <pid.3601>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0xb76f7695 in default_fatal_finish (type=<value optimized out>, status=<value optimized out>) at failures.c:178 backtrace = 0x9ef6280 "/usr/dovecot-2/lib/dovecot/libdovecot.so.0(+0x37681) [0xb76f7681] -> /usr/dovecot-2/lib/dovecot/libdovecot.so.0(+0x376ef) [0xb76f76ef] -> /usr/dovecot-2/lib/dovecot/libdovecot.so.0(i_error+0) [0xb76d1"... #4 0xb76f76ef in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x806bca4 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfdc3f84 "\017\314\006\bc") at failures.c:607 No locals. #5 0xb76d15de in i_panic ( format=0x806bca4 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:244 No locals. #6 0x080578e0 in auth_request_handler_unref (_handler=0xbfdc3fdc) at auth-request-handler.c:99 handler = 0xa0384f8 __FUNCTION__ = "auth_request_handler_unref" #7 0x08058129 in auth_request_handler_destroy (_handler=0x6) at auth-request-handler.c:117 handler = 0x0 __FUNCTION__ = "auth_request_handler_destroy" #8 0x080516f0 in auth_client_connection_destroy_full ( _conn=<value optimized out>, abort_requests=<value optimized out>) at auth-client-connection.c:355 conn = 0x9fe3bf8 clients = 0x9f82ba8 #9 0x080517b1 in auth_client_connections_deinit () at auth-client-connection.c:407 i = 2 #10 0x0805c1bf in main_deinit (argc=1, argv=0x9efe1c0) at main.c:166 No locals. #11 main (argc=1, argv=0x9efe1c0) at main.c:284 c = <value optimized out> -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

1 0

[Dovecot] pop3-login no longer segfaults with gcc4.5.2 and gold :)
by interfaSys sàrl 08 Oct '10

08 Oct '10

Hello, I reported a while back that it wasn't possible to compile the whole of Dovecot using gcc 4.5.2 and the new gold linker, but it's now working with recent snapshots of both binutils and GCC. Cheers, Olivier

1 0

[Dovecot] Significant performance problems
by Chris Hobbs 07 Oct '10

07 Oct '10

Hi all, I'm sure my issues are a result of misconfiguration, but I'm hoping someone can point me in the right direction. I'm getting pressure to move us back to GroupWise, which I desperately want to avoid :-/ We're running dovecot 1.2.9 on Ubuntu 10.4 LTS+postfix. The server is a VM with 1 vCPU and 4GB of RAM. We serve about 10,000 users with anywhere from 500-1000 logged in at any one time. Messages are stored in Maildir format on two NFS servers (one for staff, the other for students). Today I implemented the "High performance" setup described here: http://wiki.dovecot.org/NFS (mainly moving indexes off of NFS, since I'm only using the one server). I also added imapproxy to our webmail client server (SOGo). The vast majority of our users come in over the web. We currently see load averages spiking into the 20-30 range. When this happens, service crawls to a near standstill, and ultimately the SOGo client starts crashing out. I'm wondering if anything jumps out at anybody here - feel free to mock if/when you find an obvious configuration problem. I just want it to work :-) dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-25-server x86_64 Ubuntu 10.04.1 LTS log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_cert_file: /etc/dovecot/certs/mail_nhusd_k12_ca_us.crt ssl_key_file: /etc/dovecot/certs/mail_nhusd_k12_ca_us.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_process_size: 512 login_processes_count: 20 login_max_processes_count: 3000 login_max_connections: 64 max_mail_processes: 2048 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_access_groups: staffmailusers mail_privileged_group: dovecot mail_uid: mail mail_gid: 502 mail_location: maildir:~/Maildir:INDEX=/var/indexes/%u mail_nfs_storage: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): acl imap_acl quota imap_quota expire mail_plugins(imap): acl imap_acl quota imap_quota expire mail_plugins(pop3): mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: shared/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u list: children lda: deliver_log_format: %$ -- FROM=%f SUBJECT=%s mail_plugins: cmusieve acl expire log_path: info_log_path: syslog_facility: mail postmaster_address:postmaster@nhusd.k12.ca.us hostname: mail.nhusd.k12.ca.us auth_socket_path: /var/run/dovecot/auth-master auth default: passdb: driver: pam passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: maildir:User quota quota_rule: *:storage=9G quota_rule2: Trash:storage=200M acl: vfile acl_shared_dict:file:/home/staff/dovecot/shared-mailboxes expire: Trash 7 Trash/* 7 Spam 30 expire_dict: proxy::expire sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_extensions: +imapflags dict: expire: mysql:/etc/dovecot/dovecot-dict-expire.conf -- Chris Hobbs Director, Technology New Haven Unified School District -- This message was scanned by ESVA and is believed to be clean.

7 11

[Dovecot] And again... too many open files
by Joseba Torre 07 Oct '10

07 Oct '10

Hi! Two days ago I upgraded to 1.2.15, and again I the warning "Warning: fd limit 1024 is lower than what Dovecot can use under full load" reappeared. It's a bit weird, because my actual limits are higher. From /etc/security/limits.conf * soft nofile 4096 * hard nofile 8192 root soft nofile 4096 root hard nofile 8192 dovecot soft nofile 4096 dovecot hard nofile 8192 I added the * lines to avoid problems if a new user was involved, and finally supposed it was a bug in the detection process. Today, as expected, dovecot was not responding with the famous "Too many open files" error. Has something changed? Is there some way to know which is the maximum number of files that can be open? Is there some parameter I can change to avoid this? Here's my dovecot -n # 1.2.15: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-164.11.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.4 (Tikanga) syslog_facility: local1 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /usr/share/ssl/certs/imapd.pem ssl_key_file: /usr/share/ssl/certs/imapd.pem disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_process_per_connection: no login_process_size: 256 login_processes_count: 16 login_max_processes_count: 256 login_max_connections: 512 max_mail_processes: 2048 first_valid_uid: 100 mail_location: maildir:~/Maildir:INDEX=/var/dovecot/%u:CONTROL=/var/dovecot nas/%u/control mail_nfs_storage: yes lock_method: dotlock mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: cache_size: 1000 cache_ttl: 6000 master_user_separator: * debug: yes passdb: driver: passwd-file args: /usr/local/etc/bloqueados deny: yes passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf passdb: driver: passwd-file args: /usr/local/etc/shadow passdb: driver: pam passdb: driver: passwd-file args: /usr/local/etc/dovecot-master.conf master: yes userdb: driver: prefetch userdb: driver: passwd-file args: /usr/local/etc/passwd userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs -- Joseba Torre. Vicegerencia de TICs, área de Explotación

3 6

[Dovecot] dovecot-1.2.12 core
by Thomas Hummel 07 Oct '10

07 Oct '10

Hi Timo, just to report that . dovecot-1.2.12 which ran fine for several month . on FreeBSD 7.2-STABLE (/usr/obj/usr/src/sys/GENERIC amd64) . using Maildir (mailboxes, control and indexes on NFS) has crashed this morning on our server. I found nothing special in the logfile. Attached are dovecot -n output and a gdb backtrace of the core file. Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

1 0

[Dovecot] Panic: file index-search-result.c .. assertion failed: (next_uid == mail->uid)
by Lutz Preßler 07 Oct '10

07 Oct '10

Hello, with 2.0.5-0~auto+9 (6ea01abfaea9), haven't seen it earlier (but of course index files have changed): Oct 7 09:40:09 host dovecot: imap(user): Panic: file index-search-result.c: line 87 (search_result_update_search): assertion failed: (next_uid == mail->uid) Oct 7 09:40:09 host dovecot: imap(user): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x7f964c5b7842] -> /usr/lib/ dovecot/libdovecot.so.0 [0x7f964c5b78aa] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f964c5b7c53] -> /usr/lib/dovecot/libdove cot-storage.so.0(index_search_result_update_flags+0x2d8) [0x7f964c83e4d8] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so [0x7f9 64a9c4b92] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x871) [0x7f964a9c5561] -> /usr/lib/dovecot /libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7f964c8262d1] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x 7f964c826a87] -> dovecot/imap(cmd_select_full+0x264) [0x40d964] -> dovecot/imap [0x41047c] -> dovecot/imap [0x41052d] -> dovecot/ima p(client_handle_input+0x45) [0x4106a5] -> dovecot/imap(client_input+0x62) [0x4110d2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_han dler_run+0xcb) [0x7f964c5c293b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f964c5c1a58] -> /usr/lib/dovecot/libdoveco t.so.0(master_service_run+0x13) [0x7f964c5b0f93] -> dovecot/imap(main+0x281) [0x419391] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f964be3b1a6] -> dovecot/imap [0x408c79] when SELECTing virtual folder "sent" (.sent/dovecot-virtual is INBOX header return-path lutz(a)pressler.de ), IMAP session is terminated. After moving .sent/dovecot.index[.log], everything works fine again. I can send you the broken(?) index files, if appropriate. Lutz -- Lutz Preßler <Lutz.Pressler(a)SerNet.DE> http://www.SerNet.DE/ SerNet Service Network GmbH, Bahnhofsallee 1b, D-37081 Göttingen Tel.: +49-551-370000-2, FAX: +49-551-370000-9 AG Göttingen, HRB 2816, GF: Dr. Johannes Loxen

1 0

Re: [Dovecot] dovecot-lda segfaults
by Andre 07 Oct '10

07 Oct '10

Il giorno 07/ott/2010, alle ore 09.06, Andre ha scritto: > Hi to all. > Since version 2.0.3 (now I am running 2.0.5) I have experienced segfaults on mail delivery, either with dovecot-lda and lmtp. > > At least I succeded in having a core dump, here is the backtrace: > > #0 0x00007f1cca350160 in maildir_sync_set_new_msgs_count () from /usr/lib/dovecot/libdovecot-storage.so.0 > #1 0x00007f1cca34df0a in maildir_transaction_save_commit_pre () from /usr/lib/dovecot/libdovecot-storage.so.0 > #2 0x00007f1cca3491c3 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 > #3 0x00007f1cca382ef7 in mail_index_transaction_commit_full () from /usr/lib/dovecot/libdovecot-storage.so.0 > #4 0x00007f1cca348e4b in index_transaction_commit () from /usr/lib/dovecot/libdovecot-storage.so.0 > #5 0x00007f1cc8cccc8e in ?? () from /usr/lib/dovecot/modules/lib20_zlib_plugin.so > #6 0x00007f1cc8edaa31 in ?? () from /usr/lib/dovecot/modules/lib10_quota_plugin.so > #7 0x00007f1cca3281bd in mailbox_transaction_commit_get_changes () from /usr/lib/dovecot/libdovecot-storage.so.0 > #8 0x00007f1cca3281fe in mailbox_transaction_commit () from /usr/lib/dovecot/libdovecot-storage.so.0 > #9 0x00007f1cc8461fd7 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 > #10 0x00007f1cc8459597 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 > #11 0x00007f1cc845992b in sieve_result_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 > #12 0x00007f1cc846973d in sieve_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 > #13 0x00007f1cc869f83e in ?? () from /usr/lib/dovecot/modules/lib90_sieve_plugin.so > #14 0x00007f1cca0f4084 in mail_deliver () from /usr/lib/dovecot/libdovecot-lda.so.0 > #15 0x0000000000402cf0 in main () > > I have tried to disable quota and zlib, but I suppose it is not related to those plugins. > What else can I try??? > Andre > I’m so sorry I have not seen the previous thread "[Dovecot] 2.0.5: deliver crashing”. I’ll try that patch too and report to the list. Should it work even for lmtp (that is my favourite delivery method, for its scalability)? Andre

1 0

[Dovecot] dovecot-lda segfaults
by Andre 07 Oct '10

07 Oct '10

Hi to all. Since version 2.0.3 (now I am running 2.0.5) I have experienced segfaults on mail delivery, either with dovecot-lda and lmtp. At least I succeded in having a core dump, here is the backtrace: #0 0x00007f1cca350160 in maildir_sync_set_new_msgs_count () from /usr/lib/dovecot/libdovecot-storage.so.0 #1 0x00007f1cca34df0a in maildir_transaction_save_commit_pre () from /usr/lib/dovecot/libdovecot-storage.so.0 #2 0x00007f1cca3491c3 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #3 0x00007f1cca382ef7 in mail_index_transaction_commit_full () from /usr/lib/dovecot/libdovecot-storage.so.0 #4 0x00007f1cca348e4b in index_transaction_commit () from /usr/lib/dovecot/libdovecot-storage.so.0 #5 0x00007f1cc8cccc8e in ?? () from /usr/lib/dovecot/modules/lib20_zlib_plugin.so #6 0x00007f1cc8edaa31 in ?? () from /usr/lib/dovecot/modules/lib10_quota_plugin.so #7 0x00007f1cca3281bd in mailbox_transaction_commit_get_changes () from /usr/lib/dovecot/libdovecot-storage.so.0 #8 0x00007f1cca3281fe in mailbox_transaction_commit () from /usr/lib/dovecot/libdovecot-storage.so.0 #9 0x00007f1cc8461fd7 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #10 0x00007f1cc8459597 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #11 0x00007f1cc845992b in sieve_result_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 #12 0x00007f1cc846973d in sieve_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 #13 0x00007f1cc869f83e in ?? () from /usr/lib/dovecot/modules/lib90_sieve_plugin.so #14 0x00007f1cca0f4084 in mail_deliver () from /usr/lib/dovecot/libdovecot-lda.so.0 #15 0x0000000000402cf0 in main () I have tried to disable quota and zlib, but I suppose it is not related to those plugins. What else can I try??? Andre

2 1

[Dovecot] probelm with users logging in
by donovan jeffrey j 07 Oct '10

07 Oct '10

Greetings running dovecot for my first time on an OSX 10.6 server. after a reboot, several users are not able to Authenticate. here is a sample Oct 5 20:22:32 hsmail dovecot[2142]: auth(default): od(juser,127.0.0.1): auth mech=CRAM-MD5 Oct 5 20:22:32 hsmail dovecot[2142]: auth(default): od(juser,127.0.0.1): username=juser, challenge=<6757250558559635.1286324552(a)hsmail.beth.k12.pa.us>, response=26b23b30128bba4f9ba3aca261ec764e Oct 5 20:22:32 hsmail dovecot[2142]: auth(default): od(juser,127.0.0.1): found user in local table: user=juser Oct 5 20:22:34 hsmail dovecot[2142]: auth(default): client out: FAIL 41 user=juser Oct 5 20:22:39 hsmail dovecot[2142]: imap-login: Aborted login (auth failed, 1 attempts): user=<juser>, method=CRAM-MD5, rip=127.0.0.1, lip=127.0.0.1, secured these users were working fine, then poof no access. can someone guide me on how to troubleshoot the dovecot portion. i do have many other users that are fine. -j

2 2

[Dovecot] 2.0.5: deliver crashing
by Ralf Hildebrandt 07 Oct '10

07 Oct '10

>From my log: Oct 6 00:10:36 postamt kernel: [2353838.557216] deliver[2799]: segfault at 48 ip b77dd649 sp bfcf3b48 error 6 in libdovecot-storage.so.0.0.0[b778e000+b8000] Oct 6 00:14:39 postamt kernel: [2354082.014722] deliver[6399]: segfault at 48 ip b7779649 sp bf9ca028 error 6 in libdovecot-storage.so.0.0.0[b772a000+b8000] Oct 6 00:28:12 postamt kernel: [2354894.551201] deliver[13972]: segfault at 48 ip b77a4649 sp bfaa65a8 error 6 in libdovecot-storage.so.0.0.0[b7755000+b8000] Oct 6 00:31:27 postamt kernel: [2355089.844614] deliver[15649]: segfault at 48 ip b77ff649 sp bfee32e8 error 6 in libdovecot-storage.so.0.0.0[b77b0000+b8000] Oct 6 00:31:27 postamt postfix/local[6082]: A396A5CB89: to=<username(a)postamt.charite.de>, relay=local, delay=1.1, delays=0.01/0/0/1, dsn=5.3.0, status=bounced (Command died with status 255: "/usr/bin/maildrop") Please don't ask, I'm still running deliver from /etc/maildroprc, because maildrop is handling vacation message and such. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

3 4

[Dovecot] User authentication fields size limit
by Andre Nathan 06 Oct '10

06 Oct '10

Hello I'm using authentication via SQL, and I'm storing the full mail_location in the database. This is a long string because we're using multiple partitions and hashing to create this path. It looks like this: # doveadm user andre=sneakymustard.com userdb: andre=sneakymustard.com password : $1$ixW87UeD$fLhORaJS0c5wNFmWqfJdI1 mail : mdbox:/var/spool/imap/partition7/11/andre=sneakymustard.com:INDEX=/var/lib/… quota_rule: *:bytes=1024M Depending on the user's email, this string can be even longer. What I've noticed is that it is truncated when it reaches 128 bytes. Could this size limit be increased? Thanks, Andre

2 3

[Dovecot] WITHIN searching broken?
by Michael M. Slusarz 06 Oct '10

06 Oct '10

Using 2.0.5, I see this: [select INBOX] 1 search SINCE 5-Oct-2010 * SEARCH 16 17 18 19 20 21 1 OK Search completed (0.001 secs). 2 search YOUNGER 86400 * SEARCH 2 OK Search completed (0.000 secs). michael

2 1

[Dovecot] dovecot-2.0-pigeonhole-0.2.1 installation in wrong lib dir?
by Wolfgang.Friebel＠desy.de 06 Oct '10

06 Oct '10

I am building dovecot-2.0-pigeonhole-0.2.1 (dovecot-2.0.5, but that does not matter) with dovecot-config in place (in /usr/lib64/dovecot) on a 64bit Linux (RHEL5): ./configure --with-dovecot=/usr/lib64/dovecot The libs needed for several executables in libexec such as /usr/libexec/dovecot/managesieve-login are not installed in /usr/lib64 but in /usr/lib64/dovecot. Therefore the executable will fail to run: ldd /usr/libexec/dovecot/managesieve-login libdovecot-login.so.0 => not found libdovecot.so.0 => not found librt.so.1 => /lib64/librt.so.1 (0x00000032e9600000) libc.so.6 => /lib64/libc.so.6 (0x00000032e8200000) libpthread.so.0 => /lib64/libpthread.so.0 (0x00000032e8e00000) /lib64/ld-linux-x86-64.so.2 (0x00000032e7e00000) To me this looks like a bug in the generated Makefile. I could easily fix that by providing the library path for the loader or by symlinks in /usr/lib64, but this is a workaround only. When doing the fix then managesieve works as expected (tested against my patched websieve using GSSAPI) -- Wolfgang Friebel Deutsches Elektronen-Synchrotron DESY Phone/Fax: +49 33762 77372/216 Platanenallee 6 Mail: Wolfgang.Friebel AT desy.de D-15738 Zeuthen Germany

2 1

[Dovecot] 2.0.5: quota warning failing
by Ralf Hildebrandt 06 Oct '10

06 Oct '10

>From the log: Oct 6 09:54:10 postamt dovecot: imap(hkunte): Error: quota: connect(/usr/local/scripts/quota-warning2) failed: Permission denied >From the config: quota = maildir quota_rule = INBOX.Trash:storage=+2048M quota_warning = storage=99%% /usr/local/scripts/quota-warning2 99 %u quota_warning2 = storage=95%% /usr/local/scripts/quota-warning2 95 %u quota_warning3 = storage=90%% /usr/local/scripts/quota-warning2 90 %u quota_warning4 = storage=85%% /usr/local/scripts/quota-warning2 85 %u service quota-warning { executable = script /usr/local/scripts/quota-warning2 # use some unprivileged user for executing the quota warnings user = vmail unix_listener quota-warning { } } But how exactly does this work? the user vmail cannot write to the users' mailboxes, so I'd have to run /usr/local/scripts/quota-warning2 as root, don't I? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

3 14

[Dovecot] migration 1.2.5 -> 2.0.5 load increased dramatically
by Ralf Hildebrandt 06 Oct '10

06 Oct '10

During norml operation this morning we're seeing a significantly increased load on the IMAP server (factor 5, from 5 to 25). Does dovecot need to rebuild index files or perform other IO intensive operations after the upgrade? We're using Maildir Our monitoring shows increased "system" time. We're runnign fewer processes, the IO rate ist identical to yesterday, memory usage is identical. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

3 13

[Dovecot] Shared folder again !
by Johan Hendriks 06 Oct '10

06 Oct '10

Hello all, First of all sorry for this, it has been discussed many times, but i can not make it work. I tried for a long time now. I do something wrong, but i do not know what. First of all, i have virtual users, with virtual domains. Mail is stored in /usr/local/virtual/domain name/user So if my domain is domain.com and my e-mail address is johan(a)domain.com the directory is /usr/local/virtual/domain.com/johan i followed the wiki, and my configuration looks like the following. beasty dovecot # dovecot -n # 2.0.5: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.1-STABLE amd64 ufs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-acl-sql.conf quotadict = mysql:/usr/local/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_gid = 1004 first_valid_uid = 1004 last_valid_gid = 1004 last_valid_uid = 1004 log_timestamp = .%Y-%m-%d %H:%M:%S . mail_access_groups = vmail mail_debug = yes mail_gid = 1004 mail_location = maildir:/usr/local/virtual/%d/%n mail_uid = 1004 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { inbox = no list = children location = maildir:/usr/local/virtual/%%d/%%n/shared/:INDEX=/shared/%%n prefix = shared/%%d/%%u/ separator = / subscriptions = no type = shared } passdb { args = /usr/local/etc/dovecot/dovecot-mysql.conf driver = sql } plugin { acl = vfile acl_anyone = allow acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autocreate5 = Templates autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts autosubscribe5 = Templates quota = dict:::proxy::quotadict quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2 = storage=80%% /usr/local/bin/quota-warning.sh 80 } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = 192.168.50.200 port = 143 } } service pop3-login { inet_listener pop3 { address = 192.168.50.200 port = 110 } } ssl = no userdb { args = /usr/local/etc/dovecot/dovecot-mysql.conf driver = sql } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k mail_plugins = quota imap_quota autocreate acl imap_acl mail_log notify } protocol pop3 { mail_plugins = quota trash pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = quota acl mail_log notify postmaster_address = postmaster(a)test.com sendmail_path = /usr/local/sbin/sendmail } That is my config file. My dovecot-dict-acl-sql.conf looks like the following connect = host=localhost dbname=postfix user=postfix password=password map { pattern = shared/shared-boxes/$to/$from table = user_shares value_field = dummy fields { from_user = $from to_user = $to } } That is slightly different than the wiki says, if i use that , it gives me an error. the pattern on the wiki looks like this pattern = shared/shared-boxes/users/$to/$from if i login as user johan and set ACL on my INBOX i do it this way. i telnet to the server and issue the following beasty dovecot # telnet 192.168.50.200 143 Trying 192.168.50.200... Connected to beasty.localdomain.local. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN] imap, pop ready a login johan(a)domain.com mypass a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in b SETACL INBOX hans(a)domain.com lr b OK Setacl complete. c GETACL INBOX * ACL "INBOX" "hans(a)domain.com" lr "johan(a)domain.com" lrwstipekxacd c OK Getacl completed. This looks good i guess, also my database is filled, with the from and to ! But i can not see the mailbox if i login as user hans. beasty dovecot # telnet 192.168.50.200 143 Trying 192.168.50.200... Connected to beasty.localdomain.local. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN] imap, pop ready a login hans(a)domain.com hanspass a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in b list "" * * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Junk" * LIST (\HasNoChildren) "/" "Sent" * LIST (\HasNoChildren) "/" "Drafts" * LIST (\HasNoChildren) "/" "Templates" * LIST (\HasNoChildren) "/" "INBOX" b OK List completed. c list "" /shared/* c OK List completed. If been trying this for a very long time now, but can not see what i am missing. It must be something i ovelook, but i really can not find out what. I also tried some other configs from the mailing list, but still the same, no go. Thank you for your time to help another one with this issue. i am a little ashamed :D Regards, Johan Hendriks * *

2 1

[Dovecot] Imap Folder activity detect
by Antonio Perez-Aranda 06 Oct '10

06 Oct '10

Hi all, We are migrating a mail service with 80.000 users, and 40.000 of them are using IMAP. At present, this service is handled by Courier, with some custom patches. And we are migrating to Dovecot 1.2.15. One of these patches is used to interact with Spamassassin. If Courier detects any move/copy operation to the "IsSPAM" or "IsntSPAM" folders, a specific bash script is executed like IsSPAM.sh and IsntSPAM.sh These scripts do the following: IsSPAM.sh 1. Takes user as parameter USER. 2. Retrieves the homeDirectory of USER from ldap, using ldapsearch. 3. Executes /usr/bin/sa-learn --spam ... with IsSPAM folder IsntSPAM.sh 1. Takes user as parameter USER. 2. Retrieves the homeDirectory of USER from ldap, using ldapsearch. 3. Executes /usr/bin/sa-learn --ham ... with IsntSPAM folder 4. Moves all content from IsntSPAM to INBOX I think that it shouldn't be very hard to implement a plugin to detect MOVE/COPY events to specified folders, and to execute specified scripts on detection. Is there already such a plugin for dovecot 1.2.15?

2 2

[Dovecot] 2.0.5: doveadm reload results in dovecot/auth crashing
by Ralf Hildebrandt 06 Oct '10

06 Oct '10

It's not THAT bad, but: GNU gdb (GDB) 7.0.1-debian Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Core was generated by `dovecot/auth'. Program terminated with signal 6, Aborted. #0 0xb7729430 in __kernel_vsyscall () #0 0xb7729430 in __kernel_vsyscall () No symbol table info available. #1 0xb7551751 in ?? () No symbol table info available. (gdb) quit I think my automatic debugger script needs to be fixed. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

1 1

[Dovecot] How to add the missing maildir folders
by Egbert Jan van den Bussche 06 Oct '10

06 Oct '10

Hi fellow list members, What would be the best way to add the .Sent,.Draft, etc. folders to the maildir tree? It seems not Dovecots task to do that but of the MUA. I have seen several options. Use of skel but that works only for new system users. I have only virtual users preloaded in a database. I've discoverred that ONLY Roundcube add the folders (if configured to do that) but I've not been able to have the folders created by Thunderbird. Yes, you can manage the subscribtions to folders but there is no way to create them. I did not bother to try Outlook... MY users use pop3, imap and web (Roundcube) but I cannot ask them to use Roundcube first, just to create the folders. I have no such thing as maildrop, which seems to be able to create folders. Should I run some script during login? How? TIA Egbert Jan (NL)

2 2

[Dovecot] Feature request for maildir style boxes
by David Ford 06 Oct '10

06 Oct '10

greetings, i'd like to ask for a certain feature request. dovecot:maildir_uidlist_recreate() to set the gid of new files based on the parent directory group ownership and normally that's desired, an appropriate security method. on our server, we use directory permissions to more stringently isolate access between users and services. we have three group ids used for this, and i'll use my name as example. Oct 05 13:44:30 imap(david): Error: fchown(/home/david/.maildir/dovecot-uidlist.tmp, -1, 497(net-mail)) failed: Operation not permitted (egid=1234(david), group based on /home/david/.maildir) Colt log # ls -ld /home/ /home/david /home/david/public_html/ /home/david/.maildir /home/david/.maildir/cur|awk '{printf "%s %5s %9s %s\n", $1,$3,$4,$9}' drwxr-xr-x root root /home/ drwx--x--- david net-all /home/david drwxr-x--- david net-mail /home/david/.maildir drwx------ david david /home/david/.maildir/cur drwxr-x--- david net-web /home/david/public_html/ the purpose of this is to prevent undesired access to personal files. users cannot 'cd' or 'ls' in other user's home directories, mail stores, or web files. apache, procmail, dovecot et cetera, are in the appropriate groups and therefore have access needed to do file ops. however, they're limited to their appropriate stores. as mentioned at the beginning, dovecot tries to match the gid of the parent directory for new files and normally, that's desired and expected behavior, but in our case. dovecot creates the file as uid/gid of the user, so the knob can either ignore the failure to set gid per the parent and not log it, or not attempt to set the gid per parent in the first place. src/lib-storage/index/maildir/maildir-uidlist.c 1412: if (box->file_create_gid != (gid_t)-1 && fchown(fd, (uid_t)-1, box->file_create_gid) < 0) { if (errno == EPERM) { mail_storage_set_critical(box->storage, "%s", eperm_error_get_chgrp("fchown", temp_path, box->file_create_gid, box->file_create_gid_origin)); } else { mail_storage_set_critical(box->storage, "fchown(%s) failed: %m", temp_path); } } to something like: ( "new_files_inherit_parent_gid = true" ) if (box->file_create_gid != -1 && --> box->new_files_inherit_parent_gid) { fchown(fd, -1, box->file_create_gid) ... } bool new_files_inherit_parent_gid [default true] could be added the following for example: src/lib-storage/mailbox-list-private.h:struct mailbox_list src/lib-storage/mail-storage-private.h:struct mailbox this block of code appears in similar instances for a number of other occasions (and could be made a more global function), but not all files in ~/.maildir/* appear to use a function like this. the uidvalidity functions are a little different for example. == for a busy mail server, that's a lot of excess logging and pollution when trying to review nightly logs for issues :) thank you for the consideration, -david

3 10

[Dovecot] Startup error dovecot-2.0.5
by Ralf Hildebrandt 06 Oct '10

06 Oct '10

When starting 2.0.5, I'm getting: # /usr/dovecot-2/sbin/dovecot -F doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (12288) doveconf: Fatal: execvp(/usr/dovecot-2/sbin/dovecot) failed: Argument list too long Argument list too long? WTF? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

4 20

[Dovecot] (no subject)
by fakessh 06 Oct '10

06 Oct '10

hi folks hi timo , is a good day for you I use a double deliverance root and user i use lda deliver dovecot authentification and since the switch to 2.0.4 I encounter the problem that the box Maildir root for the name of the INBOX after passing sieve is the type root(a)nsXXXX.ovh.net how to correct the problem Timo your lights -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7 gpg --keyserver pgp.mit.edu --recv-key 092164A7

3 4

[Dovecot] Force index 2.04
by Henrique Fernandes 06 Oct '10

06 Oct '10

Hey, i am gonna migrate 240 GB of emails. To a new server with dovecot 2.0.4 and i am gonna also change the format from mbox to maildir. Everything is pretty ready. But i now need two things. First is, is there any command to rebuild index files in dovecot ? And i need to force a initial squat build, need comand for it also. It is about 5 thousands accounts. Its prefere have this built in dovecot than run a script that log in every sing account to make dovecot index the files, and after it make a small search to make initial squat also. Any one can help ? []'sf.rique

3 10

Re: [Dovecot] How to add the missing maildir folders
by interfaSys sàrl 06 Oct '10

06 Oct '10

Looks like it's also possible to use doveadm http://wiki2.dovecot.org/Tools/Doveadm/Mailbox

1 0