- dovecot - dovecot.org

[Dovecot] login_* options for 1.0.15
by Hugo Monteiro 10 Oct '10

10 Oct '10

Hello all, Although i'm aware that version 1.0.15 is rather old, that's what is used in Lenny, so... Either way, the setup is rather simple, regular dovecot install, with maildirs residing on a "local" ext3 filesystem accessed through FC to a SAN (2Gbps link). The server has 2 cores (with HT), so "almost" 4 cores and 3GB of ram. A couple weeks ago we had a major number of account migrations, from POP to IMAP. We started to notice that in times of peaks, specially after lunch hour, dovecot started to get REALLY slow and closing client connections. A restart to the service was enough to get things working again. Firstly i thought about the max fd number per process, but after checking it turned out it was already rather large, 8192 in our case. I cannot observe any concerning I/O load either. Besides upgrading, are there any suggestions? Regards, Hugo Monteiro. -- fct.unl.pt:~# cat .signature Hugo Monteiro Email : hugo.monteiro(a)fct.unl.pt Telefone : +351 212948300 Ext.15307 Web : http://hmonteiro.net Divisão de Informática Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa Quinta da Torre 2829-516 Caparica Portugal Telefone: +351 212948596 Fax: +351 212948548 www.fct.unl.pt apoio(a)fct.unl.pt fct.unl.pt:~# _

4 5

[Dovecot] Visible temp files as Imap Folder in INBOX
by Antonio Perez-Aranda 10 Oct '10

10 Oct '10

Hi all, I'm using dovecot-1.2.15 and NFS as storage of Maildir . When I try over IMAP and Evolution to move a mail to another Imap Folder, a file like .nfs000000000159816c0000245 is created and when move operation is finished, the file is deleted. Sometimes, this file isn't deleted and then, you can see a new imap folder called .nfs000000000159816c0000245 when you restart your Evolution or another Imap Client. Is this file created by dovecot? maybe, must dovecot delete this file on login? I think thats is easy fix this with a Post-Login script but I think that dovecot must delete it

5 5

[Dovecot] Why do these keep showing up?
by Brandon Lamb 10 Oct '10

10 Oct '10

2010-10-08 14:37:29 imap <hmarie(a)olypen.com>: Error: Mailbox Removed: Expunged GUID mismatch for UID 1257: ceb413227b55e8aa14cf86ec86f2b652 vs 32b06aa8bc66762bbd6af15228072949 I keep getting a bunch of these, which turn out to be "customer cant delete messages from folder X". I just deleted all dovecot indexes (find -name dovecot* -type f -delete) from all users this morning and this is still happening. Any ideas? Using maildir format

2 2

[Dovecot] Segfault in dovecot-lda 2.0.5
by Sean Cardus 10 Oct '10

10 Oct '10

Hi, I've recently started using dovecot-lda to handle my local maildir deliveries from Exim. Unfortunately I've been experiencing the occasional failed delivery - My Exim logs were showing: Child process of virtual_dovecot_delivery transport (running command "/usr/local/libexec/dovecot/dovecot-lda -d $local_part@$domain -f $sender_address -a $original_local_part@$original_domain") was terminated by signal 11 (Segmentation fault) I originally thought a specific mail was causing the crash, but calling the command myself delivered the mail without any issues. However, I found if I ran a script that delivered the same mail 10 times, I could reliably cause multiple segfaults all with the following backtrace: #0 0x005581e9 in maildir_sync_set_new_msgs_count (ctx=0x0, count=1) at maildir-sync-index.c:50 No locals. #1 0x0055f3c0 in maildir_save_move_files_to_newcur (_ctx=0x85afe60) at maildir-save.c:857 files = {arr = {buffer = 0x8555a08, element_size = 4}, v = 0x8555a08, v_modifiable = 0x8555a08} mfp = 0x8555a2c new_changed = false mf = 0x85affa8 newdir = true #2 maildir_transaction_save_commit_pre (_ctx=0x85afe60) at maildir-save.c:951 _data_stack_cur_id = 3 ctx = <value optimized out> _t = 0x85af500 sync_flags = <value optimized out> ret = <value optimized out> __FUNCTION__ = "maildir_transaction_save_commit_pre" #3 0x00555e8f in index_transaction_index_commit (index_trans=0x85af540, result_r=0xbfd78510) at index-transaction.c:27 it = 0x85af500 ibox = 0x858a108 ret = <value optimized out> __FUNCTION__ = "index_transaction_index_commit" #4 0x00595c11 in mail_index_transaction_commit_full (_t=0xbfd78528, result_r=0xbfd78510) at mail-index-transaction.c:237 t = 0x85af540 index = 0x85835e0 index_undeleted = false #5 0x00556284 in index_transaction_commit (t=0x85af500, changes_r=0xbfd785a8) at index-transaction.c:123 box = 0x8589ef0 itrans = 0x0 result = {log_file_seq = 0, log_file_offset = 0, commit_size = 0, ignored_modseq_changes = 0} ret = <value optimized out> #6 0x00533122 in mailbox_transaction_commit_get_changes (_t=0xbfd785d4, changes_r=0xbfd785a8) at mail-storage.c:1215 _data_stack_cur_id = 2 t = 0x85af500 ret = <value optimized out> #7 0x00a7eaef in mail_deliver_save (ctx=0xbfd786f8, mailbox=0x804ab55 "INBOX", flags=0, keywords=0x0, storage_r=0xbfd78794) at mail-deliver.c:219 open_ctx = {user = 0x85781b0, lda_mailbox_autocreate = false, lda_mailbox_autosubscribe = false} box = 0x8589ef0 trans_flags = <value optimized out> t = 0x0 save_ctx = 0x0 kw = 0x0 error = MAIL_ERROR_NONE mailbox_name = 0x804ab55 "INBOX" errstr = <value optimized out> changes = {pool = 0x85b5998, uid_validity = 0, saved_uids = {arr = {buffer = 0x85b59a8, element_size = 8}, v = 0x85b59a8, v_modifiable = 0x85b59a8}, ignored_modseq_changes = 0} range = <value optimized out> ret = 0 __FUNCTION__ = "mail_deliver_save" #8 0x00a7edf8 in mail_deliver (ctx=0xbfd786f8, storage_r=0xbfd78794) at mail-deliver.c:289 ret = -1 #9 0x0804a124 in main (argc=139843496, argv=0x855d1b8) at main.c:429 set_roots = {0x804b390, 0x0} ctx = {pool = 0x855d7a8, set = 0x855ef48, dup_ctx = 0x0, session_id = 0x0, src_mail = 0x85856e0, src_envelope_sender = 0x855d7b8 "sean(a)cardus.com", dest_user = 0x85781b0, dest_addr = 0x855d228 "sean(a)cardus.com", final_dest_addr = 0x855d228 "sean(a)cardus.com", dest_mailbox_name = 0x804ab55 "INBOX", dest_mail = 0x0, tried_default_save = true, saved_mail = false, save_dest_mail = false} service_flags = 1027 user = 0x1 <Address 0x1 out of bounds> errstr = <value optimized out> path = 0x0 storage_service = 0x855e3b0 service_user = 0x855ec70 service_input = {module = 0x804ab3c "lda", service = 0x804ab3c "lda", username = 0x855d202 "sean(a)cardus.com", local_ip = {family = 0, u = {ip6 = {in6_u = { u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = { ip6 = {in6_u = {u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, userdb_fields = 0x0} raw_mail_user = 0x857c1b8 raw_ns = 0x8571ea8 raw_ns_set = {name = 0x0, type = 0x0, separator = 0x0, prefix = 0x0, location = 0x804abd9 ":LAYOUT=none", alias_for = 0x0, inbox = false, hidden = false, list = 0x0, subscriptions = false, user_set = 0x0} storage = <value optimized out> box = 0x85801c0 raw_box = <value optimized out> input = 0x0 t = 0x8584d90 headers_ctx = 0x0 user_source = 0x804ab2c "" sets = <value optimized out> process_euid = <value optimized out> stderr_rejection = false mtime = -1 ret = <value optimized out> c = <value optimized out> error = <value optimized out> Any ideas? Thanks in advance, Sean

2 2

[Dovecot] migrate machines and upgrade
by Donny Brooks 08 Oct '10

08 Oct '10

I am about to be migrating mail servers and have a few questions. First a little background: Old mail server: Fedora 11 dovecot-1.2.11-3.fc11.x86_64 installed from yum repo mbox mail format OpenLDAP authentication 250+ users New mail server: Fedora 13 dovecot-2.0.1-1_118.fc13.x86_64 installed from atrpm rpm file Maildir mail format OpenLDAP authentication 250+ users I plan to use dsync on the new machine to migrate the mail off the old machine and mbox format to the new machine and Maildir. I think I read where I can do the migration without interfering with normal mail delivery and then when i get ready to do the final move I just kill dovecot on the old machine, dsync once more, and start the service on the new machine. What would be the best way to accomplish this? And as for the configuration changed between 1.2.11 and 2.0.1, where to start? I see there is now a conf.d directory for 2.0.1. How will this tie in to the 1.2.11 config? Any pointers there? Other option is to move the mbox mail as it sits to the new machine, install 1.2.X branch dovecot on new machine, and let the convert plugin do all the work. However I like the idea of the dsync doing the sync with minimal downtime. Thanks in advance. -- Donny B.

5 12

[Dovecot] 2.0.5: dovecot/auth crash upon reload (with backtrace)
by Ralf Hildebrandt 08 Oct '10

08 Oct '10

I can reproduce this by simply issuing: doveadm reload GNU gdb (GDB) 7.0.1-debian Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/dovecot-2/libexec/dovecot/auth...done. Reading symbols from /usr/dovecot-2/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/dovecot-2/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/i686/cmov/libcrypt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libcrypt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libcrypt.so.1 Reading symbols from /lib/libpam.so.0...(no debugging symbols found)...done. Loaded symbols for /lib/libpam.so.0 Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/i686/cmov/librt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/librt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/librt.so.1 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/i686/cmov/libpthread-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libpthread.so.0 Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `dovecot/auth'. Program terminated with signal 6, Aborted. #0 0xb772e430 in __kernel_vsyscall () #0 0xb772e430 in __kernel_vsyscall () No symbol table info available. #1 0xb7556751 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1217994764 selftid = 22112 #2 0xb7559b82 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0xbfdc3ed0, sa_sigaction = 0xbfdc3ed0}, sa_mask = {__val = {3077757632, 3218882212, 3077800674, 3218882196, 3077323828, 3218882184, 3077880404, 0, 3075510304, 1, 0, 1, 3077757192, 3218882108, 3218882104, 3077532336, 3077526747, 3077739624, 3218882188, 166684304, 0, 3218882256, 3218882184, 3218882196, 3077532029, 3077757192, 0, 725, 3218882216, 3077348830, 3218882188, 10}}, sa_flags = -1076084988, sa_restorer = 0xb772a70c <pid.3601>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0xb76f7695 in default_fatal_finish (type=<value optimized out>, status=<value optimized out>) at failures.c:178 backtrace = 0x9ef6280 "/usr/dovecot-2/lib/dovecot/libdovecot.so.0(+0x37681) [0xb76f7681] -> /usr/dovecot-2/lib/dovecot/libdovecot.so.0(+0x376ef) [0xb76f76ef] -> /usr/dovecot-2/lib/dovecot/libdovecot.so.0(i_error+0) [0xb76d1"... #4 0xb76f76ef in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x806bca4 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfdc3f84 "\017\314\006\bc") at failures.c:607 No locals. #5 0xb76d15de in i_panic ( format=0x806bca4 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:244 No locals. #6 0x080578e0 in auth_request_handler_unref (_handler=0xbfdc3fdc) at auth-request-handler.c:99 handler = 0xa0384f8 __FUNCTION__ = "auth_request_handler_unref" #7 0x08058129 in auth_request_handler_destroy (_handler=0x6) at auth-request-handler.c:117 handler = 0x0 __FUNCTION__ = "auth_request_handler_destroy" #8 0x080516f0 in auth_client_connection_destroy_full ( _conn=<value optimized out>, abort_requests=<value optimized out>) at auth-client-connection.c:355 conn = 0x9fe3bf8 clients = 0x9f82ba8 #9 0x080517b1 in auth_client_connections_deinit () at auth-client-connection.c:407 i = 2 #10 0x0805c1bf in main_deinit (argc=1, argv=0x9efe1c0) at main.c:166 No locals. #11 main (argc=1, argv=0x9efe1c0) at main.c:284 c = <value optimized out> -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

1 0

[Dovecot] pop3-login no longer segfaults with gcc4.5.2 and gold :)
by interfaSys sàrl 08 Oct '10

08 Oct '10

Hello, I reported a while back that it wasn't possible to compile the whole of Dovecot using gcc 4.5.2 and the new gold linker, but it's now working with recent snapshots of both binutils and GCC. Cheers, Olivier

1 0

[Dovecot] Significant performance problems
by Chris Hobbs 07 Oct '10

07 Oct '10

Hi all, I'm sure my issues are a result of misconfiguration, but I'm hoping someone can point me in the right direction. I'm getting pressure to move us back to GroupWise, which I desperately want to avoid :-/ We're running dovecot 1.2.9 on Ubuntu 10.4 LTS+postfix. The server is a VM with 1 vCPU and 4GB of RAM. We serve about 10,000 users with anywhere from 500-1000 logged in at any one time. Messages are stored in Maildir format on two NFS servers (one for staff, the other for students). Today I implemented the "High performance" setup described here: http://wiki.dovecot.org/NFS (mainly moving indexes off of NFS, since I'm only using the one server). I also added imapproxy to our webmail client server (SOGo). The vast majority of our users come in over the web. We currently see load averages spiking into the 20-30 range. When this happens, service crawls to a near standstill, and ultimately the SOGo client starts crashing out. I'm wondering if anything jumps out at anybody here - feel free to mock if/when you find an obvious configuration problem. I just want it to work :-) dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-25-server x86_64 Ubuntu 10.04.1 LTS log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_cert_file: /etc/dovecot/certs/mail_nhusd_k12_ca_us.crt ssl_key_file: /etc/dovecot/certs/mail_nhusd_k12_ca_us.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_process_size: 512 login_processes_count: 20 login_max_processes_count: 3000 login_max_connections: 64 max_mail_processes: 2048 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_access_groups: staffmailusers mail_privileged_group: dovecot mail_uid: mail mail_gid: 502 mail_location: maildir:~/Maildir:INDEX=/var/indexes/%u mail_nfs_storage: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): acl imap_acl quota imap_quota expire mail_plugins(imap): acl imap_acl quota imap_quota expire mail_plugins(pop3): mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: shared/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u list: children lda: deliver_log_format: %$ -- FROM=%f SUBJECT=%s mail_plugins: cmusieve acl expire log_path: info_log_path: syslog_facility: mail postmaster_address:postmaster@nhusd.k12.ca.us hostname: mail.nhusd.k12.ca.us auth_socket_path: /var/run/dovecot/auth-master auth default: passdb: driver: pam passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: maildir:User quota quota_rule: *:storage=9G quota_rule2: Trash:storage=200M acl: vfile acl_shared_dict:file:/home/staff/dovecot/shared-mailboxes expire: Trash 7 Trash/* 7 Spam 30 expire_dict: proxy::expire sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_extensions: +imapflags dict: expire: mysql:/etc/dovecot/dovecot-dict-expire.conf -- Chris Hobbs Director, Technology New Haven Unified School District -- This message was scanned by ESVA and is believed to be clean.

7 11

[Dovecot] And again... too many open files
by Joseba Torre 07 Oct '10

07 Oct '10

Hi! Two days ago I upgraded to 1.2.15, and again I the warning "Warning: fd limit 1024 is lower than what Dovecot can use under full load" reappeared. It's a bit weird, because my actual limits are higher. From /etc/security/limits.conf * soft nofile 4096 * hard nofile 8192 root soft nofile 4096 root hard nofile 8192 dovecot soft nofile 4096 dovecot hard nofile 8192 I added the * lines to avoid problems if a new user was involved, and finally supposed it was a bug in the detection process. Today, as expected, dovecot was not responding with the famous "Too many open files" error. Has something changed? Is there some way to know which is the maximum number of files that can be open? Is there some parameter I can change to avoid this? Here's my dovecot -n # 1.2.15: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-164.11.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.4 (Tikanga) syslog_facility: local1 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /usr/share/ssl/certs/imapd.pem ssl_key_file: /usr/share/ssl/certs/imapd.pem disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_process_per_connection: no login_process_size: 256 login_processes_count: 16 login_max_processes_count: 256 login_max_connections: 512 max_mail_processes: 2048 first_valid_uid: 100 mail_location: maildir:~/Maildir:INDEX=/var/dovecot/%u:CONTROL=/var/dovecot nas/%u/control mail_nfs_storage: yes lock_method: dotlock mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: cache_size: 1000 cache_ttl: 6000 master_user_separator: * debug: yes passdb: driver: passwd-file args: /usr/local/etc/bloqueados deny: yes passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf passdb: driver: passwd-file args: /usr/local/etc/shadow passdb: driver: pam passdb: driver: passwd-file args: /usr/local/etc/dovecot-master.conf master: yes userdb: driver: prefetch userdb: driver: passwd-file args: /usr/local/etc/passwd userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs -- Joseba Torre. Vicegerencia de TICs, área de Explotación

3 6

[Dovecot] dovecot-1.2.12 core
by Thomas Hummel 07 Oct '10

07 Oct '10

Hi Timo, just to report that . dovecot-1.2.12 which ran fine for several month . on FreeBSD 7.2-STABLE (/usr/obj/usr/src/sys/GENERIC amd64) . using Maildir (mailboxes, control and indexes on NFS) has crashed this morning on our server. I found nothing special in the logfile. Attached are dovecot -n output and a gdb backtrace of the core file. Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

1 0