- dovecot - dovecot.org

IMAP child killed with signal 11
by Simon Lawrence 20 Nov '14

20 Nov '14

Hello, We’re running a cluster of dovecot servers for a large amount of users. It’s been working pretty well except we are seeing occasional fatal error messages. Here is a sample error message that we are seeing: Nov 20 19:51:29 ip-10-238-11-11 dovecot: imap(<USER_HERE>): Fatal: master: service(imap): child 796 killed with signal 11 (core dumped) We are running dovecot 2.2.9 installed from apt-get on Ubuntu 14.04. I’ve checked out the core dump and here is the stack trace: Core was generated by `dovecot/imap [e22a36135b5f40'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007f83d63aa757 in mail_transaction_log_view_mark (view=0x7f83d804f8c0) at mail-transaction-log-view.c:794 794 mail-transaction-log-view.c: No such file or directory. (gdb) bt #0 0x00007f83d63aa757 in mail_transaction_log_view_mark (view=0x7f83d804f8c0) at mail-transaction-log-view.c:794 #1 0x00007f83d63a3796 in view_sync_have_expunges (view=0x7f83d804f7e0) at mail-index-view-sync.c:223 #2 mail_index_view_sync_begin (view=0x7f83d804f7e0, flags=flags@entry=MAIL_INDEX_VIEW_SYNC_FLAG_NOEXPUNGES) at mail-index-view-sync.c:583 #3 0x00007f83d6382168 in index_mailbox_sync_init (box=box@entry=0x7f83d8049f80, flags=flags@entry=(MAILBOX_SYNC_FLAG_FAST | MAILBOX_SYNC_FLAG_NO_EXPUNGES), failed=<optimized out>) at index-sync.c:226 #4 0x00007f83d632983b in maildir_storage_sync_init (box=0x7f83d8049f80, flags=(MAILBOX_SYNC_FLAG_FAST | MAILBOX_SYNC_FLAG_NO_EXPUNGES)) at maildir-sync.c:1120 #5 0x00007f83d6356cf9 in mailbox_sync_init (box=box@entry=0x7f83d8049f80, flags=flags@entry=(MAILBOX_SYNC_FLAG_FAST | MAILBOX_SYNC_FLAG_NO_EXPUNGES)) at mail-storage.c:1668 #6 0x00007f83d6835e5e in imap_sync_init (client=client@entry=0x7f83d8046b60, box=<optimized out>, imap_flags=(unknown: 0), flags=(MAILBOX_SYNC_FLAG_FAST | MAILBOX_SYNC_FLAG_NO_EXPUNGES)) at imap-sync.c:230 #7 0x00007f83d6836af0 in cmd_sync_client (sync_cmd=0x7f83d8047760) at imap-sync.c:739 #8 cmd_sync_delayed_real (client=0x7f83d8046b60) at imap-sync.c:877 #9 cmd_sync_delayed (client=client@entry=0x7f83d8046b60) at imap-sync.c:885 #10 0x00007f83d682db61 in client_handle_input (client=client@entry=0x7f83d8046b60) at imap-client.c:906 #11 0x00007f83d682de35 in client_input (client=0x7f83d8046b60) at imap-client.c:933 #12 0x00007f83d608c247 in io_loop_call_io (io=0x7f83d8047660) at ioloop.c:388 #13 0x00007f83d608cfd7 in io_loop_handler_run (ioloop=ioloop@entry=0x7f83d8030760) at ioloop-epoll.c:220 #14 0x00007f83d608bde8 in io_loop_run (ioloop=0x7f83d8030760) at ioloop.c:412 #15 0x00007f83d603cc93 in master_service_run (service=0x7f83d80305f0, callback=<optimized out>) at master-service.c:566 #16 0x00007f83d68222f4 in main (argc=2, argv=0x7f83d8030390) at main.c:400 Here are the settings we’re running (I’ve removed our domain and path information): # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-24-generic x86_64 Ubuntu 14.04.1 LTS auth_mechanisms = plain login base_dir = /var/run/dovecot/ default_client_limit = 1024 default_process_limit = 256 default_vsz_limit = 1 G disable_plaintext_auth = no mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = " imap lmtp pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap-postlogin { executable = script-login /real/location/to/the/script.sh user = vmail } service imap { client_limit = 1 executable = imap imap-postlogin process_limit = 65536 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } service_count = 0 } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lmtp { hostname = real.domain.here postmaster_address = postmaster(a)real.domain.here } This seems like some sort of bug within dovecot since we’re seeing a seg fault, but any help would be appreciated. Thanks!

1 0

Mailing list test
by Timo Sirainen 20 Nov '14

20 Nov '14

Apparently this list has somehow broken.. Not really sure what the problem is, lets see what happens to this mail.

4 4

Test
by Jorge Bastos 20 Nov '14

20 Nov '14

Test msg, nock nock dovecot list?

1 0

indexes with ocfs2
by Eduardo Ramos 20 Nov '14

20 Nov '14

Hi guys! I'm having performance issues with my dovecot+ocfs2 environment, so I'm thinking about some changes. Now, I have mail store and indexes stored in a iscsi-ocfs2 volume with that options: mmap_disable = yes dotlock_use_excl = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes lock_method = dotlock I want to change indexes to local volume ext4 and do this: mmap_disable = no mail_nfs_index = no Could it cause some problem? Thanks.

1 0

High I/O wait with Dovecot POP3
by Frido Otten 20 Nov '14

20 Nov '14

Hello, In the past we've had 4 loadbalanced servers configured with courier pop3 and dovecot handling respectively POP3 and IMAP connections. These 4 servers have a shared NFS storage on a Netapp FAS3220 controller with SAS disks. This setup is handling 50 POP3 sessions per second without any problems. Now we're installing 6 new loadbalanced servers to do the same job on the same storage, but using Dovecot to handle the POP3 sessions instead of Courier. The IMAP sessions are already handled by those 6 new servers, but we're encountering high iowait issues when using POP3 on those servers. I've applied the hints from http://wiki2.dovecot.org/NFS but this had no improvement. The 6 new servers are quad core Intel(R) Xeon(R) CPU X3323 @ 2.50GHz, with 4 GB RAM connected with gigabit ethernet connection to the storage. The 4 old servers are single core (w/o HT) P4 2,8 GHz with 1 GB RAM. # dovecot --version 2.1.7 # /usr/sbin/dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686-bigmem i686 Debian 6.0.10 ext4 auth_cache_negative_ttl = 0 auth_cache_size = 8 k auth_mechanisms = plain digest-md5 cram-md5 login base_dir = /var/run/imap/ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no login_greeting = Dovecot MX. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_fsync = always mail_location = maildir:/var/spool/mail/%1u/%1.1u/%u mail_nfs_index = yes mail_nfs_storage = yes maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = separator = . type = private } namespace { list = children location = maildir:/var/spool/mail/%%1u/%%1.1u/%%u/:INDEX=/var/spool/mail/%1u/%1.1u/%u/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql-auth.conf driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl quota = maildir quota_rule2 = Trash:storage=+25M } protocols = imap service anvil { client_limit = 4614 } service auth { client_limit = 2560 executable = /usr/lib/dovecot/auth unix_listener auth-master { mode = 0600 user = exim } user = dovecot } service dict { unix_listener dict { group = exim mode = 0660 user = exim } } service imap-login { chroot = login client_limit = 2048 executable = /usr/lib/dovecot/imap-login inet_listener imap { address = *, :: port = 143 } inet_listener imaps { address = *, :: port = 993 } process_limit = 2048 process_min_avail = 3 service_count = 0 user = dovecot vsz_limit = 128 M } service imap { executable = /usr/lib/dovecot/imap process_limit = 2048 } service managesieve-login { chroot = login client_limit = 2048 process_limit = 2048 process_min_avail = 3 service_count = 0 user = dovecot vsz_limit = 128 M } service managesieve { process_limit = 2048 } service pop3-login { chroot = login client_limit = 512 inet_listener pop3 { address = 1.2.3.4 port = 110 } inet_listener pop3s { address = 1.2.3.4 port = 0 } process_limit = 512 process_min_avail = 3 service_count = 0 user = dovecot vsz_limit = 128 M } service pop3 { process_limit = 2560 } ssl_cert = </etc/ssl/certs/wildcardcertificate.crt ssl_key = </etc/ssl/private/wildcardcertificate.key syslog_facility = local7 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql-auth.conf driver = sql } protocol imap { mail_plugins = quota imap_quota acl imap_acl } protocol pop3 { pop3_uidl_format = %v.%u } protocol lda { auth_socket_path = /var/run/imap/auth-master info_log_path = /var/log/dovecot-deliver.log log_path = /var/log/dovecot-deliver.log mail_plugins = sieve quota postmaster_address = Mailer-Daemon(a)mx.domain.nl rejection_reason = Your message with subject "%s" was automatically rejected:%n%r sendmail_path = /usr/sbin/exim } Best regards, Frido

3 3

redis dict auth and default_fields
by brd 20 Nov '14

20 Nov '14

Hi all, i'm trying to configure default_fields with redis dict (allow_nets, proxy, ...) but it seems that the properties defined are not used even if they appear on output of doveconf. It is a known behaviour? Does default_fields works only for ldap db? I have a director+NFS environment and with dict passdb i'have to put proxy=y for every entry in pass/userdb; to limit the redis memory footprint it should be cool if the proxy=y can be configured as a default_field. It is a limit of using dict for pass/userdb cause using SQL you can manage it as a SELECT fixed field, using LDAP you can manage with default_fields but with dict you are forced to put all inside the db entries. doveconf output: [...] passdb { args = /etc/dovecot/dovecot-dict-auth.conf.ext default_fields = proxy=y driver = dict } [...] Regards -brd

1 0

Dovecot auth process repeatedly crashes on OS X Server 10.9
by James Reynolds 19 Nov '14

19 Nov '14

My dovecot/auth process crashes several times a minute, sometimes at the same second, sometimes randomly. I’ve turned on auth_debug and been pouring over everything trying to see if I can see what is going on but I can’t find anything. I’m running OS X Server 10.9 and dovecot 2.2.5. I can’t say for sure, but it looks to me like the crashed process doesn’t even save anything to mail-debug.log before it crashes. It takes about 2 seconds for it to come up. Once it crashed about 10 times in 2 seconds. Can anyone give me any ideas where I should look? Here are relevant portions from logs: mail-info.log Nov 06 17:19:10 pop3-login: Info: Aborted login (auth process communication failure): user=<>, method=DIGEST-MD5, rip=155.101.106.229, lip=10.0.0.128, TLS mail-err.log Nov 06 17:19:10 pop3-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=66114, EOF) Nov 06 17:19:10 auth: Fatal: master: service(auth): child 66100 killed with signal 11 (core dumps disabled) It looks exactly like what is discussed here: https://discussions.apple.com/thread/6482632?start=0&tstart=0 I do have clients using Outlook. I haven’t run wireshark or tried to verify it is Outlook by testing different clients. postconf -n # 2.2.5: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 13.3.0 x86_64 hfs auth_mechanisms = cram-md5 digest-md5 plain login auth_realms = biomail.biology.utah.edu auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n debug_log_path = /Library/Logs/Mail/mail-debug.log default_internal_user = _dovecot default_login_user = _dovenull first_valid_gid = 6 first_valid_uid = 6 imap_id_log = * imap_id_send = "name" * "version" * imap_urlauth_submit_user = submit info_log_path = /Library/Logs/Mail/mail-info.log log_path = /Library/Logs/Mail/mail-err.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mail mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict mail_location = maildir:/Library/Server/Mail/Data/mail/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib acl fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M namespace acl-mailboxes { list = children location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace list-archives { list = children location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/messages/archive/shared/%%u prefix = archives.%%u. separator = . subscriptions = no type = shared } passdb { driver = od } passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } plugin { acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)biology.utah.edu protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 } service indexer-worker { user = _dovecot } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = _dovecot } } ssl_ca = </etc/certificates/biomail.biology.utah.edu.CE3811751089890AEEC60B91DF2C083EE1BAD5EB.chain.pem ssl_cert = </etc/certificates/biomail.biology.utah.edu.CE3811751089890AEEC60B91DF2C083EE1BAD5EB.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/biomail.biology.utah.edu.CE3811751089890AEEC60B91DF2C083EE1BAD5EB.key.pem ssl_key_path = /etc/certificates/biomail.biology.utah.edu.CE3811751089890AEEC60B91DF2C083EE1BAD5EB.key.pem userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } userdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib acl fts fts_sk sieve } protocol lda { mail_plugins = quota zlib acl fts fts_sk sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota zlib acl fts fts_sk imap_acl imap_quota imap_zlib } protocol pop3 { mail_max_userip_connections = 6 } Here’s part of a crash report: Process: auth [60325] Path: /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/auth Identifier: auth Version: 294 Code Type: X86-64 (Native) Parent Process: dovecotd [149] Responsible: dovecotd [149] User ID: 214 Date/Time: 2014-11-06 16:34:20.777 -0700 OS Version: Mac OS X 10.9.4 (13E28) Report Version: 11 Anonymous UUID: 9EB07E95-1536-96FA-A8C7-3784045DCDDE Crashed Thread: 0 Dispatch queue: com.apple.main-thread Exception Type: EXC_BAD_ACCESS (SIGSEGV) Exception Codes: KERN_INVALID_ADDRESS at 0x0000000000000000 VM Regions Near 0: --> __TEXT 0000000103b39000-0000000103b6a000 [ 196K] r-x/rwx SM=COW /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/auth Thread 0 Crashed:: Dispatch queue: com.apple.main-thread 0 libsystem_c.dylib 0x00007fff8a181732 strlen + 18 1 libdovecot.0.dylib 0x0000000103bdc2b8 vstrconcat + 72 Thread 1: 0 libsystem_kernel.dylib 0x00007fff858f9e6a __workq_kernreturn + 10 1 libsystem_pthread.dylib 0x00007fff89901f08 _pthread_wqthread + 330 2 libsystem_pthread.dylib 0x00007fff89904fb9 start_wqthread + 13 Thread 2:: Dispatch queue: com.apple.libdispatch-manager 0 libsystem_kernel.dylib 0x00007fff858fa662 kevent64 + 10 1 libdispatch.dylib 0x00007fff8808f421 _dispatch_mgr_invoke + 239 2 libdispatch.dylib 0x00007fff8808f136 _dispatch_mgr_thread + 52 Thread 3: 0 libsystem_kernel.dylib 0x00007fff858f9e6a __workq_kernreturn + 10 1 libsystem_pthread.dylib 0x00007fff89901f08 _pthread_wqthread + 330 2 libsystem_pthread.dylib 0x00007fff89904fb9 start_wqthread + 13 Thread 0 crashed with X86 Thread State (64-bit): rax: 0x00007fff5c0c6878 rbx: 0x0000000000000001 rcx: 0x0000000000000001 rdx: 0x0000000000000001 rdi: 0x0000000000000000 rsi: 0x0000000103b6354d rbp: 0x00007fff5c0c6800 rsp: 0x00007fff5c0c6800 r8: 0x0000000103b6354e r9: 0x0000000000000000 r10: 0x00007fff8a1c92a8 r11: 0x00007fb60dca54c3 r12: 0x0000000000000028 r13: 0x00007fff5c0c6920 r14: 0x0000000000000028 r15: 0x0000000000000009 rip: 0x00007fff8a181732 rfl: 0x0000000000010246 cr2: 0x0000000000000000 Logical CPU: 0 Error Code: 0x00000004 Trap Number: 14

1 1

Handle of "subscription" file/folder for IMAP
by Jorge Bastos 19 Nov '14

19 Nov '14

Hi, For IMAP users, there's the subscription file in the user's home, and if I try to subscribe more imap folders that are invisible, there's that one, but as it is a file, nothing is supposed to happen. Is there an way to, allow users to create the "subscriptions" folder without any collision, or just deny or don't show this file as an possible folder (which Is not) to subscribe. What does people normally do? Thanks in advanced,

1 0

"subscription" file/folder for IMAP
by Jorge Bastos 19 Nov '14

19 Nov '14

Hi, For IMAP users, there's the subscription file in the user's home, and if I try to subscribe more imap folders that are invisible, there's that one, but as it is an file, nothing is supposed to happen. Is there an way to, allow users to create the "subscriptions" folder without any collision, or just deny or don't show this file as an possible folder (which Is not) to subscribe. What does people normally do? Thanks in advanced,

1 0

Storage IOPs Calculation for Qmail Server
by SasiKumar.K 19 Nov '14

19 Nov '14

Dear DovecotORG, In my organization, we are about to implement Qmail Server. * The number of current users will be 800, in future it may increase upto 1200. * The number of concurrent users will be 300. I am the engineer to deploy the Qmail in Linux server. I need to tell the storage team on the IOPs requirement. I requested 8TB usable space for the mail storage (can scale up in future). Kindly provide your suggestion on this. Thanks & Regards, K.SasiKumar Systems Engineer, Locuz Enterprise Solutions Limited, Bangalore

2 1