- dovecot - dovecot.org

[Dovecot] Problem importing mail from maildir directory
by Thomas Koeller 24 Feb '13

24 Feb '13

Hi, I am trying to import mail from a maildir directory into dovecot using the 'doveadm import' command: ----------- bash-4.0$ doveadm -D import -u marion maildir:${HOME}/Mail '' ALL doveadm(marion): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(marion): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(marion): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(marion): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(marion): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Effective uid=10001, gid=10000, home=/home/marion doveadm(marion): Debug: quota: No quota setting - plugin disabled doveadm(marion): Debug: maildir++: root=/home/marion/Mail, index=, control=, inbox=/home/marion/Mail, alt= doveadm(marion): Debug: Effective uid=10001, gid=10000, home=/home/marion doveadm(marion): Debug: quota: No quota setting - plugin disabled doveadm(marion): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/marion doveadm(marion): Debug: fs: root=/home/marion/mail, index=, control=, inbox=/var/spool/mail/marion, alt= ----------- What I get is - no mails are imported - no error messages are output - nothing is written to the system log in other words, nothing happens at all. Any hints? tk

2 1

[Dovecot] make install fails on Solaris 10
by Henrik Johansson 24 Feb '13

24 Feb '13

Hello, I am trying to build dovecot-2.1.15 on Solaris 10 update 10 with Solaris Studio 12.3 and get this error: /bin/bash ../../libtool --tag=CC --mode=link /opt/SUNWspro/bin/cc -fast -xipo=2 -I/usr/sfw/include -I/usr/sfw/include -no-undefined -o doveadm doveadm-mail.o doveadm-mail-altmove.o doveadm-mail-expunge.o doveadm-mail-fetch.o doveadm-mail-import.o doveadm-mail-index.o doveadm-mail-iter.o doveadm-mail-mailbox.o doveadm-mail-mailbox-status.o doveadm-mail-copymove.o doveadm-mailbox-list-iter.o doveadm-mail-search.o doveadm-mail-server.o doveadm-print.o doveadm-settings.o doveadm-util.o server-connection.o doveadm.o doveadm-auth.o doveadm-director.o doveadm-dump.o doveadm-dump-dbox.o doveadm-dump-index.o doveadm-dump-log.o doveadm-dump-mailboxlog.o doveadm-dump-thread.o doveadm-instance.o doveadm-kick.o doveadm-log.o doveadm-master.o doveadm-mount.o doveadm-mutf7.o doveadm-penalty.o doveadm-print-flow.o doveadm-print-pager.o doveadm-print-tab.o doveadm-print-table.o doveadm-proxy.o doveadm-pw.o doveadm-sis.o doveadm-stats.o doveadm-who.o dsync/libdsync.a ../auth/libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-storage/libdovecot-storage.la -R/usr/sfw/lib -L/usr/sfw/lib -lssl -lcrypto -lsocket -lnsl -ldl ../../src/lib-dovecot/libdovecot.la -export-dynamic -lnsl -lsocket -lrt -lsendfile libtool: link: /opt/SUNWspro/bin/cc -fast -xipo=2 -I/usr/sfw/include -I/usr/sfw/include -o .libs/doveadm doveadm-mail.o doveadm-mail-altmove.o doveadm-mail-expunge.o doveadm-mail-fetch.o doveadm-mail-import.o doveadm-mail-index.o doveadm-mail-iter.o doveadm-mail-mailbox.o doveadm-mail-mailbox-status.o doveadm-mail-copymove.o doveadm-mailbox-list-iter.o doveadm-mail-search.o doveadm-mail-server.o doveadm-print.o doveadm-settings.o doveadm-util.o server-connection.o doveadm.o doveadm-auth.o doveadm-director.o doveadm-dump.o doveadm-dump-dbox.o doveadm-dump-index.o doveadm-dump-log.o doveadm-dump-mailboxlog.o doveadm-dump-thread.o doveadm-instance.o doveadm-kick.o doveadm-log.o doveadm-master.o doveadm-mount.o doveadm-mutf7.o doveadm-penalty.o doveadm-print-flow.o doveadm-print-pager.o doveadm-print-tab.o doveadm-print-table.o doveadm-proxy.o doveadm-pw.o doveadm-sis.o doveadm-stats.o doveadm-who.o dsync/libdsync.a ../auth/libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-storage/.libs/libdovecot-storage.so -L/usr/sfw/lib /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so -lssl -lcrypto -ldl ../../src/lib-dovecot/.libs/libdovecot.so -lnsl -lsocket -lrt -lsendfile -R/opt/HNKSdovecot/lib/dovecot -R/usr/sfw/lib ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file Undefined first referenced symbol in file $XBKaiwbjOCHRV5w.array_append_array_i..L93 dsync/libdsync.a(dsync-brain.o) $XBKaiwbjOCHRV5w.array_append_array_i..L94 dsync/libdsync.a(dsync-brain.o) $XBKaiwbjOCHRV5w.array_append_array_i..L95 dsync/libdsync.a(dsync-brain.o) ld: fatal: symbol referencing errors. No output written to .libs/doveadm *** Error code 2 make: Fatal error: Command failed for target `doveadm' Current working directory /home/henrikj/Build/dovecot-2.1.15/src/doveadm *** Error code 1 Any suggestions? Thanks Henrik

1 0

Re: [Dovecot] problems with imaps
by Joseph Tam 23 Feb '13

23 Feb '13

On 2013-02-22, Matthias Leopold wrote: > with thunderbird 10.0.12 i can't connect to port 993 and get errors in > the logs like > > TLS: SSL_read() failed: error:14094412:SSL > routines:SSL3_READ_BYTES:sslv3 alert bad certificate > > (certificate generated by dovecot mkcert.sh) I haven't come across any problems with our use of self-signed certificates, but I run the latest 2.1.x dovecot so maybe there's some SSL changes between our version and your's. The fact that the same certificate works for other clients, and also for TLS on Thunderbird seem to suggest Thunderbird is fumbling it. But maybe you can try the command diagnostic from the command line "openssl s_client -connect yourserver:993 ..." or use one of the online certificate checkers to get some useful diagnostics. > TLS: SSL_read() failed: error:14094418:SSL > routines:SSL3_READ_BYTES:tlsv1 alert unknown ca This error entry pops up in my logs once in a while. I think the error might be misleading since the error message happen in the middle of a long sequence of successful connections. Also check that the client is actually using the right security mode (not TLS or clear), perhaps by doing a network snoop. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] doveadm user error messages
by Thomas Leuxner 22 Feb '13

22 Feb '13

I use 'doveadm user' in some scripts and the exit codes are fine for my purposes. During tests it transpired that Dovecot 2.1 would give an error message when querying for non-existent users. Dovecot 2.2 just exits without a word. Not sure this is intended behaviour: $ doveadm user foo $ echo $? 67 $ id foo id: foo: No such user Regards Thomas

2 2

[Dovecot] assert in mail-transaction-log-file.c
by Anton Yuzhaninov 22 Feb '13

22 Feb '13

I setup new server with dovecot 2.1.12 and mboxes from backup (moboxes was used with dovecot 1.1.6). OS: FreeBSD 8.3-STABLE, amd64. All index files from dovecot 1.1.6 has been deleted. Some times dovecot processes aborted. E. g. Jan 25 03:01:52 ost dovecot: lda(user(a)example.ru): Panic: file mail-transaction-log-file.c: line 1694 (mail_transaction_log_file_map): assertion failed: (file->buffer != NULL) (gdb) bt #0 0x0000000800bd610c in kill () from /lib/libc.so.7 #1 0x0000000800bd4f0b in abort () from /lib/libc.so.7 #2 0x000000080099b339 in default_fatal_finish (type=72898, status=0) at failures.c:191 #3 0x000000080099b3be in i_syslog_fatal_handler (ctx=<value optimized out>, format=<value optimized out>, args=<value optimized out>) at failures.c:413 #4 0x000000080099a8a3 in i_panic (format=<value optimized out>) at failures.c:263 #5 0x000000080081bdb6 in mail_transaction_log_file_map (file=0x801670e00, start_offset=40, end_offset=18446744073709551615) at mail-transaction-log-file.c:1694 #6 0x000000080081da41 in mail_transaction_log_view_set (view=0x801654a80, min_file_seq=1, min_file_offset=40, max_file_seq=2, max_file_offset=18446744073709551615, reset_r=0x7fffffffbedf) at mail-transaction-log-view.c:228 #7 0x000000080081519d in mail_index_sync_map (_map=0x801670b08, type=MAIL_INDEX_SYNC_HANDLER_HEAD, force=false) at mail-index-sync-update.c:950 #8 0x0000000800805be0 in mail_index_map (index=0x801670a80, type=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map-read.c:415 #9 0x0000000800800bde in mail_index_refresh (index=<value optimized out>) at mail-index.c:735 #10 0x00000008007b2344 in mbox_sync_header_refresh (mbox=0x801680840) at mbox-sync.c:1652 #11 0x00000008007b24e2 in mbox_sync_has_changed_full (mbox=0x801680840, leave_dirty=true, empty_r=0x7fffffffe2e8) at mbox-sync.c:1729 #12 0x00000008007ae1a7 in mbox_save_begin (_ctx=0x80161a500, input=0x801669660) at mbox-save.c:296 #13 0x00000008018025ae in notify_save_begin (ctx=0x80161a500, input=0x801669660) at notify-storage.c:130 #14 0x00000008014261fd in quota_save_begin (ctx=0x80161a500, input=0x801669660) at quota-storage.c:251 #15 0x00000008007cfecc in mailbox_save_begin (ctx=0x7fffffffe3d0, input=0x801669660) at mail-storage.c:1652 #16 0x00000008007ca48d in mail_storage_copy (ctx=0x80161a500, mail=0x801637040) at mail-copy.c:68 #17 0x000000080180269d in notify_copy (ctx=0x80161a500, mail=0x801637040) at notify-storage.c:105 #18 0x00000008014262f6 in quota_copy (ctx=0x80161a500, mail=0x801637040) at quota-storage.c:200 #19 0x00000008007cfe04 in mailbox_copy (_ctx=<value optimized out>, mail=0x801637040) at mail-storage.c:1721 #20 0x0000000801b4b706 in act_store_execute (action=<value optimized out>, aenv=0x8016a3070, tr_context=<value optimized out>) at sieve-actions.c:551 #21 0x0000000801b428de in sieve_result_execute (result=0x8016a3040, keep=0x0) at sieve-result.c:1117 #22 0x0000000801b52d5a in sieve_execute (sbin=<value optimized out>, msgdata=<value optimized out>, senv=<value optimized out>, ehandler=<value optimized out>, flags=<value optimized out>, keep=0x0) at sieve.c:508 #23 0x0000000801a0aec6 in lda_sieve_deliver_mail (mdctx=0x7fffffffe970, storage_r=0x7fffffffe8e8) at lda-sieve-plugin.c:424 #24 0x0000000800651735 in mail_deliver (ctx=0x7fffffffe970, storage_r=0x7fffffffe8e8) at mail-deliver.c:390 #25 0x0000000000402ffa in main (argc=6, argv=0x7fffffffea78) at main.c:434 (gdb) f 5 (gdb) p *file $1 = {log = 0x8016463d0, next = 0x0, refcount = 5, filepath = 0x801620420 "(in-memory index).log", fd = -1, st_ino = 13919248, st_dev = 109, last_mtime = 1359082912, last_size = 0, hdr = {major_version = 1 '\001', minor_version = 2 '\002', hdr_size = 40, indexid = 1359082912, file_seq = 2, prev_file_seq = 0, prev_file_offset = 0, create_stamp = 1359082912, initial_modseq = 0, compat_flags = 1 '\001', unused = "\000\000", unused2 = 0}, mmap_buffer = {data = 0x0, used = 0, priv = {0x0, 0x0, 0x0, 0x0, 0x0}}, buffer = 0x0, buffer_offset = 0, mmap_base = 0x0, mmap_size = 0, sync_offset = 40, sync_highest_modseq = 0, saved_tail_offset = 0, max_tail_offset = 0, saved_tail_sync_offset = 0, index_deleted_offset = 0, index_undeleted_offset = 0, modseq_cache = {{offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, { offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, { offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}, {offset = 0, highest_modseq = 0}}, file_lock = 0x0, lock_created = 0, locked = 0, locked_sync_offset_updated = 0, corrupted = 0} Also same aborts can happen in imap processes: Jan 24 16:35:04 ost dovecot: imap(user(a)example.ru): Panic: file mail-transaction-log-file.c: line 1694 (mail_transaction_log_file_map): assertion failed: (file->buffer != NULL) -- Anton Yuzhaninov

2 2

[Dovecot] Ubuntu-12.04 packages for latest Dovecot release
by 3.listas＠adminlinux.com.br 22 Feb '13

22 Feb '13

Hi, Does anyone here know a trusted package repository for Ubuntu LTS which has always the latest version of Dovecot? Thanks ! -- Thiago Henrique adminlinux.com.br

3 4

[Dovecot] problems with imaps
by Matthias Leopold 22 Feb '13

22 Feb '13

hi, i'm using dovecot 1.2.15 with self signed certificates using starttls on ports 110/143 works ok with thunderbird 10.0.12 (and i guess most other clients) using imaps on port 993 works with outlook 2002. with thunderbird 10.0.12 i can't connect to port 993 and get errors in the logs like TLS: SSL_read() failed: error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate (certificate generated by dovecot mkcert.sh) or TLS: SSL_read() failed: error:14094418:SSL routines:SSL3_READ_BYTES:tlsv1 alert unknown ca (certificate generated by own openssl cmdline) i know that a lot of information is missing, but since this looks like a more general problem i dare to ask for help before posting more config details thx matthias

3 3

[Dovecot] High CPU Usage with 2.2
by Odhiambo Washington 22 Feb '13

22 Feb '13

I am seeing a rather high CPU usage with 2.2 now: last pid: 30725; load averages: 4.58, 27.36, 25.49 up 0+15:36:12 16:02:53 103 processes: 4 running, 98 sleeping, 1 zombie CPU: 34.5% user, 0.0% nice, 65.4% system, 0.2% interrupt, 0.0% idle Mem: 602M Active, 1767M Inact, 254M Wired, 6116K Cache, 112M Buf, 490M Free Swap: 5900M Total, 5900M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 30569 mailnull 1 112 0 4956K 2784K RUN 0 1:27 68.65% pop3 30704 mailnull 1 108 0 4956K 2876K CPU0 0 0:10 57.37% pop3 30712 mailnull 1 106 0 4944K 2780K RUN 1 0:07 45.26% pop3 30636 root 1 44 0 3696K 1784K CPU1 1 0:00 0.10% top My entire configuration - http://pastebin.com/XGZb5kKN -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ I can't hear you -- I'm using the scrambler.

2 3

[Dovecot] pop3_lock_session and mdbox format
by Ewald Dieterich 22 Feb '13

22 Feb '13

Setting "pop3_lock_session = yes" in the configuration has no effect when I use Dovecot 2.1.13 with the mdbox format. A second POP3 connection to the same mailbox is still allowed. Grepping for MAILBOX_FLAG_KEEP_LOCKED in the source code shows that POP3 session locking only works for the Maildir and mbox formats. Is it possible to enable it for the mdbox format, as well? Ewald

2 1

[Dovecot] environment for dovecot auth
by Emmanuel Dreyfus 22 Feb '13

22 Feb '13

Hi Is there a way to set environment variables for the auth process? All I found for now is to replace it by a shell script that sets variables and then launch the real auth, but I wonder if there is a better way. -- Emmanuel Dreyfus manu(a)netbsd.org

2 1

[Dovecot] [PATCH] support for NetBSD 6.0 libquota
by manu＠netbsd.org 22 Feb '13

22 Feb '13

Hi NetBSD 6.0 introduced a new improved quota subsystem and an unified API (libquota) to handle the new and old quota implementation. dovecot is unable to use the new quota implementation right now, and will even fail to build with the old quota API on NetBSD 6.0: Here are dovecot patches to support NetBSD libquota: http://ftp.espci.fr/shadow/manu/dovecot-libquota.tgz -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu(a)netbsd.org

2 1

[Dovecot] Trouble with expire plugin
by Gedalya 22 Feb '13

22 Feb '13

Hi all, Maybe someone here can help me with this problem, not sure if this is a configuration issue or an actual bug. my daily cron job says: #!/bin/sh doveadm expunge -A mailbox Junk savedbefore 14d doveadm expunge -A mailbox Trash savedbefore 30d doveadm expunge -A mailbox "Trash.*" savedbefore 30d But it hasn't been deleting any messages in a long time, I'm not sure when it stopped working. I've also noticed that it does delete matching rows in the expires database (expire_stamp < savedbefore days). Furthermore, rows are deleted even when running doveadm search, and regardless of the mailbox column, i.e. even when != the mailbox name being searched! Anyway why should doveadm search delete rows in the expires database? The database is mysql. ---- dovecot -n ---- # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-0.bpo.3-amd64 x86_64 Debian 6.0.6 auth_default_realm = xxxxxxx.com auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain default_client_limit = 8096 dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no mail_gid = vmail mail_plugins = quota expire listescape mail_uid = vmail managesieve_sieve_capability = fileinto envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = pipe antispam_pipe_program = /usr/bin/ssh antispam_pipe_program_args = -l;spamd;-i;/etc/dovecot/sareport.key;mx1.xxxxxxx.com antispam_pipe_program_notspam_arg = revoke antispam_pipe_program_spam_arg = report antispam_pipe_tmpdir = /tmp antispam_spam = Junk antispam_trash_pattern_ignorecase = trash;Deleted * autocreate = Trash autocreate2 = Junk autocreate3 = Drafts autocreate4 = Sent autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent expire = Trash expire2 = Trash.* expire3 = Junk expire_dict = proxy::expire quota = dict:user::proxy::quota quota_rule = *:storage=2G quota_rule2 = Trash:storage=+250M quota_rule3 = Junk:ignore quota_warning = storage=99%% quota-warning 99 %u quota_warning2 = storage=95%% quota-warning 95 %u sieve = ~/.dovecot.sieve sieve_before = /var/local/lib/dovecot/sieve/global/fileinto-spam.sieve sieve_dir = ~/sieve sieve_extensions = -vacation -body -reject -enotify -environment -virustest -spamtest sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 10K sieve_quota_max_scripts = 10 } postmaster_address = postmaster(a)xxxxxxx.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 20480 unix_listener auth-userdb { group = root mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 10240 } service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 7025 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 0 vsz_limit = 128 M } service pop3-login { process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 4096 } service quota-warning { executable = script /usr/local/bin/quota-warning unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = quota expire listescape sieve } protocol lda { mail_plugins = quota expire listescape sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = quota expire listescape autocreate imap_quota antispam ssl_cert = </etc/dovecot/imap.xxxxxxx.com.crt ssl_key = </etc/dovecot/imap.xxxxxxx.com.key } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = quota expire listescape pop3_fast_size_lookups = yes pop3_lock_session = no pop3_no_flag_updates = yes pop3_reuse_xuidl = yes pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv ssl_cert = </etc/dovecot/pop.xxxxxxx.com.crt ssl_key = </etc/dovecot/pop.xxxxxxx.com.key } in dovecot-sql.conf.ext I have: iterate_query = SELECT userid as user, domain FROM email where deleted=0 ---- dovecot-dict-sql.conf.ext ---- connect = host=localhost dbname=email user=email map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } }

3 5

[Dovecot] patch to fix binary attachment indexing
by Mike Abbott 22 Feb '13

22 Feb '13

FTS indexing of binary attachments is broken in dovecot-2.1.15: the binary data which fts_build_mail_real() sends to fts_build_body_block() (which sends it to fts_backend_update_build_more()) is garbled. This patch ungarbles it but I’m not positive it’s the best fix. --- dovecot-2.1.15/src/plugins/fts/fts-build-mail.c 2012-11-27 02:07:27.000000000 -0600 +++ dovecot/src/plugins/fts/fts-build-mail.c 2013-02-21 19:48:15.000000000 -0600 @@ -178,7 +178,8 @@ *binary_body_r = TRUE; key.type = FTS_BACKEND_BUILD_KEY_BODY_PART_BINARY; } - if (ctx->body_parser == NULL) + if (ctx->body_parser == NULL && + key.type != FTS_BACKEND_BUILD_KEY_BODY_PART_BINARY) ctx->body_parser = fts_parser_text_init(); key.body_content_type = content_type; key.body_content_disposition = ctx->content_disposition;

2 2

[Dovecot] error running indexer-worker as non-root user
by Mike Abbott 22 Feb '13

22 Feb '13

Using dovecot-2.1.15 if I run indexer-worker as a non-root user it fails with an error: Feb 11 13:06:47 indexer-worker: Error: user foobar: Error reading configuration: net_connect_unix(/var/run/dovecot/config) failed: Permission denied This is what I added to 10-master.conf: service indexer-worker { user = _dovecot } The wiki says it should work: <http://wiki2.dovecot.org/Services> indexer-worker [...] • user=root, but the privileges are (temporarily) dropped to the mail user's privileges after userdb lookup. If only a single UID is used, user can be set to the mail UID for higher security, because the process can't gain root privileges anymore. And the code says it should work: <src/indexer/indexer-worker.c> static void drop_privileges(void) { [...] if (set.uid != 0) { /* open config connection before dropping privileges */ Of course the config socket is locked down as it should be: srw------- 1 root daemon 0 Feb 11 13:06 /var/run/dovecot/config Here's where the error comes from: 2 libdovecot.0.dylib 0x00000001019612a0 master_service_settings_read + 2168 3 libdovecot.0.dylib 0x000000010196193e master_service_settings_cache_read + 294 4 libdovecot-storage.0.dylib 0x000000010185d9ad mail_storage_service_read_settings + 510 5 libdovecot-storage.0.dylib 0x000000010185da5d mail_storage_service_lookup + 96 6 libdovecot-storage.0.dylib 0x000000010185f06a mail_storage_service_lookup_next + 42 7 indexer-worker 0x00000001018101a1 master_connection_input + 335 8 libdovecot.0.dylib 0x0000000101972455 io_loop_call_io + 46 9 libdovecot.0.dylib 0x000000010197343e io_loop_handler_run + 214 10 libdovecot.0.dylib 0x0000000101972600 io_loop_run + 77 11 libdovecot.0.dylib 0x00000001019601ef master_service_run + 24 12 indexer-worker 0x000000010180ff17 main + 490 13 libdyld.dylib 0x00007fff89d2f7b5 start + 1 Is this a bug or am I configuring it incorrectly? Thanks.

2 2

[Dovecot] Userdb passwd and 'nologin' users
by Ben Morrow 22 Feb '13

22 Feb '13

I am running Dovecot with system users (userdb passwd), but some of those users don't have shell accounts on the IMAP server so their shell on that machine is set to /usr/sbin/nologin. Currently I am using maildirs and this is not a problem, but I am in the process of switching to dbox which means I will need a cronjob running 'doveadm purge -A'. During testing I found that those users with a 'nologin' shell are not included in the list returned by the userdb iterator, and that the iterator doesn't honour the first/last_valid_uid settings. This inconsistency seems undesirable, so the attached patch - makes lookup perform the same checks as iteration, - makes the 'nologin' check configurable, - adds a new optional check that the user owns their home directory. The last check was the one performed by qmail, and seems to me to be a more reliable 'is this a real user' check than a nologin shell. If this patch is applied, the release notes for the next release should probably mention that system users with a 'nologin' shell will no longer be allowed to log in to IMAP until the 'auth_check_nologin' setting is changed from true to false. Also, there seem to be two first/last_valid_uid settings: first_valid_uid itself, which is honoured by the storage subsystem, and auth_first_valid_uid, which is honoured by the 'passwd' userdb. Is this intentional? Ben

3 5

[Dovecot] "Header is huge" in fts-solr
by Valery V. Sedletski 22 Feb '13

22 Feb '13

Hi, Timo and all! I am trying to index mail in a test mailbox using fts_solr plugin for full-text search. On most mailboxes, it works fine, but on some big messages I get warnings like the following, and then I get an Out of memory error from Solr, then the indexer-worker process (or doveadm) crashes with "assertion failed" error and the backtrace: ========================================================== doveadm(valerius(a)test.afterlogic.com): Warning: fts-solr(valerius(a)test.afterlogic.com): Mailbox gmail.com UID=48 header size is huge doveadm(valerius(a)test.afterlogic.com): Warning: fts-solr(valerius(a)test.afterlogic.com): Mailbox gmail.com UID=49 header size is huge doveadm(valerius(a)test.afterlogic.com): Panic: file ../../../../src/plugins/fts-solr/solr-connection.c: line 548 (solr_connection_post_more): assertion failed: (maxfd >= 0) doveadm(valerius(a)test.afterlogic.com): Error: Raw backtrace: /usr/mailsuite/lib/dovecot/libdovecot.so.0(+0x58f04) [0x7fe8a908af04] -> /usr/mailsuite/lib/dovecot/libdovecot.so.0(default_error_handler+0) [0x7fe8a908af93] -> /usr/mailsuite/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fe8a908b274] -> /usr/mailsuite/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x2d2) [0x7fe8a75fe973] -> /usr/mailsuite/lib/dovecot/lib21_fts_solr_plugin.so(+0x4d03) [0x7fe8a75f9d03] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_build_more+0x77) [0x7fe8a7c1d401] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(+0x7fe2) [0x7fe8a7c1dfe2] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(+0x80d5) [0x7fe8a7c1e0d5] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(+0x89e4) [0x7fe8a7c1e9e4] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2b) [0x7fe8a7c1ebf5] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(+0xe7cf) [0x7fe8a7c247cf] -> /usr/mailsuite/lib/dovecot/lib20_fts_plugin.so(+0xe8ba) [0x7fe8a7c248ba] -> /usr/mailsuite/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x25) [0x7fe8a9379bc9] -> /usr/mailsuite/bin/doveadm() [0x4139de] -> /usr/mailsuite/bin/doveadm() [0x413c17] -> /usr/mailsuite/bin/doveadm() [0x413f18] -> /usr/mailsuite/bin/doveadm() [0x40fea6] -> /usr/mailsuite/bin/doveadm(doveadm_mail_single_user+0x154) [0x410069] -> /usr/mailsuite/bin/doveadm() [0x41090a] -> /usr/mailsuite/bin/doveadm(doveadm_mail_try_run+0xac) [0x410b81] -> /usr/mailsuite/bin/doveadm(main+0x28d) [0x41a92c] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fe8a8cc9ead] -> /usr/mailsuite/bin/doveadm() [0x40f499] ========================================================== And Solr log, at the same time: ========================================================== 2013-02-01 18:03:53.342:INFO::Logging to STDERR via org.mortbay.log.StdErrLog 2013-02-01 18:03:53.425:INFO::jetty-6.1-SNAPSHOT 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: JNDI not configured for solr (NoInitialContextEx) 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: solr home defaulted to 'solr/' (could not find system property or JNDI) 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader INFO: new SolrResourceLoader for deduced Solr Home: 'solr/' 01.02.2013 18:03:53 org.apache.solr.servlet.SolrDispatchFilter init INFO: SolrDispatchFilter.init() 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: JNDI not configured for solr (NoInitialContextEx) 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: solr home defaulted to 'solr/' (could not find system property or JNDI) 01.02.2013 18:03:53 org.apache.solr.core.CoreContainerSInitializer initialize INFO: looking for solr.xml: /home/valerius/apache-solr-3.6.2/example/solr/solr.xml 01.02.2013 18:03:53 org.apache.solr.core.CoreContainer load INFO: Loading CoreContainer using Solr Home: 'solr/' 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader INFO: new SolrResourceLoader for directory: 'solr/' 01.02.2013 18:03:53 org.apache.solr.core.CoreContainer create INFO: Creating SolrCore '' using instanceDir: solr/. 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader INFO: new SolrResourceLoader for directory: 'solr/./' 01.02.2013 18:03:53 org.apache.solr.core.SolrConfig initLibs INFO: Adding specified lib dirs to ClassLoader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/dist/apache-solr-cell-3.6.2.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/poi-ooxml-3.8-beta4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/jdom-1.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/bcprov-jdk15-1.45.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/xmlbeans-2.3.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/boilerpipe-1.1.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/xercesImpl-2.8.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/tika-core-1.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/metadata-extractor-2.4.0-beta-1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/apache-mime4j-core-0.7.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/fontbox-1.6.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/pdfbox-1.6.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/dom4j-1.6.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/asm-3.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/jempbox-1.6.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/poi-ooxml-schemas-3.8-beta4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/rome-0.9.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/tagsoup-1.2.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/icu4j-4.8.1.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/poi-3.8-beta4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/tika-parsers-1.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/poi-scratchpad-3.8-beta4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/commons-compress-1.3.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/xml-apis-1.0.b2.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/extraction/lib/apache-mime4j-dom-0.7.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/dist/apache-solr-clustering-3.6.2.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/jackson-mapper-asl-1.7.4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/mahout-collections-0.3.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/mahout-math-0.3.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/hppc-0.3.4-jdk15.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/carrot2-core-3.5.0.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/jackson-core-asl-1.7.4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/clustering/lib/simple-xml-2.4.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/dist/apache-solr-dataimporthandler-3.6.2.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/dataimporthandler/lib/mail-1.4.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/dataimporthandler/lib/activation-1.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/dist/apache-solr-langid-3.6.2.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/langid/lib/langdetect-1.1-20120112.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/langid/lib/jsonic-1.2.7.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/dist/apache-solr-velocity-3.6.2.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/velocity/lib/velocity-1.6.4.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/velocity/lib/commons-collections-3.2.1.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/velocity/lib/commons-beanutils-1.7.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/home/valerius/apache-solr-3.6.2/contrib/velocity/lib/velocity-tools-2.0.jar' to classloader 01.02.2013 18:03:53 org.apache.solr.core.SolrConfig INFO: Using Lucene MatchVersion: LUCENE_36 01.02.2013 18:03:54 org.apache.solr.core.SolrConfig INFO: Loaded SolrConfig: solrconfig.xml 01.02.2013 18:03:54 org.apache.solr.schema.IndexSchema readSchema INFO: Reading Solr Schema 01.02.2013 18:03:54 org.apache.solr.schema.IndexSchema readSchema INFO: Schema name=dovecot 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created string: org.apache.solr.schema.StrField 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created long: org.apache.solr.schema.LongField 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created slong: org.apache.solr.schema.SortableLongField 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created float: org.apache.solr.schema.FloatField 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created boolean: org.apache.solr.schema.BoolField 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.WhitespaceTokenizerFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.SynonymFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.StopFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.WordDelimiterFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.LowerCaseFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.SnowballPorterFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.RemoveDuplicatesTokenFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.WhitespaceTokenizerFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.StopFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.WordDelimiterFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.LowerCaseFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.SnowballPorterFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.NGramFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created : org.apache.solr.analysis.RemoveDuplicatesTokenFilterFactory 01.02.2013 18:03:54 org.apache.solr.util.plugin.AbstractPluginLoader load INFO: created text: org.apache.solr.schema.TextField 01.02.2013 18:03:54 org.apache.solr.schema.IndexSchema readSchema INFO: default search field in schema is body 01.02.2013 18:03:54 org.apache.solr.schema.IndexSchema readSchema INFO: query parser default operator is AND 01.02.2013 18:03:54 org.apache.solr.schema.IndexSchema readSchema INFO: unique key field: id 01.02.2013 18:03:54 org.apache.solr.core.SolrCore INFO: [] Opening new SolrCore at solr/./, dataDir=solr/./data/ 01.02.2013 18:03:54 org.apache.solr.core.JmxMonitoredMap INFO: JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27b4c1d7 01.02.2013 18:03:54 org.apache.solr.core.SolrCore initListeners INFO: [] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]} 01.02.2013 18:03:54 org.apache.solr.core.SolrCore initListeners INFO: [] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]} 01.02.2013 18:03:54 org.apache.solr.core.SolrCore initWriters INFO: created json: solr.JSONResponseWriter 01.02.2013 18:03:54 org.apache.solr.core.SolrCore initWriters INFO: adding lazy queryResponseWriter: solr.VelocityResponseWriter 01.02.2013 18:03:54 org.apache.solr.core.SolrCore initWriters INFO: created velocity: solr.VelocityResponseWriter 01.02.2013 18:03:54 org.apache.solr.core.SolrCore initWriters INFO: created xslt: solr.XSLTResponseWriter 01.02.2013 18:03:54 org.apache.solr.response.XSLTResponseWriter init INFO: xsltCacheLifetimeSeconds=5 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /select: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /browse: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /update: solr.XmlUpdateRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /update/javabin: solr.BinaryUpdateRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.CSVRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /update/csv: solr.CSVRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.JsonUpdateRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /update/json: solr.JsonUpdateRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.extraction.ExtractingRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /update/extract: solr.extraction.ExtractingRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.XsltUpdateRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /update/xslt: solr.XsltUpdateRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.FieldAnalysisRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /analysis/field: solr.FieldAnalysisRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.DocumentAnalysisRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /analysis/document: solr.DocumentAnalysisRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /admin/: solr.admin.AdminHandlers 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /admin/ping: solr.PingRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /debug/dump: solr.DumpRequestHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /spell: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /tvrh: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /terms: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: adding lazy requestHandler: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.core.RequestHandlers initHandlersFromConfig INFO: created /elevate: solr.SearchHandler 01.02.2013 18:03:54 org.apache.solr.search.SolrIndexSearcher INFO: Opening Searcher@5c29ea31 main 01.02.2013 18:03:54 org.apache.solr.update.CommitTracker INFO: commitTracker AutoCommit: disabled 01.02.2013 18:03:54 org.apache.solr.handler.component.SpellCheckComponent inform INFO: Initializing spell checkers 01.02.2013 18:03:54 org.apache.solr.handler.component.SpellCheckComponent inform INFO: No queryConverter defined, using default converter 01.02.2013 18:03:54 org.apache.solr.handler.component.QueryElevationComponent inform INFO: Loading QueryElevation from: /home/valerius/apache-solr-3.6.2/example/solr/./conf/elevate.xml 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.QueryComponent@4d16318b 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.FacetComponent@6c0ec436 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3d73eca6 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@5b5a5cf 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.StatsComponent@5898bbf6 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding debug component:org.apache.solr.handler.component.DebugComponent@135c40eb 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting socketTimeout to: 0 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting urlScheme to: http:// 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting connTimeout to: 0 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting maxConnectionsPerHost to: 20 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting corePoolSize to: 0 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting maximumPoolSize to: 2147483647 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting maxThreadIdleTime to: 5 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting sizeOfQueue to: -1 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting fairnessPolicy to: false 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.QueryComponent@4d16318b 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.FacetComponent@6c0ec436 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.MoreLikeThisComponent@3d73eca6 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.HighlightComponent@5b5a5cf 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.StatsComponent@5898bbf6 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding component:org.apache.solr.handler.component.SpellCheckComponent@18f2225f 01.02.2013 18:03:54 org.apache.solr.handler.component.SearchHandler inform INFO: Adding debug component:org.apache.solr.handler.component.DebugComponent@135c40eb 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting socketTimeout to: 0 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting urlScheme to: http:// 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting connTimeout to: 0 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting maxConnectionsPerHost to: 20 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting corePoolSize to: 0 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting maximumPoolSize to: 2147483647 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting maxThreadIdleTime to: 5 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting sizeOfQueue to: -1 01.02.2013 18:03:54 org.apache.solr.handler.component.HttpShardHandlerFactory getParameter INFO: Setting fairnessPolicy to: false 01.02.2013 18:03:54 org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener sending requests to Searcher@5c29ea31 main 01.02.2013 18:03:54 org.apache.solr.core.CoreContainer register INFO: registering core: 01.02.2013 18:03:54 org.apache.solr.servlet.SolrDispatchFilter init INFO: user.dir=/home/valerius/apache-solr-3.6.2/example 01.02.2013 18:03:54 org.apache.solr.servlet.SolrDispatchFilter init INFO: SolrDispatchFilter.init() done 01.02.2013 18:03:54 org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: undefined field text at org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1330) at org.apache.solr.schema.IndexSchemaSSolrQueryAnalyzer.getAnalyzer(IndexSchema.java:408) at org.apache.solr.schema.IndexSchemaSSolrIndexAnalyzer.reusableTokenStream(IndexSchema.java:383) at org.apache.lucene.queryParser.QueryParser.getFieldQuery(QueryParser.java:574) at org.apache.solr.search.SolrQueryParser.getFieldQuery(SolrQueryParser.java:206) at org.apache.lucene.queryParser.QueryParser.Term(QueryParser.java:1436) at org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:1319) at org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:1245) at org.apache.lucene.queryParser.QueryParser.TopLevelQuery(QueryParser.java:1234) at org.apache.lucene.queryParser.QueryParser.parse(QueryParser.java:206) at org.apache.solr.search.LuceneQParser.parse(LuceneQParserPlugin.java:79) at org.apache.solr.search.QParser.getQuery(QParser.java:143) at org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:105) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:165) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) at org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:59) at org.apache.solr.core.SolrCoreS3.call(SolrCore.java:1182) at java.util.concurrent.FutureTaskSSync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutorSWorker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 01.02.2013 18:03:54 org.apache.solr.core.SolrCore execute INFO: [] webapp=null path=null params={event=firstSearcher&q=static+firstSearcher+warming+in+solrconfig.xml} status=400 QTime=22 01.02.2013 18:03:54 org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener done. 01.02.2013 18:03:54 org.apache.solr.handler.component.SpellCheckComponentSSpellCheckerListener newSearcher INFO: Loading spell index for spellchecker: default 01.02.2013 18:03:54 org.apache.solr.core.SolrCore registerSearcher INFO: [] Registered new searcher Searcher@5c29ea31 main 01.02.2013 18:03:54 org.apache.solr.servlet.SolrServlet init INFO: SolrServlet.init() 01.02.2013 18:03:54 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: JNDI not configured for solr (NoInitialContextEx) 01.02.2013 18:03:54 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: solr home defaulted to 'solr/' (could not find system property or JNDI) 01.02.2013 18:03:54 org.apache.solr.servlet.SolrServlet init INFO: SolrServlet.init() done 01.02.2013 18:03:54 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: JNDI not configured for solr (NoInitialContextEx) 01.02.2013 18:03:54 org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: solr home defaulted to 'solr/' (could not find system property or JNDI) 01.02.2013 18:03:54 org.apache.solr.servlet.SolrUpdateServlet init INFO: SolrUpdateServlet.init() done 2013-02-01 18:03:54.449:INFO::Started SocketConnector@0.0.0.0:8983 01.02.2013 18:04:40 org.apache.solr.core.SolrDeletionPolicy onInit INFO: SolrDeletionPolicy.onInit: commits:num=1 commit{dir=/home/valerius/apache-solr-3.6.2/example/solr/data/index,segFN=segments_1,version=1359741540635,generation=1,filenames=[segments_1] 01.02.2013 18:04:40 org.apache.solr.core.SolrDeletionPolicy updateCommits INFO: newest commit = 1359741540635 01.02.2013 18:05:05 org.apache.solr.update.processor.LogUpdateProcessor finish INFO: {add=[1/5cc6513b4dc6de5093660000b304ded5/valerius(a)test.afterlogic.com, 48/5cc6513b4dc6de5093660000b304ded5/valerius(a)test.afterlogic.com]} 0 24629 01.02.2013 18:05:05 org.apache.solr.common.SolrException log SEVERE: java.lang.OutOfMemoryError: Java heap space at org.apache.lucene.index.FreqProxTermsWriterPerFieldSFreqProxPostingsArray.(FreqProxTermsWriterPerField.java:193) at org.apache.lucene.index.FreqProxTermsWriterPerFieldSFreqProxPostingsArray.newInstance(FreqProxTermsWriterPerField.java:204) at org.apache.lucene.index.ParallelPostingsArray.grow(ParallelPostingsArray.java:48) at org.apache.lucene.index.TermsHashPerField.growParallelPostingsArray(TermsHashPerField.java:157) at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:460) at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:189) at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:278) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:766) at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2328) at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2300) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:157) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260) at org.mortbay.jetty.servlet.ServletHandlerSCachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnectionSRequestHandler.content(HttpConnection.java:945) 2013-02-01 18:05:42.595:INFO::Shutdown hook executing 2013-02-01 18:05:42.596:INFO::Graceful shutdown SocketConnector@0.0.0.0:8983 2013-02-01 18:05:42.596:INFO::Graceful shutdown org.mortbay.jetty.webapp.WebAppContext@5484ff20{/solr,file:/home/valerius/apache-solr-3.6.2/example/webapps/solr.war} 2013-02-01 18:05:43.596:INFO::Stopped SocketConnector@0.0.0.0:8983 2013-02-01 18:05:43.784:INFO::Shutdown hook complete ========================================================== So, it seems that Dovecot tries to parse messages in the mailbox, and can't correctly determine where the message header ends. So, it thinks that the message header is big, and passes very big data to Solr. When trying to index it, Solr exhausts the available memory (though, I have 8 Gb of RAM on my machine, and java eats more than 2 Gb when indexing). Then connections to Solr get closed, and maxfd is invalid, hence the assertion is failed. Note also the following error ========================================================== SEVERE: org.apache.solr.common.SolrException: undefined field text ========================================================== before an out of memory error. I also tried to tweak the decode2text.sh script to ignore all attachments bigger than 1 Mb (just test if the file is bigger than 1 Mb, and if so, return "1"). This won't help. As I understood, this is because of big header, so attachments doesn't matter. I separated the set of messages which cause this error (by their UID's). So, I can give them as a testcase, the size of them all in archive is about 40 Mb. The error can be reproduced if put all these messages into an empty mailbox, and do reindexing, via IMAP search, or via "doveadm index -u ". I use Dovecot version 2.1.13. My doveconf -n : ========================================================== # 2.1.13: /usr/mailsuite/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian wheezy/sid ext4 auth_debug = yes auth_debug_passwords = yes auth_default_realm = test.afterlogic.com auth_mechanisms = plain login auth_socket_path = /usr/mailsuite/var/run/dovecot/auth-master base_dir = /usr/mailsuite/var/run/dovecot/ debug_log_path = /usr/mailsuite/var/log/dovecot/debug.log default_internal_user = exim dict { domainquotadict = mysql:/usr/mailsuite/etc/dovecot/dovecot-domain-quota-dict.conf realmquotadict = mysql:/usr/mailsuite/etc/dovecot/dovecot-realm-quota-dict.conf userquotadict = mysql:/usr/mailsuite/etc/dovecot/dovecot-user-quota-dict.conf } disable_plaintext_auth = no info_log_path = /usr/mailsuite/var/log/dovecot/info.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /usr/mailsuite/var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_gid = exim mail_home = /usr/mailsuite/data/settings/%d/%n mail_location = maildir:/usr/mailsuite/data/%d/%n mail_plugins = listescape fts fts_solr virtual mail_uid = exim managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus mbox_write_locks = fcntl namespace { inbox = yes location = maildir:/usr/mailsuite/data/%d/%n prefix = separator = / type = private } namespace { hidden = yes inbox = no list = no location = virtual:/usr/mailsuite/data/virtual/:LAYOUT=maildir++:INDEX=/usr/mailsuite/data/indexes/ prefix = All/ separator = / type = private } passdb { args = /usr/mailsuite/etc/dovecot/dovecot-sql.conf driver = sql } passdb { args = /usr/mailsuite/etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_allow_append_to_spam = no antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/mailsuite/scripts/sa-learn-pipe.sh antispam_mail_spam = --spam antispam_mail_tmpdir = /tmp antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_spam = SPAM antispam_spam_pattern = SPAM antispam_spam_pattern_ignorecase = SPAM antispam_trash = trash;Trash;Deleted Items; Deleted Messages antispam_trash_pattern = trash;Trash;Deleted * antispam_trash_pattern_ignorecase = trash;Deleted * antispam_unsure = antispam_unsure_pattern = antispam_unsure_pattern_ignorecase = fts = solr fts_decoder = decode2text fts_solr = break-imap-search url=http://localhost:8983/solr/ quota = dict:User quota::proxy::userquotadict quota2 = dict::%d:proxy::domainquotadict quota_rule = *:storage=100G quota_rule2 = Trash:storage=+20%% quota_rule3 = Spam:ignore quota_warning = storage=99%% quota-warning user 99 %d %n quota_warning2 = storage=95%% quota-warning user 95 %d %n quota_warning3 = storage=80%% quota-warning user 80 %d %n sieve = /usr/mailsuite/data/%d/%n/sieve.sieve sieve_before = /usr/mailsuite/etc/sieve/system.sieve sieve_dir = /usr/mailsuite/data/%d/%n/filters/ sieve_extensions = +spamtest +spamtestplus +relational +comparator-i;ascii-numeric sieve_global_dir = /usr/mailsuite/etc/sieve/ } protocols = imap pop3 lmtp sieve sendmail_path = /usr/mailsuite/bin/sendmail service auth { unix_listener auth-client { group = exim mode = 0666 user = exim } unix_listener auth-master { group = exim mode = 0666 user = exim } user = Sdefault_internal_user } service decode2text { executable = script /usr/mailsuite/libexec/dovecot/decode2text.sh unix_listener decode2text { mode = 0666 } user = exim } service dict { unix_listener dict { group = exim mode = 0600 user = exim } } service imap-login { inet_listener imap { port = 143 } } service imap-postlogin { executable = script-login /usr/mailsuite/scripts/dovecot-postlogin.sh user = root } service imap { executable = imap imap-postlogin } service indexer-worker { user = root vsz_limit = 768 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 vsz_limit = 64 M } service quota-warning { executable = script /usr/mailsuite/scripts/send_mail_warnquota.sh unix_listener quota-warning { user = exim } user = exim } ssl_cert =

2 1

[Dovecot] Errors with doveadm when using checkpassword
by Andy Dills 22 Feb '13

22 Feb '13

We have a checkpassword authentication with mysql pre-fetch for the userdb lookups. When trying to do: doveadm search -u andytest(a)xecu.net mailbox Trash DELETED I get: doveadm(andytest(a)xecu.net): Error: user andytest(a)xecu.net: Auth PASS lookup failed doveadm(andytest(a)xecu.net): Fatal: /var/run/dovecot/auth-userdb: passdb lookup failed (to see if user is proxied, because doveadm_proxy_port is set) And I see this in the logs: Feb 4 12:02:04 mail-out01 dovecot: auth: Error: userdb-checkpassword(andytest(a)xecu.net): Child 12591 exited with status 1 I'm not surprised the checkpassword lookup is failing; the password isn't being supplied. Shouldn't it just be doing the prefetch lookup instead, like the lmtp service? Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

2 6

[Dovecot] fts_solr search in subfolders?
by Frederic Biermann 22 Feb '13

22 Feb '13

Hello, i am using dovecot 2.1.x with Solr 4.x and it is all working fine. Search in current selected folder is extremly fast. But i want to ask if it is possible that i have selected inbox, setup a search and get results from subfolders. This is not working for me. I have to select the subfolder and then i get results. Is there any solution to fix this? best regards lexusburn

3 4

[Dovecot] Connection leak in sqlpool for ACL Dict Postgres in v2.1.15 (14907:b96df105ec55) and v2.2.beta1 (15857:07dfd4391d22)
by Steffen Kaiser 22 Feb '13

22 Feb '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm using a postgres dict for ACL, when when use deleteacl or setacl I get a "not connected" error and (v2.2) Panic: file driver-pgsql.c: line 84 (driver_pgsql_set_state): assertion failed: (state == SQL_DB_STATE_BUSY || db->cur_result == NULL) and a rawdump eventually. You can trigger the error with the "dict" socket easily: while true; do ( echo -en "H2\t0\t0\t\tacl\nI1\tshared/shared-boxes/\n" sleep 1 ) | socat - unix:/var/run/dovecot2.2/dict done I interprete H2-I1..-bang.log.gz (logged with v2.1) so, that each time the ACL dict is iterated, driver_sqlpool_query_s() is executed two times, once for user_shares and once for anyone_shares. I guess that the user_shares one is never finished, so that the sqlpool keeps that slot in "busy" state until timeout. The information about the slots of the log lines 0x9886d0 1. state=3 to_recon=(nil) ready=0 |driver_sqlpool_query_s end is generated by: conns = array_get(&db->all_connections, &count); for (i = 0; i < count; i++) { struct sql_db *conndb = conns[i].db; i_info("SKA: POOL: [%u] %p %u. state=%u to_recon=%p ready=%u |%s", getpid(), db, i, conndb->state, conndb->to_reconnect, SQL_DB_IS_READY(conndb)? 1: 0, msg); } msg is the function, where that log function is called from, e.g. at the end of driver_sqlpool_query_s() in this case, which is right before the return. When the user_shares query ends in driver_sqlpool_query_s(), one additional slot of the sqlpool is in state 3, at the end of driver_sqlpool_query_s() of the anyone_shares query there are two slots in state 3. When the next I1 command triggers the next iteration, there is one slot still in state 3 at the start of driver_sqlpool_query_s(), which seems to be the slot used for the user_shares query of the previous I1 command. It looks like that the user_shares query has not been "finished" correctly and is left open. The assert() panics, because db->cur_result is != NULL. When all slots in the pool have been used up, the sqlpool enters "not connected" state and all dict connections fail with this error now. Then the assert causes the dict to die eventually, I guess, because of a timeout. The quota dict seems to not trigger that behaviour, because it uses the "L" (lookup) command, but when the sqlpool is in "not connected" state, these commands fail, too. Attached you'll find the config and log file. Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUSTYgF3r2wJMiz2NAQLCGggAqcAThH8/phYIGxnkjEt3ECGBabCvDO72 L28rjvaakFffy5jmhrLrcV2b765W9XsZ/bhNOhfkQADAf8oCU9Z5q4h7wG+ZnoMj 4sd1Zax7wU/8idmrF1esSYAfZ1kCVq/ySHY7zs8stoWcpiUk6uQMN4ynYS7c3kxJ yaOWz31s0r4pS8muktq9qCwjlCXDjTigIiPbw9X5qpJ8hnvJq9Xv/BfW5uf1xKKK BXNB+HrQYrOA6VD3KCjteZhaquQFd18B9b35WkBH77thwSbaN1/R4zy8CLLpZOkS 5ss5K/doPitCunGRcNiVD8srgUU6Po7Zv0akBmE1XUfBKkn6JUILDQ== =VpqF -----END PGP SIGNATURE----- = Mailscanner Information [FB02] == Rename Filename At least one attachement has been renamed to overcome a potential filename attack. Right-click on the item and select SaveAs, in order to save the file with its original name. Mindestens ein Anhang wurde umbenannt, um eine potentielle Attacke mit unleserlichen Dateinamen zu verhinden. Um ihn mit seinem orginialen Namen zu speichern, klicken Sie rechts auf den Anhang und wählen SaveAs. See FAQ [http://www5.inf.fh-bonn-rhein-sieg.de/FAQ/mail/scan/] for more information. NewName |OldName ------------------+------------------- H2-I1.-bang.log.gz|H2-I1..-bang.log.gz -- This information was created by the mailscanner automatically. No human interferred with the process.

2 3

[Dovecot] Dovecot 2.2. proxy_maybe and twice SSL connections
by Evgeny Basov 22 Feb '13

22 Feb '13

Hello. 1. I have two identically hosts 2. I have set up replication between two hosts 3. I have 'Y' AS proxy_maybe in password_query. 4. password_query returns one of this one hosts 5. I set this parameters in dovecot config: disable_plaintext_auth = yes ssl = yes auth_mechanisms = plain login for enforce use encrypted connections by client programs. When the client connects to host imap2 directly, connection is encrypted, it is good. | client | ---- (1) ----> |imap2 (proxy_maybe='y', host = imap2)| And when the client connects to another host, I have (1) and (2) connections are encrypted | client | ---- (1) ----> |imap1 (proxy_maybe='y', host = imap2)| ---- (2) ----> |imap2| but need only (1). How do I have desired behavior? Is it possible?

3 5

[Dovecot] Using different auth_default_realm on multiple sockets with postfix. Is it possible?
by Gábor Lénárt 22 Feb '13

22 Feb '13

Hi, I have more postfix smtpd instances (via master.cf) listening on different ports, and the FW passes the inbound mail submit connections to the right port. The problem: it seems postfix is not able to append "default realm" and I need to set different values for the instances. As far as I see, it's not possible as postfix only passes the base64 encoded string from the user to the dovecot auth service (as I'm using dovecot for sasl authentication). We're talking about PLAIN and LOGIN methods. In the other hand, dovecot is happily append "realm" with auth_default_realm. It works (which does not with postfix) but again: I need more defaults. I wouldn't like to run multiple instances of dovecot (just for having a single setting be different), so I've tried similar solutions: service auth { unix_listener /var/spool/postfix/private/auth-dom1 { group = postfix mode = 0660 user = postfix } auth_default_realm = domain1.com } And the same for /var/spool/postfix/private/auth-dom2 with domain2.com. I thought then I could use postfix's master.cf to give different auth socket (like /var/spool/postfix/private/auth-dom1 and auth-dom2) with smtpd_sasl_path postfix parameter. However it seems dovecot finds auth_default_realm invalid unless it's used in the global scope of the configuration. It's dovecot 2.0.19 (in Ubuntu 12.04 LTS). Is it possible at all, what I would like to do? Maybe with newer dovecot, or can you suggest me some other solution? Any feedback is welcomed and thanked. Thanks, - Gábor

2 1

[Dovecot] Errors after enable vnd.dovecot.duplicate
by Alessio Cecchi 22 Feb '13

22 Feb '13

Hi, on dovecot 2.1.14 and pigeonhole-0.3.3 after creating a default.sieve like this: require ["vnd.dovecot.duplicate", "fileinto", "mailbox"]; if duplicate { fileinto "Trash"; } I have two strange errors, one is many of this error in lda.log: Feb 19 14:43:17 lda(info(a)domain.com): Error: file_dotlock_create(/home/vpopmail/domains/domain.com/info/.dovecot.lda-dup… failed: Resource temporarily unavailable Feb 19 14:43:43 lda(info(a)domain.com): Error: file_dotlock_create(/home/vpopmail/domains/domain.com/info/.dovecot.lda-dup… failed: Resource temporarily unavailable Feb 19 14:44:29 lda(info(a)domain.com): Error: rename(/home/vpopmail/domains/domain.com/info/.dovecot.lda-dupes.lock, /home/vpopmail/domains/domain.com/info/.dovecot.lda-dupes) failed: No such file or directory Feb 19 14:44:29 lda(info(a)domain.com): Error: file_dotlock_replace(/home/vpopmail/domains/domain.com/info/.dovecot.lda-du… failed: No such file or directory Note that my mailboxes are store on NFS. This happens for many accounts. Another error is that some messages have not Message-ID in lda.log and when this happens emails are treated as duplicate: # grep "msgid=: stored" /var/log/dovecot/lda.log Feb 18 08:02:13 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'INBOX' Feb 18 09:37:06 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 10:29:37 lda(cracigna(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 11:38:00 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 12:09:22 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 16:10:52 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 19 14:18:19 lda(cracigna(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 19 14:24:21 lda(panizzon(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'INBOX' After some investigations this emails are sent all from the same user with a Lotus Domino Server. Can these errors be solved? My dovecot configuration: # 2.1.14: /usr/local/dovecot-2.1/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_cache_size = 512 k auth_worker_max_count = 60 default_login_user = nobody dict { acl = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-share-folder.conf expire = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl zlib expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = cache_key=%s%u webmail=192.168.13.215 driver = vpopmail } plugin { acl = vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_default = /usr/local/dovecot-2.1/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { service_count = 0 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service quota-warning { executable = script /usr/local/dovecot-2.1/etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </usr/local/dovecot-2.1/etc/ssl/wildcard.pem ssl_key = </usr/local/dovecot-2.1/etc/ssl/wildcard.key submission_host = localhost userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { log_path = /var/log/dovecot/lda.log mail_plugins = quota acl zlib expire sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins mail_max_userip_connections = 18 mail_plugins = quota acl zlib expire imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 5 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

3 4

[Dovecot] Full-text search
by Valery V. Sedletski 22 Feb '13

22 Feb '13

Hi all I discovered that the full-text search (fts) plugin can work without SQUAT/LUCENE/SOLR backend. I.e., Dovecot creates separate indexes for header search in files dovecot.index and dovecot.index.cache. Even, the search by headers is fast enough, and can search for phrases. Also, it seems that this buillt-in search is faster than Solr-based search. But if I enable the Solr backend (fts_solr), then the FTS generic plugin built-in search becomes disabled. But, Solr-based Full-text search is faster if search inside message bodies. Also, it appears that the built-in search inside message bodies works too, but very slow (it seems that is because it is dumb file-based search and does not use indexes at all) So, my question is: is it possible to combine the built-in search with Solr or Lucene plugin-based search so that the first one searches by headers, and the second one works by bodies? This could make the advantages of both search methods combined. WBR, valery

2 1

[Dovecot] LDA misbehavior?
by Eugene Paskevich 22 Feb '13

22 Feb '13

Hello, Could somebody please give me a hint on what might be going wrong? Feb 21 16:33:07 hopper dovecot: lda(eugene): Panic: file mail-storage.c: line 1757 (mailbox_transaction_commit_get_changes): assertion failed: (ret < 0 || seq_range_count(&changes_r->saved_uids) == save_count) Feb 21 16:33:07 hopper dovecot: lda(eugene): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6019a) [0x7f38e5ef619a] -> /usr/lib/dovecot/ibdovecot.s o.0(i_syslog_fatal_handler+0x2b) [0x7f38e5ef621b] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f38e5eb81f4] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x7c0de) [0x7f38e61cd0de] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1b2) [0x7f38e6469d62] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xe3) [0x7f38e646a113] -> /usr/lib/dovecot/dovecot-lda(main+0x38a) [0x40295a] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f38e5b2aead] -> /usr/lib/dovecot/dovecot-lda() [0x4031e1] Feb 21 16:33:07 hopper exim[10094]: 1U8XCf-0002Za-4s ** eugene(a)hopper.volia.net <root(a)hopper.volia.net> R=local_user T=dovecot_delivery: Child process of dovecot_delivery transport (running command "/usr/lib/dovecot/dovecot-lda -f $sender_address -a $original_local_part@$original_domain") was terminated by signal 6 (Aborted) Feb 21 16:33:07 hopper exim[10094]: 1U8XCf-0002Za-4s Frozen (delivery error message) It started a couple of days ago. Triggered by the mass delivery. E.g. by for i in {1..50}; do { mail -s "test $i" eugene(a)hopper.volia.net <<< "Try $i" & }; done I suspected that sieve might cause that, but disabling it gave nothing. Current root@hopper[pts/0]:/etc/dovecot> doveconf -n # 2.2.beta1 (808a64899e8a): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.0 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } postmaster_address = hopper(a)volia.net protocols = imap service imap-login { inet_listener imap { port = 143 } inet_listener imap2 { port = 1357 } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } Is there any other info I could provide? -- Eugene Paskevich | *==)----------- | Plug me into eugene(a)raptor.kiev.ua | -----------(==* | The Matrix

2 1

[Dovecot] Bug: empty m-files
by Peer Heinlein 22 Feb '13

22 Feb '13

Having an empty m-File, doveadm force-resync isn't able to detect and repair this: -rw------- 1 vmail vmail 4948043 8. Jan 20:32 m.634 -rw------- 1 vmail vmail 5237411 8. Jan 20:32 m.635 -rw------- 1 vmail vmail 0 9. Jan 16:23 m.636 mail1:~ # doveadm force-resync -u user mailbox INBOX doveadm(user): Warning: fscking index file /vmail/example.com/user//mdbox/storage/dovecot.map.index doveadm(user): Warning: mdbox /vmail/example.com/user//mdbox/storage: rebuilding indexes doveadm(user): Error: Corrupted dbox file /vmail/example.com/user//mdbox/storage/m.636 (around offset=0): EOF while reading file header doveadm(user): Error: mdbox rebuild: Failed to fix file /vmail/example.com/user//mdbox/storage/m.636 doveadm(user): Error: mdbox /vmail/example.com/user//mdbox/storage: Duplicate GUID 2cafdd2f0224ec50773c0000085c1439 in m.627:16 and m.638:16 Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Crash in dsync [dovecot 2.1.7]
by Joe Beaubien 22 Feb '13

22 Feb '13

Just taught i'd report this crash while running the ofllowing command: 19748 Aborted (core dumped) $DSYNC_BINARY -f -u document backup mdbox:$LOCAL_BACKUP_PATH/emails/document >> $LOG_FILE 2>&1 Here is the traceback I got: dsync(document): Error: Mailbox INBOX/Julie: Corrupted index, uidvalidity=0 dsync(document): Warning: mdbox /backup_hdd/current/emails/document/storage: rebuilding indexes dsync(document): Panic: file mdbox-storage-rebuild.c: line 66 (mdbox_storage_rebuild_init): assertion failed: (!storage->rebuilding_storage) dsync(document): Error: Raw backtrace: /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x4203a) [0x7faa3bbde03a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7faa3bbde0fa] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7faa3bbb53f0] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_rebuild_in_context+0x117e) [0x7faa3be656de] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x23a) [0x7faa3be62b1a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync+0x33) [0x7faa3be630f3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x7e) [0x7faa3be631be] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7faa3bea2871] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7faa3bea2997] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_mark_index_deleted+0x9b) [0x7faa3bea3aeb] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0x85) [0x7faa3bea3a25] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_rebuild_in_context+0xb7b) [0x7faa3be650db] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x23a) [0x7faa3be62b1a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync+0x33) [0x7faa3be630f3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x7e) [0x7faa3be631be] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7faa3bea2871] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7faa3bea2997] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x8a) [0x7faa3bec47da] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xc002) [0x7faa3a775002] -> /opt/dovecot/bin/dsync() [0x42bf9a] -> /opt/dovecot/bin/dsync(dsync_worker_mailbox_iter_next+0x29) [0x428eb9] -> /opt/dovecot/bin/dsync() [0x423bfe] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x832) [0x4233a2] -> /opt/dovecot/bin/dsync(dsync_brain_sync_all+0x18) [0x423ee8] -> /opt/dovecot/bin/dsync() [0x420f36] -> /opt/dovecot/bin/dsync() [0x4215b2] -> /opt/dovecot/bin/dsync() [0x40e798] -> /opt/dovecot/bin/dsync() [0x40f1ea]

2 1

[Dovecot] Problem with managesieve proxy
by Lance A. Brown 22 Feb '13

22 Feb '13

Hi folks, I'm setting up a new dovecot email service and have a proxy server running in front of it to facilitate migrating users from my very old UW-IMAP-based mail server to the new one. I have a mysql proxy table that directs inbound IMAP and LMTP connections to the correct server, works great. Managesieve connections are not working through the proxy using either with the sieverules plugin for RoundCube or the Sieve plugin for Thunderbird. If I point them directly at the actual dovecot server everything works fine, so I must have something wrong in my proxy setup. This is what I get in the maillogs when I try to connect to the managesieve proxy: PROXY machine: Feb 21 16:16:38 sortie dovecot: managesieve-login: Error: proxy: Remote x.y.z.110:4190 disconnected: Connection closed (state=0, duration=0s): user=<brown>, method=PLAIN, rip=x.y.z.83, lip=x.y.z.109, TLS, session=<0jUal0LWswCYAxZT> Feb 21 16:16:38 sortie dovecot: managesieve-login: Disconnected (internal failure, 1 succesful auths): user=<brown>, method=PLAIN, rip=x.y.z.83, lip=x.y.z.109, TLS, session=<0jUal0LWswCYAxZT> SERVER machine: Feb 21 16:16:38 postie dovecot: managesieve-login: Disconnected: Too many invalid commands. (no auth attempts in 0 secs): user=<>, rip=x.y.z.109, lip=x.y.z.110, session=<REgal0LWnQCYAxZt> Output of a 'tcpdump -A' is attached as well if needed. x.y.z.83 - Roundcube webmail server x.y.z.109 - PROXY x.y.z.110 - SERVER If I turn off TLS all-around I get an error in the roundcube log that says: [20-Feb-2013 23:02:27] No supported authentication method found. The server supports these methods: , but we want to use: PLAIN (): [20-Feb-2013 23:02:27] Not currently in AUTHORISATION state (1): I am using Pigeonhole 0.3.3 on both proxy and server. Dovecot configurations for the proxy and server are attached below. Here are the SQL files referenced in the proxy configs. Long lines broke for readability. /etc/dovecot/dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=dovecot user=dovecot password=XXX password_query = SELECT NULL AS password, 'any-cert' as 'ssl', \ 'Y' as nopassword, host, user as destuser, \ 'Y' AS proxy \ FROM proxy WHERE user = '%u' /etc/dovecot/dovecot-sql-lmtp.conf.ext driver = mysql connect = host=localhost dbname=dovecot user=dovecot password=XXX password_query = SELECT NULL AS password, 'any-cert' as 'ssl', \ 'Y' as nopassword, host, user as destuser, 'Y' AS proxy \ FROM proxy WHERE user = '%n' The proxy DB table looks like this: - -- Table structure for table `proxy` -- CREATE TABLE IF NOT EXISTS `proxy` ( `id` int(11) NOT NULL AUTO_INCREMENT, `user` varchar(255) NOT NULL, `email` varchar(64) NOT NULL, `host` varchar(16) DEFAULT NULL, PRIMARY KEY (`id`), UNIQUE KEY `user_index` (`user`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 AUTO_INCREMENT=379 ; -- -- Dumping data for table `proxy` -- INSERT INTO `proxy` (`id`, `user`, `email`, `host`) VALUES (1, 'brown', '', 'x.y.z.110'), (2, 'fizgig', '', 'x.r.z.15'), 110 is the new dovecot IMAP server, 15 is the old UW-IMAP server. Any advice on getting managesieve proxy running would be greatly appreciated. Thanks, --[Lance] -- GPG Fingerprint: 409B A409 A38D 92BF 15D9 6EEE 9A82 F2AC 69AC 07B9 CACert.org Assurer

1 1

[Dovecot] Dovecot list archives not updating
by Mark Sapiro 22 Feb '13

22 Feb '13

The February archive indexes of this list haven't been updating since Feb 8. The text file at <http://dovecot.org/pipermail/dovecot/2013-February.txt> appears to be up to date with all posts, but the index pages at <http://dovecot.org/pipermail/dovecot/2013-February/thread.html>, <http://dovecot.org/pipermail/dovecot/2013-February/subject.html>, <http://dovecot.org/pipermail/dovecot/2013-February/author.html> and <http://dovecot.org/pipermail/dovecot/2013-February/date.html> have no posts after the one at <http://dovecot.org/pipermail/dovecot/2013-February/071213.html> from Fri Feb 8 16:31:49 EET 2013. Subsequent posts appear to not have individual HTML pages either as URLs <http://dovecot.org/pipermail/dovecot/2013-February/071214.html> and <http://dovecot.org/pipermail/dovecot/2013-February/071215.html> return 404 errors. I suspect there is a permissions issue starting soon after Fri Feb 8 16:31:49 EET 2013 and that Mailman's error log has lots of tracebacks from this. If that is the case, the messages were probably all shunted and running Mailman's bin/unshunt after fixing the underlying issue and also making sure that any messages older than Fri Feb 8 16:31:49 EET 2013 in Mailman's 'shunt' queue that should not also be reprocessed are removed. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

[Dovecot] Public folders and dsync replication Dovecot v2.1.7
by Steve Brown 21 Feb '13

21 Feb '13

Dear all I have a few public folders setup and working fine, and one such public folder is 'Public/General'. I'm trying to sort dsync replication out to another server and notice that the system log is full of error messages similar to: dovecot: doveadm: Error: dsync-remote(username: Error: Can't update subscription Pu blic/General: Invalid mailbox name The replication setup is basically as per the v2 wiki. It seems that when a mail client subscribes to a public folder, the folder name is put into '~/Maildir/subscriptions' and this seems to be the cause of the error during replication. The mails are not synchronised to the other server. Public namespace is: namespace { type = public separator = / prefix = Public/ location = maildir:/home/shared/public subscriptions = no list = yes } Hopefully somebody can send the clue bus over? Steve -- Steve Brown Operations Manager Connection Services Ltd +44 (0)1189 711 765 Direct +44 (0)870 751 7571 Fax www.connectionservices.com www.hotspot-directory.com

3 2

Re: [Dovecot] Dovecot LDA LDAP lookups on samba4 server ends very often in timeouts (Christian Wiese)
by Marco Carcano 21 Feb '13

21 Feb '13

Dear Christian thank you very much - you got it at the very first shot: modified /etc/ openldap/ldap.conf adding REFERRALS off en everything works without issues now many thanks Marco Carcano

1 0

[Dovecot] Dovecot LDA LDAP lookups on samba4 server ends very often in timeouts
by marco＠carcano.ch 20 Feb '13

20 Feb '13

I hope that someone will be so kind to help me into solving this really strange thing (don't know if it is a bug or not) I have a samba4 server and want to use postfix+dovecot - dovecot version is 2.0.11 as for the postfix side everything is OK (all the LDAP lookups works without any error, tested also manually with postmap -q) the real pain is with dovecot deliver: it seems that sometimes lda tries to lookup to the LDPA (samba 4) server, got a reply, an then report(after 2 minutes) a lookup timeout error the really strange thing is that (very seldom) lda works, but most of the times I got the timeout error. The strange thing is that if I use ldapsearch I never got timeout neither late replies, and even postfix performs its lookups without any issue it seems something related to lda itself (I do not know if I have a wrong configuration, but I think this is not a configuration issue, otherwise it should not work at all) here are the information logged when it does not work - after this log you will find the one when I got the failure (if needed I can provide a .pcap file too) (trailing and leading spaces of AT charcater has been added by me) ############################## FAULTY DELIVER LOG ############################################# Feb 20 12:20:50 sng02 postfix/smtpd[8928]: connect from localhost[127.0.0.1] Feb 20 12:21:14 sng02 postfix/smtpd[8928]: A38D4407F5: client=localhost[127.0.0.1] Feb 20 12:21:20 sng02 postfix/cleanup[8891]: A38D4407F5: warning: header Subject: prova from localhost[127.0.0.1]; from=<marco @ senderdomain.tld> to=<mac @ mydomain.com> proto=SMTP helo=<senderdomain.tld> Feb 20 12:21:20 sng02 postfix/cleanup[8891]: A38D4407F5: message-id=<20130220112114.A38D4407F5 @ srv01.mydomain.local> Feb 20 12:21:20 sng02 postfix/qmgr[8889]: A38D4407F5: from=<marco @ senderdomain.tld>, size=371, nrcpt=1 (queue active) Feb 20 12:21:20 sng02 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Feb 20 12:21:20 sng02 dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Feb 20 12:21:20 sng02 dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib20_expire_plugin.so Feb 20 12:21:20 sng02 dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Feb 20 12:21:20 sng02 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Feb 20 12:21:20 sng02 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Feb 20 12:21:20 sng02 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Feb 20 12:21:20 sng02 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_pgsql.so Feb 20 12:21:20 sng02 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Feb 20 12:21:20 sng02 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_bind Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_simple_bind Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_sasl_bind Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_new_connection 1 1 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_open_connection Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_connect_to_host: TCP localhost:389 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_new_socket: 16 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_prepare_socket: 16 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_connect_to_host: Trying ::1 389 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_pvt_connect: fd: 16 tm: -1 async: 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_open_defconn: successful Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_server_request Feb 20 12:21:20 sng02 dovecot: auth: Debug: master in: USER#0111#011marco.carcano#011service=lda Feb 20 12:21:20 sng02 dovecot: auth: Debug: password(marco.carcano): passdb doesn't support credential lookups Feb 20 12:21:20 sng02 dovecot: auth: Error: static(marco.carcano): passdb doesn't support lookups, can't verify user's existence Feb 20 12:21:20 sng02 dovecot: auth: Debug: ldap(marco.carcano): user search: base=DC=mydomain,DC=local scope=subtree filter=(sAMAccountname=marco.carcano) fields=Mailbox,dovecotMailQuota Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_result ld 0x6cba60 msgid -1 Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg ld 0x6cba60 msgid -1 (timeout 0 usec) Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg continue ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Connections: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Outstanding Requests: Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 1, origid 1, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 request count 1 (abandoned 0) Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Response Queue: Feb 20 12:21:20 sng02 dovecot: auth: Error: Empty Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 response count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x6cba60 NULL Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_select Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 1 message type bind Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 0 new referrals Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: mark request completed, ld 0x6cba60 msgid 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: request done: ld 0x6cba60 msgid 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: res_errno: 0, res_error: <>, res_matched: <> Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_free_request (origid 1, msgid 1) Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_parse_result Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_search Feb 20 12:21:20 sng02 dovecot: auth: Error: put_filter: "(sAMAccountname=marco.carcano)" Feb 20 12:21:20 sng02 dovecot: auth: Error: put_filter: simple Feb 20 12:21:20 sng02 dovecot: auth: Error: put_simple_filter: "sAMAccountname=marco.carcano" Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_server_request Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_msgfree Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_result ld 0x6cba60 msgid -1 Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg ld 0x6cba60 msgid -1 (timeout 0 usec) Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg continue ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Connections: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Outstanding Requests: Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 request count 1 (abandoned 0) Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Response Queue: Feb 20 12:21:20 sng02 dovecot: auth: Error: Empty Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 response count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x6cba60 NULL Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_select Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_result ld 0x6cba60 msgid -1 Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg ld 0x6cba60 msgid -1 (timeout 0 usec) Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg continue ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Connections: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Outstanding Requests: Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 request count 1 (abandoned 0) Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Response Queue: Feb 20 12:21:20 sng02 dovecot: auth: Error: Empty Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 response count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x6cba60 NULL Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_select Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 2 message type search-entry Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_first_attribute Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_get_values Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_next_attribute Feb 20 12:21:20 sng02 dovecot: auth: Debug: ldap(marco.carcano): result: dovecotMailQuota(quota_rule=%$)=*:storage=8192M Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_msgfree Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_result ld 0x6cba60 msgid -1 Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg ld 0x6cba60 msgid -1 (timeout 0 usec) Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg continue ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Connections: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Outstanding Requests: Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 request count 1 (abandoned 0) Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Response Queue: Feb 20 12:21:20 sng02 dovecot: auth: Error: Empty Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 response count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x6cba60 NULL Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_select Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid -1 all 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 2 message type search-reference Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chase_v3referrals Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_url_parse_ext(ldap://mydomain.local/CN=Configuration,DC=mydomain,DC=local) Feb 20 12:21:20 sng02 dovecot: auth: Error: re_encode_request: new msgid 3, new dn <CN=Configuration,DC=mydomain,DC=local> Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chase_v3referral: msgid 2, url "ldap://mydomain.local/CN=Configuration,DC=mydomain,DC=local" Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_server_request Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_new_connection 0 1 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_open_connection Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_connect_to_host: TCP mydomain.local:389 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_new_socket: 18 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_prepare_socket: 18 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.32.2:389 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_pvt_connect: fd: 18 tm: -1 async: 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_sasl_bind Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_send_server_request Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_result ld 0x6cba60 msgid 4 Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg ld 0x6cba60 msgid 4 (timeout 100000 usec) Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg continue ld 0x6cba60 msgid 4 all 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Connections: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: mydomain.local port: 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: rebind in progress Feb 20 12:21:20 sng02 dovecot: auth: Error: queue is empty Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 3 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Outstanding Requests: Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 4, origid 4, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 1, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 request count 2 (abandoned 0) Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Response Queue: Feb 20 12:21:20 sng02 dovecot: auth: Error: Empty Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 response count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x6cba60 msgid 4 all 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x6cba60 NULL Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_select Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 4 all 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 2 message type search-result Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 0 new referrals Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: mark request completed, ld 0x6cba60 msgid 2 Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg ld 0x6cba60 0 s 99952 us to go Feb 20 12:21:20 sng02 dovecot: auth: Error: wait4msg continue ld 0x6cba60 msgid 4 all 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Connections: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: mydomain.local port: 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: rebind in progress Feb 20 12:21:20 sng02 dovecot: auth: Error: queue is empty Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 20 12:21:20 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 20 12:21:20 sng02 dovecot: auth: Error: last used: Wed Feb 20 12:21:20 2013 Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Outstanding Requests: Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 4, origid 4, status InProgress Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: * msgid 2, origid 2, status RequestCompleted Feb 20 12:21:20 sng02 dovecot: auth: Error: outstanding referrals 1, parent count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 request count 2 (abandoned 0) Feb 20 12:21:20 sng02 dovecot: auth: Error: ** ld 0x6cba60 Response Queue: Feb 20 12:21:20 sng02 dovecot: auth: Error: Empty Feb 20 12:21:20 sng02 dovecot: auth: Error: ld 0x6cba60 response count 0 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x6cba60 msgid 4 all 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x6cba60 NULL Feb 20 12:21:20 sng02 dovecot: auth: Error: ldap_int_select Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 4 all 1 Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 msgid 4 message type bind Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: ld 0x6cba60 0 new referrals Feb 20 12:21:20 sng02 dovecot: auth: Error: read1msg: mark request completed, ld 0x6cba60 msgid 4 Feb 20 12:21:22 sng02 postfix/smtpd[8928]: disconnect from localhost[127.0.0.1] Feb 20 12:23:55 sng02 dovecot: lda: Error: userdb lookup(marco.carcano): Request timed out Feb 20 12:23:55 sng02 dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. Feb 20 12:23:56 sng02 postfix/pipe[8897]: A38D4407F5: to=<marco.carcano @ mydomain.local>, orig_to=<mac @ mydomain.com>, relay=dovecot, delay=171, delays=16/0.01/0/155, dsn=4.3.0, status=deferred (temporary failure) Feb 20 12:24:10 sng02 dovecot: master: Warning: Killed with signal 15 (by pid=8946 uid=0 code=kill) Feb 20 12:24:10 sng02 dovecot: auth: ldap(marco.carcano): Shutting down Feb 20 12:24:10 sng02 dovecot: auth: Debug: master out: FAIL#0111 Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_unbind Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_free_request (origid 2, msgid 3) Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_free_request (origid 2, msgid 2) Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_free_connection 1 1 Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_send_unbind Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_free_connection: actually freed Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_free_connection 1 1 Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_send_unbind Feb 20 12:24:10 sng02 dovecot: auth: Error: ldap_free_connection: actually freed Feb 20 12:24:18 sng02 postfix/postfix-script[8962]: stopping the Postfix mail system Feb 20 12:24:18 sng02 postfix/master[8886]: terminating on signal 15 ############################## END OF FAULTY DELIVER LOG ############################################# I'll add the log of a succefully delivered message in another mail (otherwise I exceed message size limit of the list)

2 1

Re: [Dovecot] Dovecot LDA LDAP lookups on samba4 server ends very often in timeouts
by marco＠carcano.ch 20 Feb '13

20 Feb '13

just to complete the informations of this thread, here is the log of a mail delivered succesfully (trailing and leading spaces of AT charcater has been added by me) ############################## MAIL SUCCEFFULLY DELIVERED LOG ############################################# Feb 19 17:41:01 sng02 postfix/smtpd[4006]: connect from localhost[127.0.0.1] Feb 19 17:41:28 sng02 postfix/smtpd[4006]: 95659407F5: client=localhost[127.0.0.1] Feb 19 17:41:36 sng02 postfix/cleanup[4011]: 95659407F5: warning: header Subject: prova from localhost[127.0.0.1]; from=<marco @ senderdomain.tld> to=<mac @ mydomain.com> proto=SMTP helo=<senderdomain.tld> Feb 19 17:41:36 sng02 postfix/cleanup[4011]: 95659407F5: message-id=<20130219164128.95659407F5 @ srv01.mydomain.local> Feb 19 17:41:36 sng02 postfix/qmgr[3992]: 95659407F5: from=<marco @ senderdomain.tld>, size=371, nrcpt=1 (queue active) Feb 19 17:41:36 sng02 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Feb 19 17:41:36 sng02 dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Feb 19 17:41:36 sng02 dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib20_expire_plugin.so Feb 19 17:41:36 sng02 dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Feb 19 17:41:36 sng02 dovecot: auth: Debug: master in: USER#0111#011marco.carcano#011service=lda Feb 19 17:41:36 sng02 dovecot: auth: Debug: password(marco.carcano): passdb doesn't support credential lookups Feb 19 17:41:36 sng02 dovecot: auth: Error: static(marco.carcano): passdb doesn't support lookups, can't verify user's existence Feb 19 17:41:36 sng02 dovecot: auth: Debug: ldap(marco.carcano): user search: base=DC=mydomain,DC=local scope=subtree filter=(sAMAccountname=marco.carcano) fields=Mailbox,dovecotMailQuota Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap(marco.carcano): Connection appears to be hanging, reconnecting Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_unbind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_request (origid 2, msgid 3) Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_request (origid 2, msgid 2) Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_connection 1 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_unbind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_connection: actually freed Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_connection 1 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_unbind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_connection: actually freed Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_create Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_bind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_simple_bind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_sasl_bind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_new_connection 1 1 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_open_connection Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_connect_to_host: TCP localhost:389 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_new_socket: 16 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_prepare_socket: 16 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_connect_to_host: Trying ::1 389 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_pvt_connect: fd: 16 tm: -1 async: 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_open_defconn: successful Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_server_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_result ld 0x666a60 msgid -1 Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg ld 0x666a60 msgid -1 (timeout 0 usec) Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg continue ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Connections: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Outstanding Requests: Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 1, origid 1, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 request count 1 (abandoned 0) Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Response Queue: Feb 19 17:41:36 sng02 dovecot: auth: Error: Empty Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 response count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x666a60 NULL Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_select Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid 1 message type bind Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 0 new referrals Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: mark request completed, ld 0x666a60 msgid 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: request done: ld 0x666a60 msgid 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: res_errno: 0, res_error: <>, res_matched: <> Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_free_request (origid 1, msgid 1) Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_parse_result Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_search Feb 19 17:41:36 sng02 dovecot: auth: Error: put_filter: "(sAMAccountname=marco.carcano)" Feb 19 17:41:36 sng02 dovecot: auth: Error: put_filter: simple Feb 19 17:41:36 sng02 dovecot: auth: Error: put_simple_filter: "sAMAccountname=marco.carcano" Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_server_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_search Feb 19 17:41:36 sng02 dovecot: auth: Error: put_filter: "(sAMAccountname=marco.carcano)" Feb 19 17:41:36 sng02 dovecot: auth: Error: put_filter: simple Feb 19 17:41:36 sng02 dovecot: auth: Error: put_simple_filter: "sAMAccountname=marco.carcano" Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_server_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_msgfree Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_result ld 0x666a60 msgid -1 Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg ld 0x666a60 msgid -1 (timeout 0 usec) Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg continue ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Connections: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 3 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Outstanding Requests: Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 3, origid 3, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 request count 2 (abandoned 0) Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Response Queue: Feb 19 17:41:36 sng02 dovecot: auth: Error: Empty Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 response count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x666a60 NULL Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_select Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_result ld 0x666a60 msgid -1 Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg ld 0x666a60 msgid -1 (timeout 0 usec) Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg continue ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Connections: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 3 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Outstanding Requests: Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 3, origid 3, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 request count 2 (abandoned 0) Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Response Queue: Feb 19 17:41:36 sng02 dovecot: auth: Error: Empty Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 response count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x666a60 NULL Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_select Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid 2 message type search-entry Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_msgfree Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_result ld 0x666a60 msgid -1 Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg ld 0x666a60 msgid -1 (timeout 0 usec) Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg continue ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Connections: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 3 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Outstanding Requests: Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 3, origid 3, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 request count 2 (abandoned 0) Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Response Queue: Feb 19 17:41:36 sng02 dovecot: auth: Error: Empty Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 response count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x666a60 NULL Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_select Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid -1 all 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid 2 message type search-reference Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chase_v3referrals Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_url_parse_ext(ldap://mydomain.local/CN=Configuration,DC=mydomain,DC=local) Feb 19 17:41:36 sng02 dovecot: auth: Error: re_encode_request: new msgid 4, new dn <CN=Configuration,DC=mydomain,DC=local> Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chase_v3referral: msgid 2, url "ldap://mydomain.local/CN=Configuration,DC=mydomain,DC=local" Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_server_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_new_connection 0 1 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_open_connection Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_connect_to_host: TCP mydomain.local:389 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_new_socket: 18 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_prepare_socket: 18 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.32.2:389 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_pvt_connect: fd: 18 tm: -1 async: 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_sasl_bind Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_initial_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_send_server_request Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_result ld 0x666a60 msgid 5 Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg ld 0x666a60 msgid 5 (timeout 100000 usec) Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg continue ld 0x666a60 msgid 5 all 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Connections: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: mydomain.local port: 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: rebind in progress Feb 19 17:41:36 sng02 dovecot: auth: Error: queue is empty Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 4 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Outstanding Requests: Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 5, origid 5, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 3, origid 3, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 0, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Feb 19 17:41:36 sng02 dovecot: auth: Error: outstanding referrals 1, parent count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 request count 3 (abandoned 0) Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Response Queue: Feb 19 17:41:36 sng02 dovecot: auth: Error: Empty Feb 19 17:41:36 sng02 dovecot: auth: Error: ld 0x666a60 response count 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList ld 0x666a60 msgid 5 all 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_chkResponseList returns ld 0x666a60 NULL Feb 19 17:41:36 sng02 dovecot: auth: Error: ldap_int_select Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid 5 all 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 msgid 2 message type search-result Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: ld 0x666a60 0 new referrals Feb 19 17:41:36 sng02 dovecot: auth: Error: read1msg: mark request completed, ld 0x666a60 msgid 2 Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg ld 0x666a60 0 s 99954 us to go Feb 19 17:41:36 sng02 dovecot: auth: Error: wait4msg continue ld 0x666a60 msgid 5 all 1 Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Connections: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: mydomain.local port: 0 Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 2 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: rebind in progress Feb 19 17:41:36 sng02 dovecot: auth: Error: queue is empty Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: * host: localhost port: 389 (default) Feb 19 17:41:36 sng02 dovecot: auth: Error: refcnt: 3 status: Connected Feb 19 17:41:36 sng02 dovecot: auth: Error: last used: Tue Feb 19 17:41:36 2013 Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: Feb 19 17:41:36 sng02 dovecot: auth: Error: ** ld 0x666a60 Outstanding Requests: Feb 19 17:41:36 sng02 dovecot: lda: Debug: auth input: marco.carcano quota_rule=*:storage=8192M Feb 19 17:41:36 sng02 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Effective uid=8, gid=12, home= Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota root: name=User quota backend=maildir args= Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 marco.carcano Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota warning: bytes=7301444403 (85%) messages=0 reverse=no command=quota-warning 85 marco.carcano Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota warning: bytes=6442450944 (75%) messages=0 reverse=no command=quota-warning 75 marco.carcano Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Feb 19 17:41:36 sng02 dovecot: lda: Error: user marco.carcano: Auth USER lookup failed Feb 19 17:41:36 sng02 dovecot: lda: Debug: auth input: Feb 19 17:41:36 sng02 dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/marco.carcano/Maildir Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: maildir++: root=/home/mailboxstore/marco.carcano/Maildir, index=, control=, inbox=/home/mailboxstore/marco.carcano/Maildir Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/%Lu/Maildir:INDEX=/home/mailboxstore/marco.carcano/Maildir/shared/%Lu Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: shared: root=/var/run/dovecot, index=, control=, inbox= Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: maildir++: root=/home/mailboxstore/public, index=, control=, inbox= Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: expire: No expire setting - plugin disabled Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota root: name=User quota backend=maildir args= Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota rule: root=User quota mailbox=* bytes=1073741824 messages=0 Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota warning: bytes=1020054732 (95%) messages=0 reverse=no command=quota-warning 95 marco.carcano Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota warning: bytes=912680550 (85%) messages=0 reverse=no command=quota-warning 85 marco.carcano Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota warning: bytes=805306368 (75%) messages=0 reverse=no command=quota-warning 75 marco.carcano Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: none: root=, index=, control=, inbox= Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Error: User marco.carcano doesn't have home dir set, disabling duplicate database Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: sieve: user's script path /home/mailboxstore/marco.carcano/.dovecot.sieve doesn't exist (using global script path in stead) Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: sieve: user has no valid personal script Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): Debug: sieve: no scripts to execute: reverting to default delivery. Feb 19 17:41:36 sng02 postfix/pipe[3995]: 7D9AE407E7: to=<marco.carcano @ mydomain.local>, orig_to=<mac @ mydomain.com>, relay=dovecot, delay=17102, delays=17034/0.05/0/68, dsn=4.3.0, status=deferred (temporary failure) Feb 19 17:41:36 sng02 dovecot: lda(marco.carcano): msgid=<20130219164128.95659407F5 @ srv01.mydomain.local>: saved mail to INBOX Feb 19 17:41:36 sng02 postfix/pipe[4013]: 95659407F5: to=<marco.carcano @ mydomain.local>, orig_to=<mac @ mydomain.com>, relay=dovecot, delay=22, delays=22/0.02/0/0.14, dsn=2.0.0, status=sent (delivered via dovecot service) Feb 19 17:41:36 sng02 postfix/qmgr[3992]: 95659407F5: removed Feb 19 17:41:38 sng02 postfix/smtpd[4006]: disconnect from localhost[127.0.0.1] ############################## END OF MAIL SUCCEFFULLY DELIVERED LOG #############################################

1 0

[Dovecot] Changin password in LDAP
by Arto Saraniva 20 Feb '13

20 Feb '13

We are using now dovecot 2.0.21 with open-ldap, but this situations has already taken a quite long time. When user changes the password, we have to reload dovecot every time, otherwise the change is ignored and dovecot sees only the old password. Any ideas where the problem might exist? Conf: # 2.0.21: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-308.24.1.el5 i686 CentOS release 5.9 (Final) auth_cache_size = 100 M auth_mechanisms = plain login auth_verbose = yes default_process_limit = 5000 disable_plaintext_auth = no info_log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir:INDEX=/var/spool/indexes/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:User Quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)artio.net service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { service_count = 0 } service imap-postlogin { executable = script-login /usr/local/sbin/dovecot-postscript-imap user = root } service imap { executable = imap imap-postlogin } service pop3-postlogin { executable = script-login /usr/local/sbin/dovecot-postscript-pop3 user = root } service pop3 { executable = pop3 pop3-postlogin } ssl_ca = </usr/share/ssl/certs/mail_artio_net-2012-geotrust.ca ssl_cert = </usr/share/ssl/certs/mail_artio_net-2012-geotrust.crt ssl_key = </usr/share/ssl/private/mail_artio_net-2012-geotrust.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = sieve quota } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } Dovecot-ldap.conf: # NOTE: We don't support "authentication binds", so you'll have to give # dovecot-auth read access to userPassword field in LDAP server. With OpenLDAP # this is done by modifying /etc/ldap/slapd.conf. There should already be # something like this: # access to attribute=userPassword # by dn="<dovecot's dn>" read # add this # by anonymous auth # by self write # by * none # Space separated list of LDAP hosts to use. host:port is allowed too. #hosts = hosts = 123.123.123.123 123.123.123.124 # Distinguished Name - the username used to login to the LDAP server #dn = # Password for LDAP server #dnpass = # LDAP protocol version to use. Likely 2 or 3. ldap_version = 3 # LDAP base #base = uid=someone, dc=foo, dc=bar, dc=org base = dc=artio,dc=net # Dereference: never, searching, finding, always deref = never # Search scope: base, onelevel, subtree scope = subtree # User attributes in order: # Virtual user name (user@domain) # Home directory # MAIL environment # System user name (for getting user's groups from /etc/group) # - For virtual users you don't want to use this, so this defaults to none. # System UID # System GID #user_attrs = uid,homeDirectory,,,uidNumber,gidNumber # user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid # user_attrs = cn,homeDirectory,,uid,uidNumber,gidNumber #user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,artioMailQuotaSize=quota_rule=*:storage=%$M # Filter for user lookup. Some variables can be used: # %u - username # %n - user part in user@domain, same as %u if there's no domain # %d - domain part in user@domain, empty if user there's no domain #user_filter = (&(objectClass=posixAccount)(uid=%u)) user_filter = (&(objectClass=posixAccount)(|(uid=%u)(mail=%u))) # Password checking attributes in order: # Virtual user name (user@domain) # Password, may optionally start with {type}, eg. {crypt} #pass_attrs = uid,userPassword # pass_attrs = cn,userPassword pass_attrs = uid=user, userPassword=password # Filter for password lookups #pass_filter = (&(objectClass=posixAccount)(uid=%u)) pass_filter = (&(objectClass=posixAccount)(|(uid=%u)(mail=%u))) # Default password scheme. "{scheme}" before password overrides this. # Currently supported schemes include PLAIN, PLAIN-MD5, DIGEST-MD5, CRYPT #default_pass_scheme = CRYPT default_pass_scheme = CRYPT # You can use same UID and GID for all user accounts if you really want to. # If the UID/GID is still found from LDAP reply, it overrides these values. #user_global_uid = #user_global_gid = Pam: /etc/pam.d/dovecot #%PAM-1.0 auth required pam_nologin.so auth include system-auth account include system-auth session include system-auth

1 0

[Dovecot] Dovecot 2 + Quota - CentOS 6.3
by drum.lucas＠gmail.com 20 Feb '13

20 Feb '13

Hello, I've a postfix+postfixadmin+mysql server+roundcubemail centos 6 mail server. My question is as follows: In postfixadmin it's possible that he show me how the mailbox is full. Show this information is dovecot service? What is the purpose of quota in dovecot? Thanks! *Lucas Possamai *

2 1

[Dovecot] 1.x with mbox files to 2.x with mdbox, I think?
by Ken A 20 Feb '13

20 Feb '13

Hi, I have a couple questions about migrating from 1.x to 2.x I'm needing to support larger mailbox sizes and mdbox seems like the right format to use to get larger size boxes and maintain, or possibly even increase speed. Is that correct? Am I correct that the best way to accomplish this migration is to copy the mboxes over to the new server and then use dsync to convert them to mdbox? Thanks for your thoughts! Ken -- Ken Anderson Pacific Internet - http://www.pacific.net Latest Pacific.Net Status - http://twitter.com/pacnetstatus

1 0

[Dovecot] Ping re: error running indexer-worker as non-root user
by Mike Abbott 19 Feb '13

19 Feb '13

Any hints about the issue I wrote about on Feb. 11? http://markmail.org/message/6g7itsu2u3fdnfkd Thanks.

1 0

[Dovecot] Dovecot-2.1.14 - pop3 processes always hangs forever - another follow-up
by Axel Luttgens 19 Feb '13

19 Feb '13

Hello, With the same basic configs as in my previous messages, I tried with the maildir format instead of the mbox format. That is, in both cases ("virtual" uids/gids vs a single "real" uid/gid), doveconf -n shows: mail_location = maildir:~/maildir instead of: mail_location = mbox:~/mboxes:INBOX=~/mboxes/inbox Here too, with "virtual" uids/gids, connections thru pop hang forever, while imap connections behave flawlessly. And with a single "real" uid/gid, connections thru both pop and imap behave as expected. As a result, it could be inferred that the problems I am encountering with pop connections do not depend on the mailbox format in use, and that they are entirely related to "virtual" uids/gids. To recap: with this very basic config # 2.1.14: /_ETC/dovecot/dovecot.conf # OS: Darwin 12.2.1 x86_64 auth_verbose = yes disable_plaintext_auth = no mail_debug = yes mail_location = mbox:~/mboxes:INBOX=~/mboxes/inbox passdb { args = /_ETC/dovecot/db.conf driver = sql } ssl = no userdb { driver = prefetch } a pop connection hangs forever after the pass command $ telnet 127.0.0.1 110 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user user2 +OK pass pass2 and the log shows (here, when the user connects for the first time) dovecot[2997]: pop3-login: Login: user=<user2>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3113, secured, session=<GTOlMjfV3gB/AAAB> dovecot[2997]: pop3(user2): Debug: Effective uid=100003, gid=100003, home=/_Data/Mailstores/100003 dovecot[2997]: pop3(user2): Debug: Home dir not found: /_Data/Mailstores/100003 dovecot[2997]: pop3(user2): Debug: fs: root=/_Data/Mailstores/100003/mboxes, index=, control=, inbox=/_Data/Mailstores/100003/mboxes/inbox, alt= dovecot[2997]: pop3(user2): Debug: Namespace : /_Data/Mailstores/100003/mboxes doesn't exist yet, using default permissions dovecot[2997]: pop3(user2): Debug: Namespace : Using permissions from /_Data/Mailstores/100003/mboxes: mode=0700 gid=-1 dovecot[2997]: pop3(user2): Debug: Namespace : /_Data/Mailstores/100003/mboxes/inbox doesn't exist yet, using default permissions dovecot[2997]: pop3(user2): Debug: Namespace : Using permissions from /_Data/Mailstores/100003/mboxes: mode=0700 gid=-1 dovecot[2997]: pop3(user2): Debug: Namespace : /_Data/Mailstores/100003/mboxes/inbox doesn't exist yet, using default permissions dovecot[2997]: pop3(user2): Debug: Namespace : Using permissions from /_Data/Mailstores/100003/mboxes: mode=0700 gid=-1 With exactly the same config, imap connections are fully functional. Does someone have an explanation? TIA, Axel

2 11

[Dovecot] Defer emails until the user is ready to deal with them (snooze button / bring-forward file / bring-up file for emails)
by Chris Laif 19 Feb '13

19 Feb '13

Hi, I would like to add a feature to my email-client (Thunderbird) which stops emails from showing up until a specific time (e.g. having buttons for: show again this evening, tomorrow, next week, next month ...). As far as I've learned this is not possible with IMAP: - storing the 'do-not-show-until-time' within a custom header-field requires down- and uploading of the whole email and therefore causes problems especially with large emails - IMAP keywords are limited are limited in quantity and can not be compared with datetime functions Any suggestions will be greatly appreciated! Chris

6 20

[Dovecot] Get rid of inotify in 2.1.15
by Martin Rabl 19 Feb '13

19 Feb '13

Hi, after update to Dovecot 2.1.5 (Ubuntu 12.04, dovecot from https://launchpad.net/~kokelnet/+archive/dovecot21) we are getting a huge ;-) bunch of log entries about " imap(USERNAME): Warning: Inotify instance limit for user 5000 (UID vmail)". At last I did an echo 512 > /proc/sys/fs/inotify/max_user_instances but the logentries did appear again after some minutes. Maybe you have a hint for me? Thank you! At the bottom my current configuration. -- Greetings, Martin Rabl # 2.1.15: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-36-generic x86_64 Ubuntu 12.04.2 LTS auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = * auth_mechanisms = plain login auth_proxy_self = auth_realms = auth_socket_path = /var/run/dovecot/auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 1 mins default_internal_user = vmail default_login_user = vmail default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-acl-sql.conf.ext } dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins director_username_hash = %u disable_plaintext_auth = yes dotlock_use_excl = yes doveadm_allowed_commands = doveadm_password = doveadm_proxy_port = 0 doveadm_socket_path = doveadm-server doveadm_worker_count = 0 dsync_alt_char = _ dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} first_valid_gid = 1 first_valid_uid = 500 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = in=%i out=%o imap_max_line_length = 64 k imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_ssl = no imapc_ssl_ca_dir = imapc_ssl_verify = yes imapc_user = %u import_environment = TZ info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/lib/dovecot listen = * lmtp_address_translate = lmtp_proxy = no lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = syslog log_timestamp = "%Y-%m-%d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c login_trusted_networks = mail_access_groups = vmail mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = mail_prefetch_count = 0 mail_privileged_group = vmail mail_save_crlf = no mail_shared_explicit_inbox = yes mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = vmail mailbox_idle_check_interval = 30 secs mailbox_list_index = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no namespace { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:%%Lh/Maildir/:INDEX=%%Lh/shared-idx/%%u:INBOX=%%Lh/Maildir/INBOX:LAYOUT=fs prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/srv/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = no special_use = \Junk } mailbox Sent { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = no special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/passwd.masterusers default_fields = deny = no driver = passwd-file master = yes override_fields = pass = no } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = deny = no driver = ldap master = no override_fields = pass = no } passdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = deny = no driver = sql master = no override_fields = pass = no } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts autosubscribe5 = public/Files autosubscribe6 = public/Groupware autosubscribe7 = public/EXAMPLE sieve = ~/.dovecot.sieve sieve_after = /srv/vmail/sieve/after.sieve sieve_before = /srv/vmail/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/sieve sieve_global_path = /srv/vmail/sieve/globalsieverc } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_host = pop3c_master_user = pop3c_password = pop3c_port = 110 pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_ca_dir = pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = postmaster(a)EXAMPLE.de protocols = imap sieve quota_full_tempfail = yes recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_full_sync_interval = 12 hours replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = vmail mode = 0660 user = vmail } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 2048 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = port = 4190 ssl = no } inet_listener sieve_deprecated { address = port = 2000 ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = </etc/ssl/imap.EXAMPLE.de-20110527-20160525.pem ssl_cert = </etc/ssl/imap.EXAMPLE.de-20110527-20160525.pem ssl_cert_username_field = commonName ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_client_cert = ssl_client_key = ssl_crypto_device = ssl_key = </etc/ssl/imap.EXAMPLE.de-20110527-20160525.pem ssl_key_password = ssl_parameters_regenerate = 1 weeks ssl_protocols = !SSLv2 ssl_require_crl = yes ssl_verify_client_cert = no stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_session_min_time = 15 mins stats_user_min_time = 1 hours submission_host = syslog_facility = mail userdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = driver = sql override_fields = } valid_chroot_dirs = verbose_proctitle = no verbose_ssl = no version_ignore = no protocol imap { imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags tb-extra-mailbox-sep mail_max_userip_connections = 10 mail_plugins = acl imap_acl autocreate } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve autocreate postmaster_address = postmaster(a)EXAMPLE.de quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags }

3 2

[Dovecot] statistics on proxy ???
by Marco Giunta 19 Feb '13

19 Feb '13

Hi at all, could I have imap statistics on my dovecot proxy server ?? Here my config: # 2.1.13: /etc/dovecot/dovecot.conf ... mail_plugins = stats ... plugin { ... stats_refresh = 30 secs stats_track_cmds = yes } ... service stats { fifo_listener stats-mail { mode = 0666 } } ... protocol imap { ... mail_plugins = stats imap_stats } File '/var/run/dovecot/stats' is always 0 byte: # ls -la /var/run/dovecot/stats srw-------. 1 root root 0 Feb 18 14:24 /var/run/dovecot/stats and 'dovecotadm' say always: # doveadm stats dump session doveadm(root): Info: no statistics available Is there something wrong in my config, or stats are not available on proxy ??? Cheers, Marco

2 2

[Dovecot] Private message flags in shared mailboxes
by Timo Sirainen 19 Feb '13

19 Feb '13

I'm wondering a bit how these should work. Comments welcome. In v2.2 the recommended way to enable private flags for shared mailboxes is to create private indexes with :INDEXPVT=<path>. This creates dovecot.index.pvt[.log] files which only contain message UIDs and flags. The indexes are updated somewhat lazily by updating them whenever user has the shared mailbox opened and it gets synced. 1. What would be a good place to configure which flags are shared and which are private? Currently it forces \Seen flag to be private and others not. With Maildir I used to have the idea of configuring these in dovecot-shared file, but that's a rather annoying extra file. Then again it could be cached into dovecot.index. Another possibility would be in dovecot-acl file, but public mailboxes might be enabled without ACL plugin. Mailbox attributes (for URLAUTH and for future METADATA) also exist in v2.2, but they require configuring a dict for them, which isn't very efficient either to read every time a mailbox is accessed. Mailbox's admin user should be able to do this somehow via IMAP protocol also. METADATA would pretty much be required for that I guess. 2. Private flags aren't currently inherited from the primary (shared) flags. With user-shared mailboxes this is good, because the owner doesn't have private indexes for the mailboxes, so when owner reads a mail it gets a \Seen flag in the primary index. If that mailbox was shared to someone else, the \Seen flag shouldn't be set. But this also means that for truly shared (public) mailboxes that have no owner you can't set initial flags with Sieve's addflag command (e.g. \Seen flag to high-scored mails in Spam). I guess it could be possible to change this so that the inheritance is done for public namespaces but not for shared namespaces, but is that really a good idea either?.. 3. Currently COPY/APPEND ignore any private flags (which also means dsync won't set them always). Fixing this would require remembering these flags, committing the save to primary index, syncing the private index to get the new mails added there, then updating their flags (or doing it directly at sync stage with some kludging code). To avoid race conditions the private index would need to be locked before committing the save. I guess this is doable.. 4. Private keywords aren't supported. I guess not much worse than system flags, but more code complexity. Wonder if anyone would care about them.

2 2

[Dovecot] Quota Problems with LMTP in HG 62a930eb22b5
by Thomas Leuxner 18 Feb '13

18 Feb '13

Since updating to the latest HG these errors occur. Nothing else changed in the config: $ dovecot --version 2.2.beta1 (62a930eb22b5) ==> /var/log/dovecot/dovecot.log <== Feb 18 09:47:32 spectre dovecot: lmtp(14340): Connect from local Feb 18 09:47:32 spectre dovecot: lmtp(14340, tlx(a)leuxner.net) Error: mkdir_parents(/var/vmail/domains/leuxner.net/tlx/mdbox) failed: File exists Feb 18 09:47:32 spectre dovecot: lmtp(14340, tlx(a)leuxner.net) Error: mkdir_parents(/var/vmail/domains/leuxner.net/tlx/mdbox) failed: File exists Feb 18 09:47:32 spectre dovecot: lmtp(14340, tlx(a)leuxner.net) Error: dict quota: Quota update failed, it's now desynced $ doveconf -n # 2.2.beta1 (62a930eb22b5): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-0.bpo.4-amd64 x86_64 Debian 6.0.6 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats mailbox_list_index = yes namespace { list = yes location = mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = " imap lmtp" quota_full_tempfail = yes service auth-worker { unix_listener auth-worker { user = doveauth } user = doveauth } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = </etc/ssl/certs/SSL123_CA_Bundle.pem ssl_cert = </etc/ssl/certs/host_domain_tld.crt ssl_key = </etc/ssl/private/host_domain_tld.key syslog_facility = local1 userdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = acl quota stats sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl quota stats mail_log notify imap_acl imap_quota imap_stats }

2 3

[Dovecot] Dsync converting dbox->Maildir
by Anes Mukhametov 17 Feb '13

17 Feb '13

Hi! I've changed my mailbox format from dbox to Maildir. The problem is maildir message filename extension has no S=/W= field after migration. Using dovecot 2.1.15.

2 3

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients
by Piotr Rotter 17 Feb '13

17 Feb '13

I configure director temporary in some tricky way because I have to serve md5 and ntlm authentication method and I do not want reconfigure pop/imap servers. Can you confirm I done all ok becouse I have that issue: # doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time <unknown> 192.168.111.24 2013-02-14 00:57:34 <unknown> 192.168.111.21 2013-02-14 00:57:46 yet everything else works ok My password_query: password_query = SELECT clear AS password, 'Y' as proxy, '%u' AS destuser, clear AS pass FROM postfix_users WHERE email = '%u' My director server config (dovecot -n): # dovecot -n # 2.1.13: /etc/dovecot/dovecot.conf # OS: Linux 3.7.1-hardened-r2 x86_64 Gentoo Base System release 2.1 auth_mechanisms = plain login digest-md5 cram-md5 ntlm apop auth_verbose = yes default_client_limit = 10000 default_process_limit = 10000 default_vsz_limit = 512 M deliver_log_format = from=%f, msgid=%m, psize=%p: %$ director_mail_servers = 192.168.111.21 192.168.111.22 192.168.111.23 192.168.111.24 192.168.111.25 192.168.111.26 director_servers = 195.78.67.29 director_user_expire = 2 hours disable_plaintext_auth = no passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = box msgid from size } protocols = imap pop3 service auth { client_limit = 10000 unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service director { inet_listener { port = 9090 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service pop3-login { executable = pop3-login director } ssl_ca = </etc/ssl/dovecot.ca ssl_cert = </etc/ssl/dovecot.crt ssl_key = </etc/ssl/dovecot.key

2 4

[Dovecot] Virtual Users Dovecot and Postfix
by Silvio Siefke 17 Feb '13

17 Feb '13

Hello, i want setup my Mailserver with the Tutorial on Dovecot Wiki. http://wiki2.dovecot.org/HowTo/VirtualUserFlatFilesPostfix I have one question for this, must i set the Mailadresses in /etc/postfix/virtual too or is the passwd File from dovecot enough? Thank you for help & Greetings Silvio

3 5

[Dovecot] doveadm -D quota get -u user
by Robert Schetterer 16 Feb '13

16 Feb '13

Hi Timo, just running into problems with doveadm -D quota get -u user doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_expire_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_lucene_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so doveadm(root): Fatal: Unknown command 'quota', but plugin quota exists. Try to set mail_plugins=quota should mail_plugins=quota really be set ? dovecot --version 2.1.12 (abcc9959b757) Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich

2 2

[Dovecot] proxy imaps
by Antonio Casado Rodriguez 16 Feb '13

16 Feb '13

Hi all, I had a imaps dovecot server working normal. I wanted to isolate the Internet connection by placing a proxy imap(Intranet connections still connect directly to the imap server). Yesterday I set up oneproxy imaps dovecot and thereafter, imap dovecot logs on errors: imap-login: Error: OpenSSL malloc() failed. You may need to increase login_process_size Need dovecot more memory with imap proxy connections than direct connections? Regards -- Antonio Casado Rodríguez Administrador de Servicios de Red y Seguridad TIC Área de Comunicaciones STIC (Servicio de las Tecnologías de la Información y las Comunicaciones) UNIVERSIDAD DE ALMERÍA Este mensaje y los ficheros que puedan ser adjuntados son confidenciales. Los mismos contienen información reservada que no puede ser difundida. Si usted ha recibido este correo por error, tenga la amabilidad de eliminarlo de su sistema y avisar al remitente mediante reenvío a su dirección electrónica; no deberá copiar el mensaje ni divulgar su contenido a ninguna persona. Su dirección de correo electrónico junto a sus datos personales constan en un fichero titularidad de La UNIVERSIDAD DE ALMERÍA cuya finalidad es la de mantener el contacto con usted. Si quiere saber de qué información disponemos de usted, modificarla, y en su caso, cancelarla, puede hacerlo enviando un escrito al efecto, acompañado de una fotocopia de su D.N.I. a la siguiente dirección: UNIVERSIDAD DE ALMERÍA –. Secretaría General de La Universidad de Almería. Edificio Central, Planta baja. Ctra. Sacramento s/n, La Cañada de San Urbano. CP 04120 Almería

2 1

[Dovecot] Segfault with doveadm-server
by Evgeny Basov 16 Feb '13

16 Feb '13

Hello. With dovecot ver. from 20130211 I have a segfault on doveadm when sync. There are messages from server: 2013-02-14T12:42:35.508031+04:00 imap1 kernel: [870542.927083] doveadm-server[9483]: segfault at 4 ip 00000074b228bc24 sp 000003f30b8e61b0 error 4 in doveadm-server[74b226b000+3a000] or 2013-02-14T12:47:39.850942+04:00 imap1 kernel: [870847.279513] doveadm[9513]: segfault at 4 ip 00000006b31ac294 sp 000003dc5c669a90 error 4 in doveadm[6b3178000+5f000] I cannot catch process doveadm-server by strace because it starts with unknown PID on demand.

3 4

[Dovecot] dovecot-2.2: dsync to imapc not working
by Evgeny Basov 16 Feb '13

16 Feb '13

Hello. I have dovecot installation # dovecot --version 20130205 (03a0af22100d+) built with imapc backend. I'm tried to sync mailboxes from another server after clean mail directory localy: # dsync -v -o imapc_user="user(a)example.org" -o imapc_password="pass" -o imapc_host=imap.example.org -o imapc_features=rfc822.size -o mailbox_list_index=no backup -R -f -u "user(a)example.org" imapc: and get this message dsync(user(a)example.org): Error: Exporting mailbox INBOX failed: Backend doesn't support GUIDs, sync with header hashes instead Repeated command returns this one message: dsync(user(a)example.org): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. What wrong with this build? Maybe there is another way to do it? For example create backup in local temporary directory and synchronize this one and working storage.

2 3

[Dovecot] accumulating orphaned processes
by Jeff Gustafson 16 Feb '13

16 Feb '13

I'm getting orphaned processes on our mail servers. Some machines has processes hanging around from a week ago. I'm running the current stable of dovecot 2.1.15, but the problem has been happening for a while now. I thought it would be good to report the issue. I ran an strace on one of them and this is the output: Process 21370 attached - interrupt to quit open("/var/run/dovecot/stats-mail", O_WRONLY) = 7 write(7, "DISCONNECT\ta09ade0350d81d517a530"..., 44) = 44 munmap(0x7f1ad8a8d000, 266240) = 0 close(13) = 0 close(12) = 0 epoll_ctl(9, EPOLL_CTL_DEL, 11, {0, {u32=17384128, u64=17384128}}) = 0 close(11) = 0 close(7) = 0 munmap(0x7f1ada5d6000, 2106272) = 0 munmap(0x7f1ada7d9000, 2161360) = 0 munmap(0x7f1ada3cf000, 2124136) = 0 munmap(0x323c800000, 2162768) = 0 munmap(0x7f1ad9fc8000, 2102976) = 0 munmap(0x7f1ada1ca000, 2114728) = 0 epoll_ctl(9, EPOLL_CTL_DEL, 4, {0, {u32=17319120, u64=17319120}}) = 0 close(4) = 0 close(8) = 0 close(9) = 0 exit_group(0) = ? Process 21370 detached As you can see, the process exited at that point. Any ideas? ...Jeff

2 1