- dovecot - dovecot.org

Re: [Dovecot] Possible mdbox corruption
by Daniel L. Miller 09 Jan '12

09 Jan '12

On 1/6/2012 12:32 PM, Daniel L. Miller wrote: > On 1/6/2012 9:36 AM, Timo Sirainen wrote: >> On 6.1.2012, at 19.30, Daniel L. Miller wrote: >> >>> Jan 6 09:22:42 bubba dovecot: indexer-worker(user1(a)domain.com): >>> Error: fts_solr: Indexing failed: 400 Illegal character ((CTRL-CHAR, >>> code 18)) at [row,col {unknown-source}]: [482765,16] >>> Jan 6 09:22:42 bubba dovecot: indexer-worker: Error: >>> >>> Google seems to indicate that Solr cannot handle "invalid" >>> characters - and that it is the responsibility of the calling >>> program to strip out such. A quick search shows me a both an >>> individual character comparison in Java and a regex used for the >>> purpose. Is there any "illegal character protection" in the Dovecot >>> Solr plugin? >> Yes, there is. So I'm not really sure what it's complaining about. >> Are you using the "solr" or "solr_old" backend? >> >> > "Solr". > > plugin { > fts = solr > fts_solr = url=http://localhost:8983/solr/ > } > Now seeing: Jan 8 15:40:09 bubba dovecot: imap(user1(a)domain.com): Error: fts_solr: Lookup failed: 400 undefined field CC Jan 8 15:40:09 bubba dovecot: imap: Error: -- Daniel

1 0

[Dovecot] Building 2.1.rc1 with cluence, but without libstemmer
by Jan Mikkelsen 08 Jan '12

08 Jan '12

Hi, I'm testing out 2.1.rc1, building against clucene 2.3.3.4. Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. Simple patch below to make dovecot 2.1.rc1 build with clucene but without libstemmer (or textcat). Looking at libstemmer itself, there are multiple versions. The version in clucene is put into libclucene-contribs-lib.so, but that version is older than libstemmer_c, which generates libstemmer.a, tested for in the dovecot 2.1.rc1 configure script. The dovecot code uses SnowballAnalyzer.h as a C++ wrapper around libstemmer. What versions of libstemmer, clucene and libtextcat is dovecot 2.1.rc1 intended to be used against? Is it worth bringing the wrapper class around libstemmer into dovecot to avoid funny dependencies against clucene and so that the -lstemmer test in configure is enough? For reference, I'm building on FreeBSD 9.0-RC3, system gcc. Regards, Jan Mikkelsen. diff -u -d -r dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc --- dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc 2011-11-09 08:45:26.000000000 +1100 +++ dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc 2011-12-14 23:36:54.319796535 +1100 @@ -23,7 +23,9 @@ #include <CLucene.h> #include <CLucene/util/CLStreams.h> #include <CLucene/search/MultiPhraseQuery.h> +#if defined(HAVE_LUCENE_STEMMER) || defined(HAVE_LUCENE_TEXTCAT) #include "SnowballAnalyzer.h" +#endif /* Lucene's default is 10000. Use it here also.. */ #define MAX_TERMS_PER_DOCUMENT 10000

3 2

[Dovecot] Possible mdbox corruption
by Daniel L. Miller 06 Jan '12

06 Jan '12

I thought I had cleared out the corruption I had before - perhaps I was mistaken. What steps should I take to help locate these issues? Currently using 2.1rc1. I see the following errors in my logs, including out of memory and message size issues (at 15:30): Jan 4 05:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7f6e17cbfd0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7f6e17cbfd56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f6e17c98d08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7f6e17cd0310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7f6e17cbc965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7f6e17cbd0ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7f6e164b7292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7f6e164b7a97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7f6e166c4abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7f6e166c5561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7f6e166ca630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f6e17ccc0f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f6e17ccd17f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f6e17ccc098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f6e17cb9123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f6e1791cd8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x401d19] Jan 4 05:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 05:17:17 bubba dovecot: master: Error: service(indexer-worker): child 10896 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 06:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 06:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7f0ec1a57d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7f0ec1a57d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0ec1a30d08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7f0ec1a68310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7f0ec1a54965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7f0ec1a550ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7f0ec024f292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7f0ec024fa97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7f0ec045cabc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7f0ec045d561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7f0ec0462630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f0ec1a640f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f0ec1a6517f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f0ec1a64098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f0ec1a51123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f0ec16b4d8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x401d19] Jan 4 06:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 06:17:17 bubba dovecot: master: Error: service(indexer-worker): child 11941 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 07:17:18 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 07:17:18 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7faed4e56d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7faed4e56d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7faed4e2fd08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7faed4e67310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7faed4e53965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7faed4e540ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7faed364e292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7faed364ea97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7faed385babc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7faed385c561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7faed3861630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7faed4e630f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7faed4e6417f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7faed4e63098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7faed4e50123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7faed4ab3d8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x401d19] Jan 4 07:17:18 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 07:17:18 bubba dovecot: master: Error: service(indexer-worker): child 13299 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 08:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 08:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7ffd84382d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7ffd84382d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffd8435bd08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7ffd84393310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7ffd8437f965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7ffd843800ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7ffd82b7a292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7ffd82b7aa97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7ffd82d87abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7ffd82d88561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7ffd82d8d630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7ffd8438f0f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7ffd8439017f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7ffd8438f098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ffd8437c123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7ffd83fdfd8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x401d19] Jan 4 08:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 08:17:17 bubba dovecot: master: Error: service(indexer-worker): child 14413 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 09:17:19 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 09:17:19 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7fb701bf5d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7fb701bf5d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb701bced08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7fb701c06310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7fb701bf2965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7fb701bf30ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7fb7003ed292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7fb7003eda97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7fb7005faabc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7fb7005fb561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7fb700600630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7fb701c020f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7fb701c0317f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7fb701c02098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb701bef123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7fb701852d8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x401d19] Jan 4 09:17:19 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 09:17:19 bubba dovecot: master: Error: service(indexer-worker): child 15486 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 10:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 10:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7f8dc590ed0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7f8dc590ed56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8dc58e7d08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7f8dc591f310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7f8dc590b965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7f8dc590c0ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7f8dc4106292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7f8dc4106a97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7f8dc4313abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7f8dc4314561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7f8dc4319630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f8dc591b0f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f8dc591c17f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f8dc591b098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8dc5908123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f8dc556bd8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7510]() [0x401d19] Jan 4 10:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 10:17:17 bubba dovecot: master: Error: service(indexer-worker): child 16472 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 11:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 11:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7ff619c1dd0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7ff619c1dd56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff619bf6d08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7ff619c2e310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7ff619c1a965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7ff619c1b0ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7ff618415292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7ff618415a97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7ff618622abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7ff618623561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7ff618628630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7514]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7514]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7ff619c2a0f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7ff619c2b17f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7ff619c2a098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ff619c17123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7514](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7ff61987ad8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7514]() [0x401d19] Jan 4 11:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 11:17:17 bubba dovecot: master: Error: service(indexer-worker): child 17522 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 12:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 12:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7ffd988c1d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7ffd988c1d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffd9889ad08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7ffd988d2310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7ffd988be965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7ffd988bf0ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7ffd970b9292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7ffd970b9a97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7ffd972c6abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7ffd972c7561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7ffd972cc630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7ffd988ce0f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7ffd988cf17f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7ffd988ce098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ffd988bb123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7ffd9851ed8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515]() [0x401d19] Jan 4 12:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 12:17:17 bubba dovecot: master: Error: service(indexer-worker): child 18498 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 13:17:16 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 13:17:16 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7f51b0163d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7f51b0163d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f51b013cd08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7f51b0174310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7f51b0160965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7f51b01610ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7f51ae95b292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7f51ae95ba97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7f51aeb68abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7f51aeb69561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7f51aeb6e630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f51b01700f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f51b017117f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f51b0170098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f51b015d123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f51afdc0d8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7515]() [0x401d19] Jan 4 13:17:16 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 13:17:16 bubba dovecot: master: Error: service(indexer-worker): child 19550 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 14:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 14:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7f423b546d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7f423b546d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f423b51fd08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7f423b557310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7f423b543965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7f423b5440ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7f4239d3e292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7f4239d3ea97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7f4239f4babc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7f4239f4c561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7f4239f51630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7516]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7516]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f423b5530f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f423b55417f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f423b553098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f423b540123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7516](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f423b1a3d8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7516]() [0x401d19] Jan 4 14:17:17 bubba dovecot: master: Error: service(indexer-worker): child 20638 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 14:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 15:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 15:17:17 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7f3ab5e51d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7f3ab5e51d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3ab5e2ad08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7f3ab5e62310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7f3ab5e4e965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7f3ab5e4f0ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7f3ab4649292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7f3ab4649a97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7f3ab4856abc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7f3ab4857561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7f3ab485c630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f3ab5e5e0f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f3ab5e5f17f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f3ab5e5e098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3ab5e4b123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f3ab5aaed8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517]() [0x401d19] Jan 4 15:17:17 bubba dovecot: master: Error: service(indexer-worker): child 21821 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 15:17:17 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com Jan 4 15:30:48 bubba dovecot: imap(user2(a)domain.com): Error: Cached message size smaller than expected (822 < 1493) Jan 4 15:30:48 bubba dovecot: imap(user2(a)domain.com): Error: Corrupted index cache file /var/mail/amfes.com/lmiller/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 1786 Jan 4 15:30:48 bubba dovecot: imap(user2(a)domain.com): Error: read(/var/mail/amfes.com/lmiller/mdbox/storage/m.208) failed: Input/output error (FETCH for mailbox Sent UID 1786) Jan 4 16:17:20 bubba dovecot: indexer-worker(user1(a)domain.com): Fatal: pool_system_realloc(134217728): Out of memory Jan 4 16:17:20 bubba dovecot: indexer-worker(user1(a)domain.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed0a) [0x7ffc91276d0a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3ed56) [0x7ffc91276d56] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffc9124fd08] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4f310) [0x7ffc91287310] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3b965) [0x7ffc91273965] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x7c) [0x7ffc912740ec] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3292) [0x7ffc8fa6e292] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x3a97) [0x7ffc8fa6ea97] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_set_build_key+0x2c) [0x7ffc8fc7babc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x2d1) [0x7ffc8fc7c561] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc630) [0x7ffc8fc81630] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517]() [0x40245f] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517]() [0x4027dd] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7ffc912830f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7ffc9128417f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7ffc91283098] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ffc91270123] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517](main+0x109) [0x401f29] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7ffc90ed3d8e] -> dovecot/indexer-worker [user1(a)domain.com Sent - 5500/7517]() [0x401d19] Jan 4 16:17:20 bubba dovecot: master: Error: service(indexer-worker): child 22927 returned error 83 (Out of memory (vsz_limit=256 MB, you may need to increase it)) Jan 4 16:17:20 bubba dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user1(a)domain.com -- Daniel

2 6

[Dovecot] v2.1.rc2 released
by Timo Sirainen 06 Jan '12

06 Jan '12

http://dovecot.org/releases/2.1/rc/dovecot-2.1.rc2.tar.gz http://dovecot.org/releases/2.1/rc/dovecot-2.1.rc2.tar.gz.sig Lots of fixes since rc1. Some of the changes were larger than I wanted at RC stage, but they had to be done now.. Hopefully it's all over now, and we can have v2.1.0 soon. :) Some of the more important changes: * dsync was merged into doveadm. There is still "dsync" symlink pointing to "doveadm", which you can use the old way for now. The preferred ways to run dsync are "doveadm sync" (for old "dsync mirror") and "doveadm backup". + IMAP SPECIAL-USE extension to describe mailboxes + Added mailbox {} sections, which deprecate autocreate plugin + lib-fs: Added "mode" parameter to "posix" backend to specify mode for created files/dirs (for mail_attachment_dir). + inet_listener names are now used to figure out what type the socket is when useful. For example naming service auth { inet_listener } to auth-client vs. auth-userdb has different behavior. + Added pop3c (= POP3 client) storage backend. - LMTP proxying code was simplified, hopefully fixing its problems. - dsync: Don't remove user's subscriptions for subscriptions=no namespaces.

3 4

[Dovecot] v2.0.17 released
by Timo Sirainen 06 Jan '12

06 Jan '12

http://dovecot.org/releases/2.0/dovecot-2.0.17.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.17.tar.gz.sig Among other changes: + Proxying now supports sending SSL client certificate to server with ssl_client_cert/key settings. + doveadm dump: Added support for dumping dbox headers/metadata. - Fixed memory leaks in login processes with SSL connections - vpopmail support was broken in v2.0.16

1 0

[Dovecot] ACL with IMAP proxying
by Alexis Lelion 06 Jan '12

06 Jan '12

Hello, I'm trying to use ACLs to restrict subscription on public mailboxes, but I went into trouble. My setup is made of two servers, and users are shared between them via a proxy. User authentication is done with LDAP, and credentials aren't shared between the mailservers. Instead, the proxies are using master password. The thing is that when the ACLs are checked, it actually doesn't give the user login, but the master login, which is useless. Is there a way to use the first part of destuser as it is done when fetching info from the userdb? Any help is appreciated, Thansk! Alexis -------------------------------------------------- ACL bug logs : 104184 Jan 6 12:09:35 mail02 dovecot: imap(user@domain): Debug: acl: acl username = proxy 104185 Jan 6 12:09:35 mail02 dovecot: imap(user@domain): Debug: acl: owner = 0 104186 Jan 6 12:09:35 mail02 dovecot: imap(user@domain): Debug: acl vfile: Global ACL directory: (none) 104187 Jan 6 12:09:35 mail02 dovecot: imap(user@domain): Debug: Namespace : type=public, prefix=Shared., sep=., inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/var/vmail/domain/Shared -------------------------------------------------- Output of "dovecot -n" # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 ext3 auth_debug = yes auth_master_user_separator = * auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes first_valid_uid = 150 lmtp_proxy = yes login_trusted_networks = mail01.ip mail_debug = yes mail_location = maildir:/var/vmail/%d/%n mail_nfs_storage = yes mail_plugins = acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = maildir:/var/vmail/%d/%n prefix = separator = . type = private } namespace { location = maildir:/var/vmail/domain/Shared prefix = Shared. separator = . subscriptions = no type = public } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 recipient_delimiter = + sieve_after = /var/lib/dovecot/sieve/after.d/ sieve_before = /var/lib/dovecot/sieve/pre.d/ sieve_dir = /var/vmail/%d/%n/sieve sieve_global_path = /var/lib/dovecot/sieve/default.sieve } postmaster_address = user@domain protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service lmtp { inet_listener lmtp { address = mail02.ip port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl = required ssl_cert = </etc/ssl/mailcert.pem ssl_key = </etc/ssl/private/mailkey.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol doveadm { auth_socket_path = director-userdb } protocol lda { mail_plugins = sieve } protocol imap { imap_id_send = name mail_plugins = acl imap_acl } protocol lmtp { passdb { args = /etc/dovecot/dovecot-sql-lmtp.conf driver = sql } passdb { args = /etc/dovecot/dovecot-ldap-lmtp.conf driver = ldap } }

2 6

[Dovecot] doveadm + dsync merging
by Timo Sirainen 06 Jan '12

06 Jan '12

doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? a) Use "doveadm dsync" prefix, and otherwise keep the names same: dsync mirror -> doveadm dsync mirror dsync backup -> doveadm dsync backup dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) b) Don't have the dsync prefix: dsync mirror -> doveadm mirror dsync backup -> doveadm backup dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? d) Something else?

5 5

[Dovecot] Deduplication active - but how good does it perform?
by Ralf Hildebrandt 06 Jan '12

06 Jan '12

I have deduplication active in my first mdbox: type mailbox, but how do I find out how well the deduplication works? Is there a way of finding out how much disk space I saved (if I saved some :) )? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

4 4

[Dovecot] dovecot-lda error
by Wesley M. 05 Jan '12

05 Jan '12

Hi, I use Dovecot 2.0.13 on OpenBSD 5.0 When i try to send emails i have the following error in /var/log/maillog Jan 5 11:23:49 mail50 postfix/pipe[29423]: D951842244C: to=, relay=dovecot, delay=0.02, delays=0.01/0/0/0.01, dsn=5.3.0, status=bounced (command line usage error. Command output: deliver: unknown option -- n Usage: dovecot-lda [-c ] [-a ] [-d ] [-p ] [-f ] [-m ] [-e] [-k] ) Jan 5 11:23:49 mail50 postfix/qmgr[13787]: D951842244C: removed In my /etc/postfix/master.cf : # Dovecot LDA dovecot unix - n n - - pipe flags=ODR user=_dovecot:_dovecot argv=/usr/local/libexec/dovecot/deliver -f ${ sender} -d ${user}@${nexthop} -n -m ${extension} How can i resolve that ? Thank you very much for your replies. Cheers, Wesley.

2 1

[Dovecot] POP3 problems
by sottilette＠rfx.it 04 Jan '12

04 Jan '12

Migrated a 1.0.2 server to 2.0.16 (same old box). IMAP seems working Ok. POP3 give problems with some clients (Outlook 2010 and Thunderbird reported). Seems authentication problem Below my doveconf -n (debug enbled, but no answer found to the problems) Any hints? Thanks, P. # doveconf -n # 2.0.16: /etc/dovecot/dovecot.conf doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:791: add auth_ prefix to all settings inside auth {} and remove the auth {} section completely doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:864: passdb {} has been replaced by passdb { driver= } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:935: userdb passwd {} has been replaced by userdb { driver=passwd } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:998: auth_user has been replaced by service auth { user } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:1131: ssl_disable has been renamed to ssl # OS: Linux 2.6.9-42.0.10.ELsmp i686 CentOS release 4.9 (Final) auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/mail/dovecot.info.log listen = * log_path = /var/log/mail/dovecot.log mail_full_filesystem_access = yes mail_location = mbox:~/:INBOX=/var/mail/%u mbox_read_locks = dotlock fcntl passdb { driver = pam } protocols = pop3 imap service auth { user = root } ssl = no ssl_cert = /etc/pki/dovecot/certs/dovecot.pem ssl_key = /etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)example.com }

4 4