[Dovecot] Lucene and Zlib with 2.2.1
Hello,
I have an "archive" folder in my inbox, where I manually stick old mails into a compressed mbox format. Since upgrading to Dovecot 2.2.1, I've started seeing messages like the following in my log files:
imap(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable imap(...): Error: indexer failed to index mailbox INBOX/Archive/2007/Sent.gz
These errors *appear* to be mostly benign; I still get results from searching the mailbox. But for whatever reason, the indexer appears to not be working for those folders.
As you can probably tell, I'm using the fts_lucene plugin, which used to work just fine (with Dovecot 2.1.x). Is this expected behavior? Are these errors truly ignorable? Why are these compressed mailboxes not selectable?
~Kyle
Where justice is denied, where poverty is enforced, where ignorance prevails, and where any one class is made to feel that society is an organized conspiracy to oppress, rob and degrade them, neither persons nor property will be safe. -- Frederick Douglas
Am 25.04.2013 18:55, schrieb Kyle Wheeler:
As you can probably tell, I'm using the fts_lucene plugin, which used to work just fine (with Dovecot 2.1.x). Is this expected behavior? Are these errors truly ignorable? Why are these compressed mailboxes not selectable?
sorry to ask , but did you compile with lucene ?
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich
On Thursday, April 25 at 07:44 PM, quoth Robert Schetterer:
Am 25.04.2013 18:55, schrieb Kyle Wheeler:
As you can probably tell, I'm using the fts_lucene plugin, which used to work just fine (with Dovecot 2.1.x). Is this expected behavior? Are these errors truly ignorable? Why are these compressed mailboxes not selectable?
sorry to ask , but did you compile with lucene ?
Yes I did. I configured my compile like this:
./configure --without-sql --without-vpopmail --with-ldap \
--with-lucene --with-stemmerI've got CLucene 2.3.3.4 installed, and libstemmer version 0+svn527-1 (the version that's packaged as part of Debian). Running ldd on /usr/local/lib/dovecot/lib21_fs_lucene_plugin.so says it's linked against both libclucene and libstemmer:
/usr/local/lib/dovecot/lib21_fts_lucene_plugin.so: linux-vdso.so.1 => (0x00007fff3f3ff000) libclucene-core.so.1 => /usr/local/lib/libclucene-core.so.1 (0x00007f9b0e5f5000) libstemmer.so.0d => /usr/lib/libstemmer.so.0d (0x00007f9b0e3a4000) librt.so.1 => /lib/librt.so.1 (0x00007f9b0e19b000) libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f9b0de87000) libm.so.6 => /lib/libm.so.6 (0x00007f9b0dc05000) libc.so.6 => /lib/libc.so.6 (0x00007f9b0d8a2000) libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00007f9b0d68c000) libclucene-shared.so.1 => /usr/local/lib/libclucene-shared.so.1 (0x00007f9b0d46c000) libpthread.so.0 => /lib/libpthread.so.0 (0x00007f9b0d24f000) libz.so.1 => /usr/lib/libz.so.1 (0x00007f9b0d038000) /lib64/ld-linux-x86-64.so.2 (0x00007f9b0ebde000)
~Kyle
It was we, the people; not we, the white male citizens; nor yet we, the male citizens; but we, the whole people, who formed the Union. [...] Men, their rights and nothing more; women, their rights and nothing less. -- Susan B. Anthony
Am 29.04.2013 17:51, schrieb Kyle Wheeler:
On Thursday, April 25 at 07:44 PM, quoth Robert Schetterer:
Am 25.04.2013 18:55, schrieb Kyle Wheeler:
As you can probably tell, I'm using the fts_lucene plugin, which used to work just fine (with Dovecot 2.1.x). Is this expected behavior? Are these errors truly ignorable? Why are these compressed mailboxes not selectable?
sorry to ask , but did you compile with lucene ?
Yes I did. I configured my compile like this:
./configure --without-sql --without-vpopmail --with-ldap \ --with-lucene --with-stemmerI've got CLucene 2.3.3.4 installed, and libstemmer version 0+svn527-1 (the version that's packaged as part of Debian). Running ldd on /usr/local/lib/dovecot/lib21_fs_lucene_plugin.so says it's linked against both libclucene and libstemmer:
/usr/local/lib/dovecot/lib21_fts_lucene_plugin.so: linux-vdso.so.1 => (0x00007fff3f3ff000) libclucene-core.so.1 => /usr/local/lib/libclucene-core.so.1 (0x00007f9b0e5f5000) libstemmer.so.0d => /usr/lib/libstemmer.so.0d (0x00007f9b0e3a4000) librt.so.1 => /lib/librt.so.1 (0x00007f9b0e19b000) libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f9b0de87000) libm.so.6 => /lib/libm.so.6 (0x00007f9b0dc05000) libc.so.6 => /lib/libc.so.6 (0x00007f9b0d8a2000) libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00007f9b0d68c000) libclucene-shared.so.1 => /usr/local/lib/libclucene-shared.so.1 (0x00007f9b0d46c000) libpthread.so.0 => /lib/libpthread.so.0 (0x00007f9b0d24f000) libz.so.1 => /usr/lib/libz.so.1 (0x00007f9b0d038000) /lib64/ld-linux-x86-64.so.2 (0x00007f9b0ebde000)
~Kyle
i ve got no problems with lucene dove 2.1.15 and before 2.1.x versions, didnt tested with 2.2.x , also as far i remember i did no use stemmer, what about try without stemmer ? But however it may be be a bug in 2.2.x, did you try latest hg version ? perhaps wait for Timos answer
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
On 25.4.2013, at 19.55, Kyle Wheeler <kyle-dovecot@memoryhole.net> wrote:
I have an "archive" folder in my inbox, where I manually stick old mails into a compressed mbox format. Since upgrading to Dovecot 2.2.1, I've started seeing messages like the following in my log files:
imap(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable imap(...): Error: indexer failed to index mailbox INBOX/Archive/2007/Sent.gz
What's your doveconf -n output? The errors about INBOX are especially strange (maybe just the error message is wrong and it's actually trying to index INBOX/Archive).
On Wednesday, May 15 at 04:29 PM, quoth Timo Sirainen:
On 25.4.2013, at 19.55, Kyle Wheeler <kyle-dovecot@memoryhole.net> wrote:
I have an "archive" folder in my inbox, where I manually stick old mails into a compressed mbox format. Since upgrading to Dovecot 2.2.1, I've started seeing messages like the following in my log files:
imap(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable imap(...): Error: indexer failed to index mailbox INBOX/Archive/2007/Sent.gz
What's your doveconf -n output? The errors about INBOX are especially strange (maybe just the error message is wrong and it's actually trying to index INBOX/Archive).
Here it is:
# 2.2.1: /service/dovecot-memoryhole.net/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.7 auth_default_realm = memoryhole.net auth_mechanisms = plain login base_dir = /var/run/dovecot/memoryhole first_valid_gid = 64020 first_valid_uid = 64020 last_valid_gid = 64020 last_valid_uid = 64020 log_path = /dev/stderr log_timestamp = login_greeting = ...you two suckers! Stop shirkin' and get workin'! mail_gid = 64020 mail_location = maildir:%h/Maildir mail_max_userip_connections = 20 mail_plugins = fts fts_lucene zlib listescape mail_uid = 64020 mailbox_list_index = yes mbox_write_locks = fcntl namespace { hidden = no inbox = yes list = yes location = maildir:~/Maildir prefix = separator = / type = private } namespace { hidden = yes inbox = no location = mbox:~/Maildir/Archive:LAYOUT=fs:INDEX=~/Maildir/ArchiveIndexes/ prefix = INBOX/Archive/ separator = / type = private } passdb { args = /var/lib/dovecot/dovecot-ldap.conf driver = ldap } plugin { fts = lucene fts_lucene = whitespace_chars=@. zlib_save = gz zlib_save_level = 6 } protocols = imap service auth { user = vpopmail } service imap-login { inet_listener imap { address = imap.memoryhole.net port = 143 } inet_listener imaps { address = imap.memoryhole.net port = 993 } user = dovecot } service imap { executable = imap } service pop3-login { user = dovecot } ssl_cert = </etc/ssl/certs/imap.memoryhole.net.pem ssl_key = </etc/ssl/private/imap.memoryhole.net.key userdb { args = uid=64020 gid=64020 home=/var/lib/vpopmail/domains/%Ld/%Ln allow_all_users=yes driver = static } valid_chroot_dirs = /var/lib/vpopmail/domains verbose_proctitle = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = writebytes=%o, readbytes=%i, session=<%{session}> mail_plugins = fts fts_lucene zlib imap_zlib listescape } protocol lda { auth_socket_path = /var/run/dovecot/localhost/auth-master hostname = memoryhole.net mail_plugins = fts fts_lucene zlib listescape postmaster_address = postmaster@memoryhole.net }
~Kyle
The borrower is the slave of the lender. -- Proverbs 22:7
participants (3)
-
Kyle Wheeler
-
Robert Schetterer
-
Timo Sirainen