[Dovecot] testing fts-solr?

[Jean-Daniel Beaubien]

Btw, since 2.1 is out-performing our old solution so badly, I thought I'd
drop some numbers.

- The old setup takes over ~4.5 seconds to perform our most common
operation.
- The new setup takes ~0.2 second to perform the same operation on the same
dataset.

- approx 22 faster, with less than half the storage; zlib is awesome, for
the test account 15GB transforms into 6.5GB.

Old setup: dovecot 1.0.9 (Athlon X2 processor, standard hdd)
New solution: dovecot 2.1, mdbox, zlib, fts_solr (i think solr works, but
not sure) (core i7-2600, standard hdd).

Thank you very much for the awesome software.





On Mon, Feb 27, 2012 at 7:14 PM, Jean-Daniel Beaubien <jd.beaubien at gmail.com
> wrote:

> Ok, I had to fix a few things. First of all, I had to declare mail_plugins
> = fts fts_solr in global file (dovecot.conf). After doing that, running
> doveadm fts optimize stopped giving me errors.
>
> I ran doveadm index -user INBOX (and other folders). I'm assuming this
> actually did something because java/tomcat6 were really busy for a few mins
> and I could see the solr logs going nuts (/var/log/tomcat6/catalina.out).
>
> However, whenever I run a search thru thunderbird (searching the
> from/to/subject/body fields), I don't see anything related to solr in the
> dovecot logs (I never see the line you mentioned or anything
> close: indexer-worker(user at domain): Info: Indexed 1 messages in INBOX).
>
> After playing with the logging level, I manage to see this in the logs:
> Feb 27 19:12:19 mba-server dovecot: imap: Debug: Loading modules from
> directory: /var/opt/dovecot/lib/dovecot
> Feb 27 19:12:19 mba-server dovecot: imap: Debug: Module loaded:
> /var/opt/dovecot/lib/dovecot/lib20_fts_plugin.so
> Feb 27 19:12:19 mba-server dovecot: imap: Debug: Module loaded:
> /var/opt/dovecot/lib/dovecot/lib20_zlib_plugin.so
> Feb 27 19:12:19 mba-server dovecot: imap: Debug: Module loaded:
> /var/opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so
>
> But nothing indicating that solr_plugin is being used. Any idea? i'd
> really like to be able to clearly see that I'm using solr.
>
> Regards,
>
> -JD
>
>
>
>
> On Mon, Feb 27, 2012 at 5:24 AM, Timo Sirainen <tss at iki.fi> wrote:
>
>> On Sun, 2012-02-26 at 18:26 -0500, Jean-Daniel Beaubien wrote:
>> > hi everyone,
>> >
>> > However, how can I verify that solr is working properly?
>>
>> You should see in logs things like:
>>
>> indexer-worker(user at domain): Info: Indexed 1 messages in INBOX
>>
>> It should be in Dovecot's info log (see "doveadm log find"). If you
>> can't find it, see if "doveadm index -u user at domain INBOX" does any
>> work.
>>
>> Make sure the fts plugin is enabled, "doveadm fts optimize" shouldn't
>> give an error.
>>
>>
>>
>