Btw, since 2.1 is out-performing our old solution so badly, I thought I'd drop some numbers.
The old setup takes over ~4.5 seconds to perform our most common operation.
The new setup takes ~0.2 second to perform the same operation on the same dataset.
approx 22 faster, with less than half the storage; zlib is awesome, for the test account 15GB transforms into 6.5GB.
Old setup: dovecot 1.0.9 (Athlon X2 processor, standard hdd) New solution: dovecot 2.1, mdbox, zlib, fts_solr (i think solr works, but not sure) (core i7-2600, standard hdd).
Thank you very much for the awesome software.
On Mon, Feb 27, 2012 at 7:14 PM, Jean-Daniel Beaubien <jd.beaubien@gmail.com
wrote:
Ok, I had to fix a few things. First of all, I had to declare mail_plugins = fts fts_solr in global file (dovecot.conf). After doing that, running doveadm fts optimize stopped giving me errors.
I ran doveadm index -user INBOX (and other folders). I'm assuming this actually did something because java/tomcat6 were really busy for a few mins and I could see the solr logs going nuts (/var/log/tomcat6/catalina.out).
However, whenever I run a search thru thunderbird (searching the from/to/subject/body fields), I don't see anything related to solr in the dovecot logs (I never see the line you mentioned or anything close: indexer-worker(user@domain): Info: Indexed 1 messages in INBOX).
After playing with the logging level, I manage to see this in the logs: Feb 27 19:12:19 mba-server dovecot: imap: Debug: Loading modules from directory: /var/opt/dovecot/lib/dovecot Feb 27 19:12:19 mba-server dovecot: imap: Debug: Module loaded: /var/opt/dovecot/lib/dovecot/lib20_fts_plugin.so Feb 27 19:12:19 mba-server dovecot: imap: Debug: Module loaded: /var/opt/dovecot/lib/dovecot/lib20_zlib_plugin.so Feb 27 19:12:19 mba-server dovecot: imap: Debug: Module loaded: /var/opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so
But nothing indicating that solr_plugin is being used. Any idea? i'd really like to be able to clearly see that I'm using solr.
Regards,
-JD
On Mon, Feb 27, 2012 at 5:24 AM, Timo Sirainen <tss@iki.fi> wrote:
On Sun, 2012-02-26 at 18:26 -0500, Jean-Daniel Beaubien wrote:
hi everyone,
However, how can I verify that solr is working properly?
You should see in logs things like:
indexer-worker(user@domain): Info: Indexed 1 messages in INBOX
It should be in Dovecot's info log (see "doveadm log find"). If you can't find it, see if "doveadm index -u user@domain INBOX" does any work.
Make sure the fts plugin is enabled, "doveadm fts optimize" shouldn't give an error.