Help with installing Apache Solr with Dovecot 2.2
Hi, I am relatively new to Apache Solr and I am trying to get it to integrate with Dovecot 2.2 running on Ubuntu 14.04 and needed a little help with configuration. The following steps I have already configured. Appreciate if someone could help, so please help me!
- Apache Solr installed, up and running
6406 [main] INFO org.eclipse.jetty.server.AbstractConnector ? Started SocketConnector@0.0.0.0:8983
I can then ssh into it and see the running solr admin.
ssh -t -L 8983:localhost:8983 user@mydomain.com
Schema file added
startTime: 3 minutes ago instanceDir: /opt/solr/solr/collection1/ dataDir: /opt/solr/solr/collection1/data/
In my collection1 core selector I have the following files:- 1.solrconfig.xml 2.schema.xml
The output of schema.xml is shown below:-
<?xml version="1.0" encoding="UTF-8" ?>
<!-- For fts-solr:
Tested with dovecot 2 and Solr 4.10
This is the Solr schema file, place it into solr/conf/schema.xml.
by Adrian Jon kriel --> <schema name="dovecot" version="1.5">
<field name="_version_" type="long" indexed="true" stored="true"/> <field name="_root_" type="string" indexed="true" stored="false"/>
<types> <!-- IMAP has 32bit unsigned ints but java ints are signed, so use longs --> <fieldType name="string" class="solr.StrField" omitNorms="true"/> <fieldType name="long" class="solr.LongField" omitNorms="true"/> <fieldType name="slong" class="solr.SortableLongField" omitNorms="true"/> <fieldType name="float" class="solr.FloatField" omitNorms="true"/> <fieldType name="boolean" class="solr.BoolField" omitNorms="true"/>
<fieldType name="text" class="solr.TextField" positionIncrementGap="100">
<analyzer type="index">
<tokenizer class="solr.WhitespaceTokenizerFactory"/>
<filter class="solr.StopFilterFactory" ignoreCase="true"words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="1" catenateNumbers="1" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <!-- DEPRECATED VALUE <filter class="solr.EnglishPorterFilterFactory" protected="protwords.txt"/> --> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> <analyzer type="query"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <!-- DEPRECATED VALUE <filter class="solr.EnglishPorterFilterFactory" protected="protwords.txt"/> --> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> </fieldType> </types>
<fields> <field name="id" type="string" indexed="true" stored="true" required="true" /> <field name="uid" type="slong" indexed="true" stored="true" required="true" /> <field name="box" type="string" indexed="true" stored="true" required="true" /> <field name="user" type="string" indexed="true" stored="true" required="true" />
<field name="hdr" type="text" indexed="true" stored="false" /> <field name="body" type="text" indexed="true" stored="false" />
<field name="from" type="text" indexed="true" stored="false" /> <field name="to" type="text" indexed="true" stored="false" /> <field name="cc" type="text" indexed="true" stored="false" /> <field name="bcc" type="text" indexed="true" stored="false" /> <field name="subject" type="text" indexed="true" stored="false" /> </fields>
<uniqueKey>id</uniqueKey> <defaultSearchField>body</defaultSearchField> <solrQueryParser defaultOperator="AND" /> </schema>
Dovecot package dovecot-solr installed
Dovecot configured with following files to run on solr-fts.
In 10-mail.conf:-
# Space separated list of plugins to load for all services. Plugins specific to # IMAP, LDA, etc. are added to this list in their own .conf files. #mail_plugins = mail_plugins = fts fts_solr
In 90-plugin.conf:-
plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8983/solr/ }
I would really appreciate if someone could please help me here. Request for someone to guide me here. Thanks a lot Kevin
Zitat von Kev Lau <superinterstellar@gmail.com>:
Hi, I am relatively new to Apache Solr and I am trying to get it to integrate with Dovecot 2.2 running on Ubuntu 14.04 and needed a little help with configuration.
How do you store your user data?
Aside that, you should later setup the necessary cronjobs for Solr to
run smoothly.
If unsure what's the problem turn on mail_debug=yes in your dovecot.conf .
Dear Marc, Thanks for your feedback!
I store it in MySQL.
I will add a cronjob to run Solr if I can figure out why its not working on test runs. Maybe I might try to setup a cronjob for solr to avoid having to manually start it everytime.
Will turn on the mail_debug in dovecot.conf . Where will it log the problems?
Thanks Kevin
On Sat, Jan 3, 2015 at 4:45 PM, Marc Stürmer <mail@marc-stuermer.de> wrote:
Zitat von Kev Lau <superinterstellar@gmail.com>:
Hi,
I am relatively new to Apache Solr and I am trying to get it to integrate with Dovecot 2.2 running on Ubuntu 14.04 and needed a little help with configuration.
How do you store your user data?
Aside that, you should later setup the necessary cronjobs for Solr to run smoothly.
If unsure what's the problem turn on mail_debug=yes in your dovecot.conf .
Dear Marc, Found the log for mail-debug. Apologies for the bad question. Thanks Kevin
On Sat, Jan 3, 2015 at 5:27 PM, Kev Lau <superinterstellar@gmail.com> wrote:
Dear Marc, Thanks for your feedback!
I store it in MySQL.
I will add a cronjob to run Solr if I can figure out why its not working on test runs. Maybe I might try to setup a cronjob for solr to avoid having to manually start it everytime.
Will turn on the mail_debug in dovecot.conf . Where will it log the problems?
Thanks Kevin
On Sat, Jan 3, 2015 at 4:45 PM, Marc Stürmer <mail@marc-stuermer.de> wrote:
Zitat von Kev Lau <superinterstellar@gmail.com>:
Hi,
I am relatively new to Apache Solr and I am trying to get it to integrate with Dovecot 2.2 running on Ubuntu 14.04 and needed a little help with configuration.
How do you store your user data?
Aside that, you should later setup the necessary cronjobs for Solr to run smoothly.
If unsure what's the problem turn on mail_debug=yes in your dovecot.conf .
Hi Marc,
I have debug turned on but i keep getting this in my logs:-
Jan 03 17:36:41 imap(user@mydomain.com): Info: Disconnected: Logged out in=478 out=4938 Jan 03 17:37:41 imap-login: Info: Login: user=<user@mydomain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=20247, secured, session=<WDhzE8ILHQB/AAA$ Jan 03 17:37:41 imap(user@mydomain.com): Info: Disconnected: Logged out in=478 out=4938 Jan 03 17:38:41 imap-login: Info: Login: user=<user@mydomain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=20255, secured, session=<Z8EHF8ILIQB/AAA$ Jan 03 17:38:41 imap(thai@sicl.net): Info: Disconnected: Logged out in=478 out=4938 Jan 03 17:38:45 imap-login: Info: Login: user=<thai@sicl.net>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=20259, secured, session=<OwdFF8ILJAB/AAA$ Jan 03 17:38:47 imap(user@mydomain.com): Info: Disconnected: Logged out in=752 out=42154 Jan 03 17:39:38 imap(user@mydomain.com): Info: Disconnected: Logged out in=70 out=34565
Also my search is showing the following. And when I try to do full-text searches on Roundcube, it does not return the results, it just searches and stops in the middle. However when I try through telnet it gives this long search time duration.
. search text passport
- OK Searched 5% of the mailbox, ETA 2:37
- OK Searched 12% of the mailbox, ETA 2:11
- OK Searched 20% of the mailbox, ETA 1:55
- OK Searched 26% of the mailbox, ETA 1:51
- OK Searched 32% of the mailbox, ETA 1:42
- OK Searched 39% of the mailbox, ETA 1:32
- OK Searched 46% of the mailbox, ETA 1:19
- OK Searched 54% of the mailbox, ETA 1:07
- OK Searched 60% of the mailbox, ETA 0:57
- OK Searched 67% of the mailbox, ETA 0:47
- OK Searched 74% of the mailbox, ETA 0:37
- OK Searched 84% of the mailbox, ETA 0:21
- OK Searched 92% of the mailbox, ETA 0:10
- OK Searched 98% of the mailbox, ETA 0:01
Appreciate if someone could provide me guidance/help/support on this. Really in need of help here.
Thanks Kevin
On Sat, Jan 3, 2015 at 7:19 PM, Kev Lau <superinterstellar@gmail.com> wrote:
Dear Marc, Found the log for mail-debug. Apologies for the bad question. Thanks Kevin
On Sat, Jan 3, 2015 at 5:27 PM, Kev Lau <superinterstellar@gmail.com> wrote:
Dear Marc, Thanks for your feedback!
I store it in MySQL.
I will add a cronjob to run Solr if I can figure out why its not working on test runs. Maybe I might try to setup a cronjob for solr to avoid having to manually start it everytime.
Will turn on the mail_debug in dovecot.conf . Where will it log the problems?
Thanks Kevin
On Sat, Jan 3, 2015 at 4:45 PM, Marc Stürmer <mail@marc-stuermer.de> wrote:
Zitat von Kev Lau <superinterstellar@gmail.com>:
Hi,
I am relatively new to Apache Solr and I am trying to get it to integrate with Dovecot 2.2 running on Ubuntu 14.04 and needed a little help with configuration.
How do you store your user data?
Aside that, you should later setup the necessary cronjobs for Solr to run smoothly.
If unsure what's the problem turn on mail_debug=yes in your dovecot.conf .
participants (2)
-
Kev Lau
-
Marc Stürmer