Solr

[Daniel Miller]

Joan,

I understand and sympathize with your frustration - trying to get 
multiple applications to work together, particularly given the lack of 
documentation for some of them, can be extremely challenging.  That 
said, I suggest you consider an alternative viewpoint.  Frequently being 
misunderstood myself I apologize in advance if I'm reading you wrong - 
but it appears your view towards the situation is there is a bug in 
Dovecot related to this problem.  That may well be - but I generally 
approach these matters from the assumption that *I* made the error in 
configuration and go from there.  I'm not an official rep for any 
product nor claim to be any form of expert in these matters - but I do 
have a working setup and I'd like to help you if I can.  If you're 
willing to - take a deep breath and let's try starting over.

Looking back through your emails there were two items that stood out - 
your Dovecot config has two settings I don't use: "fts_decoder" and 
"fts_enforced".  I also asked you earlier whether or not NFS is involved 
here and I didn't see an answer - please clarify.

I suggest you try once more: delete Solr completely.  Re-install per the 
directions and use *my* managed-schema.  Also comment out the Dovecot 
directives for "fts_decoder" and "fts_enforced" so you're closer to my 
setup.  Try running again and then post back - I'll do what I can.  
Based on the fact that Dovecot+Solr 7.5+my schema is working for me 
leads me to believe we can get it working for you as well.

Daniel

On 12/15/2018 2:42 PM, Joan Moreau wrote:
>
> here my latest schema.xml (remove the "long" type hich seems to be 
> very deprecated in 7.x)
>
> <?xml version="1.0" encoding="UTF-8"?>
> <schema name="dovecot" version="2.0">
> <uniqueKey>id</uniqueKey>
> <types>
> <fieldType name="string" class="solr.StrField" />
> <fieldType name="gjlong" class="solr.LongPointField" 
> positionIncrementGap="0" />
> <fieldType name="gjtext" class="solr.TextField" 
> autoGeneratePhraseQueries="true" positionIncrementGap="100">
> <analyzer type="index">
> <tokenizer class="solr.StandardTokenizerFactory"/>
> <filter class="solr.StopFilterFactory" words="stopwords.txt" 
> ignoreCase="true"/>
> <filter class="solr.WordDelimiterGraphFilterFactory" 
> generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" 
> splitOnNumerics="1" catenateWords="1" catenateNumbers="1" 
> catenateAll="1"/>
> <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on 
> index analyzers after graph filters -->
> <filter class="solr.LowerCaseFilterFactory"/>
> <filter class="solr.NGramFilterFactory" minGramSize="3" 
> maxGramSize="15" />
> <filter class="solr.KeywordMarkerFilterFactory" 
> protected="protwords.txt"/>
> <filter class="solr.PorterStemFilterFactory"/>
> </analyzer>
> <analyzer type="query">
> <tokenizer class="solr.StandardTokenizerFactory"/>
> <filter class="solr.SynonymGraphFilterFactory" expand="true" 
> ignoreCase="true" synonyms="synonyms.txt"/>
> <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on 
> index analyzers after graph filters -->
> <filter class="solr.StopFilterFactory" words="stopwords.txt" 
> ignoreCase="true"/>
> <filter class="solr.WordDelimiterGraphFilterFactory" 
> generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" 
> splitOnNumerics="1" catenateWords="1" catenateNumbers="1" 
> catenateAll="1"/>
> <filter class="solr.LowerCaseFilterFactory"/>
> <filter class="solr.NGramFilterFactory" minGramSize="3" 
> maxGramSize="15" />
> <filter class="solr.KeywordMarkerFilterFactory" 
> protected="protwords.txt"/>
> <filter class="solr.PorterStemFilterFactory"/>
> </analyzer>
> </fieldType>
> </types>
> <fields>
> <field name="_version_" type="string" indexed="true" stored="true"/>
> <field name="bcc" type="string" indexed="false" stored="false"/>
> <field name="body" type="gjtext" indexed="true" stored="false"/>
> <field name="box" type="string" indexed="true" required="true" 
> stored="true"/>
> <field name="hdr" type="gjtext" indexed="false" stored="false"/>
> <field name="cc" type="gjtext" indexed="true" stored="false"/>
> <field name="from" type="gjtext" indexed="true" stored="false"/>
> <field name="id" type="string" indexed="true" required="true" 
> stored="true"/>
> <field name="subject" type="gjtext" indexed="true" stored="false"/>
> <field name="to" type="gjtext" indexed="true" stored="false"/>
> <field name="uid" type="string" indexed="true" required="true" 
> stored="true"/>
> <field name="user" type="string" indexed="true" required="true" 
> stored="true"/>
> </fields>
> </schema>
>
>
>
> On 2018-12-15 20:54, Joan Moreau wrote:
>
>> Daniel,
>> I have done that so any times (deleteing the data folders, recreating 
>> the instance, restarting etc...)
>> But this is really not the issue
>> The issue is
>> 1 - fts_solr reports errors in the log file (this is a pure dovecot 
>> issue) : how to have much more details on what fts_solr sends to Slor 
>> server and what does it returns ?
>> 2 - Solr returns properly for a few hours, then starts crashing or 
>> responding non-sense after some time
>> Additionally, is there a doc of fts-squat in order to adjust the code 
>> to new releases of dovect ?
>>
>> On December 12, 2018 4:44:10 PM Daniel Miller via dovecot 
>> <dovecot at dovecot.org> wrote:
>>
>>     On 12/11/2018 4:46 AM, Joan Moreau via dovecot wrote:
>>>
>>>     I shared the errors already so many times (check this mailinling
>>>     for "solr" in teh title)
>>>
>>>     Contrary to what you say, with SOlr 7.5 and Dovecot git,  I had
>>>     to remove the "managed-schema" to make solr respond a bit
>>>     properly. It relies on schema.xml
>>>
>>>     In order to create the instance, no, it copies the default
>>>     config in the dovecot instance.
>>>
>>     I'm not a Solr expert by any means but I believe you are incorrect.
>>
>>     As of Solr 5.x the managed-schema file is the primary method for
>>     configuration.  The method I detailed previously for setting up a
>>     config helps automate creating new Solr instances - but as I
>>     stated you can either setup a Solr template and then create the
>>     instance from that or create an instance using the default
>>     template and then adjust it.
>>
>>     The part that you *must* do after creating from the default
>>     template is stop the server, delete the entire
>>     "<prefix>/solr/dovecot/data" folder, then install the correct
>>     managed-schema file, then restart the server.  The server will
>>     not function with mismatched schema/data.
>>
>>     If you'll try that - explicitly "rm -rf
>>     <prefix>/solr/dovecot/data", copy the managed-schema file into
>>     the conf folder, and restart - things will either work or there's
>>     something else that needs correction.
>>
>>     --
>>     Daniel
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dovecot.org/pipermail/dovecot/attachments/20181215/9258f2a9/attachment-0001.html>