Dovecot and Solr on the same server or on different
Hi.
what would you suggest? What are the pros and cons for having dovecot and Solr on the same or different hots?
I have about 800 accounts, some millions of mails and about 2 TB of zipped mails.
From the recent experiences regarding maintenance I’d prefer different hosts for each.
Thanks for suggestions and feedback . GötzHi, from a scalability perspective I would put solr on a separate host. Regards
Il giorno gio 20 giu 2019 alle ore 09:18 Götz Reinicke via dovecot dovecot@dovecot.org ha scritto:
Hi.
what would you suggest? What are the pros and cons for having dovecot and Solr on the same or different hots?
I have about 800 accounts, some millions of mails and about 2 TB of zipped mails.
From the recent experiences regarding maintenance I’d prefer different hosts for each.
Thanks for suggestions and feedback . Götz
On 20 Jun 2019, at 01:21, Riccardo Bicelli via dovecot dovecot@dovecot.org wrote:
dovecot@dovecot.org ha scritto:
what would you suggest? What are the pros and cons for having dovecot and Solr on the same or different hots?
I have about 800 accounts, some millions of mails and about 2 TB of zipped mails.
From the recent experiences regarding maintenance I’d prefer different hosts for each.
Hi, from a scalability perspective I would put solr on a separate host.
With that small a mail load?
I mean, the scalability issues will be a long time coming unless the hardware is really weak, and the headache of two servers not to mention the constant communication between them…
But if that’s what you would rather do anyway, then sure.
-- Don't ride in anything with a Capissen-38 engine, they fall right out of the sky
I agree that is a small mail load. But I mean, if you are running virtual machines (like me) it is better to split the roles and leave solr on its own.
Il giorno gio 20 giu 2019 alle ore 11:51 @lbutlr via dovecot dovecot@dovecot.org ha scritto:
On 20 Jun 2019, at 01:21, Riccardo Bicelli via dovecot dovecot@dovecot.org wrote:
dovecot@dovecot.org ha scritto:
what would you suggest? What are the pros and cons for having dovecot and Solr on the same or different hots?
I have about 800 accounts, some millions of mails and about 2 TB of zipped mails.
From the recent experiences regarding maintenance I’d prefer different hosts for each.
Hi, from a scalability perspective I would put solr on a separate host.
With that small a mail load?
I mean, the scalability issues will be a long time coming unless the hardware is really weak, and the headache of two servers not to mention the constant communication between them…
But if that’s what you would rather do anyway, then sure.
-- Don't ride in anything with a Capissen-38 engine, they fall right out of the sky
On 20 Jun 2019, at 04:12, Riccardo Bicelli via dovecot dovecot@dovecot.org wrote:
I agree that is a small mail load. But I mean, if you are running virtual machines (like me) it is better to split the roles and leave solr on its own.
Oh, right. I thought we were talking about actual hardware separation.
-- Lead me not into temptation, I can find the way.
Am 20.06.2019 um 12:27 schrieb @lbutlr via dovecot dovecot@dovecot.org:
On 20 Jun 2019, at 04:12, Riccardo Bicelli via dovecot dovecot@dovecot.org wrote:
I agree that is a small mail load. But I mean, if you are running virtual machines (like me) it is better to split the roles and leave solr on its own.
Oh, right. I thought we were talking about actual hardware separation.
Hi and thanks for all feedback.
Yes, we are on VMs. Of course I could extend the resources for the dovecot VM (more CPU, more RAM) but as mentioned having separate VMs/systems is in some situations the preferred way.
So if dovecot and Solr are good with a host each, I m fine with managing two VMs.
Regards . GötzHi Christian,
Am 20.06.2019 um 18:05 schrieb Christian Kivalo via dovecot dovecot@dovecot.org:
So if dovecot and Solr are good with a host each, I m fine with managing two VMs. They do. I'm using such a setup for some years now.
May be you you could give me some suggestions on how to proceed after having the Solr up and running?
What is the best procedure to move all mailbox search index from the current (old) style to Solr?
Like: doveadm index -A -q '*'
May I adjust some Sorl defaults for memory/cahces etc to suite my setup?
Thanks fro feedback and regards . GötzHi Christian,
Am 20.06.2019 um 18:05 schrieb Christian Kivalo via dovecot dovecot@dovecot.org:
So if dovecot and Solr are good with a host each, I m fine with managing two VMs. They do. I'm using such a setup for some years now.
May be you you could give me some suggestions on how to proceed after having the Solr up and running?
What is the best procedure to move all mailbox search index from the current (old) style to Solr?
Like: doveadm index -A -q '*' This should do it. I did some searches. That triggers indexing when
On 2019-06-21 09:18, Götz Reinicke via dovecot wrote: there is none.
May I adjust some Sorl defaults for memory/cahces etc to suite my setup? Apart from min and max java mem i didn't change any solr defaults. I'm using solr 8.0.0 and setup as described in the wiki. I changed the provided schema from the wiki to support partial searches. The index grew quite a bit but it's working fine. Thanks fro feedback and regards . Götz
-- Christian Kivalo
What changes did you make to support partial searches?
On Fri, Jul 5, 2019 at 3:58 PM Christian Kivalo via dovecot < dovecot@dovecot.org> wrote:
Hi Christian,
Am 20.06.2019 um 18:05 schrieb Christian Kivalo via dovecot dovecot@dovecot.org:
So if dovecot and Solr are good with a host each, I m fine with managing two VMs. They do. I'm using such a setup for some years now.
May be you you could give me some suggestions on how to proceed after having the Solr up and running?
What is the best procedure to move all mailbox search index from the current (old) style to Solr?
Like: doveadm index -A -q '*' This should do it. I did some searches. That triggers indexing when
On 2019-06-21 09:18, Götz Reinicke via dovecot wrote: there is none.
May I adjust some Sorl defaults for memory/cahces etc to suite my setup? Apart from min and max java mem i didn't change any solr defaults. I'm using solr 8.0.0 and setup as described in the wiki. I changed the provided schema from the wiki to support partial searches. The index grew quite a bit but it's working fine. Thanks fro feedback and regards . Götz
-- Christian Kivalo
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
On 2019-07-05 23:00, Larry Rosenman via dovecot wrote:
What changes did you make to support partial searches? added the line <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15" /> after <filter class="solr.LowerCaseFilterFactory"/> to the <analyzer type="index"> block of the schema.xml from the wiki. Then remove your existing index and managed-schema, restart solr and reindex.
This nearly doubled the index in size but it's worth it.
On Fri, Jul 5, 2019 at 3:58 PM Christian Kivalo via dovecot dovecot@dovecot.org wrote:
Hi Christian,
Am 20.06.2019 um 18:05 schrieb Christian Kivalo via dovecot dovecot@dovecot.org:
So if dovecot and Solr are good with a host each, I m fine with managing two VMs. They do. I'm using such a setup for some years now.
May be you you could give me some suggestions on how to proceed after having the Solr up and running?
What is the best procedure to move all mailbox search index from
current (old) style to Solr?
Like: doveadm index -A -q '*' This should do it. I did some searches. That triggers indexing when
On 2019-06-21 09:18, Götz Reinicke via dovecot wrote: the there is none.
May I adjust some Sorl defaults for memory/cahces etc to suite my setup? Apart from min and max java mem i didn't change any solr defaults. I'm using solr 8.0.0 and setup as described in the wiki. I changed the provided schema from the wiki to support partial searches. The index grew quite a bit but it's working fine. Thanks fro feedback and regards . Götz
-- Christian Kivalo
--
Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
-- Christian Kivalo
On 20 Jun 2019, at 07:45, Götz Reinicke via dovecot dovecot@dovecot.org wrote:
Yes, we are on VMs. Of course I could extend the resources for the dovecot VM (more CPU, more RAM) but as mentioned having separate VMs/systems is in some situations the preferred way.
Yep, that totally makes sense. I am Old™ and still think of “server” as a physical box sitting in a rack.
-- Lead me not into temptation, I can find the way.
Am 21.06.2019 um 00:13 schrieb @lbutlr via dovecot dovecot@dovecot.org:
On 20 Jun 2019, at 07:45, Götz Reinicke via dovecot dovecot@dovecot.org wrote:
Yes, we are on VMs. Of course I could extend the resources for the dovecot VM (more CPU, more RAM) but as mentioned having separate VMs/systems is in some situations the preferred way.
Yep, that totally makes sense. I am Old™ and still think of “server” as a physical box sitting in a rack.
For me, it is often a „it depends, if …“. Take my current setup. I want to add Solr to a up-and-running dovecot system. In my VM I would have to add CPU and RAM, which I just can when rebooting the dovecot server. This is a (little) downtime, but is is a downtime.
So adding a Solr VM is currently the better choice regarding the uptime.
Thanks for your feedback and regards . Götz
participants (5)
-
＠lbutlr
-
Christian Kivalo
-
Götz Reinicke
-
Larry Rosenman
-
Riccardo Bicelli