Proper configuration of fts-xapian for dovecot
Dears,
I recently installed the package dovecot-fts-xapian on my Ubuntu 22.04 VM, where dovecot 2.3.16 is installed.
I enabled the plugins
mail_plugins = $mail_plugins fts fts_xapian
plugin {
### # fts fts = xapian fts_xapian = partial=3 full=20
fts_autoindex = yes fts_enforced = yes
#fts_autoindex_exclude = \Trash
# Index attachements fts_decoder = decode2text }
I skip to show the "service indexer-worker" and "decode2text" for the moment.
After restarting dovecot I ran
doveadm index -A \*
which ran without any issues. But for the moment I am faced with two issues I am unable to solve on my own and also didn't found a solution on the internet:
The indexer created a new directory "xapian-indexes" in the user's mail folder (where also "INBOX", "Drafts", "Sent", ... exists), with the result that you can see this folder in Thunderbird and GMail Android App. How to hide / disable the folder to mail programs, IMHO no mail program should have access to it.
When listing the capabilities of my mail server I get "CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ AUTH=PLAIN AUTH=LOGIN" and it seems to lack the FTS capability(s). Am I right? And should dovecot set the capabality on its own or is something missing in the config?
If you need more info, just let me know please.
Thanks and kind regards Torge
On 2024-11-07, Torge Riedel via dovecot <dovecot@dovecot.org> wrote:
I recently installed the package dovecot-fts-xapian on my Ubuntu 22.04 VM, where dovecot 2.3.16 is installed.
I'd suggest dovecot-fts-flatcurve, that's the one which will be in Dovecot 2.4..
- The indexer created a new directory "xapian-indexes" in the user's mail folder (where also "INBOX", "Drafts", "Sent", ... exists), with the result that you can see this folder in Thunderbird and GMail Android App. How to hide / disable the folder to mail programs, IMHO no mail program should have access to it.
Not sure how to exclude this - it's not a problem if you use dbox, only Maildir etc.
- When listing the capabilities of my mail server I get "CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ AUTH=PLAIN AUTH=LOGIN" and it seems to lack the FTS capability(s). Am I right? And should dovecot set the capabality on its own or is something missing in the config?
That's a pre-auth capability, you'll get more after login.
Am 07.11.24 um 14:57 schrieb Stuart Henderson via dovecot:
On 2024-11-07, Torge Riedel via dovecot <dovecot@dovecot.org> wrote:
I recently installed the package dovecot-fts-xapian on my Ubuntu 22.04 VM, where dovecot 2.3.16 is installed. I'd suggest dovecot-fts-flatcurve, that's the one which will be in Dovecot 2.4.. Thank you, I will consider this on upgrade
- The indexer created a new directory "xapian-indexes" in the user's mail folder (where also "INBOX", "Drafts", "Sent", ... exists), with the result that you can see this folder in Thunderbird and GMail Android App. How to hide / disable the folder to mail programs, IMHO no mail program should have access to it. Not sure how to exclude this - it's not a problem if you use dbox, only Maildir etc.
Well, I found the info when scrolling through the issue list at https://github.com/grosjo/fts-xapian/issues. I had to configure the mail_location properly and add INDEX=...
mail_location = maildir:~/mail:INDEX=~/index:LAYOUT=fs
This fixed the visible xapian-indexes folder.
- When listing the capabilities of my mail server I get "CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ AUTH=PLAIN AUTH=LOGIN" and it seems to lack the FTS capability(s). Am I right? And should dovecot set the capabality on its own or is something missing in the config? That's a pre-auth capability, you'll get more after login.
Ah, I missed that point. After login the capabilities are as follows and seem to include FTS:
A001 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY PREVIEW STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE QUOTA] Logged in
But the Android GMail app still doesn't find any mails when using the search bar in a folder. I'm trying to figure out at the moment, how I could monitor the search attempt.
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org
Am 07.11.24 um 16:28 schrieb Torge Riedel via dovecot:
- When listing the capabilities of my mail server I get "CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ AUTH=PLAIN AUTH=LOGIN" and it seems to lack the FTS capability(s). Am I right? And should dovecot set the capabality on its own or is something missing in the config? That's a pre-auth capability, you'll get more after login.
Ah, I missed that point. After login the capabilities are as follows and seem to include FTS:
A001 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY PREVIEW STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE QUOTA] Logged in
But the Android GMail app still doesn't find any mails when using the search bar in a folder. I'm trying to figure out at the moment, how I could monitor the search attempt.
Searching in Android GMail app works directly in INBOX. But searching in a sub folder of INBOX, Trash, or Sent I do not get results ... I'm confused.
Kindly check the location of you mail_location variable in dovecot.conf
Can you share the full config ?
On 2024-11-07 21:23, Torge Riedel via dovecot wrote:
Dears,
I recently installed the package dovecot-fts-xapian on my Ubuntu 22.04 VM, where dovecot 2.3.16 is installed.
I enabled the plugins
mail_plugins = $mail_plugins fts fts_xapian
plugin {
### # fts fts = xapian fts_xapian = partial=3 full=20
fts_autoindex = yes fts_enforced = yes
#fts_autoindex_exclude = \Trash
# Index attachements fts_decoder = decode2text }
I skip to show the "service indexer-worker" and "decode2text" for the moment.
After restarting dovecot I ran
doveadm index -A \*
which ran without any issues. But for the moment I am faced with two issues I am unable to solve on my own and also didn't found a solution on the internet:
The indexer created a new directory "xapian-indexes" in the user's mail folder (where also "INBOX", "Drafts", "Sent", ... exists), with the result that you can see this folder in Thunderbird and GMail Android App. How to hide / disable the folder to mail programs, IMHO no mail program should have access to it.
When listing the capabilities of my mail server I get "CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ AUTH=PLAIN AUTH=LOGIN" and it seems to lack the FTS capability(s). Am I right? And should dovecot set the capabality on its own or is something missing in the config?
If you need more info, just let me know please.
Thanks and kind regards Torge
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org
participants (3)
-
Joan Moreau
-
Stuart Henderson
-
Torge Riedel