[Dovecot] fts_lucene - hiding lucene-indexes folder?
Hi,
Is there any way to hide this folder from IMAP clients? I can see it is not runtime configurable and just #defined as LUCENE_INDEX_DIR_NAME in fts-backend-lucene.c.
Nicholas Riley <njriley@illinois.edu>
Am 09.05.2014 18:20, schrieb Nicholas Riley:
Hi,
Is there any way to hide this folder from IMAP clients? I can see it is not runtime configurable and just #defined as LUCENE_INDEX_DIR_NAME in fts-backend-lucene.c.
you shouldnt see it, guess you configured something wrong like
i.e
maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored.
etc
post your full dove conf to give chance for analysis
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
I'm using mbox, so it DOES show up.
thebighonker.lerctr.org /home/ler $ more /tmp/doveconf.n.out
# 2.2.12: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-STABLE amd64
auth_default_realm = lerctr.org
auth_mechanisms = plain login
auth_realms = lerctr.org thebighonker.lerctr.org tbh.lerctr.org
auth_username_format = %Ln
disable_plaintext_auth = no
lda_mailbox_autocreate = yes
lmtp_save_to_detail_mailbox = yes
login_access_sockets = tcpwrap
mail_debug = yes
mail_location = mbox:~/mail:INBOX=~/mail/INBOX
mail_plugins = snarf fts fts_lucene stats
mail_privileged_group = mail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave
namespace Snarf {
hidden = yes
list = no
location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY
prefix = ~~Snarfbox/
separator = /
}
namespace archive {
hidden = no
inbox = no
list = no
location = mbox:~/MAILARCHIVE
prefix = "#ARCHIVE/"
separator = /
}
namespace default {
hidden = yes
list = no
location =
prefix = ~~default/
separator = /
}
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts}
mailbox INBOX {
auto = create}
mailbox Junk {
special_use = \Junk}
mailbox Sent {
special_use = \Sent}
mailbox "Sent Messages" {
special_use = \Sent}
mailbox Trash {
special_use = \Trash}
prefix =
}
passdb {
args = failure_show_msg=yes session=yes max_requests=20
driver = pam
}
plugin {
fts = lucene
fts_lucene = whitespace_chars=@. normalize no_snowball
mbox_snarf = ~/mail/INBOX
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
snarf = ~~Snarfbox/INBOX
stats_command_min_time = 1 mins
stats_domain_min_time = 12 hours
stats_ip_min_time = 12 hours
stats_memory_limit = 16 M
stats_refresh = 5s
stats_session_min_time = 15 mins
stats_track_cmds = yes
stats_user_min_time = 1 hours
}
service auth {
unix_listener auth-client {
mode = 0666}
unix_listener auth-master {
mode = 0666}
}
service stats {
chroot = empty
client_limit = 0
drop_priv_before_exec = no
executable = stats
extra_groups =
fifo_listener stats-mail {
group =
mode = 0666
user =}
group =
idle_kill = 4294967295 secs
privileged_group =
process_limit = 1
process_min_avail = 0
protocol =
service_count = 0
type =
unix_listener stats {
group =
mode = 0666
user =}
user = $default_internal_user
vsz_limit = 18446744073709551615 B
}
service tcpwrap {
unix_listener login/tcpwrap {
group = $default_login_user
mode = 0600
user = $default_login_user}
}
ssl_cert = </etc/ssl/certs/dovecot.pem
ssl_key = </etc/ssl/private/dovecot.pem
userdb {
driver = passwd
}
protocol imap {
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
mail_max_userip_connections = 50
mail_plugins = snarf fts fts_lucene stats imap_stats
}
thebighonker.lerctr.org /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley:
Hi,
Is there any way to hide this folder from IMAP clients? I can see it is not runtime configurable and just #defined as LUCENE_INDEX_DIR_NAME in fts-backend-lucene.c.
you shouldnt see it, guess you configured something wrong like
i.e
maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored.
etc
post your full dove conf to give chance for analysis
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Am 09.05.2014 19:27, schrieb Larry Rosenman:
I'm using mbox, so it DOES show up.
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $ more /tmp/doveconf.n.out
# 2.2.12: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-STABLE amd64
auth_default_realm = lerctr.org <http://lerctr.org>
auth_mechanisms = plain login
auth_realms = lerctr.org <http://lerctr.org> thebighonker.lerctr.org <http://thebighonker.lerctr.org> tbh.lerctr.org <http://tbh.lerctr.org>
auth_username_format = %Ln
disable_plaintext_auth = no
lda_mailbox_autocreate = yes
lmtp_save_to_detail_mailbox = yes
login_access_sockets = tcpwrap
mail_debug = yes
mail_location = mbox:~/mail:INBOX=~/mail/INBOX
mail_plugins = snarf fts fts_lucene stats
mail_privileged_group = mail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave
namespace Snarf {
hidden = yes
list = no
location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY
prefix = ~~Snarfbox/
separator = /
}
namespace archive {
hidden = no
inbox = no
list = no
location = mbox:~/MAILARCHIVE
prefix = "#ARCHIVE/"
separator = /
}
namespace default {
hidden = yes
list = no
location =
prefix = ~~default/
separator = /
}
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts}
mailbox INBOX {
auto = create}
mailbox Junk {
special_use = \Junk}
mailbox Sent {
special_use = \Sent}
mailbox "Sent Messages" {
special_use = \Sent}
mailbox Trash {
special_use = \Trash}
prefix =
}
passdb {
args = failure_show_msg=yes session=yes max_requests=20
driver = pam
}
plugin {
fts = lucene
fts_lucene = whitespace_chars=@. normalize no_snowball
mbox_snarf = ~/mail/INBOX
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
snarf = ~~Snarfbox/INBOX
stats_command_min_time = 1 mins
stats_domain_min_time = 12 hours
stats_ip_min_time = 12 hours
stats_memory_limit = 16 M
stats_refresh = 5s
stats_session_min_time = 15 mins
stats_track_cmds = yes
stats_user_min_time = 1 hours
}
service auth {
unix_listener auth-client {
mode = 0666}
unix_listener auth-master {
mode = 0666}
}
service stats {
chroot = empty
client_limit = 0
drop_priv_before_exec = no
executable = stats
extra_groups =
fifo_listener stats-mail {
group = mode = 0666 user =}
group =
idle_kill = 4294967295 secs
privileged_group =
process_limit = 1
process_min_avail = 0
protocol =
service_count = 0
type =
unix_listener stats {
group = mode = 0666 user =}
user = $default_internal_user
vsz_limit = 18446744073709551615 B
}
service tcpwrap {
unix_listener login/tcpwrap {
group = $default_login_user mode = 0600 user = $default_login_user}
}
ssl_cert = </etc/ssl/certs/dovecot.pem
ssl_key = </etc/ssl/private/dovecot.pem
userdb {
driver = passwd
}
protocol imap {
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
mail_max_userip_connections = 50
mail_plugins = snarf fts fts_lucene stats imap_stats
}
i am not using mbox , didnt analyse your conf very deeply but my bet is ,your namespace and/or directory layout setup is the problem
perhaps reread
http://wiki2.dovecot.org/MboxChildFolders?highlight=%28index%29
http://wiki2.dovecot.org/Plugins/FTS/Lucene
Requires Dovecot v2.1+ to work properly. The CLucene version must be v2.3 (not v0.9). Dovecot builds only a single Lucene index for all mailboxes. The Lucene indexes are stored in lucene-indexes/ directory under the mail root index directory (e.g. ~/Maildir/lucene-indexes/).
so perhaps you need configure index directory seperate/extra setting etc
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de <mailto:rs@sys4.de>> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley: > Hi, > > Is there any way to hide this folder from IMAP clients? I can see it is > not runtime configurable and just #defined as LUCENE_INDEX_DIR_NAME in > fts-backend-lucene.c. > you shouldnt see it, guess you configured something wrong like i.e maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored. etc post your full dove conf to give chance for analysis Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 <tel:%2B49%20%2889%29%2030%2090%2046%2064> Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com <mailto:larryrtx@gmail.com> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On 2014-05-09 10:38 AM, Robert Schetterer wrote:
Am 09.05.2014 19:27, schrieb Larry Rosenman:
I'm using mbox, so it DOES show up.
- --snip--
}
i am not using mbox , didnt analyse your conf very deeply but my bet is ,your namespace and/or directory layout setup is the problem
perhaps reread
http://wiki2.dovecot.org/MboxChildFolders?highlight=%28index%29
http://wiki2.dovecot.org/Plugins/FTS/Lucene
Requires Dovecot v2.1+ to work properly. The CLucene version must be v2.3 (not v0.9). Dovecot builds only a single Lucene index for all mailboxes. The Lucene indexes are stored in lucene-indexes/ directory under the mail root index directory (e.g. ~/Maildir/lucene-indexes/).
so perhaps you need configure index directory seperate/extra setting etc
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de <mailto:rs@sys4.de>> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley: > Hi, > > Is there any way to hide this folder from IMAP clients? I can see it is > not runtime configurable and just #defined as LUCENE_INDEX_DIR_NAME in > fts-backend-lucene.c. > you shouldnt see it, guess you configured something wrong like i.e maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored. etc post your full dove conf to give chance for analysis Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 <tel:%2B49%20%2889%29%2030%2090%2046%2064> Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com <mailto:larryrtx@gmail.com> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Best Regards MfG Robert Schetterer
This is the same question I asked the list last week. There is no configuration directive listed on either of the two wiki pages you linked to above. My system is using Maildir with LAYOUT=fs, and my clients see the lucene-indexes folder as well, although it is not selectable.
My ideal case would be to move it to the home directory instead of the mail root directory, but I think the best option would be for it to be configurable similar to INDEXes, etc.
I can make an attempt at a patch, but it will take me a while to get up to speed on dovecot sources...
Thank you,
Greg
-----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJTbR7KAAoJECD7Htp+IT9e07cQALtJ8IHANrjWS54p1dpY/zfC GOKVS0gJuODcusJJXwOxwQxrCq74VRuxL07dp7myVfP+ZZybrHKYzb5nT12HGc5v fdb72aeBXdXXNfAIWdm82Jcbz8nbpwZQm3IK1G2+dUqkDRygb0muVrvCjbx5HV8G ub7kxMHTyMifbfq88eiAHfg1qINQBRxeECtDMgyyOpCrc4yu8yPZ7E7fDNLuheY4 WROBLMAeHyfcf+nIIcVVpIYKM0C69J6wWh14uz3zKayK2TNoGu6J0TYtAT+ImCdx dEUWiMbWqjfBMOCpW0Dyv8fy7wRMM4q/XTjc7AuWYNiM+hjzZfJ1ysdD+VTlIG8i r3m68YQPhfbnwr8608H2ZlvI1rzo6duxvSusi5OlmaF6FA/twz+w8EG7DhqqSodf 8eSVk2E426E2sXCBt7h0QaE9jBLUUgk1C0pHGvulpLJ3hGAOuMybqWx7d6LCNUFj LHpzP5aLXBaPtphiniBe3jt8foyVuTNxAYXAKr/g03Y3HRTcLLLwrIY/BW3yROIH u/XcqsPGzSc2xsiLAdVjJZbfv62EkTtj/VkwL6Z/JXXEsXy4IEYlYOM/AaUW3A6+ zKsZT27DTZ71SxmkIVtUq9jRnBGCJ1nMymkMEvzc3wkWeQ63VcnMEJK/DuQ18iGX MiJ3OdwCGpjk8Vus4H4m =NwOy -----END PGP SIGNATURE-----
Am 09.05.2014 20:30, schrieb Gregory Finch:
On 2014-05-09 10:38 AM, Robert Schetterer wrote:
Am 09.05.2014 19:27, schrieb Larry Rosenman:
I'm using mbox, so it DOES show up.
--snip--
}
i am not using mbox , didnt analyse your conf very deeply but my bet is ,your namespace and/or directory layout setup is the problem
perhaps reread
http://wiki2.dovecot.org/MboxChildFolders?highlight=%28index%29
Requires Dovecot v2.1+ to work properly. The CLucene version must be v2.3 (not v0.9). Dovecot builds only a single Lucene index for all mailboxes. The Lucene indexes are stored in lucene-indexes/ directory under the mail root index directory (e.g. ~/Maildir/lucene-indexes/).
so perhaps you need configure index directory seperate/extra setting etc
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de <mailto:rs@sys4.de>> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley: > Hi, > > Is there any way to hide this folder from IMAP clients? I can see it is > not runtime configurable and just #defined as LUCENE_INDEX_DIR_NAME in > fts-backend-lucene.c. > you shouldnt see it, guess you configured something wrong like i.e maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored. etc post your full dove conf to give chance for analysis Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 <tel:%2B49%20%2889%29%2030%2090%2046%2064> Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com <mailto:larryrtx@gmail.com> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Best Regards MfG Robert Schetterer
This is the same question I asked the list last week. There is no configuration directive listed on either of the two wiki pages you linked to above. My system is using Maildir with LAYOUT=fs, and my clients see the lucene-indexes folder as well, although it is not selectable.
My ideal case would be to move it to the home directory instead of the mail root directory, but I think the best option would be for it to be configurable similar to INDEXes, etc.
I can make an attempt at a patch, but it will take me a while to get up to speed on dovecot sources...
Thank you,
Hi Greg ,sounds plausible to me, you should contact Timo about this
Greg
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
Timo, Is there any chance of this happening (making lucene-indexes \NOSELECT)?
On Fri, May 9, 2014 at 12:38 PM, Robert Schetterer <rs@sys4.de> wrote:
Am 09.05.2014 19:27, schrieb Larry Rosenman:
I'm using mbox, so it DOES show up.
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $ more /tmp/doveconf.n.out
# 2.2.12: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-STABLE amd64
auth_default_realm = lerctr.org <http://lerctr.org>
auth_mechanisms = plain login
auth_realms = lerctr.org <http://lerctr.org> thebighonker.lerctr.org <http://thebighonker.lerctr.org> tbh.lerctr.org <http://tbh.lerctr.org>
auth_username_format = %Ln
disable_plaintext_auth = no
lda_mailbox_autocreate = yes
lmtp_save_to_detail_mailbox = yes
login_access_sockets = tcpwrap
mail_debug = yes
mail_location = mbox:~/mail:INBOX=~/mail/INBOX
mail_plugins = snarf fts fts_lucene stats
mail_privileged_group = mail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave
namespace Snarf {
hidden = yes
list = no
location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY
prefix = ~~Snarfbox/
separator = /
}
namespace archive {
hidden = no
inbox = no
list = no
location = mbox:~/MAILARCHIVE
prefix = "#ARCHIVE/"
separator = /
}
namespace default {
hidden = yes
list = no
location =
prefix = ~~default/
separator = /
}
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts}
mailbox INBOX {
auto = create}
mailbox Junk {
special_use = \Junk}
mailbox Sent {
special_use = \Sent}
mailbox "Sent Messages" {
special_use = \Sent}
mailbox Trash {
special_use = \Trash}
prefix =
}
passdb {
args = failure_show_msg=yes session=yes max_requests=20
driver = pam
}
plugin {
fts = lucene
fts_lucene = whitespace_chars=@. normalize no_snowball
mbox_snarf = ~/mail/INBOX
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
snarf = ~~Snarfbox/INBOX
stats_command_min_time = 1 mins
stats_domain_min_time = 12 hours
stats_ip_min_time = 12 hours
stats_memory_limit = 16 M
stats_refresh = 5s
stats_session_min_time = 15 mins
stats_track_cmds = yes
stats_user_min_time = 1 hours
}
service auth {
unix_listener auth-client {
mode = 0666}
unix_listener auth-master {
mode = 0666}
}
service stats {
chroot = empty
client_limit = 0
drop_priv_before_exec = no
executable = stats
extra_groups =
fifo_listener stats-mail {
group = mode = 0666 user =}
group =
idle_kill = 4294967295 secs
privileged_group =
process_limit = 1
process_min_avail = 0
protocol =
service_count = 0
type =
unix_listener stats {
group = mode = 0666 user =}
user = $default_internal_user
vsz_limit = 18446744073709551615 B
}
service tcpwrap {
unix_listener login/tcpwrap {
group = $default_login_user mode = 0600 user = $default_login_user}
}
ssl_cert = </etc/ssl/certs/dovecot.pem
ssl_key = </etc/ssl/private/dovecot.pem
userdb {
driver = passwd
}
protocol imap {
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
mail_max_userip_connections = 50
mail_plugins = snarf fts fts_lucene stats imap_stats
}
i am not using mbox , didnt analyse your conf very deeply but my bet is ,your namespace and/or directory layout setup is the problem
perhaps reread
http://wiki2.dovecot.org/MboxChildFolders?highlight=%28index%29
http://wiki2.dovecot.org/Plugins/FTS/Lucene
Requires Dovecot v2.1+ to work properly. The CLucene version must be v2.3 (not v0.9). Dovecot builds only a single Lucene index for all mailboxes. The Lucene indexes are stored in lucene-indexes/ directory under the mail root index directory (e.g. ~/Maildir/lucene-indexes/).
so perhaps you need configure index directory seperate/extra setting etc
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de <mailto:rs@sys4.de>> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley: > Hi, > > Is there any way to hide this folder from IMAP clients? I can see it is > not runtime configurable and just #defined asLUCENE_INDEX_DIR_NAME in
> fts-backend-lucene.c. > you shouldnt see it, guess you configured something wrong like i.e maildir_stat_dirs=no (default): Assume that all the files beginningwith
a dot in the maildir are maildirs. You shouldn't have anynon-directory
files beginning with a dot in the maildirs, but if you do you mayneed
to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored. etc post your full dove conf to give chance for analysis Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 <tel:%2B49%20%2889%29%2030%2090%2046%2064> Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com <mailto:larryrtx@gmail.com> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Try the latest hg version. The lucene-indexes directory should be hidden under .imap/ directory.
On 3.7.2014, at 20.55, Larry Rosenman <larryrtx@gmail.com> wrote:
Timo, Is there any chance of this happening (making lucene-indexes \NOSELECT)?
On Fri, May 9, 2014 at 12:38 PM, Robert Schetterer <rs@sys4.de> wrote:
Am 09.05.2014 19:27, schrieb Larry Rosenman:
I'm using mbox, so it DOES show up.
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $ more /tmp/doveconf.n.out
# 2.2.12: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-STABLE amd64
auth_default_realm = lerctr.org <http://lerctr.org>
auth_mechanisms = plain login
auth_realms = lerctr.org <http://lerctr.org> thebighonker.lerctr.org <http://thebighonker.lerctr.org> tbh.lerctr.org <http://tbh.lerctr.org>
auth_username_format = %Ln
disable_plaintext_auth = no
lda_mailbox_autocreate = yes
lmtp_save_to_detail_mailbox = yes
login_access_sockets = tcpwrap
mail_debug = yes
mail_location = mbox:~/mail:INBOX=~/mail/INBOX
mail_plugins = snarf fts fts_lucene stats
mail_privileged_group = mail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave
namespace Snarf {
hidden = yes
list = no
location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY
prefix = ~~Snarfbox/
separator = /
}
namespace archive {
hidden = no
inbox = no
list = no
location = mbox:~/MAILARCHIVE
prefix = "#ARCHIVE/"
separator = /
}
namespace default {
hidden = yes
list = no
location =
prefix = ~~default/
separator = /
}
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts
}
mailbox INBOX {
auto = create
}
mailbox Junk {
special_use = \Junk
}
mailbox Sent {
special_use = \Sent
}
mailbox "Sent Messages" {
special_use = \Sent
}
mailbox Trash {
special_use = \Trash
}
prefix =
}
passdb {
args = failure_show_msg=yes session=yes max_requests=20
driver = pam
}
plugin {
fts = lucene
fts_lucene = whitespace_chars=@. normalize no_snowball
mbox_snarf = ~/mail/INBOX
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
snarf = ~~Snarfbox/INBOX
stats_command_min_time = 1 mins
stats_domain_min_time = 12 hours
stats_ip_min_time = 12 hours
stats_memory_limit = 16 M
stats_refresh = 5s
stats_session_min_time = 15 mins
stats_track_cmds = yes
stats_user_min_time = 1 hours
}
service auth {
unix_listener auth-client {
mode = 0666
}
unix_listener auth-master {
mode = 0666
}
}
service stats {
chroot = empty
client_limit = 0
drop_priv_before_exec = no
executable = stats
extra_groups =
fifo_listener stats-mail {
group =
mode = 0666
user =
}
group =
idle_kill = 4294967295 secs
privileged_group =
process_limit = 1
process_min_avail = 0
protocol =
service_count = 0
type =
unix_listener stats {
group =
mode = 0666
user =
}
user = $default_internal_user
vsz_limit = 18446744073709551615 B
}
service tcpwrap {
unix_listener login/tcpwrap {
group = $default_login_user
mode = 0600
user = $default_login_user
}
}
ssl_cert = </etc/ssl/certs/dovecot.pem
ssl_key = </etc/ssl/private/dovecot.pem
userdb {
driver = passwd
}
protocol imap {
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
mail_max_userip_connections = 50
mail_plugins = snarf fts fts_lucene stats imap_stats
}
i am not using mbox , didnt analyse your conf very deeply but my bet is ,your namespace and/or directory layout setup is the problem
perhaps reread
http://wiki2.dovecot.org/MboxChildFolders?highlight=%28index%29
http://wiki2.dovecot.org/Plugins/FTS/Lucene
Requires Dovecot v2.1+ to work properly. The CLucene version must be v2.3 (not v0.9). Dovecot builds only a single Lucene index for all mailboxes. The Lucene indexes are stored in lucene-indexes/ directory under the mail root index directory (e.g. ~/Maildir/lucene-indexes/).
so perhaps you need configure index directory seperate/extra setting etc
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de <mailto:rs@sys4.de>> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley:
Hi,
Is there any way to hide this folder from IMAP clients? I can see it is not runtime configurable and just #defined as
LUCENE_INDEX_DIR_NAME in
fts-backend-lucene.c.
you shouldnt see it, guess you configured something wrong like
i.e
maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored.
etc
post your full dove conf to give chance for analysis
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 <tel:%2B49%20%2889%29%2030%2090%2046%2064> Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com <mailto:larryrtx@gmail.com> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Yeah, I see that now -- I needed to move all my users lucene-indexes, or they'll get rebuilt over time......
On Thu, Jul 3, 2014 at 1:58 PM, Timo Sirainen <tss@iki.fi> wrote:
Try the latest hg version. The lucene-indexes directory should be hidden under .imap/ directory.
On 3.7.2014, at 20.55, Larry Rosenman <larryrtx@gmail.com> wrote:
Timo, Is there any chance of this happening (making lucene-indexes \NOSELECT)?
On Fri, May 9, 2014 at 12:38 PM, Robert Schetterer <rs@sys4.de> wrote:
Am 09.05.2014 19:27, schrieb Larry Rosenman:
I'm using mbox, so it DOES show up.
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $ more /tmp/doveconf.n.out
# 2.2.12: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-STABLE amd64
auth_default_realm = lerctr.org <http://lerctr.org>
auth_mechanisms = plain login
auth_realms = lerctr.org <http://lerctr.org> thebighonker.lerctr.org <http://thebighonker.lerctr.org> tbh.lerctr.org <http://tbh.lerctr.org
auth_username_format = %Ln
disable_plaintext_auth = no
lda_mailbox_autocreate = yes
lmtp_save_to_detail_mailbox = yes
login_access_sockets = tcpwrap
mail_debug = yes
mail_location = mbox:~/mail:INBOX=~/mail/INBOX
mail_plugins = snarf fts fts_lucene stats
mail_privileged_group = mail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave
namespace Snarf {
hidden = yes
list = no
location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY
prefix = ~~Snarfbox/
separator = /
}
namespace archive {
hidden = no
inbox = no
list = no
location = mbox:~/MAILARCHIVE
prefix = "#ARCHIVE/"
separator = /
}
namespace default {
hidden = yes
list = no
location =
prefix = ~~default/
separator = /
}
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts
}
mailbox INBOX {
auto = create
}
mailbox Junk {
special_use = \Junk
}
mailbox Sent {
special_use = \Sent
}
mailbox "Sent Messages" {
special_use = \Sent
}
mailbox Trash {
special_use = \Trash
}
prefix =
}
passdb {
args = failure_show_msg=yes session=yes max_requests=20
driver = pam
}
plugin {
fts = lucene
fts_lucene = whitespace_chars=@. normalize no_snowball
mbox_snarf = ~/mail/INBOX
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
snarf = ~~Snarfbox/INBOX
stats_command_min_time = 1 mins
stats_domain_min_time = 12 hours
stats_ip_min_time = 12 hours
stats_memory_limit = 16 M
stats_refresh = 5s
stats_session_min_time = 15 mins
stats_track_cmds = yes
stats_user_min_time = 1 hours
}
service auth {
unix_listener auth-client {
mode = 0666
}
unix_listener auth-master {
mode = 0666
}
}
service stats {
chroot = empty
client_limit = 0
drop_priv_before_exec = no
executable = stats
extra_groups =
fifo_listener stats-mail {
group =
mode = 0666
user =
}
group =
idle_kill = 4294967295 secs
privileged_group =
process_limit = 1
process_min_avail = 0
protocol =
service_count = 0
type =
unix_listener stats {
group =
mode = 0666
user =
}
user = $default_internal_user
vsz_limit = 18446744073709551615 B
}
service tcpwrap {
unix_listener login/tcpwrap {
group = $default_login_user
mode = 0600
user = $default_login_user
}
}
ssl_cert = </etc/ssl/certs/dovecot.pem
ssl_key = </etc/ssl/private/dovecot.pem
userdb {
driver = passwd
}
protocol imap {
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
mail_max_userip_connections = 50
mail_plugins = snarf fts fts_lucene stats imap_stats
}
i am not using mbox , didnt analyse your conf very deeply but my bet is ,your namespace and/or directory layout setup is the problem
perhaps reread
http://wiki2.dovecot.org/MboxChildFolders?highlight=%28index%29
http://wiki2.dovecot.org/Plugins/FTS/Lucene
Requires Dovecot v2.1+ to work properly. The CLucene version must be v2.3 (not v0.9). Dovecot builds only a single Lucene index for all mailboxes. The Lucene indexes are stored in lucene-indexes/ directory under the mail root index directory (e.g. ~/Maildir/lucene-indexes/).
so perhaps you need configure index directory seperate/extra setting etc
thebighonker.lerctr.org <http://thebighonker.lerctr.org> /home/ler $
On Fri, May 9, 2014 at 12:24 PM, Robert Schetterer <rs@sys4.de <mailto:rs@sys4.de>> wrote:
Am 09.05.2014 18:20, schrieb Nicholas Riley:
Hi,
Is there any way to hide this folder from IMAP clients? I can see it is not runtime configurable and just #defined as
LUCENE_INDEX_DIR_NAME in
fts-backend-lucene.c.
you shouldnt see it, guess you configured something wrong like
i.e
maildir_stat_dirs=no (default): Assume that all the files beginning with a dot in the maildir are maildirs. You shouldn't have any non-directory files beginning with a dot in the maildirs, but if you do you may need to set this to "yes", in which case Dovecot needs to stat() each directory entry, which degrades the performance. Some filesystems provide the directory/non-directory status for free without having to stat(). In those filesystems this setting is ignored.
etc
post your full dove conf to give chance for analysis
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 <tel:%2B49%20%2889%29%2030%2090%2046%2064> Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com <mailto:larryrtx@gmail.com> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Best Regards MfG Robert Schetterer
-- [*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
participants (5)
-
Gregory Finch
-
Larry Rosenman
-
Nicholas Riley
-
Robert Schetterer
-
Timo Sirainen