[Dovecot] doveadm fts: mbox/lucene-indexes, and other errors

Larry Rosenman larryrtx at gmail.com
Tue May 27 20:03:43 UTC 2014 

I turned on fts_autoindex today, and wanted to rescan all my mailboxes....

Ran doveadm -Dv fts rescan, and garnered:

thebighonker.lerctr.org /home/ler/mail $ doveadm -Dv fts rescan
    doveadm(ler): Debug: Loading modules from directory:
/usr/local/lib/dovecot

doveadm(ler): Debug: Module loaded:
/usr/local/lib/dovecot/lib20_fts_plugin.so

doveadm(ler): Debug: Module loaded:
/usr/local/lib/dovecot/lib21_fts_lucene_plugin.so

doveadm(ler): Debug: Module loaded:
/usr/local/lib/dovecot/lib90_stats_plugin.so

doveadm(ler): Debug: Loading modules from directory:
/usr/local/lib/dovecot/doveadm

doveadm(ler): Debug: Skipping module doveadm_acl_plugin, because dlopen()
failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so:
Undefined symbol "acl_user_module" (this is usually intentional, so just
ignore this message)

doveadm(ler): Debug: Skipping module doveadm_expire_plugin, because
dlopen() failed:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined
symbol "expire_set_lookup" (this is usually intentional, so just ignore
this message)

doveadm(ler): Debug: Skipping module doveadm_quota_plugin, because dlopen()
failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so:
Undefined symbol "quota_user_module" (this is usually intentional, so just
ignore this message)

doveadm(ler): Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so

doveadm(ler): Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so

doveadm(ler): Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so

doveadm(ler): Debug: Effective uid=1002, gid=1002, home=/home/ler

doveadm(ler): Debug: Namespace inbox: type=private, prefix=, sep=,
inbox=yes, hidden=no, list=yes, subscriptions=yes
location=mbox:~/mail:INBOX=~/mail/INBOX

doveadm(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=,
inbox=/home/ler/mail/INBOX, alt=

doveadm(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/,
sep=/, inbox=no, hidden=no, list=no, subscriptions=yes
location=mbox:~/MAILARCHIVE

doveadm(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inbox

doveadm(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=,
control=, inbox=/home/ler/MAILARCHIVE/inbox, alt=

doveadm(ler): Error: Couldn't get mailbox
lucene-indexes/dovecot-expunges.log GUID: Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_a1.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9t.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9z.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9t_1.del GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/segments.gen GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9u.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_a0.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9x.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9v.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/segments_ke GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9w.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9y.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_5w.cfs GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_5w_1.del GUID:
Mailbox isn't a valid mbox file

doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with
GUID=21ba3234186a115376580000bbe98eac): Internal error occurred. Refer to
server log for more information. [2014-05-27 14:59:45]

doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with
GUID=77614b1bb0383a530fb30000bbe98eac): Internal error occurred. Refer to
server log for more information. [2014-05-27 14:59:45]

doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with
GUID=c77d8c12ac6b115348590000bbe98eac): Internal error occurred. Refer to
server log for more information. [2014-05-27 14:59:45]

doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with
GUID=d07d8c12ac6b115348590000bbe98eac): Internal error occurred. Refer to
server log for more information. [2014-05-27 14:59:45]

doveadm(ler): Error: fts rescan failed

thebighonker.lerctr.org /home/ler/mail $


1) why doesn't Dovecot make the lucene-indexes directory \NoSelect or
invisible?

2) how can I find the error(s) for the internal errors?  (I looked in my
debug.maillog and find NOTHING).


Dovecot 2.2.13

FreeBSD 10.0

dovecot -n:


thebighonker.lerctr.org /home/ler/mail $ dovecot -n

# 2.2.13: /usr/local/etc/dovecot/dovecot.conf

# OS: FreeBSD 10.0-STABLE amd64

auth_default_realm = lerctr.org

auth_mechanisms = plain login

auth_realms = lerctr.org thebighonker.lerctr.org tbh.lerctr.org

auth_username_format = %Ln

disable_plaintext_auth = no

lda_mailbox_autocreate = yes

lmtp_save_to_detail_mailbox = yes

login_access_sockets = tcpwrap

mail_debug = yes

mail_location = mbox:~/mail:INBOX=~/mail/INBOX

mail_plugins = fts fts_lucene stats

mail_privileged_group = mail

managesieve_notify_capability = mailto

managesieve_sieve_capability = fileinto reject envelope encoded-character
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags
copy include variables body enotify environment mailbox date ihave duplicate

namespace archive {

  hidden = no

  inbox = no

  list = no

  location = mbox:~/MAILARCHIVE

  prefix = "#ARCHIVE/"

  separator = /

}

namespace inbox {

  inbox = yes

  location =

  mailbox Drafts {

    special_use = \Drafts

  }

  mailbox INBOX {

    auto = create

  }

  mailbox Junk {

    special_use = \Junk

  }

  mailbox Sent {

    special_use = \Sent

  }

  mailbox "Sent Messages" {

    special_use = \Sent

  }

  mailbox Trash {

    special_use = \Trash

  }

  prefix =

}

passdb {

  args = failure_show_msg=yes session=yes max_requests=20

  driver = pam

}

plugin {

  fts = lucene

  fts_autoindex = yes

  fts_lucene = whitespace_chars=@. normalize no_snowball

  sieve = ~/.dovecot.sieve

  sieve_dir = ~/sieve

  stats_command_min_time = 1 mins

  stats_domain_min_time = 12 hours

  stats_ip_min_time = 12 hours

  stats_memory_limit = 16 M

  stats_refresh = 5s

  stats_session_min_time = 15 mins

  stats_track_cmds = yes

  stats_user_min_time = 1 hours

}

service auth {

  unix_listener auth-client {

    mode = 0666

  }

  unix_listener auth-master {

    mode = 0666

  }

}

service stats {

  chroot = empty

  client_limit = 0

  drop_priv_before_exec = no

  executable = stats

  extra_groups =

  fifo_listener stats-mail {

    group =

    mode = 0666

    user =

  }

  group =

  idle_kill = 4294967295 secs

  privileged_group =

  process_limit = 1

  process_min_avail = 0

  protocol =

  service_count = 0

  type =

  unix_listener stats {

    group =

    mode = 0666

    user =

  }

  user = $default_internal_user

  vsz_limit = 18446744073709551615 B

}

service tcpwrap {

  unix_listener login/tcpwrap {

    group = $default_login_user

    mode = 0600

    user = $default_login_user

  }

}

ssl_cert = </etc/ssl/certs/dovecot.pem

ssl_key = </etc/ssl/private/dovecot.pem

userdb {

  driver = passwd

}

verbose_proctitle = yes

protocol imap {

  imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags

  mail_max_userip_connections = 50

  mail_plugins = fts fts_lucene stats imap_stats

}

thebighonker.lerctr.org /home/ler/mail $

-- 
Larry Rosenman                     http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
US Mail: 108 Turvey Cove, Hutto, TX 78634-5688

More information about the dovecot mailing list