doveadm index: can't index a different namespace?
doveadm -D -vvvvvv index \#ARCHIVE/\* garners the below for ALL mailboxes in the namespace: doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/clamav-rules: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-01 13:25:21] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/SA/FN: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-01 13:25:21] thebighonker.lerctr.org ~ $
doveconf -n attached.
2.2.26.0, pigeonhole 0.4.16, clucene from FreeBSD ports.
What else do we need here?
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
Nothing in them from what I can see.....
Nov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: fs: root=/home/mrm/mail, index=, indexpvt=, control=, inbox=/home/mrm/mail/INBOX, alt= Nov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE Nov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: mbox: INBOX defaulted to /home/mrm/MAILARCHIVE/inbox Nov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: fs: root=/home/mrm/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/mrm/MAILARCHIVE/inbox, alt= Nov 1 13:25:14 thebighonker exim[6544]: 1c1dkI-0001gw-B7 => mrm < mrm@lerctr.org> R=localuser T=dovecot_lmtp S=11532 C="250 2.0.0 < mrm@lerctr.org> pfbVHwreGFhQFgAAu+mOrA Saved" QT=0s DT=0s Nov 1 13:25:14 thebighonker exim[6544]: 1c1dkI-0001gw-B7 Completed QT=0s Nov 1 13:25:15 thebighonker dovecot: indexer-worker(mrm): Debug: Mailbox INBOX: Opened mail UID=447860 because: fts indexing Nov 1 13:25:15 thebighonker dovecot: indexer-worker(mrm): Indexed 1 messages in INBOX Nov 1 13:25:19 thebighonker exim[6519]: H=(ylmf-pc) [69.64.78.83]:57747 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pc Nov 1 13:25:27 thebighonker dovecot: imap-login: Login: user=<ler>, method=PLAIN, rip=2001:470:1f0f:3ad:223:7dff:fe9e:6e8a, lip=2001:470:1f0f:3ad:223:7dff:fe9e:6e8a, mpid=6583, TLS, session=<mEXVckFAIEcg AQRwHw8DrQIjff/+nm6K> Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Loading modules from directory: /usr/local/lib/dovecot Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib95_imap_stats_plugin.so Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Effective uid=1001, gid=1001, home=/home/ler Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt= Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inbox Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/ler/MAILARCHIVE/inbox, alt= Nov 1 13:25:27 thebighonker dovecot: imap(ler): Logged out in=6049 out=63372 fhc=50 fhb=22424 fbc=0 fbb=0 del=0 exp=0 trash=0 Nov 1 13:25:29 thebighonker exim[6561]: H=(ylmf-pc) [69.64.78.83]:63376 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pc Nov 1 13:25:39 thebighonker exim[6585]: H=(ylmf-pc) [69.64.78.83]:60216 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pc Nov 1 13:25:46 thebighonker exim[6588]: no host name found for IP address 125.123.158.215 Nov 1 13:25:47 thebighonker exim[6588]: H=(qrhx) [125.123.158.215]:60710 I=[192.147.25.65]:25 F=<ler@lerctr.org> rejected RCPT <3371453348@qq.com>: RBL: found in zen.spamhaus.org (127.0.0.11) (https://ww w.spamhaus.org/query/ip/125.123.158.215) Nov 1 13:25:48 thebighonker exim[6588]: unexpected disconnection while reading SMTP command from (qrhx) [125.123.158.215]:60710 I=[192.147.25.65]:25 Nov 1 13:25:49 thebighonker exim[6590]: H=(ylmf-pc) [69.64.78.83]:60073 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pc Nov 1 13:25:59 thebighonker exim[6608]: H=(ylmf-pc) [69.64.78.83]:60168 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pc Nov 1 13:26:09 thebighonker exim[6613]: H=(ylmf-pc) [69.64.78.83]:55031 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pc Nov 1 13:26:15 thebighonker dovecot: imap-login: Login: user=<ler>, method=PLAIN, rip=2600:1:d613:48fb:b5da:4a31:b4b6:7ff8, lip=2001:470:1f0f:3ad:223:7dff:fe9e:6e8a, mpid=6645, TLS, session=<PsGzdUFA9Y8m AAAB1hNI+7XaSjG0tn/4> Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Loading modules from directory: /usr/local/lib/dovecot Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib95_imap_stats_plugin.so Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Effective uid=1001, gid=1001, home=/home/ler Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt=
I can provide fuller logs, but doveadm running on the server seems to log all to it's own srdout/stderr
On Tue, Nov 1, 2016 at 1:32 PM, Aki Tuomi <aki.tuomi@dovecot.fi> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
clamav-rules is NOT a directory, nor are any of the others:
thebighonker.lerctr.org ~/MAILARCHIVE $ cd 2016/10 thebighonker.lerctr.org ~/MAILARCHIVE/2016/10 $ ls -l total 72106 -rw-r--r-- 1 ler ler 440461 Nov 1 00:05 Amplify_Mail -rw-r--r-- 1 ler ler 104102478 Nov 1 14:53 INBOX drwxr-xr-x 3 ler ler 4 Nov 1 00:05 SA -rw-r--r-- 1 ler ler 21083767 Nov 1 00:05 SENT -rw-r--r-- 1 ler ler 1850677 Nov 1 00:05 SPAM -rw-r--r-- 1 ler ler 36483 Nov 1 00:05 UFCU_Mail -rw-r--r-- 1 ler ler 460073 Nov 1 00:05 bacula -rw-r--r-- 1 ler ler 1107098 Nov 1 00:05 bayes-update -rw-r--r-- 1 ler ler 3884041 Nov 1 00:05 clamav-rules -rw-r--r-- 1 ler ler 652132 Nov 1 00:05 firewall drwxr-xr-x 11 ler ler 20 Nov 1 00:05 lists -rw-r--r-- 1 ler ler 25122465 Nov 1 00:05 root-mail -rw-r--r-- 1 ler ler 44553 Nov 1 00:05 satelliteguys -rw-r--r-- 1 ler ler 625628 Nov 1 00:05 wview thebighonker.lerctr.org ~/MAILARCHIVE/2016/10 $
On Wed, Nov 2, 2016 at 12:17 PM, Timo Sirainen <tss@iki.fi> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
thebighonker.lerctr.org ~ $ doveadm mailbox status -u ler@lerctr.org vsize \#ARCHIVE/2016/10/clamav-rules #ARCHIVE/2016/10/clamav-rules vsize=3840752 thebighonker.lerctr.org ~ $
On Wed, Nov 2, 2016 at 12:22 PM, Timo Sirainen <tss@iki.fi> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
It's getting a bit strange. You were running 2.2.25 previously and it was working then? Does the doveadm index always fail with the same errors?
Also I just noticed that it's saying INBOX isn't selectable: "lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable". Which I guess isn't true. It seems to be failing somewhat randomly..
It's ALWAYS failed on the other NAMESPACE.
Some of the logging looks weird as well for the 2nd namespace:
Nov 2 12:32:03 thebighonker dovecot: imap-login: Login: user=<mrm>, method=PLAIN, rip=207.231.91.36, lip=192.147.25.65, mpid=76712, TLS, session=<HC+00VRAWczP51sk> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Loading modules from directory: /usr/local/lib/dovecot Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib95_imap_stats_plugin.so Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Effective uid=1004, gid=1004, home=/home/mrm Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: fs: root=/home/mrm/mail, index=, indexpvt=, control=, inbox=/home/mrm/mail/INBOX, alt= Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: mbox: INBOX defaulted to /home/mrm/MAILARCHIVE/inbox Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: fs: root=/home/mrm/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/mrm/MAILARCHIVE/inbox, alt=
On Wed, Nov 2, 2016 at 12:30 PM, Timo Sirainen <tss@iki.fi> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
FWIW it DOES work on my default NAMESPACE, just not the #ARCHIVE/ NAMESPACE.
On Wed, Nov 2, 2016 at 12:32 PM, Larry Rosenman <larryrtx@gmail.com> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
one other thing, fts_autoindex does NOT appear to be working on the #ARCHIVE/ NAMESPACE.
I wonder if these are all interrelated?
On Wed, Nov 2, 2016 at 1:10 PM, Larry Rosenman <larryrtx@gmail.com> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
nope -- No difference
thebighonker.lerctr.org ~ $ ls -l ~/MAILARCHIVE/ total 176 drwx------ 6 ler ler 7 May 25 2014 2004 drwx------ 8 ler ler 8 Mar 3 2013 2005 drwx------ 11 ler ler 11 Mar 3 2013 2006 drwx------ 11 ler ler 11 May 3 2013 2007 drwx------ 14 ler ler 14 Mar 3 2013 2008 drwx------ 14 ler ler 14 Mar 3 2013 2009 drwx------ 14 ler ler 14 Mar 3 2013 2010 drwx------ 15 ler ler 15 Mar 3 2013 2011 drwx------ 15 ler ler 15 Mar 3 2013 2012 drwx------ 14 ler ler 14 Dec 31 2013 2013 drwxr-xr-x 14 ler ler 14 Jan 1 2015 2014 drwxr-xr-x 14 ler ler 14 Jan 1 2016 2015 drwxr-xr-x 12 ler ler 12 Nov 1 00:05 2016 -rw-r--r-- 1 ler ler 0 Nov 2 13:26 inbox thebighonker.lerctr.org ~ $
doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/Amplify_Mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:28:28] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/clamav-rules: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:28:28] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/SA/FN: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:28:28] thebighonker.lerctr.org ~ $
thebighonker.lerctr.org ~ $ doveadm -D -vvvvv index \#ARCHIVE/\* Debug: Loading modules from directory: /usr/local/lib/dovecot Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_lookup" (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm(ler): Debug: Effective uid=1001, gid=1001, home=/home/ler doveadm(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX doveadm(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt= doveadm(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE doveadm(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inbox doveadm(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/ler/MAILARCHIVE/inbox, alt= doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/satelliteguys: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/SA/FN: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/SENT: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/INBOX: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/SPAM: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/root-mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/bacula: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/Junk E-mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/Amplify_Mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable
On Wed, Nov 2, 2016 at 1:25 PM, Timo Sirainen <tss@iki.fi> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
Is there anything else I can provide?
On Wed, Nov 2, 2016 at 1:30 PM, Larry Rosenman <larryrtx@gmail.com> wrote:
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
participants (3)
-
Aki Tuomi
-
Larry Rosenman
-
Timo Sirainen