Hi, tried to Google/etc to see what to tweak.. not finding anything helpful.
So.. I've been running my private mail through a Linux server since approx year 2000. The OS has been various flavors of Fedora or CentOS, since for work, I have to spend all day supporting some sort of Red Hat flavor.
So I run SquirrelMail on top of Dovecot and Postfix on CentOS 7, things have been great for like forever. I recently ran updates and all my INBOX folders disappeared. I have made no configuration changes in at least 5 years. I can't seem to resolve/figure out what's going on. I have backups to see everything before the update. I've noticed that my subscriptions file is missing all the folders, which are all in this file in the backups. If I repopulate this file with the names, the next time I access mail, they are all removed. Most of my mail is in folders, therefore I have access to almost none of it (can see new stuff coming in, but can't sort it anywhere).
k, for the details.. I was running dovecot-2.2.10 (2.2.10-8.el7.x86_64) and was updated to dovecot-2.2.36 (2.2.36-3.el7_7.1.x86_64) with yum updates.
# dovecot --version 2.2.36 (1f10bfa63) # dovecot -n # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1062.18.1.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) # Hostname: vm1.tech...com auth_mechanisms = plain login login_greeting = IMAP ready. mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0600 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1,68.139.25.150 } inet_listener imaps { address = 127.0.0.1,68.139.25.150 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { address = 127.0.0.1,68.139.25.150 } } ssl = required ssl_cert =
Regards, -Dave
Dave> Hi, tried to Google/etc to see what to tweak.. not finding Dave> anything helpful. So.. I've been running my private mail Dave> through a Linux server since approx year 2000. The OS has been Dave> various flavors of Fedora or CentOS, since for work, I have to Dave> spend all day supporting some sort of Red Hat flavor.
Makes sense. I'm not a dovecot expert, but in terms of RHEL, have you checkd that the yum update didn't change file permissions, or enable selinux or do something like that?
Dave> So I run SquirrelMail on top of Dovecot and Postfix on CentOS 7, Dave> things have been great for like forever. I recently ran updates Dave> and all my INBOX folders disappeared. I have made no Dave> configuration changes in at least 5 years. I can't seem to Dave> resolve/figure out what's going on. I have backups to see Dave> everything before the update. I've noticed that my subscriptions Dave> file is missing all the folders, which are all in this file in Dave> the backups. If I repopulate this file with the names, the next Dave> time I access mail, they are all removed. Most of my mail is in Dave> folders, therefore I have access to almost none of it (can see Dave> new stuff coming in, but can't sort it anywhere).
Can you see the mail using none IMAP based tools? What do the dovecot and postfix logs show? And what about squirrelmail? Check all your logs for permissions issues.
What else got updated when you did the yum update?
doveadm log errors
might give you some hints.
Dave> k, for the details.. I was running dovecot-2.2.10 (2.2.10-8.el7.x86_64) Dave> and was updated to dovecot-2.2.36 (2.2.36-3.el7_7.1.x86_64) with yum Dave> updates.
Dave> # dovecot --version Dave> 2.2.36 (1f10bfa63) Dave> # dovecot -n Dave> # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf Dave> # OS: Linux 3.10.0-1062.18.1.el7.x86_64 x86_64 CentOS Linux release Dave> 7.7.1908 (Core) Dave> # Hostname: vm1.tech...com Dave> auth_mechanisms = plain login Dave> login_greeting = IMAP ready. Dave> mail_location = maildir:~/Maildir Dave> mbox_write_locks = fcntl Dave> namespace inbox { Dave> inbox = yes Dave> location = Dave> mailbox Drafts { Dave> special_use = \Drafts Dave> } Dave> mailbox Junk { Dave> special_use = \Junk Dave> } Dave> mailbox Sent { Dave> special_use = \Sent Dave> } Dave> mailbox "Sent Messages" { Dave> special_use = \Sent Dave> } Dave> mailbox Trash { Dave> special_use = \Trash Dave> } Dave> prefix = Dave> } Dave> passdb { Dave> driver = pam Dave> } Dave> service auth { Dave> unix_listener /var/spool/postfix/private/auth { Dave> mode = 0600 Dave> user = postfix Dave> } Dave> } Dave> service imap-login { Dave> inet_listener imap { Dave> address = 127.0.0.1,68.139.25.150 Dave> } Dave> inet_listener imaps { Dave> address = 127.0.0.1,68.139.25.150 Dave> } Dave> } Dave> service pop3-login { Dave> inet_listener pop3 { Dave> port = 0 Dave> } Dave> inet_listener pop3s { Dave> address = 127.0.0.1,68.139.25.150 Dave> } Dave> } Dave> ssl = required Dave> ssl_cert = ssl_cipher_list = ALL:!aNULL:!eNULL:!LOW:!EXP:!RC4 Dave> ssl_key = # hidden, use -P to show it Dave> ssl_prefer_server_ciphers = yes Dave> userdb { Dave> driver = passwd Dave> }
Dave> Regards, Dave> -Dave
On Thu, April 16, 2020 2:33 pm, John Stoffel wrote:
Makes sense. I'm not a dovecot expert, but in terms of RHEL, have you checkd that the yum update didn't change file permissions, or enable selinux or do something like that?
old (before upgrade) dir was like this (from backup):
drwx------ 2 dave dave 245760 Mar 10 16:56 cur -rw-rw-r-- 1 dave dave 48744 Mar 9 14:48 dovecot.index -rw-rw-r-- 1 dave dave 1920452 Mar 2 06:49 dovecot.index.cache -rw-rw-r-- 1 dave dave 1808 Mar 10 17:01 dovecot.index.log -rw-rw-r-- 1 dave dave 32792 Mar 9 14:48 dovecot.index.log.2 -rw-rw-r-- 1 dave dave 450 Sep 15 2017 dovecot.index.thread -rw-rw-r-- 1 dave dave 3192 Aug 26 2019 dovecot.mailbox.log -rw-rw-r-- 1 dave dave 206829 Mar 10 16:56 dovecot-uidlist -rw-rw-r-- 1 dave dave 8 May 7 2019 dovecot-uidvalidity -r--r--r-- 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a69fb -r--r--r-- 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a6a01 drwxrwxr-x 5 dave dave 167 Aug 28 2019 .DRAFTS drwxrwxr-x 33 dave dave 4096 Mar 2 2019 .INBOX drwx------ 2 dave dave 4096 Mar 10 16:56 new drwxrwxr-x 5 dave dave 192 Dec 21 14:33 .SENT drwxrwxr-x 5 dave dave 192 Feb 12 16:04 .SPAM -rw-rw-r-- 1 dave dave 728 Aug 26 2019 subscriptions drwx------ 2 dave dave 10 Mar 10 18:17 tmp drwxrwxr-x 14 dave dave 320 Sep 11 2019 .TRASH
new dir is now like so (maybe this gives some clues to someone, altho I assume the dovecot guys would understand the changes that have been made - I tried to dig thru changelogs to some level):
drwx------. 2 dave dave 221184 Apr 17 02:28 cur -rw-rw-r--. 1 dave dave 80008 Apr 16 13:33 dovecot.index -rw-rw-r--. 1 dave dave 2113444 Apr 16 13:30 dovecot.index.cache -rw-rw-r--. 1 dave dave 29992 Apr 17 02:34 dovecot.index.log -rw-rw-r--. 1 dave dave 450 Sep 15 2017 dovecot.index.thread -rw-rw-r--. 1 dave dave 3192 Aug 26 2019 dovecot.mailbox.log -rw-rw-r--. 1 dave dave 227210 Apr 17 02:28 dovecot-uidlist -rw-rw-r--. 1 dave dave 8 Mar 28 09:31 dovecot-uidvalidity -r--r--r--. 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a6a04 drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 DRAFTS drwxrwxr-x. 5 dave dave 4096 Aug 28 2019 .DRAFTS drwxrwxr-x. 32 dave dave 4096 Mar 2 2019 .INBOX drwx------. 2 dave dave 4096 Apr 20 18:13 new drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 SENT drwxrwxr-x. 5 dave dave 4096 Apr 15 19:21 .SENT drwxrwxr-x. 5 dave dave 4096 Mar 17 13:22 .SPAM -rw-rw-r--. 1 dave dave 728 Aug 26 2019 subscriptions drwx------. 2 dave dave 6 Apr 20 18:13 tmp drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 TRASH drwxrwxr-x. 14 dave dave 4096 Sep 11 2019 .TRASH
no config changes were done, just binary updates.. I compared configs against the backup to check
Can you see the mail using none IMAP based tools? What do the dovecot and postfix logs show? And what about squirrelmail? Check all your logs for permissions issues.
I put the old subscriptions file back and do (pure dovecot at this point):
[dave@vm1 ~]$ doveadm mailbox list SENT TRASH DRAFTS SPAM INBOX
(SPAM was an old folder I had created many years back, other than it, everything had been created as folders under INBOX)
subscriptions (snippet)
SENT TRASH DRAFTS INBOX/Facebook SPAM INBOX/Amazon INBOX/Linkedin INBOX/bills INBOX/ADT INBOX/food INBOX/money INBOX/art INBOX/pets ........
doveadm log errors
alot of errs related to the previous folders that used to work
Apr 07 15:21:43 Warning: imap(dave): Subscriptions file /home/davej/Maildir/subscriptions: Removing invalid entry: INBOX/property Apr 15 14:55:39 Warning: imap(dave): Subscriptions file /home/dave/Maildir/subscriptions: Removing invalid entry: INBOX/Facebook
Regards, -Dave
"Dave" == Dave dave@techhosts.com writes:
Dave> On Thu, April 16, 2020 2:33 pm, John Stoffel wrote:
Makes sense. I'm not a dovecot expert, but in terms of RHEL, have you checkd that the yum update didn't change file permissions, or enable selinux or do something like that?
Dave> old (before upgrade) dir was like this (from backup):
I think your dovecot config has changed in some manner. Can you share the output of 'dovecot -n' please?
Dave> drwx------ 2 dave dave 245760 Mar 10 16:56 cur Dave> -rw-rw-r-- 1 dave dave 48744 Mar 9 14:48 dovecot.index Dave> -rw-rw-r-- 1 dave dave 1920452 Mar 2 06:49 dovecot.index.cache Dave> -rw-rw-r-- 1 dave dave 1808 Mar 10 17:01 dovecot.index.log Dave> -rw-rw-r-- 1 dave dave 32792 Mar 9 14:48 dovecot.index.log.2 Dave> -rw-rw-r-- 1 dave dave 450 Sep 15 2017 dovecot.index.thread Dave> -rw-rw-r-- 1 dave dave 3192 Aug 26 2019 dovecot.mailbox.log Dave> -rw-rw-r-- 1 dave dave 206829 Mar 10 16:56 dovecot-uidlist Dave> -rw-rw-r-- 1 dave dave 8 May 7 2019 dovecot-uidvalidity Dave> -r--r--r-- 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a69fb Dave> -r--r--r-- 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a6a01 Dave> drwxrwxr-x 5 dave dave 167 Aug 28 2019 .DRAFTS Dave> drwxrwxr-x 33 dave dave 4096 Mar 2 2019 .INBOX Dave> drwx------ 2 dave dave 4096 Mar 10 16:56 new Dave> drwxrwxr-x 5 dave dave 192 Dec 21 14:33 .SENT Dave> drwxrwxr-x 5 dave dave 192 Feb 12 16:04 .SPAM Dave> -rw-rw-r-- 1 dave dave 728 Aug 26 2019 subscriptions Dave> drwx------ 2 dave dave 10 Mar 10 18:17 tmp Dave> drwxrwxr-x 14 dave dave 320 Sep 11 2019 .TRASH
Dave> new dir is now like so (maybe this gives some clues to someone, Dave> altho I assume the dovecot guys would understand the changes Dave> that have been made - I tried to dig thru changelogs to some Dave> level):
I suspect it's a config change that was put in place by the RHEL upgrade, which is why you need to provide the 'dovecot -n' output.
Dave> drwx------. 2 dave dave 221184 Apr 17 02:28 cur Dave> -rw-rw-r--. 1 dave dave 80008 Apr 16 13:33 dovecot.index Dave> -rw-rw-r--. 1 dave dave 2113444 Apr 16 13:30 dovecot.index.cache Dave> -rw-rw-r--. 1 dave dave 29992 Apr 17 02:34 dovecot.index.log Dave> -rw-rw-r--. 1 dave dave 450 Sep 15 2017 dovecot.index.thread Dave> -rw-rw-r--. 1 dave dave 3192 Aug 26 2019 dovecot.mailbox.log Dave> -rw-rw-r--. 1 dave dave 227210 Apr 17 02:28 dovecot-uidlist Dave> -rw-rw-r--. 1 dave dave 8 Mar 28 09:31 dovecot-uidvalidity Dave> -r--r--r--. 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a6a04 Dave> drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 DRAFTS Dave> drwxrwxr-x. 5 dave dave 4096 Aug 28 2019 .DRAFTS Dave> drwxrwxr-x. 32 dave dave 4096 Mar 2 2019 .INBOX Dave> drwx------. 2 dave dave 4096 Apr 20 18:13 new Dave> drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 SENT Dave> drwxrwxr-x. 5 dave dave 4096 Apr 15 19:21 .SENT Dave> drwxrwxr-x. 5 dave dave 4096 Mar 17 13:22 .SPAM Dave> -rw-rw-r--. 1 dave dave 728 Aug 26 2019 subscriptions Dave> drwx------. 2 dave dave 6 Apr 20 18:13 tmp Dave> drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 TRASH Dave> drwxrwxr-x. 14 dave dave 4096 Sep 11 2019 .TRASH
Dave> no config changes were done, just binary updates.. I compared configs Dave> against the backup to check
How did you compare them?
Can you see the mail using none IMAP based tools? What do the dovecot and postfix logs show? And what about squirrelmail? Check all your logs for permissions issues.
Dave> I put the old subscriptions file back and do (pure dovecot at this point):
Dave> [dave@vm1 ~]$ doveadm mailbox list Dave> SENT Dave> TRASH Dave> DRAFTS Dave> SPAM Dave> INBOX
Dave> (SPAM was an old folder I had created many years back, other than it, Dave> everything had been created as folders under INBOX)
Dave> subscriptions (snippet)
Dave> SENT Dave> TRASH Dave> DRAFTS Dave> INBOX/Facebook Dave> SPAM Dave> INBOX/Amazon Dave> INBOX/Linkedin Dave> INBOX/bills Dave> INBOX/ADT Dave> INBOX/food Dave> INBOX/money Dave> INBOX/art Dave> INBOX/pets Dave> ........
doveadm log errors
Dave> alot of errs related to the previous folders that used to work
Dave> Apr 07 15:21:43 Warning: imap(dave): Subscriptions file Dave> /home/davej/Maildir/subscriptions: Removing invalid entry: INBOX/property Dave> Apr 15 14:55:39 Warning: imap(dave): Subscriptions file Dave> /home/dave/Maildir/subscriptions: Removing invalid entry: INBOX/Facebook
This smells funky, are there any *other* errors or warnings in the log file other than these types of messages?
John
On Tue, April 21, 2020 11:50 am, John Stoffel wrote:
"Dave" == Dave dave@techhosts.com writes:
Dave> On Thu, April 16, 2020 2:33 pm, John Stoffel wrote:
Makes sense. I'm not a dovecot expert, but in terms of RHEL, have you checkd that the yum update didn't change file permissions, or enable selinux or do something like that?
Dave> old (before upgrade) dir was like this (from backup):
I think your dovecot config has changed in some manner. Can you share the output of 'dovecot -n' please?
'dovecot -n' was how I opened this thread, as it was recommended to start out providing as much info as possible. Please read the 1st message you originally replied to
Dave> drwx------ 2 dave dave 245760 Mar 10 16:56 cur Dave> -rw-rw-r-- 1 dave dave 48744 Mar 9 14:48 dovecot.index Dave> -rw-rw-r-- 1 dave dave 1920452 Mar 2 06:49 dovecot.index.cache Dave> -rw-rw-r-- 1 dave dave 1808 Mar 10 17:01 dovecot.index.log Dave> -rw-rw-r-- 1 dave dave 32792 Mar 9 14:48 dovecot.index.log.2 Dave> -rw-rw-r-- 1 dave dave 450 Sep 15 2017 dovecot.index.thread Dave> -rw-rw-r-- 1 dave dave 3192 Aug 26 2019 dovecot.mailbox.log Dave> -rw-rw-r-- 1 dave dave 206829 Mar 10 16:56 dovecot-uidlist Dave> -rw-rw-r-- 1 dave dave 8 May 7 2019 dovecot-uidvalidity Dave> -r--r--r-- 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a69fb Dave> -r--r--r-- 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a6a01 Dave> drwxrwxr-x 5 dave dave 167 Aug 28 2019 .DRAFTS Dave> drwxrwxr-x 33 dave dave 4096 Mar 2 2019 .INBOX Dave> drwx------ 2 dave dave 4096 Mar 10 16:56 new Dave> drwxrwxr-x 5 dave dave 192 Dec 21 14:33 .SENT Dave> drwxrwxr-x 5 dave dave 192 Feb 12 16:04 .SPAM Dave> -rw-rw-r-- 1 dave dave 728 Aug 26 2019 subscriptions Dave> drwx------ 2 dave dave 10 Mar 10 18:17 tmp Dave> drwxrwxr-x 14 dave dave 320 Sep 11 2019 .TRASH
Dave> new dir is now like so (maybe this gives some clues to someone, Dave> altho I assume the dovecot guys would understand the changes Dave> that have been made - I tried to dig thru changelogs to some Dave> level):
I suspect it's a config change that was put in place by the RHEL upgrade, which is why you need to provide the 'dovecot -n' output.
Dave> drwx------. 2 dave dave 221184 Apr 17 02:28 cur Dave> -rw-rw-r--. 1 dave dave 80008 Apr 16 13:33 dovecot.index Dave> -rw-rw-r--. 1 dave dave 2113444 Apr 16 13:30 dovecot.index.cache Dave> -rw-rw-r--. 1 dave dave 29992 Apr 17 02:34 dovecot.index.log Dave> -rw-rw-r--. 1 dave dave 450 Sep 15 2017 dovecot.index.thread Dave> -rw-rw-r--. 1 dave dave 3192 Aug 26 2019 dovecot.mailbox.log Dave> -rw-rw-r--. 1 dave dave 227210 Apr 17 02:28 dovecot-uidlist Dave> -rw-rw-r--. 1 dave dave 8 Mar 28 09:31 dovecot-uidvalidity Dave> -r--r--r--. 1 dave dave 0 Nov 14 2016 dovecot-uidvalidity.582a6a04 Dave> drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 DRAFTS Dave> drwxrwxr-x. 5 dave dave 4096 Aug 28 2019 .DRAFTS Dave> drwxrwxr-x. 32 dave dave 4096 Mar 2 2019 .INBOX Dave> drwx------. 2 dave dave 4096 Apr 20 18:13 new Dave> drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 SENT Dave> drwxrwxr-x. 5 dave dave 4096 Apr 15 19:21 .SENT Dave> drwxrwxr-x. 5 dave dave 4096 Mar 17 13:22 .SPAM Dave> -rw-rw-r--. 1 dave dave 728 Aug 26 2019 subscriptions Dave> drwx------. 2 dave dave 6 Apr 20 18:13 tmp Dave> drwxrwxr-x. 5 dave dave 4096 Mar 28 09:31 TRASH Dave> drwxrwxr-x. 14 dave dave 4096 Sep 11 2019 .TRASH
Dave> no config changes were done, just binary updates.. I compared configs Dave> against the backup to check
How did you compare them?
copied the configs from the backup to a tmp dir and ran diff
Can you see the mail using none IMAP based tools? What do the dovecot and postfix logs show? And what about squirrelmail? Check all your logs for permissions issues.
Dave> I put the old subscriptions file back and do (pure dovecot at this point):
Dave> [dave@vm1 ~]$ doveadm mailbox list Dave> SENT Dave> TRASH Dave> DRAFTS Dave> SPAM Dave> INBOX
Dave> (SPAM was an old folder I had created many years back, other than it, Dave> everything had been created as folders under INBOX)
Dave> subscriptions (snippet)
Dave> SENT Dave> TRASH Dave> DRAFTS Dave> INBOX/Facebook Dave> SPAM Dave> INBOX/Amazon Dave> INBOX/Linkedin Dave> INBOX/bills Dave> INBOX/ADT Dave> INBOX/food Dave> INBOX/money Dave> INBOX/art Dave> INBOX/pets Dave> ........
doveadm log errors
Dave> alot of errs related to the previous folders that used to work
Dave> Apr 07 15:21:43 Warning: imap(dave): Subscriptions file Dave> /home/davej/Maildir/subscriptions: Removing invalid entry: INBOX/property Dave> Apr 15 14:55:39 Warning: imap(dave): Subscriptions file Dave> /home/dave/Maildir/subscriptions: Removing invalid entry: INBOX/Facebook
This smells funky, are there any *other* errors or warnings in the log file other than these types of messages?
did not find anything else, one reason this is such a mystery.. I was hoping by posting here, the dovecot folks/developers would have a clue, since they'd be more intimate with the changes that could have affected this situation
John
Regards, -Dave
participants (2)
-
Dave
-
John Stoffel