Re: Issue with one user only, exceeding connections
Date: Thursday, June 09, 2022 11:07:38 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
On 6/9/2022 10:59, Richard wrote:
Date: Thursday, June 09, 2022 10:46:25 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
That was the first thing I tried, I lowered the cache connections in Thunderbird. Actually the max connections was 50, not 500, but I could see why as I do have a lot of folders, but what is odd is I have other mailboxes that have even more folders, but it's only one mailbox that is trowing the error.
"# ps -axww | grep imap" does not give me the same results -
.....
19897 ? S 0:00 dovecot/imap 19900 ? S 0:02 dovecot/imap 19901 ? S 0:00 dovecot/imap 19902 ? S 0:00 dovecot/imap .....
I wish it did give me the mailbox, is there a option to get it to give me that information?
Try "auxw" on your "ps". I.e., add in the "u" which will get you the user detail in the first column, otherwise you just get the process id.
Thank you! That worked, I piped the output to a file, grep the username and sure enough there are 60 lines. So I guess going over 50 was a possibility.
Learn something new every day. I set the maximum to 100 so I should not have any errors on that anymore.
Rather than simply upping the limit I think a reasonable question to ask is why/how they are managing to do that. That's a lot of open folders.
By the way, the single command:
ps auxw | grep imap | cut -d" " -f1 | sort | uniq -c
will get you a nice list with the users and their connection counts.
doveadm who and doveadm kick are useful too :)
On Thu, Jun 9, 2022 at 11:29 AM Richard < inbound-dovecot@listmail.innovate.net> wrote:
Date: Thursday, June 09, 2022 11:07:38 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
On 6/9/2022 10:59, Richard wrote:
Date: Thursday, June 09, 2022 10:46:25 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
That was the first thing I tried, I lowered the cache connections in Thunderbird. Actually the max connections was 50, not 500, but I could see why as I do have a lot of folders, but what is odd is I have other mailboxes that have even more folders, but it's only one mailbox that is trowing the error.
"# ps -axww | grep imap" does not give me the same results -
.....
19897 ? S 0:00 dovecot/imap 19900 ? S 0:02 dovecot/imap 19901 ? S 0:00 dovecot/imap 19902 ? S 0:00 dovecot/imap .....
I wish it did give me the mailbox, is there a option to get it to give me that information?
Try "auxw" on your "ps". I.e., add in the "u" which will get you the user detail in the first column, otherwise you just get the process id.
Thank you! That worked, I piped the output to a file, grep the username and sure enough there are 60 lines. So I guess going over 50 was a possibility.
Learn something new every day. I set the maximum to 100 so I should not have any errors on that anymore.
Rather than simply upping the limit I think a reasonable question to ask is why/how they are managing to do that. That's a lot of open folders.
By the way, the single command:
ps auxw | grep imap | cut -d" " -f1 | sort | uniq -c
will get you a nice list with the users and their connection counts.
-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
Thanks for the command, that is very useful.
That user is actually me, I know why where are so many open. I have my computer, and two tablets, and since I am using server side filtering (procmail) I have to set watch on all the folders that are filtered to or I miss a email. But I am doing the same for about 4 other users accounts I also monitor, so I am not sure why it's just my username that is doing that. I am going to shut down all the clients one at a time and see what client is opening all those connections.
Once I close the client, I assume the connection should also close and the count go down, correct?
I turned off both tablets and the connection count for my username still is at 60, since I am writing this email with my computer client I will send it and close my client and see what happens. Thanks! - Jeremy
On 6/9/2022 11:29, Richard wrote:
Date: Thursday, June 09, 2022 11:07:38 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
On 6/9/2022 10:59, Richard wrote:
Date: Thursday, June 09, 2022 10:46:25 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
That was the first thing I tried, I lowered the cache connections in Thunderbird. Actually the max connections was 50, not 500, but I could see why as I do have a lot of folders, but what is odd is I have other mailboxes that have even more folders, but it's only one mailbox that is trowing the error.
"# ps -axww | grep imap" does not give me the same results -
.....
19897 ? S 0:00 dovecot/imap 19900 ? S 0:02 dovecot/imap 19901 ? S 0:00 dovecot/imap 19902 ? S 0:00 dovecot/imap .....
I wish it did give me the mailbox, is there a option to get it to give me that information? Try "auxw" on your "ps". I.e., add in the "u" which will get you the user detail in the first column, otherwise you just get the process id.
Thank you! That worked, I piped the output to a file, grep the username and sure enough there are 60 lines. So I guess going over 50 was a possibility.
Learn something new every day. I set the maximum to 100 so I should not have any errors on that anymore.
Rather than simply upping the limit I think a reasonable question to ask is why/how they are managing to do that. That's a lot of open folders.
By the way, the single command:
ps auxw | grep imap | cut -d" " -f1 | sort | uniq -c
will get you a nice list with the users and their connection counts.
Ok, more information. I closed all my clients and checked the connection count. It was still at 57, so I cleared the user with "doveadm kick", count was then 0. I launched Thunderbird again and the count went to 16, then started my tablet and it when to 3.
I am thinking I still have a issue as why when I closed all the clients I still had 57 threads/connections open, and after Thunderbird settled down it dropped its connections to 3, but over time that connection count rises.
In the 5 min while writing this the connections jumped to 30.
I turned off Wifi on my tablet so the client would use a different IP, the connection list went to 41
Now it went back to 59 open connections. I turned my tablet back off, its staying at 59. I kicked the user again. I am going to keep my tablet off, maybe it's the one causing this.
Is there a way to find more information about what is going on in one of the pids? It would seem like one of the clients is opening up a connection and for some reason its not dropping and it keeps just opening up new ones, but there are no errors in the log files. Once I turn off the client the connections are not clearing.
- Jeremy
On 6/9/2022 11:44, Jeremy Schaeffer wrote:
Thanks for the command, that is very useful.
That user is actually me, I know why where are so many open. I have my computer, and two tablets, and since I am using server side filtering (procmail) I have to set watch on all the folders that are filtered to or I miss a email. But I am doing the same for about 4 other users accounts I also monitor, so I am not sure why it's just my username that is doing that. I am going to shut down all the clients one at a time and see what client is opening all those connections.
Once I close the client, I assume the connection should also close and the count go down, correct?
I turned off both tablets and the connection count for my username still is at 60, since I am writing this email with my computer client I will send it and close my client and see what happens. Thanks! - Jeremy
On 6/9/2022 11:29, Richard wrote:
Date: Thursday, June 09, 2022 11:07:38 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
On 6/9/2022 10:59, Richard wrote:
Date: Thursday, June 09, 2022 10:46:25 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
That was the first thing I tried, I lowered the cache connections in Thunderbird. Actually the max connections was 50, not 500, but I could see why as I do have a lot of folders, but what is odd is I have other mailboxes that have even more folders, but it's only one mailbox that is trowing the error.
"# ps -axww | grep imap" does not give me the same results -
.....
19897 ? S 0:00 dovecot/imap 19900 ? S 0:02 dovecot/imap 19901 ? S 0:00 dovecot/imap 19902 ? S 0:00 dovecot/imap .....
I wish it did give me the mailbox, is there a option to get it to give me that information? Try "auxw" on your "ps". I.e., add in the "u" which will get you the user detail in the first column, otherwise you just get the process id.
Thank you! That worked, I piped the output to a file, grep the username and sure enough there are 60 lines. So I guess going over 50 was a possibility.
Learn something new every day. I set the maximum to 100 so I should not have any errors on that anymore.
Rather than simply upping the limit I think a reasonable question to ask is why/how they are managing to do that. That's a lot of open folders. By the way, the single command: ps auxw | grep imap | cut -d" " -f1 | sort | uniq -c will get you a nice list with the users and their connection counts.
"Jeremy" == Jeremy Schaeffer kb9mfd@phonesplus.biz writes:
Jeremy> Thanks for the command, that is very useful. That user is Jeremy> actually me, I know why where are so many open. I have my Jeremy> computer, and two tablets, and since I am using server side Jeremy> filtering (procmail) I have to set watch on all the folders Jeremy> that are filtered to or I miss a email. But I am doing the Jeremy> same for about 4 other users accounts I also monitor, so I am Jeremy> not sure why it's just my username that is doing that. I am Jeremy> going to shut down all the clients one at a time and see what Jeremy> client is opening all those connections.
I too used to use procmail, but it's old and un-maintained and it's not a great solution any more. Instead just setup Sieve and you can manage it remotely. I personally do it from a makefile which does all the steps needed, and I just edit the file in emacs as needed.
I can give you a copy of my makefile if that will help.
Jeremy> Once I close the client, I assume the connection should also close and Jeremy> the count go down, correct?
Jeremy> I turned off both tablets and the connection count for my username still Jeremy> is at 60, since I am writing this email with my computer client I will Jeremy> send it and close my client and see what happens. Thanks! - Jeremy
Jeremy> On 6/9/2022 11:29, Richard wrote:
Date: Thursday, June 09, 2022 11:07:38 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
On 6/9/2022 10:59, Richard wrote:
Date: Thursday, June 09, 2022 10:46:25 -0500 From: Jeremy Schaeffer kb9mfd@phonesplus.biz
That was the first thing I tried, I lowered the cache connections in Thunderbird. Actually the max connections was 50, not 500, but I could see why as I do have a lot of folders, but what is odd is I have other mailboxes that have even more folders, but it's only one mailbox that is trowing the error.
"# ps -axww | grep imap" does not give me the same results -
.....
19897 ? S 0:00 dovecot/imap 19900 ? S 0:02 dovecot/imap 19901 ? S 0:00 dovecot/imap 19902 ? S 0:00 dovecot/imap .....
I wish it did give me the mailbox, is there a option to get it to give me that information? Try "auxw" on your "ps". I.e., add in the "u" which will get you the user detail in the first column, otherwise you just get the process id.
Thank you! That worked, I piped the output to a file, grep the username and sure enough there are 60 lines. So I guess going over 50 was a possibility.
Learn something new every day. I set the maximum to 100 so I should not have any errors on that anymore.
Rather than simply upping the limit I think a reasonable question to ask is why/how they are managing to do that. That's a lot of open folders.
By the way, the single command:
ps auxw | grep imap | cut -d" " -f1 | sort | uniq -c
will get you a nice list with the users and their connection counts.
participants (4)
-
Jeremy Schaeffer
-
John Stoffel
-
Larry Rosenman
-
Richard