<html><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"></head><body><div>Try tracing auth-worker process instead, as sql uses worker.</div><div><br></div><div id="composer_signature"><meta http-equiv="Content-Type" content="text/html; charset=UTF-8">---<div>Aki Tuomi</div><div>Dovecot oy</div></div><div><br></div><div style="font-size:100%;color:#000000"><!-- originalMessage --><div>-------- Original message --------</div><div>From: Simone Lazzaris <s.lazzaris@interactive.eu> </div><div>Date: 07/09/2018 12:59 (GMT+02:00) </div><div>To: Sami Ketola <sami.ketola@dovecot.fi> </div><div>Cc: Dovecot Mailing List <dovecot@dovecot.org>, Aki Tuomi <aki.tuomi@dovecot.fi> </div><div>Subject: Re: Auth process sometimes stop responding after upgrade </div><div><br></div></div>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">In data venerdì 7 settembre 2018 11:20:49 CEST, Sami Ketola ha scritto:</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> > On 7 Sep 2018, at 11.25, Simone Lazzaris <simone.lazzaris@qcom.it> wrote:</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> > Actually, I have a poolmon script running that should drop vhost count for</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> > unresponsive backends; the strage thing is, the backends are NOT</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> > unresponsive, they are working as ususal.</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> If it's this one https://github.com/brandond/poolmon/blob/master/poolmon</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> <https://github.com/brandond/poolmon/blob/master/poolmon> you are running</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> and old version of it as the latest version is more compatible with recent</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> dovecot releases.</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> current version in git correctly uses HOST-DOWN and HOST-FLUSH instead of</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> modifying vhost count.</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">> </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Interesting, I'll surely upgrade the script in the next days. Thanks for the hint.</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">But the script is surely not the ultimate cause of the failures: the backend (and the script itself) are untouched - and working - since many moons ago. </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">The only modified entity is dovecot on the frontends. </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">And even in the event of some (3 out of 8, in this very case) backends marked as failed, the authentication on the frontends should work, shouldn't it?</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">I've tried to strace the auth process during the last failure, and this is what I've got:</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Process 2539 attached - interrupt to quit</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">gettimeofday({1536308480, 998803}, NULL) = 0</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">epoll_wait(15, </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">After about 60 seconds, I've aborted the strace and restarted dovecot to avoid upsetting customers. Searching for file descriptor #15 in /proc/nnnn/fd I found "anon_inode:[eventpoll]"</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"><br>-- </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; font-weight:600; color:#777777;">Simone Lazzaris</span><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; color:#777777;"><br>Responsabile datacenter<br><br></span><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; font-weight:600; color:#777777;">Qcom S.p.A.</span><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; color:#777777;"><br>Via Roggia Vignola, 9 | 24047 Treviglio (BG)<br>T +39036347905 | D +3903631970352| M +393938111237<br></span><a href="mailto:simone.lazzaris@qcom.it"><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; text-decoration: underline; color:#2980b9;">simone.lazzaris@qcom.it</span></a><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; color:#777777;"> | </span><a href="https://www.qcom.it"><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; text-decoration: underline; color:#2980b9;">www.qcom.it</span></a><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; color:#777777;"><br><br>Qcom Official Pages</span><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; font-weight:600; color:#777777;"> </span><a href="https://www.linkedin.com/company/qcom-spa"><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; font-weight:600; text-decoration: underline; color:#2980b9;">LinkedIn</span></a><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; color:#777777;"> | </span><a href="http://www.facebook.com/qcomspa"><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; font-weight:600; text-decoration: underline; color:#2980b9;">Facebook</span></a><span style=" font-family:'Helvetica,Arial,sans-serif'; font-size:small; color:#777777;"><br><br></span><img src="https://www.qcom.it/includes/email-banner.gif" height="60" onmouseover="imageMousePointerUpdate(true)" onmouseout="imageMousePointerUpdate(false)" id="1536327999660"> <br><br><br><br></p></body></html>