Dovecot 2.3.18 and OpenMetrics-Prometheus problem

Fri Feb 25 10:50:47 UTC 2022

Hi Aki,

> Am 25.02.2022 um 11:34 schrieb Aki Tuomi <aki.tuomi at open-xchange.com>:
> 
>> 
>> On 25/02/2022 12:23 Christian Rößner <lists at mlserv.org> wrote:
>> 
>> 
>> Hi,
>> 
>> I have defined several metrics in Dovecot and activated the metrics service. After the I tried to include this in Prometheues, but I get strange errors. I gave up now after several hours in the hope that this might be a bug. So I ask for help here:
>> 
>> Distribution: Rocky 8
>> Official Dovecot Repo
>> Version: 2.3.18
>> 
>> Config for metrics, service and events:
>> 
> 
> Can you include the full metrics output, please?

Yes

----------------------------------------------------------------------
support at mx ~ » curl "http://localhost:9900/metrics"
# HELP process_start_time_seconds Timestamp of service start
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1645743604
# HELP dovecot_build Dovecot build information
# TYPE dovecot_build info
dovecot_build_info{version="2.3.18",revision="9dd8408c18"} 1
# HELP dovecot_auth_success Total number of all events of this kind
# TYPE dovecot_auth_success counter
dovecot_auth_success_total 1843
# HELP dovecot_auth_success_duration_seconds Total duration of all events of this kind
# TYPE dovecot_auth_success_duration_seconds counter
dovecot_auth_success_duration_seconds_total 1.424372
# HELP dovecot_auth_failures Total number of all events of this kind
# TYPE dovecot_auth_failures counter
dovecot_auth_failures_total 1
# HELP dovecot_auth_failures_duration_seconds Total duration of all events of this kind
# TYPE dovecot_auth_failures_duration_seconds counter
dovecot_auth_failures_duration_seconds_total 3.917099
# HELP dovecot_auth_client_userdb Total number of all events of this kind
# TYPE dovecot_auth_client_userdb counter
dovecot_auth_client_userdb_total 30882
# HELP dovecot_auth_client_userdb_duration_seconds Total duration of all events of this kind
# TYPE dovecot_auth_client_userdb_duration_seconds counter
dovecot_auth_client_userdb_duration_seconds_total 35.746910
# HELP dovecot_auth_master Total number of all events of this kind
# TYPE dovecot_auth_master counter
dovecot_auth_master_total 1843
# HELP dovecot_auth_master_duration_seconds Total duration of all events of this kind
# TYPE dovecot_auth_master_duration_seconds counter
dovecot_auth_master_duration_seconds_total 1.029899
# HELP dovecot_client_connected Total number of all events of this kind
# TYPE dovecot_client_connected counter
dovecot_client_connected_total 10591
# HELP dovecot_client_connected_duration_seconds Total duration of all events of this kind
# TYPE dovecot_client_connected_duration_seconds counter
dovecot_client_connected_duration_seconds_total 0.359288
# HELP dovecot_client_disconnected Total number of all events of this kind
# TYPE dovecot_client_disconnected counter
dovecot_client_disconnected_total{reason="Connection closed"} 7173
dovecot_client_disconnected_total{reason="Deinitializing"} 3418
dovecot_client_disconnected_count 10591
# HELP dovecot_client_disconnected_duration_seconds Total duration of all events of this kind
# TYPE dovecot_client_disconnected_duration_seconds counter
dovecot_client_disconnected_duration_seconds_total{reason="Connection closed"} 146.829269
dovecot_client_disconnected_duration_seconds_total{reason="Deinitializing"} 72.953468
dovecot_client_disconnected_duration_seconds_sum 219.782730
# HELP dovecot_imap_command Total number of all events of this kind
# TYPE dovecot_imap_command counter
dovecot_imap_command_total{cmd_name="unknown"} 94
dovecot_imap_command_total{cmd_name="unknown",tagged_reply_state="OK"} 75
dovecot_imap_command_total{cmd_name="FETCH"} 720
dovecot_imap_command_total{cmd_name="FETCH",tagged_reply_state="OK"} 720
dovecot_imap_command_total{cmd_name="IDLE"} 5076
dovecot_imap_command_total{cmd_name="IDLE",tagged_reply_state="OK"} 1555
dovecot_imap_command_total{cmd_name="UID FETCH"} 2473
dovecot_imap_command_total{cmd_name="UID FETCH",tagged_reply_state="OK"} 2473
dovecot_imap_command_total{cmd_name="UID SEARCH"} 7402
dovecot_imap_command_total{cmd_name="UID SEARCH",tagged_reply_state="OK"} 7400
dovecot_imap_command_total{cmd_name="UID SEARCH",tagged_reply_state="BAD"} 2
dovecot_imap_command_total{cmd_name="LOGOUT"} 1112
dovecot_imap_command_total{cmd_name="LOGOUT",tagged_reply_state="OK"} 1112
dovecot_imap_command_total{cmd_name="LIST"} 5942
dovecot_imap_command_total{cmd_name="LIST",tagged_reply_state="OK"} 5942
dovecot_imap_command_total{cmd_name="GETQUOTAROOT"} 88
dovecot_imap_command_total{cmd_name="GETQUOTAROOT",tagged_reply_state="OK"} 88
dovecot_imap_command_total{cmd_name="ID"} 600
dovecot_imap_command_total{cmd_name="ID",tagged_reply_state="OK"} 600
dovecot_imap_command_total{cmd_name="COMPRESS"} 591
dovecot_imap_command_total{cmd_name="COMPRESS",tagged_reply_state="OK"} 591
dovecot_imap_command_total{cmd_name="SELECT"} 3084
dovecot_imap_command_total{cmd_name="SELECT",tagged_reply_state="OK"} 3084
dovecot_imap_command_total{cmd_name="NOOP"} 225
dovecot_imap_command_total{cmd_name="NOOP",tagged_reply_state="OK"} 225
dovecot_imap_command_total{cmd_name="STATUS"} 15337
dovecot_imap_command_total{cmd_name="STATUS",tagged_reply_state="OK"} 15337
dovecot_imap_command_total{cmd_name="UNSELECT"} 1193
dovecot_imap_command_total{cmd_name="UNSELECT",tagged_reply_state="OK"} 1193
dovecot_imap_command_total{cmd_name="CHECK"} 82
dovecot_imap_command_total{cmd_name="CHECK",tagged_reply_state="OK"} 82
dovecot_imap_command_total{cmd_name="ENABLE"} 667
dovecot_imap_command_total{cmd_name="ENABLE",tagged_reply_state="OK"} 667
dovecot_imap_command_total{cmd_name="LSUB"} 403
dovecot_imap_command_total{cmd_name="LSUB",tagged_reply_state="OK"} 403
dovecot_imap_command_total{cmd_name="EXPUNGE"} 427
dovecot_imap_command_total{cmd_name="EXPUNGE",tagged_reply_state="OK"} 427
dovecot_imap_command_total{cmd_name="CLOSE"} 614
dovecot_imap_command_total{cmd_name="CLOSE",tagged_reply_state="OK"} 614
dovecot_imap_command_total{cmd_name="UID MOVE"} 18
dovecot_imap_command_total{cmd_name="UID MOVE",tagged_reply_state="OK"} 18
dovecot_imap_command_total{cmd_name="UID STORE"} 172
dovecot_imap_command_total{cmd_name="UID STORE",tagged_reply_state="OK"} 172
dovecot_imap_command_total{cmd_name="NAMESPACE"} 37
dovecot_imap_command_total{cmd_name="NAMESPACE",tagged_reply_state="OK"} 37
dovecot_imap_command_total{cmd_name="SEARCH"} 489
dovecot_imap_command_total{cmd_name="SEARCH",tagged_reply_state="OK"} 489
dovecot_imap_command_total{cmd_name="UID EXPUNGE"} 73
dovecot_imap_command_total{cmd_name="UID EXPUNGE",tagged_reply_state="OK"} 73
dovecot_imap_command_total{cmd_name="APPEND"} 86
dovecot_imap_command_total{cmd_name="APPEND",tagged_reply_state="OK"} 86
dovecot_imap_command_total{cmd_name="UID COPY"} 8
dovecot_imap_command_total{cmd_name="UID COPY",tagged_reply_state="OK"} 8
dovecot_imap_command_total{cmd_name="SUBSCRIBE"} 16
dovecot_imap_command_total{cmd_name="SUBSCRIBE",tagged_reply_state="OK"} 16
dovecot_imap_command_count 47029
# HELP dovecot_imap_command_duration_seconds Total duration of all events of this kind
# TYPE dovecot_imap_command_duration_seconds counter
dovecot_imap_command_duration_seconds_total{cmd_name="unknown"} 394.558197
dovecot_imap_command_duration_seconds_total{cmd_name="unknown",tagged_reply_state="OK"} 49.297886
dovecot_imap_command_duration_seconds_total{cmd_name="FETCH"} 1.987493
dovecot_imap_command_duration_seconds_total{cmd_name="FETCH",tagged_reply_state="OK"} 1.987493
dovecot_imap_command_duration_seconds_total{cmd_name="IDLE"} 283744.312500
dovecot_imap_command_duration_seconds_total{cmd_name="IDLE",tagged_reply_state="OK"} 229685.437500
dovecot_imap_command_duration_seconds_total{cmd_name="UID FETCH"} 4.214446
dovecot_imap_command_duration_seconds_total{cmd_name="UID FETCH",tagged_reply_state="OK"} 4.214446
dovecot_imap_command_duration_seconds_total{cmd_name="UID SEARCH"} 175.945587
dovecot_imap_command_duration_seconds_total{cmd_name="UID SEARCH",tagged_reply_state="OK"} 175.945496
dovecot_imap_command_duration_seconds_total{cmd_name="UID SEARCH",tagged_reply_state="BAD"} 0.000094
dovecot_imap_command_duration_seconds_total{cmd_name="LOGOUT"} 0.265836
dovecot_imap_command_duration_seconds_total{cmd_name="LOGOUT",tagged_reply_state="OK"} 0.265836
dovecot_imap_command_duration_seconds_total{cmd_name="LIST"} 35.530193
dovecot_imap_command_duration_seconds_total{cmd_name="LIST",tagged_reply_state="OK"} 35.530193
dovecot_imap_command_duration_seconds_total{cmd_name="GETQUOTAROOT"} 0.565966
dovecot_imap_command_duration_seconds_total{cmd_name="GETQUOTAROOT",tagged_reply_state="OK"} 0.565966
dovecot_imap_command_duration_seconds_total{cmd_name="ID"} 0.064538
dovecot_imap_command_duration_seconds_total{cmd_name="ID",tagged_reply_state="OK"} 0.064538
dovecot_imap_command_duration_seconds_total{cmd_name="COMPRESS"} 0.140604
dovecot_imap_command_duration_seconds_total{cmd_name="COMPRESS",tagged_reply_state="OK"} 0.140604
dovecot_imap_command_duration_seconds_total{cmd_name="SELECT"} 4.893884
dovecot_imap_command_duration_seconds_total{cmd_name="SELECT",tagged_reply_state="OK"} 4.893884
dovecot_imap_command_duration_seconds_total{cmd_name="NOOP"} 0.571025
dovecot_imap_command_duration_seconds_total{cmd_name="NOOP",tagged_reply_state="OK"} 0.571025
dovecot_imap_command_duration_seconds_total{cmd_name="STATUS"} 5.291285
dovecot_imap_command_duration_seconds_total{cmd_name="STATUS",tagged_reply_state="OK"} 5.291285
dovecot_imap_command_duration_seconds_total{cmd_name="UNSELECT"} 0.110757
dovecot_imap_command_duration_seconds_total{cmd_name="UNSELECT",tagged_reply_state="OK"} 0.110757
dovecot_imap_command_duration_seconds_total{cmd_name="CHECK"} 0.019408
dovecot_imap_command_duration_seconds_total{cmd_name="CHECK",tagged_reply_state="OK"} 0.019408
dovecot_imap_command_duration_seconds_total{cmd_name="ENABLE"} 0.051830
dovecot_imap_command_duration_seconds_total{cmd_name="ENABLE",tagged_reply_state="OK"} 0.051830
dovecot_imap_command_duration_seconds_total{cmd_name="LSUB"} 59.131454
dovecot_imap_command_duration_seconds_total{cmd_name="LSUB",tagged_reply_state="OK"} 59.131454
dovecot_imap_command_duration_seconds_total{cmd_name="EXPUNGE"} 0.379475
dovecot_imap_command_duration_seconds_total{cmd_name="EXPUNGE",tagged_reply_state="OK"} 0.379475
dovecot_imap_command_duration_seconds_total{cmd_name="CLOSE"} 0.648228
dovecot_imap_command_duration_seconds_total{cmd_name="CLOSE",tagged_reply_state="OK"} 0.648228
dovecot_imap_command_duration_seconds_total{cmd_name="UID MOVE"} 0.941667
dovecot_imap_command_duration_seconds_total{cmd_name="UID MOVE",tagged_reply_state="OK"} 0.941667
dovecot_imap_command_duration_seconds_total{cmd_name="UID STORE"} 0.302505
dovecot_imap_command_duration_seconds_total{cmd_name="UID STORE",tagged_reply_state="OK"} 0.302505
dovecot_imap_command_duration_seconds_total{cmd_name="NAMESPACE"} 0.001530
dovecot_imap_command_duration_seconds_total{cmd_name="NAMESPACE",tagged_reply_state="OK"} 0.001530
dovecot_imap_command_duration_seconds_total{cmd_name="SEARCH"} 0.150726
dovecot_imap_command_duration_seconds_total{cmd_name="SEARCH",tagged_reply_state="OK"} 0.150726
dovecot_imap_command_duration_seconds_total{cmd_name="UID EXPUNGE"} 1.155379
dovecot_imap_command_duration_seconds_total{cmd_name="UID EXPUNGE",tagged_reply_state="OK"} 1.155379
dovecot_imap_command_duration_seconds_total{cmd_name="APPEND"} 53.821384
dovecot_imap_command_duration_seconds_total{cmd_name="APPEND",tagged_reply_state="OK"} 53.821384
dovecot_imap_command_duration_seconds_total{cmd_name="UID COPY"} 0.298924
dovecot_imap_command_duration_seconds_total{cmd_name="UID COPY",tagged_reply_state="OK"} 0.298924
dovecot_imap_command_duration_seconds_total{cmd_name="SUBSCRIBE"} 0.003328
dovecot_imap_command_duration_seconds_total{cmd_name="SUBSCRIBE",tagged_reply_state="OK"} 0.003328
dovecot_imap_command_duration_seconds_sum 284485.343750
# HELP dovecot_lmtp_command Histogram
# TYPE dovecot_lmtp_command histogram
dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.000010"} 0
dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.000100"} 89
dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.001000"} 155
dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.010000"} 155
dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.100000"} 155
dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="+Inf"} 155
dovecot_lmtp_command_sum{cmd_name="LHLO",status_code="250"} 0.016240
dovecot_lmtp_command_count{cmd_name="LHLO",status_code="250"} 155
dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.000010"} 0
dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.000100"} 92
dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.001000"} 155
dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.010000"} 155
dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.100000"} 155
dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="+Inf"} 155
dovecot_lmtp_command_sum{cmd_name="MAIL",status_code="250"} 0.015810
dovecot_lmtp_command_count{cmd_name="MAIL",status_code="250"} 155
dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.000010"} 0
dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.000100"} 0
dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.001000"} 0
dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.010000"} 126
dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.100000"} 155
dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="+Inf"} 155
dovecot_lmtp_command_sum{cmd_name="RCPT",status_code="250"} 1.180280
dovecot_lmtp_command_count{cmd_name="RCPT",status_code="250"} 155
dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.000010"} 0
dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.000100"} 0
dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.001000"} 0
dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.010000"} 0
dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.100000"} 87
dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="+Inf"} 155
dovecot_lmtp_command_sum{cmd_name="DATA",status_code="250"} 15.400592
dovecot_lmtp_command_count{cmd_name="DATA",status_code="250"} 155
dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.000010"} 0
dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.000100"} 344
dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.001000"} 397
dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.010000"} 400
dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.100000"} 400
dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="+Inf"} 400
dovecot_lmtp_command_sum{cmd_name="QUIT",status_code="221"} 0.037257
dovecot_lmtp_command_count{cmd_name="QUIT",status_code="221"} 400
# HELP dovecot_imap_hibernate Total number of all events of this kind
# TYPE dovecot_imap_hibernate counter
dovecot_imap_hibernate_total{error="COMPRESS enabled"} 407
dovecot_imap_hibernate_count 3943
# HELP dovecot_imap_hibernate_duration_seconds Total duration of all events of this kind
# TYPE dovecot_imap_hibernate_duration_seconds counter
dovecot_imap_hibernate_duration_seconds_total{error="COMPRESS enabled"} 654362.125000
dovecot_imap_hibernate_duration_seconds_sum 726514.937500
# HELP dovecot_imap_unhibernate Total number of all events of this kind
# TYPE dovecot_imap_unhibernate counter
dovecot_imap_unhibernate_count 3943
# HELP dovecot_imap_unhibernate_duration_seconds Total duration of all events of this kind
# TYPE dovecot_imap_unhibernate_duration_seconds counter
dovecot_imap_unhibernate_duration_seconds_sum 726514.937500
# HELP dovecot_mail_delivery Histogram
# TYPE dovecot_mail_delivery histogram
dovecot_mail_delivery_bucket{le="0.000010"} 0
dovecot_mail_delivery_bucket{le="0.000100"} 0
dovecot_mail_delivery_bucket{le="0.001000"} 0
dovecot_mail_delivery_bucket{le="0.010000"} 0
dovecot_mail_delivery_bucket{le="0.100000"} 88
dovecot_mail_delivery_bucket{le="+Inf"} 155
dovecot_mail_delivery_sum 15.048336
dovecot_mail_delivery_count 155
# HELP dovecot_sql_query Total number of all events of this kind
# TYPE dovecot_sql_query counter
dovecot_sql_query_count 4005
# HELP dovecot_sql_query_duration_seconds Total duration of all events of this kind
# TYPE dovecot_sql_query_duration_seconds counter
dovecot_sql_query_duration_seconds_sum 14.431981
# HELP dovecot_sieve_actions Total number of all events of this kind
# TYPE dovecot_sieve_actions counter
dovecot_sieve_actions_total{action_name="keep"} 42
dovecot_sieve_actions_total{action_name="fileinto"} 113
dovecot_sieve_actions_total{action_name="pipe"} 1
dovecot_sieve_actions_total{"duration_10001_100000"} 88
dovecot_sieve_actions_count 156
# HELP dovecot_sieve_actions_duration_seconds Total duration of all events of this kind
# TYPE dovecot_sieve_actions_duration_seconds counter
dovecot_sieve_actions_duration_seconds_total{action_name="keep"} 2.472612
dovecot_sieve_actions_duration_seconds_total{action_name="fileinto"} 12.159110
dovecot_sieve_actions_duration_seconds_total{action_name="pipe"} 0.105447
dovecot_sieve_actions_duration_seconds_sum 14.737169
# HELP dovecot_managesieve Total number of all events of this kind
# TYPE dovecot_managesieve counter
dovecot_managesieve_count 0
# HELP dovecot_managesieve_duration_seconds Total duration of all events of this kind
# TYPE dovecot_managesieve_duration_seconds counter
dovecot_managesieve_duration_seconds_sum 0.000000
# HELP dovecot_dict_lookups Total number of all events of this kind
# TYPE dovecot_dict_lookups counter
dovecot_dict_lookups_count 0
# HELP dovecot_dict_lookups_duration_seconds Total duration of all events of this kind
# TYPE dovecot_dict_lookups_duration_seconds counter
dovecot_dict_lookups_duration_seconds_sum 0.000000
# EOF
----------------------------------------------------------------------

Thanks in advance

> 
> Aki

Christian Rößner
-- 
Rößner-Network-Solutions
Zertifizierter ITSiBe / CISO
Karl-Bröger-Str. 10, 36304 Alsfeld
Fax: +49 6631 78823409, Mobil: +49 171 9905345
USt-IdNr.: DE225643613, https://roessner.website
PGP fingerprint: 658D 1342 B762 F484 2DDF 1E88 38A5 4346 D727 94E5 