Dovecot 2.3.18 and OpenMetrics-Prometheus problem

Christian Rößner lists at mlserv.org
Fri Feb 25 10:55:00 UTC 2022 

Am 25.02.2022 um 11:50 schrieb Christian Rößner <lists at mlserv.org>:
> 
> Hi Aki,
> 
>> Am 25.02.2022 um 11:34 schrieb Aki Tuomi <aki.tuomi at open-xchange.com>:
>> 
>>> 
>>> On 25/02/2022 12:23 Christian Rößner <lists at mlserv.org> wrote:
>>> 
>>> 
>>> Hi,
>>> 
>>> I have defined several metrics in Dovecot and activated the metrics service. After the I tried to include this in Prometheues, but I get strange errors. I gave up now after several hours in the hope that this might be a bug. So I ask for help here:
>>> 
>>> Distribution: Rocky 8
>>> Official Dovecot Repo
>>> Version: 2.3.18
>>> 
>>> Config for metrics, service and events:
>>> 
>> 
>> Can you include the full metrics output, please?
> 
> Yes
> 
> ----------------------------------------------------------------------
> support at mx ~ » curl "http://localhost:9900/metrics"
> # HELP process_start_time_seconds Timestamp of service start
> # TYPE process_start_time_seconds gauge
> process_start_time_seconds 1645743604
> # HELP dovecot_build Dovecot build information
> # TYPE dovecot_build info
> dovecot_build_info{version="2.3.18",revision="9dd8408c18"} 1
> # HELP dovecot_auth_success Total number of all events of this kind
> # TYPE dovecot_auth_success counter
> dovecot_auth_success_total 1843
> # HELP dovecot_auth_success_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_auth_success_duration_seconds counter
> dovecot_auth_success_duration_seconds_total 1.424372
> # HELP dovecot_auth_failures Total number of all events of this kind
> # TYPE dovecot_auth_failures counter
> dovecot_auth_failures_total 1
> # HELP dovecot_auth_failures_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_auth_failures_duration_seconds counter
> dovecot_auth_failures_duration_seconds_total 3.917099
> # HELP dovecot_auth_client_userdb Total number of all events of this kind
> # TYPE dovecot_auth_client_userdb counter
> dovecot_auth_client_userdb_total 30882
> # HELP dovecot_auth_client_userdb_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_auth_client_userdb_duration_seconds counter
> dovecot_auth_client_userdb_duration_seconds_total 35.746910
> # HELP dovecot_auth_master Total number of all events of this kind
> # TYPE dovecot_auth_master counter
> dovecot_auth_master_total 1843
> # HELP dovecot_auth_master_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_auth_master_duration_seconds counter
> dovecot_auth_master_duration_seconds_total 1.029899
> # HELP dovecot_client_connected Total number of all events of this kind
> # TYPE dovecot_client_connected counter
> dovecot_client_connected_total 10591
> # HELP dovecot_client_connected_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_client_connected_duration_seconds counter
> dovecot_client_connected_duration_seconds_total 0.359288
> # HELP dovecot_client_disconnected Total number of all events of this kind
> # TYPE dovecot_client_disconnected counter
> dovecot_client_disconnected_total{reason="Connection closed"} 7173
> dovecot_client_disconnected_total{reason="Deinitializing"} 3418
> dovecot_client_disconnected_count 10591
> # HELP dovecot_client_disconnected_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_client_disconnected_duration_seconds counter
> dovecot_client_disconnected_duration_seconds_total{reason="Connection closed"} 146.829269
> dovecot_client_disconnected_duration_seconds_total{reason="Deinitializing"} 72.953468
> dovecot_client_disconnected_duration_seconds_sum 219.782730
> # HELP dovecot_imap_command Total number of all events of this kind
> # TYPE dovecot_imap_command counter
> dovecot_imap_command_total{cmd_name="unknown"} 94
> dovecot_imap_command_total{cmd_name="unknown",tagged_reply_state="OK"} 75
> dovecot_imap_command_total{cmd_name="FETCH"} 720
> dovecot_imap_command_total{cmd_name="FETCH",tagged_reply_state="OK"} 720
> dovecot_imap_command_total{cmd_name="IDLE"} 5076
> dovecot_imap_command_total{cmd_name="IDLE",tagged_reply_state="OK"} 1555
> dovecot_imap_command_total{cmd_name="UID FETCH"} 2473
> dovecot_imap_command_total{cmd_name="UID FETCH",tagged_reply_state="OK"} 2473
> dovecot_imap_command_total{cmd_name="UID SEARCH"} 7402
> dovecot_imap_command_total{cmd_name="UID SEARCH",tagged_reply_state="OK"} 7400
> dovecot_imap_command_total{cmd_name="UID SEARCH",tagged_reply_state="BAD"} 2
> dovecot_imap_command_total{cmd_name="LOGOUT"} 1112
> dovecot_imap_command_total{cmd_name="LOGOUT",tagged_reply_state="OK"} 1112
> dovecot_imap_command_total{cmd_name="LIST"} 5942
> dovecot_imap_command_total{cmd_name="LIST",tagged_reply_state="OK"} 5942
> dovecot_imap_command_total{cmd_name="GETQUOTAROOT"} 88
> dovecot_imap_command_total{cmd_name="GETQUOTAROOT",tagged_reply_state="OK"} 88
> dovecot_imap_command_total{cmd_name="ID"} 600
> dovecot_imap_command_total{cmd_name="ID",tagged_reply_state="OK"} 600
> dovecot_imap_command_total{cmd_name="COMPRESS"} 591
> dovecot_imap_command_total{cmd_name="COMPRESS",tagged_reply_state="OK"} 591
> dovecot_imap_command_total{cmd_name="SELECT"} 3084
> dovecot_imap_command_total{cmd_name="SELECT",tagged_reply_state="OK"} 3084
> dovecot_imap_command_total{cmd_name="NOOP"} 225
> dovecot_imap_command_total{cmd_name="NOOP",tagged_reply_state="OK"} 225
> dovecot_imap_command_total{cmd_name="STATUS"} 15337
> dovecot_imap_command_total{cmd_name="STATUS",tagged_reply_state="OK"} 15337
> dovecot_imap_command_total{cmd_name="UNSELECT"} 1193
> dovecot_imap_command_total{cmd_name="UNSELECT",tagged_reply_state="OK"} 1193
> dovecot_imap_command_total{cmd_name="CHECK"} 82
> dovecot_imap_command_total{cmd_name="CHECK",tagged_reply_state="OK"} 82
> dovecot_imap_command_total{cmd_name="ENABLE"} 667
> dovecot_imap_command_total{cmd_name="ENABLE",tagged_reply_state="OK"} 667
> dovecot_imap_command_total{cmd_name="LSUB"} 403
> dovecot_imap_command_total{cmd_name="LSUB",tagged_reply_state="OK"} 403
> dovecot_imap_command_total{cmd_name="EXPUNGE"} 427
> dovecot_imap_command_total{cmd_name="EXPUNGE",tagged_reply_state="OK"} 427
> dovecot_imap_command_total{cmd_name="CLOSE"} 614
> dovecot_imap_command_total{cmd_name="CLOSE",tagged_reply_state="OK"} 614
> dovecot_imap_command_total{cmd_name="UID MOVE"} 18
> dovecot_imap_command_total{cmd_name="UID MOVE",tagged_reply_state="OK"} 18
> dovecot_imap_command_total{cmd_name="UID STORE"} 172
> dovecot_imap_command_total{cmd_name="UID STORE",tagged_reply_state="OK"} 172
> dovecot_imap_command_total{cmd_name="NAMESPACE"} 37
> dovecot_imap_command_total{cmd_name="NAMESPACE",tagged_reply_state="OK"} 37
> dovecot_imap_command_total{cmd_name="SEARCH"} 489
> dovecot_imap_command_total{cmd_name="SEARCH",tagged_reply_state="OK"} 489
> dovecot_imap_command_total{cmd_name="UID EXPUNGE"} 73
> dovecot_imap_command_total{cmd_name="UID EXPUNGE",tagged_reply_state="OK"} 73
> dovecot_imap_command_total{cmd_name="APPEND"} 86
> dovecot_imap_command_total{cmd_name="APPEND",tagged_reply_state="OK"} 86
> dovecot_imap_command_total{cmd_name="UID COPY"} 8
> dovecot_imap_command_total{cmd_name="UID COPY",tagged_reply_state="OK"} 8
> dovecot_imap_command_total{cmd_name="SUBSCRIBE"} 16
> dovecot_imap_command_total{cmd_name="SUBSCRIBE",tagged_reply_state="OK"} 16
> dovecot_imap_command_count 47029
> # HELP dovecot_imap_command_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_imap_command_duration_seconds counter
> dovecot_imap_command_duration_seconds_total{cmd_name="unknown"} 394.558197
> dovecot_imap_command_duration_seconds_total{cmd_name="unknown",tagged_reply_state="OK"} 49.297886
> dovecot_imap_command_duration_seconds_total{cmd_name="FETCH"} 1.987493
> dovecot_imap_command_duration_seconds_total{cmd_name="FETCH",tagged_reply_state="OK"} 1.987493
> dovecot_imap_command_duration_seconds_total{cmd_name="IDLE"} 283744.312500
> dovecot_imap_command_duration_seconds_total{cmd_name="IDLE",tagged_reply_state="OK"} 229685.437500
> dovecot_imap_command_duration_seconds_total{cmd_name="UID FETCH"} 4.214446
> dovecot_imap_command_duration_seconds_total{cmd_name="UID FETCH",tagged_reply_state="OK"} 4.214446
> dovecot_imap_command_duration_seconds_total{cmd_name="UID SEARCH"} 175.945587
> dovecot_imap_command_duration_seconds_total{cmd_name="UID SEARCH",tagged_reply_state="OK"} 175.945496
> dovecot_imap_command_duration_seconds_total{cmd_name="UID SEARCH",tagged_reply_state="BAD"} 0.000094
> dovecot_imap_command_duration_seconds_total{cmd_name="LOGOUT"} 0.265836
> dovecot_imap_command_duration_seconds_total{cmd_name="LOGOUT",tagged_reply_state="OK"} 0.265836
> dovecot_imap_command_duration_seconds_total{cmd_name="LIST"} 35.530193
> dovecot_imap_command_duration_seconds_total{cmd_name="LIST",tagged_reply_state="OK"} 35.530193
> dovecot_imap_command_duration_seconds_total{cmd_name="GETQUOTAROOT"} 0.565966
> dovecot_imap_command_duration_seconds_total{cmd_name="GETQUOTAROOT",tagged_reply_state="OK"} 0.565966
> dovecot_imap_command_duration_seconds_total{cmd_name="ID"} 0.064538
> dovecot_imap_command_duration_seconds_total{cmd_name="ID",tagged_reply_state="OK"} 0.064538
> dovecot_imap_command_duration_seconds_total{cmd_name="COMPRESS"} 0.140604
> dovecot_imap_command_duration_seconds_total{cmd_name="COMPRESS",tagged_reply_state="OK"} 0.140604
> dovecot_imap_command_duration_seconds_total{cmd_name="SELECT"} 4.893884
> dovecot_imap_command_duration_seconds_total{cmd_name="SELECT",tagged_reply_state="OK"} 4.893884
> dovecot_imap_command_duration_seconds_total{cmd_name="NOOP"} 0.571025
> dovecot_imap_command_duration_seconds_total{cmd_name="NOOP",tagged_reply_state="OK"} 0.571025
> dovecot_imap_command_duration_seconds_total{cmd_name="STATUS"} 5.291285
> dovecot_imap_command_duration_seconds_total{cmd_name="STATUS",tagged_reply_state="OK"} 5.291285
> dovecot_imap_command_duration_seconds_total{cmd_name="UNSELECT"} 0.110757
> dovecot_imap_command_duration_seconds_total{cmd_name="UNSELECT",tagged_reply_state="OK"} 0.110757
> dovecot_imap_command_duration_seconds_total{cmd_name="CHECK"} 0.019408
> dovecot_imap_command_duration_seconds_total{cmd_name="CHECK",tagged_reply_state="OK"} 0.019408
> dovecot_imap_command_duration_seconds_total{cmd_name="ENABLE"} 0.051830
> dovecot_imap_command_duration_seconds_total{cmd_name="ENABLE",tagged_reply_state="OK"} 0.051830
> dovecot_imap_command_duration_seconds_total{cmd_name="LSUB"} 59.131454
> dovecot_imap_command_duration_seconds_total{cmd_name="LSUB",tagged_reply_state="OK"} 59.131454
> dovecot_imap_command_duration_seconds_total{cmd_name="EXPUNGE"} 0.379475
> dovecot_imap_command_duration_seconds_total{cmd_name="EXPUNGE",tagged_reply_state="OK"} 0.379475
> dovecot_imap_command_duration_seconds_total{cmd_name="CLOSE"} 0.648228
> dovecot_imap_command_duration_seconds_total{cmd_name="CLOSE",tagged_reply_state="OK"} 0.648228
> dovecot_imap_command_duration_seconds_total{cmd_name="UID MOVE"} 0.941667
> dovecot_imap_command_duration_seconds_total{cmd_name="UID MOVE",tagged_reply_state="OK"} 0.941667
> dovecot_imap_command_duration_seconds_total{cmd_name="UID STORE"} 0.302505
> dovecot_imap_command_duration_seconds_total{cmd_name="UID STORE",tagged_reply_state="OK"} 0.302505
> dovecot_imap_command_duration_seconds_total{cmd_name="NAMESPACE"} 0.001530
> dovecot_imap_command_duration_seconds_total{cmd_name="NAMESPACE",tagged_reply_state="OK"} 0.001530
> dovecot_imap_command_duration_seconds_total{cmd_name="SEARCH"} 0.150726
> dovecot_imap_command_duration_seconds_total{cmd_name="SEARCH",tagged_reply_state="OK"} 0.150726
> dovecot_imap_command_duration_seconds_total{cmd_name="UID EXPUNGE"} 1.155379
> dovecot_imap_command_duration_seconds_total{cmd_name="UID EXPUNGE",tagged_reply_state="OK"} 1.155379
> dovecot_imap_command_duration_seconds_total{cmd_name="APPEND"} 53.821384
> dovecot_imap_command_duration_seconds_total{cmd_name="APPEND",tagged_reply_state="OK"} 53.821384
> dovecot_imap_command_duration_seconds_total{cmd_name="UID COPY"} 0.298924
> dovecot_imap_command_duration_seconds_total{cmd_name="UID COPY",tagged_reply_state="OK"} 0.298924
> dovecot_imap_command_duration_seconds_total{cmd_name="SUBSCRIBE"} 0.003328
> dovecot_imap_command_duration_seconds_total{cmd_name="SUBSCRIBE",tagged_reply_state="OK"} 0.003328
> dovecot_imap_command_duration_seconds_sum 284485.343750
> # HELP dovecot_lmtp_command Histogram
> # TYPE dovecot_lmtp_command histogram
> dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.000010"} 0
> dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.000100"} 89
> dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.001000"} 155
> dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.010000"} 155
> dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="0.100000"} 155
> dovecot_lmtp_command_bucket{cmd_name="LHLO",status_code="250",le="+Inf"} 155
> dovecot_lmtp_command_sum{cmd_name="LHLO",status_code="250"} 0.016240
> dovecot_lmtp_command_count{cmd_name="LHLO",status_code="250"} 155
> dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.000010"} 0
> dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.000100"} 92
> dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.001000"} 155
> dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.010000"} 155
> dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="0.100000"} 155
> dovecot_lmtp_command_bucket{cmd_name="MAIL",status_code="250",le="+Inf"} 155
> dovecot_lmtp_command_sum{cmd_name="MAIL",status_code="250"} 0.015810
> dovecot_lmtp_command_count{cmd_name="MAIL",status_code="250"} 155
> dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.000010"} 0
> dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.000100"} 0
> dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.001000"} 0
> dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.010000"} 126
> dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="0.100000"} 155
> dovecot_lmtp_command_bucket{cmd_name="RCPT",status_code="250",le="+Inf"} 155
> dovecot_lmtp_command_sum{cmd_name="RCPT",status_code="250"} 1.180280
> dovecot_lmtp_command_count{cmd_name="RCPT",status_code="250"} 155
> dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.000010"} 0
> dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.000100"} 0
> dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.001000"} 0
> dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.010000"} 0
> dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="0.100000"} 87
> dovecot_lmtp_command_bucket{cmd_name="DATA",status_code="250",le="+Inf"} 155
> dovecot_lmtp_command_sum{cmd_name="DATA",status_code="250"} 15.400592
> dovecot_lmtp_command_count{cmd_name="DATA",status_code="250"} 155
> dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.000010"} 0
> dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.000100"} 344
> dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.001000"} 397
> dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.010000"} 400
> dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="0.100000"} 400
> dovecot_lmtp_command_bucket{cmd_name="QUIT",status_code="221",le="+Inf"} 400
> dovecot_lmtp_command_sum{cmd_name="QUIT",status_code="221"} 0.037257
> dovecot_lmtp_command_count{cmd_name="QUIT",status_code="221"} 400
> # HELP dovecot_imap_hibernate Total number of all events of this kind
> # TYPE dovecot_imap_hibernate counter
> dovecot_imap_hibernate_total{error="COMPRESS enabled"} 407
> dovecot_imap_hibernate_count 3943
> # HELP dovecot_imap_hibernate_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_imap_hibernate_duration_seconds counter
> dovecot_imap_hibernate_duration_seconds_total{error="COMPRESS enabled"} 654362.125000
> dovecot_imap_hibernate_duration_seconds_sum 726514.937500
> # HELP dovecot_imap_unhibernate Total number of all events of this kind
> # TYPE dovecot_imap_unhibernate counter
> dovecot_imap_unhibernate_count 3943
> # HELP dovecot_imap_unhibernate_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_imap_unhibernate_duration_seconds counter
> dovecot_imap_unhibernate_duration_seconds_sum 726514.937500
> # HELP dovecot_mail_delivery Histogram
> # TYPE dovecot_mail_delivery histogram
> dovecot_mail_delivery_bucket{le="0.000010"} 0
> dovecot_mail_delivery_bucket{le="0.000100"} 0
> dovecot_mail_delivery_bucket{le="0.001000"} 0
> dovecot_mail_delivery_bucket{le="0.010000"} 0
> dovecot_mail_delivery_bucket{le="0.100000"} 88
> dovecot_mail_delivery_bucket{le="+Inf"} 155
> dovecot_mail_delivery_sum 15.048336
> dovecot_mail_delivery_count 155
> # HELP dovecot_sql_query Total number of all events of this kind
> # TYPE dovecot_sql_query counter
> dovecot_sql_query_count 4005
> # HELP dovecot_sql_query_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_sql_query_duration_seconds counter
> dovecot_sql_query_duration_seconds_sum 14.431981
> # HELP dovecot_sieve_actions Total number of all events of this kind
> # TYPE dovecot_sieve_actions counter
> dovecot_sieve_actions_total{action_name="keep"} 42
> dovecot_sieve_actions_total{action_name="fileinto"} 113
> dovecot_sieve_actions_total{action_name="pipe"} 1
> dovecot_sieve_actions_total{"duration_10001_100000"} 88
> dovecot_sieve_actions_count 156
> # HELP dovecot_sieve_actions_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_sieve_actions_duration_seconds counter
> dovecot_sieve_actions_duration_seconds_total{action_name="keep"} 2.472612
> dovecot_sieve_actions_duration_seconds_total{action_name="fileinto"} 12.159110
> dovecot_sieve_actions_duration_seconds_total{action_name="pipe"} 0.105447
> dovecot_sieve_actions_duration_seconds_sum 14.737169
> # HELP dovecot_managesieve Total number of all events of this kind
> # TYPE dovecot_managesieve counter
> dovecot_managesieve_count 0
> # HELP dovecot_managesieve_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_managesieve_duration_seconds counter
> dovecot_managesieve_duration_seconds_sum 0.000000
> # HELP dovecot_dict_lookups Total number of all events of this kind
> # TYPE dovecot_dict_lookups counter
> dovecot_dict_lookups_count 0
> # HELP dovecot_dict_lookups_duration_seconds Total duration of all events of this kind
> # TYPE dovecot_dict_lookups_duration_seconds counter
> dovecot_dict_lookups_duration_seconds_sum 0.000000
> # EOF
> ----------------------------------------------------------------------
> 
> Thanks in advance

Just to complete information, Prometheus version:

----------------------------------------------------------------------
prometheus_1     | ts=2022-02-25T09:57:14.492Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch
=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)"
----------------------------------------------------------------------

Christian
-- 
Rößner-Network-Solutions
Zertifizierter ITSiBe / CISO
Karl-Bröger-Str. 10, 36304 Alsfeld
Fax: +49 6631 78823409, Mobil: +49 171 9905345
USt-IdNr.: DE225643613, https://roessner.website
PGP fingerprint: 658D 1342 B762 F484 2DDF 1E88 38A5 4346 D727 94E5

More information about the dovecot mailing list