October 2024 - dovecot

2.3.21.1 and oauth
by v＠minakov.pro 14 Nov '24

14 Nov '24

Hello! I'm using dovecot with keycloak for oauth authentication. My config is: client_id = dovecot client_secret = MY_SECRET introspection_url = https://MY_KEYCLOAK/realms/master/protocol/openid-connect/token/introspect introspection_mode = post pass_attrs = pass=%{oauth2:access_token} Everything worked great on version 2.3.20. After upgrading to version 2.3.21.1 oauth stopped working with errors: auth: Debug: http-client: conn [::1]:443 [1]: Got 401 response for request [Req1: POST https://MY_KEYCLOAK/realms/master/protocol/openid-connect/token/introspect] Unauthorized (took 5 ms + >Aug 16 00:23:58 auth: Error: oauth2(MY_EMAIL,127.0.0.1,<HADwdb8f+PN/AAAB>): oauth2 failed: Introspection failed: No username returned I tried all combination of configurations, debugging and versions of keycloak. Seems something was broken in this version of dovecot.

3 3

What is the appropriate action for out of memory error for exceeding vsz_limit in my situation?
by Steve Dondley 08 Nov '24

08 Nov '24

Hi, I have sporadic messages on my server about an account getting an out of memory error: Fatal: master: service(imap): child 17910 returned error 83 (Out of memory (service imap { vsz_limit=325 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) In response, I raised the limit from 256MB up to 325. That didn’t seem to help. The server has only 512 MB of RAM so I’m afraid to go much higher. I googled around a bit and some people are saying that when the dovecot.index.cache grows too large, it can cause these errors. The imap account has a dovecot.index.cache file that is 167 MB which seems to be well below the limit (but maybe it is compressed?). So I’m not entirely sure as to what the underlying problem is. So before upgrading to the server to 1024 MB of ram and going on a wild goose chase, I just want to get input on whether I have positively identified the problem and whether there might be something else I can do to manage this problem.

2 3

Upgrade Dovecot Cluster 2.2 to 2.3
by Steven Varco 05 Nov '24

05 Nov '24

Hi All I’m planing to upgrade/migrate my dovecot cluster with two dovecot 2.2.36 nodes to 2.3.16. They use Maildir als IMAP backend and will continue to use that in the future. Can I just: - Install a new Server (AlmaLinux 9) - Stop dovecot on the old node-2 - Copy all the data from the old mail directory of node-2 to the new one - Install dovecot 2.3 on the new on with more or less the same config and let it run - Repeat the same with old node-1 ? Or would it be better to start of with an empty mail directory and let the other old node imapsync the data to the new one? - What would the advantage be (over the disadvantage that it may take some time to get everything synced)? I know that Maildir are just static files, so moving them to the new server should not be a problem. I’m thinking more about indexes created by dovecot 2.2.36… Are they read without issues with the newever dovecot 2.3.16 or should I consider a re-index. or something the like? thanks in advance, Steven -- https://steven.varco.ch/ https://www.tech-island.com/

2 1

dovecot-lda from www-data - doesnt work
by Sebastian Nielsen 01 Nov '24

01 Nov '24

m trying to deliver email from a webform, but its not working. I then tried manually in the console: WORKS: sudo -u info /usr/lib/dovecot/dovecot-lda -d info DOES NOT WORK: sudo -u www-data /usr/lib/dovecot/dovecot-lda -d info sudo -u postfix /usr/lib/dovecot/dovecot-lda -d info sudo -u dovecot /usr/lib/dovecot/dovecot-lda -d info I need to be able to deliver email from "www-data" to any user on the system (that is a valid dovecot-lda mail user). It seems a security setting blocks it. I have already set authdb to 0777 in dovecot settings (because otherwise it gives an error about lookup rights), and also enabled stats-writer and stats-reader with 0666. so no more error messages in log, but the above commands that does NOT work, terminate immediately, while the working command waits for email from STDIN. No error messages in either log or on STDOUT/STDERR. What can be the problem?

3 7

Namespace configuration
by Scott Q. 31 Oct '24

31 Oct '24

We are having an issue with our namespace configuration, as per the eM Client folks. We present the following namespaces via IMAP, with Dovecot as backend. This is the actual imap conversation 08:37:10.896|03E| 01: A4 ID ("name" "eM Client" "version" "10.1.4393.0" "GUID" "EMCLIENT_V1" "vendor" "eM Client" "contact" "support(a)emclient.com") 08:37:10.961|03E| 01: * ID ("name" "Dovecot") 08:37:10.961|03E| 01: A4 OK ID completed (0.001 + 0.000 secs). 08:37:10.961|03E| 01: A5 NAMESPACE 08:37:11.184|03E| 01: * NAMESPACE (("" ".")("Labels." ".")) (("shared." ".")) NIL 08:37:11.184|03E| 01: A5 OK Namespace completed (0.001 + 0.162 + 0.161 secs). As per them, the problem is the first empty prefix: "The problem is not necessarily in the fact that it is empty but because it is then mixed with another one with a prefix. Logically it means that everything in the empty namespace must be mixed together with the prefixed namespace and that is not really ok." "NAMESPACE (("personal." ".")("Labels." ".")) (("shared." ".")) NIL would make sense as both personal namespaces point to different directory structures." Reading the RFC I'm not understanding this at all, but then again, maybe I'm wrong. Anyone care to shed some light on how multiple namespaces should be defined ? Thank you, Scott

1 0

Crash dovecot-2.3.21.1 on OpenBSD
by Kirill A. Korinsky 31 Oct '24

31 Oct '24

Good day, I just discovered a core file from dovecot's imap. It is running on OpenBSD 7.6 and dovecot is built with https://github.com/dovecot/core/pull/223 Stacktrace: #0 fts_search_merge_scores_or (dest=0x73b552104f38, src=<optimized out>) at fts-search.c:278 src2 = <error reading variable src2 (Cannot access memory at address 0x8)> src_map = 0xc7d7dcb6028 src2_map = 0xc7d6338d5c0 src2i = 3157 srci = 8699 src_count = 6133 src2_count = 5729 #1 fts_search_merge_scores_level (fctx=0xc7df32c4000, args=0xc7dc4e9a110, idx=0x73b552105064, and_args=<optimized out>, scores=0x73b552104f38) at fts-search.c:333 arg_scores = {arr = {buffer = 0xc7e01e35468, element_size = 8}, v = 0xc7e01e35468, v_modifiable = 0xc7e01e35468} level = <optimized out> #2 0x00000c7da13ccabe in fts_search_merge_scores_level (fctx=0xc7df32c4000, args=0xc7dc4e99ca0, idx=0x73b552105064, and_args=<optimized out>, scores=0x73b552104fc8) at fts-search.c:326 arg_scores = {arr = {buffer = 0xc7e01e34860, element_size = 8}, v = 0xc7e01e34860, v_modifiable = 0xc7e01e34860} level = <optimized out> #3 0x00000c7da13ccabe in fts_search_merge_scores_level (fctx=0xc7df32c4000, args=0xc7e24477628, idx=0x73b552105064, and_args=<optimized out>, scores=0xc7daf51ea28) at fts-search.c:326 arg_scores = {arr = {buffer = 0xc7e01e345f8, element_size = 8}, v = 0xc7e01e345f8, v_modifiable = 0xc7e01e345f8} level = <optimized out> #4 0x00000c7da13cbf07 in fts_search_merge_scores (fctx=0xc7df32c4000) at fts-search.c:341 idx = 8 #5 fts_search_try_lookup (fctx=0xc7df32c4000) at fts-search.c:373 last_uid = <optimized out> seq1 = <optimized out> seq2 = 0 #6 fts_search_lookup (fctx=0xc7df32c4000) at fts-search.c:383 reason = <optimized out> #7 0x00000c7da13cefb4 in fts_try_build_init (ctx=0xc7daf52b640, fctx=0xc7df32c4000) at fts-storage.c:147 ret = 8699 #8 fts_mailbox_search_init (t=<optimized out>, args=0xc7dd96dd048, sort_program=<optimized out>, wanted_fields=<optimized out>, wanted_headers=<optimized out>) at fts-storage.c:262 ft = 0xc7df32dec00 fbox = <optimized out> flist = <optimized out> ctx = 0xc7daf52b640 fctx = 0xc7df32c4000 #9 0x00000c7b3879aef3 in imap_search_start (ctx=0xc7df32dfbc8, sargs=0xc7dd96dd048, sort_program=0x0) at imap-search.c:537 cmd = 0xc7df32df848 #10 0x00000c7b38789e6e in cmd_search (cmd=0xc7df32df848) at cmd-search.c:48 args = <optimized out> ctx = 0xc7df32dfbc8 ret = 8699 charset = <optimized out> sargs = 0x0 #11 0x00000c7b38792db3 in command_exec (cmd=0xc7df32df848) at imap-commands.c:201 hook = <optimized out> finished = <optimized out> #12 0x00000c7b387915d8 in client_command_input (cmd=0xc7df32df848) at imap-client.c:1237 client = 0xc7df32bc048 command = <optimized out> tag = <optimized out> ret = <optimized out> name = <optimized out> #13 0x00000c7b38791749 in client_command_input (cmd=0xc7df32df848) at imap-client.c:1305 client = 0xc7df32bc048 command = <optimized out> tag = <optimized out> ret = <optimized out> name = <optimized out> #14 0x00000c7b38791749 in client_command_input (cmd=0xc7df32df848) at imap-client.c:1305 client = 0xc7df32bc048 command = <optimized out> tag = <optimized out> ret = <optimized out> name = <optimized out> #15 0x00000c7b3878ff68 in client_handle_next_command (client=0xc7df32bc048, remove_io_r=<optimized out>) at imap-client.c:1348 No locals. #16 client_handle_input (client=0xc7df32bc048) at imap-client.c:1363 _data_stack_cur_id = <optimized out> handled_commands = <optimized out> ret = <optimized out> remove_io = <optimized out> #17 0x00000c7b3878e569 in client_input (client=0xc7df32bc048) at imap-client.c:1407 output = 0xc7daf5003a0 bytes = 251 cmd = <optimized out> #18 0x00000c7dc9c7ff3f in io_loop_call_io (io=0xc7daf515240) at ioloop.c:737 ioloop = 0xc7daf520460 t_id = 8699 #19 0x00000c7dc9c830a4 in io_loop_handler_run_internal (ioloop=0xc7daf520460) at ioloop-kqueue.c:164 tv = {tv_sec = 4, tv_usec = 790941} ts = {tv_sec = 4, tv_nsec = 790941000} ctx = 0xc7daf503520 msecs = <optimized out> events = <optimized out> events_count = <optimized out> ret = <optimized out> i = 0 io = 0xc7daf515240 event = <optimized out> #20 0x00000c7dc9c806a0 in io_loop_handler_run (ioloop=0xc7daf520460) at ioloop.c:789 No locals. #21 0x00000c7dc9c804a8 in io_loop_run (ioloop=0xc7daf520460) at ioloop.c:762 No locals. #22 0x00000c7dc9bd56b9 in master_service_run (service=0xc7daf52b500, callback=0x0) at master-service.c:878 No locals. #23 0x00000c7b387a19d0 in main (argc=1, argv=<optimized out>) at main.c:575 set_roots = {0xc7dc9ccd480 <smtp_submit_setting_parser_info>, 0xc7b387af1b0 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xc7e01e2f550 "\004", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0xc7b387a1bc0 <login_client_connected>, failure_callback = 0xc7b387a1f40 <login_client_failed>, update_proctitle = false, request_auth_token = true} service_flags = <optimized out> storage_service_flags = <optimized out> username = <optimized out> auth_socket_path = <optimized out> c = <optimized out> error = 0xc7e056c4af0 <_dl_dtors> "\363\017\036\372UH\211\345\350s\030" config: # 2.3.21.1 (d492236fa0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21.1 (49005e73) # OS: OpenBSD 7.6 amd64 # Hostname: mx1.catap.net # NOTE: Send doveconf -n output instead when asking for help. auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_cache_verify_password_with_worker = no auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_gssapi_hostname = auth_krb5_keytab = auth_master_user_separator = auth_mechanisms = plain auth_policy_check_after_auth = yes auth_policy_check_before_auth = yes auth_policy_hash_mech = sha256 auth_policy_hash_nonce = auth_policy_hash_truncate = 12 auth_policy_log_only = no auth_policy_reject_on_fail = no auth_policy_report_after_auth = yes auth_policy_request_attributes = login=%{requested_username} pwhash=%{hashed_password} remote=%{rip} device_id=%{client_id} protocol=%s session_id=%{session} auth_policy_server_api_header = auth_policy_server_timeout_msecs = 2000 auth_policy_server_url = auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_stats = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 1 mins default_internal_group = _dovecot default_internal_user = _dovecot default_login_user = _dovenull default_process_limit = 100 default_vsz_limit = 10 G deliver_log_format = msgid=%m: %$ dict_db_config = director_flush_socket = director_mail_servers = director_max_parallel_kicks = 100 director_max_parallel_moves = 100 director_output_buffer_size = 10 M director_ping_idle_timeout = 30 secs director_ping_max_timeout = 1 mins director_servers = director_user_expire = 15 mins director_user_kick_delay = 2 secs director_username_hash = %Lu disable_plaintext_auth = yes dotlock_use_excl = yes doveadm_allowed_commands = doveadm_api_key = doveadm_http_rawlog_dir = doveadm_password = # hidden, use -P to show it doveadm_port = 12345 doveadm_socket_path = doveadm-server doveadm_ssl = no doveadm_username = doveadm doveadm_worker_count = 0 dsync_alt_char = _ dsync_commit_msgs_interval = 100 dsync_features = dsync_hashed_headers = Date Message-ID dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -U first_valid_gid = 1 first_valid_uid = 1000 haproxy_timeout = 3 secs haproxy_trusted_networks = hostname = imap_capability = imap_client_workarounds = imap_fetch_failure = disconnect-immediately imap_hibernate_timeout = 0 imap_id_log = imap_id_retain = no imap_id_send = name * imap_idle_notify_interval = 2 mins imap_literal_minus = no imap_logout_format = in=%i out=%o deleted=%{deleted} expunged=%{expunged} trashed=%{trashed} hdr_count=%{fetch_hdr_count} hdr_bytes=%{fetch_hdr_bytes} body_count=%{fetch_body_count} body_bytes=%{fetch_body_bytes} imap_max_line_length = 64 k imap_metadata = no imap_urlauth_host = imap_urlauth_logout_format = in=%i out=%o imap_urlauth_port = 143 imapc_cmd_timeout = 5 mins imapc_connection_retry_count = 1 imapc_connection_retry_interval = 1 secs imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_max_line_length = 0 imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_sasl_mechanisms = imapc_ssl = no imapc_ssl_verify = yes imapc_user = import_environment = TZ CORE_OUTOFMEM CORE_ERROR info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/local/libexec/dovecot listen = *, :: lmtp_add_received_header = no lmtp_client_workarounds = lmtp_hdr_delivery_address = final lmtp_proxy = no lmtp_proxy_rawlog_dir = lmtp_rawlog_dir = lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lmtp_user_concurrency_limit = 0 lmtp_verbose_replies = no lock_method = fcntl log_core_filter = log_debug = log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> login_plugin_dir = /usr/local/lib/dovecot/login login_plugins = login_proxy_max_disconnect_delay = 0 login_proxy_max_reconnects = 3 login_proxy_notify_path = proxy-notify login_proxy_rawlog_dir = login_proxy_timeout = 30 secs login_source_ips = login_trusted_networks = mail_access_groups = mail_always_cache_fields = mail_attachment_detection_options = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_cache_fields = flags mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = vmail mail_home = mail_location = maildir:~/Maildir mail_log_prefix = "%s(%u)<%{pid}><%{session}>: " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = notify fts fts_flatcurve replication virtual mail_prefetch_count = 0 mail_privileged_group = mail_save_crlf = no mail_server_admin = mail_server_comment = mail_shared_explicit_inbox = no mail_sort_max_read_count = 0 mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = vmail mail_vsize_bg_after_count = 0 mailbox_idle_check_interval = 30 secs mailbox_list_index = yes mailbox_list_index_include_inbox = no mailbox_list_index_very_dirty_syncs = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_empty_new = no maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 64 k managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 10 M mmap_disable = yes namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Archive { auto = subscribe autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = \Archive } mailbox Drafts { auto = subscribe autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 60 days autoexpunge_max_mails = 0 comment = driver = special_use = \Junk } mailbox Sent { auto = subscribe autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 60 days autoexpunge_max_mails = 0 comment = driver = special_use = \Trash } order = 0 prefix = separator = . subscriptions = yes type = private } namespace virtual { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = virtual:/etc/dovecot/virtual:INDEX=~/virtual mailbox All { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = All messages without Trash and Junk driver = special_use = \All } mailbox Flagged { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = All flagged messages without Trash and Junk driver = special_use = \Flagged } order = 0 prefix = virtual. separator = . subscriptions = yes type = private } old_stats_carbon_interval = 30 secs old_stats_carbon_name = old_stats_carbon_server = old_stats_command_min_time = 1 mins old_stats_domain_min_time = 12 hours old_stats_ip_min_time = 12 hours old_stats_memory_limit = 16 M old_stats_session_min_time = 15 mins old_stats_user_min_time = 1 hours passdb { args = username_format=%u /etc/mail/credentials auth_verbose = default default_fields = deny = no driver = passwd-file master = no mechanisms = name = override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never username_filter = } plugin { fts = flatcurve fts_decoder = decode2text fts_filters = normalizer-icu snowball stopwords fts_filters_en = lowercase snowball english-possessive stopwords fts_flatcurve_substring_search = yes fts_languages = en de ru es fts_tokenizer_generic = algorithm=simple fts_tokenizers = generic email-address mail_replica = tcps:mx2.catap.net replication_sync_timeout = 10 sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /etc/dovecot/sieve_before.d/ } pop3_client_workarounds = pop3_delete_type = default pop3_deleted_flag = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_features = pop3c_host = pop3c_master_user = pop3c_password = pop3c_port = 110 pop3c_quick_received_date = no pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = postmaster@%{if;%d;ne;;%d;%{hostname}} process_shutdown_filter = protocols = imap lmtp sieve quota_full_tempfail = no rawlog_dir = recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_dsync_parameters = -d -l 30 -U -x virtual. replication_full_sync_interval = 5 mins replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = vmail mode = 0600 user = vmail } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = vmail mode = 0600 user = vmail } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = worker unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = $default_internal_user } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service decode2text { chroot = client_limit = 0 drop_priv_before_exec = no executable = script /usr/local/libexec/dovecot/decode2text.sh extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener decode2text { group = mode = 0666 user = } user = vmail vsz_limit = 18446744073709551615 B } service dict-async { chroot = client_limit = 0 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict-async { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = haproxy = no port = 0 reuse_port = no ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns-client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = $default_internal_group group = idle_kill = 0 inet_listener { address = haproxy = no port = 12345 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service health-check { chroot = client_limit = 1 drop_priv_before_exec = yes executable = script -p health-check.sh extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap-hibernate { chroot = client_limit = 0 drop_priv_before_exec = no executable = imap-hibernate extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 0 type = unix_listener imap-hibernate { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = haproxy = no port = 143 reuse_port = no ssl = no } inet_listener imaps { address = haproxy = no port = 993 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-master { group = mode = 0600 user = } unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = worker unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = $default_internal_user } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = $default_internal_group group = vmail idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vmail vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = haproxy = no port = 4190 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service old-stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = old-stats extra_groups = fifo_listener old-stats-mail { group = mode = 0600 user = } fifo_listener old-stats-user { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener old-stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = haproxy = no port = 110 reuse_port = no ssl = no } inet_listener pop3s { address = haproxy = no port = 995 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = vmail mode = 0600 user = vmail } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service stats { chroot = client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener login/stats-writer { group = mode = 0600 user = $default_login_user } unix_listener stats-reader { group = mode = 0600 user = } unix_listener stats-writer { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service submission-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = submission-login extra_groups = group = idle_kill = 0 inet_listener submission { address = haproxy = no port = 587 reuse_port = no ssl = no } inet_listener submissions { address = haproxy = no port = 0 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = submission service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service submission { chroot = client_limit = 1 drop_priv_before_exec = no executable = submission extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = submission service_count = 1 type = unix_listener login/submission { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_alt_cert = ssl_alt_key = ssl_ca = ssl_cert = </etc/ssl/mx.catap.net.crt ssl_cert_username_field = commonName ssl_cipher_list = ALL:!kRSA:!SRP:!kDHd:!DSS:!aNULL:!eNULL:!EXPORT:!DES:!3DES:!MD5:!PSK:!RC4:!ADH:!LOW@STRENGTH ssl_cipher_suites = ssl_client_ca_dir = ssl_client_ca_file = ssl_client_cert = ssl_client_key = ssl_client_require_valid_cert = yes ssl_crypto_device = ssl_curve_list = ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_key_password = ssl_min_protocol = TLSv1.2 ssl_options = ssl_prefer_server_ciphers = no ssl_require_crl = yes ssl_verify_client_cert = no state_dir = /var/dovecot stats_http_rawlog_dir = stats_writer_socket_path = stats-writer submission_client_workarounds = submission_host = submission_logout_format = in=%i out=%o submission_max_mail_size = 0 submission_max_recipients = 0 submission_relay_command_timeout = 5 mins submission_relay_connect_timeout = 30 secs submission_relay_host = submission_relay_master_user = submission_relay_max_idle_time = 29 mins submission_relay_password = submission_relay_port = 25 submission_relay_rawlog_dir = submission_relay_ssl = no submission_relay_ssl_verify = yes submission_relay_trusted = no submission_relay_user = submission_ssl = no submission_timeout = 30 secs syslog_facility = mail userdb { args = username_format=%u /etc/mail/credentials auth_verbose = default default_fields = driver = passwd-file name = override_fields = uid=vmail gid=vmail home=/var/vmail/%u result_failure = continue result_internalfail = continue result_success = return-ok skip = never } valid_chroot_dirs = verbose_proctitle = no verbose_ssl = no version_ignore = no protocol lmtp { mail_plugins = notify fts fts_flatcurve replication virtual sieve } protocol imap { imap_metadata = yes mail_max_userip_connections = 1000 } -- wbr, Kirill

2 2

Inboxes incorrectly become /var/mail/%u
by ma.sao＠msa.hinet.net 29 Oct '24

29 Oct '24

With configuration "mail_location = maildir:~/Maildir", incoming mails are always saved to /var/mail/%u , which are invisible to Thunderbird. How do I configure Dovecot to save incoming mails to ~/Maildir/cur/ and ~/Maildir/new/ ? Thank you in advance! context: I replaced my host recently. Version 2.3.13 running in the old host used to correctly save incoming mails to ~/Maildir. I copied the files in /home/user1/Maildir/ Dovecot 2.3.13 managed to my new host where the new Dovecot 2.3.19.1 runs. Thunderbird now correctly displays files in /home/user1/Maildir/cur/ in the new server as inbox mails, but obviously it can not see file /var/mail/user1 in the new server. ===== Output of "dovecot -n" follows. # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-22-amd64 x86_64 Debian 12.7 # Hostname: example auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } } ssl = required ssl_cert = </etc/letsencrypt/live/example.com/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } ======== Output of "ls -la /home/user1/Maildir/" in my new host follows. total 112 drwx------ 9 user1 user1 4096 Oct 26 23:39 . drwxr-xr-x 4 user1 user1 4096 Oct 26 23:39 .. drwx------ 5 user1 user1 4096 Oct 26 22:18 .Drafts drwx------ 5 user1 user1 4096 Oct 29 00:11 .Sent drwx------ 5 user1 user1 4096 Oct 26 23:39 .Templates drwx------ 5 user1 user1 4096 Oct 29 00:12 .Trash drwx------ 2 user1 user1 4096 Oct 26 21:14 cur -rw------- 1 user1 user1 609 Oct 26 20:15 dovecot-uidlist -rw------- 1 user1 user1 8 Nov 13 2023 dovecot-uidvalidity -r--r--r-- 1 user1 user1 0 Oct 15 2022 dovecot-uidvalidity.634a88ee -rw------- 1 user1 user1 600 Oct 18 16:39 dovecot.index -rw------- 1 user1 user1 13296 Oct 26 21:23 dovecot.index.cache -rw------- 1 user1 user1 26084 Oct 26 21:14 dovecot.index.log -rw------- 1 user1 user1 744 Oct 22 18:32 dovecot.list.index -rw------- 1 user1 user1 7232 Oct 29 00:12 dovecot.list.index.log -rw------- 1 user1 user1 96 Nov 13 2023 dovecot.mailbox.log drwx------ 2 user1 user1 4096 Oct 26 20:15 new -rw------- 1 user1 user1 33 Nov 13 2023 subscriptions drwx------ 2 user1 user1 4096 Oct 25 21:32 tmp ==== Output of "ls -l /var/mail" follows. total 288 -rw------- 1 user1 mail 35086 Oct 29 18:02 user1 -rw------- 1 daemon mail 36244 Oct 28 12:32 daemon -rw------- 1 debian mail 36223 Oct 26 21:32 debian -rw------- 1 dovecot mail 36248 Oct 28 19:18 dovecot -rw------- 1 games mail 36223 Oct 27 12:38 games -rw------- 1 news mail 36237 Oct 27 13:52 news -rw------- 1 nobody mail 36266 Oct 27 15:31 nobody -rw------- 1 sshd mail 36195 Oct 29 12:36 sshd

3 4

Aggregating auth/proxy events
by matus.vlcek＠gmail.com 28 Oct '24

28 Oct '24

Hi, I'm working on aggregating event logs and trying to correlate all related events using session IDs. However, I’m struggling with some events as they're missing the session ID. 1. proxy_session_* events lack a session ID field, making it difficult to pair them with auth_request_* events. 2. when using dovecot as sasl for postfix with a unix listener, both auth_request_* and auth_passdb_request_* events are missing the session ID too. Example of the fields object for auth_request_finished when using smtp. It's missing multiple common fields, but session ID is, imho, the most important one. https://doc.dovecot.org/2.3/admin_manual/list_of_events/#id1 ``` categories: [ "auth", "service:auth" ] "fields": { "translated_user": "alex", "mechanism": "LOGIN", "real_remote_ip": "X.X.X.X", "user": "alex", "transport": "insecure", "local_ip": "X.X.X.X", "remote_ip": "X.X.X.X", "real_local_ip": "X.X.X.X", "policy_result": "ok", "service": "smtp", "duration": 96764, "original_user": "alex" }, ``` Would it be possible to add session ID fields to these logs? Alternatively, is there another method to correlate all the session related logs? Thanks, Matus Dovecot v. 2.3.21

1 0

LMTP rejecting aliased emails
by Nick Howitt 27 Oct '24

27 Oct '24

Hi, I am pretty new to Dovecot and totally new to LMTP. I have normal delivery working but I am struggling with aliases. In my mail queue I am seeing things like: -Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient------- E0F617055DB 720 Sat Oct 26 14:50:24 clamav(a)mydomain.com (host mail.mydomain.com[private/dovecot-lmtp] said: 451 4.3.0 <clamav(a)mydomain.com> Temporary internal error (in reply to end of DATA command)) clamav(a)mydomain.com But in my /etc/aliases, I am aliasing clamav to nick and nick(a)mydomain.com is a valid mail box that can receive normal mail. The corresponding line in the mail log is: 2024-10-26T14:55:56.385500+01:00 mail-www dovecot: lmtp(1371485): Error: lmtp-server: conn unix:pid=1371484,uid=102 [1]: rcpt clamav(a)mydomain.com: Failed to initialize user: Mail access for users with UID 107 not permitted (see first_valid_uid in config file, uid from userdb lookup). How do I get round this issue? I can drop the minimum UID to 0, but then all system users are deemed valid for mail which is not true. None of them are. Thanks, Nick

5 30

sieve crashes when two optional include scripts are missing
by Michal Hlavinka 27 Oct '24

27 Oct '24

Hi, we've found an issue with sieve plugin. When script includes two missing optional scripts, it causes crash. For reproducing the issue, script names must belong to same hash table node, so either two scripts with same name or scripts where 'hash(name) % table->size' results in same value, like missing_a and missing_aa in reproducer below. Reduced reproducer: cat >dovecot.min.conf <<EOF mail_location = maildir:~/Maildir plugin { sieve = file:/tmp;active=/tmp/dovecot.sieve } EOF cat >reproducer.sieve <<EOF require "include"; include :personal :optional "missing_a"; include :personal :optional "missing_aa"; EOF echo -n > empty sieve-test -c dovecot.min.conf reproducer.sieve empty any test mail would do, but empty file is enough for reproducer # return sblock->id causes the crash as sblock is NULL backtrace: (gdb) bt #0 sieve_binary_block_get_id (sblock=0x0) at src/lib-sieve/sieve-binary.c:421 #1 ext_include_execute_include (renv=0x5555555bbed8, include_id=1, flags=EXT_INCLUDE_FLAG_OPTIONAL) at plugins/include/ext-include-common.c:696 #2 opc_include_execute (renv=0x5555555bbed8, address=0x5555555bbf10) at plugins/include/cmd-include.c:399 #3 sieve_interpreter_operation_execute (interp=0x5555555bbe88) at src/lib-sieve/sieve-interpreter.c:901 #4 sieve_interpreter_continue (interp=0x5555555bbe88, interrupted=0x0) at src/lib-sieve/sieve-interpreter.c:959 #5 sieve_interpreter_start (interp=0x5555555bbe88, result=0x5555555b9230, interrupted=0x0) at src/lib-sieve/sieve-interpreter.c:1049 #6 sieve_interpreter_run (interp=0x5555555bbe88, result=0x5555555b9230) at src/lib-sieve/sieve-interpreter.c:1057 #7 sieve_run (sbin=0x55555558ee18, result=0x5555555b9230, eenv=0x7fffffffe890, ehandler=0x55555558c338) at src/lib-sieve/sieve.c:357 #8 sieve_test (sbin=0x55555558ee18, msgdata=0x7fffffffe9f0, senv=0x7fffffffea30, ehandler=0x55555558c338, stream=0x5555555b2cd0, flags=SIEVE_EXECUTE_FLAG_LOG_RESULT) at src/lib-sieve/sieve.c:598 #9 main (argc=5, argv=0x555555567a10) at src/sieve-tools/sieve-test.c:391 issue seems to be caused by lib-sieve/plugins/include/ext-include-common.c: ext_include_generate_include on first pass (script) the check for script already compiled into binary at 529: included = ext_include_binary_script_get_include_info(binctx, script); returns NULL, so code goes through 'else' block where it hits sieve_script_is_open(script) check. It includes script with NULL block, returns 0 so caller cmd_include_generate does not emit anything. On second pass the above 'included' check returns first missing script, it goes through true block where it just checks flags and returns non-zero, so caller this time goes through the emit code block and the previously included NULL sblock gets referenced causing crash later. Note: despite scripts have different name, they pass the "same script" check because sieve_file_script_equals compares 0==0 dev & inode numbers as scripts do not exist. This is why scripts do not have to have same names. Side effect of this is that as missing_a and missing_aa are treated like the same script, only first one is linked in compiled svbin. Which means that if missing_aa reappears later, svbin won't get recompiled. Another manifestation of the issue is when included missing_a script is present when main script is compiled and later missina_a is removed again. During execution, script is not recompiled and it aborts for hash table dupe check: sieve_binary_open->ext_include_binary_script_include->hash_table_insert There are several ways how to solve this. I've tried a few, but there were other corner cases that appeared. One tried way was for example ext_include_generate_include in the 'if (included)' replicate the check sieve_script_is_open(...) from else block, just check flags, no include and set result to 0. Another way to solve this is to return from ext_include_execute_include early if sblock is NULL just before it tries to derefernce it, similarly as it does if it fails 'once' check. Same for dumping in opc_include_dump. Whilst the first approach seems a bit better, it won't stop crashing in existing environments as it won't trigger svbin recompilation and svbin would fail. This means that the second soultion is sort of needed anyway. This still won't solve the problem with different missing scripts as only first one would be able to trigger recompilation when file becomes available. Just including both in the mentioned function won't work either as they would still be evaluated as same and hash table anti-dupe check would trigger abort. So some changes in script comparison seem needed anyway. This is what I've used in my approach. Return early from ext_include_execute_include and opc_include_dump if sblock is NULL and change sieve_file_script_equals to compare also script->location for missing scripts (when inode is 0). Let me know if you need more information. Cheers, Michal Hlavinka

2 1