- dovecot - dovecot.org

Mailbox sharing not working
by Kees van Vloten 17 Feb '22

17 Feb '22

Hi Team, I am trying to setup mailbox sharing. But although user test2 shares INBOX with test1, it is not visible for user1. doveadm acl get -u test2 INBOX ID Global Rights user=test1 admin create delete expunge insert lookup post read write write-deleted write-seen cat /srv/mail/dovecot/lib/shared-mailboxes.db shared/shared-boxes/user/test1/test2(a)example.com 1 Log output: Feb 16 20:12:42 server dovecot: imap-login: Login: user=<test1(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=900367, secured, session=<mDkSbyfYotF/AAAB> Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Loading modules from directory: /usr/lib/dovecot/modules Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_push_notification_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_xapian_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Effective uid=990, gid=986, home=/srv/mail/vmail Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Namespace inbox: type=private, prefix=, sep=~, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/mail/vmail/example.com/test1/store:LAYOUT=fs:FULLDIRN… Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test1/store, index=/srv/mail/vmail/example.com/test1/index, indexpvt=, control=/srv/mail/vmail/example.com/test1/control, inbox=, alt= Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: acl: initializing backend with data: vfile Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Mailbox INBOX~example.com: Mailbox opened because: SELECT Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/INBOX/example.com/0_FolderContent/dovecot-acl not found Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Logged out in=136 out=1584 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Feb 16 20:12:43 server dovecot: imap-login: Login: user=<test1(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=900369, secured, session=<82gfbyfYuNF/AAAB> <removed lines> Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: Namespace inbox: type=private, prefix=, sep=~, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/mail/vmail/example.com/test1/store:LAYOUT=fs:FULLDIRN… Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test1/store, index=/srv/mail/vmail/example.com/test1/index, indexpvt=, control=/srv/mail/vmail/example.com/test1/control, inbox=, alt= Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: initializing backend with data: vfile Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: acl username = test1(a)example.com Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: owner = 1 Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: Global ACLs disabled Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: Namespace : type=shared, prefix=shared~%u~, sep=~, inbox=no, hidden=no, list=no, subscriptions=no location=maildir:/srv/mail/vmail/example.com/%n/store:LAYOUT=fs:FULLDIRNAME… Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: fts: Indexes disabled for namespace 'shared~%u~' Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: initializing backend with data: vfile Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: acl username = test1(a)example.com Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: reading file /srv/mail/vmail/example.com/test1/store/INBOX/0_FolderContent/dovecot-acl Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Drafts/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Junk/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Trash/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Sent/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/INBOX/example.com/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: Namespace shared~: Using permissions from : mode=0700 gid=default Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Logged out in=130 out=1518 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Dovecot -n: # 2.3.13 (89f716dc2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 5.10.0-10-amd64 x86_64 Debian 11.2 ext4 # Hostname: server.example.com auth_default_realm = EXAMPLE.COM auth_gssapi_hostname = server.example.com auth_krb5_keytab = /etc/keytab/dovecot.keytab auth_master_user_separator = * auth_mechanisms = gssapi gss-spnego plain auth_realms = EXAMPLE.COM first_valid_gid = 601 first_valid_uid = 601 hostname = server.example.com imap_client_workarounds = tb-extra-mailbox-sep imap_max_line_length = 2 M login_greeting = Dovecot ready. mail_debug = yes mail_gid = 986 mail_location = maildir:/srv/mail/vmail/example.com/%n/store:LAYOUT=fs:FULLDIRNAME=0_Folder… mail_plugins = zlib notify push_notification listescape acl mail_shared_explicit_inbox = yes mail_uid = 990 namespace { hidden = no list = no location = maildir:/srv/mail/vmail/example.com/%%n/store:LAYOUT=fs:FULLDIRNAME=0_Folde… prefix = shared~%%u~ separator = ~ subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Inbox { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = ~ subscriptions = yes type = private } passdb { args = username_format=%u /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/ldap_user_to_principal.conf.ext driver = ldap pass = yes } passdb { args = nopassword=y allow_nets=127.0.0.1/32 driver = static } passdb { driver = pam } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/srv/mail/dovecot/lib/shared-mailboxes.db acl_user = %u autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = Sent listescape_char = \ } postmaster_address = admin(a)example.com protocols = " imap lmtp submission" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imap_local { address = 127.0.0.1 port = 144 ssl = no } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 } service indexer-worker { vsz_limit = 2 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service submission-login { inet_listener submission { port = 465 ssl = yes } } ssl = required ssl_cert = </etc/dovecot/private/dovecot.pem ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM ssl_client_ca_dir = /etc/ssl/certs ssl_curve_list = X25519:secp521r1:secp384r1:prime256v1 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 submission_client_workarounds = whitespace-before-path submission_relay_host = localhost userdb { args = /etc/dovecot/ldap_list_users.conf.ext driver = ldap result_success = continue } userdb { args = /etc/dovecot/ldap_user_domain.conf.ext driver = ldap result_success = continue } userdb { args = uid=vmail gid=vmail home=/srv/mail/vmail allow_all_users=yes driver = static } protocol lmtp { mail_plugins = zlib notify push_notification listescape acl } protocol lda { mail_plugins = zlib notify push_notification listescape acl } protocol imap { mail_max_userip_connections = 50 mail_plugins = zlib notify push_notification listescape acl imap_acl } Is there anything obviously wrong in the config? I suspect a mismatch between %u and %n somewhere but don't know how to figure out the culprit. How can I get more relevant debug log output about namespaces / mailbox sharing? Or can I run commands to check validity? - Kees

2 10

Replications ERROR
by Günther J. Niederwimmer 16 Feb '22

16 Feb '22

Hello, Can any Help me to find out the Problem with "sync failed" I have all disabled only one user is in the moment running? doveadm replicator status '*' username priority fast sync full sync success sync failed gjn(a)example.com none 00:01:47 23:37:43 - y gjn none 00:01:47 23:42:43 - y Could it be a Problem with this doveadm user '*' gjn(a)example.com What is the way to become logs what is going wrong ? Could it be, I have Problems with the Dovecot Variables in the LDAP Config ? Thanks very match for a answer, -- mit freundlichen Grüßen / best regards Günther J. Niederwimmer

2 3

Memory problems with config service
by Víctor Rubiella Monfort 16 Feb '22

16 Feb '22

Hi all, I'm having problems with memory in config service. I increased vsz_limit to 10GB but continue with this errors when try to reload or restart dovecot: config: Panic: data stack: Out of memory when allocating 2147483688 bytes master: Error: service(config): command startup failed, throttling for 2 secs config: Fatal: master: service(config): child 5512 killed with signal 6 (core dumps disabled) Dovecot has a lot of certificates TLS configured (SNI) (about 3k), but if I check the size of all of them is aprox 170MB on disk.Why does it need so much memory to boot? Is normal? service config { vsz_limit = {{ vszlimit }} }

2 1

mail.error listen_fd(7): Error: 22 46530 BYE
by Juerg Reimann 14 Feb '22

14 Feb '22

Hi there, What do the following logs mean and how do I resolve the problem? 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46519 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46529 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46531 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46530 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46532 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46537 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46535 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46536 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46534 BYE Thanks for your help, Juerg

1 0

JWT tokens, timestamps and doubles (microseconds)
by Aleš Krajník 14 Feb '22

14 Feb '22

Hi all, I am having troubles with OAuth2 setup with local introspection of JWT tokens. This happens, when the JWT tokens contain timestamps as doubles, with microseconds, for example with the following payload: { "aud": "caf65d650022e3eb7cce518e7526a39f", "jti": "8291efed41d2ce65ec5c59a4cbcaa285f2ca37d5b2785da56de66adbd1b8eef65495bc 599be5ac56", "iat": 1644833538.793359, "nbf": 1644833538.79336, "exp": 1644833838.773605, "sub": "ales(a)example.com", "scope": "email" } Such a JWT token produces the following error: dovecot_1 | Feb 14 10:10:46 auth: Info: oauth2(ales(a)example.com,192.168.224.2,<xWZFoffXYujAqOAC>): oauth2 failed: Local validation failed: Malformed 'exp' field According to the RFC, the timestamps seem to be allowed to contain non- integer values: NumericDate A JSON numeric value representing the number of seconds from 1970- 01-01T00:00:00Z UTC until the specified UTC date/time, ignoring leap seconds. This is equivalent to the IEEE Std 1003.1, 2013 Edition [POSIX.1] definition "Seconds Since the Epoch", in which each day is accounted for by exactly 86400 seconds, other than that non-integer values can be represented. See RFC 3339 [RFC3339] for details regarding date/times in general and UTC in particular. (https://datatracker.ietf.org/doc/html/draft-ietf-oauth-json-web-token-32#se…) After removing the fractions, the token works well. This seems to be happening here: https://github.com/dovecot/core/blob/master/src/lib-oauth2/oauth2-jwt.c#L41 If you agree for this to be a bug, can I fill in a bug report somewhere? Thank you! Best, Aleš

2 1

wondering if I configured sieve vacation correctly
by Marc 14 Feb '22

14 Feb '22

I have a user who feels compelled to use the vacation as autoreply to confirm that a message has been received. The down side is of course, that if spam/abuse messages get through the spam filters, this can get 'messy'. Currently I am getting these ndr's as postmaster(?). But I was not actually expecting this. I would expect that the mailbox with the autoreply would get this report. The vacation is configured like this[1], my question is. What am I doing wrong that this ndr is not ending up in the users mailbox? Can it be the from is not correctly configured/set at the time the vacation message is being sent? [1] require ["vacation"]; # rule:[cccccccccc] if true { vacation :addresses "test(a)test.com" :from "test(a)test.com" text: dddddddddddddd } [2] Return-Path: <> Received: from aaaaa (localhost [127.0.0.1]) by aaaaa (8.14.7/8.14.7) with ESMTP id 21BDgaPj014029 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for <postyk(a)hm.edu>; Fri, 11 Feb 2022 14:42:36 +0100 Received: (from root@localhost) by aaaaa (8.14.7/8.14.7/Submit) id 21BDgamD014028 for postyk(a)hm.edu; Fri, 11 Feb 2022 14:42:36 +0100 X-Sieve: Pigeonhole Sieve 0.4.24 (124e06aa) Message-ID: <dovecot-sieve-1644586956-19320-0@bbbb> Date: Fri, 11 Feb 2022 14:42:36 +0100 From: test(a)test.com To: <postyk(a)hm.edu>

1 1

Backup procedures
by Jorge Bastos 13 Feb '22

13 Feb '22

Howdy, I have a particular situation where I have about 5 users using a large account in IMAP, and I have the need to backup the account daily or weekly or so. I was thinking about to copy the whole directory, each email is a file, it could probably work, but the dovecot index files would be damaged/wrong. Is there a tool that could perform a backup (ex: yesterday), and when I inserted that backup, it just insert the emails and folders that were deleted today? Thanks in advanced, Jorge

5 8

LMTP Crash with Dovecot 2.3.18
by Bryan Jacobs 13 Feb '22

13 Feb '22

Dear Dovecot Users, Upgrading from Dovecot 2.3.14 to 2.3.18 on Arch gives me the following dump immediately (100% of the time) on every LMTP handler invocation. Of course I'm using Squat for FTS (yes, I understand it's deprecated...). plugin { fts = squat fts_squat = partial=4 full=4 fts_autoindex = yes sieve = file:/mnt/mail/%Ln/sieve;active=/mnt/mail/%Ln/.dovecot.sieve master_user = %u } lmtp[592878]: segfault at 50 ip 00007f5355153eed sp 00007fff45b87ba0 error 4 in lib20_fts_plugin.so[7f5355153000+11000] Code: 00 4c 8d 05 f9 17 01 00 48 8d 0d ae 19 01 00 31 c0 ba 53 01 00 00 48 8d 35 f2 17 01 00 48 8d 3d 49 01 01 00 ff 15 53 7f 03 00 <48> 8b 04 25 50 00 00 00 0f 0b be 2a 01 00 00 8d 3d cf 17 01 00 > Feb 08 01:23:20 mail systemd-coredump[592880]: [🡕] Process 592878 (lmtp) of user 0 dumped core. > > Module linux-vdso.so.1 with build-id 0f9bd6468a3798a863048e6cd927830796809b46 > Module libffi.so.8 with build-id f90d8b734f6de9b25faedb8cbfab7054dafc0a42 > Module libp11-kit.so.0 with build-id cc372ea3c28c4d3dfc633b4d2e933c8584d2af16 > Module libcrypt.so.2 with build-id 5d45bdae438c16d52364b23d70bd5041ad070b0b > Module librt.so.1 with build-id 75484da2d6f1515189eefa076e0a40328834cd16 > Module libnss_systemd.so.2 with build-id 56da60140e2f0e47044a141378608146f6fd9bb8 > Module libnss_files.so.2 with build-id 1a36dfc01d3a1010b2ee79766a24a8090a3266d5 > Module libdovecot-sieve.so.0 with build-id a358da532b8ef09782b5a97a951df8ab5c8eb0db > Module lib90_sieve_plugin.so with build-id eb52835c5c3d1034617e745995b950484faed909 > Module lib21_fts_squat_plugin.so with build-id cc731fa9bf9cac2f890bbc1da598e958cb465d52 > Module libicudata.so.70 with build-id e1dcc2a88cfaafed882d09c90c668af0eed4efed > Module libgcc_s.so.1 with build-id 7f8508bb914546ada778809b64b99d234337d835 > Module libm.so.6 with build-id 2b8fd1f869ecab4e0b55e92f2f151897f6818acf > Module libstdc++.so.6 with build-id 9b5eeeb149bf3c4efe787fb398b44f00507aec87 > Module libicuuc.so.70 with build-id 2e245c2bf12f95fd8ab79b3a4be99524677cbd70 > Module libicui18n.so.70 with build-id 95af755fca990df26753a7d720b8e3ae24270e42 > Module lib20_fts_plugin.so with build-id 5b44deef3cd93f2cdac9a38ab3f5c4f1a2f48d40 > Module lib10_quota_plugin.so with build-id 5fa33175575dcf45f4aead56c701fe58a19f0df8 > Module libpthread.so.0 with build-id 07c8f95b4f3251d08550217ad8a1f31066229996 > Module libcrypto.so.1.1 with build-id 4c926b672d97886b123e03a008387aecf0786de4 > Module libssl.so.1.1 with build-id 1024424ab33a3767da03f4fdb1fc1b02479f160f > Module libssl_iostream_openssl.so with build-id ba2cf9015fbabf8459896bd584379f2f566aaa51 > Module ld-linux-x86-64.so.2 with build-id 040cc3dd10461562f177df39e3be2f3704258c3c > Module libdl.so.2 with build-id 5abc547e7b0949f89f3c0e21ab0c8331a7440a8a > Module libc.so.6 with build-id 4b406737057708c0e4c642345a703c47a61c73dc > Module libdovecot.so.0 with build-id 3f68ab1f1e0bffceea1c130e6b46f799eea45522 > Module libdovecot-storage.so.0 with build-id 3bf1e7c355c0c6184165e209f67b3a6627355401 > Module libdovecot-lda.so.0 with build-id 54cc9d9face18809a95ccd5ee643330eed997d8b > Module lmtp with build-id 7cc9238bb78e35771572aa3e31bdecf1cda5d754 > Stack trace of thread 592878: > #0 0x00007f5355153eed n/a (lib20_fts_plugin.so + 0x9eed) > #1 0x00007f535515db30 fts_mailbox_allocated (lib20_fts_plugin.so + 0x13b30) > #2 0x00007f535595eb6d hook_mailbox_allocated (libdovecot-storage.so.0 + 0x60b6d) > #3 0x00007f53559598ec mailbox_alloc (libdovecot-storage.so.0 + 0x5b8ec) > #4 0x00007f5355959b5e mailbox_alloc_for_user (libdovecot-storage.so.0 + 0x5bb5e) > #5 0x00007f5355a6d790 mail_deliver_save_open (libdovecot-lda.so.0 + 0x4790) > #6 0x00007f5355a6dbdc mail_deliver_save (libdovecot-lda.so.0 + 0x4bdc) > #7 0x00007f5355a6e39a mail_deliver (libdovecot-lda.so.0 + 0x539a) > #8 0x0000563d3a90bc2d lmtp_local_default_deliver (lmtp + 0x8c2d) > #9 0x0000563d3a90c39f lmtp_local_data (lmtp + 0x939f) > #10 0x0000563d3a90acc1 client_default_cmd_data (lmtp + 0x7cc1) > #11 0x0000563d3a90aa31 cmd_data_continue (lmtp + 0x7a31) > #12 0x00007f535579c3bf n/a (libdovecot.so.0 + 0x6d3bf) > #13 0x00007f535579cc46 n/a (libdovecot.so.0 + 0x6dc46) > #14 0x00007f53557a023e smtp_server_command_call_hooks (libdovecot.so.0 + 0x7123e) > #15 0x00007f53557a07f1 smtp_server_command_next_to_reply (libdovecot.so.0 + 0x717f1) > #16 0x00007f53557a5b5b n/a (libdovecot.so.0 + 0x76b5b) > #17 0x00007f535584469f io_loop_call_io (libdovecot.so.0 + 0x11569f) > #18 0x00007f5355844787 io_loop_handler_run (libdovecot.so.0 + 0x115787) > #19 0x00007f5355844919 io_loop_run (libdovecot.so.0 + 0x115919) > #20 0x00007f53557b31d8 master_service_run (libdovecot.so.0 + 0x841d8) > #21 0x0000563d3a909606 main (lmtp + 0x6606) > #22 0x00007f535557bb25 __libc_start_main (libc.so.6 + 0x27b25) Thanks, Bryan Jacobs

2 1

Dovecot installation problem (libssl_iostream_openssl.so is not portable!)
by Dimitri 11 Feb '22

11 Feb '22

Hi there, i finally solved the problem. On my server i always used openssl compiled from source with the following configuration options: > ./config --prefix=/test/dep/openssl --openssldir=/test/dep/openssl no-deprecated no-ssl The error when i try to compile dovecot tell about undefined references: > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `OBJ_cleanup' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_CTX_need_tmp_RSA' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_load_error_strings' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `ENGINE_cleanup' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `ERR_free_strings' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `EVP_cleanup' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_library_init' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `CRYPTO_cleanup_all_ex_data' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_CTX_set_tmp_rsa_callback' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `OpenSSL_add_all_algorithms' for example "OBJ_cleanup". So i check these functions on the openssl documentation an saw the notice about "deprecated function since OpenSSL 1.1.0" Therefore i recompiled openssl with the following configuration options: > ./config --prefix=/test/dep/openssl --openssldir=/test/dep/openssl --api=1.0.0 After that the compilation of dovecot was successful. It seems that dovecot still uses now deprecated functions from openssl befor version 1.1.0 Can anyone tell me when dovecot doesn't need this deprecated functions anymore? Thanks!

1 0

Hanging doveadm-server processes with dsync replication
by Sebastian Marske 10 Feb '22

10 Feb '22

Dear Dovecot mailing list, after updating Dovecot from 2.3.16 to 2.3.18 on a dsync-replicated server there are hanging doveadm-server processes piling up over time, eventually resulting in some of the affected users being shown as out of sync. Our setup is based on FreeBSD 13, ZFS and Dovecot (we use custom packages built with poudriere) with master/master replication using dsync. However, we use a shared ip (Carp), so that only one server is actually active. Please see the output of "doveconf -n" at the end for our config. Starting from an in-sync state, I updated Dovecot on the inactive server. Occasionally, Dovecot logs messages like: Feb 8 15:02:15 myhost dovecot[99800]: doveadm(someuser)<2090><ZLayIal3AmIqCAAADKIhQg>: Error: write(<local>) failed: Timed out after 60 seconds These occur for an increasing number of users (maybe 30 after two days), but not for every user (there are >4800 users on that server) and also only once for every affected user. Here's some more information about the process/user from the log entry: # doveadm replicator dsync-status username type status someuser incremental Waiting for dsync to finish (the type is "incremental for most users, but "normal" and "full" show up as well) # doveadm replicator status someuser username priority fast sync full sync success sync failed someuser low 00:01:51 21:56:06 69:56:10 y (again, not all are in failed state) # top -abp 2090 PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 2090 sysdov 1 20 0 26M 15M kqread 12 0:01 0.00% doveadm-server: [<local>] (doveadm-server) (didn't change for >1d) # top -m io -abp 2090 PID USERNAME VCSW IVCSW READ WRITE FAULT TOTAL PERCENT COMMAND 2090 sysdov 363 58 0 271 2 273 0.00% doveadm-server: [<local>] (doveadm-server) (didn't change for >1d) # gdb -p 2090 ... (gdb stuff; gdb complaining about missing debug symbols) (gdb) bt full #0 0x00000000416a94ca in _kevent () from /lib/libc.so.7 No symbol table info available. #1 0x00000000419b94f3 in ?? () from /lib/libthr.so.3 No symbol table info available. #2 0x000000004152a645 in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00000000415282fa in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x0000000041528138 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x000000004148ac58 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #6 0x0000000001086431 in main () No symbol table info available. (gdb) So I guess it's waiting for something that * doesn't happen on my system * or it didn't wait for in 2.3.16 >From what I've seen, mails from the active server (still on 2.3.16) are replicated to this server. For non-affected users, mails are also replicated from this server to the active one. I can't tell about "outgoing" replication for affected users, yet. After downgrading back to 2.3.16, things are fine again. Most affected users jump back to being successfully synced within a couple of minutes. If not, starting replication via doveadm get's them there. Testing 2.3.18 again, it seems that the same users are affected again. I also tested 2.3.17 when it came out and had the same issue, paired with the ioloop issue [1], which was fixed in 2.3.18 and which I don't see anymore. The hanging doveadm processes remain, though. Do you have any suggestions on how to resolve this? [1] https://dovecot.org/pipermail/dovecot/2022-January/123907.html Best regards Sebastian # doveconf -n # 2.3.18 (9dd8408c18): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: FreeBSD 13.0-RELEASE-p6 amd64 # Hostname: myhost... auth_cache_ttl = 0 auth_username_chars = abcdefghijklmnopqrstuvwxyz01234567890@.- auth_username_format = %n default_client_limit = 126000 default_process_limit = 50000 default_vsz_limit = 512 M doveadm_password = # hidden, use -P to show it first_valid_gid = 20 first_valid_uid = 20 imap_client_workarounds = tb-extra-mailbox-sep imap_logout_format = in=%i out=%o delflag=%{deleted} deleted=%{expunged} trashed=%{trashed} session=<%{session}> login_trusted_networks = # imap proxy ips... mail_gid = sysdov mail_location = maildir:~/maildir:INDEX=/addons/index/%u:CONTROL=~/control:LAYOUT=fs mail_plugins = acl notify replication mail_uid = sysdov managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader namespace fremdeordner { list = yes location = maildir:%%h/maildir:INDEX=/addons/index/%u/FremdeOrdner/%%u:LAYOUT=fs prefix = FremdeOrdner/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes list = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox AutoCleanSpam { auto = subscribe } mailbox "Deleted Items" { special_use = \Trash } mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Entwürfe { special_use = \Drafts } mailbox "Gelöschte Elemente" { special_use = \Trash } mailbox "Gesendete Elemente" { special_use = \Sent } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox name { special_use = \Drafts \Junk \Sent \Trash \Archive } prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = failure_show_msg=yes dovecot driver = pam } plugin { acl = vfile acl_shared_dict = file:/addons/acl/shared-folder mail_replica = tcp:myreplica...:12345 sieve = /addons/sieve/%u.sieve sieve_dir = sieve_extensions = +imap4flags +editheader sieve_vacation_dont_check_recipient = yes } protocols = imap lmtp replication_dsync_parameters = -d -n 'inbox' -l 30 -U replication_max_conns = 150 service aggregator { fifo_listener replication-notify-fifo { user = sysdov } unix_listener replication-notify { user = sysdov } } service anvil { client_limit = 60003 unix_listener anvil-auth-penalty { mode = 00 } unix_listener anvil { group = nagios mode = 0660 } } service auth { client_limit = 126000 unix_listener auth-userdb { mode = 0644 user = sysdov } } service config { unix_listener config { user = sysdov } } service doveadm { inet_listener { port = 12345 } user = sysdov vsz_limit = 1 G } service imap-login { client_limit = 20000 process_limit = 10000 process_min_avail = 138 service_count = 0 } service imap { process_limit = 80000 process_min_avail = 10 vsz_limit = 512 M } service lmtp { client_limit = 1 executable = lmtp -L process_min_avail = 20 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = sysdov } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = sysdov } } ssl_cert = </usr/local/etc/letsencrypt/live/myhost/fullchain.pem ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { default_fields = mail_replica=tcp:myreplica...:12345 driver = passwd override_fields = uid=29 gid=29 blocking=yes } verbose_proctitle = yes protocol imap { login_trusted_networks = # imap proxy ips... mail_max_userip_connections = 25 mail_plugins = acl notify replication acl imap_acl } protocol lmtp { mail_plugins = acl notify replication sieve postmaster_address = postmaster@... sendmail_path = /usr/local/sbin/sendmail }

1 0