February 2022 - dovecot

Build with MySQL -> libmysqlclient not found
by Dimitri 28 Feb '22

28 Feb '22

> John: > > ./configure --help > > might also be a good idea, I think it might have some options like: > > --mysql-libs=/path/to/lib > --mysql-includes=/path/to/include > > or something similiar to use. Unfortunately not, just the "--with-mysql" Option. > Oscar: > > You might need CPPFLAGS as well. (e.g. CPPFLAGS="-I/test/core/mariadb/include") > Check also "config.log" for errors. I had already done both, just forgot to mention it. But i should have looked further. Near the end of config.log is saw: ================================ > | /* Override any GCC internal prototype to avoid an error. > | Use char because int might match the return type of a GCC > | builtin and then its argument prototype would still apply. */ > | #ifdef __cplusplus > | extern "C" > | #endif > | char mysql_init (); > | int > | main () > | { > | return mysql_init (); > | ; > | return 0; > | } > configure:23386: result: noconfigure:23520: error: Can't build with MySQL support: libmysqlclient not found ================================ and thought that wouldn't help me. Now i looked again but further up an saw: ================================ > configure:23377: gcc -o conftest -std=gnu99 -g -O2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -mfunction-return=keep -mindirect-branch=keep -Wall -W -Wmissing-prototypes -Wmissing-declarations> ... > /usr/bin/ld: cannot find -lzcollect2: error: ld returned 1 exit status ================================ Zlib i have (of course ;) ) also compiled from source. After adding "/test/dep/zlib/include" to CPPFLAGS and "/test/dep/zlib/lib" to LDFLAGS the configuration runs without errors. However i don't understand why the configuration-script takes the non-standard path for openssl automatically and correctly from the PKG_CONFIG_PATH, but the paths to my zlib and mariadb installations, which i also set in PKG_CONFIG_PATH not...

3 3

Build with MySQL -> libmysqlclient not found
by Dimitri 28 Feb '22

28 Feb '22

Hi folks, just step into another problem and don't know why? If i try to configure dovecot with the following: > ./configure --prefix=/test/core/dovecot --with-ssldir=/test/core/dovecot/tls --with-mysql i get > ... > checking for auth_userokay... no > checking for mysql_config... NO > checking for mysql_init in -lmysqlclient... noconfigure: error: Can't build with MySQL support: libmysqlclient not found After that i've tried to configure with following: > LDFLAGS="-L/test/core/mariadb/lib" ./configure --prefix=/test/core/dovecot --with-ssldir=/test/core/dovecot/tls --with-mysql but with same result. The Content of "/test/core/mariadb/lib" is: libmariadbclient.a libmariadb.so -> libmariadb.so.3 libmariadb.so.3 libmysqlclient.a -> libmariadbclient.a libmysqlclient_r.a -> libmariadbclient.a libmysqlclient_r.so -> libmariadb.so.3 libmysqlclient.so -> libmariadb.so.3 libmysqlservices.a pkgconfigplugin Also the Path "/test/core/mariadb/lib/pkgconfig" is in the PKG_CONFIG_PATH variable and the Library-Path "/test/core/mariadb/lib" is known by the dynamic linker (/etc/ld.so.conf.d/mylibs.conf). So what am i doing wrong? My Dovecot version: 2.3.18 My Mariadb version: 10.6.5 My OS: Ubuntu 20.04

4 4

Build with MySQL -> libmysqlclient not found
by Dimitri 27 Feb '22

27 Feb '22

> Why aren't you just using the Ubuntu 20.04 packaged version instead? > > Also, did you install the headers for libmysqlclient properly as > > well? > > What does /test/core/mariadb/includes/ or > > /test/core/includes/... show? Hi John, i just want to manage all the software manually, use own directorie-structur and have all the programs in one place, deepen my understanding how these programs work and build these programs only with the components i need. The content of "/test/core/mariadb/include/mysql" is: > errmsg.h > ma_list.h > ma_pvio.h > mariadb/ > mariadb/ma_io.h > mariadb_com.h > mariadb_ctype.h > mariadb_dyncol.h > mariadb_rpl.h > mariadb_stmt.h > mariadb_version.h > ma_tls.h > my_config.h > my_global.h > mysql/ > mysql/client_plugin.h > mysql/plugin_auth_common.h > mysql/plugin_auth.h > mysql_com.h > mysqld_error.h > mysql.h > mysql_version.h > my_sys.h > server/...

1 0

email location - files or sql
by Robert Moskowitz 25 Feb '22

25 Feb '22

I have been running a Dovecot based mail server for over 10 years and it is time (really past) to upgrade. I really don't want to roll my own anymore. Too much time and too many skills needed. Time to retire. But still want it 'in-house'. What I am seeing is that many of the packages seem to roll the messages into some SQL database. My Dovecot setup uses the /home/vmail/doman/../{cur,new,etc} tree structure. Is there any pros vs cons on this that I can read? Is there some nice packed mailserver I can drop on a Centos-arm server that has Dovecot under the covers and I can easily rsync my current mail store to it? Mail-in-a-box looks interesting. But I have not figured out its internals and if I have to worry about anything compiled for arm that is not part of the distro. Thanks in advance for help.

5 7

Messages reappearing in mailboxes as duplicates
by Andrew Skipper 23 Feb '22

23 Feb '22

Hello, We have 3 nodes running, with a two way replication between 2 of them and a 1 way replication to a DR node running off one. We use mdbox, and directors to split traffic across nodes. There is no shared file system. Users are experiencing messages reappearing in their INBOX as unread with duplicate GUID and message headers. This occurs generally several days after a message was first received (and often actioned; read, moved, trashed, expunged, also often bulk moved/deleted). We have attempted to remove replication from the equation by cutting down to one single node with all replication disabled which did not have any impact. We have also started regular cache and mailbox purging. There are no logged events when mail items reappear, and we only observe it based on user report, mailbox inspection (doveadm looking for duplicate GUIDs/unique message headers) or seeing IMAP commands being done against the same message twice (e.g. monday they copy to trash, delete and expunge from inbox, delete and expunge from trash, then the next monday they will have to do the same for the reappearing message). OS: Centos 7 Dovecot: dovecot -version Scheduled jobs: */15 0 * * 0 doveadm sync -u "*" tcps:<dr node>:12345 > /var/log/dovecot/dr_sync.log 2>&1 1 3 * * * doveadm mailbox cache purge -A INBOX 21 3 * * * doveadm mailbox cache purge -A Trash 0 1 * * 0 /usr/bin/doveadm purge -A >/dev/null 2>&1 Conf: dovecot -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1160.53.1.el7.x86_64 x86_64 CentOS Linux release 7.9.2009 (Core) # Hostname: <primary node> auth_master_user_separator = * default_vsz_limit = 1 G disable_plaintext_auth = no dotlock_use_excl = no doveadm_password = # hidden, use -P to show it listen = * mail_fsync = always mail_location = mdbox:~/mail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify replication" mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { autoexpunge = 30 days special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/conf.d/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/dovecot/conf.d/passwd.masterusers driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename save flag_change mail_log_fields = uid box msgid size flags mail_log_group_events = mail_replica = tcps:<second node>:12345 } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { inet_listener imap { port = 144 } inet_listener imaps { port = 994 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot-internal.pem ssl_cipher_list = TLS_AES_256_GCM_SHA384:TLS_CHACHA20_POLY1305_SHA256:TLS_AES_128_GCM_SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA256:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_client_ca_file = /etc/ssl/certs/ca-bundle.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/conf.d/dovecot-dict-auth.conf.ext driver = dict } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 9999 mail_plugins = " notify replication mail_log notify" } Any thoughts would be greatly appreciated. Thanks in advance, Andrew

1 0

Pigeonhole page's RFC links broken (fix attached)
by Patrick Nagel 22 Feb '22

22 Feb '22

Hi there, I was just reading https://pigeonhole.dovecot.org/ and noticed that all the links to the RFCs are broken. I fixed them via regexp search & replace curl https://pigeonhole.dovecot.org/ | sed -e 's|https\?://tools.ietf.org/html/rfc\([0-9]\{4\}\)/\?|https://www.ietf.org/r…' >Pigeonhole_fixed_rfc_links.html and attached the resulting page. Cheers, Patrick.

1 0

postfix, dovecot-lda, /run/dovecot/stats-writer socket permision and local user delivery, again
by Michael Tokarev 22 Feb '22

22 Feb '22

Hi! There are many questions on the 'net about the same theme: lda(mjt): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied dovecot-lda is run from postfix as mailbox_command for local users. There's even a suggestion on dovecot wiki to make dovecot-lda setgid (to mail) - for a different reason but people use this trick to shut this error message up. See eg the last message at https://forum.zentyal.org/index.php?topic=35236.0 which points to https://wiki2.dovecot.org/LDA/Postfix . But the thing is: mail delivery stops right after making dovecot-lda setgid, like this: Feb 22 00:06:46 tsrv dovecot: lda(mjt)<253650><s+nnHub+E2LS3gMA7tuOMA>: \ Fatal: setresgid(914(dovecot),914(dovecot),8(mail)) failed with euid=1000(mjt): \ Operation not permitted why the hell lda tries to setuid to dovecot user? It will definitely unable to write to the maildir since it is owned by user mjt, not by user dovecot! And I *only* made it setgid, not setuid. How to use dovecot-lda together with postfix, after all? Thanks, /mjt

2 2

RE: Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 22 Feb '22

22 Feb '22

No, the problem is the logging of the cache lookup with password mismatch. (release 2.3.17) We missing client IP and user in the cache lookup logging. auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) Arvid -----Original Message----- From: Aki Tuomi <aki.tuomi(a)open-xchange.com> Sent: tirsdag 22. februar 2022 09:15 To: Eikås Arvid <arvid.eikas(a)telenor.no>; dovecot(a)dovecot.org Subject: Re: Different auth logging with cache lookup. (OPEN) > On 22/02/2022 09:42 Eikås Arvid <arvid.eikas(a)telenor.no> wrote: > > > dovecot-2.3.5 and centos 7 > User and IP are logged in both scenarios. > auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch > auth-worker(13380): cache(user(a)online.no,1.1.1.1): Password mismatch > > > > > dovecot-2.3.17 and rhel 8 > Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker > (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): > Password mismatch (given password: xxxx) Feb 03 14:43:48 > auth-worker(1676266): Info: conn unix:auth-worker > (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given > password: xxxx) > > User and IP is not logged in cache lookup. > Is this a design change or a unplanned change? > > Any ide when it was changed? Looks more like 2.3.5 is incorrectly checking both cache and sql? Aki

1 0

Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 22 Feb '22

22 Feb '22

dovecot-2.3.5 and centos 7 User and IP are logged in both scenarios. auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch auth-worker(13380): cache(user(a)online.no,1.1.1.1<mailto:user@online.no,1.1.1.1>): Password mismatch dovecot-2.3.17 and rhel 8 Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): Password mismatch (given password: xxxx) Feb 03 14:43:48 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) User and IP is not logged in cache lookup. Is this a design change or a unplanned change? Any ide when it was changed?

2 1

/usr/libexec/dovecot/anvil crashes immediately
by Friedrich Kink 21 Feb '22

21 Feb '22

Dear list, I built a dovecot package for openindiana (which is a Solaris derivative) from latest version 2.3.18. Everything compiles and builds fine without any issue. Even subsequent installation and startup of main dovecot process works as expected. But execution of /usr/libexec/dovecot/anvil immediately crashes. To get some more meaningful backtrace I compiled with -g. Below some facts of my environment and a backtrace. Maybe some of you are more familiar with this kind of issue as I, and can give some hint or share ideas how to nail down the problem. Or can it be a configuration issue? BTW it is running in a so-called zone. And former versions, I don't know exactly but I believe up to 2.3.17, did not show this crash. gcc --version gcc (OpenIndiana 7.5.0-il-0) 7.5.0 Configure parameters: gcc_OPT = -g CONFIGURE_OPTIONS+= --sysconfdir=/etc \ --localstatedir=/var \ --with-gssapi=plugin \ --with-ldap=plugin \ --with-sql=plugin \ --with-lua=plugin \ --with-ssl=openssl \ --with-ioloop=poll \ --with-notify=none \ --with-sodium \ --with-mysql \ --with-pgsql \ --enable-static=no \ --without-systemd \ SSL_CFLAGS=-I/usr/openssl/1.1/include \ SSL_LIBS="-L/usr/openssl/1.1/lib/amd64 -lssl -lcrypto" \ LDFLAGS="-lldap_r" Backtrace: (gdb) bt full #0 0x00007fff5d2e6f2a in _lwp_kill () from /lib/64/libc.so.1 No symbol table info available. #1 0x00007fff5d2dd7f0 in thr_kill () from /lib/64/libc.so.1 No symbol table info available. #2 0x00007fff5d27ae7e in raise () from /lib/64/libc.so.1 No symbol table info available. #3 0x00007fff5d254ad8 in abort () from /lib/64/libc.so.1 No symbol table info available. #4 0x00007ffef05367c0 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:459 backtrace = 0x4178b8 "/usr/lib/amd64/dovecot/libdovecot.so.0.0.0'backtrace_append_libc+0x4c [0x7ffef0522042] -> /usr/lib/amd64/dovecot/libdovecot.so.0.0.0'backtrace_append+0x18 [0x7ffef05221c5] -> /usr/lib/amd64/dovecot/li"... recursed = 0 #5 0x00007ffef0536827 in fatal_handler_real (ctx=0x7fffbffff820, format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffbffff850) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:471 status = 0 #6 0x00007ffef0536871 in default_fatal_handler (ctx=0x7fffbffff820, format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffbffff850) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:479 No locals. #7 0x00007ffef0536aed in i_panic (format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)") at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:524 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0, log_prefix = 0x0, log_prefix_type_pos = 0} args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7fffbffff930, reg_save_area = 0x7fffbffff870}} #8 0x00007ffef056048b in io_loop_handle_add (io=0x42d7c0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop-poll.c:94 ctx = 0x423180 condition = IO_READ old_count = 3221223792 index = 0 old_events = 59 fd = 4 __func__ = "io_loop_handle_add" #9 0x00007ffef055c1ab in io_add_file (ioloop=0x423070, fd=4, condition=IO_READ, source_filename=0x7ffef05d9f48 "/usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c", source_linenum=192, callback=0x7ffef05698f4 <signal_read>, context=0x0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop.c:72 io = 0x42d7c0 __func__ = "io_add_file" #10 0x00007ffef055c27a in io_add_to (ioloop=0x423070, fd=4, condition=IO_READ, source_filename=0x7ffef05d9f48 "/usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c", source_linenum=192, callback=0x7ffef05698f4 <signal_read>, context=0x0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop.c:94 io = 0x7ffef0609aa0 <static_system_pool> __func__ = "io_add_to" #11 0x00007ffef0569289 in lib_signals_init_io (l=0x420a00) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:192 __func__ = "lib_signals_init_io" #12 0x00007ffef056933c in lib_signals_ioloop_ref (ioloop=0x423070) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:205 l = 0x420a00 #13 0x00007ffef0569507 in signal_handler_switch_ioloop (h=0x4209c0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:232 No locals. #14 0x00007ffef056a10a in lib_signals_set_handler (signo=2, flags=LIBSIG_FLAG_DELAYED, handler=0x7ffef0475e74 <sig_die>, context=0x422f20) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:520 h = 0x4209c0 __func__ = "lib_signals_set_handler" #15 0x00007ffef0477596 in master_service_init_finish (service=0x422f20) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib-master/master-service.c:668 sigint_flags = LIBSIG_FLAG_DELAYED st = {st_dev = 79, st_ino = 4209307, st_mode = 1, st_nlink = 79, st_uid = 4218704, st_gid = 0, st_rdev = 17179869185, st_size = 4337776, st_atim = {tv_sec = 140736414612384, tv_nsec = 1}, st_mtim = {tv_sec = 0, tv_nsec = 8388608}, st_ctim = {tv_sec = 0, tv_nsec = 0}, st_blksize = 4378928, st_blocks = 255, st_fstype = " /B\000\000\000\000\000 /B\000\000\000\000"} __func__ = "master_service_init_finish" #16 0x0000000000403cce in main (argc=1, argv=0x7fffbffffc38) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/anvil/main.c:80 service_flags = (MASTER_SERVICE_FLAG_UPDATE_PROCTITLE | MASTER_SERVICE_FLAG_DONT_SEND_STATS) error = 0x7fffbffffc10 " \374\377\277\377\177" Thanks a lot for any help, Fritz

2 1