- dovecot - dovecot.org

Migration from one server to 2 new servers
by Kishore Potnuru 28 Jul '20

28 Jul '20

Hi I am in the process/planning of moving from my existing dovecot imap/pop3 server to 2 new servers (for HA/Resilience). I will be implementing dovecot replication on new servers. Please find my current and new servers versions. My Current Production Server details: ======================== Linux OS - Red Hat Enterprise Linux Server release 6.5 (Santiago) Dovecot version - 2.0.9 Postfix version - 2.6.6 ======================== New Servers: ========================== Linux OS - Red Hat Enterprise Linux Server release 7.7 (Maipo) Dovecot version - 2.2.36 (1f10bfa63) Postfix version - 2.10.1 ========================== What is the best way to stop/copy/migrate the current production data to the new servers? I am planning the following steps. Not sure if it is correct or not. 1. Stop the Postfix services on the old server and wait for few mins. So that no new emails will be coming to the old servers. Existing emails will be delivered to the receipients. 2. copy/migrate the data from old server to new servers. Please suggest what is the best way? 3. I see that dovecot version(2.0.9) in old production server, I do not know the which is the best option? see the options in the current version. ================================= [root@prodcution ~]# doveadm usage: doveadm [-Dv] [-f <formatter>] <command> [<args>] altmove [-u <user>|-A] [-S <socket_path>] <search query> auth [-a <auth socket path>] [-x <auth info>] <user> [<password>] config [doveconf parameters] director add|flush|map|remove|status dump [-t <type>] <path> expunge [-u <user>|-A] [-S <socket_path>] <search query> fetch [-u <user>|-A] [-S <socket_path>] <fields> <search query> force-resync [-u <user>|-A] [-S <socket_path>] <mailbox> help <cmd> import [-u <user>|-A] [-S <socket_path>] <source mail location> <dest parent mailbox> <search query> kick [-a <anvil socket path>] [-f] <user mask>[|]<ip/bits> log find|reopen|test mailbox create|delete|list|mutf7|rename|status|subscribe|unsubscribe penalty [-a <anvil socket path>] [<ip/bits>] purge [-u <user>|-A] [-S <socket_path>] pw [-l] [-p plaintext] [-r rounds] [-s scheme] [-u user] [-V] reload search [-u <user>|-A] [-S <socket_path>] <search query> sis deduplicate|find stop user [-a <userdb socket path>] [-x <auth info>] <user mask> [...] ================================= Please suggest me. Thanks, Kishore Potnuru

5 24

dsync fails for existing user: "Error: Failed to initialize user: Namespace '': Mailbox list driver imapc: missing imapc_password" ?
by PGNet Dev 27 Jul '20

27 Jul '20

i'm attempting to dsync from a remote/other IMAP store to my current/new dovecot instance testing remote's IMAP access from the local/dovecot box, i can successfully login openssl s_client \ -crlf \ -4 \ -showcerts \ -bind 10.0.1.10 \ -connect remote-imap.example.com:993 \ -cert /sec/vmail/client.EC.crt.pem \ -key /sec/vmail/client.EC.key.pem \ -CAfile /sec/vmail/CA.crt.pem a1 login "testuser(a)example.net" "my!secret" a1 OK [CAPABILITY IMAP4rev1 ACL BINARY CATENATE CHILDREN CONDSTORE ENABLE ESEARCH ESORT I18NLEVEL=1 ID IDLE LIST-EXTENDED LIST-STATUS LITERAL+ LOGIN-REFERRALS MULTIAPPEND NAMESPACE QRESYNC QUOTA RIGHTS=ektx SASL-IR SEARCHRES SORT THREAD=ORDEREDSUBJECT UIDPLUS UNSELECT WITHIN XLIST] LOGIN completed atm, my dovecot config includes the following, matching the ssl config above, ssl_client_ca_file = /sec/vmail/CA.crt.pem ssl_client_require_valid_cert = yes ssl_client_cert = < /sec/vmail/client.EC.crt.pem ssl_client_key = < /sec/vmail/client.EC.key.pem protocol doveadm { mail_plugins = virtual } imapc_host = remote-imap.example.com imapc_features = rfc822.size imapc_features = $imapc_features fetch-headers mail_prefetch_count = 20 imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no dsync_features = empty-header-workaround dsync_commit_msgs_interval = 100 # default in v2.2.30+ dsync_hashed_headers = Date Message-ID and grep users.conf /etc/dovecot/conf.d/* /etc/dovecot/conf.d/10-auth.conf: args = scheme=ARGON2ID /etc/dovecot/sec/users.conf _USER="testuser(a)example.net" _PASS="my!secret" _PASS_ENC=$( doveadm pw -s ARGON2ID -p ${_PASS} ) echo "${_USER}:${_PASS_ENC}::::" >> /etc/dovecot/sec/users.conf grep testuser(a)example.net /etc/dovecot/sec/users.conf testuser@example.net:{ARGON2ID}$argon2id$v=19$m=65536,t=3,p=1$...qY:::: on exec doveadm -D -o mail_fsync=never backup -R -u "testuser(a)example.net" imapc: returns/fails, Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib20_virtual_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(testuser(a)example.net)<>: Debug: auth-master: userdb lookup(testuser(a)example.net): Started userdb lookup doveadm(testuser(a)example.net)<>: Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Connecting doveadm(testuser(a)example.net)<>: Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=10517,uid=0): Client connected (fd=10) doveadm(testuser(a)example.net)<>: Debug: auth-master: userdb lookup(testuser(a)example.net): auth USER input: testuser(a)example.net uid=5000 gid=5000 home=/data/vmail/example.net/testuser/Maildir doveadm(testuser(a)example.net)<>: Debug: auth-master: userdb lookup(testuser(a)example.net): Finished userdb lookup (username=testuser(a)example.net uid=5000 gid=5000 home=/data/vmail/example.net/testuser/Maildir) doveadm(testuser(a)example.net): Debug: Effective uid=5000, gid=5000, home=/data/vmail/example.net/testuser/Maildir doveadm(testuser(a)example.net): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/data/vmail/example.net/testuser/Maildir:CONTROL=/data/vma… doveadm(testuser(a)example.net): Debug: fs: root=/data/vmail/example.net/testuser/Maildir, index=/var/vmail-index/example.net/testuser, indexpvt=, control=/data/vmail/example.net/testuser/_control, inbox=/data/vmail/example.net/testuser/Maildir, alt= doveadm(testuser(a)example.net): Debug: Namespace shared: type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/data/vmail/example.net/testuser/Maildir:INDEXPVT=/var/vma… doveadm(testuser(a)example.net): Debug: shared: root=/run/dovecot/, index=, indexpvt=, control=, inbox=, alt= doveadm(testuser(a)example.net): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/data/vmail/virtual:INDEX=MEMORY doveadm(testuser(a)example.net): Debug: fs: root=/data/vmail/virtual, index=, indexpvt=, control=, inbox=, alt= doveadm(testuser(a)example.net): Debug: brain M: Namespace has location maildir:/data/vmail/example.net/testuser/Maildir:CONTROL=/data/vmail/exampl… doveadm(testuser(a)example.net): Debug: Namespace : Using permissions from /data/vmail/example.net/testuser/Maildir: mode=0700 gid=default dsync(testuser(a)example.net): Debug: Effective uid=5000, gid=5000, home=/data/vmail/example.net/testuser/Maildir dsync(testuser(a)example.net): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(testuser(a)example.net): Error: Failed to initialize user: Namespace '': Mailbox list driver imapc: missing imapc_password dsync(testuser(a)example.net): Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=10517,uid=0): Disconnected: Connection closed (fd=10) what needs to change in this^ config so that 'dsync' successfully gets/uses the "missing imapc_password" from the existing users.conf file?

2 2

Crash during "doveadm import"
by Ralf Hildebrandt 27 Jul '20

27 Jul '20

Today I was looking for some spam and issued this command: ========================================================== doveadm import -u restore(a)backup.invalid mdbox:/home/copymail2/mdbox INBOX header Reply-To bixrs.com Then I immediately got a crash: doveadm(restore(a)backup.invalid): Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) doveadm(restore(a)backup.invalid): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f757c0edf32] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f757c0ee04e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe692e) [0x7f757c0f892e] -> /usr/lib/dovecot/libdovecot.so.0(+0xe6971) [0x7f757c0f8971] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f757c05321b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x70)[0x7f757c4a43c0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b)[0x7f757c48cf4b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449)[0x7f757c46f5f9] -> /usr/lib/dovecot/libdovecot.so.0(+0xbf2c3) [0x7f757c0d12c3] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x74)[0x7f757c105c94] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x29) [0x7f757c105fc9]-> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f757c10693d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68) [0x7f757c0d79c8] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x4f) [0x7f757c0d839f] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xc9741) [0x7f757c479741] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xca9f4) [0x7f757c47a9f4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x10d)[0x7f757c47b1cd] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x22)[0x7f757c3fd6e2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d)[0x7f757c3fd74d] -> doveadm(+0x31a33) [0x559bc9c63a33] -> doveadm(+0x2c518) [0x559bc9c5e518] -> doveadm(+0x2d256) [0x559bc9c5f256] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x559bc9c600ce]-> doveadm(doveadm_cmd_run_ver2+0x548) [0x559bc9c70fa8] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x559bc9c70ff7] -> doveadm(main+0x1d1) [0x559bc9c4e641] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f757b653b97] -> doveadm(_start+0x2a) [0x559bc9c4eb3a] Command terminated by signal 6 Running it in gdb gives me: # gdb doveadm (gdb) set args import -u restore(a)backup.invalid mdbox:/home/copymail2/mdbox mailbox INBOX header Reply-To bixrs.com (gdb) run Starting program: /usr/bin/doveadm import -u restore(a)backup.invalid mdbox:/home/copymail2/mdbox INBOX header Reply-To bixrs.com (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007ffff68ec8b1 in __GI_abort () at abort.c:79 #2 0x00007ffff73728e1 in default_fatal_finish (status=0, type=LOG_TYPE_PANIC) at failures.c:459 #3 fatal_handler_real (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:471 #4 0x00007ffff7372971 in default_fatal_handler (ctx=<optimized out>, format=<optimized out>, args=<optimized out>) at failures.c:479 #5 0x00007ffff72cd21b in i_panic (format=format@entry=0x7ffff772dd60 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:523 #6 0x00007ffff771e3c0 in mail_index_uint32_to_offset (offset=<optimized out>) at mail-index-util.c:10 #7 0x00007ffff7706f4b in mail_cache_header_fields_write (ctx=0x55555585b690, buffer=<optimized out>, buffer=<optimized out>) at mail-cache-transaction.c:609 #8 mail_cache_header_add_field (field_idx=15, ctx=0x55555585b690) at mail-cache-transaction.c:690 #9 mail_cache_add (ctx=0x55555585b690, seq=1, field_idx=field_idx@entry=15, data=0x7ffff773b736, data_size=0) at mail-cache-transaction.c:739 #10 0x00007ffff76ebc34 in index_mail_cache_add_idx (mail=mail@entry=0x55555586e8d8, field_idx=field_idx@entry=15, data=data@entry=0x7ffff773b736, data_size=data_size@entry=0) at index-mail.c:631 #11 0x00007ffff76e95f9 in index_mail_parse_header_finish (mail=<optimized out>) at index-mail-headers.c:132 #12 index_mail_parse_header (part=<optimized out>, hdr=<optimized out>, mail=<optimized out>) at index-mail-headers.c:313 #13 0x00007ffff734b2c3 in read_header (mstream=0x555555879530) at istream-header-filter.c:356 #14 i_stream_header_filter_read (stream=0x555555879530) at istream-header-filter.c:446 #15 0x00007ffff737fc94 in i_stream_read_memarea (stream=stream@entry=0x5555558795b0) at istream.c:313 #16 0x00007ffff737ffc9 in i_stream_read (stream=stream@entry=0x5555558795b0) at istream.c:271 #17 0x00007ffff738093d in i_stream_read_data (stream=0x5555558795b0, data_r=data_r@entry=0x7fffffffdc18, size_r=size_r@entry=0x7fffffffdc20, threshold=threshold@entry=1) at istream.c:745 #18 0x00007ffff73519c8 in i_stream_read_bytes (wanted=2, size_r=0x7fffffffdc20, data_r=0x7fffffffdc18, stream=<optimized out>) at ../../src/lib/istream.h:217 #19 message_parse_header_next (ctx=0x55555582e580, hdr_r=hdr_r@entry=0x7fffffffdc80) at message-header-parser.c:85 #20 0x00007ffff735239f in message_parse_header (input=<optimized out>, hdr_size=hdr_size@entry=0x0, flags=flags@entry=MESSAGE_HEADER_PARSER_FLAG_CLEAN_ONELINE, callback=callback@entry=0x7ffff76f2cb0 <search_header>, context=context@entry=0x7fffffffdcf0) at message-header-parser.c:392 #21 0x00007ffff76f3741 in search_arg_match_text (ctx=0x55555585bad0, args=0x5555558216d0) at index-search.c:759 #22 search_match_once (ctx=0x55555585bad0) at index-search.c:1398 #23 0x00007ffff76f49f4 in search_match_next (ctx=0x55555585bad0) at index-search.c:1505 #24 search_more_with_mail (mail=<optimized out>, ctx=0x55555585bad0) at index-search.c:1621 #25 search_more_with_prefetching (mail_r=<optimized out>, ctx=<optimized out>) at index-search.c:1703 #26 search_more (ctx=ctx@entry=0x55555585bad0, mail_r=mail_r@entry=0x7fffffffde20) at index-search.c:1777 #27 0x00007ffff76f51cd in index_storage_search_next_nonblock (_ctx=0x55555585bad0, mail_r=0x7fffffffdef0, tryagain_r=0x7fffffffde87) at index-search.c:1805 #28 0x00007ffff76776e2 in mailbox_search_next_nonblock (ctx=0x55555585bad0, mail_r=0x7fffffffdef0, tryagain_r=<optimized out>) at mail-storage.c:2307 #29 0x00007ffff767774d in mailbox_search_next (ctx=0x55555585bad0, mail_r=mail_r@entry=0x7fffffffdef0) at mail-storage.c:2292 #30 0x0000555555586c02 in doveadm_mail_iter_next (iter=<optimized out>, mail_r=mail_r@entry=0x7fffffffdef0) at doveadm-mail-iter.c:161 #31 0x0000555555585a33 in cmd_import_box (search_args=<optimized out>, info=0x55555584f820, dest_user=<optimized out>, ctx=0x55555581fda8) at doveadm-mail-import.c:143 #32 cmd_import_run (_ctx=0x55555581fda8, user=0x5555558374a8) at doveadm-mail-import.c:203 #33 0x0000555555580518 in doveadm_mail_next_user (ctx=ctx@entry=0x55555581fda8, error_r=error_r@entry=0x7fffffffe0d0) at doveadm-mail.c:462 #34 0x000055555558116e in doveadm_mail_single_user (ctx=ctx@entry=0x55555581fda8, error_r=error_r@entry=0x7fffffffe0d0) at doveadm-mail.c:492 #35 0x0000555555581256 in doveadm_mail_cmd_exec (ctx=ctx@entry=0x55555581fda8, wildcard_user=wildcard_user@entry=0x0) at doveadm-mail.c:653 #36 0x00005555555820ce in doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=<optimized out>) at doveadm-mail.c:1149 #37 0x0000555555592fa8 in doveadm_cmd_run_ver2 (argc=8, argv=0x5555557f6bb8, cctx=cctx@entry=0x7fffffffe2c0) at doveadm-cmd.c:575 #38 0x0000555555592ff7 in doveadm_cmd_try_run_ver2 (cmd_name=<optimized out>, argc=<optimized out>, argv=<optimized out>, cctx=0x7fffffffe2c0) at doveadm-cmd.c:497 #39 0x0000555555570641 in main (argc=<optimized out>, argv=<optimized out>) at doveadm.c:395 -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

1 2

Problem with change file format in maildir
by turix13＠gmail.com 27 Jul '20

27 Jul '20

hi, i have a problem with a dovecot 2.2.36 (1f10bfa63) server, using maildir, some mails change the file format, the flag is modified and they appear again in the inbox as unread. ex. 1548753605.56008.server-mail,S=5935:2 (origin) 1548~RZ!.ESS:2 (modified) Could someone give me some light? thx. br. -- Sent from: http://dovecot.2317879.n4.nabble.com/

1 0

Multiple authentication instances (GSSAPI _or_ Client Certificate)
by Joakim Ekblad 27 Jul '20

27 Jul '20

Hi there, I am trying to make a paranoid IMAPS/Submission server. I'm running Ubuntu 20.04 with Dovecot 2.3.7.2 (3c910f64b). I mostly use my mail-server from the LAN/Realm where I have GSSAPI working well for both IMAPS and Submission and most other services But... I would like to be able to configure Dovecot to require mobile ("external") devices to authenticate using client certificates (with different SSL cert superset) instead of 'plain' fallback (if there is no valid Kerberos token/infrastructure). I have one SSL-certificate for the LAN-solution, but would like to have my self-signed PKI-stuff for the other solution where client certificates are used to authenticate. So. First of all. Is this a possible scenario? I'm struggling with the configuration and it seems Dovecot-configs are not accepting different authentication methods for different local listeners for different IPs etc. The only way i can think of getting this up and running is having two separate Dovecot instances (somehow) listening to different ports or even on different server hosts. What would be neat is if it would be possible to have like: auth_mechanisms = gssapi ssl :D But i know that's not how things work. I hope I'm not too unspecific. Is there any other clever ideas on how to get this use-case configured with the current version of Dovecot? I am thinking i _might_ be able to do something with stunnel to terminate the PKI authentication and still require normal plain user authentication with login/pass to get the extra security. But it does not feel clean enough. All good ideas are welcome! Stay safe! Kind regards, Joakim Ekblad

1 0

To field was not correct indexed by FTS
by TACHIBANA Masashi 27 Jul '20

27 Jul '20

Hi, This To field was not correct indexed by FTS. To: Yamada Taro <yamada(a)example.com>,=?UTF-8?B?dXNlcjJAZXhhbXBsZS5jb20=?= <user2(a)example.com>, =?UTF-8?B?dXNlcjNAZXhhbXBsZS5jb20=?= <user3(a)example.com>, user4 desu <user4(a)example.com> --> Yamada Taro <yamada(a)example.com> , user2(a)example.com And follow was correct indexed by FTS To: Yamada Taro <yamada(a)example.com>,"user2(a)example.com" <user2(a)example.com>, "user3(a)example.com" <user3(a)example.com>, user4 desu <user4(a)example.com> --> Yamada Taro <yamada(a)example.com> , user2(a)example.com <user2(a)example.com> , user3(a)example.com <user3(a)example.com> , user4 desu <user4(a)example.com> Any hint? -- TACHIBANA Masashi QUALITIA CO., LTD. mailto:tachibana@qualitia.co.jp 株式会社クオリティア https://www.qualitia.co.jp/

2 6

Dovecot serving incorrect certificate
by Antonio Leding 26 Jul '20

26 Jul '20

Hello all, I have a Dovecot (v2.3.10.1) + Postfix (v3.5.3) both cfg; d to use TLS however each using different certificates. In addition, I have cfg’d a DNS CNAME that points to the server A record. For example, mail.example.com (A) —> 1.2.3.4 alias.example.con (CNAME) —> mail.example.com When setting up a new account in Apple Mail, if I specify the server name as the “Host Name” (i.e. mil server), the cert that is cfg’d in Dovecot is received and everything works fine. However, if I instead use the alias CNAME as the “Host Name”, then the cert for Postfix is sent to the client. This causes issues because I do not have the CNAME in the SAN of the Postfix certificate. I doubt this is a bug because I have to think others have employed a similar configuration so I must be missing something here — any thoughts? Thanks in advance...

2 4

(re-) dsync: INBOX Can't be deleted
by PGNet Dev 24 Jul '20

24 Jul '20

with dovecot --version 2.3.10.1 (a3d0e1171) exec of doveadm -v -o mail_fsync=never backup -R -f -u testuser(a)example.com imapc: currently fails, here, with Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted checking lists, this has been seen before @ https://dovecot.org/pipermail/dovecot/2016-January/102988.html On 24 Jan 2016, at 18:47, Timo Sirainen <tss at iki.fi> wrote: > During Migration with dsync I get these Errors: > Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted > Is there a way to work around these Errors ? With "doveadm backup" you have gotten into such a state that the INBOX needs to be deleted and recreated to preserve it exactly as it's in source. But you're using Maildir format, which doesn't allow deleting INBOX. So possibilities: a) Don't use Maildir format b) Delete the entire Maildir manually with rm -rf and the next doveadm backup should work (if not then something strange is going on) per "b)", i explicitly 'rm' the Maildir rm -rf /data/vmail/example.com/testuser/Maildir tree /data/vmail/example.com/testuser/Maildir /data/vmail/example.com/testuser/Maildir [error opening dir] on re-exec, the backup still fails dsync(testuser(a)example.com): Info: imapc(mx.example.com:993): Connected to 10.1.0.20:993 (local 10.1.0.114:42926) dsync(testuser(a)example.com): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. where tree /data/vmail/example.com/testuser/Maildir /data/vmail/example.com/testuser/Maildir ├── cur ├── new ├── sieve │ └── tmp └── tmp and log detail, Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib20_virtual_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(testuser(a)example.com)<>: Debug: auth-master: userdb lookup(testuser(a)example.com): Started userdb lookup doveadm(testuser(a)example.com)<>: Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Connecting doveadm(testuser(a)example.com)<>: Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=25419,uid=0): Client connected (fd=10) doveadm(testuser(a)example.com)<>: Debug: auth-master: userdb lookup(testuser(a)example.com): auth USER input: testuser(a)example.com uid=5000 gid=5000 home=/data/vmail/example.com/testuser/Maildir doveadm(testuser(a)example.com)<>: Debug: auth-master: userdb lookup(testuser(a)example.com): Finished userdb lookup (username=testuser(a)example.com uid=5000 gid=5000 home=/data/vmail/example.com/testuser/Maildir) doveadm(testuser(a)example.com): Debug: Effective uid=5000, gid=5000, home=/data/vmail/example.com/testuser/Maildir doveadm(testuser(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/data/vmail/example.com/testuser/Maildir:CONTROL=/data/vma… doveadm(testuser(a)example.com): Debug: fs: root=/data/vmail/example.com/testuser/Maildir, index=/var/vmail-index/example.com/testuser, indexpvt=, control=/data/vmail/example.com/testuser/_control, inbox=/data/vmail/example.com/testuser/Maildir, alt= doveadm(testuser(a)example.com): Debug: Namespace shared: type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/data/vmail/example.com/testuser/Maildir:INDEXPVT=/var/vma… doveadm(testuser(a)example.com): Debug: shared: root=/run/dovecot/, index=, indexpvt=, control=, inbox=, alt= doveadm(testuser(a)example.com): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/data/vmail/virtual:INDEX=MEMORY doveadm(testuser(a)example.com): Debug: fs: root=/data/vmail/virtual, index=, indexpvt=, control=, inbox=, alt= doveadm(testuser(a)example.com): Debug: brain M: Namespace has location maildir:/data/vmail/example.com/testuser/Maildir:CONTROL=/data/vmail/exampl… doveadm(testuser(a)example.com): Debug: Namespace : Using permissions from /data/vmail/example.com/testuser/Maildir: mode=0700 gid=default dsync(testuser(a)example.com): Debug: Effective uid=5000, gid=5000, home=/data/vmail/example.com/testuser/Maildir dsync(testuser(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Created new connection dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Looking up IP address (reconnect_ok=true, last_connect=1595599741) dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Connecting to 10.1.0.20:993 dsync(testuser(a)example.com): Info: imapc(mx.example.com:993): Connected to 10.1.0.20:993 (local 10.1.0.114:42924) dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Starting SSL handshake dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): SSL handshake successful dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Server capabilities: IMAP4rev1 AUTH=PLAIN ACL BINARY CATENATE CHILDREN CONDSTORE ENABLE ESEARCH ESORT I18NLEVEL=1 ID IDLE LIST-EXTENDED LIST-STATUS LITERAL+ LOGIN-REFERRALS MULTIAPPEND NAMESPACE QRESYNC QUOTA RIGHTS=ektx SASL-IR SEARCHRES SORT THREAD=ORDEREDSUBJECT UIDPLUS UNSELECT WITHIN XLIST dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Authenticating as testuser(a)example.com dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Server capabilities: IMAP4rev1 ACL BINARY CATENATE CHILDREN CONDSTORE ENABLE ESEARCH ESORT I18NLEVEL=1 ID IDLE LIST-EXTENDED LIST-STATUS LITERAL+ LOGIN-REFERRALS MULTIAPPEND NAMESPACE QRESYNC QUOTA RIGHTS=ektx SASL-IR SEARCHRES SORT THREAD=ORDEREDSUBJECT UIDPLUS UNSELECT WITHIN XLIST dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Authenticated successfully dsync(testuser(a)example.com): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= dsync(testuser(a)example.com): Debug: Namespace shared: type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/data/vmail/example.com/testuser/Maildir:INDEXPVT=/var/vma… dsync(testuser(a)example.com): Debug: shared: root=/run/dovecot/, index=, indexpvt=, control=, inbox=, alt= dsync(testuser(a)example.com): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/data/vmail/virtual:INDEX=MEMORY dsync(testuser(a)example.com): Debug: fs: root=/data/vmail/virtual, index=, indexpvt=, control=, inbox=, alt= dsync(testuser(a)example.com): Debug: brain S: Namespace has location imapc: dsync(testuser(a)example.com): Debug: brain M: Local mailbox tree: Sent guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=yes last_change=0 last_subs=1595535189 dsync(testuser(a)example.com): Debug: brain S: Local mailbox tree: Trash guid=7f5af7ba291b2df1a11d573bdb55d7e9 uid_validity=1 uid_next=89207 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Local mailbox tree: Drafts guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=yes last_change=0 last_subs=1595535189 dsync(testuser(a)example.com): Debug: brain S: Local mailbox tree: Templates guid=d9f092123a43acb205a6869342cf9dd6 uid_validity=126054 uid_next=22295 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Local mailbox tree: Trash guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=yes last_change=0 last_subs=1595534293 dsync(testuser(a)example.com): Debug: brain S: Local mailbox tree: Sent guid=bfb2e03fdce327671e82bf173b1ccb8b uid_validity=1 uid_next=89068 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Local mailbox tree: INBOX guid=6f51443ad5eb195f9f4400005439fba4 uid_validity=1595534294 uid_next=1 subs=no last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Local mailbox tree: Junk guid=6e51443ad5eb195f9f4400005439fba4 uid_validity=1595534293 uid_next=1 subs=yes last_change=0 last_subs=1595534293 dsync(testuser(a)example.com): Debug: brain S: Local mailbox tree: Junk guid=87680557f26fcb26843f739f7427e8c4 uid_validity=1 uid_next=88649 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain S: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1 uid_next=89209 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Remote mailbox tree: Trash guid=7f5af7ba291b2df1a11d573bdb55d7e9 uid_validity=1 uid_next=89207 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Remote mailbox tree: Templates guid=d9f092123a43acb205a6869342cf9dd6 uid_validity=126054 uid_next=22295 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Remote mailbox tree: Sent guid=bfb2e03fdce327671e82bf173b1ccb8b uid_validity=1 uid_next=89068 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Remote mailbox tree: Junk guid=87680557f26fcb26843f739f7427e8c4 uid_validity=1 uid_next=88649 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1 uid_next=89209 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain S: Local mailbox tree: Drafts guid=e0187b65e763143666d22094cedfe6a4 uid_validity=1 uid_next=88914 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Remote mailbox tree: Drafts guid=e0187b65e763143666d22094cedfe6a4 uid_validity=1 uid_next=88914 subs=yes last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain M: Mailbox Drafts: local=00000000000000000000000000000000/0/2, remote=e0187b65e763143666d22094cedfe6a4/0/1: mailbox not selectable yet dsync(testuser(a)example.com): Debug: brain M: Mailbox INBOX: local=6f51443ad5eb195f9f4400005439fba4/0/1, remote=c92f64f79f0d1ed01e6d5b314f04886c/0/1: GUIDs conflict - will be merged later dsync(testuser(a)example.com): Debug: brain M: Mailbox Junk: local=6e51443ad5eb195f9f4400005439fba4/0/1, remote=87680557f26fcb26843f739f7427e8c4/0/1: GUIDs conflict - will be merged later dsync(testuser(a)example.com): Debug: brain M: Mailbox Sent: local=00000000000000000000000000000000/0/0, remote=bfb2e03fdce327671e82bf173b1ccb8b/0/1: mailbox not selectable yet dsync(testuser(a)example.com): Debug: brain M: Mailbox Templates: local=00000000000000000000000000000000/0/0, remote=d9f092123a43acb205a6869342cf9dd6/0/1: mailbox not selectable yet dsync(testuser(a)example.com): Debug: brain M: Mailbox Trash: local=00000000000000000000000000000000/0/0, remote=7f5af7ba291b2df1a11d573bdb55d7e9/0/1: mailbox not selectable yet dsync(testuser(a)example.com): Debug: brain M: Deleting mailbox 'INBOX' (GUID 6f51443ad5eb195f9f4400005439fba4): UIDVALIDITY changed (1 -> 1595534294) dsync(testuser(a)example.com): Debug: brain M: Deleting mailbox 'Junk' (GUID 6e51443ad5eb195f9f4400005439fba4): UIDVALIDITY changed (1 -> 1595534293) dsync(testuser(a)example.com): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. dsync(testuser(a)example.com): Debug: brain S: Remote mailbox tree: Sent guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=yes last_change=0 last_subs=1595535189 dsync(testuser(a)example.com): Debug: brain S: Remote mailbox tree: Drafts guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=yes last_change=0 last_subs=1595535189 dsync(testuser(a)example.com): Debug: brain S: Remote mailbox tree: Trash guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=yes last_change=0 last_subs=1595534293 dsync(testuser(a)example.com): Debug: brain S: Remote mailbox tree: INBOX guid=6f51443ad5eb195f9f4400005439fba4 uid_validity=1595534294 uid_next=1 subs=no last_change=0 last_subs=0 dsync(testuser(a)example.com): Debug: brain S: Remote mailbox tree: Junk guid=6e51443ad5eb195f9f4400005439fba4 uid_validity=1595534293 uid_next=1 subs=yes last_change=0 last_subs=1595534293 dsync(testuser(a)example.com): Debug: imapc(mx.example.com:993): Disconnected dsync(testuser(a)example.com): Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=25419,uid=0): Disconnected: Connection closed (fd=10) given the error again on "next doveadm backup", it indeed appears "something strange is going on" ... hints/suggestions as to what?

1 1

Mailbox sharing, user to user in same domain, OK! User to user sharing in separate domains, problem. ( ... and more oh boy!)
by Andreas T (DC) 22 Jul '20

22 Jul '20

Dovecot -n and version present at the bottom of the email for legibility. System is a Debian 10 + Virtualmin hosting setup for my domains ------------------------------------------------------------------- Hello everyone, my first post. Sorry for the long and confusing post, I'm pretty new to dovecot other than basic functionality. I recently in the last week went through the documentation for both shared (user to user) and public mailboxes and got them both working. Took me a bit but eventually I figured it out, but I am still encountering some stubborn scenarios. I am having some issues with 2 types of sharing. ( I believe problem A + B are related as the error is similarly permission based error) For inconsistencies in the user account names, user(a)domain.com vs user-domain.com please see issue C, which my workaround is functional. A.) Sharing user to user between in the same domain works fine. Sharing user to user in different domains gives me some permission errors. Permissions have been granted (to (using Linux ACL for more fine grained permissions) as far as I can tell. Trying to share the info "INBOX" (fullshare, same issue for single boxes as well) from the info(a)primarydomain.com to user(a)externaldomain.com from info(a)primarydomain.com Mailder cat dovecot-acl user=user-externaldomain.com akxeilprwts getfacl dovecot-acl # file: dovecot-acl # owner: info(a)primarydomain.com # group: primarydomain.com user::rw- user:user@externaldomain.com:rwx #effective:rw- user:info@primarydomain.com:rwx #effective:rw- group::--- mask::rw- other::--- doveadm acl debug -u user-externaldomain.com "@/info@primarydomain.com/INBOX" doveadm(user-externaldomain.com): Error: stat(/home/primarydomain.com/homes/info/Maildir/tmp) failed: Permission denied (euid=1121(user(a)externaldomain.com) egid=1091(holanow.com) missing +x perm: /home/primarydomain.com, we're not in group 1092(primarydomain.com), dir owned by 1126:1092 mode=0750) doveadm(user-externaldomain.com): Error: Can't open mailbox @/info@primarydomain.com/INBOX: stat(/home/primarydomain.com/homes/info/Maildir/tmp) failed: Permission denied (euid=1121(user(a)externaldomain.com) egid=1091(holanow.com) missing +x perm: /home/primarydomain.com, we're not in group 1092(primarydomain.com), dir owned by 1126:1092 mode=0750) getfacl /home/primarydomain.com/homes/info/Maildir/tmp # file: home/primarydomain.com/homes/info/Maildir/tmp # owner: info(a)primarydomain.com # group: primarydomain.com user::rwx user:user@externaldomain.com:rwx user:info@primarydomain.com:rwx group::--- mask::rwx other::--- default:user::rwx default:user:user@externaldomain.com:rwx default:user:info@primarydomain.com:rwx default:group::--- default:mask::rwx default:other::--- getfacl /home/primarydomain.com/homes/info/Maildir # file: home/primarydomain.com/homes/info/Maildir/ # owner: info(a)primarydomain.com # group: primarydomain.com user::rwx user:user@externaldomain.com:rwx user:info@primarydomain.com:rwx group::--- mask::rwx other::--- default:user::rwx default:user:user@externaldomain.com:rwx default:user:info@primarydomain.com:rwx default:group::--- default:mask::rwx default:other::--- B.) Public mailbox, mailboxes that are physically present on the public mail dir, work fine. Public boxes which are symlinks to mailboxes to other users, with correct permission and ACL, always give me permission errors and do not show up publicly. These type of mailboxes do show up if the person already has user to user share setup with those boxes, which due to problem A, means only within the same domain. Similar errors as to the A scenario, even if giving complete rwx access to all (user/group/other) I still get permission denied issues. It just feel like dovecot isn't even trying to access the files C. Tiny "other" problem I have worked around already. dovecot-acl when using users via their user(a)domain.com account doesn't lookup the user correctly. I already have set, auth_username_translation = @- which works for when users login but it doesn't seem to work with dovecot-acl files. I have helper account pointers replacing the @ with - and then the ACL file works fine. Would prefer acl files contain, user=user1(a)primarydomain.com akxeilprwts user=user2(a)primarydomain.com akxeilprwts But this works and is not a show stopper. user=user1-primarydomain.com akxeilprwts user=user2-primarydomain.com akxeilprwts -------------------------------------------- dovecot --version 2.3.4.1 (f79e8e7e4) # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 5.4.44-2-pve x86_64 Debian 10.4 # Hostname: vps1.abclution.com doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem auth_mechanisms = plain login auth_username_translation = @- mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = acl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } namespace public_ns1 { location = maildir:/home/.Public_Mailboxes:INDEX=~/Maildir/public_ns1:INDEXPVT=~/Maildir/public_ns1 prefix = Public/ separator = / subscriptions = no type = public } namespace shared_ns1 { list = yes location = maildir:%%h/Maildir:INDEX=~/Maildir/shared_ns1/%%u:INDEXPVT=~/Maildir/shared_ns1/%%u prefix = @/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile acl_anyone = allow acl_defaults_from_inbox = yes acl_shared_dict = file:%h/Maildir/shared-mailboxes } protocols = " imap pop3" service auth { unix_listener auth-userdb { mode = 0777 } } ssl_cert = </etc/dovecot/dovecot.cert.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = passwd } protocol imap { mail_plugins = acl imap_acl }

1 1

IMAP ALERT on reason/nologin
by Pedro Ribeiro 22 Jul '20

22 Jul '20

Hello everyone, Some dovecot versions (years!) ago. I've made a rather complicated SQL query that verified some conditions during the SQL passdb checking and returned the usual parameters or "nologin" field signalling some account problem and a text on the "reason" field that were shown to the user telling him the reason of being rejected the login. Common "reasons" are blocked accounts, suspected brute-force to the user account, historic problems from his IP address, etc. In the current versions I've found that despite the attributes being set by the SQL query, dovecot no longer seems to signal that to the client application and it ends with some generic "wrong password" causing a lot of confusion and user complains. I can't find any reference to that (nologin/reason) logic in the current Dovecot documentation. Is this feature deprecated/removed? Were that logic changed and documented elsewhere? regards! stay safe! Note: running Dovecot 2.3.10.1 -- Best regards, =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Pedro Ribeiro Politécnico de Lisboa, Serviços da Presidência Departamento de Sistemas de Informação e Comunicações Phone: +351 210 464 700 (general) / VoIP: 80100 Helpdesk: helpdesk(a)net.ipl.pt / https://www.net.ipl.pt =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

1 0