Hello
This is my setup:
- Old server: RHEL 7 x64, dovecot 2.3.13 from dovecot RPM repo
- New Server: RHEL 9 x64, dovecot-2.3.16-15.el9.x86_64 (rhel rpm)
I am migrating several thousand mailboxes with doveadm backup, >99% worked, but 3 of them fail:
doveadm(mbejdom)<KlUSFVAuEGnASxcAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox) doveadm(mportcal)<rFRoEw0zEGl+XBcAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox) doveadm(agalmun)<1l2fMZFoEWnoGhgAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox)
When I enable debug in doveadm backup this is what I get in one of them:
Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: Mailbox ELAICH: Recreated /buzones/indices_correo/18/c4/mportcal/mailboxes/ELAICH/dovecot.index (file_seq=3) because: .log read 20380..8244 > rewrite_min_log_bytes 8192 Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:21:00 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox) Nov 13 06:21:00 doveadm(304593): Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:21:00 doveadm(304593): Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:21:00 doveadm(304593): Debug: auth-master: conn unix:/var/run/dovecot//auth-userdb (pid=303177,uid=0): Disconnected: Connection closed (fd=9)
In the old server I get this log:
Nov 13 06:00:33 myserver dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 (backtrace_append+0x42) [0x7f51347cc4c2] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f51347cc5ce] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf262e) [0x7f51347d962e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf26d1) [0x7f51347d96d1] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x7f513472bea8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x114376) [0x7f51347fb376] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1143cb) [0x7f51347fb3cb] -> /usr/lib64/dovecot/libdovecot.so.0(buffer_create_dynamic+0x15) [0x7f51347cedc5] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eacc600] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eac13ac] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eac23e5] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eabf932] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eabff61] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263ead4b9f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f51347f1775] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12b) [0x7f51347f310b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x59) [0x7f51347f1879] -> /usr/lib64/dovecot/libdovecot.so.0 (io_loop_run+0x38) [0x7f51347f1ab8] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eaa2ceb] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eaa48c7] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eabbbc4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f51347f1775] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12b) [0x7f51347f310b] -> /usr/lib64/dovecot/libdovecot.so.0 (io_loop_handler_run+0x59) [0x7f51347f1879] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f51347f1ab8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f513475d493] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263ea94a3c] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f5134039555] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263ea94b02]
I have tried doveadm force-resync but still get the same error.
What can I do to troubleshoot what is happening? I attach doveconf -n output of the old server:
auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 2 mins auth_master_user_separator = * auth_worker_max_count = 5500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it imap_capability = +XLIST imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags imap_id_log = * imap_max_line_length = 92 k lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_attribute_dict = file:/indices_correo/%2.26Hn/%2.200Hn/%n/dovecot-attributes mail_fsync = never mail_gid = entrega mail_home = /buzones_primarios/%2.26Hn/%2.200Hn/%n/home_usuario mail_location = mdbox:/buzones_primarios/%2.26Hn/%2.200Hn/%n:ALT=/buzones_secundarios/%2.26Hn/%2.200Hn/%n:INDEX=/indices_correo/%2.26Hn/%2.200Hn/%n:ITERINDEX mail_log_prefix = "%s(%u)<%{session}>: " mail_max_userip_connections = 2500 mail_plugins = " zlib acl quota virtual" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox SPAM { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/deny deny = yes driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile lda_mailbox_autosubscribe = yes quota = dict:Cuota de usuario::file:/indices_correo/cuotas/%n quota_rule2 = Trash:storage=+10%% quota_warning = storage=90%% aviso_cuota 90 %u sieve = /buzones_primarios/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve sieve_dir = /buzones_primarios/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/ sieve_max_redirects = 20 zlib_save = gz zlib_save_level = 1 } pop3_no_flag_updates = yes protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 32000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service aviso_cuota { executable = script /usr/local/bin/quota-warning.sh unix_listener aviso_cuota { mode = 0666 } user = entrega } service config { process_min_avail = 4 } service doveadm { inet_listener { port = 12354 } } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull process_min_avail = 2 service_count = 0 vsz_limit = 1 G } service imap { executable = /usr/libexec/dovecot/imap process_limit = 8000 process_min_avail = 12 vsz_limit = 1 G } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 vsz_limit = 1 G } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 5000 process_min_avail = 2 service_count = 0 vsz_limit = 1 G } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 5000 } service stats { fifo_listener stats-mail { mode = 0600 user = entrega } } ssl_cert = </etc/pki/tls/certificado.pem ssl_cipher_list = ECDHE-RSA-AES128-SHA256:AES128-GCM-SHA256:RC4:HIGH:!MD5:!aNULL:!EDH ssl_min_protocol = TLSv1.2 userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } verbose_proctitle = yes protocol sieve { managesieve_implementation_string = dovecot managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 64 k } protocol lda { hostname = mydomain.tldr info_log_path = log_path = mail_fsync = optimized mail_plugins = sieve zlib quota virtual postmaster_address = me@mydomain.tldr syslog_facility = mail } protocol imap { imap_metadata = yes mail_plugins = zlib quota imap_quota virtual } protocol pop3 { mail_plugins = zlib quota virtual pop3_enable_last = yes pop3_uidl_format = %g }
Regards
Javier
Hello
This is my setup:
o Old server: RHEL 7 x64, dovecot 2.3.13 from dovecot RPM repo
o New Server: RHEL 9 x64, dovecot-2.3.16-15.el9.x86_64 (rhel rpm)
I am migrating several thousand mailboxes with doveadm backup, >99%worked, but 3 of them fail:
doveadm(mbejdom)<KlUSFVAuEGnASxcAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox) doveadm(mportcal)<rFRoEw0zEGl+XBcAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox) doveadm(agalmun)<1l2fMZFoEWnoGhgAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox)
When I enable debug in doveadm backup this is what I get in one of them:
Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: Mailbox ELAICH: Recreated /buzones/indices_correo/18/c4/mportcal/mailboxes/ELAICH/dovecot.index (file_seq=3) because: .log read 20380..8244 > rewrite_min_log_bytes 8192 Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:20:59 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:21:00 doveadm(mportcal)<mIcAIbtqFWnRpQQAVKmH5w>: Error: read(myserver) failed: EOF (last sent=mailbox, last recv=mailbox) Nov 13 06:21:00 doveadm(304593): Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:21:00 doveadm(304593): Debug: dict(file)<mportcal>: Waiting for dict to finish pending operations Nov 13 06:21:00 doveadm(304593): Debug: auth-master: conn unix:/var/run/dovecot//auth-userdb (pid=303177,uid=0): Disconnected: Connection closed (fd=9)
In the old server I get this log:
Nov 13 06:00:33 myserver dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 (backtrace_append+0x42) [0x7f51347cc4c2] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f51347cc5ce] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf262e) [0x7f51347d962e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf26d1) [0x7f51347d96d1] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x7f513472bea8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x114376) [0x7f51347fb376] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1143cb) [0x7f51347fb3cb] -> /usr/lib64/dovecot/libdovecot.so.0(buffer_create_dynamic+0x15) [0x7f51347cedc5] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eacc600] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eac13ac] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eac23e5] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eabf932] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eabff61] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263ead4b9f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f51347f1775] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12b) [0x7f51347f310b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x59) [0x7f51347f1879] -> /usr/lib64/dovecot/libdovecot.so.0 (io_loop_run+0x38) [0x7f51347f1ab8] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eaa2ceb] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eaa48c7] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263eabbbc4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f51347f1775] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12b) [0x7f51347f310b] -> /usr/lib64/dovecot/libdovecot.so.0 (io_loop_handler_run+0x59) [0x7f51347f1879] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f51347f1ab8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f513475d493] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263ea94a3c] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f5134039555] -> dovecot/doveadm-server 192.168.10.62 mportcal slave_recv_mailbox [0x56263ea94b02]
I have tried doveadm force-resync but still get the same error.
What can I do to troubleshoot what is happening? I attach doveconf -n output of the old server:
auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 2 mins auth_master_user_separator = * auth_worker_max_count = 5500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it imap_capability = +XLIST imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags imap_id_log = * imap_max_line_length = 92 k lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_attribute_dict = [1]file:/indices_correo/%2.26Hn/%2.200Hn/%n/dovecot-attributes mail_fsync = never mail_gid = entrega mail_home = /buzones_primarios/%2.26Hn/%2.200Hn/%n/home_usuario mail_location = mdbox:/buzones_primarios/%2.26Hn/%2.200Hn/%n:ALT=/buzones_secundarios/%2.26Hn/%2.200Hn/%n:INDEX=/indices_correo/%2.26Hn/%2.200Hn/%n:ITERINDEX mail_log_prefix = "%s(%u)<%{session}>: " mail_max_userip_connections = 2500 mail_plugins = " zlib acl quota virtual" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox SPAM { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/deny deny = yes driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile lda_mailbox_autosubscribe = yes quota = dict:Cuota de usuario::[2]file:/indices_correo/cuotas/%n quota_rule2 = Trash:storage=+10%% quota_warning = storage=90%% aviso_cuota 90 %u sieve = /buzones_primarios/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve sieve_dir = /buzones_primarios/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/ sieve_max_redirects = 20 zlib_save = gz zlib_save_level = 1 } pop3_no_flag_updates = yes protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 32000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service aviso_cuota { executable = script /usr/local/bin/quota-warning.sh unix_listener aviso_cuota { mode = 0666 } user = entrega } service config { process_min_avail = 4 } service doveadm { inet_listener { port = 12354 } } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull process_min_avail = 2 service_count = 0 vsz_limit = 1 G } service imap { executable = /usr/libexec/dovecot/imap process_limit = 8000 process_min_avail = 12 vsz_limit = 1 G } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 vsz_limit = 1 G } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 5000 process_min_avail = 2 service_count = 0 vsz_limit = 1 G } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 5000 } service stats { fifo_listener stats-mail { mode = 0600 user = entrega } } ssl_cert = </etc/pki/tls/certificado.pem ssl_cipher_list = ECDHE-RSA-AES128-SHA256:AES128-GCM-SHA256:RC4:HIGH:!MD5:!aNULL:!EDH ssl_min_protocol = TLSv1.2 userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } verbose_proctitle = yes protocol sieve { managesieve_implementation_string = dovecot managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 64 k } protocol lda { hostname = mydomain.tldr info_log_path = log_path = mail_fsync = optimized mail_plugins = sieve zlib quota virtual postmaster_address = [3]me@mydomain.tldr syslog_facility = mail } protocol imap { imap_metadata = yes mail_plugins = zlib quota imap_quota virtual } protocol pop3 { mail_plugins = zlib quota virtual pop3_enable_last = yes pop3_uidl_format = %g }
Regards
Javier
References
Visible links
- file://indices_correo/%2.26Hn/%2.200Hn/%n/dovecot-attributes
- file://indices_correo/cuotas/%n
- mailto:me@mydomain.tldr