- dovecot - dovecot.org

dsync: assert panic on mbox // no INBOX sync on hybrid mbox/maildir
by David Gardner 27 Sep '17

27 Sep '17

Hi, This (hopefully!) might be a case of user error, as I'm new to dovecot... Alternatively it might be some confusion in an index, since I've been mucking about trying different things in my configuration files and had frequent crashes. I'm trying to sync 2 (LAN) hosts, ideally to have full automatic replication happening. They both have hybrid mbox INBOX and maildir++ folders, using namespaces, as suggested in the wiki. I might have deviated the config from the wiki version, in trying to get things working. Both hosts communicate perfectly with an external IMAP client (thunderbird). Replication is working, but only partially - it is syncing the folders but not INBOX. I've thus been trying various things to try to get the INBOX to sync. The crash is only happening one of the 2 hosts which I've named crashhost for this report. The process crashes no matter which host starts the sync. With a second user, the crash happens on the other host crashhost: Ubuntu 16.04, x86_64, laptop, Dovecot 2.2.22, and Dovecot 2.2.32 (from debian sid package, locally compiled) otherhost: Ubuntu 16.04, x86_64, desktop, Dovecot 2.2.22, and Dovecot 2.2.32 (from debian sid package, locally compiled) RESULTS: 1) doveadm sync -f -u david tcp:otherhost synchronises the folders, but does not touch INBOXes. 2) doveadm sync -f -m INBOX -u david tcp:otherhost Does not touch INBOXes 3) doveadm sync -n '#mbox/' -f -u david tcp:otherhost dsync-local(david): Panic: file mbox-lock.c: line 800 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) I added some debug code, the assertion failure is being triggered by a call to mbox-lock() with: locktype=F_WRCLK mbox->mbox_lock_type=F_RDLCK, mbox->external_transactions=1 The config files on the 2 hosts only differ by the hostnames they're supposed to be syncing to. $ dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 4.10.0-35-generic x86_64 Ubuntu 16.04.3 LTS doveadm_password = # hidden, use -P to show it doveadm_port = 12346 imapc_host = crashhost imapc_password = # hidden, use -P to show it imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no imapc_user = %u mail_location = maildir:~/mail mail_plugins = " notify replication" mail_privileged_group = mail namespace { inbox = no list = yes location = prefix = separator = / subscriptions = yes } namespace inbox { hidden = yes inbox = yes list = no location = mbox:~/nomail:INBOX=/var/mail/%u:INDEX=/var/spool/mailindex/%u mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = "#mbox/" separator = / type = private } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { mail_replica = tcp:otherhost:12346 } protocols = " imap" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service config { unix_listener config { user = vmail } } service doveadm { inet_listener { port = 12346 } user = root } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/dovecot/dovecot.pem ssl_client_ca_dir = /etc/ssl ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } gdb) bt #0 0x00007f37f426e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 #1 0x00007f37f427002a in __GI_abort () at abort.c:89 #2 0x00007f37f469f7aa in ?? () from /usr/lib/dovecot/libdovecot.so.0 #3 0x00007f37f469f829 in default_fatal_handler () from /usr/lib/dovecot/libdovecot.so.0 #4 0x00007f37f46302a1 in i_panic () from /usr/lib/dovecot/libdovecot.so.0 #5 0x00007f37f49ac235 in mbox_lock () from /usr/lib/dovecot/libdovecot-storage.so.0 #6 0x00007f37f49adb11 in mbox_save_begin () from /usr/lib/dovecot/libdovecot-storage.so.0 #7 0x00007f37f49769a1 in mailbox_save_begin () from /usr/lib/dovecot/libdovecot-storage.so.0 #8 0x00007f37f496a2e8 in mail_storage_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 #9 0x00007f37f3e332a5 in ?? () from /usr/lib/dovecot/modules/lib15_notify_plugin.so #10 0x00007f37f4976b73 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #11 0x00007f37f4976d89 in mailbox_move () from /usr/lib/dovecot/libdovecot-storage.so.0 #12 0x000055b45f0da448 in ?? () #13 0x000055b45f0db35a in ?? () #14 0x000055b45f0ddbc0 in dsync_mailbox_import_changes_finish () #15 0x000055b45f0d8645 in dsync_brain_sync_mails () #16 0x000055b45f0d3df8 in dsync_brain_run () #17 0x000055b45f0d4140 in ?? () #18 0x000055b45f0ea3ff in ?? () #19 0x00007f37f46b4c82 in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 #20 0x00007f37f46b6309 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 #21 0x00007f37f46b4d1c in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 #22 0x00007f37f46b4ec8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 #23 0x000055b45f0bb4c2 in ?? () #24 0x000055b45f0bd91c in ?? () #25 0x000055b45f0be5aa in ?? () #26 0x000055b45f0beeda in doveadm_mail_try_run () #27 0x000055b45f0ae47c in main ()

3 3

Quota-status service on Director
by Michael Kliewe 27 Sep '17

27 Sep '17

Hello, I'm trying to configure the quota-status service, but it seems I'm not successful with my director setup (2.2.9). I activate the quota-status service like this on my director server: $ cat 91-quota-status.conf ## ## Quota-Status configuration. ## # Load Module quota-status and listen on TCP/IP Port for connections. service quota-status { executable = quota-status -p postfix inet_listener { address = 10.0.1.44 port = 12340 } client_limit = 1 } # Plugin configuration. # Return messages for requests by quota status: success, nouser and overquota. plugin { quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is over quota" } After restarting the director service I try to query the quota status service: printf "recipient=user(a)domain.de\nsize=100000\n\n" | nc 10.0.1.44 12340 The output is: action=DEFER_IF_PERMIT Invalid user settings. Refer to server log for more information. In the debug log of the director I see this: Feb 23 03:03:09 director01 dovecot: auth: Debug: userdb out: USER 1 user(a)domain.de mail=mdbox:/mnt/data01/domain.de/user/maildir home=/mnt/data01/domain.de/user proxy=Y master=<hidden> pass=<hidden> uid=5000 gid=1 quota_rule=*:storage=60593 quota_rule2=*:messages=100000 Feb 23 03:03:09 director01 dovecot: quota-status(user(a)domain.de): Error: user user(a)domain.de: Initialization failed: Namespace '': mkdir(/mnt/data01/domain.de/user/maildir/mailboxes) failed: Permission denied (euid=5000(vmail) egid=1(daemon) missing +w perm: /mnt, dir owned by 0:0 mode=0755) So the quota status service tries to access the mailbox of the user ON THE DIRECTOR. But the director has not mounted the mailboxes of the users, that's what the backend dovecots are for (proxy=Y). So the quota-status query is not proxied to the dovecot backend server I would assume. Does that mean I have to start the quota-status service on the dovecot backend servers and access it from the Postfix server directly? Currently the Postfixes can only reach the directors, not the backend servers. Is it possible to use the quota-status service on the director? Thanks for any hints and help Michael

3 4

librmb: Mail storage on RADOS with Dovecot
by mj 25 Sep '17

25 Sep '17

Hi ceph-ers, The email below was posted on the ceph mailinglist yesterday by Wido den Hollander. I guess this could be interesting for user here as well. MJ -------- Forwarded Message -------- Subject: [ceph-users] librmb: Mail storage on RADOS with Dovecot Date: Thu, 21 Sep 2017 10:40:03 +0200 (CEST) From: Wido den Hollander <wido(a)42on.com> To: ceph-users(a)ceph.com Hi, A tracker issue has been out there for a while: http://tracker.ceph.com/issues/12430 Storing e-mail in RADOS with Dovecot, the IMAP/POP3/LDA server with a huge marketshare. It took a while, but last year Deutsche Telekom took on the heavy work and started a project to develop librmb: LibRadosMailBox Together with Deutsche Telekom and Tallence GmbH (DE) this project came to life. First, the Github link: https://github.com/ceph-dovecot/dovecot-ceph-plugin I am not going to repeat everything which is on Github, put a short summary: - CephFS is used for storing Mailbox Indexes - E-Mails are stored directly as RADOS objects - It's a Dovecot plugin We would like everybody to test librmb and report back issues on Github so that further development can be done. It's not finalized yet, but all the help is welcome to make librmb the best solution for storing your e-mails on Ceph with Dovecot. Danny Al-Gaaf has written a small blogpost about it and a presentation: - https://dalgaaf.github.io/CephMeetUpBerlin20170918-librmb/ - http://blog.bisect.de/2017/09/ceph-meetup-berlin-followup-librmb.html To get a idea of the scale: 4,7PB of RAW storage over 1.200 OSDs is the final goal (last slide in presentation). That will provide roughly 1,2PB of usable storage capacity for storing e-mail, a lot of e-mail. To see this project finally go into the Open Source world excites me a lot :-) A very, very big thanks to Deutsche Telekom for funding this awesome project! A big thanks as well to Tallence as they did an awesome job in developing librmb in such a short time. Wido

4 3

Different users having same home/mail_location?
by Tapio Sokura 24 Sep '17

24 Sep '17

Hello, Will I be breaking something if I have two users share the same home and/or mail_location (maildir format) in dovecot? Mail will only be delivered to the primary user, the other would be used every now and then to login via imap (webmail). This would be on a CentOS 7 box running dovecot from the packaging system, i.e. dovecot-2.2.10-8.el7 currently. The reason I'd like to do this is to have two ways to login to the same mailbox, one using username + password and the other otherusername + otherpassword + otp-token. Basically this "otherusername" would be for cases where I don't trust the client computer to not have a keylogger etc badness in it, but still need to see my mail. I have this kind of a dual-login setup via PAM for regular system user authentication and it's working ok. I'm just wondering about the dovecot part, whether dovecot will do Unexpected Things if more than one user have the same home and mail_location? If it makes any difference, the users can have separate homes, but the mailbox should be the same for usability. Tapio

4 6

Sieve vacation and srs
by azurit＠pobox.sk 23 Sep '17

23 Sep '17

Hi, is this already fixed? https://www.dovecot.org/pipermail/dovecot/2017-July/108688.html If so, which version of Dovecot includes fix for this? Thanks for info. azur

2 1

Panic: file dict-fs.c:
by Computerisms Corporation 22 Sep '17

22 Sep '17

Hi, Am I doing something wrong here, or is this an actual problem? I am trying to get the top level of a public Mailbox to be an actual mailbox, instead of just storing subfolders. I get what looks to be an identical error when running doveadm acl recalc as well doveadm acl debug Departments2/IT doveadm(root): Info: Mailbox 'IT' is in namespace 'Departments2/' doveadm(root): Info: Mailbox path: /mail/Departments2/.IT doveadm(root): Info: Per-user private flags in mailbox: \Seen doveadm(root): Info: User root has rights: lookup read write write-seen write-deleted insert post expunge doveadm(root): Info: Mailbox found from dovecot-acl-list doveadm(root): Info: Mailbox is in public namespace doveadm(root): Info: Mailbox Departments2/IT is visible in LIST doveadm acl debug Departments2 doveadm(root): Info: Mailbox '' is in namespace 'Departments2/' doveadm(root): Info: Mailbox path: /mail/Departments2 doveadm(root): Info: Per-user private flags in mailbox: \Seen doveadm(root): Info: User root has rights: lookup read write write-seen write-deleted insert post expunge doveadm(root): Error: Mailbox not found from dovecot-acl-list, rebuilding doveadm(root): Panic: file dict-fs.c: line 127 (fs_dict_iterate_init): assertion failed: ((flags & DICT_ITERATE_FLAG_RECURSE) == 0) doveadm(root): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x9a954) [0x7f36a1627954] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x9a9d9) [0x7f36a16279d9] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f36a15bc9a0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x30438) [0x7f36a15bd438] -> /usr/local/lib/dovecot/libdovecot.so.0(dict_iterate_init_multiple+0x74) [0x7f36a15f3bf4] -> /usr/local/lib/dovecot/libdovecot.so.0(dict_iterate_init+0x19) [0x7f36a15f3c69] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_lookup_dict_rebuild+0x392) [0x7f36a0de1ab2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xa695) [0x7f36a0ddf695] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_backend_vfile_acllist_rebuild+0xd) [0x7f36a0ddf7cd] -> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x2552) [0x7f36a07b4552] -> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x27ff) [0x7f36a07b47ff] -> doveadm(+0x2a14d) [0x5624042e714d] -> doveadm(+0x2ac20) [0x5624042e7c20] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x22a) [0x5624042e89ea] -> doveadm(doveadm_cmd_run_ver2+0x515) [0x5624042f7125] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5624042f7177] -> doveadm(main+0x1ca) [0x5624042d85ba] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f36a120e2b1] -> doveadm(_start+0x2a) [0x5624042d897a] Aborted -- Bob Miller Cell: 867-334-7117 Office: 867-633-3760 www.computerisms.ca

1 0

Very high load
by absolutely_free＠libero.it 22 Sep '17

22 Sep '17

Hi, I am using dovecot 2.0.9 (official CentOS rpm), I am experiencing very high load issue. I think it is something related to my storage (/var/spool is about 3 TB and it is almost full). I noticed those kind of messages in /var/log/maillog: Warning: Maildir: Scanning /var/spool/pop/domains/domain.it/username/Maildir/cur took 100 seconds (14281 readdir()s, 0 rename()s to cur/) Warning: Maildir /var/spool/pop/domains/domain.it/username/Maildir: Synchronization took 103 seconds (0 new msgs, 0 flag change attempts, 0 expunge attempts) I wondering if there is something to try, at configuration level, to "mitigate" this.. I use Maildir format, MTA is postfix, I have many users (> 10000) with pop3/imap/webmail access. Physical server with 8 GB RAM and two CPU (Intel(R) Pentium(R) D CPU 3.00GHz) This is my dovecot's conf: auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain login digest-md5 cram-md5 auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = /var/log/dovecot.log default_client_limit = 1000 default_idle_kill = 60 default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins disable_plaintext_auth = no dotlock_use_excl = no doveadm_socket_path = doveadm-server doveadm_worker_count = 0 first_valid_gid = 89 first_valid_uid = 89 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k info_log_path = last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/libexec/dovecot listen = *, :: lmtp_proxy = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = 89 mail_home = mail_location = maildir:/coraid-s2l2/domains mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib64/dovecot mail_plugins = mail_privileged_group = mail_save_crlf = no mail_temp_dir = /tmp mail_uid = 89 mailbox_idle_check_interval = 30 secs mailbox_list_index_disable = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext deny = no driver = sql master = no pass = no } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext deny = no driver = sql master = no pass = no } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_script_size = 1M } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv postmaster_address = protocols = imap pop3 lmtp sieve quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s sendmail_path = /usr/sbin/sendmail service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 4096 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0600 user = } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 0 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 0 } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = port = 4190 ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } unix_listener ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service tcpwrap { chroot = client_limit = 1 drop_priv_before_exec = no executable = tcpwrap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = </etc/nginx/ssl/wildcard.domain.net_bundle.crt ssl_cert_username_field = commonName ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_dh_parameters_length = 1024 ssl_key = </etc/nginx/ssl/wildcard.domain.net.key ssl_key_password = ssl_parameters_file = ssl-parameters.dat ssl_parameters_regenerate = 0 ssl_protocols = !SSLv2 !SSLv3 ssl_verify_client_cert = no syslog_facility = mail userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = verbose_auth = no verbose_proctitle = no verbose_ssl = no version_ignore = no protocol lmtp { mail_plugins = } protocol lda { mail_plugins = } protocol imap { imap_id_log = * } Thank you!

2 2

Migrating maildirs - Courier to Dovecot
by Stroller 22 Sep '17

22 Sep '17

I apologise, because I'm sure this subject has been done to death, but I want to migrate from Courier to Dovecot. I think my main question is whether there's any reason I shouldn't just rsync the maildirs across from the old mail server to the new one? There aren't many clients using this server, so I don't care if clients have to redownload all their messages (in fact, I expect they'll probably end up doing so anyway). I'd like to preserve read/unread status of each message, but can't think of anything else important. It doesn't matter if there's a few hours of downtime, but I thought to use rsync because I figured I copy the maildirs a day or two ahead of time, and then a sync immediately before going live will be quicker. Using imapsync [1] looks pretty good, and I'm happy to use that if it'll be "cleaner" or help Dovecot to create its hierarchy more neatly. It looks like Courier creates a courierimapuiddb, courierimapkeywords and courierimapacl in each folder - can I not just delete these, and hand Dovecot a bunch of maildir directories and files to reindex for itself? There are probably only a few hundred thousand messages on the server, a few GB worth, although some of them are many years old. Some of the messages on the old server have the wrong "received" date on them, having the wrong file creation / modification date on the server's filesystem, having been copied there previously (years ago) without using cp's --archive flag. I've always thought I should one day write a script to fix this, perhaps using mboxgrep. Thanks in advance for any of your thoughts, Stroller. [1] https://wiki2.dovecot.org/Migration#IMAP_.3C-.3E_IMAP_copying

4 4

Fwd: Bug#876364: dovecot-sieve: Just discovered imap_sieve/sieve_imapsieve is not set up to work with virtual mailboxes.
by Thurgood Angelou 22 Sep '17

22 Sep '17

Hi... The output of my doveconf -n is as folllows. # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) doveconf: Warning: /etc/dovecot/dovecot.conf line 105: Global setting mail_plugins won't change the setting inside an earlier filter at /etc/dovecot/conf.d/15-lda.conf line 47 (if this is intentional, avoid this warning by moving the global setting before /etc/dovecot/conf.d/15-lda.conf line 47) doveconf: Warning: /etc/dovecot/dovecot.conf line 105: Global setting mail_plugins won't change the setting inside an earlier filter at /etc/dovecot/conf.d/15-lda.conf line 47 (if this is intentional, avoid this warning by moving the global setting before /etc/dovecot/conf.d/15-lda.conf line 47) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 ext4 auth_default_realm = othersider92.com auth_mechanisms = plain login first_valid_uid = 100 log_path = /var/log/dovecot.log mail_location = maildir:/var/mail/%d/%n mail_plugins = " virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create autoexpunge = 1 weeks special_use = \Junk } mailbox Promotions { auto = subscribe } mailbox Sent { auto = create special_use = \Sent } mailbox Trash { auto = create autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } namespace virtual { disabled = yes hidden = yes list = no location = virtual:/var/mail/virtual prefix = virtual/ separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/etc/sieve/report-spam-promo.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Promotions imapsieve_mailbox4_before = file:/etc/sieve/report-ham-promo.sieve imapsieve_mailbox4_causes = COPY imapsieve_mailbox4_from = Promotions imapsieve_mailbox4_name = * sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/sieve/conf.d/after sieve_before = /etc/sieve/conf.d/before sieve_global_extensions = +editheader +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/local/bin sieve_plugins = sieve_extprograms sieve_imapsieve } protocols = imap lmtp service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/ssl/mail/ssl.cert ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail home=/var/mail/%d/%n driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = " virtual" } protocol lda { mail_plugins = " sieve virtual" } protocol imap { mail_plugins = " virtual imap_sieve" } I hope this helps. On Thu, Sep 21, 2017 at 4:47 AM, Apollon Oikonomopoulos <apoikos(a)debian.org> wrote: > Control: tags -1 + moreinfo upstream > > [Forwarding this to the Dovecot mailing list, just in case someone can > help] > > Hi, > > Thanks for the report! See my comments inline. > > On 11:56 Thu 21 Sep , Thurgood Angelou wrote: > > Package: dovecot-core > > Version: 1:2.2.32-2 > > > > I've just discovered a bug where the sieve plugin (especially IMAP) > > will not work with a virtual mailbox. I recently found this out when > > testing a virtual mailbox setup and I use imap_sieve for SPAM > > filtering so to lose that would be painful. > > > > This is what is reported in dovecot's debug log... > > > > Sep 21 10:53:01 imap(personal(a)othersider92.com): Panic: file > mail-index-map.c: line 549 (mail_index_map_lookup_seq_range): assertion > failed: (first_uid > 0) > > Sep 21 10:53:01 imap(personal(a)othersider92.com): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f4226fd50a2] -> > /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f4226fd519a] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4226f65cf8] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map_lookup_seq_range+0x120) > [0x7f422733dae0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xe8d1d) > [0x7f422734cd1d] -> /usr/lib/dovecot/libdovecot-st > orage.so.0(mail_index_lookup_seq+0xf) [0x7f4227350e9f] -> > /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x82aa) > [0x7f422678a2aa] -> /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so(+0x708c) > [0x7f422657d08c] -> /usr/lib/dovecot/libdovecot-st > orage.so.0(mailbox_transaction_commit_get_changes+0x52) [0x7f42272adca2] > -> dovecot/imap(+0x10084) [0x556502adb084] -> dovecot/imap(command_exec+0x5c) > [0x556502ae7d9c] -> dovecot/imap(+0x1b322) [0x556502ae6322] -> > dovecot/imap(+0x1b3bc) [0x556502ae63bc] -> dovecot/imap(client_handle_inp > ut > > +0x18d) [0x556502ae677d] -> dovecot/imap(client_input+0xac) > [0x556502ae6ccc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) > [0x7f4226fea742] -> /usr/lib/dovecot/libdovecot.so > .0(io_loop_handler_run_internal+0x12e) [0x7f4226febd8e] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) > [0x7f4226fea7d6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) > [0x7f4226fea988] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f4226f70353] -> dovecot/imap(main+0x329) [0x556502ad9139] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f4226bb92e1] > -> dovecot/imap(_start+0x2a) [0x556502ad92ca] > > After mixing in the debug symbols, this backtrace becomes: > > /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f4226fd50a2] > default_fatal_finish at ./src/lib/failures.c:195 > /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f4226fd519a] > ?? at ./src/lib/failures.c:670 > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4226f65cf8] > i_fatal at ./src/lib/failures.c:280 > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map_lookup_seq_range+0x120) > [0x7f422733dae0] > mail_index_map_lookup_seq_range at ./src/lib-index/mail-index-map > .c:550 > /usr/lib/dovecot/libdovecot-storage.so.0(+0xe8d1d) [0x7f422734cd1d] > tview_lookup_seq_range at ./src/lib-index/mail-index-tra > nsaction-view.c:178 > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq+0xf) > [0x7f4227350e9f] > mail_index_lookup_seq at ./src/lib-index/mail-index-view.c:522 > /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x82aa) [0x7f422678a2aa] > virtual_mail_set_uid at ./src/plugins/virtual/virtual-mail.c:213 > /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so(+0x708c) > [0x7f422657d08c] > imap_sieve_mailbox_transaction_run at ./pigeonhole/src/plugins/imapsieve/imap-sieve-storage.c:752 > (inlined by: imap_sieve_mailbox_transaction_commit at > ./pigeonhole/src/plugins/imapsieve/imap-sieve-storage.c:807) > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) > [0x7f42272adca2] > mailbox_transaction_commit_get_changes at > ./src/lib-storage/mail-storage.c:2083 > dovecot/imap(+0x10084) [0x556502adb084] > cmd_copy_full at ./src/imap/cmd-copy.c:146 > dovecot/imap(command_exec+0x5c) [0x556502ae7d9c] > command_exec at ./src/imap/imap-commands.c:200 > dovecot/imap(+0x1b322) [0x556502ae6322] > client_command_input at ./src/imap/imap-client.c:1088 > dovecot/imap(+0x1b3bc) [0x556502ae63bc] > client_command_input at ./src/imap/imap-client.c:1150 > dovecot/imap(client_handle_input+0x18d) [0x556502ae677d] > client_handle_input at ./src/imap/imap-client.c:1203 > dovecot/imap(client_input+0xac) [0x556502ae6ccc] > client_input at ./src/imap/imap-client.c:1249 > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f4226fea742] > io_loop_call_io at ./src/lib/ioloop.c:600 > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) > [0x7f4226febd8e] > io_loop_handler_run_internal at ./src/lib/ioloop-epoll.c:223 > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) > [0x7f4226fea7d6] > io_loop_handler_run at ./src/lib/ioloop.c:648 > /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f4226fea988] > io_loop_run at ./src/lib/ioloop.c:622 > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f4226f70353] > master_service_run at ./src/lib-master/master-service.c:667 > dovecot/imap(main+0x329) [0x556502ad9139] > main at ./src/imap/main.c:491 > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f4226bb92e1] > __libc_start_main at ../csu/libc-start.c:325 > dovecot/imap(_start+0x2a) [0x556502ad92ca] > start at ??:0 > > > -- System Information: > > Debian Release: 8.2 > > APT prefers oldstable-updates > > APT policy: (500, 'oldstable-updates'), (500, 'unstable'), (500, > 'testing'), (500, 'oldstable') > > Architecture: amd64 (x86_64) > > > > Kernel: Linux 3.16.0-4-amd64 (SMP w/2 CPU cores) > > Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8), > LANGUAGE=en_GB:en (charmap=UTF-8) > > Shell: /bin/sh linked to /bin/dash > > Init: systemd (via /run/systemd/system) > > > > Versions of packages dovecot-sieve depends on: > > ii dovecot-core 1:2.2.32-2 > > ii libc6 2.24-17 > > ii ucf 3.0030 > > > > dovecot-sieve recommends no packages. > > > > dovecot-sieve suggests no packages. > > > > Versions of packages dovecot-sieve is related to: > > ii dovecot-core [dovecot-common] 1:2.2.32-2 > > pn dovecot-dbg <none> > > pn dovecot-dev <none> > > ii dovecot-gssapi 1:2.2.32-2 > > ii dovecot-imapd 1:2.2.32-2 > > ii dovecot-ldap 1:2.2.32-2 > > ii dovecot-lmtpd 1:2.2.32-2 > > ii dovecot-managesieved 1:2.2.32-2 > > ii dovecot-mysql 1:2.2.32-2 > > pn dovecot-pgsql <none> > > pn dovecot-pop3d <none> > > ii dovecot-sieve 1:2.2.32-2 > > pn dovecot-sqlite <none> > > Could you also include the output of doveconf -n? > > Regards, > Apollon >

1 0

Re: JMAP support in Dovecot
by Aki Tuomi 21 Sep '17

21 Sep '17

answer is not yet. we are going to implement it when we get free resources to do it. ---Aki TuomiDovecot oy -------- Original message --------From: Steinar Bang <sb(a)dod.no> Date: 21/09/2017 17:28 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Re: JMAP support in Dovecot >>>>> Aki Tuomi <aki.tuomi(a)dovecot.fi>: > We are working on including JMAP support to Dovecot. At this moment I > cannot give any promise for exact version, but hopefully it will be > part of v2.3 Any updates on jmap support in dovecot? I tried searching the git repo for "jmap" yesterday, so I'm guessing the answer is "no" or "not yet"...?

1 0