- dovecot - dovecot.org

[Dovecot] Mailbox conversion/importing
by Alan Brown 18 Jun '13

18 Jun '13

I've been tasked with importing a large bunch of mbox folders (about 500) into an existing mdbox setup in Dovecot 2.1 As far as I can see, dsync "mirror" or "backup" are both inappropriate ways of doing this. Does anyone have any suggestions about how I could proceed? Thanks in advance

5 5

[Dovecot] doveadm index crashes when indexing shared mailboxes
by W. de Hoog 18 Jun '13

18 Jun '13

Hi, We store our mail archive in a tree of subfolders. I am trying to speed up text searching on our mail archive but when running "doveadm -D -v index -u neil shared/Exalon/Aandeelhouders" the following output is produced: doveadm(neil): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(neil): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so doveadm(neil): Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so doveadm(neil): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(neil): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_dovea dm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(neil): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_do veadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(neil): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_dov eadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(neil): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_dove adm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(neil): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so doveadm(neil): Debug: auth input: neil system_groups_user=neil uid=1000 gid=1000 home=/home/neil doveadm(neil): Debug: Effective uid=1000, gid=1000, home=/home/neil doveadm(neil): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location= mbox:~/mail:INBOX=/var/mail/neil doveadm(neil): Debug: fs: root=/home/neil/mail, index=, control=, inbox=/var/mail/neil, alt= doveadm(neil): Debug: Namespace : type=shared, prefix=shared/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location= mbox:~imapshared doveadm(neil): Debug: mbox: INBOX defaulted to /home/imapshared/inbox doveadm(neil): Debug: fs: root=/home/imapshared, index=, control=, inbox=/home/imapshared/inbox, alt= doveadm(neil): Info: shared/Exalon/Aandeelhouders: Caching mails seq=1..27 27/27 doveadm(neil): Panic: file mbox-storage.c: line 711 (mbox_transaction_unlock): assertion failed: (mbox->box.transaction_count > 0 || mbox->mbox_lock_type == F_UNLCK) doveadm(neil): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3c0ba) [0x7fb91d7460ba] -> /usr/lib/dovecot/libdovecot .so.0(default_fatal_handler+0x2a) [0x7fb91d74617a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb91d71d85a] -> /usr/lib/ dovecot/libdovecot-storage.so.0(+0x54d80) [0x7fb91d9e4d80] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x54dee) [0x7fb91d9e4de e] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xb0e2) [0x7fb91c2c30e2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbo x_transaction_commit_get_changes+0x3d) [0x7fb91da0010d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+ 0x15) [0x7fb91da00145] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x3927) [0x7fb91c0ab927] -> /usr/lib/dovecot/modu les/lib21_fts_squat_plugin.so(+0x39b1) [0x7fb91c0ab9b1] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x649c) [0x7fb91c2be49 c] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_update_deinit+0x2b) [0x7fb91c2be59b] -> /usr/lib/dovecot/modules /lib20_fts_plugin.so(+0xb03c) [0x7fb91c2c303c] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xb0d3) [0x7fb91c2c30d3] -> /us r/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7fb91da0010d] -> /usr/lib/dovecot/libdove cot-storage.so.0(mailbox_transaction_commit+0x15) [0x7fb91da00145] -> /usr/bin/doveadm(+0x15430) [0x7fb91e0fb430] -> /usr/bin/d oveadm(+0x11f66) [0x7fb91e0f7f66] -> /usr/bin/doveadm(+0x12a41) [0x7fb91e0f8a41] -> /usr/bin/doveadm(doveadm_mail_try_run+0x161 ) [0x7fb91e0f8f01] -> /usr/bin/doveadm(main+0x3d1) [0x7fb91e0f7b21] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fb91d363ea5] -> /usr/bin/doveadm(+0x11d55) [0x7fb91e0f7d55] Aborted (core dumped) When indexing is triggered using the imap server it logs: Jun 10 12:32:16 indexer: Error: Indexer worker disconnected, discarding 1 requests for neil Jun 10 12:32:16 indexer-worker(neil): Fatal: master: service(indexer-worker): child 22173 killed with signal 6 (core dumps disabled) Jun 10 12:32:16 imap(neil): Error: indexer failed to index mailbox shared/Suppliers/NXP Jun 10 12:32:16 indexer-worker: Debug: Loading modules from directory: /usr/lib/dovecot/modules Jun 10 12:32:16 indexer-worker: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so Jun 10 12:32:16 indexer-worker: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so Jun 10 12:32:16 indexer-worker: Debug: auth input: neil system_groups_user=neil uid=1000 gid=1000 home=/home/neil Jun 10 12:32:16 indexer-worker(neil): Debug: Effective uid=1000, gid=1000, home=/home/neil Jun 10 12:32:16 indexer-worker(neil): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/mail/nei l Jun 10 12:32:16 indexer-worker(neil): Debug: fs: root=/home/neil/mail, index=, control=, inbox=/var/mail/neil, alt= Jun 10 12:32:16 indexer-worker(neil): Debug: Namespace : type=shared, prefix=shared/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mbox:~imapshared Jun 10 12:32:16 indexer-worker(neil): Debug: mbox: INBOX defaulted to /home/imapshared/inbox Jun 10 12:32:16 indexer-worker(neil): Debug: fs: root=/home/imapshared, index=, control=, inbox=/home/imapshared/inbox, alt= Jun 10 12:32:16 indexer-worker(neil): Panic: file mbox-storage.c: line 711 (mbox_transaction_unlock): assertion failed: (mbox->box.transaction_count > 0 || mbox->mbox_lock_type == F _UNLCK) Jun 10 12:32:16 indexer-worker(neil): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3c0ba) [0x7f9da1ef60ba] -> /usr/lib/dovecot/libdovecot.so.0(+0x3c0fe) [0x7f9da1ef60fe ] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9da1ecd85a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x54d80) [0x7f9da2194d80] -> /usr/lib/dovecot/libdovecot-storage.so.0( +0x54dee) [0x7f9da2194dee] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xb0e2) [0x7f9da0a730e2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_chang es+0x3d) [0x7f9da21b010d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0x15) [0x7f9da21b0145] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x3927 ) [0x7f9da085b927] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x39b1) [0x7f9da085b9b1] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x649c) [0x7f9da0a6e49c] -> /usr/ lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_update_deinit+0x2b) [0x7f9da0a6e59b] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xb03c) [0x7f9da0a7303c] -> /usr/lib/doveco t/modules/lib20_fts_plugin.so(+0xb0d3) [0x7f9da0a730d3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7f9da21b010d] -> /usr/lib/dovecot /libdovecot-storage.so.0(mailbox_transaction_commit+0x15) [0x7f9da21b0145] -> dovecot/indexer-worker(+0x287c) [0x7f9da265f87c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x 36) [0x7f9da1f02f76] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f9da1f03c37] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f9da1f02988] -> /usr/li b/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f9da1eef3c3] -> dovecot/indexer-worker(main+0xfe) [0x7f9da265f10e] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f9da1b13ea5] -> dovecot/indexer-worker(+0x21b5) [0x7f9da265f1b5] neil@athina:~$ dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.8.0-23-generic x86_64 Ubuntu 13.04 auth_verbose = yes disable_plaintext_auth = no log_path = /var/log/dovecot.log mail_debug = yes mail_plugins = fts fts_squat mail_privileged_group = mail namespace { list = yes location = mbox:~imapshared prefix = shared/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mbox:~/mail:INBOX=/var/mail/%u mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap" ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_ssl = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags } -- Willem-Jan de Hoog

2 2

[Dovecot] Problem redirecting email using pigeonhole 0.4.0 (with patch)
by Andriy Syrovenko 18 Jun '13

18 Jun '13

Hello, Starting from the version 0.4.0 Pigeonhole adds "X-Sieve" and "X-Sieve-Redirected-From" headers ending them with CR+LF, and then copies the original message (including original headers) ending the lines with LF-only. This causes troubles at least if using Exim (I have not checked with other MTAs)- original message gets dropped, and only the new pigeonhole-generated headers are sent out. The attached file fixed the problem for me. --- dovecot-2.2-pigeonhole-0.4.0.orig/src/lib-sieve/cmd-redirect.c 2013-04-07 01:57:26.000000000 +0300 +++ dovecot-2.2-pigeonhole-0.4.0/src/lib-sieve/cmd-redirect.c 2013-06-05 03:22:53.000000000 +0300 @@ -344,9 +344,9 @@ string_t *hdr = t_str_new(256); /* Prepend sieve headers (should not affect signatures) */ - rfc2822_header_write(hdr, "X-Sieve", SIEVE_IMPLEMENTATION); + rfc2822_header_append(hdr, "X-Sieve", SIEVE_IMPLEMENTATION, FALSE, NULL); if ( recipient != NULL ) - rfc2822_header_write(hdr, "X-Sieve-Redirected-From", recipient); + rfc2822_header_append(hdr, "X-Sieve-Redirected-From", recipient, FALSE, NULL); o_stream_send(output, str_data(hdr), str_len(hdr)); } T_END; Best regards, Andrey.

2 1

[Dovecot] Dovecot 2.2.2: doveadm user doesn't honor -x option
by Axel Luttgens 17 Jun '13

17 Jun '13

Hello, 1. Considering a user_query similar to this one: SELECT ... FROM ... WHERE CASE '%s' WHEN 'lmtp' THEN ... and issuing following command: doveadm user -x service=lmtp someuser(a)example.com the log shows: SELECT ... FROM ... WHERE CASE 'doveadm' WHEN 'lmtp' THEN ... and the query of course fails. The same config with Dovecot 2.1.16 yields expected results. 2. This is more a question. Issuing above command first writes this to the log: prefetch(someuser(a)example.com): passdb didn't return userdb entries, trying the next userdb Is there really an attempt to make use of the prefetch database? If yes, under which circumstances could it succeed? TIA, Axel

2 2

[Dovecot] dovecot 2.2 with lucene compile error
by Robert Schetterer 17 Jun '13

17 Jun '13

Hi ,i get an compile error security -Werror=format-security -MT lucene-wrapper.lo -MD -MP -MF .deps/lucene-wrapper.Tpo -c lucene-wrapper.cc -fPIC -DPIC -o .libs/lucene-wrapper.o lucene-wrapper.cc: In function 'lucene_index* lucene_index_init(const char*, mailbox_list*, const fts_lucene_settings*)': lucene-wrapper.cc:128:2: error: 'else' without a previous 'if' make[5]: *** [lucene-wrapper.lo] Error 1 Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

2 2

[Dovecot] IMAP MOVE and lazy_expunge_only_last_instance
by Pavel Volkovitskiy 17 Jun '13

17 Jun '13

Hello! im testing lazy_expunge_only_last_instance here and it seems it works wrong with IMAP MOVE IN: 14 uid move 13 "INBOX" OUT: * OK [COPYUID 1188569061 13 34] Moved UIDs. * 5 EXPUNGE 14 OK Move completed. dovecot.log: 2013-06-14 10:56:06 imap(test13(a)mtx.ru): Info: copy from Test: box=INBOX, uid=34, msgid=<1294858169.32435.3.camel(a)int.office.matrix>, size=996, from=Pavel Volkovitskiy <int(a)mtx.ru>, subject=test, flags=(\Seen) 2013-06-14 10:56:06 imap(test13(a)mtx.ru): Info: copy from Test: box=.EXPUNGED/Test, uid=9, msgid=<1294858169.32435.3.camel(a)int.office.matrix>, size=996, from=Pavel Volkovitskiy <int(a)mtx.ru>, subject=test, flags=(\Seen) 2013-06-14 10:56:06 imap(test13(a)mtx.ru): Info: expunge: box=Test, uid=13, msgid=<1294858169.32435.3.camel(a)int.office.matrix>, size=996, from=Pavel Volkovitskiy <int(a)mtx.ru>, subject=test, flags=(\Seen) i'm using dovecot 2:2.2.2-0~auto+64 (cfd442fcc672) PS: it works well if i copy and delete mails -- Pavel

2 4

[Dovecot] Trash plugin
by Jason Pfingstmann 16 Jun '13

16 Jun '13

Hello all! I tried to post this earlier today, but it's stuck in a moderator queue for being too long, so here's a shorter version (mod, please delete the pending message from me, if you read this). I'm new to dovecot and just finished setting everything up. It's a postfix + dovecot + myql + spamassassin + postgrey virtual mail server. The issue I'm having (1 of 2) is that the Trash plugin isn't working, over-quota mail is being rejected despite a large piece that would bring it under quota with room to spare for the piece being delivered that is in the Trash folder. My configs (postconf -n, doveconf -n, trash.conf): http://pastebin.com/vFJ0rfZ6 It may be unrelated, but it seems postgrey isn't running either, but maybe those are partially tied together? Thanks for all your help! Jason Pfingstmann

1 0

[Dovecot] Trash plugin
by Jason Pfingstmann 16 Jun '13

16 Jun '13

Hello! This is my first dovecot install, which I put together by mixing and matching pieces of various online howtos (fortunately, Dovecot doesn't seem to be overly complex - a big plus). I've got it mostly working, but the trash plugin doesn't seem to be working right. Below are configs and some logs. Any thoughts? Also, any suggestions regarding my configuration? I can post other items for troubleshooting if they'd be helpful. -Jason Pfingstmann Here's my doveconf -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.6.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) ext4 auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain login auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 60 default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins disable_plaintext_auth = yes dotlock_use_excl = no doveadm_socket_path = doveadm-server doveadm_worker_count = 0 first_valid_gid = 12 first_valid_uid = 101 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k info_log_path = last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = libexec_dir = /usr/libexec/dovecot listen = *, :: lmtp_proxy = no lmtp_save_to_detail_mailbox = yes lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = maildir:/home/vmail/%d/%n mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib64/dovecot mail_plugins = trash mail_privileged_group = mail_save_crlf = no mail_temp_dir = /tmp mail_uid = mailbox_idle_check_interval = 30 secs mailbox_list_index_disable = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no passdb { args = /etc/dovecot/dovecot-mysql.conf deny = no driver = sql master = no pass = no } plugin { acl = vfile:/etc/dovecot/acls quota = dict:user::proxy::quotadict sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /home/sieve/ sieve_global_path = /home/sieve/globalfilter.sieve sieve_max_script_size = 1M trash = /etc/dovecot/trash.conf } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv postmaster_address = protocols = imap pop3 lmtp sieve quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s sendmail_path = /usr/sbin/sendmail service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 4096 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = vmail mode = 0666 user = vmail } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 256 M } service lmtp { chroot = client_limit = 0 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 0 } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = port = 4190 ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = </etc/postfix/smtpd.crt ssl_cert_username_field = commonName ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_key = </etc/postfix/smtpd.key ssl_key_password = ssl_parameters_file = ssl-parameters.dat ssl_parameters_regenerate = 168 ssl_verify_client_cert = no syslog_facility = mail userdb { args = driver = prefetch } userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } valid_chroot_dirs = verbose_auth = no verbose_proctitle = no verbose_ssl = no version_ignore = no protocol lda { mail_plugins = trash quota sieve postmaster_address = postmaster(a)otakuuniversity.org } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = trash quota imap_quota } protocol lmtp { mail_plugins = trash sieve } protocol pop3 { mail_plugins = trash quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } [root@nerv-03 dovecot]# dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.6.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) ext4 auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_gid = 12 first_valid_uid = 101 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_location = maildir:/home/vmail/%d/%n mail_plugins = trash managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { acl = vfile:/etc/dovecot/acls quota = dict:user::proxy::quotadict sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /home/sieve/ sieve_global_path = /home/sieve/globalfilter.sieve sieve_max_script_size = 1M trash = /etc/dovecot/trash.conf } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap { vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/postfix/smtpd.crt ssl_key = </etc/postfix/smtpd.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { mail_plugins = trash quota sieve postmaster_address = postmaster(a)otakuuniversity.org } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = trash quota imap_quota } protocol lmtp { mail_plugins = trash sieve } protocol pop3 { mail_plugins = trash quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } postconf -n: alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases broken_sasl_auth_clients = yes command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix delay_warning_time = 4 disable_vrfy_command = yes html_directory = no inet_interfaces = all mail_owner = postfix mailbox_size_limit = 0 mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man message_size_limit = 409600000 mydestination = $myhostname, localhost.$mydomain, localhost mydomain = otakuuniversity.org myhostname = nerv-03.otakuuniversity.org mynetworks = $config_directory/mynetworks newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix recipient_delimiter = + relay_domains = proxy:mysql:/etc/postfix/mysql-relay_domains_maps.cf sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_tls_session_cache_database = btree:$data_directory/smtp_tls_session_cache smtp_use_tls = yes smtpd_client_restrictions = smtpd_data_restrictions = reject_unauth_pipelining smtpd_helo_required = yes smtpd_helo_restrictions = smtpd_recipient_restrictions = permit_sasl_authenticated, permit_mynetworks, reject_unauth_destination, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unknown_recipient_domain, check_policy_service unix:/var/spool/postfix/postgrey/socket smtpd_sasl_auth_enable = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot smtpd_sender_restrictions = smtpd_tls_CAfile = /etc/postfix/cacert.pem smtpd_tls_cert_file = /etc/postfix/smtpd.crt smtpd_tls_key_file = /etc/postfix/smtpd.key smtpd_tls_loglevel = 1 smtpd_tls_received_header = yes smtpd_tls_security_level = may smtpd_tls_session_cache_timeout = 3600s smtpd_use_tls = yes tls_random_source = dev:/dev/urandom transport_maps = hash:/etc/postfix/transport unknown_local_recipient_reject_code = 550 virtual_alias_maps = proxy:mysql:/etc/postfix/mysql-virtual_alias_maps.cf, regexp:/etc/postfix/virtual_regexp virtual_gid_maps = static:12 virtual_mailbox_base = /home/vmail virtual_mailbox_domains = proxy:mysql:/etc/postfix/ mysql-virtual_domains_maps.cf virtual_mailbox_maps = proxy:mysql:/etc/postfix/ mysql-virtual_mailbox_maps.cf virtual_minimum_uid = 101 virtual_transport = dovecot virtual_uid_maps = static:101 maillog entry for the inbound test: Jun 17 00:48:07 nerv-03 postfix/smtpd[20800]: connect from mail-oa0-f51.google.com[209.85.219.51] Jun 17 00:48:08 nerv-03 postfix/smtpd[20800]: setting up TLS connection from mail-oa0-f51.google.com[209.85.219.51] Jun 17 00:48:08 nerv-03 postfix/smtpd[20800]: Anonymous TLS connection established from mail-oa0-f51.google.com[209.85.219.51]: TLSv1 with cipher RC4-SHA (128/128 bits) Jun 17 00:48:09 nerv-03 postgrey[7116]: action=pass, reason=client whitelist, client_name=mail-oa0-f51.google.com, client_address=209.85.219.51, sender=jason.pfingstmann(a)gmail.com, recipient= test(a)otakuuniversity.org Jun 17 00:48:09 nerv-03 postfix/smtpd[20800]: 1D9CA26265C: client= mail-oa0-f51.google.com[209.85.219.51] Jun 17 00:48:09 nerv-03 postfix/cleanup[20808]: 1D9CA26265C: message-id=<CANGr1k1wms7WC= dmQNFwbKdh7AF69PBYrz5VFqLrbvBjYgXtpw(a)mail.gmail.com> Jun 17 00:48:13 nerv-03 postfix/qmgr[5885]: 1D9CA26265C: from=< jason.pfingstmann(a)gmail.com>, size=8185581, nrcpt=1 (queue active) Jun 17 00:48:13 nerv-03 postfix/smtpd[20800]: disconnect from mail-oa0-f51.google.com[209.85.219.51] Jun 17 00:48:13 nerv-03 dovecot: auth: mysql: Connected to localhost (mail) Jun 17 00:48:13 nerv-03 dovecot: imap-login: Login: user=< test(a)otakuuniversity.org>, method=PLAIN, rip=::1, lip=::1, mpid=20834, secured Jun 17 00:48:13 nerv-03 dovecot: imap(test(a)otakuuniversity.org): Disconnected: Logged out bytes=90/779 Jun 17 00:48:15 nerv-03 postfix/smtpd[20839]: connect from unknown[127.0.0.1] Jun 17 00:48:15 nerv-03 postfix/smtpd[20839]: 6CDC726265D: client=unknown[127.0.0.1] Jun 17 00:48:15 nerv-03 postfix/cleanup[20808]: 6CDC726265D: message-id=<CANGr1k1wms7WC= dmQNFwbKdh7AF69PBYrz5VFqLrbvBjYgXtpw(a)mail.gmail.com> Jun 17 00:48:15 nerv-03 postfix/smtpd[20839]: disconnect from unknown[127.0.0.1] Jun 17 00:48:15 nerv-03 postfix/qmgr[5885]: 6CDC726265D: from=< jason.pfingstmann(a)gmail.com>, size=8186433, nrcpt=1 (queue active) Jun 17 00:48:15 nerv-03 amavis[29202]: (29202-06) Passed CLEAN {RelayedInbound}, [209.85.219.51]:47269 [209.85.219.51] < jason.pfingstmann(a)gmail.com> -> <test(a)otakuuniversity.org>, Message-ID: <CANGr1k1wms7WC=dmQNFwbKdh7AF69PBYrz5VFqLrbvBjYgXtpw(a)mail.gmail.com>, mail_id: WX-Kn6BdkJ7l, Hits: 0.002, size: 8185580, queued_as: 6CDC726265D, dkim_sd=20120113:gmail.com, 1967 ms Jun 17 00:48:15 nerv-03 postfix/smtp[20819]: 1D9CA26265C: to=< test(a)otakuuniversity.org>, relay=127.0.0.1[127.0.0.1]:10024, delay=6.7, delays=4.7/0.01/0/2, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 6CDC726265D) Jun 17 00:48:15 nerv-03 postfix/qmgr[5885]: 1D9CA26265C: removed Jun 17 00:48:15 nerv-03 dovecot: dict: mysql: Connected to localhost (mail) Jun 17 00:48:15 nerv-03 dovecot: lda(test(a)otakuuniversity.org): Error: sieve: msgid=<CANGr1k1wms7WC= dmQNFwbKdh7AF69PBYrz5VFqLrbvBjYgXtpw(a)mail.gmail.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) Jun 17 00:48:15 nerv-03 dovecot: lda(test(a)otakuuniversity.org): Error: sieve: script /home/vmail/otakuuniversity.org/test/dovecot.sieve failed with unsuccessful implicit keep (user logfile /home/vmail/ otakuuniversity.org/test/dovecot.sieve.log may reveal additional details) Jun 17 00:48:15 nerv-03 dovecot: lda(test(a)otakuuniversity.org): msgid=<CANGr1k1wms7WC=dmQNFwbKdh7AF69PBYrz5VFqLrbvBjYgXtpw(a)mail.gmail.com>: rejected: Quota exceeded (mailbox for user is full) Jun 17 00:48:15 nerv-03 postfix/pickup[5887]: B3A1126265C: uid=5000 from=<> Jun 17 00:48:15 nerv-03 postfix/cleanup[20808]: B3A1126265C: message-id=< dovecot-1371422895-666694-0(a)nerv-03.otakuuniversity.org> Jun 17 00:48:15 nerv-03 postfix/pipe[20841]: 6CDC726265D: to=< test(a)otakuuniversity.org>, relay=dovecot, delay=0.29, delays=0.2/0.01/0/0.09, dsn=2.0.0, status=sent (delivered via dovecot service) Jun 17 00:48:15 nerv-03 postfix/qmgr[5885]: 6CDC726265D: removed Jun 17 00:48:15 nerv-03 postfix/qmgr[5885]: B3A1126265C: from=<>, size=4409, nrcpt=1 (queue active) Jun 17 00:48:15 nerv-03 postfix/smtp[20847]: certificate verification failed for gmail-smtp-in.l.google.com[173.194.70.27]:25: untrusted issuer /C=US/O=Equifax/OU=Equifax Secure Certificate Authority Jun 17 00:48:16 nerv-03 postfix/smtp[20847]: B3A1126265C: to=< jason.pfingstmann(a)gmail.com>, relay=gmail-smtp-in.l.google.com[173.194.70.27]:25, delay=0.87, delays=0.01/0.01/0.13/0.72, dsn=2.0.0, status=sent (250 2.0.0 OK 1371423370 p43si7910797eeu.4 - gsmtp) Jun 17 00:48:16 nerv-03 postfix/qmgr[5885]: B3A1126265C: removed trash.conf: 1 Spam 2 Trash Also tried INBOX.<folder>

1 0

[Dovecot] Transparent IMAP proxy
by Yonatan Broza 16 Jun '13

16 Jun '13

Hi, I'm considering patching Dovecot to work as a transparent (and virus scanning) IMAP proxy. What is the appropriate feature to extend? (I've considered the following: IMAPC and reverse proxying, with IMAPC looking more promising since it actually parses IMAP communication). Can anyone who is familiar with the IMAPC code recommend what are the most appropriate locations in the code to make the required changes? (I've considered hooking the storage virtual functions and making the settings local rather than global - but would appreciate more specific ideas). Thanks.

6 5

[Dovecot] Multiple user sharing a single mailbox
by Jonathon Price 16 Jun '13

16 Jun '13

I'm designing a system where some but not all groups of users want to share a single mailbox, i.e the user will not have there own inbox. I think this is possible by setting up a user database that returns the same mail location and possible the same home directory. This sharing would only occur in a single domain. Example User Database UserID | home | mail all(a)site1.example.com | /mail/home/site1.example.com/all | /mail/mailstorage/site1.example.com/all user1(a)site1.example.com | /mail/home/site1.example.com/user1| /mail/mailstorage/ site1.example.com/all user2(a)site1.example.com | /mail/home/site1.example.com/user2| /mail/mailstorage/ site1.example.com/all user1(a)site2.example.com | /mail/home/site2.example.com/user1| /mail/mailstorage/ site2.example.com/user1 user2(a)site2.example.com | /mail/home/site2.example.com/user2| /mail/mailstorage/ site2.example.com/user2 In this example all of site1.example.com users share a single mailbox, and site2.example.com users each have there own mailbox. Should the home directory also be shared, I read the comment that they should never be shared but wasn't sure if that still applied when the mailbox is the same path. For groups that are sharing a mailbox there would likely be a relatively low number of users concurrently logged in, say less than 10. For clustering we are currently limited to NFS mail storage. I was planning on using director setup so that the hashing/sharding is performed on the domain only, so all users for a domain will end up on a single node. At this stage clustering is mainly for high availability not performances. Lastly I'm concerned about possible issues with locking on the mailbox files and indexes. Will one of the mail formats reduces this risk, we can use any format as all mail will be written by Dovecot. Would giving each user there own index location help? and I assume this would mean that each user would see there own flags like read status? Does this setup sound ok, are there aspects that should change? thanks, Jon

3 4