- dovecot - dovecot.org

maildir, how to always add size tags to filename (,S=).
by Sergei Franco 19 Jun '15

19 Jun '15

Hi There, I have thoroughly read through documentation and wiki and I simply cannot find how to force dovecot to always add the size tag to the filename when using maildir format. We are using dovecot 2.2.9 (whatever comes from ubuntu 14.04 LTS). We are using dovecot in conjunction with exim with maidirsize file enabled and maildir quotas. For example exim has following configuration: maildir_tag = ,S=$message_size Which adds the size to the filename of the message. This has enormous (orders of magnitude) performance benefit as to calculate quota one does not need to stat every single file (only getents for each directory). I have wrote a script that adds the size tag retrospectively to files it didn't had it, and rebuild the dovecot index/cache if changes where made. This worked fine. Behaviour of dovecot is very peculiar: it generally adds the ,S= tag (along with ,W= tag) but occasionally it does not (I wander if it depends on the IMAP client). Is there anyway to force dovecot to add size tag to the files (like with exim example above)? Thank you very much. Sergei.

3 2

Best practices for mailbox network file storage?
by Andy Csillag 18 Jun '15

18 Jun '15

Is there a current best practice for a shared filesystem backend for mailboxes (in my case, all virtual accounts)? NFS 3/4, GFS2, GlusterFS, other? In the case of the latter ones, is the use of Director necessary? Any specific anti-recommendations? Also, if it matters, I *think* I want to use BackBlaze racks for storage. Also, I've seen recommendations for the filesystem underneath like XFS or ext4 or whatever. Is there a best practice? Thanks, Drew

3 2

Help with Namespaces
by Steve Matzura 18 Jun '15

18 Jun '15

Most of my users are virtual. Do I need defined namespaces or is the default undefined one OK?

2 2

LMTP with Postfix Problem
by Steve Matzura 18 Jun '15

18 Jun '15

Here's a maillog entry that's one of many I receive when I try sending a test message to my system. The recipient is a virtual user in /etc/virtual. The way I'm expecting it to work is that my message from me to this Postfix virtual user will be sent back to me. Every time the message delivery is attempted, Dovecot says the LMTP directory doesn't exist. I thought it was created automatically as messages arrive. Jun 18 01:48:27 <machine-name> postfix/lmtp[30644]: 4CA5B8CB6: to=<postmaster@<my-domain>>, orig_to=<postmaster>, relay=none, delay=0.02, delays=0.02/0/0/0, dsn=4.4.1, status=deferred (connect to <my-FQDN>[private/dovecot-lmtp]: No such file or directory)

2 2

Pigeonhole vacation from alias address
by Dino Blazeka 18 Jun '15

18 Jun '15

Hi everyone. I've set up my instance not to check recipient address with sieve_vacation_dont_check_recipient=yes to enable users to set up their vacation script without listing addresses (there are to many). Only problem remaining is that when they receive an e-mail sent to their alias, the vacation response comes from their original mail address. Is there a setting or workaround that would enable vacation extension to send response with from field set to whichever address the original message was addressed to. Thank you in advance, Dino P. S. This is my first message to the list so I apologize in advance if I have broken any rules. It was not done intentionally

1 0

get failed auth
by My Work 18 Jun '15

18 Jun '15

Hi, how i can write all users to my db (mysql example) if it is possible that get "unknown user", "auth failed" e.g.? dovecot 2.2.13 root@dev0:/home/fov# dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.0 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 103 first_valid_uid = 101 listen = * mail_access_groups = mail,Debian-exim,dovecot mail_debug = yes mail_full_filesystem_access = yes mail_gid = 103 mail_location = maildir:/var/vmail/%d/%n mail_uid = 101 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = Junk autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Junk sieve = /var/vmail/%d/%n/currently-active-script.sieve sieve_dir = /var/vmail/%d/%n/sieve } protocols = imap sieve service auth { unix_listener auth-client { group = Debian-exim mode = 0666 user = Debian-exim } unix_listener auth-master { group = Debian-exim mode = 0666 user = Debian-exim } user = root } service imap-login { inet_listener imap { port = 143 } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { port = 2074 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { executable = /usr/lib/dovecot/managesieve process_limit = 10 } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /tmp/dovecot-deliver.log log_path = /tmp/dovecot-deliver.log mail_plugins = sieve postmaster_address = postmaster(a)horsetele.com.ua sendmail_path = /usr/sbin/exim4 } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = autocreate } protocol sieve { managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 }

2 1

privilege of process executed by extprograms plugin
by Takahiro Yakoh 18 Jun '15

18 Jun '15

Hi, I'm just a beginner of extprograms plugin of sieve. When I execute a process via execute or pipe command, the process start with "root" privilege. Why? I believe the process must be executed with recipient privilege. Give me some checkpoints, or hints, please. My setup is as follows: Ubuntu 14.04.2 LTS 64bit + dovecot-core, dovecot-sieve plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /some/where sieve_extensions = +vnd.dovecot.execute +vnd.dovecot.pipe sieve_pipe_bin_dir = /some/where sieve_plugins = sieve_extprograms } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster(a)some.where } Yakoh

1 0

bug in indexer/indexer-worker
by Infoomatic 18 Jun '15

18 Jun '15

Hi, I have already mentioned this in http://www.dovecot.org/pipermail/dovecot/2014-November/098592.html I could reproduce the errors above in a self-compiled v2.2.18 and the prebuilt packages from xi.rename-it.nl (in addition to version 2.2.15 mentioned in the link) The problem occurs when enabling fts_tika in the plugins (tried tika 1.6, 1.7 and 1.8). I tried to move a folder of my mailbox with about 2000 mails to my server (no users, modern hardware). At some point I get an error and from this time on dovecot keeps repeating the last lines with every mail that comes in ... see [1] I then get kernel syslog messages like in [2]. when I try to index all users (had another testuser) mailboxes with "doveadm index" I get the errors of [3]. The mailfolder does contain mails with attachments of all sorts, videos, office documents etc. When disabling fts_tika it works. dovecot -n output is [4] Could someone of the devs please have a look? best regards, infoomatic [1] Then comes the panic which produces loads of errormessages below the "Raw backtrace" part: Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f40b55c39d0 (line 411, fd 20) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f40b55c3780 (line 325) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Panic: file ioloop.c: line 39 (io_add_file): assertion failed: (callback != NULL) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x78320) [0x7f40b55f4320] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x783fe) [0x7f40b55f43fe] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f40b55a3b25] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x897d0) [0x7f40b56057d0] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f40b560643e] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f40b55f21d4] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f40b55c8148] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x44536) [0x7f40b55c0536] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x49) [0x7f40b108d469] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x3ac9) [0x7f40b1089ac9] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x3b6d) [0x7f40b1089b6d] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x86ec) [0x7f40b495c6ec] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x23) [0x7f40b495c723] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xe5cc) [0x7f40b49625cc] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xf451) [0x7f40b4963451] -> /opt/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xb454) [0x7f40b4b97454] -> /opt/dovecot/lib/dovecot/lib01_acl_plugin.so(+0xcfea) [0x7f40b4daafea] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x41) [0x7f40b58a64f1] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7f40b58a658e] -> dovecot/indexer-worker() [0x40250c] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f40b560615c] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7f40b56070ab] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f40b56061c9] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f40b5606248] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f40b55a9093] -> dovecot/indexer-worker(main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f40b51d8ec5] -> dovecot/indexer-worker() [0x401fc2] Jun 16 10:11:08 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2066 killed with signal 6 (core dumped) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f25bc1689d0 (line 120, fd 23) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f25bc168780 (line 325) Jun 16 10:11:09 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2124 killed with signal 11 (core dumped) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f6cabb149d0 (line 120, fd 23) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f6cabb14780 (line 325) Jun 16 10:11:09 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2125 killed with signal 11 (core dumped) [2] kernel syslog: [Tue Jun 16 09:51:15 2015] indexer-worker[7592]: segfault at 8 ip 00007f066e8c8c27 sp 00007fff36a038b0 error 4 in libdovecot.so.0.0.0[7f066e832000+e7000] [Tue Jun 16 09:51:16 2015] indexer-worker[7594]: segfault at 8 ip 00007f702671ac27 sp 00007ffc6e134840 error 4 in libdovecot.so.0.0.0[7f7026684000+e7000] [Tue Jun 16 09:51:16 2015] indexer-worker[7596]: segfault at 20 ip 00007fb8a5af2c47 sp 00007fff0a344780 error 4 in libdovecot.so.0.0.0[7fb8a5a69000+e7000] [Tue Jun 16 09:51:17 2015] indexer-worker[7598]: segfault at 20 ip 00007f5834b6ac47 sp 00007ffd54f35c00 error 4 in libdovecot.so.0.0.0[7f5834ae1000+e7000] [Tue Jun 16 09:51:18 2015] indexer-worker[7600]: segfault at 20 ip 00007f5b2f6fac47 sp 00007fff1a697690 error 4 in libdovecot.so.0.0.0[7f5b2f671000+e7000] [Tue Jun 16 09:51:19 2015] indexer-worker[7602]: segfault at 20 ip 00007fd6084ddc47 sp 00007ffdb4495af0 error 4 in libdovecot.so.0.0.0[7fd608454000+e7000] [Tue Jun 16 09:51:20 2015] indexer-worker[7604]: segfault at 20 ip 00007f7049789c47 sp 00007ffe71e4bdd0 error 4 in libdovecot.so.0.0.0[7f7049700000+e7000] [Tue Jun 16 09:51:20 2015] indexer-worker[7606]: segfault at 20 ip 00007f771d54dc47 sp 00007ffe01c6ff80 error 4 in libdovecot.so.0.0.0[7f771d4c4000+e7000] [Tue Jun 16 09:51:21 2015] indexer-worker[7608]: segfault at 20 ip 00007fc19d482c47 sp 00007ffc9a0b0280 error 4 in libdovecot.so.0.0.0[7fc19d3f9000+e7000] [Tue Jun 16 09:51:22 2015] indexer-worker[7610]: segfault at 29 ip 00007fa14df25c2b sp 00007ffeb246e5f0 error 4 in libdovecot.so.0.0.0[7fa14de8f000+e7000] [Tue Jun 16 09:51:23 2015] indexer-worker[7612]: segfault at 8 ip 00007fe8e41f2c27 sp 00007ffc700e2170 error 4 in libdovecot.so.0.0.0[7fe8e415c000+e7000] [Tue Jun 16 09:51:24 2015] indexer-worker[7614]: segfault at 8 ip 00007ff9a0c76c27 sp 00007fffecd44c90 error 4 in libdovecot.so.0.0.0[7ff9a0be0000+e7000] [Tue Jun 16 09:51:25 2015] indexer-worker[7616]: segfault at 8 ip 00007fd27867dc27 sp 00007ffedd8407f0 error 4 in libdovecot.so.0.0.0[7fd2785e7000+e7000] [Tue Jun 16 09:51:25 2015] indexer-worker[7618]: segfault at 8 ip 00007f94f8753c27 sp 00007fff56cc5ea0 error 4 in libdovecot.so.0.0.0[7f94f86bd000+e7000] [3] errors from "doveadm index": /opt/dovecot/bin/doveadm index -A '*' doveadm(user1): Warning: I/O leak: 0x7f0e072519d0 (line 120, fd 27) doveadm(user1): Warning: Timeout leak: 0x7f0e07251780 (line 325) Segmentation fault (core dumped) /opt/dovecot/bin/doveadm index -u user1 '*' doveadm(user1): Warning: I/O leak: 0x7f99b4fba9d0 (line 411, fd 14) doveadm(user1): Warning: Timeout leak: 0x7f99b4fba780 (line 325) doveadm(user1): Fatal: pool_system_realloc(17179869184): Out of memory doveadm(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x78320) [0x7f99b4feb320] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f99b4feb38a] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f99b4f9ac7f] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x8f3a3) [0x7f99b50023a3] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x7472d) [0x7f99b4fe772d] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x5f) [0x7f99b4fe7f5f] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handle_add+0x24) [0x7f99b4ffdd94] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x89761) [0x7f99b4ffc761] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f99b4ffd43e] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f99b4fe91d4] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f99b4fbf148] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x44536) [0x7f99b4fb7536] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x49) [0x7f99b0c9d469] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x373f) [0x7f99b0c9973f] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x91e8) [0x7f99b43541e8] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x95f0) [0x7f99b43545f0] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x714) [0x7f99b4354d34] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xf17e) [0x7f99b435a17e] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x19) [0x7f99b5294e89] -> /opt/dovecot/bin/doveadm() [0x423211] -> /opt/dovecot/bin/doveadm() [0x41ecc6] -> /opt/dovecot/bin/doveadm(doveadm_mail_try_run+0x27f) [0x41fb8f] -> /opt/dovecot/bin/doveadm(main+0x38f) [0x412a9f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f99b4bcfec5] -> /opt/dovecot/bin/doveadm() [0x412b99] [4] dovecot -n # 2.2.18: /opt/dovecot/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 3.13.0-52-generic x86_64 Ubuntu 14.04.2 LTS ext4 auth_username_format = %n auth_verbose = yes disable_plaintext_auth = no imap_idle_notify_interval = 5 mins mail_gid = vmail mail_home = /var/lib/vmail/home/%d/%u mail_location = mdbox:/var/lib/vmail/mail/%d/%u mail_plugins = fts fts_solr zlib acl quota zlib fts fts_solr acl mail_uid = vmail mailbox_idle_check_interval = 1 mins managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mdbox_rotate_size = 32 M namespace { list = children location = mdbox:/var/lib/vmail/mail/%d/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/var/lib/vmail/shared-mailboxes fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ break-imap-search fts_tika = http://localhost:8081/tika quota = dict:Quota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags zlib_save = gz zlib_save_level = 9 } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } service imap-login { inet_listener imaps { port = 0 } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/ssl/testhost/testhost.crt ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA ssl_key = </etc/ssl/testhost/testhost.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = fts fts_solr zlib sieve acl } protocol imap { mail_plugins = fts fts_solr zlib acl quota imap_acl imap_quota } protocol sieve { mail_plugins = fts fts_solr }

3 3

FTS lucene and english + german mails
by Felix Zielcke 17 Jun '15

17 Jun '15

Hi, I'm currently looking over the FTS pages to enable it in my dovecot. But I'm unsure what the best settings of the lucene plugin are, if you receive german and english mails. Wiki says: textcat_conf=<path> textcat_dir=<path>: If specified, enable guessing the stemming language for emails and search keywords. This is a little bit problematic in practice, since indexing and searching languages may differ and may not find even exact words because they stem differently. On Debian libstemmer is included in the debian-lucene package. So what settings are the best to have not the problem that exact words can't be found?

2 2

Sorry, wrong paste buffer
by Steve Matzura 17 Jun '15

17 Jun '15

Please ignore last message.

1 0