- dovecot - dovecot.org

help filtering messages
by James 23 Oct '15

23 Oct '15

Hello, I'm attempting to use sieve-filter on a local mailbox. I've defined mail_location as follows: % grep mail_location /etc/dovecot/conf.d/10-mail.conf mail_location = maildir:~/Mail I have a large number of mailboxes / mail in ~/Mail: ~ % find Mail | wc -l 63158 There are definitely a few messages in INBOX: ~ % find Mail/INBOX/cur | wc -l 5 I must admit, I'm completely new to sieve and have just begun experimenting with it. Based on a super helpful blog post[1], I quick set up the following ~/.sieve: % cat ~/.sieve require ["fileinto"]; # rule:[TEST] if header :contains "Subject" "Test Email" { fileinto "TEST"; stop; } As mentioned, there are numerous emails in INBOX. This email is located in ~/Mail/INBOX/cur/<blah> and, for verbosity (and to ensure I'm not making a foolish mistake), I've displayed it here: From: Test Account <test(a)test.com> To: "Me" <me(a)test.com> Subject: Test Email Date: Mon, 19 Oct 2015 14:55:06 +0000 This is a test email. Looking at the sieve filter recipe and email message, it appears that I should have a match, no? sieve-filter appears to disagree: % sieve-filter -C ~/.sieve INBOX sieve-filter(test_user): Debug: Effective uid=1000, gid=1000, home=/home/test_user sieve-filter(test_user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Mail sieve-filter(test_user): Debug: maildir++: root=/home/test_user/Mail, index=, indexpvt=, control=, inbox=/home/test_user/Mail, alt= Thinking this was because sieve will only filter on new messages, I moved the file from cur to new. No change. Any thoughts on why this may be happening? Thanks! 1 https://mebsd.com/configure-freebsd-servers/dovecot-pigeonhole-sieve-filter…

2 2

More information about - Dovecot 2.2.x quota mysql and dict
by Simon 22 Oct '15

22 Oct '15

I some add information about bug... Dovecot 2.2.19 version on server FreeBSD 10.2 Release. Config quota (dict + mysql) Database create Postfixadmin 2.3.7 Old version Dovecot 2.2.13 use method UPDATE in MySQL base + dict example mysql.log ----------------- Connect postfix@localhost on postfix 134 Query SELECT bytes FROM quota2 WHERE username = 'user(a)mydomain.lan' 135 Query SELECT bytes FROM quota2 WHERE username = 'user(a)mydomain.lan' 135 Query BEGIN 135 Query UPDATE quota2 SET bytes=bytes+2570,messages=messages+1 WHERE username = 'user(a)mydomain.lan' 136 Connect postfix@localhost on postfix 136 Query BEGIN 136 Query UPDATE domain SET quota=quota+2570 WHERE domain = 'mydomain.lan' 134 Query BEGIN 134 Query UPDATE quota2 SET bytes=bytes+1723,messages=messages+1 WHERE username = 'user(a)mydomain.lan' 137 Connect postfix@localhost on postfix 137 Query BEGIN 137 Query UPDATE domain SET quota=quota+1723 WHERE domain = 'mydomain.lan' 136 Query UPDATE quota2 SET messages=messages+1 WHERE username = 'mydomain.lan' - - - 137 Query COMMIT 151004 3:12:27 128 Quit ----------------- # cat dovecot-2.2.13/src/lib-dict/dict-sql.c === some text delete === static const char * sql_dict_update_query(const struct dict_sql_build_query *build) { struct sql_dict *dict = build->dict; const struct dict_sql_build_query_field *fields; unsigned int i, field_count; string_t *query; i_assert(build->inc); fields = array_get(&build->fields, &field_count); i_assert(field_count > 0); query = t_str_new(64); str_printfa(query, "UPDATE %s SET ", fields[0].map->table); #### this in code, work excellent for (i = 0; i < field_count; i++) { if (i > 0) str_append_c(query, ','); str_printfa(query, "%s=%s", fields[i].map->value_field, fields[i].map->value_field); if (fields[i].value[0] != '-') str_append_c(query, '+'); str_append(query, fields[i].value); } sql_dict_where_build(dict, fields[0].map, build->extra_values, build->key1, SQL_DICT_RECURSE_NONE, query); return str_c(query); } === === === Latest version Dovecot 2.2.19 use method DELETE/INSERT in MySQL base + dict 140 Connect postfix@localhost on postfix 140 Query SELECT quota FROM domain WHERE domain = 'mydomain.lan' 140 Query SELECT quota FROM domain WHERE domain = 'mydomain.lan' 140 Query SELECT messages FROM quota2 WHERE username = 'mydomain.lan' 140 Query BEGIN 140 Query DELETE FROM domain WHERE domain = 'mydomain.lan' 140 Query DELETE FROM quota2 WHERE username = 'mydomain.lan' 140 Query INSERT INTO domain (quota,domain) VALUES ('8581','mydomain.lan') ON DUPLICATE KEY UPDATE quota='8581' 151004 15:18:45 140 Quit # cat dovecot-2.2.19/src/lib-dict/dict-sql.c === some text delete === static void sql_dict_unset(struct dict_transaction_context *_ctx, const char *key) { struct sql_dict_transaction_context *ctx = (struct sql_dict_transaction_context *)_ctx; struct sql_dict *dict = (struct sql_dict *)_ctx->dict; const struct dict_sql_map *map; ARRAY_TYPE(const_string) values; if (ctx->prev_inc_map != NULL) sql_dict_prev_inc_flush(ctx); map = sql_dict_find_map(dict, key, &values); if (map == NULL) { i_error("sql dict unset: Invalid/unmapped key: %s", key); ctx->failed = TRUE; return; } T_BEGIN { string_t *query = t_str_new(256); const char *error; str_printfa(query, "DELETE FROM %s", map->table); #### here deleted all information about domain, this code i think need change if (sql_dict_where_build(dict, map, &values, key[0], SQL_DICT_RECURSE_NONE, query, &error) < 0) { i_error("dict-sql: Failed to delete %s: %s", key, error); ctx->failed = TRUE; } else { sql_update(ctx->sql_ctx, str_c(query)); } } T_END; } === === === Now dic + mysql doesn’t work in Dovecot 2.2.19, because first DELETE operator delete information from base about my domain mydomain.lan Thanks! Simon. -- View this message in context: http://dovecot.2317879.n4.nabble.com/More-information-about-Dovecot-2-2-x-q… Sent from the Dovecot mailing list archive at Nabble.com.

2 7

migration from zimbra to dovecot
by micah 22 Oct '15

22 Oct '15

Hello, Are there any migration scripts to handle UID conversion for moving from a zimbra setup to dovecot? It would be nice to move all the mail without having re-download it all! thanks! micah ps - asking for a friend

2 1

Dsync only indexes
by guest user 21 Oct '15

21 Oct '15

Hello, We are using dbox and we would like to put indexes on a separate storage, our actual setup have indexes on the same storage has the messages. Is there a way to only synchronise the indexes to easily change our setup ? Thanks.

1 0

Dovecot 2.2.19 - Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0)
by mailing lists 20 Oct '15

20 Oct '15

Hello everyone, For this installation I am using passdb against AD, userdb with MySQL and nfs storage but using simultaneously the vfile acl backend and the shared mailbox dictionary I get the following panic: Oct 19 12:34:51 server dovecot: imap-login: Login: user=<user04>, method=PLAIN, rip=10.112.99.52, lip=10.113.63.50, mpid=7538, session=<NKsDsnIiU7YKcGM0> Oct 19 12:34:51 server dovecot: dict(7540): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 19 12:34:51 server dovecot: dict(7540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x31826800ca] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3182680136] -> /usr/lib64/dovecot/libdovecot.so.0() [0x31826299ea] -> dovecot-mailbox/dict() [0x406abc] -> dovecot-mailbox/dict() [0x4047aa] -> dovecot-mailbox/dict() [0x404f32] -> dovecot-mailbox/dict(dict_command_input+0xab) [0x4050bb] -> dovecot-mailbox/dict() [0x40425b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x3182692deb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xb7) [0x31826943c7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x3182692e95] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3182693038] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x318262e953] -> dovecot-mailbox/dict(main+0x165) [0x405295] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x303be1ed5d] -> dovecot-mailbox/dict() [0x403da9] Oct 19 12:34:51 server dovecot: dict(7540): Fatal: master: service(dict): child 7540 killed with signal 6 (core dumps disabled) to reproduce the panic I only have to delete the dovecot-acl-list file and access the mailbox. It looks like that this commit http://hg.dovecot.org/dovecot-2.2/rev/7ccff6d5dd1b is causing the panic. # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 2.6.32-573.1.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) auth_master_user_separator = * auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-acl.conf.ext } disable_plaintext_auth = no instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_gid = vmail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " mail_log notify acl mailbox_alias quota listescape" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex im ap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace { list = children location = maildir:%%h/Mail:INDEX=~/shared/%%u:INDEXPVT=~/shared-pvt/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox sent_mail_folder { special_use = \Sent } mailbox trash_folder { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-pass_db-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size flags sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_actions = 32 sieve_max_redirects = 25 sieve_max_script_size = 1M sieve_quota_max_storage = 10M } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service dict { unix_listener dict { group = dovecot mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } service managesieve { process_limit = 1024 } ssl = no userdb { args = /etc/dovecot/dovecot-user_db-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol lda { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol imap { mail_plugins = " mail_log notify acl mailbox_alias quota listescape imap_acl imap_quota" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 1 managesieve_max_line_length = 65536 } protocol pop3 { mail_plugins = " mail_log notify acl mailbox_alias quota listescape" }

2 2

Hibernation disabled when mailbox selected
by Joseph Tam 20 Oct '15

20 Oct '15

After setting imap_hibernate_timeout to 60s, I could not find any hibernated connections after a few hours. I tested hibernation and made an observation: IDLE'd imap sessions only hibernate if they don't have a mailbox SELECT'd, otherwise they never hibernate. Is this the way it's supposed to work? Joseph Tam <jtam.home(a)gmail.com>

2 4

Dovecot 2.2.19 - Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0)
by mailing lists 19 Oct '15

19 Oct '15

Hello everyone, For this installation I am using passdb against AD, userdb with MySQL and nfs storage but using simultaneously the vfile acl backend and the shared mailbox dictionary I get the following panic: Oct 19 12:34:51 server dovecot: imap-login: Login: user=<user04>, method=PLAIN, rip=10.112.99.52, lip=10.113.63.50, mpid=7538, session=<NKsDsnIiU7YKcGM0> Oct 19 12:34:51 server dovecot: dict(7540): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 19 12:34:51 server dovecot: dict(7540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x31826800ca] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3182680136] -> /usr/lib64/dovecot/libdovecot.so.0() [0x31826299ea] -> dovecot-mailbox/dict() [0x406abc] -> dovecot-mailbox/dict() [0x4047aa] -> dovecot-mailbox/dict() [0x404f32] -> dovecot-mailbox/dict(dict_command_input+0xab) [0x4050bb] -> dovecot-mailbox/dict() [0x40425b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x3182692deb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xb7) [0x31826943c7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x3182692e95] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3182693038] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x318262e953] -> dovecot-mailbox/dict(main+0x165) [0x405295] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x303be1ed5d] -> dovecot-mailbox/dict() [0x403da9] Oct 19 12:34:51 server dovecot: dict(7540): Fatal: master: service(dict): child 7540 killed with signal 6 (core dumps disabled) am I missing something obvious or this is a dovecot bug? # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 2.6.32-573.1.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) auth_master_user_separator = * auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-acl.conf.ext } disable_plaintext_auth = no instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_gid = vmail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " mail_log notify acl mailbox_alias quota listescape" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex im ap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace { list = children location = maildir:%%h/Mail:INDEX=~/shared/%%u:INDEXPVT=~/shared-pvt/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox sent_mail_folder { special_use = \Sent } mailbox trash_folder { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-pass_db-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size flags sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_actions = 32 sieve_max_redirects = 25 sieve_max_script_size = 1M sieve_quota_max_storage = 10M } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service dict { unix_listener dict { group = dovecot mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } service managesieve { process_limit = 1024 } ssl = no userdb { args = /etc/dovecot/dovecot-user_db-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol lda { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol imap { mail_plugins = " mail_log notify acl mailbox_alias quota listescape imap_acl imap_quota" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 1 managesieve_max_line_length = 65536 } protocol pop3 { mail_plugins = " mail_log notify acl mailbox_alias quota listescape" }

1 0

Re: doveadm index assertion failed
by Nick Rosier 19 Oct '15

19 Oct '15

Timo Sirainen wrote: > On 05 Oct 2015, at 22:05, Nick Rosier<nick+dovecot(a)bunbun.be> wrote: >> Hi, >> >> one of my mailboxes returns following error when I run doveadm index on it: >> >> Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft<= CHARSET_MAX_PENDING_BUF_SIZE) >> >> OS: FreeBSD 10.2 >> Dovecot: 2.1.19 >> Tika: 1.10 >> SOLR: 5.3.1 > > I thought this would have definitely been fixed by now.. Can you find some specific email which is triggering this? It's either something strange that I didn't expect, or it's a bug in FreeBSD's iconv(). > > Also can you debug this like: > > gdb --args doveadm index -u user@domain INBOX > run > <it should crash now> > f 5 > p src > p ic_srcbuf > p *src_size > p srcleft I recompiled Dovecot with Debug but I suspect I will have to do it for all the required libraries as well; I did manage to find the offending message is in Trash but have not been able to pin-point which message it is. Just in case, here is the debugging info. I will see if I can compile all dependencies in debug mode as well. GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run Starting program: /usr/local/bin/doveadm index -u xxxx@xxxx Trash doveadm(xxxx@xxxx): Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) Program received signal SIGABRT, Aborted. 0x000000080149f64a in thr_kill () from /lib/libc.so.7 (gdb) f 5 #5 0x0000000801143cd3 in i_panic (format=0x801191c30 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 275 failures.c: No such file or directory. in failures.c Current language: auto; currently minimal (gdb) p src No symbol "src" in current context. (gdb) p ic_srcbuf No symbol "ic_srcbuf" in current context. (gdb) p *src_size No symbol "src_size" in current context. (gdb) p srcleft No symbol "srcleft" in current context.

2 3

TLS communication director -> backend with X.509 cert checks?
by Heiko Schlittermann 19 Oct '15

19 Oct '15

Hello, using Dovecot 2.2.9 and a setup with directors and backends. The communication between directors and backends needs to be TLS secured. The director config contains a list of hostnames for the backends. (implicit list because of multiple A/AAAA records for a single hostname or explicit list of several host names) On connection setup from a client the director connects to the selected backend. But it seems (not checked in the source yet), that for SSL certificate verification the director doesn't know the original host name anymore. The certificate's CN gets compared to the IP address the director connects to. Oct 12 23:56:51 director2 dovecot: director: Error: director(2001:683:921:f33::5:1:9090/out): connect() failed: Connection reset by peer Oct 12 23:57:53 director2 dovecot: imap-login: Error: proxy: hostname doesn't match SSL certificate at 2001:683:921:f33::5:fe:993: user=<foo>, method=PLAIN, rip=2001:638:912:f33::1:1, lip=2001:638:912:f33::5:2, TLS, session=<fLrUa+8hggAgAQY4CRIPMwAAAAAAAQAB> In 10-directors.conf I've: director_mail_servers = backend1.<domain> backend2.<domain> Should I create certificates with IP address in SAN? (Any hint about the correct syntax for the openssl.conf is welcome). Or is there any chance that this is fixed already or will be fixed in the near future or even better, that it's my fault? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 13

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 19 Oct '15

19 Oct '15

> > > Date: Fri, 16 Oct 2015 10:22:37 +0200 > From: grupo correo <grupodecorreo10(a)gmail.com> > To: dovecot(a)dovecot.org > Subject: Re: Problems sync with mail client MAC and > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > Message-ID: > < > CALxU0ypQfUkT5Df6ZeeN+_QrCfPcZF7tgDsOgGSM_84xVQF-eA(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > > > Date: Wed, 14 Oct 2015 11:43:22 +0200 > > From: Christian Kivalo <ml+dovecot(a)valo.at> > > To: Dovecot Mailing List <dovecot(a)dovecot.org> > > Subject: Re: Problems sync with mail client MAC and > > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > > Message-ID: <33ba2eacef5dcfcb4c703615e559b094(a)valo.at> > > Content-Type: text/plain; charset=US-ASCII; format=flowed > > > > > > > Attached the doveconf -n > > > Yes i have mail_debug = yes into file conf.d/10-logging.conf > > > I paste the rest of log: > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from > > > directory: /usr/lib64/dovecot > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib01_acl_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib02_imap_acl_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib10_quota_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib11_imap_quota_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Effective > > > uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > > root: > > > name=User quota backend=maildir args= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > > grace: root=User quota bytes=0 (10%) > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Namespace > > > inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, > > > list=children, subscriptions=yes location=maildir:~/Maildir > > > > Your inbox namespace seems to be ok and is also defined in your doveconf > > -n output. > > > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > maildir++: > > > root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, > > > inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > initializing backend with data: vfile > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > acl > > > username = xxxxxxxxxxxxxx > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > owner > > > = 1 > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl > > > vfile: > > > Global ACL directory: (none) > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Namespace : > > > type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, > > > subscriptions=no location=fail::LAYOUT=none > > > > Somehow there seems to be an empty namespace in addition to your inbox > > namespace. > > > > Is there a second namespace in your config somewhere? > > > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: > > > root=, index=, indexpvt=, control=, inbox=, alt= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: > > > service(imap): child 2464 killed with signal 11 (core dumps disabled) > > > > Just guessing: > > Could it be with Thunderbird that the second namespace is ignored when > > there is no subscription to it and the Apple mailprogram behaves > > differently? > > > > regards > > christian > > > > > > > > > Hi, > i can reproduce the error, conencting opnessl to port 993: > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot(a)dovecot.org > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > > ------------------------------ > > Hello, excuse me my last email, i clicked very fast..... I can reproduce the problem doing: - openssl s_client -host localhost -port 993 - 0 LOGIN xxxxxxxxxxxx xxxxxxxxxxxxxxxx ......... - 0 NAMESPACE * NAMESPACE (("INBOX." ".")) NIL (("#shared." ".")("shared." ".")) 0 OK NAMESPACE completed. 0 list "*" "" closed And the log show: Oct 19 09:35:58 localhost dovecot: imapxxxxxxxxxxxxxxxx): Fatal: master: service(imap): child 22048 killed with signal 11 (core dumps disabled) I can reproduce this problem with Mac email client and Outlook 2007. Best regards

1 0

replication full documentation
by MyWorking 19 Oct '15

19 Oct '15

Hi! I am create replication between two Debian 8.2 servers with dovecot 2.2.13. It work, but wont now more about replication used and i didn't now where i can red it: 1. aggregator - documentation and what he done? 2. replicator - full description or man for him 3. dsync - full description or man for him 4. doveadm replicator status - full description for all his points: * Queued 'sync' requests - when it started and what it is mean? * Queued 'high' requests - when it started and what it is mean? * Queued 'low' requests - when it started and what it is mean? * Queued 'failed' requests - when it started and what it is mean? * Queued 'full resync' requests - when it started and what it is mean? (wherry often i see this point is active on status for all my mail accounts) * Waiting 'failed' requests - i now what is it! * Total number of known users - i now what is it! 5. can dovecot create replication in real-time????

1 0

Doveadm client/server possible?
by Leon Kyneur 19 Oct '15

19 Oct '15

Hi As my mail infrastructure grows I'm now looking at the possibility of running all my doveadm commands from a central location. Wondering if there is a way to configure an inet_listener on doveadm and have a client elsewhere connect to it? Have seen the inet_listener for replication but not sure if it can also be used for general client server communication. Thanks Leon

1 0

Order in which UIDs are assigned..
by Akash 17 Oct '15

17 Oct '15

Hi, I just want some clarification on how Dovecot's IMAP assigns UIDs when it picks files from the "new" directory of a Maildir. What I am observing is that only ctime has a role to play in it. For example if there are two files in "new", a.msg & z.msg. Even when a.msg has lower mtime than z.msg and "a" comes before "z" alphabetically, dovecot will assign z.msg a lower UID if its ctime is lower than a.msg. Is this correct? Secondly, when mails are placed into Maildir through a external mechanism by-passing LDA, by any means is it possible for IMAP to run seive on it when it migrates the files from new to cur and indexes them? I understand that this might not be a valid question as mail is delivered already so there is nothing to filter :-) -Akash

2 4

doveadm-search-query pattern format
by Frank-Ulrich Sommer 17 Oct '15

17 Oct '15

Hello, the doveadm-search-query documentation specifies a 'pattern' for many search keys. Unfortunately it does not mention the format specification of this pattern (special characters, wildcards, ...). I'm using dovecot 2.2.9 but also searched the current documention on dovecot.org. Where can I find further documentation concerning the exact specification of the pattern format?

2 1

Re: doveadm index assertion failed
by Nick Rosier 16 Oct '15

16 Oct '15

Nick Rosier schreef: > > Timo Sirainen wrote: >> On 05 Oct 2015, at 22:05, Nick Rosier<nick+dovecot(a)bunbun.be> wrote: >>> Hi, >>> >>> one of my mailboxes returns following error when I run doveadm index on it: >>> >>> Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft<= CHARSET_MAX_PENDING_BUF_SIZE) >>> >>> OS: FreeBSD 10.2 >>> Dovecot: 2.1.19 >>> Tika: 1.10 >>> SOLR: 5.3.1 >> >> I thought this would have definitely been fixed by now.. Can you find some specific email which is triggering this? It's either something strange that I didn't expect, or it's a bug in FreeBSD's iconv(). >> >> Also can you debug this like: >> >> gdb --args doveadm index -u user@domain INBOX >> run >> <it should crash now> >> f 5 >> p src >> p ic_srcbuf >> p *src_size >> p srcleft > I recompiled Dovecot with Debug but I suspect I will have to do it for > all the required libraries as well; I did manage to find the offending > message is in Trash but have not been able to pin-point which message > it is. Just in case, here is the debugging info. I will see if I can > compile all dependencies in debug mode as well. > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and > you are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for > details. > This GDB was configured as "amd64-marcel-freebsd"... > (gdb) run > Starting program: /usr/local/bin/doveadm index -u xxxx@xxxx Trash > doveadm(xxxx@xxxx): Panic: file charset-iconv.c: line 85 > (charset_to_utf8_try): assertion failed: (srcleft <= > CHARSET_MAX_PENDING_BUF_SIZE) > > Program received signal SIGABRT, Aborted. > 0x000000080149f64a in thr_kill () from /lib/libc.so.7 > (gdb) f 5 > #5 0x0000000801143cd3 in i_panic (format=0x801191c30 "file %s: line > %d (%s): assertion failed: (%s)") at failures.c:275 > 275 failures.c: No such file or directory. > in failures.c > Current language: auto; currently minimal > (gdb) p src > No symbol "src" in current context. > (gdb) p ic_srcbuf > No symbol "ic_srcbuf" in current context. > (gdb) p *src_size > No symbol "src_size" in current context. > (gdb) p srcleft > No symbol "srcleft" in current context. > recompiled dovecot + all dependencies with debug but I get the same output. anything else I can try?

1 0

quotas configuration a few questions
by niya levi 16 Oct '15

16 Oct '15

hi everyone need a few questions answering if possible before i can complete some modifications on my mailserver 1 how do i modify my user_query line in dovecot-sql.conf for quotas 2 is my iterate_query line ok 3 should i use lmtp or lda to deliver the quota warnings in quota-warning.sh my server is using lmtp but i've only seen examples using lda 4 how do i break long lines in dovecot.conf, is it the same as postgresql where you leave a space on the next line before continuing the txt. i would like to break the cipher line in dovecot.conf over multiple lines 5 have i configured my namespace section correctly so that i can substitute for the autocreate plugin also could you give the files a quick look over to make sure there isn't any unnecessary additions that shouldn't be there or omissions that should be there thanks shadrock ============ /etc/dovecot/dovecot.conf disable_plaintext_auth = no mail_privileged_group = vmail log_timestamp = "%Y-%m-%d %H:%M:%S " log_path = /var/log/dovecot.log auth_debug_passwords=yes mail_debug=yes verbose_ssl=yes ssl_prefer_server_ciphers = yes ssl_dh_parameters_length = 2048 ssl_cert = </etc/ssl/certs/postfix.crt ssl_key = </etc/ssl/private/postfix.key ssl_ca = </etc/ssl/ca.crt ssl_protocols = !SSLv2 !SSLv3 ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH: auth_mechanisms = plain login passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } #namespace inbox { # separator = / # type = private # inbox = yes # location = maildir:/home/mailboxes/Maildir # list = yes # prefix = INBOX. #mailbox Drafts { # auto = subscribe # special_use = \Drafts #} #mailbox Junk { # auto = subscribe # special_use = \Junk #} #mailbox Sent { # auto = subscribe # special_use = \Sent #} #mailbox Trash { # auto = subscribe # special_use = \Trash #} #} mail_plugins = quota # protocols = "pop3 imap lmtp" protocols = pop3 imap lmtp sieve plugin { autocreate = Trash autocreate2 = Sent autosubscribe = Trash autosubscribe2 = Sent sieve = ~/.dovecot.sieve sieve_global_path = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ quota = dict:User quota::proxy::quotadict quota_rule2 = Trash:storage=+10%% quota_warning = storage=100%% quota-warning +100 %u quota_warning2 = storage=95%% quota-warning +95 %u quota_warning3 = storage=80%% quota-warning +80 %u quota_warning4 = -storage=100%% quota-warning -100 %u # user is no longer over quota } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } user = root } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } protocol imap { mail_plugins = $mail_plugins autocreate imap_quota } protocol sieve { managesieve_max_line_length = 65536 managesieve_implementation_string = dovecot log_path = /var/log/dovecot-sieve-errors.log info_log_path = /var/log/dovecot-sieve.log } protocol lmtp { postmaster_address=postmaster(a)thisdomain.co.uk hostname=testy.thisdomain.co.uk mail_plugins = $mail_plugins sieve quota info_log_path = /var/log/dovecot-lmtp.log } dict { quotadict = pgsql:/etc/dovecot/dovecot-dict-sql.conf } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } --(postgresql stuff)-- CREATE DATABASE mail WITH OWNER mailreader; CREATE TABLE aliases ( alias text NOT NULL, email text NOT NULL ); CREATE TABLE users ( email text NOT NULL, password text NOT NULL, maildir text NOT NULL, created timestamp with time zone DEFAULT now() ); CREATE TABLE vdomain ( domain text NOT NULL ); CREATE TABLE quota ( username varchar(100) not null, bytes bigint not null default 0, messages integer not null default 0, primary key (username) ); CREATE OR REPLACE FUNCTION merge_quota() RETURNS TRIGGER AS $$ BEGIN IF NEW.messages < 0 OR NEW.messages IS NULL THEN -- ugly kludge: we came here from this function, really do try to insert IF NEW.messages IS NULL THEN NEW.messages = 0; ELSE NEW.messages = -NEW.messages; END IF; return NEW; END IF; LOOP UPDATE quota SET bytes = bytes + NEW.bytes, messages = messages + NEW.messages WHERE username = NEW.username; IF found THEN RETURN NULL; END IF; BEGIN IF NEW.messages = 0 THEN INSERT INTO quota (bytes, messages, username) VALUES (NEW.bytes, NULL, NEW.username); ELSE INSERT INTO quota (bytes, messages, username) VALUES (NEW.bytes, -NEW.messages, NEW.username); END IF; return NULL; EXCEPTION WHEN unique_violation THEN -- someone just inserted the record, update it END; END LOOP; END; $$ LANGUAGE plpgsql; DROP TRIGGER IF EXISTS mergequota ON quota; CREATE TRIGGER mergequota BEFORE INSERT ON quota FOR EACH ROW EXECUTE PROCEDURE merge_quota(); --(postgresql stuff)-- ============ /etc/dovecot/dovecot-dict-sql.conf connect = host=/run/postgresql dbname=mail user=mailreader map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } ============ /etc/dovecot/dovecot-sql.conf driver = pgsql connect = host=/run/postgresql dbname=mail user=mailreader default_pass_scheme = SHA512 password_query = SELECT email as user, password FROM users WHERE email = '%u' user_query = SELECT email as user, 'maildir:/home/mailboxes/maildir/'||maildir as mail, '/home/mailboxes/maildir/'||maildir as home, 500 as uid, 500 as gid FROM users WHERE email = '%u' iterate_query = SELECT email AS user FROM users ============ /usr/local/bin/quota-warning.sh #!/bin/sh BOUNDARY="$1" USER="$2" MSG="" if [[ "$BOUNDARY" = "+100" ]]; then MSG="Your mailbox is now overfull (>100%). In order for your account to continue functioning properly, you need to remove some emails NOW." elif [[ "$BOUNDARY" = "+95" ]]; then MSG="Your mailbox is now over 95% full. Please remove some emails ASAP." elif [[ "$BOUNDARY" = "+80" ]]; then MSG="Your mailbox is now over 80% full. Please consider removing some emails to save space." elif [[ "$BOUNDARY" = "-100" ]]; then MSG="Your mailbox is now back to normal (<100%)." fi cat << EOF | /usr/lib/dovecot/lmtp -d $USER -o "plugin/quota=maildir:User quota:noenforcing" From: postmaster(a)yourdomain.com Subject: Email Account Quota Warning Dear User, $MSG Best regards, Your Mail System EOF

1 0

Strange indexing behavior on HTML emails ..
by Akash 16 Oct '15

16 Oct '15

Hi, In continuation to the issue I had posted about long back: http://www.dovecot.org/list/dovecot/2014-August/097362.html I did further testing today on a fresh new Debian & latest Dovecot and observed a undesired behavior. I am using fts_lucene & following sequence of commands on a empty test account me(a)myself.com: doveadm expunge -u 'my(a)myself.com' mailbox 'INBOX' all cat test.eml | /usr/lib/dovecot/dovecot-lda -e -f you(a)yourself.com -d me(a)myself.com doveadm search -u 'akash(a)mailjol.in' mailbox 'INBOX' text ABCD Search command does or doesn't find the email with slight variation in the content of test.eml. Here are the results: test.eml content: ----------------------------- From: you(a)yourself.com To: me(a)myself.com Subject: Test Message Content-Type: text/html <div id="mydiv">ABCD 1234</div> ----------------------------- RESULT: OK. The email is found. test.eml content (double quotes inside div tag replaced with single): ----------------------------- From: you(a)yourself.com To: me(a)myself.com Subject: Test Message Content-Type: text/html <div id='mydiv'>ABCD 1234</div> ----------------------------- RESULT: None. The email isn't found. test.eml content (single quotes in div but content/type header removed): ----------------------------- From: you(a)yourself.com To: me(a)myself.com Subject: Test Message <div id='mydiv'>ABCD 1234</div> ----------------------------- RESULT: OK. The email is found. What could be the reason for this? -Akash

3 7

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 16 Oct '15

16 Oct '15

> Message: 6 > Date: Wed, 14 Oct 2015 11:43:22 +0200 > From: Christian Kivalo <ml+dovecot(a)valo.at> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: Problems sync with mail client MAC and > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > Message-ID: <33ba2eacef5dcfcb4c703615e559b094(a)valo.at> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > > > Attached the doveconf -n > > Yes i have mail_debug = yes into file conf.d/10-logging.conf > > I paste the rest of log: > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from > > directory: /usr/lib64/dovecot > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib01_acl_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib02_imap_acl_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib10_quota_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib11_imap_quota_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Effective > > uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > root: > > name=User quota backend=maildir args= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > grace: root=User quota bytes=0 (10%) > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Namespace > > inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, > > list=children, subscriptions=yes location=maildir:~/Maildir > > Your inbox namespace seems to be ok and is also defined in your doveconf > -n output. > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > maildir++: > > root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, > > inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > initializing backend with data: vfile > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > acl > > username = xxxxxxxxxxxxxx > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > owner > > = 1 > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl > > vfile: > > Global ACL directory: (none) > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Namespace : > > type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, > > subscriptions=no location=fail::LAYOUT=none > > Somehow there seems to be an empty namespace in addition to your inbox > namespace. > > Is there a second namespace in your config somewhere? > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: > > root=, index=, indexpvt=, control=, inbox=, alt= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: > > service(imap): child 2464 killed with signal 11 (core dumps disabled) > > Just guessing: > Could it be with Thunderbird that the second namespace is ignored when > there is no subscription to it and the Apple mailprogram behaves > differently? > > regards > christian > > > > Hi, i can reproduce the error, conencting opnessl to port 993:

1 0

Problem with ldap - master user - sogo vacation
by zava.zava＠libero.it 16 Oct '15

16 Oct '15

Hi,I have a problem, i can't get the authentication for the master user using dovecot - ldap authentication, in combination with sogo.There is a script that is used by Sogo to check and disable the vacation messagge: "sogo /usr/sbin/sogo-tool expire-autoreply -p /etc/dovecot/master-users" Insidie this file there is: sogo:{SHA}gkodfgdk6yujkgdklkkdfkgjrg9ugr9p= if I run the script I get: Oct 16 09:59:12 auth: Debug: auth client connected (pid=6528)Oct 16 09:59:12 auth: Debug: client in: AUTH 1 PLAIN service=sieve secured session=aQDV64h65pAB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=4190 rport=36260 resp=Y2VkQGdyddgPQ== (previous base64 data may contain sensitive data)Oct 16 09:59:12 auth: Debug: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): Master user lookup for login: user(a)domain.comOct 16 09:59:12 auth: Debug: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): lookup: user=sogo file=/etc/dovecot/master-usersOct 16 09:59:12 auth: Info: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): Password mismatch (given password: {SHA}4sdgkfgwe22=)Oct 16 09:59:12 auth: Debug: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): SHA({SHA}kerwkekwrejkewerjrw=) != 'erwrewwweewrerewrwe='Oct 16 09:59:14 auth: Debug: client passdb out: FAIL 1 user=sogoOct 16 09:59:14 managesieve-login: Info: Disconnected (auth failed, 1 attempts in 2 secs): user=<sogo>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS: Disconnected, session=<aQDVKzQipAB/AAAB> In the auth-master.conf.ext file I have: passdb { driver = passwd-file master = yes args = /etc/dovecot/master-users} Thanks in advance for help. # 2.2.13: /etc/dovecot/dovecot.conf# OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 ext4auth_debug = yesauth_debug_passwords = yesauth_master_user_separator = *auth_mechanisms = plain auth_verbose = yesauth_verbose_passwords = yesdefault_client_limit = 22000default_process_limit = 5000default_vsz_limit = 1 Gdisable_plaintext_auth = nofirst_valid_gid = 5000first_valid_uid = 5000last_valid_gid = 5000last_valid_uid = 5000log_path = /var/log/dovecot.logmail_debug = yesmail_location = maildir:/var/vmail/xxx/%Ln/Maildirmanagesieve_notify_capability = mailtomanagesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notifynamespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = /}passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes}passdb { driver = pam}passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf1.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf3.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf4.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf5.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}plugin { sieve = /var/vmail/xxx/%n/.dovecot.sieve sieve_dir = /var/vmail/xxx/%n/ sieve_extensions = +enotify +vacation +copy +imapflags +notify}protocols = imap sieveservice auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0666 }}service imap { process_limit = 5000}service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 0 vsz_limit = 64 M}service managesieve { process_limit = 1024}ssl_cert = </etc/ssl/certs/xxx.pemssl_dh_parameters_length = 2048ssl_key = </etc/ssl/private/xxx.keyuserdb { args = uid=5000 gid=5000 home=/var/vmail/xxx/%Lu driver = passwd}userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf1.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf3.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf4.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf5.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}protocol imap { mail_max_userip_connections = 100 mail_plugins =}protocol sieve { mail_max_userip_connections = 10 managesieve_max_line_length = 65536}

1 0

master user in dovecot 1.2
by Michal Žila 16 Oct '15

16 Oct '15

Hello list, i would like to use master user functionality in dovecot v1.2, but i just cant get it to work: Here’s my configuration: # dovecot -n # 1.2.9: /etc/dovecot.conf # OS: Linux 2.6.18-164.10.1.el5PAE i686 Red Hat Enterprise Linux Server release 5.4 (Tikanga) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 200 mail_privileged_group: mail mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable(default): /root/dovecot-master-postlogin mail_executable(imap): /root/dovecot-master-postlogin mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)example.com auth default: master_user_separator: * debug: yes passdb: driver: passwd-file args: /etc/dovecot.passwd.masterusers pass: yes master: yes passdb: driver: pam userdb: driver: passwd # cat /root/dovecot-master-postlogin #!/bin/bash MASTER_USER=$USER export MASTER_USER exec /usr/libexec/dovecot/imap "$@“ # cat /etc/dovecot.passwd.masterusers masteruser:{PLAIN}Heslo42 Trying login as normal user: # telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. a1 login jozefkova jozefkova026 a1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in Trying login as master user: # telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. a1 login jozefkova*masteruser Heslo42 a1 NO [AUTHORIZATIONFAILED] Authorization failed log sequence of failed auth: Oct 15 13:04:47 linux dovecot: auth(default): client in: AUTH 1 PLAIN service=imap secured lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=34618 resp=<hidden> Oct 15 13:04:47 linux dovecot: auth(default): passwd-file(masteruser,127.0.0.1,master): lookup: user=masteruser file=/etc/dovecot.passwd.masterusers Oct 15 13:04:47 linux dovecot: auth(default): passdb(masteruser,127.0.0.1,master): Master user logging in as jozefkova Oct 15 13:04:47 linux dovecot: auth-worker(default): pam(jozefkova,127.0.0.1): lookup service=dovecot Oct 15 13:04:47 linux dovecot: auth-worker(default): pam(jozefkova,127.0.0.1): #1/1 style=1 msg=Password: Oct 15 13:04:49 linux dovecot: auth-worker(default): pam(jozefkova,127.0.0.1): pam_authenticate() failed: Authentication failure (password mismatch?) Oct 15 13:04:51 linux dovecot: auth(default): client out: FAIL 1 user=jozefkova authz So i can see it’s trying to loggin in using pam mech. Is there something i can configure in dovecot userdb or is it something else? I use pam to authenticate my real users… Thank you in advance… — Michal Zila

4 9

Dovecot top stats
by Kilburn Abrahams 15 Oct '15

15 Oct '15

Hi, I have being try to track down top email users to sometime. When I do a network traffic check I can see there is about 15 times more email traffic pulled from mail server than sent. The problem I am trying to track down is which users are the culprit. I have enabled doevcot stats and I can do a doveadm stats dump user but I get a 0 for disk_input, disk_output, read_bytes and write_bytes. I do get mail_read_bytes numbers but I am not sure these numbers are correct. I there a top utility that works well so I can see email traffic from users mailboxes. The doveadm top does not work well. I also tried the perl scripts and that does not do a much better job. Thanks Kilburn

2 2

Re: iterate users with passwd-file passdb?
by Joseph Tam 15 Oct '15

15 Oct '15

Eric Abrahamsen writes: > Simply: Is it possible to iterate over users if I'm using the > passwd-file passdb driver? Do I need a SQL-based driver if I want to > iterate? What do you mean by "iterate"? If you mean whether you can look up a password entry in a multi-entry file, then yes, definitely. If you mean to sequentially go through it and do a first/last/best match, probably not. Joseph Tam <jtam.home(a)gmail.com>

4 4

Emails with sender MISSING_MAILBOX@missing_domain
by grupo correo 15 Oct '15

15 Oct '15

Hello, we are working in the migration from courier-imap to dovecot 2.2.10-4.el7_0.1.x86_64. Some emails that send a internal application show as sender "MISSING_MAILBOX@missing_domain", i use like email client Horde using dovecot like server. But if i open that email with Horde and courier-imap i can see the correct email sender. I think that the email of the sender is no correct or not accomplish some RFC. Can anyone help me to understand this? Thank you

3 2

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 14 Oct '15

14 Oct '15

> > On 2015-10-13 09:20, grupo correo wrote: > > Hello, > > > > i have installed Centos 7.1.1503 with Dovecot 2.2.10-4.el7_0.1. With > > Thunderbird all works fine, but when i configure the email client of > > Mac > > (Yosemite) with IMAP i can see a error in the log and the client not > > see > > the emails: > > > > Oct 9 14:31:34 localhost dovecot: imap(xxxxxxx@xxxxxxx): Fatal: > > master: > > service(imap): child 18639 killed with signal 11 (core dumps disabled) > > Do you have more logs? > > Have you enabled mail_debug = yes to get more verbose logs? > > > > > I have read the instructions of http://www.dovecot.org/bugreport.html, > > but > > core file is not writing. > > > > Does anyone have this issues? I think that can be a problem in the > > configuration > > Please share your doveconf -n output. > > > Best regards > > regards > christian > Attached the doveconf -n Yes i have mail_debug = yes into file conf.d/10-logging.conf I paste the rest of log: Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from directory: /usr/lib64/dovecot Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib02_imap_acl_plugin.so Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Effective uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota root: name=User quota backend=maildir args= Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota grace: root=User quota bytes=0 (10%) Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=children, subscriptions=yes location=maildir:~/Maildir Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: maildir++: root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: initializing backend with data: vfile Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: acl username = xxxxxxxxxxxxxx Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: owner = 1 Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl vfile: Global ACL directory: (none) Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: service(imap): child 2464 killed with signal 11 (core dumps disabled)

2 1

Thanks for Dovecot
by Steve Litt 14 Oct '15

14 Oct '15

Hi all, Thanks for making Dovecot. I just transitioned from Debian Wheezy to Void Linux. It was fairly easy to get Dovecot working on my Void box, and having Dovecot makes all of my email activities easier by doing one thing and doing it right. Thank you for such great software. SteveT

6 5

Indexing fails with .. FIELDS_INDEX_EXTENSION).c_str() )' failed
by Akash 14 Oct '15

14 Oct '15

Hi, Mailing list archives suggest that this problem has been fixed in the older versions itself but I am getting the error still while trying to doveadm index a large folder of emails. Sometimes it throws error after 30000, something 40000, the latest it gave up after 111000. But it just never completes. 111000/322080doveadm: /home/stephan/packages/wheezy/i386/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:210: std::string lucene::index::DocumentsWriter::closeDocStore(): Assertion `numDocsInStore*8 == directory->fileLength( (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )' failed. Aborted I am using dovecot 2:2.2.19-1~auto+7& libclucene-core1:i386 2.3.3.4-4 from debian wheezy backports. Please advice. -Akash

3 2

Re: iterate users with passwd-file passdb?
by Joseph Tam 14 Oct '15

14 Oct '15

Eric Abrahamsen <eric(a)ericabrahamsen.net> writes: >>> Simply: Is it possible to iterate over users if I'm using the >>> passwd-file passdb driver? Do I need a SQL-based driver if I want to >>> iterate? >> >> What do you mean by "iterate"? If you mean whether you can look up a >> password entry in a multi-entry file, then yes, definitely. If you >> mean to sequentially go through it and do a first/last/best match, >> probably not. > > Basically I just mean the -A argument to the doveadm commands. For > example, iterate through all the users and run sa-learn on each user's > learn/spam folder. If it's got to be SQL, it won't kill me... Ah. Yes, you can use -A and iterate through users, subject to any constraints such as first_valid_uid, last_valid_uid, etc. Joseph Tam <jtam.home(a)gmail.com>

1 0

Dovecot - Postfix with HAproxy
by Michael JOIGNY 13 Oct '15

13 Oct '15

Hi Everyone, I wouldlike to set up a postfix-dovecot with HA using HAproxy but im facing issues. I've followed this documentation : http://wiki2.dovecot.org/HAProxy (pour dovecot) http://blog.haproxy.com/2012/06/30/efficient-smtp-relay-infrastructure-with… (pour postfix) Package's version : dovecot : 2:2.2.19 (>= 2.2.19 pour proxy protocol) haproxy : 1.5.14 postfix : 2.11.2-1 (>2.10 pour postscreen) A part of my configuration : ##HAPROXY #postfix listen smtp bind mail.xx.xx:465 balance roundrobin timeout client 1m timeout connect 5s no option http-server-close mode tcp option smtpchk option tcplog server tst tst.xxx:10465 send-proxy server tst2 tst2.xxx:10465 send-proxy server tst3 tst3.xxx:10465 send-proxy #dovecot listen imap bind mail.xxx.xx:993 timeout client 1m no option http-server-close balance leastconn stick store-request src stick-table type ip size 200k expire 30m mode tcp option tcplog server tst tst.xxx:10993 send-proxy-v2 server tst2tst2.xxx:10993 send-proxy-v2 server tst3 tst3.xxx:10993 send-proxy-v2 ##POSTFIX postix main.cf #Haproxy proxy protocol postscreen_upstream_proxy_protocol = haproxy postfix master.cf #haproxy 10465 inet n – n – 1 postscreen smtpd pass – – n – – smtpd S ##DOVECOT # 2.2.19 (719e7f8fd70b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 # OS: Linux 2.6.32-41-pve x86_64 Debian 7.9 simfs auth_debug = yes auth_verbose = yes disable_plaintext_auth = no *haproxy_timeout = 5 secs** **haproxy_trusted_networks = x.x.x.x* log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/mailbox/%d/%n mail_max_userip_connections = 0 mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_path = /mailbox/globalsieverc } protocols = sieve pop3 imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0660 user = mailboxes } unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } user = root } service imap-login { inet_listener imap { port = 0 } inet_listener imap_haproxy { haproxy = yes port = 10993 } inet_listener imaps { address = * port = 993 } process_limit = 450 } service pop3-login { inet_listener pop3 { address = * port = 110 } process_limit = 180 } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/star.key userdb { args = uid=5000 gid=5000 home=/mailbox/%d/%n/ allow_all_users=yes driver = static } protocol imap { imap_client_workarounds = } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol sieve { mail_location = maildir:/mailbox } protocol lda { auth_socket_path = /var/run/dovecot/auth-master hostname = xxx.yyy.com log_path = /var/log/dovecot/deliver.log mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = sieve postmaster_address = postmaster(a)xxx.yyy rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s sendmail_path = /usr/sbin/sendmail } With my mail client : With an IMAP connection, logs below, i don't understand why my login is empty ... dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts in 0 secs): *user=<>*, rip=mon_ip_publique, lip=ip_publique_haproxy, session= xxx With a SMTP connection, logs below, i have a timeout. postfix/postscreen[16654]: CONNECT from [my public ip]:49942 to [my haproxy public ip]:465 postfix/postscreen[16654]: PREGREET 166 after 0 from [mon ip publique]:49942: \22\3\1\161\1\157\3\3+0E\b\213\131\177\173>\r/\213\177i\223k”FjA#\144\145\153\vP\\\155HL\190 If someone could help me, thanks. Kind regards. --

2 1

Dualstack IPv4/IPv6 setup with directors
by Heiko Schlittermann 13 Oct '15

13 Oct '15

Hi, still using 2.2.9, I've two directors, and these directors use both IPv4/IPv6 addresses. `host directors.<domain>` returns one A and AAA for each of the two directors: directors.<domain> has address 149.x.y.96 (director1) directors.<domain> has address 149.x.y.97 (director2) directors.<domain> has IPv6 address 2001:x:y:f33::5:1 (director1) directors.<domain> has IPv6 address 2001:x:y:f33::5:2 (director2) But connecting the the neighbor director gives: Oct 13 21:23:29 director1 dovecot: director: Warning: Director 2001:x:y:f33::5:2:9090/left disconnected us with reason: Invalid input: ME 149.x.y.96 9090 Oct 13 21:23:29 director1 dovecot: director: Error: director(149.x.y.97:9090/out): connect() failed: Connection refused Oct 13 21:23:29 director1 dovecot: director: Warning: net_connect_ip(): ip->family != my_ip->family Oct 13 21:23:29 director1 dovecot: director: Error: Remote director thinks it's someone else (connected to 2001:x:y:f33::5:1:9090, remote says it's 149.x.y.96:9090) I assume it's because the director uses only one (IPv4 OR IPv6) address for it's own identity, right? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

Storage Design (Regligious War, Whatever)
by Kelsey Cummings 13 Oct '15

13 Oct '15

We've been running dovecot director setup using MAILDIR++ spools on NFS served by 4 (aging) Netapp clustered filers and are considering modernizing our storage. There's nothing particularly wrong with the existing storage except the age, density and power consumption don't compare well when against new systems. Refreshing the Netapps is an option but they come at a substantial cost. The last time we were looking one of the recommended hot DIY setups was Linux NFS backed by XFS on N mirrors but this predated the availability of stable ZFS in FreeBSD or Linux as well as products like FreeNAS. A FreeBSD NFS/ZFS filer on commodity hardware with zil/l2arc on a PCIe SSD seems like an attractive, affordable and easily scaled out solution which also would allow us to leverage compression at the filesystem layer. Does anyone have any experience running ZFS spool storage? If so, how do you handle DR/HA for spool storage? Thoughts on how this might compare to using DRBD? Any pitfalls to watch out for or general pointers? Suggestions on pool configuration? -K

1 0

Unknown cache fields?
by Larry Rosenman 13 Oct '15

13 Oct '15

I assume this is expected, but just checking. I do NOT use POP3. Oct 5 09:41:20 thebighonker dovecot: indexer-worker(mrm): Debug: Ignoring unknown cache field: pop3.order Oct 5 09:41:20 thebighonker dovecot: indexer-worker(mrm): Debug: Ignoring unknown cache field: binary.parts Oct 5 09:41:20 thebighonker dovecot: indexer-worker(mrm): Debug: Ignoring unknown cache field: body.snippet -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961

2 1

doveadm index assertion failed
by Nick Rosier 13 Oct '15

13 Oct '15

Hi, one of my mailboxes returns following error when I run doveadm index on it: Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) OS: FreeBSD 10.2 Dovecot: 2.1.19 Tika: 1.10 SOLR: 5.3.1 Running doveadm -D index does not show any more information indicating what causes this error (mail/folder/...) How I can find what is causing this error? Rgds, N.

2 1

Re: bug report: dovecot-imapd core dump
by Tamas Papp 13 Oct '15

13 Oct '15

Hi, could not find it -- back to the list, maybe someone can suggest a fix/workaround. Best, Tamas On Wed, Oct 07 2015, Dominik Breu wrote: > Hello, > > yeah this one looks familiar to me can you search the list back in > september there was a somewhat similar bug with thunderbird imho timo > posted a notice about it. > > greetings, > > dominik > > Am Mittwoch, den 07.10.2015, 15:53 +0200 schrieb Tamas Papp: >> Hi Dominik, >> >> Thanks for the help, the backtrace is here (I did not sent it to the >> list since I am not sure if it contains password or message >> information, >> sorry but I am unfamiliar with these things). >> >> Core was generated by `dovecot/imap'. >> Program terminated with signal SIGSEGV, Segmentation fault. >> #0 0x00007f404e58e3b6 in mail_index_keywords_unref >> #(_keywords=_keywords@entry=0x7ffecb8adeb8) at mail-index.c:383 >> 383 mail-index.c: No such file or directory. >> (gdb) bt full >> #0 0x00007f404e58e3b6 in mail_index_keywords_unref >> #(_keywords=_keywords@entry=0x7ffecb8adeb8) at mail-index.c:383 >> keywords = 0x7f404e27066d <buffer_alloc+45> >> __FUNCTION__ = "mail_index_keywords_unref" >> #1 0x00007f404e559975 in mailbox_keywords_unref >> (keywords=keywords@entry=0x7ffecb8adeb8) at mailbox-keywords.c:94 >> No locals. >> #2 0x00007f404ea254ad in cmd_append_handle_args >> (nonsync_r=0x7ffecb8ade8f, >> #args=<optimized out>, cmd=0x7f4050bc3250) at cmd-append.c:602 >> ctx = 0x7f4050bc3348 >> flags_list = 0x7f4050bcc840 >> flags = 9 >> keywords_list = 0x7f4050bc33f0 >> internal_date_str = 0x7f4050bcca00 "17-Sep-2015 14:19:23 >> +0200" >> internal_date = -1 >> timezone_offset = 0 >> keywords = 0x0 >> ret = <optimized out> >> client = 0x7f4050bc2670 >> cat_list = 0x0 >> input = <optimized out> >> valid = <optimized out> >> #3 cmd_append_parse_new_msg (cmd=cmd@entry=0x7f4050bc3250) at >> cmd-append.c:770 >> client = <optimized out> >> ctx = 0x7f4050bc3348 >> args = 0x7f4050bcc488 >> msg = <optimized out> >> arg_min_count = <optimized out> >> fatal = 255 >> nonsync = true >> last_literal = <optimized out> >> ret = <optimized out> >> __FUNCTION__ = "cmd_append_parse_new_msg" >> #4 0x00007f404ea25a17 in cmd_append (cmd=0x7f4050bc3250) at >> cmd-append.c:932 >> client = 0x7f4050bc2670 >> ctx = 0x7f4050bc3348 >> mailbox = 0x7f4050bafb78 "Cemex" >> #5 0x00007f404ea30e4c in command_exec (cmd=cmd@entry=0x7f4050bc3250) >> at >> imap-commands.c:158 >> hook = 0x7f4050bad0d0 >> ret = <optimized out> >> #6 0x00007f404ea2fd62 in client_command_input (cmd=0x7f4050bc3250) >> at >> imap-client.c:780 >> client = 0x7f4050bc2670 >> command = <optimized out> >> __FUNCTION__ = "client_command_input" >> #7 0x00007f404ea2fe16 in client_command_input (cmd=0x7f4050bc3250) >> at >> imap-client.c:841 >> client = 0x7f4050bc2670 >> command = <optimized out> >> __FUNCTION__ = "client_command_input" >> #8 0x00007f404ea3014d in client_handle_next_command >> (remove_io_r=<synthetic >> pointer>, client=0x7f4050bc2670) at imap-client.c:879 >> ---Type <return> to continue, or q <return> to quit--- >> No locals. >> #9 client_handle_input (client=0x7f4050bc2670) at imap-client.c:891 >> _data_stack_cur_id = 3 >> remove_io = false >> handled_commands = false >> client = 0x7f4050bc2670 >> #10 0x00007f404ea304f5 in client_input (client=0x7f4050bc2670) at >> imap-client.c:933 >> cmd = 0xf013c >> output = 0x7f4050bc30a0 >> bytes = 135 >> __FUNCTION__ = "client_input" >> #11 0x00007f404e285247 in io_loop_call_io (io=0x7f4050bc3170) at >> ioloop.c:388 >> ioloop = 0x7f4050bac720 >> t_id = 2 >> #12 0x00007f404e286079 in io_loop_handler_run >> (ioloop=ioloop@entry=0x7f4050bac720) at ioloop-epoll.c:220 >> ctx = 0x7f4050bad3b0 >> io = <optimized out> >> tv = {tv_sec = 1799, tv_usec = 999282} >> events_count = <optimized out> >> msecs = <optimized out> >> ret = 1 >> i = 0 >> j = <optimized out> >> call = <optimized out> >> __FUNCTION__ = "io_loop_handler_run" >> #13 0x00007f404e284d88 in io_loop_run (ioloop=0x7f4050bac720) at >> ioloop.c:412 >> __FUNCTION__ = "io_loop_run" >> #14 0x00007f404e231de3 in master_service_run (service=0x7f4050bac5b0, >> callback=<optimized out>) at master-service.c:566 >> No locals. >> #15 0x00007f404ea2424e in main (argc=1, argv=0x7f4050bac390) at >> main.c:400 >> set_roots = {0x7f404ec489c0 <imap_setting_parser_info>, 0x0} >> login_set = {auth_socket_path = 0x7f4050ba4048 "\001", >> postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = >> 0x7f404ea39f40 <login_client_connected>, >> failure_callback = 0x7f404ea39c20 <login_client_failed>, >> request_auth_token = 1} >> service_flags = <optimized out> >> storage_service_flags = <optimized out> >> username = 0x0 >> c = <optimized out> >> (gdb) quit >> >> Best, >> >> Tamas >> >> On Wed, Oct 07 2015, Dominik Breu wrote: >> >> > Hello >> > >> > Tamas it would be a better backtace when you have installed the >> > dovecot >> > debug symboly mostly located under dovecote-dbg in apt. Further >> > debug >> > help can you find in the wiki. >> > >> > greetings >> > >> > dominik >> > >> > Am Mittwoch, den 07.10.2015, 15:09 +0200 schrieb Tamas Papp: >> > > Typical log message: >> > > >> > > Oct 7 11:39:36 hostname dovecot: imap(username): Fatal: master: >> > > service(imap): child 14864 killed with signal 11 (core dumped) >> > > >> > > What triggers the problem: >> > > >> > > User moving multiple messages to a subfolder via IMAP (from >> > > another >> > > account, on another server, client: Thunderbird). Moving single >> > > messages >> > > either does not trigger the problem, or with much lower >> > > probability >> > > (could not reproduce). >> > > >> > > Version: >> > > $ dpkg -l 'dovecot*' >> > > Desired=Unknown/Install/Remove/Purge/Hold >> > > > Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig >> > > > -aWait/Trig-pend >> > > > / Err?=(none)/Reinst-required (Status,Err: uppercase=bad) >> > > > > / Name Version >> > > > > Architecture Description >> > > +++-=====================================-======================= >> > > -======================= >> > > -================================================================ >> > > ==== >> > > ============ >> > > un dovecot-common <none> >> > > <none> (no description available) >> > > ii dovecot-core 1:2.2.9-1ubuntu5 >> > > amd64 secure POP3/IMAP server - core files >> > > un dovecot-gssapi <none> >> > > <none> (no description available) >> > > ii dovecot-imapd 1:2.2.9-1ubuntu5 >> > > amd64 secure POP3/IMAP server - IMAP daemon >> > > un dovecot-ldap <none> >> > > <none> (no description available) >> > > un dovecot-lmtpd <none> >> > > <none> (no description available) >> > > un dovecot-managesieved <none> >> > > <none> (no description available) >> > > un dovecot-mysql <none> >> > > <none> (no description available) >> > > un dovecot-pgsql <none> >> > > <none> (no description available) >> > > un dovecot-pop3d <none> >> > > <none> (no description available) >> > > un dovecot-sieve <none> >> > > <none> (no description available) >> > > un dovecot-solr <none> >> > > <none> (no description available) >> > > un dovecot-sqlite <none> >> > > <none> (no description available) >> > > tamas@szob:~$ lsb_release -a >> > > No LSB modules are available. >> > > Distributor ID: Ubuntu >> > > Description: Ubuntu 15.04 >> > > Release: 15.04 >> > > Codename: vivid >> > > >> > > Also tried 2.2.18 from Ubuntu wiley, same results. >> > > >> > > Backtrace (I am not sure this is useful, extraced core from >> > > Ubuntu's >> > > Apport): >> > > >> > > (gdb) bt full >> > > #0 0x00007f404e58e3b6 in mail_index_keywords_unref () from >> > > /usr/lib/dovecot/libdovecot-storage.so.0 >> > > No symbol table info available. >> > > #1 0x00007f404ea254ad in _start () >> > > No symbol table info available. >> > > >> > > Any help would be appreciated, I am happy to provide more info if >> > > necessary. >> > > >> > > Tamas

2 2

dovecot as proxy and verification of the backends certificate
by Heiko Schlittermann 13 Oct '15

13 Oct '15

Hello, I'm using a dovecot as proxy, connecting to one or more backends. The backends use X.509 certificates. The proxy's passdb returns extra fields: user=foo proxy host=backend1.<domain> ssl=yes nopassword=y Thus the proxy connects to the backend but can't verify the backends certificate. The following comment suggests using ssl_client_ca_file for that. # Directory and/or file for trusted SSL CA certificates. These are used only # when Dovecot needs to act as an SSL client (e.g. imapc backend). The # directory is usually /etc/ssl/certs in Debian-based systems and the file is # /etc/pki/tls/cert.pem in RedHat-based systems. #ssl_client_ca_dir = #ssl_client_ca_file = ssl_client_ca_file = /tmp/certs/ca-local.pem But that does not work! Instead I've to use ssl_ca # PEM encoded trusted certificate authority. Set this only if you intend to use # ssl_verify_client_cert=yes. The file should contain the CA certificate(s) # followed by the matching CRL(s). (e.g. ssl_ca = </etc/ssl/certs/ca.pem) # ssl_ca = ssl_ca = </tmp/certs/ca-local.pem Bug or feature? Mainly I'm asking because the comments do not indicate that I should have used ssl_ca for this type of operation (dovecot as a SSL client) Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

Dovecot auth-ldap ignores tls_* settings when using ldaps://
by Heiko Schlittermann 13 Oct '15

13 Oct '15

Hi, I'm using dovecot 2.2.9 (but after checking src/auth/db-ldap.c in 2.2.13 there seems to be the same bug/feature). The userdb and passdb use LDAP. All further configuration is done in auth-ldap.conf.ext. uri = ldaps://<host>/ # tls = tls_cert_file = /etc/ssl/certs/client-cert.pem tls_key_file = /etc/ssl/certs/client-key.file Dovecot ignores the tls_* options. If I use an ldap:// URI and switch on TLS using tls=yes it works as expected. But I do not see any reason why LDAPS should not read the tls_* settings. This small patch solved it for me --- dovecot-2.2.9/src/auth/db-ldap.c 2013-11-24 14:37:39.000000000 +0100 +++ dovecot-2.2.9.hs12/src/auth/db-ldap.c 2015-10-08 21:24:47.051446465 +0200 @@ -1043,7 +1043,7 @@ static void db_ldap_set_tls_options(struct ldap_connection *conn) { - if (!conn->set.tls) + if (!(conn->set.tls || strncmp(conn->set.uris, "ldaps:", 6) == 0)) return; #ifdef OPENLDAP_TLS_OPTIONS It would be great, if somebody can confirm this and if this or some equivalent patch could make it upstream. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

Multiple core solr support
by Daniel Miller 13 Oct '15

13 Oct '15

Is it possible to use variables, such as domain or username, in the plugin url declaration? This would allow using multiple cores to separate the stored indexes. So when my own giant mailbox gets corrupt...I don't have to rebuild everybody's... Something like url=http://mysolr.server.com:8983/solr/%u -- Daniel

2 1

fts solr ignores new mailboxes until fts rescan
by Giorgio Paolucci 13 Oct '15

13 Oct '15

Hello, on my debian wheezy installation, I implemented fts plugin with solr as indexing system. I noticed that if a user creates a new folder, that folder it is ignored by dovecot indexing until a doveadm fts rescan is performed for that user. From that time on everything works ok on that folder. As a test I set fts_autoindex=yes and put in that folder a brand new mail never indexed before. in my logs indexer-worker says it indexed 0 messages Obviously this is a major issue as users often create new folders, but a search always returns empty results. My system is a debian wheezy with dovecot packages from backports dovecot 2.2.13-11~bpo70+1. Am I missing something? Any clue would be appreciated. Thank you all in advance. Bests Giorgio Paolucci ============================= doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 auth_default_realm = xxx disable_plaintext_auth = no log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota listescape mail_log notify fts fts_solr managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_interval = 1 days mdbox_rotate_size = 10 M mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext driver = sql } plugin { fts = solr fts_solr = url=http://%n.%1n.solr.csia:8983/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size pop3_migration_mailbox = INBOX quota = dict:User quota::file:/SYSTEM/USERS/homes/%d/%1u/%u/%u.quota quota_rule = *:storage=7000M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /SYSTEM/USERS/mailbox/%d/%1n/%u/.dovecotactive.sieve sieve_default = /etc/dovecot/default.sieve sieve_dir = /SYSTEM/USERS/mailbox/%d/%1n/%u/sieve } pop3c_host = 147.162.10.68 protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imaps { ssl = no } process_min_avail = 20 service_count = 1 } service imap { executable = imap postlogin process_limit = 4096 } service lmtp { executable = lmtp inet_listener lmtp { port = 2223 } process_min_avail = 15 } service pop3-login { inet_listener pop3s { ssl = no } } service pop3 { process_limit = 256 } service postlogin { executable = script-login -d rawlog user = vmail } service quota-warning { executable = script /SYSTEM/DOVECOT/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext driver = sql } protocol lmtp { info_log_path = /tmp/dovecot-lmtp-info.log log_path = /tmp/dovecot-lmtp.log mail_plugins = quota listescape mail_log notify sieve } protocol lda { mail_plugins = quota listescape mail_log notify } protocol imap { imap_max_line_length = 128 k mail_max_userip_connections = 20 mail_plugins = quota listescape mail_log notify fts fts_solr imap_quota } protocol doveadm { mail_plugins = quota listescape mail_log notify fts fts_solr pop3_migration } protocol pop3 { pop3_no_flag_updates = yes pop3_uidl_format = %10v.%09u

2 3

Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 13 Oct '15

13 Oct '15

Hello, i have installed Centos 7.1.1503 with Dovecot 2.2.10-4.el7_0.1. With Thunderbird all works fine, but when i configure the email client of Mac (Yosemite) with IMAP i can see a error in the log and the client not see the emails: Oct 9 14:31:34 localhost dovecot: imap(xxxxxxx@xxxxxxx): Fatal: master: service(imap): child 18639 killed with signal 11 (core dumps disabled) I have read the instructions of http://www.dovecot.org/bugreport.html, but core file is not writing. Does anyone have this issues? I think that can be a problem in the configuration Best regards

2 1

iterate users with passwd-file passdb?
by Eric Abrahamsen 12 Oct '15

12 Oct '15

Apologies for the basic question, but I've been googling and can't figure out if this is possible or not. Simply: Is it possible to iterate over users if I'm using the passwd-file passdb driver? Do I need a SQL-based driver if I want to iterate? Here's what I've got right now. I don't have many users, and would prefer to retain the simplicity of the passwd-file if possible. Thanks! passdb { driver = passwd-file args = username_format=%u scheme=ssha512 /etc/dovecot/passwd.db deny = no master = no pass = no skip = never result_failure = continue result_internalfail = continue result_success = return-ok } userdb { driver = static args = uid=5000 gid=5000 home=/var/mail/vmail/%d/%n }

1 0

Syncronizing two IMAP servers
by Timothy Murphy 10 Oct '15

10 Oct '15

I spend time in two places, in different countries. I have a local network in each place, with IMAP servers on each network. I collect email by fetchmail from various servers, and read email on my laptop with KMail. I tried using just one IMAP server, but this proved impractical. So I have two collections of the same sub-folders, on the two servers. I have two questions: 1. Is there a simpler way of organizing my email? 2. Given the current method, is there a way of syncronizing folders on the two servers? -- Timothy Murphy gayleard /at/ eircom.net School of Mathematics, Trinity College, Dublin

4 3

Maildir: ACLs/Unix perms and unable to see content of specific mailbox
by Olaf Marzocchi 10 Oct '15

10 Oct '15

Dear Dovecot users, hello. I will merge two issues I have into a single email because they may be related. I used dovecot on a OmniOS server since 2014 (currently OmniOS r151014) with the following configuration (it shows 2.2.18 because I recently updated dovecot, skipping only the PostgreSQL plugin): # 2.2.18: /etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc zfs mail_location = maildir:/tank/home/%u/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap ssl = required ssl_cert = </etc/dovecot/certs/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } You can see that I set the Maildir folder inside the shared home folders of my server (it is only one user, anyway). It always worked perfectly, but one-two months ago I changed the permissions of my whole home folder, recursively, to add proper ACLs. I needed them because the clients started using illumos kernel SMB (relying on ACLs) instead of Netatalk/AFP (relying on Unix perms only). I didn't realise I applied the ACLs also to the Maildir folder. Dovecot worked for several weeks fine, I noticed the issue only yesterday when a mailbox (see below) appeared in Thunderbird completely empty even if the "cur" subfolder on the server still contains all the mails. Dovecot was throwing some errors like: dovecot: [ID 583609 mail.error] imap(olaf): Error: rename(/tank/home/olaf/Maildir/.&A6k- Mailing Lists.Log/dovecot.index.cache) failed: Permission denied (euid=501(olaf) egid=501(olaf) UNIX perms appear ok (ACL/MAC wrong?)) dovecot: [ID 583609 mail.error] imap(olaf): Error: rename(/tank/home/olaf/Maildir/.&A6k- Mailing Lists.Log/dovecot.index.tmp, /tank/home/olaf/Maildir/.&A6k- Mailing Lists.Log/dovecot.index) failed: Permission denied dovecot: [ID 583609 mail.error] imap(olaf): Error: unlink(/tank/home/olaf/Maildir/subscriptions.lock) failed: Permission denied dovecot: [ID 583609 mail.error] imap(olaf): Error: rename(/tank/home/olaf/Maildir/subscriptions.lock, /tank/home/olaf/Maildir/subscriptions) failed: Permission denied I will post here the current permissions of the folder containing Maildir, of the Maildir itself, of its contents, and of the folder that appears empty when browsed with a client (Thunderbird). /tank/home/olaf $ ls -lV .. drwx------+ 16 olaf olaf 17 Sep 19 01:52 olaf user:olaf:rwxpdDaARWcCos:fd-----:allow group:2147483648:rwxpdDaARWcCos:fd-----:allow everyone@:rwxpdDaARWcCos:fd-----:deny /tank/home/olaf $ ls -lV drwxrwx--- 348 olaf olaf 359 Sep 19 01:51 Maildir owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow /tank/home/olaf $ ls -lV Maildir/ drwxrwx--- 2 olaf olaf 2 Jan 30 2014 cur owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow -rwxrwx--- 1 olaf olaf 21 Jan 30 2014 dovecot-keywords owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow (ALL THE SAME PERMISSIONS FOR THE OTHER FILES EXCEPT...) -rwxrwx--- 1 olaf olaf 13735 Jan 24 2015 subscriptions owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow -rw-rw---- 1 olaf olaf 13709 Sep 19 01:51 subscriptions.lock owner@:rw-p--aARWcCos:-------:allow group@:rw-p--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow The folder that appears empty: /tank/home/olaf $ ls -lV Maildir/.Generiche/ total 513 drwxrwx--- 2 olaf olaf 949 Sep 18 01:42 cur owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow -rwxrwx--- 1 olaf olaf 46 May 18 2014 dovecot-keywords owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow (ALL THE SAME PERMISSIONS FOR THE OTHER FILES) I really hope you will have the time to help me because I already applied the permissions recursively and I removed the ACLs, almost as it was before my mistake. I specified "almost" because originally (I checked the backups) the Maildir folder had an ACL that gave access permissions also to the group "mail": drwxrwx---+349 olaf olaf 359 Feb 16 2014 Maildir group:mail:rwxpdDaARWcCos:fd-----:allow owner@:rwxpdDaARWcCos:fd----I:allow group@:rwxpdDaARWcCos:fd----I:allow everyone@:rwxpdDaARWcCos:fd----I:deny Yesterday I haven't replicated it because from the documentation I understood it was not necessary. My questions, in short: - what are the permissions I need to give to the Maildir folder? I understood from the documentation it's 700, with my user/group (the one of the user accessing the mail). What about ACLs? and what about group "mail"? - the (only!) subfolder which appears empty in Thunderbird, may it depend on the permissions? maybe due to them the index was not updated and UIDs don't match. If after applying the correct permissions I still cannot see its contents, is there a way to recover the mails? the files are all still there. Sorry for the long email, but after several tries yesterday I exhausted my ideas. Regards, Olaf

2 4

Double Dots
by Ken Mandelberg 09 Oct '15

09 Oct '15

I've noticed lately that Dovecot seems to be inserting an extra dot in some url's contained in html email. The most consistent example I see is in the newsletters from the Washington Post. For example, if I look at the raw email on the mail server I see text that starts <http://link.washingtonpost.com/click But if I look at what Thunderbird shows it starts http://link..washingtonpost.com/click/ I don't think its Thunderbird adding the dot, since K9 mail on my Android phone shows the same issue. It's only after the IMAP delivery that the extra dot appears. We are running dovecot 2.0.12 Incidentally, the newsletter is full of these link.washington post url's. For each article it appears 3 times, once on title, once on a "read full article" link, and one on a picture. Its only the one on title, that gets the extra dot after its been through dovecot. Furthermore, it only happens from the second article on. Any ideas?

2 1

Dovecot plugin and Push Mail
by Steffan Cline 08 Oct '15

08 Oct '15

I’m posting this here and will in a couple other places to see if anyone has any experience with this and knows what I can do. My setup is CentOS 6 with postfix, procmail and dovecot administered via Virtualmin. Postfix of course receives the email. Procmail uses it’s hooks to run the email through spam assassin and clamd. After than procmail hands it off to dovecot/deliver to drop it in the user’s mail box. I use the following plugin for dovecot with the daemon to provide Apple push mail for iPhones. https://github.com/st3fan/dovecot-xaps-daemon https://github.com/st3fan/dovecot-xaps-plugin For the most part, this works awesome but have run into a bit of a race issue with notification of mail in a particular instance. On my computer I use Outlook for Mac which says it supports IDLE but is broken. When an email comes in, I ALWAYS get the notification via the dovecpt plugin for a push since Outlook is checking IMAP every 2 minutes. On a buddy’s setup, he uses Apple Mail which supports IDLE that actually works. When his email client is connected from his laptop, it does actually maintain a persistent connection and NEVER receives a notification from the dovecot plugin because I’m guessing dovecot/deliver sees that the email was received by the desktop client. I’m not sure how to make the plugin ALWAYS give a push. Is it a dovecot config? A bug in the plugin? I’m not sure. Suggestions? Thank you, Steffan Cline 602-793-0014

1 1

how to treat synonymous domain names as one
by Nikolai Krot 08 Oct '15

08 Oct '15

Hallo List Users, I am curious if there is a way to rewrite domain name to another domain name. My goal is to provide authentication and mailboxes for the synonymous domains in a single source while keeping all other domains separate. I have setup: auth_username_format = %Lu mail_location = /var/vmail/%d/%u/Maildir in userdb/passdb (passwd-file): /etc/dovecot/%d/users Say I have two synonymous domain names my-domain-1.com my-long-named-domain-1.com I want both to resolve to my-domain-1.com when %d variable is used in Dovecot configs, so that passwd-file is /etc/dovecot/my-domain-1.com/users mailbox is /var/vmail/my-domain-1.com/user/Maildir while keeping other domains unchanged my-other-domain-2.com should resolve to: passwd-file is /etc/dovecot/my-other-domain-2.com/users mailbox is /var/vmail/my-other-domain-2.com/user/Maildir thanks, Nikolai

2 2

bug report: dovecot-imapd core dump
by Tamas Papp 07 Oct '15

07 Oct '15

Typical log message: Oct 7 11:39:36 hostname dovecot: imap(username): Fatal: master: service(imap): child 14864 killed with signal 11 (core dumped) What triggers the problem: User moving multiple messages to a subfolder via IMAP (from another account, on another server, client: Thunderbird). Moving single messages either does not trigger the problem, or with much lower probability (could not reproduce). Version: $ dpkg -l 'dovecot*' Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-=====================================-=======================-=======================-================================================================================ un dovecot-common <none> <none> (no description available) ii dovecot-core 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - core files un dovecot-gssapi <none> <none> (no description available) ii dovecot-imapd 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - IMAP daemon un dovecot-ldap <none> <none> (no description available) un dovecot-lmtpd <none> <none> (no description available) un dovecot-managesieved <none> <none> (no description available) un dovecot-mysql <none> <none> (no description available) un dovecot-pgsql <none> <none> (no description available) un dovecot-pop3d <none> <none> (no description available) un dovecot-sieve <none> <none> (no description available) un dovecot-solr <none> <none> (no description available) un dovecot-sqlite <none> <none> (no description available) tamas@szob:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 15.04 Release: 15.04 Codename: vivid Also tried 2.2.18 from Ubuntu wiley, same results. Backtrace (I am not sure this is useful, extraced core from Ubuntu's Apport): (gdb) bt full #0 0x00007f404e58e3b6 in mail_index_keywords_unref () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007f404ea254ad in _start () No symbol table info available. Any help would be appreciated, I am happy to provide more info if necessary. Tamas

1 0

separate passdb for unix_listener
by Damon 07 Oct '15

07 Oct '15

I want to use a separate passed for the unix_listener (postfix smtp-auth) so i can limit access to the smtp server by user/domain using the postfixadmin database. I want to let users access map to receive email but not be able to send. Any ideas? Thanks Damon

3 2

Dovecot don't erase mails from storage.
by Carlos Baptista 05 Oct '15

05 Oct '15

Hi, I have a dovecot installation with a strange problem: all the mails stays in storage after deleted from users mailbox. If user logon after the mails are deleted, they don't receive them any more, but the m.## files aren’t deleted. This happens with pop3 (default for this installation) and/or imap. The dovecot is installed along postfix with mysql and multi-domains support Here's the dovecot conf ######################## dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab111.11 x86_64 Debian 7.9 auth_mechanisms = plain login first_valid_uid = 111 last_valid_uid = 111 lda_mailbox_autocreate = yes mail_debug = yes mail_gid = vmail mail_plugins = " quota" mail_privileged_group = vmail mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::file:%h/mail/dovecot-quota quota_rule = *:storage=500MB } postmaster_address = sysadmin(a)inside.pt protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { mail_plugins = " quota sieve" } protocol lda { mail_plugins = " quota" } protocol imap { mail_plugins = " quota imap_quota" } ############################### Here is an example of log file with debug Oct 02 17:50:38 auth: Debug: auth client connected (pid=11621) Oct 02 17:50:38 auth: Debug: client in: AUTH 1 PLAIN service=pop3 secured session=Xiif9iEhmgBV80+u lip=xxx.xxx.xxx.xxx rip=xxx.xxx.xxx.xxx lport=995 rport=53914 resp=<hidden> Oct 02 17:50:38 auth-worker(11561): Debug: sql(carla.franjoso(a)xxxxxxx.xx,xxx.xxx.xxx.xxx): query: /* dovecot-sql.conf password_query */ SELECT '/var/vmail/xxxxxx.xx/carla.franjoso' AS userdb_home, 'mdbox:~/mail' AS userdb_mail, 111 AS userdb_uid, 114 AS userdb_gid, CONCAT('*:bytes=', CAST(m.quota AS CHAR)) AS userdb_quota_rule, CONCAT(m.local_part, '@', d.name) AS user, m.password AS password FROM mailboxes AS m LEFT JOIN domains AS d ON m.domain_id = d.id WHERE m.local_part = 'carla.franjoso' AND d.name = 'xxxxxxx.xx' AND m.is_active AND d.is_active Oct 02 17:50:38 auth: Debug: client out: OK 1 user=carla.franjoso(a)xxxxxx.xx Oct 02 17:50:38 auth: Debug: master in: REQUEST 3537633281 11621 1 41ef179d4a37a603ce38c43fab768f78 Oct 02 17:50:38 auth: Debug: prefetch(carla.franjoso(a)xxxxxx.xx,xxx.xxx.xxx.xxx,<Xiif9iEhmgBV80+u>): success Oct 02 17:50:38 auth: Debug: master out: USER 3537633281 carla.franjoso(a)xxxxx.xx home=/var/vmail/xxxxxxxx/carla.franjoso mail=mdbox:~/mail uid=1 11 gid=114 quota_rule=*:bytes=104857600 Oct 02 17:50:38 pop3: Debug: Loading modules from directory: /usr/lib/dovecot/modules Oct 02 17:50:38 pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Oct 02 17:50:38 pop3: Debug: Added userdb setting: mail=mdbox:~/mail Oct 02 17:50:38 pop3: Debug: Added userdb setting: plugin/quota_rule=*:bytes=104857600 Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Effective uid=111, gid=114, home=/var/vmail/xxxxxxxx.xx/carla.franjoso Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Quota root: name=User quota backend=dict args=:file:/var/vmail/xxxxxxxxx.xx/carla.franjoso/mail/dovecot-quota Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Quota rule: root=User quota mailbox=* bytes=104857600 messages=0 Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: dict quota: user=carla.franjoso(a)xxxx.xx, uri=file:/var/vmail/xxxxxx,xx/carla.franjoso/mail/dovecot-quot a, noenforcing=0 Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes locatio n=mdbox:~/mail Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: fs: root=/var/vmail/ assis.pt/carla.franjoso/mail, index=, control=, inbox=, alt= Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Namespace : Using permissions from /var/vmail/xxxxxxx.xx/carla.franjoso/mail: mode=0700 gid=-1 What is "gid=-1" at the end of the log? Can anyone help? Thanks Carlos Baptista

2 1

Compiling v2.2.19 - internal compiler error: segmentation fault (test-timing.c -> int64_t issue?)
by Guest-X 05 Oct '15

05 Oct '15

Hi, I am trying to compile a 64-build of the latest dovecot v2.2.19 on my SuSE Linux Enterprise Server 10 (x64) system. I've run ./configure with two parameters, the --prefix one and the --with-ssldir one. During the make stage, I am getting the following 'internal compiler error' message : --------------------------------------------- [...] gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-test -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT test_lib-test-timing.o -MD -MP -MF .deps/test_lib-test-timing.Tpo -c -o test_lib-test-timing.o `test -f 'test-timing.c' || echo './'`test-timing.c test-timing.c: In function ‘test_timing’: test-timing.c:48: internal compiler error: Segmentation fault Please submit a full bug report, with preprocessed source if appropriate. See <URL:http://bugs.opensuse.org> for instructions. make[4]: *** [test_lib-test-timing.o] Error 1 ---------------------------------------------- The lines that seem to be causing the problem are the following ( from src/lib/test-timing.c ) : 45: void test_timing(void) 46: { 47: static int64_t test_input1[] = { 48: 20, 19, 18, 1, 2, 3, 4, 5, 6, 7, 8, 49: 9, 10, 11, 12, 13, 14, 15, 16, 17, -1 50: }; This is the first time that any version of dovecot (the v2.2 branch) couldn't compile on my system, and I've literally compiled every single release up to now. My gcc version is a very old one (4.1.2) : ---------------------------------------------- Using built-in specs. Target: x86_64-suse-linux Configured with: ../configure --enable-threads=posix --prefix=/usr --with-local-prefix=/usr/local --infodir=/usr/share/info --mandir=/usr/share/man --libdir=/usr/lib64 --libexecdir=/usr/lib64 --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-checking=release --with-gxx-include-dir=/usr/include/c++/4.1.2 --enable-ssp --disable-libssp --disable-libgcj --with-slibdir=/lib64 --with-system-zlib --enable-shared --enable-__cxa_atexit --enable-libstdcxx-allocator=new --program-suffix= --enable-version-specific-runtime-libs --without-system-libunwind --with-cpu=generic --host=x86_64-suse-linux Thread model: posix gcc version 4.1.2 20070115 (prerelease) (SUSE Linux) ----------------------------------------------- Don't know whether this helps, but I've noticed that if I change the int64_t to uint64_t in the following lines of the same file : 61: static int64_t *test_inputs[] = { 62: test_input1, test_input2, test_input3 63: }; ..then compilation finishes without errors, but I'm not certain what the practical consequences of this action might be. Can somebody help me please ? Thank you for your time.

1 0

Released Pigeonhole v0.4.9 for Dovecot v2.2.19
by Stephan Bosch 05 Oct '15

05 Oct '15

Hello Dovecot users, Here is the definitive 0.4.9 release. Only a few minor fixes were done since RC1. Changelog v0.4.9: * Properly implemented checking of ABI version for Sieve interpreter plugins, much like Dovecot itself does for plugins. This will prevent plugin ABI mismatches. + Implemented a vnd.dovecot.environment extension. This builds upon the standard environment extension and adds a few more environment items, such as username and default mailbox. It also creates a variables namespace so that environment items can be accessed directly. I am still thinking about more environment items that can be added. + Sieve extprograms plugin: Made line endings of the input passed to the external programs configurable. This can be configured separately for each of the three extensions. + ManageSieve: Implemented proxy XCLIENT support. This allows the proxy to pass client information to the back-end. - ManageSieve: Fixed an assert failure occurring when a client disconnects during the GETSCRIPT command. - doveadm sieve plugin: Fixed incorrect initialization of mail user. This caused a few memory leaks. - sieve-filter command line tool: Fixed handling of failure-related implicit keep when there is an explicit default destination folder. This caused message duplication. - lib-sieve: Fixed bug in RFC5322 header folding. Words longer than the optimal line length caused empty lines in the output, which would break the resulting message header. This surfaced in References: headers with very long message IDs. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.9.tar… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.9.tar… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

v2.2.19 released
by Timo Sirainen 03 Oct '15

03 Oct '15

http://dovecot.org/releases/2.2/dovecot-2.2.19.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.19.tar.gz.sig * pop3_deleted_flag has been broken since v2.2.10. Using it would cause buffer overflows, which could be exploitable. However, this bug would have become visible quite soon after users had deleted some POP3 mails, because the pop3 processes would have started crashing all the time even in normal use. * "doveadm director flush" command has a changed meaning now: It safely moves users to their wanted backends, instead of simply forgetting the mapping entirely and leaving the existing connections untouched. Use -F parameter to get the original unsafe behavior. + Added imap-hibernate processes (see imap_hibernate_timeout setting). IDLEing IMAP connections can be hibernated, which saves memory. + Optimized tracking mailboxes' vsizes (= sum of all messages' sizes). If mailbox_list_index=yes, it's also stored in there. This makes it very efficient to look up vsizes for all mailboxes. + Added a quota "count" backend, which uses the mailbox vsizes to get the current quota usage. It requires using the new quota_vsizes=yes setting, which tracks the messages' "virtual sizes" rather than "physical sizes". Their distiction is minor and mostly irrelevant nowadays (if mail sizes should be counted with LF or CRLF newlines). + "doveadm director up/down" commands added. The monitoring script should be using these commands instead of changing the vhost count. This allows admin to manually disable a server by changing the vhost count to 0 without the monitoring script changing it back. + Added support for HAProxy protocol: http://wiki2.dovecot.org/HAProxy + Added push-notification plugin framework, which can be used to easily implement push notifications to various backends. Implemented "ox" backend for notifying Open-Xchange via HTTP/json. + imap_logout_format supports more variables now, e.g. number of deleted messages. + pop3: Added pop3_delete_type setting (related to pop3_deleted_flag). + plugin { fts_enforced=yes } setting now fails body searches unless it can be done via the full text search engine. + Added %{passdb:*} and %{userdb:*} variables to various places + auth: Added ":protected" suffix for passdb and userdb fields. If used, the field doesn't overwrite an existing field. + IMAP/POP3 proxy: If a backend server dies, avoid client reconnection spikes by slowly disconnecting clients over time. This is enabled by setting login_proxy_max_disconnect_delay=secs passdb extra field. + imap: Added new read-only METADATA entries: /private/specialuse, /shared/comment, /shared/admin + imap: If client disconnects in the middle of a command, log how long the command had been running. - mdbox: Rebuilding could have caused message's reference count to overflow the 16bit number in some situations, causing problems when trying to expunge the duplicates. - Various search fixes (fts, solr, tika, lib-charset, indexer) - Various virtual plugin fixes - Various fixes and optimizations to dsync, imapc and pop3-migration - imap: Various RFC compliancy and crash fixes to NOTIFY

3 6