October 2015 - dovecot

important message
by fila＠pruda.com 23 Oct '15

23 Oct '15

Hello! New message, please read <http://westelmmarketing.com/touched.php?bfyz> fila(a)pruda.com

1 0

help filtering messages
by James 22 Oct '15

22 Oct '15

Hello, I'm attempting to use sieve-filter on a local mailbox. I've defined mail_location as follows: % grep mail_location /etc/dovecot/conf.d/10-mail.conf mail_location = maildir:~/Mail I have a large number of mailboxes / mail in ~/Mail: ~ % find Mail | wc -l 63158 There are definitely a few messages in INBOX: ~ % find Mail/INBOX/cur | wc -l 5 I must admit, I'm completely new to sieve and have just begun experimenting with it. Based on a super helpful blog post[1], I quick set up the following ~/.sieve: % cat ~/.sieve require ["fileinto"]; # rule:[TEST] if header :contains "Subject" "Test Email" { fileinto "TEST"; stop; } As mentioned, there are numerous emails in INBOX. This email is located in ~/Mail/INBOX/cur/<blah> and, for verbosity (and to ensure I'm not making a foolish mistake), I've displayed it here: From: Test Account <test(a)test.com> To: "Me" <me(a)test.com> Subject: Test Email Date: Mon, 19 Oct 2015 14:55:06 +0000 This is a test email. Looking at the sieve filter recipe and email message, it appears that I should have a match, no? sieve-filter appears to disagree: % sieve-filter -C ~/.sieve INBOX sieve-filter(test_user): Debug: Effective uid=1000, gid=1000, home=/home/test_user sieve-filter(test_user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Mail sieve-filter(test_user): Debug: maildir++: root=/home/test_user/Mail, index=, indexpvt=, control=, inbox=/home/test_user/Mail, alt= Thinking this was because sieve will only filter on new messages, I moved the file from cur to new. No change. Any thoughts on why this may be happening? Thanks! 1 https://mebsd.com/configure-freebsd-servers/dovecot-pigeonhole-sieve-filter…

2 2

More information about - Dovecot 2.2.x quota mysql and dict
by Simon 22 Oct '15

22 Oct '15

I some add information about bug... Dovecot 2.2.19 version on server FreeBSD 10.2 Release. Config quota (dict + mysql) Database create Postfixadmin 2.3.7 Old version Dovecot 2.2.13 use method UPDATE in MySQL base + dict example mysql.log ----------------- Connect postfix@localhost on postfix 134 Query SELECT bytes FROM quota2 WHERE username = 'user(a)mydomain.lan' 135 Query SELECT bytes FROM quota2 WHERE username = 'user(a)mydomain.lan' 135 Query BEGIN 135 Query UPDATE quota2 SET bytes=bytes+2570,messages=messages+1 WHERE username = 'user(a)mydomain.lan' 136 Connect postfix@localhost on postfix 136 Query BEGIN 136 Query UPDATE domain SET quota=quota+2570 WHERE domain = 'mydomain.lan' 134 Query BEGIN 134 Query UPDATE quota2 SET bytes=bytes+1723,messages=messages+1 WHERE username = 'user(a)mydomain.lan' 137 Connect postfix@localhost on postfix 137 Query BEGIN 137 Query UPDATE domain SET quota=quota+1723 WHERE domain = 'mydomain.lan' 136 Query UPDATE quota2 SET messages=messages+1 WHERE username = 'mydomain.lan' - - - 137 Query COMMIT 151004 3:12:27 128 Quit ----------------- # cat dovecot-2.2.13/src/lib-dict/dict-sql.c === some text delete === static const char * sql_dict_update_query(const struct dict_sql_build_query *build) { struct sql_dict *dict = build->dict; const struct dict_sql_build_query_field *fields; unsigned int i, field_count; string_t *query; i_assert(build->inc); fields = array_get(&build->fields, &field_count); i_assert(field_count > 0); query = t_str_new(64); str_printfa(query, "UPDATE %s SET ", fields[0].map->table); #### this in code, work excellent for (i = 0; i < field_count; i++) { if (i > 0) str_append_c(query, ','); str_printfa(query, "%s=%s", fields[i].map->value_field, fields[i].map->value_field); if (fields[i].value[0] != '-') str_append_c(query, '+'); str_append(query, fields[i].value); } sql_dict_where_build(dict, fields[0].map, build->extra_values, build->key1, SQL_DICT_RECURSE_NONE, query); return str_c(query); } === === === Latest version Dovecot 2.2.19 use method DELETE/INSERT in MySQL base + dict 140 Connect postfix@localhost on postfix 140 Query SELECT quota FROM domain WHERE domain = 'mydomain.lan' 140 Query SELECT quota FROM domain WHERE domain = 'mydomain.lan' 140 Query SELECT messages FROM quota2 WHERE username = 'mydomain.lan' 140 Query BEGIN 140 Query DELETE FROM domain WHERE domain = 'mydomain.lan' 140 Query DELETE FROM quota2 WHERE username = 'mydomain.lan' 140 Query INSERT INTO domain (quota,domain) VALUES ('8581','mydomain.lan') ON DUPLICATE KEY UPDATE quota='8581' 151004 15:18:45 140 Quit # cat dovecot-2.2.19/src/lib-dict/dict-sql.c === some text delete === static void sql_dict_unset(struct dict_transaction_context *_ctx, const char *key) { struct sql_dict_transaction_context *ctx = (struct sql_dict_transaction_context *)_ctx; struct sql_dict *dict = (struct sql_dict *)_ctx->dict; const struct dict_sql_map *map; ARRAY_TYPE(const_string) values; if (ctx->prev_inc_map != NULL) sql_dict_prev_inc_flush(ctx); map = sql_dict_find_map(dict, key, &values); if (map == NULL) { i_error("sql dict unset: Invalid/unmapped key: %s", key); ctx->failed = TRUE; return; } T_BEGIN { string_t *query = t_str_new(256); const char *error; str_printfa(query, "DELETE FROM %s", map->table); #### here deleted all information about domain, this code i think need change if (sql_dict_where_build(dict, map, &values, key[0], SQL_DICT_RECURSE_NONE, query, &error) < 0) { i_error("dict-sql: Failed to delete %s: %s", key, error); ctx->failed = TRUE; } else { sql_update(ctx->sql_ctx, str_c(query)); } } T_END; } === === === Now dic + mysql doesn’t work in Dovecot 2.2.19, because first DELETE operator delete information from base about my domain mydomain.lan Thanks! Simon. -- View this message in context: http://dovecot.2317879.n4.nabble.com/More-information-about-Dovecot-2-2-x-q… Sent from the Dovecot mailing list archive at Nabble.com.

2 7

migration from zimbra to dovecot
by micah 21 Oct '15

21 Oct '15

Hello, Are there any migration scripts to handle UID conversion for moving from a zimbra setup to dovecot? It would be nice to move all the mail without having re-download it all! thanks! micah ps - asking for a friend

2 1

Dsync only indexes
by guest user 21 Oct '15

21 Oct '15

Hello, We are using dbox and we would like to put indexes on a separate storage, our actual setup have indexes on the same storage has the messages. Is there a way to only synchronise the indexes to easily change our setup ? Thanks.

1 0

Dovecot 2.2.19 - Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0)
by mailing lists 20 Oct '15

20 Oct '15

Hello everyone, For this installation I am using passdb against AD, userdb with MySQL and nfs storage but using simultaneously the vfile acl backend and the shared mailbox dictionary I get the following panic: Oct 19 12:34:51 server dovecot: imap-login: Login: user=<user04>, method=PLAIN, rip=10.112.99.52, lip=10.113.63.50, mpid=7538, session=<NKsDsnIiU7YKcGM0> Oct 19 12:34:51 server dovecot: dict(7540): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 19 12:34:51 server dovecot: dict(7540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x31826800ca] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3182680136] -> /usr/lib64/dovecot/libdovecot.so.0() [0x31826299ea] -> dovecot-mailbox/dict() [0x406abc] -> dovecot-mailbox/dict() [0x4047aa] -> dovecot-mailbox/dict() [0x404f32] -> dovecot-mailbox/dict(dict_command_input+0xab) [0x4050bb] -> dovecot-mailbox/dict() [0x40425b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x3182692deb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xb7) [0x31826943c7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x3182692e95] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3182693038] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x318262e953] -> dovecot-mailbox/dict(main+0x165) [0x405295] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x303be1ed5d] -> dovecot-mailbox/dict() [0x403da9] Oct 19 12:34:51 server dovecot: dict(7540): Fatal: master: service(dict): child 7540 killed with signal 6 (core dumps disabled) to reproduce the panic I only have to delete the dovecot-acl-list file and access the mailbox. It looks like that this commit http://hg.dovecot.org/dovecot-2.2/rev/7ccff6d5dd1b is causing the panic. # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 2.6.32-573.1.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) auth_master_user_separator = * auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-acl.conf.ext } disable_plaintext_auth = no instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_gid = vmail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " mail_log notify acl mailbox_alias quota listescape" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex im ap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace { list = children location = maildir:%%h/Mail:INDEX=~/shared/%%u:INDEXPVT=~/shared-pvt/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox sent_mail_folder { special_use = \Sent } mailbox trash_folder { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-pass_db-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size flags sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_actions = 32 sieve_max_redirects = 25 sieve_max_script_size = 1M sieve_quota_max_storage = 10M } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service dict { unix_listener dict { group = dovecot mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } service managesieve { process_limit = 1024 } ssl = no userdb { args = /etc/dovecot/dovecot-user_db-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol lda { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol imap { mail_plugins = " mail_log notify acl mailbox_alias quota listescape imap_acl imap_quota" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 1 managesieve_max_line_length = 65536 } protocol pop3 { mail_plugins = " mail_log notify acl mailbox_alias quota listescape" }

2 2

Hibernation disabled when mailbox selected
by Joseph Tam 19 Oct '15

19 Oct '15

After setting imap_hibernate_timeout to 60s, I could not find any hibernated connections after a few hours. I tested hibernation and made an observation: IDLE'd imap sessions only hibernate if they don't have a mailbox SELECT'd, otherwise they never hibernate. Is this the way it's supposed to work? Joseph Tam <jtam.home(a)gmail.com>

2 4

Dovecot 2.2.19 - Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0)
by mailing lists 19 Oct '15

19 Oct '15

Hello everyone, For this installation I am using passdb against AD, userdb with MySQL and nfs storage but using simultaneously the vfile acl backend and the shared mailbox dictionary I get the following panic: Oct 19 12:34:51 server dovecot: imap-login: Login: user=<user04>, method=PLAIN, rip=10.112.99.52, lip=10.113.63.50, mpid=7538, session=<NKsDsnIiU7YKcGM0> Oct 19 12:34:51 server dovecot: dict(7540): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 19 12:34:51 server dovecot: dict(7540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x31826800ca] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3182680136] -> /usr/lib64/dovecot/libdovecot.so.0() [0x31826299ea] -> dovecot-mailbox/dict() [0x406abc] -> dovecot-mailbox/dict() [0x4047aa] -> dovecot-mailbox/dict() [0x404f32] -> dovecot-mailbox/dict(dict_command_input+0xab) [0x4050bb] -> dovecot-mailbox/dict() [0x40425b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x3182692deb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xb7) [0x31826943c7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x3182692e95] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3182693038] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x318262e953] -> dovecot-mailbox/dict(main+0x165) [0x405295] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x303be1ed5d] -> dovecot-mailbox/dict() [0x403da9] Oct 19 12:34:51 server dovecot: dict(7540): Fatal: master: service(dict): child 7540 killed with signal 6 (core dumps disabled) am I missing something obvious or this is a dovecot bug? # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 2.6.32-573.1.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) auth_master_user_separator = * auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-acl.conf.ext } disable_plaintext_auth = no instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_gid = vmail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " mail_log notify acl mailbox_alias quota listescape" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex im ap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace { list = children location = maildir:%%h/Mail:INDEX=~/shared/%%u:INDEXPVT=~/shared-pvt/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox sent_mail_folder { special_use = \Sent } mailbox trash_folder { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-pass_db-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size flags sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_actions = 32 sieve_max_redirects = 25 sieve_max_script_size = 1M sieve_quota_max_storage = 10M } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service dict { unix_listener dict { group = dovecot mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } service managesieve { process_limit = 1024 } ssl = no userdb { args = /etc/dovecot/dovecot-user_db-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol lda { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol imap { mail_plugins = " mail_log notify acl mailbox_alias quota listescape imap_acl imap_quota" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 1 managesieve_max_line_length = 65536 } protocol pop3 { mail_plugins = " mail_log notify acl mailbox_alias quota listescape" }

1 0

Re: doveadm index assertion failed
by Nick Rosier 19 Oct '15

19 Oct '15

Timo Sirainen wrote: > On 05 Oct 2015, at 22:05, Nick Rosier<nick+dovecot(a)bunbun.be> wrote: >> Hi, >> >> one of my mailboxes returns following error when I run doveadm index on it: >> >> Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft<= CHARSET_MAX_PENDING_BUF_SIZE) >> >> OS: FreeBSD 10.2 >> Dovecot: 2.1.19 >> Tika: 1.10 >> SOLR: 5.3.1 > > I thought this would have definitely been fixed by now.. Can you find some specific email which is triggering this? It's either something strange that I didn't expect, or it's a bug in FreeBSD's iconv(). > > Also can you debug this like: > > gdb --args doveadm index -u user@domain INBOX > run > <it should crash now> > f 5 > p src > p ic_srcbuf > p *src_size > p srcleft I recompiled Dovecot with Debug but I suspect I will have to do it for all the required libraries as well; I did manage to find the offending message is in Trash but have not been able to pin-point which message it is. Just in case, here is the debugging info. I will see if I can compile all dependencies in debug mode as well. GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run Starting program: /usr/local/bin/doveadm index -u xxxx@xxxx Trash doveadm(xxxx@xxxx): Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) Program received signal SIGABRT, Aborted. 0x000000080149f64a in thr_kill () from /lib/libc.so.7 (gdb) f 5 #5 0x0000000801143cd3 in i_panic (format=0x801191c30 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 275 failures.c: No such file or directory. in failures.c Current language: auto; currently minimal (gdb) p src No symbol "src" in current context. (gdb) p ic_srcbuf No symbol "ic_srcbuf" in current context. (gdb) p *src_size No symbol "src_size" in current context. (gdb) p srcleft No symbol "srcleft" in current context.

2 3

TLS communication director -> backend with X.509 cert checks?
by Heiko Schlittermann 19 Oct '15

19 Oct '15

Hello, using Dovecot 2.2.9 and a setup with directors and backends. The communication between directors and backends needs to be TLS secured. The director config contains a list of hostnames for the backends. (implicit list because of multiple A/AAAA records for a single hostname or explicit list of several host names) On connection setup from a client the director connects to the selected backend. But it seems (not checked in the source yet), that for SSL certificate verification the director doesn't know the original host name anymore. The certificate's CN gets compared to the IP address the director connects to. Oct 12 23:56:51 director2 dovecot: director: Error: director(2001:683:921:f33::5:1:9090/out): connect() failed: Connection reset by peer Oct 12 23:57:53 director2 dovecot: imap-login: Error: proxy: hostname doesn't match SSL certificate at 2001:683:921:f33::5:fe:993: user=<foo>, method=PLAIN, rip=2001:638:912:f33::1:1, lip=2001:638:912:f33::5:2, TLS, session=<fLrUa+8hggAgAQY4CRIPMwAAAAAAAQAB> In 10-directors.conf I've: director_mail_servers = backend1.<domain> backend2.<domain> Should I create certificates with IP address in SAN? (Any hint about the correct syntax for the openssl.conf is welcome). Or is there any chance that this is fixed already or will be fixed in the near future or even better, that it's my fault? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 13