- dovecot - dovecot.org

Dsync only indexes
by guest user 21 Oct '15

21 Oct '15

Hello, We are using dbox and we would like to put indexes on a separate storage, our actual setup have indexes on the same storage has the messages. Is there a way to only synchronise the indexes to easily change our setup ? Thanks.

1 0

Dovecot 2.2.19 - Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0)
by mailing lists 20 Oct '15

20 Oct '15

Hello everyone, For this installation I am using passdb against AD, userdb with MySQL and nfs storage but using simultaneously the vfile acl backend and the shared mailbox dictionary I get the following panic: Oct 19 12:34:51 server dovecot: imap-login: Login: user=<user04>, method=PLAIN, rip=10.112.99.52, lip=10.113.63.50, mpid=7538, session=<NKsDsnIiU7YKcGM0> Oct 19 12:34:51 server dovecot: dict(7540): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 19 12:34:51 server dovecot: dict(7540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x31826800ca] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3182680136] -> /usr/lib64/dovecot/libdovecot.so.0() [0x31826299ea] -> dovecot-mailbox/dict() [0x406abc] -> dovecot-mailbox/dict() [0x4047aa] -> dovecot-mailbox/dict() [0x404f32] -> dovecot-mailbox/dict(dict_command_input+0xab) [0x4050bb] -> dovecot-mailbox/dict() [0x40425b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x3182692deb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xb7) [0x31826943c7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x3182692e95] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3182693038] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x318262e953] -> dovecot-mailbox/dict(main+0x165) [0x405295] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x303be1ed5d] -> dovecot-mailbox/dict() [0x403da9] Oct 19 12:34:51 server dovecot: dict(7540): Fatal: master: service(dict): child 7540 killed with signal 6 (core dumps disabled) to reproduce the panic I only have to delete the dovecot-acl-list file and access the mailbox. It looks like that this commit http://hg.dovecot.org/dovecot-2.2/rev/7ccff6d5dd1b is causing the panic. # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 2.6.32-573.1.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) auth_master_user_separator = * auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-acl.conf.ext } disable_plaintext_auth = no instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_gid = vmail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " mail_log notify acl mailbox_alias quota listescape" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex im ap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace { list = children location = maildir:%%h/Mail:INDEX=~/shared/%%u:INDEXPVT=~/shared-pvt/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox sent_mail_folder { special_use = \Sent } mailbox trash_folder { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-pass_db-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size flags sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_actions = 32 sieve_max_redirects = 25 sieve_max_script_size = 1M sieve_quota_max_storage = 10M } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service dict { unix_listener dict { group = dovecot mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } service managesieve { process_limit = 1024 } ssl = no userdb { args = /etc/dovecot/dovecot-user_db-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol lda { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol imap { mail_plugins = " mail_log notify acl mailbox_alias quota listescape imap_acl imap_quota" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 1 managesieve_max_line_length = 65536 } protocol pop3 { mail_plugins = " mail_log notify acl mailbox_alias quota listescape" }

2 2

Hibernation disabled when mailbox selected
by Joseph Tam 19 Oct '15

19 Oct '15

After setting imap_hibernate_timeout to 60s, I could not find any hibernated connections after a few hours. I tested hibernation and made an observation: IDLE'd imap sessions only hibernate if they don't have a mailbox SELECT'd, otherwise they never hibernate. Is this the way it's supposed to work? Joseph Tam <jtam.home(a)gmail.com>

2 4

Dovecot 2.2.19 - Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0)
by mailing lists 19 Oct '15

19 Oct '15

Hello everyone, For this installation I am using passdb against AD, userdb with MySQL and nfs storage but using simultaneously the vfile acl backend and the shared mailbox dictionary I get the following panic: Oct 19 12:34:51 server dovecot: imap-login: Login: user=<user04>, method=PLAIN, rip=10.112.99.52, lip=10.113.63.50, mpid=7538, session=<NKsDsnIiU7YKcGM0> Oct 19 12:34:51 server dovecot: dict(7540): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 19 12:34:51 server dovecot: dict(7540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x31826800ca] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3182680136] -> /usr/lib64/dovecot/libdovecot.so.0() [0x31826299ea] -> dovecot-mailbox/dict() [0x406abc] -> dovecot-mailbox/dict() [0x4047aa] -> dovecot-mailbox/dict() [0x404f32] -> dovecot-mailbox/dict(dict_command_input+0xab) [0x4050bb] -> dovecot-mailbox/dict() [0x40425b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x3182692deb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xb7) [0x31826943c7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x3182692e95] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x3182693038] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x318262e953] -> dovecot-mailbox/dict(main+0x165) [0x405295] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x303be1ed5d] -> dovecot-mailbox/dict() [0x403da9] Oct 19 12:34:51 server dovecot: dict(7540): Fatal: master: service(dict): child 7540 killed with signal 6 (core dumps disabled) am I missing something obvious or this is a dovecot bug? # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 2.6.32-573.1.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) auth_master_user_separator = * auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/dovecot-dict-acl.conf.ext } disable_plaintext_auth = no instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_gid = vmail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " mail_log notify acl mailbox_alias quota listescape" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex im ap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace { list = children location = maildir:%%h/Mail:INDEX=~/shared/%%u:INDEXPVT=~/shared-pvt/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox sent_mail_folder { special_use = \Sent } mailbox trash_folder { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-pass_db-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size flags sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_actions = 32 sieve_max_redirects = 25 sieve_max_script_size = 1M sieve_quota_max_storage = 10M } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service dict { unix_listener dict { group = dovecot mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } service managesieve { process_limit = 1024 } ssl = no userdb { args = /etc/dovecot/dovecot-user_db-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol lda { mail_plugins = " mail_log notify acl mailbox_alias quota listescape sieve" } protocol imap { mail_plugins = " mail_log notify acl mailbox_alias quota listescape imap_acl imap_quota" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 1 managesieve_max_line_length = 65536 } protocol pop3 { mail_plugins = " mail_log notify acl mailbox_alias quota listescape" }

1 0

Re: doveadm index assertion failed
by Nick Rosier 19 Oct '15

19 Oct '15

Timo Sirainen wrote: > On 05 Oct 2015, at 22:05, Nick Rosier<nick+dovecot(a)bunbun.be> wrote: >> Hi, >> >> one of my mailboxes returns following error when I run doveadm index on it: >> >> Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft<= CHARSET_MAX_PENDING_BUF_SIZE) >> >> OS: FreeBSD 10.2 >> Dovecot: 2.1.19 >> Tika: 1.10 >> SOLR: 5.3.1 > > I thought this would have definitely been fixed by now.. Can you find some specific email which is triggering this? It's either something strange that I didn't expect, or it's a bug in FreeBSD's iconv(). > > Also can you debug this like: > > gdb --args doveadm index -u user@domain INBOX > run > <it should crash now> > f 5 > p src > p ic_srcbuf > p *src_size > p srcleft I recompiled Dovecot with Debug but I suspect I will have to do it for all the required libraries as well; I did manage to find the offending message is in Trash but have not been able to pin-point which message it is. Just in case, here is the debugging info. I will see if I can compile all dependencies in debug mode as well. GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run Starting program: /usr/local/bin/doveadm index -u xxxx@xxxx Trash doveadm(xxxx@xxxx): Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) Program received signal SIGABRT, Aborted. 0x000000080149f64a in thr_kill () from /lib/libc.so.7 (gdb) f 5 #5 0x0000000801143cd3 in i_panic (format=0x801191c30 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 275 failures.c: No such file or directory. in failures.c Current language: auto; currently minimal (gdb) p src No symbol "src" in current context. (gdb) p ic_srcbuf No symbol "ic_srcbuf" in current context. (gdb) p *src_size No symbol "src_size" in current context. (gdb) p srcleft No symbol "srcleft" in current context.

2 3

TLS communication director -> backend with X.509 cert checks?
by Heiko Schlittermann 19 Oct '15

19 Oct '15

Hello, using Dovecot 2.2.9 and a setup with directors and backends. The communication between directors and backends needs to be TLS secured. The director config contains a list of hostnames for the backends. (implicit list because of multiple A/AAAA records for a single hostname or explicit list of several host names) On connection setup from a client the director connects to the selected backend. But it seems (not checked in the source yet), that for SSL certificate verification the director doesn't know the original host name anymore. The certificate's CN gets compared to the IP address the director connects to. Oct 12 23:56:51 director2 dovecot: director: Error: director(2001:683:921:f33::5:1:9090/out): connect() failed: Connection reset by peer Oct 12 23:57:53 director2 dovecot: imap-login: Error: proxy: hostname doesn't match SSL certificate at 2001:683:921:f33::5:fe:993: user=<foo>, method=PLAIN, rip=2001:638:912:f33::1:1, lip=2001:638:912:f33::5:2, TLS, session=<fLrUa+8hggAgAQY4CRIPMwAAAAAAAQAB> In 10-directors.conf I've: director_mail_servers = backend1.<domain> backend2.<domain> Should I create certificates with IP address in SAN? (Any hint about the correct syntax for the openssl.conf is welcome). Or is there any chance that this is fixed already or will be fixed in the near future or even better, that it's my fault? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 13

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 19 Oct '15

19 Oct '15

> > > Date: Fri, 16 Oct 2015 10:22:37 +0200 > From: grupo correo <grupodecorreo10(a)gmail.com> > To: dovecot(a)dovecot.org > Subject: Re: Problems sync with mail client MAC and > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > Message-ID: > < > CALxU0ypQfUkT5Df6ZeeN+_QrCfPcZF7tgDsOgGSM_84xVQF-eA(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > > > Date: Wed, 14 Oct 2015 11:43:22 +0200 > > From: Christian Kivalo <ml+dovecot(a)valo.at> > > To: Dovecot Mailing List <dovecot(a)dovecot.org> > > Subject: Re: Problems sync with mail client MAC and > > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > > Message-ID: <33ba2eacef5dcfcb4c703615e559b094(a)valo.at> > > Content-Type: text/plain; charset=US-ASCII; format=flowed > > > > > > > Attached the doveconf -n > > > Yes i have mail_debug = yes into file conf.d/10-logging.conf > > > I paste the rest of log: > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from > > > directory: /usr/lib64/dovecot > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib01_acl_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib02_imap_acl_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib10_quota_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib11_imap_quota_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Effective > > > uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > > root: > > > name=User quota backend=maildir args= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > > grace: root=User quota bytes=0 (10%) > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Namespace > > > inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, > > > list=children, subscriptions=yes location=maildir:~/Maildir > > > > Your inbox namespace seems to be ok and is also defined in your doveconf > > -n output. > > > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > maildir++: > > > root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, > > > inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > initializing backend with data: vfile > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > acl > > > username = xxxxxxxxxxxxxx > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > owner > > > = 1 > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl > > > vfile: > > > Global ACL directory: (none) > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Namespace : > > > type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, > > > subscriptions=no location=fail::LAYOUT=none > > > > Somehow there seems to be an empty namespace in addition to your inbox > > namespace. > > > > Is there a second namespace in your config somewhere? > > > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: > > > root=, index=, indexpvt=, control=, inbox=, alt= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: > > > service(imap): child 2464 killed with signal 11 (core dumps disabled) > > > > Just guessing: > > Could it be with Thunderbird that the second namespace is ignored when > > there is no subscription to it and the Apple mailprogram behaves > > differently? > > > > regards > > christian > > > > > > > > > Hi, > i can reproduce the error, conencting opnessl to port 993: > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot(a)dovecot.org > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > > ------------------------------ > > Hello, excuse me my last email, i clicked very fast..... I can reproduce the problem doing: - openssl s_client -host localhost -port 993 - 0 LOGIN xxxxxxxxxxxx xxxxxxxxxxxxxxxx ......... - 0 NAMESPACE * NAMESPACE (("INBOX." ".")) NIL (("#shared." ".")("shared." ".")) 0 OK NAMESPACE completed. 0 list "*" "" closed And the log show: Oct 19 09:35:58 localhost dovecot: imapxxxxxxxxxxxxxxxx): Fatal: master: service(imap): child 22048 killed with signal 11 (core dumps disabled) I can reproduce this problem with Mac email client and Outlook 2007. Best regards

1 0

replication full documentation
by MyWorking 19 Oct '15

19 Oct '15

Hi! I am create replication between two Debian 8.2 servers with dovecot 2.2.13. It work, but wont now more about replication used and i didn't now where i can red it: 1. aggregator - documentation and what he done? 2. replicator - full description or man for him 3. dsync - full description or man for him 4. doveadm replicator status - full description for all his points: * Queued 'sync' requests - when it started and what it is mean? * Queued 'high' requests - when it started and what it is mean? * Queued 'low' requests - when it started and what it is mean? * Queued 'failed' requests - when it started and what it is mean? * Queued 'full resync' requests - when it started and what it is mean? (wherry often i see this point is active on status for all my mail accounts) * Waiting 'failed' requests - i now what is it! * Total number of known users - i now what is it! 5. can dovecot create replication in real-time????

1 0

Doveadm client/server possible?
by Leon Kyneur 18 Oct '15

18 Oct '15

Hi As my mail infrastructure grows I'm now looking at the possibility of running all my doveadm commands from a central location. Wondering if there is a way to configure an inet_listener on doveadm and have a client elsewhere connect to it? Have seen the inet_listener for replication but not sure if it can also be used for general client server communication. Thanks Leon

1 0

Order in which UIDs are assigned..
by Akash 17 Oct '15

17 Oct '15

Hi, I just want some clarification on how Dovecot's IMAP assigns UIDs when it picks files from the "new" directory of a Maildir. What I am observing is that only ctime has a role to play in it. For example if there are two files in "new", a.msg & z.msg. Even when a.msg has lower mtime than z.msg and "a" comes before "z" alphabetically, dovecot will assign z.msg a lower UID if its ctime is lower than a.msg. Is this correct? Secondly, when mails are placed into Maildir through a external mechanism by-passing LDA, by any means is it possible for IMAP to run seive on it when it migrates the files from new to cur and indexes them? I understand that this might not be a valid question as mail is delivered already so there is nothing to filter :-) -Akash

2 4