October 2015 - dovecot

TLS communication director -> backend with X.509 cert checks?
by Heiko Schlittermann 19 Oct '15

19 Oct '15

Hello, using Dovecot 2.2.9 and a setup with directors and backends. The communication between directors and backends needs to be TLS secured. The director config contains a list of hostnames for the backends. (implicit list because of multiple A/AAAA records for a single hostname or explicit list of several host names) On connection setup from a client the director connects to the selected backend. But it seems (not checked in the source yet), that for SSL certificate verification the … [View More]

2 13

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 19 Oct '15

19 Oct '15

> > > Date: Fri, 16 Oct 2015 10:22:37 +0200 > From: grupo correo <grupodecorreo10(a)gmail.com> > To: dovecot(a)dovecot.org > Subject: Re: Problems sync with mail client MAC and > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > Message-ID: > < > CALxU0ypQfUkT5Df6ZeeN+_QrCfPcZF7tgDsOgGSM_84xVQF-eA(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > > > Date: Wed, 14 Oct 2015 11:43:22 +0200 > > From: Christian … [View More]Kivalo <ml+dovecot(a)valo.at> > > To: Dovecot Mailing List <dovecot(a)dovecot.org> > > Subject: Re: Problems sync with mail client MAC and > > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > > Message-ID: <33ba2eacef5dcfcb4c703615e559b094(a)valo.at> > > Content-Type: text/plain; charset=US-ASCII; format=flowed > > > > > > > Attached the doveconf -n > > > Yes i have mail_debug = yes into file conf.d/10-logging.conf > > > I paste the rest of log: > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from > > > directory: /usr/lib64/dovecot > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib01_acl_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib02_imap_acl_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib10_quota_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > > /usr/lib64/dovecot/lib11_imap_quota_plugin.so > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Effective > > > uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > > root: > > > name=User quota backend=maildir args= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > > grace: root=User quota bytes=0 (10%) > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Namespace > > > inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, > > > list=children, subscriptions=yes location=maildir:~/Maildir > > > > Your inbox namespace seems to be ok and is also defined in your doveconf > > -n output. > > > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > maildir++: > > > root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, > > > inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > initializing backend with data: vfile > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > acl > > > username = xxxxxxxxxxxxxx > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > > owner > > > = 1 > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl > > > vfile: > > > Global ACL directory: (none) > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > > Namespace : > > > type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, > > > subscriptions=no location=fail::LAYOUT=none > > > > Somehow there seems to be an empty namespace in addition to your inbox > > namespace. > > > > Is there a second namespace in your config somewhere? > > > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: > > > root=, index=, indexpvt=, control=, inbox=, alt= > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: > > > service(imap): child 2464 killed with signal 11 (core dumps disabled) > > > > Just guessing: > > Could it be with Thunderbird that the second namespace is ignored when > > there is no subscription to it and the Apple mailprogram behaves > > differently? > > > > regards > > christian > > > > > > > > > Hi, > i can reproduce the error, conencting opnessl to port 993: > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot(a)dovecot.org > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > > ------------------------------ > > Hello, excuse me my last email, i clicked very fast..... I can reproduce the problem doing: - openssl s_client -host localhost -port 993 - 0 LOGIN xxxxxxxxxxxx xxxxxxxxxxxxxxxx ......... - 0 NAMESPACE * NAMESPACE (("INBOX." ".")) NIL (("#shared." ".")("shared." ".")) 0 OK NAMESPACE completed. 0 list "*" "" closed And the log show: Oct 19 09:35:58 localhost dovecot: imapxxxxxxxxxxxxxxxx): Fatal: master: service(imap): child 22048 killed with signal 11 (core dumps disabled) I can reproduce this problem with Mac email client and Outlook 2007. Best regards [View Less]

1 0

replication full documentation
by MyWorking 19 Oct '15

19 Oct '15

Hi! I am create replication between two Debian 8.2 servers with dovecot 2.2.13. It work, but wont now more about replication used and i didn't now where i can red it: 1. aggregator - documentation and what he done? 2. replicator - full description or man for him 3. dsync - full description or man for him 4. doveadm replicator status - full description for all his points: * Queued 'sync' requests - when it started and what it is mean? * Queued 'high' requests - when it started and what … [View More]

1 0

Doveadm client/server possible?
by Leon Kyneur 19 Oct '15

19 Oct '15

Hi As my mail infrastructure grows I'm now looking at the possibility of running all my doveadm commands from a central location. Wondering if there is a way to configure an inet_listener on doveadm and have a client elsewhere connect to it? Have seen the inet_listener for replication but not sure if it can also be used for general client server communication. Thanks Leon

1 0

Order in which UIDs are assigned..
by Akash 17 Oct '15

17 Oct '15

Hi, I just want some clarification on how Dovecot's IMAP assigns UIDs when it picks files from the "new" directory of a Maildir. What I am observing is that only ctime has a role to play in it. For example if there are two files in "new", a.msg & z.msg. Even when a.msg has lower mtime than z.msg and "a" comes before "z" alphabetically, dovecot will assign z.msg a lower UID if its ctime is lower than a.msg. Is this correct? Secondly, when mails are placed into Maildir through a … [View More]

2 4

doveadm-search-query pattern format
by Frank-Ulrich Sommer 17 Oct '15

17 Oct '15

Hello, the doveadm-search-query documentation specifies a 'pattern' for many search keys. Unfortunately it does not mention the format specification of this pattern (special characters, wildcards, ...). I'm using dovecot 2.2.9 but also searched the current documention on dovecot.org. Where can I find further documentation concerning the exact specification of the pattern format?

2 1

Re: doveadm index assertion failed
by Nick Rosier 16 Oct '15

16 Oct '15

Nick Rosier schreef: > > Timo Sirainen wrote: >> On 05 Oct 2015, at 22:05, Nick Rosier<nick+dovecot(a)bunbun.be> wrote: >>> Hi, >>> >>> one of my mailboxes returns following error when I run doveadm index on it: >>> >>> Panic: file charset-iconv.c: line 85 (charset_to_utf8_try): assertion failed: (srcleft<= CHARSET_MAX_PENDING_BUF_SIZE) >>> >>> OS: FreeBSD 10.2 >>> Dovecot: 2.1.19 >>> Tika: 1.… [View More]10 >>> SOLR: 5.3.1 >> >> I thought this would have definitely been fixed by now.. Can you find some specific email which is triggering this? It's either something strange that I didn't expect, or it's a bug in FreeBSD's iconv(). >> >> Also can you debug this like: >> >> gdb --args doveadm index -u user@domain INBOX >> run >> <it should crash now> >> f 5 >> p src >> p ic_srcbuf >> p *src_size >> p srcleft > I recompiled Dovecot with Debug but I suspect I will have to do it for > all the required libraries as well; I did manage to find the offending > message is in Trash but have not been able to pin-point which message > it is. Just in case, here is the debugging info. I will see if I can > compile all dependencies in debug mode as well. > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and > you are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for > details. > This GDB was configured as "amd64-marcel-freebsd"... > (gdb) run > Starting program: /usr/local/bin/doveadm index -u xxxx@xxxx Trash > doveadm(xxxx@xxxx): Panic: file charset-iconv.c: line 85 > (charset_to_utf8_try): assertion failed: (srcleft <= > CHARSET_MAX_PENDING_BUF_SIZE) > > Program received signal SIGABRT, Aborted. > 0x000000080149f64a in thr_kill () from /lib/libc.so.7 > (gdb) f 5 > #5 0x0000000801143cd3 in i_panic (format=0x801191c30 "file %s: line > %d (%s): assertion failed: (%s)") at failures.c:275 > 275 failures.c: No such file or directory. > in failures.c > Current language: auto; currently minimal > (gdb) p src > No symbol "src" in current context. > (gdb) p ic_srcbuf > No symbol "ic_srcbuf" in current context. > (gdb) p *src_size > No symbol "src_size" in current context. > (gdb) p srcleft > No symbol "srcleft" in current context. > recompiled dovecot + all dependencies with debug but I get the same output. anything else I can try? [View Less]

1 0

quotas configuration a few questions
by niya levi 16 Oct '15

16 Oct '15

hi everyone need a few questions answering if possible before i can complete some modifications on my mailserver 1 how do i modify my user_query line in dovecot-sql.conf for quotas 2 is my iterate_query line ok 3 should i use lmtp or lda to deliver the quota warnings in quota-warning.sh my server is using lmtp but i've only seen examples using lda 4 how do i break long lines in dovecot.conf, is it the same as postgresql where you leave a space on the next line before … [View More]continuing the txt. i would like to break the cipher line in dovecot.conf over multiple lines 5 have i configured my namespace section correctly so that i can substitute for the autocreate plugin also could you give the files a quick look over to make sure there isn't any unnecessary additions that shouldn't be there or omissions that should be there thanks shadrock ============ /etc/dovecot/dovecot.conf disable_plaintext_auth = no mail_privileged_group = vmail log_timestamp = "%Y-%m-%d %H:%M:%S " log_path = /var/log/dovecot.log auth_debug_passwords=yes mail_debug=yes verbose_ssl=yes ssl_prefer_server_ciphers = yes ssl_dh_parameters_length = 2048 ssl_cert = </etc/ssl/certs/postfix.crt ssl_key = </etc/ssl/private/postfix.key ssl_ca = </etc/ssl/ca.crt ssl_protocols = !SSLv2 !SSLv3 ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH: auth_mechanisms = plain login passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } #namespace inbox { # separator = / # type = private # inbox = yes # location = maildir:/home/mailboxes/Maildir # list = yes # prefix = INBOX. #mailbox Drafts { # auto = subscribe # special_use = \Drafts #} #mailbox Junk { # auto = subscribe # special_use = \Junk #} #mailbox Sent { # auto = subscribe # special_use = \Sent #} #mailbox Trash { # auto = subscribe # special_use = \Trash #} #} mail_plugins = quota # protocols = "pop3 imap lmtp" protocols = pop3 imap lmtp sieve plugin { autocreate = Trash autocreate2 = Sent autosubscribe = Trash autosubscribe2 = Sent sieve = ~/.dovecot.sieve sieve_global_path = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ quota = dict:User quota::proxy::quotadict quota_rule2 = Trash:storage=+10%% quota_warning = storage=100%% quota-warning +100 %u quota_warning2 = storage=95%% quota-warning +95 %u quota_warning3 = storage=80%% quota-warning +80 %u quota_warning4 = -storage=100%% quota-warning -100 %u # user is no longer over quota } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } user = root } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } protocol imap { mail_plugins = $mail_plugins autocreate imap_quota } protocol sieve { managesieve_max_line_length = 65536 managesieve_implementation_string = dovecot log_path = /var/log/dovecot-sieve-errors.log info_log_path = /var/log/dovecot-sieve.log } protocol lmtp { postmaster_address=postmaster(a)thisdomain.co.uk hostname=testy.thisdomain.co.uk mail_plugins = $mail_plugins sieve quota info_log_path = /var/log/dovecot-lmtp.log } dict { quotadict = pgsql:/etc/dovecot/dovecot-dict-sql.conf } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } --(postgresql stuff)-- CREATE DATABASE mail WITH OWNER mailreader; CREATE TABLE aliases ( alias text NOT NULL, email text NOT NULL ); CREATE TABLE users ( email text NOT NULL, password text NOT NULL, maildir text NOT NULL, created timestamp with time zone DEFAULT now() ); CREATE TABLE vdomain ( domain text NOT NULL ); CREATE TABLE quota ( username varchar(100) not null, bytes bigint not null default 0, messages integer not null default 0, primary key (username) ); CREATE OR REPLACE FUNCTION merge_quota() RETURNS TRIGGER AS $$ BEGIN IF NEW.messages < 0 OR NEW.messages IS NULL THEN -- ugly kludge: we came here from this function, really do try to insert IF NEW.messages IS NULL THEN NEW.messages = 0; ELSE NEW.messages = -NEW.messages; END IF; return NEW; END IF; LOOP UPDATE quota SET bytes = bytes + NEW.bytes, messages = messages + NEW.messages WHERE username = NEW.username; IF found THEN RETURN NULL; END IF; BEGIN IF NEW.messages = 0 THEN INSERT INTO quota (bytes, messages, username) VALUES (NEW.bytes, NULL, NEW.username); ELSE INSERT INTO quota (bytes, messages, username) VALUES (NEW.bytes, -NEW.messages, NEW.username); END IF; return NULL; EXCEPTION WHEN unique_violation THEN -- someone just inserted the record, update it END; END LOOP; END; $$ LANGUAGE plpgsql; DROP TRIGGER IF EXISTS mergequota ON quota; CREATE TRIGGER mergequota BEFORE INSERT ON quota FOR EACH ROW EXECUTE PROCEDURE merge_quota(); --(postgresql stuff)-- ============ /etc/dovecot/dovecot-dict-sql.conf connect = host=/run/postgresql dbname=mail user=mailreader map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } ============ /etc/dovecot/dovecot-sql.conf driver = pgsql connect = host=/run/postgresql dbname=mail user=mailreader default_pass_scheme = SHA512 password_query = SELECT email as user, password FROM users WHERE email = '%u' user_query = SELECT email as user, 'maildir:/home/mailboxes/maildir/'||maildir as mail, '/home/mailboxes/maildir/'||maildir as home, 500 as uid, 500 as gid FROM users WHERE email = '%u' iterate_query = SELECT email AS user FROM users ============ /usr/local/bin/quota-warning.sh #!/bin/sh BOUNDARY="$1" USER="$2" MSG="" if [[ "$BOUNDARY" = "+100" ]]; then MSG="Your mailbox is now overfull (>100%). In order for your account to continue functioning properly, you need to remove some emails NOW." elif [[ "$BOUNDARY" = "+95" ]]; then MSG="Your mailbox is now over 95% full. Please remove some emails ASAP." elif [[ "$BOUNDARY" = "+80" ]]; then MSG="Your mailbox is now over 80% full. Please consider removing some emails to save space." elif [[ "$BOUNDARY" = "-100" ]]; then MSG="Your mailbox is now back to normal (<100%)." fi cat << EOF | /usr/lib/dovecot/lmtp -d $USER -o "plugin/quota=maildir:User quota:noenforcing" From: postmaster(a)yourdomain.com Subject: Email Account Quota Warning Dear User, $MSG Best regards, Your Mail System EOF [View Less]

1 0

Strange indexing behavior on HTML emails ..
by Akash 16 Oct '15

16 Oct '15

Hi, In continuation to the issue I had posted about long back: http://www.dovecot.org/list/dovecot/2014-August/097362.html I did further testing today on a fresh new Debian & latest Dovecot and observed a undesired behavior. I am using fts_lucene & following sequence of commands on a empty test account me(a)myself.com: doveadm expunge -u 'my(a)myself.com' mailbox 'INBOX' all cat test.eml | /usr/lib/dovecot/dovecot-lda -e -f you(a)yourself.com -d me(a)myself.com doveadm search -u '… [View More]

3 7

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 16 Oct '15

16 Oct '15

> Message: 6 > Date: Wed, 14 Oct 2015 11:43:22 +0200 > From: Christian Kivalo <ml+dovecot(a)valo.at> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: Problems sync with mail client MAC and > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > Message-ID: <33ba2eacef5dcfcb4c703615e559b094(a)valo.at> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > > > Attached the doveconf -n > > Yes i have mail_debug = yes … [View More]into file conf.d/10-logging.conf > > I paste the rest of log: > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from > > directory: /usr/lib64/dovecot > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib01_acl_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib02_imap_acl_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib10_quota_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib11_imap_quota_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Effective > > uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > root: > > name=User quota backend=maildir args= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > grace: root=User quota bytes=0 (10%) > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Namespace > > inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, > > list=children, subscriptions=yes location=maildir:~/Maildir > > Your inbox namespace seems to be ok and is also defined in your doveconf > -n output. > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > maildir++: > > root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, > > inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > initializing backend with data: vfile > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > acl > > username = xxxxxxxxxxxxxx > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > owner > > = 1 > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl > > vfile: > > Global ACL directory: (none) > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Namespace : > > type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, > > subscriptions=no location=fail::LAYOUT=none > > Somehow there seems to be an empty namespace in addition to your inbox > namespace. > > Is there a second namespace in your config somewhere? > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: > > root=, index=, indexpvt=, control=, inbox=, alt= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: > > service(imap): child 2464 killed with signal 11 (core dumps disabled) > > Just guessing: > Could it be with Thunderbird that the second namespace is ignored when > there is no subscription to it and the Apple mailprogram behaves > differently? > > regards > christian > > > > Hi, i can reproduce the error, conencting opnessl to port 993: [View Less]

1 0