- dovecot - dovecot.org

Pigeonhole/sieve possibly corrupting mails
by Ladislav Laska 08 Nov '16

08 Nov '16

Hi! I'm here again with a problem. I'm using dovecot as an IMAP server and LDA, filtering mail via sieve. However, few times a day I get the following error on server and my client (mutt) gets disconnected. Oct 15 20:20:29 ibex dovecot: imap(krakonos): Error: Corrupted index cache file /home/krakonos/.mbox/.imap/INBOX/dovecot.index.cache: Broken physical s ize for mail UID 149418 in mailbox INBOX: read(/home/krakonos/.mbox/inbox) failed: Cached message size smaller than expected (3793 < 8065, box=INBOX, UID=149418, cached Message-Id=<88deda0d-86f6-6115-af10-60ac06bb2d22(a)rename-it.nl>) Oct 15 20:20:29 ibex dovecot: imap(krakonos): Error: read(/home/krakonos/.mbox/inbox) failed: Cached message size smaller than expected (3793 < 8065, box=INBOX, UID=149418, cached Message-Id=<88deda0d-86f6-6115-af10-60ac06bb2d22(a)rename-it.nl>) (FETCH BODY[] for mailbox INBOX UID 149418) Oct 15 20:20:29 ibex dovecot: imap(krakonos): FETCH read() failed in=110326 out=5115197 This is on a new message (attached), and this error happens on some messages when first opened. Once I reconnect, the message always opens fine, and no old message ever causes problem. I also noticed this error, which is possibly connected: Oct 15 20:15:12 ibex dovecot: lda(krakonos): Error: Next message unexpectedly corrupted in mbox file /home/krakonos/.mbox/inbox at 546862809 The filesystem is ext4, and there are no errors in syslog or problems with any other services. I also don't access the mbox locally, and only dovecot manipulates the mbox (via imap and mailbox_command = /usr/libexec/dovecot/deliver) The postfix version is 2.2.25. I'm attaching dovecot -n and the offending message (after it's been corrected). I'd rather not publish my sieve file, but will send it privately. The offending message also contains other message I received at approximately the same time. Any hint's on what could be wrong? -- S pozdravem Ladislav "Krakonoš" Láska http://www.krakonos.org/

3 6

connection to storage server failed
by ＠lbutlr 08 Nov '16

08 Nov '16

I am getting this error after updating to dovecot2-2.2.26.0_1 under FreeBSD 10.2 when a user tries to login via roundcube webmail. I am able to login via my own mail client and there is no error in the log when roundcube fails to login. I stopped dovecot, removed all the dovecot files from the maildir folders and restarted dovecot, but get the same error. <https://help.directadmin.com/item.php?id=473>

1 0

Backing up and Importing IMAP folders
by Jerry 08 Nov '16

08 Nov '16

I am running Dovecot with Postfix on a FreeBSD machine. There are problems with the drive and I cannot depend on it. Dovecot saves all mail in IMAP format. I want to back up the mail folders, install a new HD, install the latest FreeBSD OS and then reinstall my programs. Reinstalling Dovecot is simple, but how do I reinstall the IMAP folders? Can Dovecot backup the folders onto a CD and then import them when I reinstall it? My mail is kept under “/var/mail/vmail”. Should I just back up that entire directory structure and then restore it later? Thanks! -- Jerry

3 9

Sieve Logs
by GP 08 Nov '16

08 Nov '16

Hi all, I have installed dovecot version 2.2.13 on a debian wheezy (bakported version). I want to debug/log sieve filtering and lda if possible on a per user level (like procmail for example) , is it possible ? thanks in advance

2 1

Re: logging TLS SNI hostname
by Arkadiusz Miśkiewicz 08 Nov '16

08 Nov '16

On Tuesday 08 of November 2016, Aki Tuomi wrote: > > On November 8, 2016 at 4:08 PM Arkadiusz Miśkiewicz <arekm(a)maven.pl> > > wrote: > > > > On Thursday 20 of October 2016, Arkadiusz Miśkiewicz wrote: > > > On Thursday 20 of October 2016, Aki Tuomi wrote: > > > > On 20.10.2016 15:52, Arkadiusz Miśkiewicz wrote: > > > > > > ... -servername something > > > > > > > > If you want to try out, try applying this patch... > > > > > > Works, thanks! > > > > But... it's easy to log fake things > > > > Nov 8 15:04:01 mbox dovecot: pop3-login: Aborted login (no auth attempts > > in 1 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, > > local_name=whitehouse.gov, i_can=put_anything, here=etc, TLS, > > session=<26rEnMpAPMtb6rD0> > > > > by using > > > > openssl s_client -connect 127.0.0.1:110 -starttls pop3 -servername > > "whitehouse.gov, i_can=put_anything, here=etc" > > > > so some escaping here would also be needed. > > > > conf: > > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e > > local_name=%{local_name} %c session=<%{session}> > > > > > > From 066edb5e5c14a05c90e9ae63f0b76fcfd9c1149e Mon Sep 17 00:00:00 > > > > 2001 From: Aki Tuomi <aki.tuomi(a)dovecot.fi> > > > > Date: Thu, 20 Oct 2016 16:06:27 +0300 > > > > Subject: [PATCH] login-common: Include local_name in > > > > login_var_expand_table > > > > > > > > This way it can be used in login_log_format > > There is escaping in the final code in 2.2.26.0. This is on 2.2.26.0. Escaping was only added to auth code, not logging one, right? -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

1 0

logging TLS SNI hostname
by Arkadiusz Miśkiewicz 08 Nov '16

08 Nov '16

Is there a way to log SNI hostname used in TLS session? Info is there in SSL_CTX_set_tlsext_servername_callback, dovecot copies it to ssl_io->host. Unfortunately I don't see it expanded to any variables ( http://wiki.dovecot.org/Variables ). Please consider this to be a feature request. The goal is to be able to see which hostname client used like: May 30 08:21:19 xxx dovecot: pop3-login: Login: user=<abc>, method=PLAIN, rip=1.1.1.1, lip=2.2.2.2, mpid=17135, TLS, SNI=pop3.somehost.org, session=<hfS9Qwk03sBTBnrN> -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

3 11

build failure --without-ssl
by Eray Aslan 08 Nov '16

08 Nov '16

dovecot-2.2.26.0: $ ./configure --without-ssl && make [...] libtool: error: cannot find the library '../lib-ssl-iostream/libssl_iostream_openssl.la' or unhandled argument '../lib-ssl-iostream/libssl_iostream_openssl.la' make[3]: *** [Makefile:738: test-http-client] Error 1 Had a quick look. When configured without ssl, the tests were failing at run time for dovecot-2.2.25. So, this change is good but not enough. Apparently, some people do use dovecot without ssl. https://bugs.gentoo.org/show_bug.cgi?id=599024 -- Eray

1 0

Dovecot and zlib
by Peter Fraser 07 Nov '16

07 Nov '16

HI All I have a dovecot 1 server up and running without zlib and I am setting up a new Dovecot 2 Server and I want to use zlib. What is the proper way to do this? Should I set up the new server, copy the mail across and then enable zlib or do I compress the current mail in place and then copy across? Thanks for any help.

1 0

sieve sending vacation message from vmail@ns1.domain.tld
by Matthew Broadhead 07 Nov '16

07 Nov '16

I have a server running centos-release-7-2.1511.el7.centos.2.10.x86_64 with dovecot version 2.2.10. I am also using roundcube for webmail. when a vacation filter (reply with message) is created in roundcube it adds a rule to managesieve.sieve in the user's mailbox. everything works fine except the reply comes from vmail(a)ns1.domain.tld instead of user(a)domain.tld. ns1.domain.tld is the fully qualified name of the server. it used to work fine on my old CentOS 6 server so I am not sure what has changed. Can anyone point me in the direction of where I can configure this behaviour?

2 17

virtual mailbox: any way to include.....
by Larry Rosenman 07 Nov '16

07 Nov '16

a namespace that starts with # in a dovecot-virtual file? \# and plain # does NOT work. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

2 2

dovecot-antispam plugin not work
by basti 04 Nov '16

04 Nov '16

Hello, I try to use the plugin for my dovecot in debian. It seem that the /usr/bin/sa-learn-pipe.sh is not execute. When I run /usr/bin/sa-learn-pipe.sh from commandline logfiles are created. I also read https://johannes.sipsolutions.net/files/antispam.html In syslog you can see fist move a mail from "z_SPAM" to INBOX and then move a mail from INBOX to "z_SPAM". Can you please help? Best regards Config and log's are append. dpkg -l | grep dovecot ii dovecot-antispam 2.0+20130912-2 amd64 Dovecot plugins for training spam filters ii dovecot-core 1:2.2.13-12~deb8u1 amd64 secure POP3/IMAP server - core files ii dovecot-imapd 1:2.2.13-12~deb8u1 amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-pgsql 1:2.2.13-12~deb8u1 amd64 secure POP3/IMAP server - PostgreSQL support ### log root@vsrv78105:/etc/dovecot# /etc/init.d/dovecot restart [ ok ] Restarting dovecot (via systemctl): dovecot.service. root@vsrv78105:/etc/dovecot# tail -f /var/log/syslog | grep imap Nov 3 20:02:45 vsrv78105 dovecot: imap-login: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 3 20:02:48 vsrv78105 dovecot: master: Dovecot v2.2.13 starting up for imap (core dumps disabled) Nov 3 20:03:03 vsrv78105 dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=xxx, lip=xxx, mpid=14954, TLS, session=<pqb/NGpAvgBP8o1u> Nov 3 20:03:03 vsrv78105 imap: antispam: plugin initialising (2.0-notgit) Nov 3 20:03:03 vsrv78105 imap: antispam: verbose debug enabled Nov 3 20:03:03 vsrv78105 imap: antispam: "Spam" is exact match spam folder Nov 3 20:03:03 vsrv78105 imap: antispam: "SPAM" is exact match spam folder Nov 3 20:03:03 vsrv78105 imap: antispam: "z_SPAM" is exact match spam folder Nov 3 20:03:03 vsrv78105 imap: antispam: no unsure folders Nov 3 20:03:03 vsrv78105 imap: antispam: "Trash" is exact match trash folder Nov 3 20:03:03 vsrv78105 imap: antispam: "trash" is exact match trash folder Nov 3 20:03:03 vsrv78105 imap: antispam: pipe backend tmpdir /tmp Nov 3 20:03:13 vsrv78105 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mailbox_is_trash(z_SPAM): 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mailbox_is_spam(z_SPAM): 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mailbox_is_unsure(z_SPAM): 0 Nov 3 20:03:13 vsrv78105 imap: antispam: mail copy: src spam: 0, dst spam: 0, src unsure: 0 Nov 3 20:03:14 vsrv78105 dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=xxx, lip=xxx, mpid=14959, TLS, session=<KxqnNWpAvwBP8o1u> Nov 3 20:03:14 vsrv78105 imap: antispam: plugin initialising (2.0-notgit) Nov 3 20:03:14 vsrv78105 imap: antispam: verbose debug enabled Nov 3 20:03:14 vsrv78105 imap: antispam: "Spam" is exact match spam folder Nov 3 20:03:14 vsrv78105 imap: antispam: "SPAM" is exact match spam folder Nov 3 20:03:14 vsrv78105 imap: antispam: "z_SPAM" is exact match spam folder Nov 3 20:03:14 vsrv78105 imap: antispam: no unsure folders Nov 3 20:03:14 vsrv78105 imap: antispam: "Trash" is exact match trash folder Nov 3 20:03:14 vsrv78105 imap: antispam: "trash" is exact match trash folder Nov 3 20:03:14 vsrv78105 imap: antispam: pipe backend tmpdir /tmp Nov 3 20:04:05 vsrv78105 imap: antispam: mailbox_is_unsure(z_SPAM): 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mailbox_is_trash(z_SPAM): 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mailbox_is_spam(z_SPAM): 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 3 20:04:05 vsrv78105 imap: antispam: mail copy: src spam: 0, dst spam: 0, src unsure: 0 ^C root@vsrv78105:/etc/dovecot# ls -la /tmp/ insgesamt 8864 drwxrwxrwt 8 root root 12288 Nov 3 20:07 . drwxr-xr-x 22 root root 4096 Jun 17 14:41 .. drwxrwxrwt 2 root root 4096 Nov 1 14:16 .font-unix drwxrwxrwt 2 root root 4096 Nov 1 14:16 .ICE-unix drwxrwxrwt 2 root root 4096 Nov 1 14:16 .Test-unix drwxrwxrwt 2 root root 4096 Nov 1 14:16 .X11-unix drwxrwxrwt 2 root root 4096 Nov 1 14:16 .XIM-unix root@vsrv78105:/etc/dovecot# ls -la /etc/dovecot/sa-learn-pipe.sh -rwxr-xr-x 1 root root 769 Nov 3 19:38 /etc/dovecot/sa-learn-pipe.sh ######################### config ### 90-plugin.conf plugin { #setting_name = value antispam_backend = pipe antispam_debug_target = syslog antispam_verbose_debug = 1 # antispam_mail_sendmail_args= --username=%u antispam_mail_spam_arg = --spam antispam_mail_notspam_arg = --ham antispam_mail_program = /etc/dovecot/sa-learn-pipe.sh antispam_spam = Spam;SPAM;z_SPAM antispam_trash = Trash;trash } ### sa-learn-pipe.sh #!/bin/bash set -x pid=$$ # remove the # from next line to background learner #( { echo "$(date) ${pid}-start ($*) /tmp/sendmail-msg-$$.txt" set -x #id -a #env cat > /tmp/sendmail-msg-${pid}.txt /usr/bin/sa-learn "$@" /tmp/sendmail-msg-${pid}.txt echo "$(date) $$-end rc=$?" } >/tmp/antispam.${pid}.log 2>&1 echo "cat antispam.${pid}.log" cat /tmp/antispam.${pid}.log >>/tmp/sa-learn-pipe.log rm -f /tmp/antispam.${pid}.log /tmp/sendmail-msg-${pid}.txt true # remove the # from next line to background learner #) & exit 0

2 2

Errors with count:User quota and NFS
by Tom Sommer 04 Nov '16

04 Nov '16

I upgraded to 2.2.26.0 and enabled count as quota backend, expecting the recent fixes to allow me to use the backend, however I get the following errors: Oct 31 10:52:13 imap(xxxx(a)xxxx.xx): Error: Transaction log file /mnt/nfs/xxxx.xx/xxx/indexes/dovecot.list.index.log: marked corrupted Oct 31 10:52:15 imap(xxx(a)xxxx.xx): Error: Transaction log file /mnt/nfs/xxxx.xx/xxx/indexes/dovecot.list.index.log: marked corrupted Oct 31 10:52:37 imap(xxx(a)xxxx.xx): Warning: Locking transaction log file /mnt/nfs/xxx.xx/xxx/indexes/dovecot.list.index.log took 31 seconds (syncing) Oct 31 10:52:37 imap(xxx(a)xxx.xx): Warning: Locking transaction log file /mnt/nfs/xxx.xx/xxx/indexes/dovecot.list.index.log took 31 seconds (syncing) Oct 31 10:52:43 imap(xxx(a)xxx.xx): Error: Transaction log file /mnt/nfs/xxx.xx/xx/indexes/dovecot.list.index.log: marked corrupted Oct 31 10:52:52 imap(xxx(a)xxx.xx): Warning: Locking transaction log file /mnt/nfs/xxx.xx/xxx/indexes/dovecot.list.index.log took 31 seconds (syncing) Oct 31 10:53:04 imap(xxx(a)xxx.x): Warning: Locking transaction log file /mnt/nfs/xxx.xx/xxx/indexes/dovecot.list.index.log took 60 seconds (syncing) Oct 31 10:53:06 imap(xxx(a)xxx.xx): Warning: Locking transaction log file /mnt/nfs/xxx.xxx/xxx/indexes/dovecot.list.index.log took 31 seconds (syncing) (all different accounts) If I disable count as backend, there are no errors. I'm running my mail-storage on NFS, so I suspect the errors are due to locking? So is there no way to run count as quota backend with NFS? Thanks. -- Tom

2 4

deleting indices
by cheese＠nosuchhost.net 04 Nov '16

04 Nov '16

hi i have dovecot 2.0.9 - the version from rhel6 - and the following setup: two imap-servers with distinct /var/indices. those directory is local only, no sharing. the users mailboxes life on a shared nfs-storage. the two servers are setup active/passive: only one server is active and in case of a problem or maintenance the second server jumps in. no director in place. we would like to upgrade to rhel7 and add a director. there would be dovecot 2.2.10, but will take some time. one application (horde + activesync which use imap to access emails) seems to have troubles during the second server being active. horde relies according to their deveolpers heavily on modseq/qresync and if we switch to the seconds side there is another set of index-files. my knowledge was that deletion/corruption of index-files would be never a problem, as dovecot recreates them automatically. is this true for QRESNC, too? * is it a problem to have a old set of index-files on the second server, as this system is only in use every 3-4 weeks? * would it be better to start with empty indices? but there we have trouble with horde. and as it seems only with horde. "normal" imap-clients seem to be fine. yours josef

1 0

Forcibly terminated after 10 milliseconds
by Doug Luce 03 Nov '16

03 Nov '16

After an OS upgrade (to FreeBSD 11 with pkg Dovecot 2.2.26) I'm getting this sort of thing in my logs: Nov 3 12:15:16 toma dovecot: lda(doug): Error: program `/usr/local/lib/dovecot/sieve-pipe/growlmail' was forcibly terminated with signal 15 Debugging gives a little more info: Nov 3 12:05:51 toma dovecot: lda(doug): Debug: waiting for program `/usr/local/lib/dovecot/sieve-pipe/growlmail' to finish after 0 msecs Nov 3 12:05:51 toma dovecot: lda(doug): Debug: program `/usr/local/lib/dovecot/sieve-pipe/growlmail'(11794) execution timed out after 10 milliseconds: sending TERM signal growlmail is specified via a sieve rule: pipe :try :copy "growlmail"; This would seem to be a function of input_idle_timeout_msecs in lib-program-client/program-client-local.c, but it's not clear where this is set (or why it would be 10 milliseconds by default). Is there a way to up this timeout? Thanks, Doug # 2.2.26 (54d6540): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: FreeBSD 11.0-RELEASE-p2 amd64 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/dovecot/ debug_log_path = /var/log/dovecot-debug.log default_login_user = nobody mail_debug = yes mail_fsync = never mail_location = maildir:~/Maildir:INDEX=/var/indexes/%u mail_plugins = " fts fts_solr" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.pipe vnd.dovecot.execute mbox_write_locks = fcntl passdb { args = failure_show_msg=yes dovecot driver = pam } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://localhost:4949/solr/dovecot/ fts_tika = http://localhost:9998/tika sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /usr/local/lib/dovecot/sieve-execute sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve-pipe sieve_plugins = sieve_extprograms sieve_vacation_dont_check_recipient = yes } protocols = imap sieve lmtp service auth { service_count = 0 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { idle_kill = 0 inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = 0.0.0.0 127.0.0.1 port = 993 } service_count = 0 user = dovecot } service lmtp { service_count = 0 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { group = dovecot inet_listener sieve { port = 4190 } user = dovecot } ssl_cert = </usr/local/etc/nginx/ssl/con.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 20 } protocol lda { mail_plugins = " fts fts_solr sieve" } protocol lmtp { mail_plugins = " fts fts_solr sieve" }

2 1

"make install" fails
by E Kogler 03 Nov '16

03 Nov '16

I want to install dovecot 2.2.25 on my opensuse 12.3 (yes, I know that this is an old distro). "./configure, make" run with no problems but "make install" fails with: [...] libtool: warning: 'libstats_auth.la' has not been installed in '/usr/local/lib/dovecot/stats' libtool: install: /usr/bin/install -c .libs/auth /usr/local/lib/dovecot/auth libtool: install: /usr/bin/install -c .libs/checkpassword-reply /usr/local/lib/dovecot/checkpassword-reply /usr/bin/mkdir -p '/usr/local/lib/dovecot/auth' /usr/bin/mkdir: can't create „/usr/local/lib/dovecot/auth“ : file exists make[3]: *** [install-auth_moduleLTLIBRARIES] Fehler 1 make[3]: Leaving directory `/root/dovecot-2.2.25/src/auth' make[2]: *** [install-am] Fehler 2 make[2]: Leaving directory `/root/dovecot-2.2.25/src/auth' make[1]: *** [install-recursive] Fehler 1 make[1]: Leaving directory `/root/dovecot-2.2.25/src' make: *** [install-recursive] Fehler 1 ------------------------ I'm stuck.Can anyone help ? Edgar

2 1

Re: doveadm index: can't index a different namespace?
by Larry Rosenman 03 Nov '16

03 Nov '16

On Wed, Nov 2, 2016 at 3:15 PM, Larry Rosenman <larryrtx(a)gmail.com> wrote: > ah. Looking into Solr. Is the wiki out of date with regard to > solr 6.2.0? there doesn't seem to be a conf/schmea.xml file any more. I started the default solr from FreeBSD ports, and there is no update URL. I'll continue investigating. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 1

Re: Outlook 2010 woes
by Joseph Tam 02 Nov '16

02 Nov '16

> Old server: > * Ubuntu 10.04.4 LTS > * Dovecot 2.1.13 > * Maildir++ > * Local auth via passwd/shadow files > > New server: > * Debian GNU/Linux 8.6 > * Dovecot 2.2.13 > * Maildir++ > * Quotas enabled > * LDAP > > Basically what's happening is that users are seeing large delays when > navigating between different IMAP folders. So, for example, user "X" is > sitting idle in their INBOX. Rebuilding caches? Do you get the same delay when going back to the folder after the initial delay. Joseph Tam <jtam.home(a)gmail.com>

7 19

Re: doveadm index: can't index a different namespace?
by Timo Sirainen 02 Nov '16

02 Nov '16

On 02 Nov 2016, at 22:02, Larry Rosenman <larryrtx(a)gmail.com> wrote: > > why wouldn't it be able to use the ~/MAILARCHIVE/ filesystem space? > > The other indexes etc seem to get built there. It's not about adding an index there, but about trying to open "MAILARCHIVE" itself as a folder. fts-lucene attempts to use an existing folder's indexes for tracking some (rather useless) settings information. I guess that tracking could be removed entirely as well. > > I'll see if the current FreeBSD solr port is easier to set up than the last time I tried. > > > On Wed, Nov 2, 2016 at 2:58 PM, Timo Sirainen <tss(a)iki.fi <mailto:tss@iki.fi>> wrote: > I think it's simply not going to work with mbox. It's trying to open the "#ARCHIVE" namespace prefix itself, which won't work and it's too much work to try to fix it. You could try if this happens to make it work, but I'm not sure: http://wiki2.dovecot.org/MboxChildFolders <http://wiki2.dovecot.org/MboxChildFolders> > > Also instead of fts-lucene, you should switch to fts-solr. That would also fix it and in general works better. > > >> On 02 Nov 2016, at 21:40, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >> >> Is there anything else I can provide? >> >> >> On Wed, Nov 2, 2016 at 1:30 PM, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >> nope -- No difference >> >> thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~ $ ls -l ~/MAILARCHIVE/ >> total 176 >> drwx------ 6 ler ler 7 May 25 2014 2004 >> drwx------ 8 ler ler 8 Mar 3 2013 2005 >> drwx------ 11 ler ler 11 Mar 3 2013 2006 >> drwx------ 11 ler ler 11 May 3 2013 2007 >> drwx------ 14 ler ler 14 Mar 3 2013 2008 >> drwx------ 14 ler ler 14 Mar 3 2013 2009 >> drwx------ 14 ler ler 14 Mar 3 2013 2010 >> drwx------ 15 ler ler 15 Mar 3 2013 2011 >> drwx------ 15 ler ler 15 Mar 3 2013 2012 >> drwx------ 14 ler ler 14 Dec 31 2013 2013 >> drwxr-xr-x 14 ler ler 14 Jan 1 2015 2014 >> drwxr-xr-x 14 ler ler 14 Jan 1 2016 2015 >> drwxr-xr-x 12 ler ler 12 Nov 1 00:05 2016 >> -rw-r--r-- 1 ler ler 0 Nov 2 13:26 inbox >> thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~ $ >> >> doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/Amplify_Mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:28:28] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/clamav-rules: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:28:28] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/SA/FN: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:28:28] >> thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~ $ >> >> thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~ $ doveadm -D -vvvvv index \#ARCHIVE/\* >> Debug: Loading modules from directory: /usr/local/lib/dovecot >> Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so >> Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so >> Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so >> Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so >> Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm >> Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) >> Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_lookup" (this is usually intentional, so just ignore this message) >> Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) >> Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so >> Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so >> Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so >> doveadm(ler): Debug: Effective uid=1001, gid=1001, home=/home/ler >> doveadm(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX >> doveadm(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt= >> doveadm(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE >> doveadm(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inbox >> doveadm(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/ler/MAILARCHIVE/inbox, alt= >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/satelliteguys: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/SA/FN: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/SENT: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/INBOX: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/SPAM: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/root-mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/bacula: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/Junk E-mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> doveadm(ler): Error: Mailbox #ARCHIVE/2011/07/Amplify_Mail: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-02 13:27:19] >> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable >> >> On Wed, Nov 2, 2016 at 1:25 PM, Timo Sirainen <tss(a)iki.fi <mailto:tss@iki.fi>> wrote: >> It looks like fts-lucene wants to write some information into INBOX's index files. But your archive namespace doesn't have a working INBOX. Maybe it would work if you create "#ARCHIVE/inbox"? >> >>> On 02 Nov 2016, at 20:13, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >>> >>> one other thing, fts_autoindex does NOT appear to be working on the >>> #ARCHIVE/ NAMESPACE. >>> >>> I wonder if these are all interrelated? >>> >>> On Wed, Nov 2, 2016 at 1:10 PM, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >>> FWIW it DOES work on my default NAMESPACE, just not the #ARCHIVE/ NAMESPACE. >>> >>> >>> On Wed, Nov 2, 2016 at 12:32 PM, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >>> It's ALWAYS failed on the other NAMESPACE. >>> >>> Some of the logging looks weird as well for the 2nd namespace: >>> >>> Nov 2 12:32:03 thebighonker dovecot: imap-login: Login: user=<mrm>, method=PLAIN, rip=207.231.91.36, lip=192.147.25.65, mpid=76712, TLS, session=<HC+00VRAWczP51sk> >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Loading modules from directory: /usr/local/lib/dovecot >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Module loaded: /usr/local/lib/dovecot/lib95_imap_stats_plugin.so >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Effective uid=1004, gid=1004, home=/home/mrm >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: fs: root=/home/mrm/mail, index=, indexpvt=, control=, inbox=/home/mrm/mail/INBOX, alt= >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: mbox: INBOX defaulted to /home/mrm/MAILARCHIVE/inbox >>> Nov 2 12:32:03 thebighonker dovecot: imap(mrm): Debug: fs: root=/home/mrm/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/mrm/MAILARCHIVE/inbox, alt= >>> >>> >>> >>> On Wed, Nov 2, 2016 at 12:30 PM, Timo Sirainen <tss(a)iki.fi <mailto:tss@iki.fi>> wrote: >>> It's getting a bit strange. You were running 2.2.25 previously and it was working then? Does the doveadm index always fail with the same errors? >>> >>> Also I just noticed that it's saying INBOX isn't selectable: "lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable". Which I guess isn't true. It seems to be failing somewhat randomly.. >>> >>>> On 02 Nov 2016, at 19:25, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >>>> >>>> thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~ $ doveadm mailbox status -u ler(a)lerctr.org <mailto:ler@lerctr.org> vsize \#ARCHIVE/2016/10/clamav-rules >>>> #ARCHIVE/2016/10/clamav-rules vsize=3840752 >>>> thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~ $ >>>> >>>> >>>> >>>> On Wed, Nov 2, 2016 at 12:22 PM, Timo Sirainen <tss(a)iki.fi <mailto:tss@iki.fi>> wrote: >>>> On 02 Nov 2016, at 19:19, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >>>> > >>>> > clamav-rules is NOT a directory, nor are any of the others: >>>> >>>> Can you access these mboxes at all with Dovecot? e.g. >>>> >>>> doveadm mailbox status -u user@domain clamav-rules >>>> >>>> > thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~/MAILARCHIVE $ cd 2016/10 >>>> > thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~/MAILARCHIVE/2016/10 $ ls -l >>>> > total 72106 >>>> > -rw-r--r-- 1 ler ler 440461 Nov 1 00:05 Amplify_Mail >>>> > -rw-r--r-- 1 ler ler 104102478 Nov 1 14:53 INBOX >>>> > drwxr-xr-x 3 ler ler 4 Nov 1 00:05 SA >>>> > -rw-r--r-- 1 ler ler 21083767 Nov 1 00:05 SENT >>>> > -rw-r--r-- 1 ler ler 1850677 Nov 1 00:05 SPAM >>>> > -rw-r--r-- 1 ler ler 36483 Nov 1 00:05 UFCU_Mail >>>> > -rw-r--r-- 1 ler ler 460073 Nov 1 00:05 bacula >>>> > -rw-r--r-- 1 ler ler 1107098 Nov 1 00:05 bayes-update >>>> > -rw-r--r-- 1 ler ler 3884041 Nov 1 00:05 clamav-rules >>>> > -rw-r--r-- 1 ler ler 652132 Nov 1 00:05 firewall >>>> > drwxr-xr-x 11 ler ler 20 Nov 1 00:05 lists >>>> > -rw-r--r-- 1 ler ler 25122465 Nov 1 00:05 root-mail >>>> > -rw-r--r-- 1 ler ler 44553 Nov 1 00:05 satelliteguys >>>> > -rw-r--r-- 1 ler ler 625628 Nov 1 00:05 wview >>>> > thebighonker.lerctr.org <http://thebighonker.lerctr.org/> ~/MAILARCHIVE/2016/10 $ >>>> > >>>> > On Wed, Nov 2, 2016 at 12:17 PM, Timo Sirainen <tss(a)iki.fi <mailto:tss@iki.fi>> wrote: >>>> > >>>> >> On 01 Nov 2016, at 20:30, Larry Rosenman <larryrtx(a)gmail.com <mailto:larryrtx@gmail.com>> wrote: >>>> >>> >>>> >>> doveadm -D -vvvvvv index \#ARCHIVE/\* garners the below for ALL >>>> >> mailboxes >>>> >>> in the >>>> >>> namespace: >>>> >>> doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/clamav-rules: Status lookup >>>> >>> failed: Internal error occurred. Refer to server log for more >>>> >> information. >>>> >>> [2016-11-01 13:25:21] >>>> >>> doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't >>>> >>> selectable >>>> >> >>>> >> You're using mbox format and "clamav-rules" is a directory. I guess >>>> >> doveadm should be ignoring non-selectable mailboxes. >>>> >> >>>> >> >>>> > >>>> > >>>> > -- >>>> > Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >>>> > Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >>>> > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>> >>>> >>>> >>>> >>>> -- >>>> Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >>>> Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>> >>> >>> >>> >>> -- >>> Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >>> Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>> >>> >>> >>> -- >>> Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >>> Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>> >>> >>> >>> -- >>> Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >>> Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >> >> >> >> >> -- >> Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >> Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >> >> >> >> -- >> Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> >> Phone: +1 214-642-9640 <tel:%2B1%20214-642-9640> (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> >> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > > > > > -- > Larry Rosenman http://www.lerctr.org/~ler <http://www.lerctr.org/~ler> > Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com <mailto:larryrtx@gmail.com> > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Re: doveadm index: can't index a different namespace?
by Larry Rosenman 02 Nov '16

02 Nov '16

On Wed, Nov 2, 2016 at 3:02 PM, Larry Rosenman <larryrtx(a)gmail.com> wrote: > why wouldn't it be able to use the ~/MAILARCHIVE/ filesystem space? > > The other indexes etc seem to get built there. > > I'll see if the current FreeBSD solr port is easier to set up than the > last time I tried. > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

doveadm index: can't index a different namespace?
by Larry Rosenman 02 Nov '16

02 Nov '16

doveadm -D -vvvvvv index \#ARCHIVE/\* garners the below for ALL mailboxes in the namespace: doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/clamav-rules: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-01 13:25:21] doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/SA/FN: Status lookup failed: Internal error occurred. Refer to server log for more information. [2016-11-01 13:25:21] thebighonker.lerctr.org ~ $ doveconf -n attached. 2.2.26.0, pigeonhole 0.4.16, clucene from FreeBSD ports. What else do we need here? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

3 13

v2.2.26.0 released
by Timo Sirainen 02 Nov '16

02 Nov '16

http://dovecot.org/releases/2.2/dovecot-2.2.26.0.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.26.0.tar.gz.sig v2.2.26 had a couple of nasty bugs left in it, so here's a fixup release. The version number is also a little bit weird, but had to be done this way (although 2.2.26.0.1 could have been another possibility). - Fixed some compiling issues. - auth: Fixed assert-crash when using NTLM or SKEY mechanisms and multiple passdbs. - auth: Fixed crash when exporting to auth-worker passdb extra fields that had empty values. - dsync: Fixed assert-crash in dsync_brain_sync_mailbox_deinit

6 17

Dovecot Issues on FreeBSD 10.3 and FreebSD 11.0
by The Doctor 02 Nov '16

02 Nov '16

Hello everyone. I see we are having issues with dovecot 2.226.0 in the FreeBSD world. I did run dovecot-2.2.26.rc1 myself and did not see repeat problem in POP3 or IMAP issue customers were reporting. I see this repeat issue in dovecot 2.26.0 either port or compiled similarly. So the question begs way so many problem in BSD after the initial release and not in rc1 ? -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca God,Queen and country!Never Satan President Republic!Beware AntiChrist rising! http://www.fullyfollow.me/rootnl2k Look at Psalms 14 and 53 on Atheism Time for the USA to hold a referendum on its republic and vote to dissolve!!

1 0

Re: doveadm index: can't index a different namespace?
by larryrtx 02 Nov '16

02 Nov '16

Anything else I can provide ? Sent from my Sprint Samsung Galaxy S7. -------- Original message --------From: Larry Rosenman <larryrtx(a)gmail.com> Date: 11/1/16 1:37 PM (GMT-06:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi> Cc: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Re: doveadm index: can't index a different namespace? Nothing in them from what I can see..... Nov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: fs: root=/home/mrm/mail, index=, indexpvt=, control=, inbox=/home/mrm/mail/INBOX, alt=Nov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVENov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: mbox: INBOX defaulted to /home/mrm/MAILARCHIVE/inboxNov 1 13:25:14 thebighonker dovecot: indexer-worker(mrm): Debug: fs: root=/home/mrm/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/mrm/MAILARCHIVE/inbox, alt=Nov 1 13:25:14 thebighonker exim[6544]: 1c1dkI-0001gw-B7 => mrm <mrm(a)lerctr.org> R=localuser T=dovecot_lmtp S=11532 C="250 2.0.0 <mrm(a)lerctr.org> pfbVHwreGFhQFgAAu+mOrA Saved" QT=0s DT=0sNov 1 13:25:14 thebighonker exim[6544]: 1c1dkI-0001gw-B7 Completed QT=0sNov 1 13:25:15 thebighonker dovecot: indexer-worker(mrm): Debug: Mailbox INBOX: Opened mail UID=447860 because: fts indexingNov 1 13:25:15 thebighonker dovecot: indexer-worker(mrm): Indexed 1 messages in INBOXNov 1 13:25:19 thebighonker exim[6519]: H=(ylmf-pc) [69.64.78.83]:57747 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pcNov 1 13:25:27 thebighonker dovecot: imap-login: Login: user=<ler>, method=PLAIN, rip=2001:470:1f0f:3ad:223:7dff:fe9e:6e8a, lip=2001:470:1f0f:3ad:223:7dff:fe9e:6e8a, mpid=6583, TLS, session=<mEXVckFAIEcgAQRwHw8DrQIjff/+nm6K>Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Loading modules from directory: /usr/local/lib/dovecotNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.soNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.soNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.soNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.soNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.soNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib95_imap_stats_plugin.soNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Effective uid=1001, gid=1001, home=/home/lerNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOXNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt=Nov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVENov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inboxNov 1 13:25:27 thebighonker dovecot: imap(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/ler/MAILARCHIVE/inbox, alt=Nov 1 13:25:27 thebighonker dovecot: imap(ler): Logged out in=6049 out=63372 fhc=50 fhb=22424 fbc=0 fbb=0 del=0 exp=0 trash=0Nov 1 13:25:29 thebighonker exim[6561]: H=(ylmf-pc) [69.64.78.83]:63376 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pcNov 1 13:25:39 thebighonker exim[6585]: H=(ylmf-pc) [69.64.78.83]:60216 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pcNov 1 13:25:46 thebighonker exim[6588]: no host name found for IP address 125.123.158.215Nov 1 13:25:47 thebighonker exim[6588]: H=(qrhx) [125.123.158.215]:60710 I=[192.147.25.65]:25 F=<ler(a)lerctr.org> rejected RCPT <3371453348(a)qq.com>: RBL: found in zen.spamhaus.org (127.0.0.11) (https://www.spamhaus.org/query/ip/125.123.158.215)Nov 1 13:25:48 thebighonker exim[6588]: unexpected disconnection while reading SMTP command from (qrhx) [125.123.158.215]:60710 I=[192.147.25.65]:25Nov 1 13:25:49 thebighonker exim[6590]: H=(ylmf-pc) [69.64.78.83]:60073 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pcNov 1 13:25:59 thebighonker exim[6608]: H=(ylmf-pc) [69.64.78.83]:60168 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pcNov 1 13:26:09 thebighonker exim[6613]: H=(ylmf-pc) [69.64.78.83]:55031 I=[192.147.25.65]:25 rejected EHLO or HELO ylmf-pc: CHECK_HELO: ylmf-pcNov 1 13:26:15 thebighonker dovecot: imap-login: Login: user=<ler>, method=PLAIN, rip=2600:1:d613:48fb:b5da:4a31:b4b6:7ff8, lip=2001:470:1f0f:3ad:223:7dff:fe9e:6e8a, mpid=6645, TLS, session=<PsGzdUFA9Y8mAAAB1hNI+7XaSjG0tn/4>Nov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Loading modules from directory: /usr/local/lib/dovecotNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.soNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.soNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.soNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.soNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.soNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib95_imap_stats_plugin.soNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Effective uid=1001, gid=1001, home=/home/lerNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOXNov 1 13:26:15 thebighonker dovecot: imap(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt= I can provide fuller logs, but doveadm running on the server seems to log all to it's ownsrdout/stderr On Tue, Nov 1, 2016 at 1:32 PM, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: Server logs would be appreciated. Aki > On November 1, 2016 at 8:30 PM Larry Rosenman <larryrtx(a)gmail.com> wrote: > > > doveadm -D -vvvvvv index \#ARCHIVE/\* garners the below for ALL mailboxes > in the > namespace: > doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/clamav-rules: Status lookup > failed: Internal error occurred. Refer to server log for more information. > [2016-11-01 13:25:21] > doveadm(ler): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't > selectable > doveadm(ler): Error: Mailbox #ARCHIVE/2013/04/SA/FN: Status lookup failed: > Internal error occurred. Refer to server log for more information. > [2016-11-01 13:25:21] > thebighonker.lerctr.org ~ $ > > doveconf -n attached. > > 2.2.26.0, pigeonhole 0.4.16, clucene from FreeBSD ports. > > What else do we need here? > > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Α compilation problem exists with Sun studio 12
by Limperis Antonis 02 Nov '16

02 Nov '16

Hello, I tried to compile Dovecot 2.2.26.0 with Sun Studio 12.0 on a Sun Solaris 10 x86 machine, but an error occurred related to src/lib-ldap/ldap-compare.c. "ldap-compare.c", line 112: void function cannot return value cc: acomp failed for ldap-compare.c *** Error code 1 make: Fatal error: Command failed for target `ldap-compare.lo' The problem fixed with the following changes on this file: --- dovecot-2.2.26.0/src/lib-ldap/ldap-compare.c.orig Wed Nov 2 06:51:27 2016 +++ dovecot-2.2.26.0/src/lib-ldap/ldap-compare.c Wed Nov 2 06:24:02 2016 @@ -109,7 +109,9 @@ req->send_request_cb = ldap_compare_send; req->timeout_secs = input->timeout_secs; - return ldap_connection_queue_request(conn, req); +// return ldap_connection_queue_request(conn, req); + ldap_connection_queue_request(conn, req); + return; } You could see it in the next release of dovecot; Thank You. Antonis

2 1

Server migration
by Gandalf Corvotempesta 01 Nov '16

01 Nov '16

Hi i have to migrate, online, a dovecot 1.2.15 to a new server. Which is the best way to accomplish this? I have 2 possibility: 1) migrate from the very old server to a newer server with the same dovecot version 2) migrate from the very old server to a new server with the latest dovecot version can i simply use rsync to sync everything and, when the sync is quick, move the mailbox from the old server to the new server? My biggest concern is how to manage the the emails that are coming during the server switch. Let's assume a 50gb maildir , the first sync would require hours to complete (tons of very small files) do i can't shutdown the mailbox. The second sync would require much less time and would also sync the email received during the first sync (but the mailbox is still receiving new emails) now, as third phase, i can move the mailbox to the new server (by changing the postfix configuration) so that all new emails are received on the new server and then start the last rsync (by removing the --delete flag or any new emails would be deleted as not existsnt on the older server) Any better solution?

7 21

Released Pigeonhole v0.4.16 for Dovecot v2.2.26.0.
by Stephan Bosch 01 Nov '16

01 Nov '16

Hello Dovecot users, Here's the definitive 0.4.16 release. There were no changes since the release candidate. The reported replication issues are still open, since we haven't been able to reproduce them so far. Changelog v0.4.16: * Part of the Sieve extprograms implementation was moved to Dovecot, which means that this release depends on Dovecot v2.2.26+. * ManageSieve: The PUTSCRIPT command now allows uploading empty Sieve scripts. There was really no good reason to disallow doing that. + Sieve vnd.dovecot.report extension: + Added a Dovecot-Reporting-User field to the report body, which contains the e-mail address of the user sending the report. + Added support for configuring the "From:" address used in the report. + LDA sieve plugin: Implemented support for a "discard script" that is run when the message is going to be discarded. This allows doing something other than throwing the message away for good. + Sieve vnd.dovecot.environment extension: Added vnd.dovecot.config.* environment items. These environment items map to sieve_env_* settings from the plugin {} section in the configuration. Such values can of course also be returned from userdb. + Sieve vacation extension: Use the Microsoft X-Auto-Response-Suppress header to prevent unwanted responses from and to (older) Microsoft products. + ManageSieve: Added rawlog_dir setting to store ManageSieve traffic logs. This replaces at least partially the rawlog plugin (mimics similar IMAP/POP3 change). - doveadm sieve plugin: synchronization: Prevent setting file timestamps to unix epoch time. This occurred when Dovecot passed the timestamp as 'unknown' during synchronization. - Sieve exprograms plugin: Fixed spurious '+' sometimes returned at the end of socket-based program output. - imapsieve plugin: Fixed crash occurring in specific situations. - Performed various fixes based on static analysis and Clang warnings. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.16.ta… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.16.ta… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 1

2.2.26.0: Error: redis: Unexpected input (state=0): -ERR max number of clients reached
by Tom Sommer 01 Nov '16

01 Nov '16

I use redis as quota backend (currently). After upgrading to 2.2.26.0 I see a ton of "Error: redis: Unexpected input (state=0): -ERR max number of clients reached" errors. It looks like either more Redis connections are being made, or Redis connections don't time out/are reused correctly anymore. No such errors were seen in 2.2.24. -- Tom

1 0

Panic: file mail-transaction-log-file.c: line 104 (mail_transaction_log_file_free): assertion failed: (!file->locked)
by Arkadiusz Miśkiewicz 01 Nov '16

01 Nov '16

2.2.25 (also happens on 2.2.24). Happens every time I try to make deliver and only for this user: Jul 14 09:52:02 mbox dovecot: lmtp(25601): Connect from local Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=<CRU2EaJEh1cBZAAALZVUYQ>, Error: Index /var/mail/powiadomienia/dovecot.index: Lost log for seq=1009 offset=40: Missing middle file seq=1009 (between 1009..4294967295) Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=<CRU2EaJEh1cBZAAALZVUYQ>, Warning: fscking index file /var/mail/powiadomienia/dovecot.index Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=<CRU2EaJEh1cBZAAALZVUYQ>, Error: Fixed index file /var/mail/powiadomienia/dovecot.index: log_file_seq 1009 -> 1011 Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=<CRU2EaJEh1cBZAAALZVUYQ>, Panic: file mail-transaction-log-file.c: line 104 (mail_transaction_log_file_free): assertion failed: (!file->locked) Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=<CRU2EaJEh1cBZAAALZVUYQ>, Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d7d2) [0x7feb89fc97d2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8d8bd) [0x7feb89fc98bd] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7feb89f67e31] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_free+0x160) [0x7feb8a331fa0] -> /usr/lib64/dovecot/libdovecot- storage.so.0(mail_transaction_logs_clean+0x4d) [0x7feb8a3360ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_close+0x30) [0x7feb8a336230] -> /usr/lib64/dovecot/libdovecot- storage.so.0(mail_transaction_log_move_to_memory+0xd5) [0x7feb8a3363e5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_move_to_memory+0xa0) [0x7feb8a330440] -> /usr/lib64/dovecot/libdovecot- storage.so.0(mail_index_write+0x183) [0x7feb8a32e9d3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_fsck+0xc1f) [0x7feb8a3186ff] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x49b) [0x7feb8a322eab] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x71) [0x7feb8a31a231] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xe0fed) [0x7feb8a32ffed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xe15f3) [0x7feb8a3305f3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x78) [0x7feb8a3306d8] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x92) [0x7feb8a309202] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x6c0e2) [0x7feb8a2bb0e2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x6c1c8) [0x7feb8a2bb1c8] -> /usr/lib64/dovecot/plugins/lib20_zlib_plugin.so(+0x2fdc) [0x7feb85697fdc] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x450c6) [0x7feb8a2940c6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7feb8a294240] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save_open+0xad) [0x7feb8a58d1ad] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save+0xbb) [0x7feb8a58d48b] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x123) [0x7feb8a58d9e3] -> dovecot/lmtp [DATA powiadomienia]() [0x406bc8] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7feb89fdd67c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7feb89fdeb01] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7feb89fdd705] Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=<CRU2EaJEh1cBZAAALZVUYQ>, Fatal: master: service(lmtp): child 25601 killed with signal 6 (core dumps disabled) -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

2 4

please suggest me a nice movie
by bunkertor 01 Nov '16

01 Nov '16

Hi! I'd like to watch something really interesting, can you suggest me something cool? Here is the list of movies I've already watched <http://ferruccio.realestatelakewildwood.com/oikhd/1> bunkertor

1 0

mail relay for local network
by jean francois pion 01 Nov '16

01 Nov '16

hello, i'm quite a newbie to the mail server instalation and admin (you must start one day !) i would like to use a rapberry pi to build a system to get the mails from different mail accounts via pop, to store them in the raspberry memory an be able to get them with my thunderbird client on the different computers on my local network. no need to accesse them via internet it is for local use only. the puropose is to avoid gettin my fai mail box full and loosing mails (quite a big mail traffic ) no need for spamkiller i've got what i want already on the computer no need for an smtp relay the computer can acces the fai smtp, is dovecot able to do that ? thank you sorry for the bad english -- -- JF Pion *Quand je suis allé à l'école, ils m'ont demandé ce que je voulais être quand je serai grand. J'ai répondu : "Heureux"* Ils m’ont dit que je n’avais pas compris la question, j’ai répondu qu’ils n’avaient pas compris la vie. John Lennon Des montages électroniques pour le modélisme http://jean.francois.pion.free.fr le site du vol électrique http://electrofly.free.fr/ --- L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel antivirus Avast. https://www.avast.com/antivirus

2 1

IP Addresses
by Stephen Hanselman 01 Nov '16

01 Nov '16

Good Morning, Can someone point me to the area in Dovecot that deals with incoming IP addresses. Specifically I want to determine if it is possible to "spoof" the address or is the address I look at in the headers the actual address that made the connection request (hopefully it is). Thank you Steve Hanselman

2 1

Safe to run migration on live/production server?
by mrobti＠insiberia.net 31 Oct '16

31 Oct '16

I have an old mbox formatted INBOX and folders that need to be converted to a Maildir. Can I run the dsync command when the server is live and Dovecot LMTP is delivering new mails to the same user? Will it be able to preserve UIDs and not confuse any indexes? I started the job with deliveries disabled so the conversion could complete, but it's taking too long. I want to know if I can re-enable mail deliveries and not cause problems. I see it building a massive number of files in the user's Maildir/tmp folder, which I presume is normal. By the way, what's the size multiplier for mbox to maildir for many small emails only a couple K each? I'm finding it's a lot more disk space for maildir in this case.

1 0

doveadm stats top crash
by Sven Roellig 31 Oct '16

31 Oct '16

Hi,when i start doveadm stats top it crash Panic: key not found from hash Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9560e) [0x7fe0e5e5c60e] -> /usr/lib/dovecot/libdovecot.so.0(+0x95688) [0x7fe0e5e5c688] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fe0e5df496e] -> doveadm(+0x25290) [0x7fe0e6abb290] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xfb) [0x7fe0e5e7104b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xc3) [0x7fe0e5e72643] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fe0e5e71265] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0x7fe0e5e71400] -> doveadm(+0x256a1) [0x7fe0e6abb6a1] -> doveadm(doveadm_cmd_ver2_to_cmd_wrapper+0x23a) [0x7fe0e6acf8aa] -> doveadm(doveadm_cmd_run_ver2+0x560) [0x7fe0e6ad0600] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x7fe0e6ad0657] -> doveadm(main+0x1e4) [0x7fe0e6ab07c4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fe0e5a3db45] -> doveadm(+0x1aba8) [0x7fe0e6ab0ba8] Aborted Sven

1 0

Dovecot Proxy and Director
by Gandalf Corvotempesta 29 Oct '16

29 Oct '16

Hi, just a simple question: by using a directory and a proxy, I would be able to totally hide the pop3/imap server ip addresses from outside? I'm asking this because I would like to hide the real server IP for security reasosn (DDoS and so on). The proxy would be placed on servers with high bandwidth while the pop3/imap dovecot servers are placed in a small datacenter that would go down easily in case of attack

2 2

Panic: file dsync-brain-mailbox.c: line 358 (dsync_brain_sync_mailbox_deinit): assertion failed: (brain->failed || brain->sync_type == DSYNC_BRAIN_SYNC_TYPE_CHANGED)
by Gilles Chauvin 28 Oct '16

28 Oct '16

Hello, Here is a Panic that happened while doing some testing with two servers both running Dovecot v2.2.26 on CentOS 7. These are test servers owning 32 accounts whose data were copied from our production server. What I've done is: server01# doveadm force-resync -A '*' server01# doveadm replicator replicate -f '*' For 5 accounts I obtained the following crash: 2016-10-28T14:09:43.236946+02:00 server01 dovecot: dsync-server(someuser): Panic: file dsync-brain-mailbox.c: line 358 (dsync_brain_sync_mailbox_deinit): assertion failed: (brain->failed || brain->sync_type == DSYNC_BRAIN_SYNC_TYPE_CHANGED) 2016-10-28T14:09:43.237441+02:00 server01 dovecot: dsync-server(someuser): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x8f7e0) [0x7f3d9318d7e0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x8f8be) [0x7f3d9318d8be] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3d9312b9be] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox](dsync_brain_sync_mailbox_deinit+0x163) [0x438243] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox](dsync_brain_slave_recv_mailbox+0x277) [0x438da7] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox](dsync_brain_run+0x5fe) [0x4368be] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox]() [0x436c71] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox]() [0x44becf] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f3d931a0c3c] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe7) [0x7f3d931a1fd7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f3d931a0cc5] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3d931a0e78] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox]() [0x41fc7e] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox]() [0x421256] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox]() [0x433654] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f3d931a0c3c] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe7) [0x7f3d931a1fd7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f3d931a0cc5] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3d931a0e78] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3d93131a23] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox](main+0x197) [0x413c87] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f3d92d5db15] -> dovecot/doveadm-server [10.0.0.2 someuser slave_recv_mailbox]() [0x413d25] 2016-10-28T14:09:43.238013+02:00 server01 dovecot: dsync-server(someuser): Fatal: master: service(doveadm): child 96390 killed with signal 6 (core dumps disabled) 2016-10-28T14:09:43.505098+02:00 server01 dovecot: dsync-server(someuser): Error: read(server02.localdomain) failed: read(size=5807) failed: Connection reset by peer (last sent=mailbox_state, last recv=mailbox_state) Regards, Gilles.

2 2

use a second userdb that only returns extra fields
by Alexander 'Leo' Bergolth 28 Oct '16

28 Oct '16

Hi! Is it possible to get all basic userdb information from the passwd userdb and add a second userdb of type checkpassword that only sets some additional extra fields like namespaces? I tried the following setup: -------------------- 8< -------------------- userdb { driver = passwd result_success = continue-ok } userdb { driver = checkpassword args = /usr/local/sbin/dovecot-userdb.py skip = never } -------------------- 8< -------------------- ... but it seems that as soon as the second userdb is active, dovecot doesn't take settings like uid and gid from the first userdb anymore. (Even if I don't set userdb_uid and userdb_gid in checkpassword.) On the other hand there are no environment variables that pass the settings from the previous lookup to the checkpassword script. Cheers, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

1 0

Dovecot POP3 - Enable POP for mail that arrives from now on
by Ricardo Machini Barbosa 28 Oct '16

28 Oct '16

Hello, Someone knows some method for implement feature like Gmail and Zimbra, about download POP3 messages only that "arrives from now" ? Regards, Ricardo Machini

1 0

v2.2.26 released
by Timo Sirainen 28 Oct '16

28 Oct '16

http://dovecot.org/releases/2.2/dovecot-2.2.26.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.26.tar.gz.sig There were some changes since rc1: https://github.com/dovecot/core/commit/54d654098032d96975b70749b505fae538e9… Mainly there are quite a lot of director fixes and improvements. Here's the full list of changes: * master: Removed hardcoded 511 backlog limit for listen(). The kernel should limit this as needed. * doveadm import: Source user is now initialized the same as target user. Added -U parameter to override the source user. * Mailbox names are no longer limited to 16 hierarchy levels. We'll check another way to make sure mailbox names can't grow larger than 4096 bytes. + Added a concept of "alternative usernames" by returning user_* extra field(s) in passdb. doveadm proxy list shows these alt usernames in "doveadm proxy list" output. "doveadm director&proxy kick" adds -f <passdb field> parameter. The alt usernames don't have to be unique, so this allows creation of user groups and kicking them in one command. + auth: passdb/userdb dict allows now %variables in key settings. + auth: If passdb returns noauthenticate=yes extra field, assume that it only set extra fields and authentication wasn't actually performed. + auth: passdb static now supports password={scheme} prefix. + auth, login_log_format_elements: Added %{local_name} variable, which expands to TLS SNI hostname if given. + imapc: Added imapc_max_line_length to limit maximum memory usage. + imap, pop3: Added rawlog_dir setting to store IMAP/POP3 traffic logs. This replaces at least partially the rawlog plugin. + dsync: Added dsync_features=empty-header-workaround setting. This makes incremental dsyncs work better for servers that randomly return empty headers for mails. When an empty header is seen for an existing mail, dsync assumes that it matches the local mail. + doveadm sync/backup: Added -I <max size> parameter to skip too large mails. + doveadm sync/backup: Fixed -t parameter and added -e for "end date". + doveadm mailbox metadata: Added -s parameter to allow accessing server metadata by using empty mailbox name. + Added "doveadm service status" and "doveadm process status" commands. + director: Added director_flush_socket. See http://wiki2.dovecot.org/Director#Flush_socket + doveadm director flush: Users are now moved only max 100 at a time to avoid load spikes. --max-parallel parameter overrides this. + Added FILE_LOCK_SLOW_WARNING_MSECS environment, which logs a warning if any lock is waited on or kept for this many milliseconds. - master process's listener socket was leaked to all child processes. This might have allowed untrusted processes to capture and prevent "doveadm service stop" comands from working. - login proxy: Fixed crash when outgoing SSL connections were hanging. - auth: userdb fields weren't passed to auth-workers, so %{userdb:*} from previous userdbs didn't work there. - auth: Each userdb lookup from cache reset its TTL. - auth: Fixed auth_bind=yes + sasl_bind=yes to work together - auth: Blocking userdb lookups reset extra fields set by previous userdbs. - auth: Cache keys didn't include %{passdb:*} and %{userdb:*} - auth-policy: Fixed crash due to using already-freed memory if policy lookup takes longer than auth request exists. - lib-auth: Unescape passdb/userdb extra fields. Mainly affected returning extra fields with LFs or TABs. - lmtp_user_concurrency_limit>0 setting was logging unnecessary anvil errors. - lmtp_user_concurrency_limit is now checked before quota check with lmtp_rcpt_check_quota=yes to avoid unnecessary quota work. - lmtp: %{userdb:*} variables didn't work in mail_log_prefix - autoexpunge settings for mailboxes with wildcards didn't work when namespace prefix was non-empty. - Fixed writing >2GB to iostream-temp files (used by fs-compress, fs-metawrap, doveadm-http) - director: Ignore duplicates in director_servers setting. - director: Many fixes related to connection handshaking, user moving and error handling. - director: Don't break with shutdown_clients=no - zlib, IMAP BINARY: Fixed internal caching when accessing multiple newly created mails. They all had UID=0 and the next mail could have wrongly used the previously cached mail. - doveadm stats reset wasn't reseting all the stats. - auth_stats=yes: Don't update num_logins, since it doubles them when using with mail stats. - quota count: Fixed deadlocks when updating vsize header. - dict-quota: Fixed crashes happening due to memory corruption. - dict proxy: Fixed various timeout-related bugs. - doveadm proxying: Fixed -A and -u wildcard handling. - doveadm proxying: Fixed hangs and bugs related to printing. - imap: Fixed wrongly triggering assert-crash in client_check_command_hangs. - imap proxy: Don't send ID command pipelined with nopipelining=yes - imap-hibernate: Don't execute quota_over_script or last_login after un-hibernation. - imap-hibernate: Don't un-hibernate if client sends DONE+IDLE in one IP packet. - imap-hibernate: Fixed various failures when un-hibernating. - fts: fts_autoindex=yes was broken in 2.2.25 unless fts_autoindex_exclude settings existed. - fts-solr: Fixed searching multiple mailboxes (patch by x16a0) - doveadm fetch body.snippet wasn't working in 2.2.25. Also fixed a crash with certain emails. - pop3-migration + dbox: Various fixes related to POP3 UIDL optimization in 2.2.25. - pop3-migration: Fixed "truncated email header" workaround.

5 10

Bugreport: managesieve-login won't start without a ssl-key
by Moritz Fago 28 Oct '16

28 Oct '16

Hello, If you don’t have a ssl_key and ssl_cert configured in your dovecot config managesieve-login will fail to start with the following error message: dovecot: managesieve-login: Fatal: Couldn't parse private ssl_key: error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: ANY PRIVATE KEY, even if you haven’t enabled ssl for managesieve-login. Infos according to http://www.dovecot.org/bugreport.html: Filesystem: ext4 doveconf -n: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.6 auth_default_realm = toppoint.de auth_mechanisms = plain login auth_username_format = %Ln mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = dovecot driver = pam } plugin { sieve = ~/.sieve/dovecot.sieve sieve_dir = ~/.sieve } protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 ssl = yes } } ssl = required ssl_cert = </etc/ssl/private/imap.toppoint.de.crt ssl_cipher_list = HIGH::!aNULL:!eNULL:!kRSA:!kPSK:!kSRP:!aDSS:!kECDH:!kDH:!MD5:!SHA1:!RC2:!RC4:!SEED:!IDEA:!DES:!3DES ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/imap.toppoint.de.pem ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv3 !SSLv2 userdb { driver = passwd } protocol lmtp { mail_plugins = sieve } protocol imap { ssl_cert = </etc/ssl/private/imap.toppoint.de.crt ssl_key = </etc/ssl/private/imap.toppoint.de.pem } protocol pop3 { ssl_cert = </etc/ssl/private/pop3.toppoint.de.crt ssl_key = </etc/ssl/private/pop3.toppoint.de.pem } P.S I used doveconf -n to generate the config output, the website says you should use dovecot -n, is this an error or intentional?

3 2

Subscription not immediately reflected
by John van der Kamp 27 Oct '16

27 Oct '16

Hello, I noticed that somewhere between 2.2.22 and 2.2.25 the workings of subscriptions seem to have changed. In version 2.2.25, when a client subscribes to a folder, and then does an LSUB command, it will not see that subscribed folder. If you retry the LSUB command, the change is there. Same with unsubscribes. In version 2.2.22 I did not see this weird behavior. John

3 5

multiple SSL certificates story
by Arkadiusz Miśkiewicz 26 Oct '16

26 Oct '16

Hi. Little story :-) I'm playing with dovecot 2.2.25 and multiple SSL certificates. ~7000 certificates which are loaded twice, so my dovecot has ~14 000 certificate pairs (14k key + 14k cert) in config. 14 000 local_name entries. Like these: local_name imap.example.com { ssl_cert = </etc/certs/cert1.pem ssl_key = </etc/certs/cert1.pem } local_name pop3.example.com { ssl_cert = </etc/certs/cert1.pem ssl_key = </etc/certs/cert1.pem } (it needs to be "duplicated" like this because dovecot doesn't support globs/regexps for local_name, so can't use: local_name *.example.com { ssl_cert = </etc/certs/cert1.pem ssl_key = </etc/certs/cert1.pem } ) All certificates take 87MB on disk. Dovecot config for certificates itself is 3MB. Now fun begins. Trying to start dovecot fails Oct 26 12:49:59 ixion dovecot[19831]: master: Dovecot v2.2.25 (7be1766) starting up for imap, pop3, lmtp (core dumps disabled) Oct 26 12:50:01 ixion dovecot[19835]: config: Fatal: pool_system_malloc(1608): Out of memory Oct 26 12:50:01 ixion dovecot[19831]: master: Error: service(config): command startup failed, throttling for 2 secs Oct 26 12:50:01 ixion dovecot[19835]: config: Fatal: master: service(config): child 19837 returned error 83 (Out of memory (service config { vsz_limit=1024 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) Oct 26 12:50:01 ixion dovecot[19835]: anvil: Fatal: Error reading configuration: read(/var/run/dovecot/config) failed: read(size=8192) failed: Connection reset by peer Oct 26 12:50:01 ixion dovecot[19835]: ssl-params: Fatal: Error reading configuration: read(/var/run/dovecot/config) failed: read(size=8192) failed: Connection reset by peer Oct 26 12:50:01 ixion dovecot[19831]: master: Error: service(anvil): command startup failed, throttling for 2 secs Oct 26 12:50:01 ixion dovecot[19831]: master: Error: service(ssl-params): command startup failed, throttling for 2 secs vsz_limit=1024 MB not enough. 2048 MB not enough. Raised to 3048 MB - now memory is enough but it still isn't able to start because it hits hardcoded config reading timeout (#define CONFIG_READ_TIMEOUT_SECS 10) Oct 26 13:00:24 ixion dovecot[20272]: master: Dovecot v2.2.25 (7be1766) starting up for imap, pop3, lmtp (core dumps disabled) Oct 26 13:00:34 ixion dovecot[20276]: anvil: Fatal: Error reading configuration: Timeout reading config from /var/run/dovecot/config Oct 26 13:00:34 ixion dovecot[20276]: ssl-params: Fatal: Error reading configuration: Timeout reading config from /var/run/dovecot/config Oct 26 13:00:34 ixion dovecot[20272]: master: Error: service(anvil): command startup failed, throttling for 2 secs Oct 26 13:00:34 ixion dovecot[20272]: master: Error: service(ssl-params): command startup failed, throttling for 2 secs On faster, SSD disk based machine with no load, it starts but then trying to do "doveadm reload" ends up with timeout Oct 26 12:22:12 master: Warning: SIGHUP received - reloading configuration Oct 26 12:22:22 master: Error: Error reading configuration: Timeout reading config from /var/run/dovecot/config dovecot also seem to stop handling clients when such reload happens. What can be done to make it work and how? ps. for comparison on how others handle SSL certificates. Exim MTA for example can easily handle milions of SSL certificates.That's because it loads certificates on demand, when these are actually needed. Core part of exim ssl config is two lines: tls_privatekey = ${if exists{/etc/certs/cert.${lc:${sha1:${lc:${tls_sni}}}}.pem}{/etc/certs//cert.${lc:${sha1:${lc:${tls_sni}}}}.pem}{/etc/certs/default-cert.key}} tls_certificate = ${if exists{/etc/certs/cert.${lc:${sha1:${lc:${tls_sni}}}}.pem}{/etc/certs/cert.${lc:${sha1:${lc:${tls_sni}}}}.pem}{/etc/certs/default-cert.pem}} which means check runtime if file on disk exists; if it exists then use it for tls_XYZ option; if it doesn't exist use default-cert.{pem/key} (sha1/lowercase game is to make sure that attacker cannot put own filename in TLS SNI servername). That's all. There is no memory impact and only little cpu impact with such solution. The other big advantage of exim solution is also no need for daemon to reload its config. You only change/add/remove certificate files on disk. ps2. thanks to letsencrypt project you can have thousands certificates for each domain/subdomain possible, so such usage should grow -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

2 2

Replication with SSL
by deZillium 26 Oct '16

26 Oct '16

Hello, - Set up a pair of servers according to http://wiki2.dovecot.org/Replication -Enabled SSL for both servers - Dovecot version: 2.2.13 (Debian 8.6) I couldn't find an option to specify the certificate that doveadm should use when connecting to the other server. Both servers have hostnames that are different, as verified by dovecot --hostdomain(as per the instructions) but use a common certificate when emailclients connect to them (high availability setup). Yes, single server login works as expected, been working for the past few years :-). Setting up a custom ssl_client_ca_file doesn't work, since doveadm doesn't know which certificate it should send when connecting to the other doveadm. Setting the ssl_client_ca_dir tothe directory with the global CAsdoesn't work either, since doveadm doesn't use the hostname that dovecot actually uses. The custom self-signed CA works when used outside dovecot(mysql for example). Is there any configuration thatneeds to be changed in order for doveadm to use a custom self signed certificate? Thank you

1 0

Shared storage for dovecot cluster
by Gandalf Corvotempesta 26 Oct '16

26 Oct '16

As I'm planning some server migrations and a new mail architecture, i would like to create an HA cluster Any advice on which kind of shared storage should i use? Are gluster performances with small files enough for dovecot? Any other solution? It's mandatory to avoid any splibrains or similiar thus the replication must be done on at least 3 storage servers.

1 0

Problem to configure dovecot-ldap.conf.ext
by Günther J. Niederwimmer 26 Oct '16

26 Oct '16

Hello, Dovecot 2.2.25 CentOS 7 I setup ldap (FreeIPA) to have a user for dovecot that can (read search compare) all attributes that I need for dovecot. I must also have mailAlternateAddress When I make a ldapsearch with this user, I found all I need to configure dovecot. But for me it is not possible to configure this correct ? I can make for user doveadm auth test office and doveadm auth test office(a)examle.com with success authentication but when I make a doveadm auth test info(a)example.co (mailAlternateAddress) I have a broken authentication Can any give me a hint what is wrong, or is this not possible ? # Space separated list of LDAP hosts to use. host:port is allowed too. #hosts = 192.168.100.204 192.168.100.214 #hosts = 192.168.100.204 hosts = ipa.example.com # LDAP URIs to use. You can use this instead of hosts list. Note that this # setting isn't supported by all LDAP libraries. #uris = ldap://ipa.example.com ldap://ipa1.example.com # Distinguished Name - the username used to login to the LDAP server. # Leave it commented out to bind anonymously (useful with auth_bind=yes). dn = uid=system,cn=sysaccounts,cn=etc,dc=example,dc=com # Password for LDAP server, if dn is specified. dnpass = 'XXXXXXXXXXXXXX' # Use SASL binding instead of the simple binding. Note that this changes # ldap_version automatically to be 3 if it's lower. Also note that SASL binds # and auth_bind=yes don't work together. sasl_bind = yes # SASL mechanism name to use. sasl_mech = gssapi # SASL realm to use. sasl_realm = EXAMPLE.COM # SASL authorization ID, ie. the dnpass is for this "master user", but the # dn is still the logged in user. Normally you want to keep this empty. sasl_authz_id = imap/mx01.example.com(a)EXAMPLE.COM # Use TLS to connect to the LDAP server. #tls = yes # TLS options, currently supported only with OpenLDAP: tls_ca_cert_file = /etc/ipa/ca.crt #tls_ca_cert_dir = #tls_cipher_suite = # TLS cert/key is used only if LDAP server requires a client certificate. #tls_cert_file = #tls_key_file = # Valid values: never, hard, demand, allow, try tls_require_cert = demand # Use the given ldaprc path. #ldaprc_path = # LDAP library debug level as specified by LDAP_DEBUG_* in ldap_log.h. # -1 = everything. You may need to recompile OpenLDAP with debugging enabled # to get enough output. #debug_level = 0 # Use authentication binding for verifying password's validity. This works by # logging into LDAP server using the username and password given by client. # The pass_filter is used to find the DN for the user. Note that the pass_attrs # is still used, only the password field is ignored in it. Before doing any # search, the binding is switched back to the default DN. auth_bind = yes # If authentication binding is used, you can save one LDAP request per login # if users' DN can be specified with a common template. The template can use # the standard %variables (see user_filter). Note that you can't # use any pass_attrs if you use this setting. # # If you use this setting, it's a good idea to use a different # dovecot-ldap.conf.ext for userdb (it can even be a symlink, just as long as # the filename is different in userdb's args). That way one connection is used # only for LDAP binds and another connection is used for user lookups. # Otherwise the binding is changed to the default DN before each user lookup. # # For example: # auth_bind_userdn = cn=%u,ou=people,o=org # auth_bind_userdn = uid=%n,cn=users,cn=accounts,dc=example,dc=com # LDAP protocol version to use. Likely 2 or 3. ldap_version = 3 # LDAP base. %variables can be used here. # For example: dc=mail, dc=example, dc=org base = cn=users,cn=accounts,dc=example,dc=com # Dereference: never, searching, finding, always #deref = never # Search scope: base, onelevel, subtree scope = subtree #scope = onelevel # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki2.dovecot.org/UserDatabase/ExtraFields #user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_attrs = uid=user,uid=home=/srv/vmail/%$,=uid=10000,=gid=10000 # Filter for user lookup. Some variables can be used (see # http://wiki2.dovecot.org/Variables for full list): # %u - username # %n - user part in user@domain, same as %u if there's no domain # %d - domain part in user@domain, empty if user there's no domain user_filter = (&(objectClass=mailrecipient)(|(uid=%Ln)(mail=%Lu) (mailAlternateAddress=%Lu))) # Password checking attributes: # user: Virtual user name (user@domain), if you wish to change the # user-given username to something else # password: Password, may optionally start with {type}, eg. {crypt} # There are also other special fields which can be returned, see # http://wiki2.dovecot.org/PasswordDatabase/ExtraFields pass_attrs = uid=user,userPassword=password,mailAlternateAddress=user # If you wish to avoid two LDAP lookups (passdb + userdb), you can use # userdb prefetch instead of userdb ldap in dovecot.conf. In that case you'll # also have to include user_attrs in pass_attrs field prefixed with "userdb_" # string. For example: #pass_attrs = uid=user,userPassword=password,\ # homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid # Filter for password lookups #pass_filter = (&(objectClass=posixAccount)(uid=%u)) pass_filter = (&(objectClass=mailrecipient)(|(uid=%Ln)(mail=%Lu) (mailAlternateAddress=%Lu))) # Attributes and filter to get a list of all users iterate_attrs = uid=user, mailAlternateAddress=user iterate_filter = (objectClass=posixAccount) # Default password scheme. "{scheme}" before password overrides this. # List of supported schemes is in: http://wiki2.dovecot.org/Authentication #default_pass_scheme = CRYPT -- mit freundlichen Grüßen / best regards, Günther J. Niederwimmer

2 3

Re: keent() from Tika - with doveadm
by Aki Tuomi 25 Oct '16

25 Oct '16

Hi, can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run p errno p ret p *ioloop p *ctx p *events Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is. > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

2 9

Break up massive INBOX?
by mrobti＠insiberia.net 25 Oct '16

25 Oct '16

I have inherited a 10+ GB mailbox which dsync converted to maildir very nicely. But 15GB in tens of thousands of messages is too much in one INBOX when used in webmail. I guess it's best to divide the messages into subfolders for date. Is there a server-side way to safely move messages into new subfolders so that Dovecot indexes and UIDs won't break? If I write a shell script to move maildir files based on date of the files, I think Dovecot would not like this? Also, is there any way to automatically create delivery or archive folders by date eg., on the 1st of each month? And deliver mails to the subfolder for the current month? I know I can create Sieve rules for such by hand, but prefer if there is a plugin or something to do this automatically.

2 3

ssl_options missing no_ticket documentation in example config
by Christopher Head 25 Oct '16

25 Oct '16

Hello! I have a very minor bug to report. The ssl_options configuration directive takes a space-separated list of options, each of which must be in the set {“no_compression”, “no_ticket”}, according to the 2.2.25 source code. However, the file doc/example-config/conf.d/10-ssl.conf shipped in the tarball only mentions the “no_compression” option; it makes no mention of the “no_ticket” option. Oh, and by the way, the changelog <http://dovecot.org/doc/NEWS> linked from the download page is missing information for anything newer than 2.2.21. Please include me in replies; I am not subscribed to the list. -- Christopher Head

1 0

Hierarchy separator and LAYOUT=FS change
by Simeon Ott 25 Oct '16

25 Oct '16

Hello, I stumbled across a 5-year-old post on the dovecot list about changing the dovecot hierarchy separator to enable shared mailboxes (http://www.dovecot.org/list/dovecot/2011-January/056201.html <http://www.dovecot.org/list/dovecot/2011-January/056201.html>). At the moment I’m stuck in a pretty similar situation. Migrated from courier to dovecot 2 years ago and preserved the dot-separator. Because I’m using the e-mail adress as a username, the dots for folder separation and the dots in the email adresses getting messed up - I do have a pretty small mailserver with about 150 accounts. The Maildir filestructur of a typical mail account looks like this: drwx------ 2 vmail vmail 4096 Oct 10 20:02 cur drwx------ 5 vmail vmail 4096 Oct 3 07:48 .Daten.Administration drwx------ 5 vmail vmail 4096 Oct 3 09:51 .Daten.Anfragen, Werbung drwx------ 5 vmail vmail 4096 Oct 3 08:02 .Daten drwx------ 5 vmail vmail 4096 Oct 6 09:57 .Daten.Intern drwx------ 5 vmail vmail 4096 Oct 3 08:03 .Daten.Intern.Fahrzeuge drwx------ 5 vmail vmail 4096 Oct 6 12:57 .Daten.Intern.Infos, FileMaker etc drwx------ 5 vmail vmail 4096 Oct 3 09:19 .Daten.Intern.Sonstiges drwx------ 5 vmail vmail 4096 Oct 3 07:47 .Daten.Kunden drwx------ 5 vmail vmail 4096 Sep 16 08:29 .Daten.Lieferanten drwx------ 5 vmail vmail 4096 Oct 3 08:28 .Daten.Marketing drwx------ 2 vmail vmail 4096 Oct 10 20:02 new drwx------ 5 vmail vmail 4096 Oct 10 18:00 .Sent drwx------ 5 vmail vmail 4096 Oct 10 18:00 .Spam drwx------ 5 vmail vmail 4096 Oct 10 18:00 .Trash When changing the separator in my inbox namespace the documentation mentions that the filestructur doesn’t change. This means I will get the same problems when using shared boxes with email adresses as usernames. I definitly need to change to maildir:~/Maildir:LAYOUT=fs When changing to LAYOUT=fs i need to convert all the mailboxes manually, is that correct? Is dsync is the way to go? Or is it better to leave the separator and change to a different username schema (without dots in it) and advise the clients to change their credentials? I know there are people out there who successfully converted this - but I can’f find that many information about this subject. doveconf -n: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.11 auth_mechanisms = plain login auth_verbose = yes lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_gid = 5000 mail_location = maildir:~/Maildir mail_plugins = zlib quota acl mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/spool/postfix/virtual/shared-mailboxes quota = maildir:User quota quota_exceeded_message = 4.2.2 Mailbox full quota_rule = *:storage=1G quota_rule2 = INBOX.Trash:storage=+100M quota_rule3 = INBOX.Spam:ignore quota_warning = storage=95%% quota-warning 95 %u sieve = ~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 0 } protocols = " imap lmtp sieve pop3" service auth { group = dovecot unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = dovecot } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/ssl/private/startssl-onnet.ch <http://startssl-onnet.ch/>-chain.crt ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA:!SSLv2 ssl_key = </etc/ssl/private/startssl-onnet.ch.key userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = zlib quota acl sieve } protocol lda { auth_socket_path = /var/run/dovecot/auth-master deliver_log_format = msgid=%m: %$ mail_plugins = zlib quota acl sieve postmaster_address = postmaster(a)onnet.ch <mailto:postmaster@onnet.ch> } protocol imap { mail_plugins = zlib quota acl imap_quota imap_acl } protocol sieve { info_log_path = /var/log/sieve.log log_path = /var/log/sieve.log mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } … parts of the ldap config user_attrs = homeDirectory=home=/var/spool/postfix/virtual/%$,uidNumber=uid,gidNumber=gid,quota=quota_rule=*:bytes=%$ user_filter = (&(objectClass=CourierMailAccount)(mail=%u)) … my shared configuration is currently commented out. # namespace { # type = shared # separator = . # prefix = shared.%%u. # location = maildir:%h/Maildir:INDEX=~/Maildir/shared/%%u # subscriptions = yes # list = children #} thanks in advance for any help Sincerely, Simeon - onnet.ch <http://onnet.ch/>

1 1

Re: keent() from Tika - with doveadm
by larryrtx 23 Oct '16

23 Oct '16

Any news Ali? Sent from my Sprint Samsung Galaxy S7. -------- Original message --------From: Larry Rosenman <larryrtx(a)gmail.com> Date: 10/21/16 12:27 PM (GMT-06:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi> Cc: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Re: keent() from Tika - with doveadm Unfortuantely it doesn't seem to log that, and it's not 100% consistent. I did catch one, but the log file is huge so it's at: http://www.lerctr.org/~ler/Dovecot/doveadm0-tika On Fri, Oct 21, 2016 at 12:17 PM, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > On October 21, 2016 at 8:06 PM Larry Rosenman <larryrtx(a)gmail.com> wrote: > > > getting the following: > > Oct 21, 2016 12:04:25 PM org.apache.tika.server.resource.TikaResource > logRequest > INFO: tika/ > (application/vnd.openxmlformats-officedocument.wordprocessingml.document) > doveadm(ctr): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response > for request [Req69: PUT http://localhost:9998/tika/] (took 91 ms + 210 ms > in queue) > doveadm(ctr): Panic: kevent(): Invalid argument > Abort trap (core dumped) > > if I turn off tika, I do NOt get it. > > 2.2.26-RC1 > > what else do you need? > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 Any hope for exact request? Aki Tuomi Dovecot oy -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

3 6

Messed up dovecot mail store, need some repair advice
by Gerben Wierda 23 Oct '16

23 Oct '16

Hello folks, I have an older dovecot 2.0 (which I will migrate to a 2.2 asap, but at this point in time I need a fix). This is a dovecot 2.0 that came with Mac OS X 10.8.5 Server 2.2.5. Today, my spam/virus filtering (clamav) on the Server broke down. As a result, all my meesages got the ***UNCHECKED*** tag added to each subject. That was clearly unacceptable. SO, for the tim ebeing I have set that tag to undef so the tag is no longer added. But I also wanted to repair the messages that already ended up in dovecot 2.0 So, I did something simple: stopped all mail services on the server, went into the dovecot mail store and edited the messages. I first tried with one small ccount and it seemed OK. But now my mail client is experiencing problems with the messages (cannot display) and I think I've been to simplistic. I have for instance notedthat th esizeof the message is part of the filename. So, I can change these of course, but probably I need to change more. Can someone enlighten me how I can repair the broken data store? Thanks, (Foolish) Gerben

2 3

More informations in doveadm proxy ring status
by Peer Heinlein 22 Oct '16

22 Oct '16

I would love to have a) the number of active users b) the number of active TCP sessions (pop3, imap, lmtp, sieve, doveadm) included in the output of "doveadm director ring status". This would be helpful to get a good overview over load and usage of the whole director ring and would help to plan downtimes and maintenance work. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

MFA 2FA TOTP razz-ma-tazz!
by WJCarpenter 22 Oct '16

22 Oct '16

I'd like to start offering my server's users multi-factor authentication. Right now, I funnel all authentication through dovecot. Before I get too far down the fantasy design path, I'm wondering if anyone else has already done this and could share some details or code. (I loaded up the subject line with acronyms to show how serious I am. :-)) I am specifically thinking of two-factor authentication using TOTP (time-based one-time passwords) as described in RFC-6238. Those are the ones compatible with Google Authenticator and compatible apps. I already am a user of those at several sites. Some of them don't have a separate opportunity to enter the 6-digit code. Instead, you append the 6-digit code to your normal password. If your config on the site shows you as a user of TOTP, they peel those trailing 6 digits off your password and then validate the rest of the password in the normal way. That is what I think I would do for dovecot authentication. So, who's already done this or something like it?

1 0

Dovecot does not close connections
by Benedikt Carda 22 Oct '16

22 Oct '16

Hello, I am running into this error: /Maximum number of connections from user+IP exceeded (mail_max_userip_connections=10)/ The suggested solution in hundreds of support requests on this mailing list and throughout the internet is to increase the number of maximum userip connections. But this is not curing the problem, it is just postponing it to the moment when the new limit is reached. When i type: /doveadm who// / I can see that some accounts have several pids running: /someaccount 10 imap (25396 25391 25386 25381 25374 7822 7817 5559 5543 5531) (xxx.xxx.xxx.xxx)/ Now when I check these pids with /ps aux/ I find out that the oldest pid (5531) has a lifetime of already over 12 hours. Anyway I know that the clients that initiated the connections are not connected anymore, so there is no way that there is a valid reason why this connection should still be open. Also I never had this problem before, it appeared some months ago. Does anybody know how to solve this? Thanks in advance, Benedikt.

3 4

keent() from Tika - with doveadm
by Larry Rosenman 21 Oct '16

21 Oct '16

getting the following: Oct 21, 2016 12:04:25 PM org.apache.tika.server.resource.TikaResource logRequest INFO: tika/ (application/vnd.openxmlformats-officedocument.wordprocessingml.document) doveadm(ctr): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req69: PUT http://localhost:9998/tika/] (took 91 ms + 210 ms in queue) doveadm(ctr): Panic: kevent(): Invalid argument Abort trap (core dumped) if I turn off tika, I do NOt get it. 2.2.26-RC1 what else do you need? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

2 2

Released Pigeonhole v0.4.16.rc1 for Dovecot v2.2.26.rc1.
by Stephan Bosch 21 Oct '16

21 Oct '16

Hello Dovecot users, The upcoming release includes quite a few new features for a change. The most important ones are the Sieve discard-script feature and the new vnd.dovecot.config environment items. Documentation for these features can be found in the package itself. Please test these thoroughly. Changelog v0.4.16: * Part of the Sieve extprograms implementation was moved to Dovecot, which means that this release depends on Dovecot v2.2.26+. * ManageSieve: The PUTSCRIPT command now allows uploading empty Sieve scripts. There was really no good reason to disallow doing that. + Sieve vnd.dovecot.report extension: + Added a Dovecot-Reporting-User field to the report body, which contains the e-mail address of the user sending the report. + Added support for configuring the "From:" address used in the report. + LDA sieve plugin: Implemented support for a "discard script" that is run when the message is going to be discarded. This allows doing something other than throwing the message away for good. + Sieve vnd.dovecot.environment extension: Added vnd.dovecot.config.* environment items. These environment items map to sieve_env_* settings from the plugin {} section in the configuration. Such values can of course also be returned from userdb. + Sieve vacation extension: Use the Microsoft X-Auto-Response-Suppress header to prevent unwanted responses from and to (older) Microsoft products. + ManageSieve: Added rawlog_dir setting to store ManageSieve traffic logs. This replaces at least partially the rawlog plugin (mimics similar IMAP/POP3 change). - doveadm sieve plugin: synchronization: Prevent setting file timestamps to unix epoch time. This occurred when Dovecot passed the timestamp as 'unknown' during synchronization. - Sieve exprograms plugin: Fixed spurious '+' sometimes returned at the end of socket-based program output. - imapsieve plugin: Fixed crash occurring in specific situations. - Performed various fixes based on static analysis and Clang warnings. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.16… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.16… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

v2.2.26 release candidate released
by Timo Sirainen 21 Oct '16

21 Oct '16

http://dovecot.org/releases/2.2/rc/dovecot-2.2.26.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.26.rc1.tar.gz.sig There are quite a lot of changes since v2.2.25. Please try out this RC so we can get a good and stable v2.2.26 out. * master: Removed hardcoded 511 backlog limit for listen(). The kernel should limit this as needed. * doveadm import: Source user is now initialized the same as target user. Added -U parameter to override the source user. * Mailbox names are no longer limited to 16 hierarchy levels. We'll check another way to make sure mailbox names can't grow larger than 4096 bytes. + Added a concept of "alternative usernames" by returning user_* extra field(s) in passdb. doveadm proxy list shows these alt usernames in "doveadm proxy list" output. "doveadm director&proxy kick" adds -f <passdb field> parameter. The alt usernames don't have to be unique, so this allows creation of user groups and kicking them in one command. + auth: passdb/userdb dict allows now %variables in key settings. + auth: If passdb returns noauthenticate=yes extra field, assume that it only set extra fields and authentication wasn't actually performed. + auth: passdb static now supports password={scheme} prefix. + imapc: Added imapc_max_line_length to limit maximum memory usage. + imap, pop3: Added rawlog_dir setting to store IMAP/POP3 traffic logs. This replaces at least partially the rawlog plugin. + dsync: Added dsync_features=empty-header-workaround setting. This makes incremental dsyncs work better for servers that randomly return empty headers for mails. When an empty header is seen for an existing mail, dsync assumes that it matches the local mail. + doveadm sync/backup: Added -I <max size> parameter to skip too large mails. + doveadm sync/backup: Fixed -t parameter and added -e for "end date". + doveadm mailbox metadata: Added -s parameter to allow accessing server metadata by using empty mailbox name. - master process's listener socket was leaked to all child processes. This might have allowed untrusted processes to capture and prevent "doveadm service stop" comands from working. - auth: userdb fields weren't passed to auth-workers, so %{userdb:*} from previous userdbs didn't work there. - auth: Each userdb lookup from cache reset its TTL. - auth: Fixed auth_bind=yes + sasl_bind=yes to work together - auth: Blocking userdb lookups reset extra fields set by previous userdbs. - auth: Cache keys didn't include %{passdb:*} and %{userdb:*} - auth-policy: Fixed crash due to using already-freed memory if policy lookup takes longer than auth request exists. - lib-auth: Unescape passdb/userdb extra fields. Mainly affected returning extra fields with LFs or TABs. - lmtp_user_concurrency_limit>0 setting was logging unnecessary anvil errors. - lmtp_user_concurrency_limit is now checked before quota check with lmtp_rcpt_check_quota=yes to avoid unnecessary quota work. - lmtp: %{userdb:*} variables didn't work in mail_log_prefix - autoexpunge settings for mailboxes with wildcards didn't work when namespace prefix was non-empty. - Fixed writing >2GB to iostream-temp files (used by fs-compress, fs-metawrap, doveadm-http) - director: Ignore duplicates in director_servers setting. - zlib, IMAP BINARY: Fixed internal caching when accessing multiple newly created mails. They all had UID=0 and the next mail could have wrongly used the previously cached mail. - doveadm stats reset wasn't reseting all the stats. - auth_stats=yes: Don't update num_logins, since it doubles them when using with mail stats. - quota count: Fixed deadlocks when updating vsize header. - dict-quota: Fixed crashes happening due to memory corruption. - dict proxy: Fixed various timeout-related bugs. - doveadm proxying: Fixed -A and -u wildcard handling. - doveadm proxying: Fixed hangs and bugs related to printing. - imap: Fixed wrongly triggering assert-crash in client_check_command_hangs. - imap proxy: Don't send ID command pipelined with nopipelining=yes - imap-hibernate: Don't execute quota_over_script or last_login after un-hibernation. - imap-hibernate: Don't un-hibernate if client sends DONE+IDLE in one IP packet. - imap-hibernate: Fixed various failures when un-hibernating. - fts: fts_autoindex=yes was broken in 2.2.25 unless fts_autoindex_exclude settings existed. - fts-solr: Fixed searching multiple mailboxes (patch by x16a0) - doveadm fetch body.snippet wasn't working in 2.2.25. Also fixed a crash with certain emails. - pop3-migration + dbox: Various fixes related to POP3 UIDL optimization in 2.2.25. - pop3-migration: Fixed "truncated email header" workaround.

10 17

Migrating users from a 2.0.19 to a 2.2.24 installation
by Gerben Wierda 21 Oct '16

21 Oct '16

Hello, I am currently still running an older dovecot (2.0.19apple1 on Mac OS X 10.8.5) and I want to migrate my users to a new server (macOS 10.12 with Server 5, which contains dovecot 2.2.24 (a82c823)). Basically, I want to create a new server installation on the new server so I don't bring any junk over (new user accounts, with the same uid/gid (still need to figure that one out), but after I have done that I need to move the data over from the old instalation to the new. Has anything changed in the formats between 2.0 and 2.2 that will stop me from doing this? Thanks, G

2 1

Extending IMAP daemon to comply with legacy Proxy
by Thorsten Hater 21 Oct '16

21 Oct '16

Hello, I am currently investigating if and how to migrate a legacy setup based on a modified Courier installation to Dovecot. So far I am really liking Dovecot. however, I will have to work with an existing IMAP proxy for the time being. In particular, the proxy authenticates the user and looks up the location of the mail directory and transfers the data to the actual server via an extension of the IMAP protocol. This extension will have to stay and the information transferred is not easily recoverable. Further database lookups on the real server would be possible to solve the issue, but I would prefer to keep the design intact at least for now. Is it possible to handle IMAP commands after LOGIN/AUTHENTICATE but before opening any mailboxes? Basically these commands aim to replace the userdb lookup. Any pointers on how to implement this, perhaps as a plugin? Best regards, Thorsten

1 0

sieve duplicate locking
by Alexander 'Leo' Bergolth 20 Oct '16

20 Oct '16

Hi! Does the duplicate sieve plugin do any locking to avoid duplicate parallel delivery of the same message? I sometimes experience duplicate mail delivery of messages with the same message-id, despite the use of a sieve duplicate filter. According to the log files, those messages are delivered in the same second by two parallel dovecot-lda processes. (Duplicate filtering works fine in all other cases.) RFC7352 states that the ID of a message may only be committed to the duplicate tracking list at the _end_ of a successful script execution, which may lead to race conditions. Maybe I am running into this? Is there an easy way to serialize mail delivery using some locking inside sieve? Or do I have to serialize per-user dovecot-lda delivery? Any experiences with that? I am using dovecot-2.2.25 and pidgeonhole-0.4.15. Mail is delivered using postfix-2.10 and dovecot-lda as mailbox_command. Mailbox format is maildir with LAYOUT=fs. Cheers, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

2 2

Re: Massive LMTP Problems with dovecot
by Ralf Hildebrandt 20 Oct '16

20 Oct '16

> We'll need the `dovecot -n` output first. Here we go: > # 2.2.devel (933d16f): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.devel (63f9b42) > # OS: Linux 3.13.0-98-generic x86_64 Ubuntu 14.04.5 LTS > default_vsz_limit = 2 G > lmtp_user_concurrency_limit = 10000 > mail_attachment_dir = /home/copymail/attachments > mail_location = mdbox:~/mdbox > mail_plugins = zlib fts fts_lucene > mdbox_rotate_size = 128 M > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = username_format=%u /etc/dovecot/passwd > driver = passwd-file > } > plugin { > fts = lucene > fts_autoindex = yes > fts_languages = de,en > fts_lucene = whitespace_chars=@. > sieve = file:~/sieve;active=~/.dovecot.sieve > zlib_save = gz > zlib_save_level = 5 > } > protocols = " imap lmtp" > service imap-login { > inet_listener imap { > address = 127.0.0.1 > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > inet_listener lmtp { > address = 141.42.1.208 > port = 1025 > } > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > } > ssl_ca = /etc/ssl/certs/ca-certificates.crt > ssl_cert = </etc/ssl/certs/mail-cbf.pem > ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 > ssl_key = # hidden, use -P to show it > ssl_prefer_server_ciphers = yes > ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = username_format=%u /etc/dovecot/passwd > driver = passwd-file > } > protocol lmtp { > mail_plugins = zlib fts fts_lucene > } Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 6

Lmtp Fatal Error
by Sven Roellig 19 Oct '16

19 Oct '16

Hi,dovecot is create an Fatal Panik Error. <AM5DMwaCBlgpDQAAWm89Cw>: Fatal: master: service(lmtp): child 3369 killed with signal 6 (core dumps disabled) <1jx3DhuCBlg1DQAAWm89Cw>: Panic: file lda-sieve-plugin.c: line 447 (lda_sieve_execute_scripts): assertion failed: (script != NULL) <1jx3DhuCBlg1DQAAWm89Cw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x93fae) [0x7f547f6a3fae] -> /usr/lib/dovecot/libdovecot.so.0(+0x9409c) [0x7f547f6a409c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f547f63d56e] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3ae8) [0x7f547d765ae8] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x49) [0x7f547fc709a9] -> dovecot/lmtp(+0x7201) [0x7f54800a1201] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5f) [0x7f547f6b88bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7f547f6b9d8a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f547f6b8965] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0x7f547f6b8b00] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f547f643ac3] -> dovecot/lmtp(main+0x1c9) [0x7f548009f2c9] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f547f286b45] -> dovecot/lmtp(+0x53ae) [0x7f548009f3ae] Normal Mails are not deliverd but filterd mails are deliverd. System is Debian 8.6 Dovecot Core is 2%3a2.3.0-alpha0-1-auto+385 AMD64 can anyone help. Sven

3 4

Iteration base for LDAP
by Taso N. Devetzis 19 Oct '16

19 Oct '16

Greetings, The iteration machinery uses the LDAP search base set with the "base" directive (typically from dovecot-ldap.conf.ext); the same base used during nominal operations (e.g., passdb/userdb searches). Consider a directory: dc=ROOT |_ dc=foo,dc=com,dc=ROOT (foo.com subtree) |_ dc=bar,dc=net,dc=ROOT (bar.net subtree) A search base setting appropriate for mail operations might be: base = dc=%Dd,dc=ROOT # e.g. dc=foo,dc=com,dc=ROOT for user(a)foo.com This fails when iterating, as the variable substitution is meaningless in this context (and even a static subtree search base would only cover a portion of the overall directory during iterative searches). Setting the base to "dc=ROOT" obviously solves the issue at the expense of searching the entire directory for all operations. This is less than optimal. I could not find a way to override this setting at runtime via a doveadm option or similar. Ideally, a separate "iterate_base" setting would solve this issue. Any other solutions? Thanks, /taso

1 0

RE: First steps in Dovecot; IMAP not working
by Joseph Tam 19 Oct '16

19 Oct '16

> > doveadm user mailtest > field value > uid 1002 > gid 8 > home /home/mailtest > mail mbox:~/mail:INBOX=/var/mail/mailtest > system_groups_user mailtest Looks fine. > [log files] I'll try to locate them. Your best hope. Maybe this helps doveconf -n | grep log_ Or just force it somewhere by settings the *log_path configuration values. Also your mail server's log when trying to deliver. Joseph Tam <jtam.home(a)gmail.com>

1 0

Dict proxy client returning empty string instead of multiline string
by Pierre Jaury 18 Oct '16

18 Oct '16

Hello, I am using a dict proxy for my sieve extdata plugin to access some fields from an SQLite database (autoreply text and other database-configured items). All tests are performed against version 2.2.25. $ dovecot --version 2.2.25 (7be1766) My configuration looks like: dict { sieve = sqlite:/etc/dovecot/pigeonhole-sieve.dict } [...] sieve_extdata_dict_uri = proxy::sieve I am able to read pretty much any attribute without any issue, except when the value contains a special character like "\r" or "\n". By using the doveadm dict client, I narrowed it down to the dictionary management part (either server, protocol or client). I was suspecting escaping functions from "lib/strescape.c" (mostly str_tabescape and its counterpart, used by "lib-dict/client.c"), so I monitored socket communications. It seems that escaping is done properly on the server and the socket is not an issue either. The following strace dump results from running "doveadm dict get" against the dict socket: connect(8, {sa_family=AF_UNIX, sun_path="..."}, 110) = 0 fstat(8, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 [...] write(8, "H2\t0\t0\tadmin(a)domain.tld\tsieve\n", 30) = 30 [...] read(8, "Otest\1r\1ntest\n", 8192) = 14 Indeed "\1r" and "\1n" are the escape sequences used by "lib/strescape.c". I went deeped and debugged the call to "dict_lookup" performed by doveadm. Indeed the client gets the proper string from the socket and to my surprise, it is properly unescaped. Then, in "client_dict_lookup" ("lib-dict/dict-client.c"), the call to "p_strdup" returns an empty string (null byte set at the target address). Before the call to the dict "->lookup" attribute (client_dict_lookup): RAX: 0x7ffff73a37c0 (push r14) RBX: 0x6831b8 ("priv/reply_body") RCX: 0x7fffffffe240 --> 0x682a60 --> 0x6831b8 ("priv/reply_body") RDX: 0x6831b8 ("priv/reply_body") RSI: 0x683288 --> 0x7ffff7653120 --> 0x7ffff73ea620 ([...]) RDI: 0x690ad0 --> 0x7ffff7400713 --> 0x75250079786f7270 ('proxy') 0x7ffff73a1f10 <dict_lookup+32>: mov rcx,r11 (value_r) 0x7ffff73a1f13 <dict_lookup+35>: mov rdx,r8 (key) 0x7ffff73a1f16 <dict_lookup+38>: mov rsi,r10 (pool) 0x7ffff73a1f19 <dict_lookup+41>: mov rdi,r9 (dict) 0x7ffff73a1f1c <dict_lookup+44>: add rsp,0x8 => 0x7ffff73a1f20 <dict_lookup+48>: jmp rax Before the call to p_strdup in "client_dict_lookup": RSI: 0x6832d8 ("test\r\ntest") (lookup.result.value) RDI: 0x683288 --> 0x7ffff7653120 --> [...] (pool) RAX: 0x0 (result) 0x7ffff73a384f: nop 0x7ffff73a3850: mov rsi,QWORD PTR [rsp+0x8] 0x7ffff73a3855: mov rdi,r14 => 0x7ffff73a3858: call 0x7ffff736d3c0 <p_strdup@plt> 0x7ffff73a385d: mov QWORD PTR [r13+0x0],rax 0x7ffff73a3861: mov rsi,QWORD PTR [rsp+0x18] 0x7ffff73a3866: xor rsi,QWORD PTR fs:0x28 0x7ffff73a386f: mov eax,ebx After the call: 0x7ffff73a3850: mov rsi,QWORD PTR [rsp+0x8] 0x7ffff73a3855: mov rdi,r14 0x7ffff73a3858: call 0x7ffff736d3c0 <p_strdup@plt> => 0x7ffff73a385d: mov QWORD PTR [r13+0x0],rax 0x7ffff73a3861: mov rsi,QWORD PTR [rsp+0x18] 0x7ffff73a3866: xor rsi,QWORD PTR fs:0x28 0x7ffff73a386f: mov eax,ebx 0x7ffff73a3871: jne 0x7ffff73a38da RSI: 0x0 RDI: 0x6832d8 --> 0x0 RAX: 0x6832d8 --> 0x0 (result) It is worth noting that I can reproduce the exact same execution flow with a non-multiline result string (lookup.result.value) that is properly copied by "p_strdup" and returned in RAX, then displayed by doveadm. I am not familiar with the pooling mechanism hidden behind the call to p_strdump and not quite sure why this behaviour is emerging. Maybe I am even miles away from an understanding of the issue here, but it sounds to me like something is wrong in the way "p_strdup" performs the copy. Hope this helps, kaiyou.

2 11

Re: First steps in Dovecot; IMAP not working
by Joseph Tam 18 Oct '16

18 Oct '16

Marnaud <anic297(a)mac.com> writes: > "mailtest", the new user, is in group mail(8). In addition, I've added > write permission for "others" to /var/mail. Now, I'm trying to send a > message to "mailtest" from another, working, e-mail account and nothing > happens. This time, "doveadm log errors" is empty. > > In short, I don't get any error but no mail either. Two things to check: # What does dovecot think user "mailtest" has? doveadm user mailtest # The sticky bit should be set on /var/mail (you didn't mention # setting it. It probably doesn't have bearing on this problem, # but it will make it a little more secure. chmod 1777 /var/mail > Since "doveadm log errors" returns an empty result, where should I look > for the problem? I usually don't use this command, I look at the log file which seems to have more details. Try looking there for more diagnostics. Also, look at your MTA's logs as well. Joseph Tam <jtam.home(a)gmail.com>

4 4

Warning: Sent SIGKILL to 100 imap-login processes
by Ximo Mira 18 Oct '16

18 Oct '16

Hi, Last night we tried a traffic bypass in an existing mail environment before migration to new Dovecot backend platfom using Dovecot proxy. We are using an LDAP value for checking the proxy host of the user. POP traffic was running flawlessly, but IMAP connections started to drop when few clients connected: Oct 17 22 :26:51 master: Warning: Sent SIGKILL to 100 imap-login processes There are hundreds of these lines, always between 99 and 100 processes. Looks like some kind of limit, but not sure if its related to the Dovecot proxy machines (pool of 3 in total) or the final destination (the same IMAP server for +10000 users). Concurrect IMAP connections may rise to around 2000. Thanks.

2 1

dovecot 2.2.25 BUG: local_name is not matching correctly
by Arkadiusz Miśkiewicz 18 Oct '16

18 Oct '16

Bug report: When using dovecot 2.2.25 SNI capability it doesn't always match proper vhost config. For example if we have such config: local_name imap.example.com { ssl_cert = </etc/certs/cert.imap.example.com.pem ssl_key = </etc/certs/cert.imap.example.com.pem } but imap client sends mixedcase SNI hostname like "IMAP.example.com" then dovecot won't match above local_name imap.example.coml config section. IMO dovecot should do case insensitive comparison. Case sensitive matching for DNS names makes little sense. -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

2 2

Massive LMTP Problems with dovecot
by Ralf Hildebrandt 17 Oct '16

17 Oct '16

Currently I'm having massive problems with LMTP delivery into dovcot. dovecot/lmtp processes are piling up, eas using considerable amounts of CPU: # ps auxwww|fgrep dove root 20537 0.0 0.0 18124 1196 ? Ss 15:18 0:00 /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf dovecot 20541 0.0 0.0 9620 1084 ? S 15:18 0:00 dovecot/anvil root 20542 0.0 0.0 9752 1264 ? S 15:18 0:00 dovecot/log root 20544 0.0 0.0 21168 2276 ? S 15:18 0:00 dovecot/config copymail 20580 72.8 0.0 39556 7036 ? R 15:18 2:00 dovecot/lmtp dovecot 20582 0.0 0.0 18568 1756 ? S 15:18 0:00 dovecot/auth copymail 20597 77.2 0.0 35688 5136 ? R 15:18 2:06 dovecot/lmtp copymail 20598 39.3 0.0 38060 5596 ? R 15:18 1:04 dovecot/lmtp copymail 20613 62.3 0.0 38036 5600 ? R 15:18 1:41 dovecot/lmtp copymail 20619 56.4 0.0 37732 7448 ? R 15:18 1:31 dovecot/lmtp copymail 20620 75.9 0.0 35872 5336 ? R 15:18 2:03 dovecot/lmtp copymail 20627 37.8 0.0 36480 5892 ? R 15:18 1:01 dovecot/lmtp copymail 20838 60.5 0.0 35640 5036 ? R 15:19 0:59 dovecot/lmtp copymail 20840 66.3 0.0 35920 5296 ? R 15:19 1:04 dovecot/lmtp copymail 20841 66.0 0.0 37456 6852 ? R 15:19 1:04 dovecot/lmtp copymail 20842 64.5 0.0 36424 5808 ? R 15:19 1:02 dovecot/lmtp copymail 20843 67.6 0.0 39612 7064 ? R 15:19 1:05 dovecot/lmtp doveadm stop won't stop these, I have to use kill -9 on them. I already tried disabling fts (entirely), still things won't speed up. I can't strace: # strace -p 20841 Process 20841 attached (and that's it) # dpkg -l|grep dovecot ii dovecot-core 2:2.2.25-1~auto+57 amd64 secure POP3/IMAP server - core files ii dovecot-imapd 2:2.2.25-1~auto+57 amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-lmtpd 2:2.2.25-1~auto+57 amd64 secure POP3/IMAP server - LMTP server ii dovecot-lucene 2:2.2.25-1~auto+57 amd64 secure POP3/IMAP server - Lucene support ii dovecot-sieve 2:2.2.25-1~auto+57 amd64 secure POP3/IMAP server - Sieve filters support I also tried deleting the mdboxes, that also didn't change anything. Ideas? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 1

Re: First steps in Dovecot; IMAP not working
by Marnaud 17 Oct '16

17 Oct '16

Sorry, my previous message got mangled. I'm re-writing it, quoting manually. I apologize for the traffic. >(Sorry I read this list in digest form so frequently I'm half a step behind.) No problem. >No, it's quite explicit. User "webuser" has uid/gid = 1001(webuser)/1000(ftpusers). Your mail spool has permission uid/gid = root(0)/mail(8), neither of which allows webuser to write to this mail spool to creates its own mail folder. You're right (I don't have enough Unix habits, it seems...). I couldn't change this user (it must be in the ftpusers group for other purposes), so I tried adding another user for testing mail. "mailtest", the new user, is in group mail(8). In addition, I've added write permission for "others" to /var/mail. Now, I'm trying to send a message to "mailtest" from another, working, e-mail account and nothing happens. This time, "doveadm log errors" is empty. In short, I don't get any error but no mail either. >Aki Tuomi <aki.tuomi(a)dovecot.fi> replies with several solutions: >>In your configuration, dovecot uses whatever user/group returned by PAM. Since the webuser has never logged in, it has no directory under /var/mail. If you want, you can >>a) override mail_uid and mail_gid in userdb/passdb >>b) pre-create /var/mail/webuser and chown it to webuser:ftpusers >>c) you can let ftpusers write to /var/mail. Ok, I thought I had to do all of them (and didn't understand step a)). So I've done step c) by allowing everyone write access. >Or if you dynamically/frequently onboard mail accounts, and users cannot arbitrarily write into this directory, you can "chmod 1777 /var/mail/" and let dovecot auto-create it (might also want to set "lda_mailbox_autocreate = yes". I've done it right now; same problem. Since "doveadm log errors" returns an empty result, where should I look for the problem? Thank you.

1 0

Re: First steps in Dovecot; IMAP not working
by Joseph Tam 17 Oct '16

17 Oct '16

(Sorry I read this list in digest form so frequently I'm half a step behind.) > For sake of ?security?, I chose to not allow plaintext communication > (being new to this, I think being strict is a good choice). I?ve tried > with the openssl option and it successfully logged in. Yes, you've included some more log entries, which makes the problem clearer, as it usually does. > Oct 13 05:56:28 imap(webuser): Error: open(/var/mail/webuser) failed: > Permission denied (euid=1001(webuser) egid=1000(ftpusers) missing +w perm: > /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0775) > ... > I checked, using ls -l /var, and I get this: > drwxrwsr-x 2 root mail 4096 Apr 27 11:27 mail > so the group looks to be correctly set to 'mail', despite what the log says, > right? No, it's quite explicit. User "webuser" has uid/gid = 1001(webuser)/1000(ftpusers). Your mail spool has permission uid/gid = root(0)/mail(8), neither of which allows webuser to write to this mail spool to creates its own mail folder. Aki Tuomi <aki.tuomi(a)dovecot.fi> replies with several solutions: > In your configuration, dovecot uses whatever user/group returned by > PAM. Since the webuser has never logged in, it has no directory under > /var/mail. If you want, you can > > a) override mail_uid and mail_gid in userdb/passdb > b) pre-create /var/mail/webuser and chown it to webuser:ftpusers > c) you can let ftpusers write to /var/mail. Or if you dynamically/frequently onboard mail accounts, and users cannot arbitrarily write into this directory, you can "chmod 1777 /var/mail/" and let dovecot auto-create it (might also want to set "lda_mailbox_autocreate = yes". Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: First steps in Dovecot; IMAP not working
by Aki Tuomi 17 Oct '16

17 Oct '16

On 13.10.2016 12:42, Marnaud wrote: > > "Aki Tuomi" <aki.tuomi(a)dovecot.fi> wrote: > >> doveconf -n shows what's there. if you have ssl=no somewhere else in the >> config after you set it to required, it gets overwritten. >> >> Aki > > Thanks, Aki. > It means I have to open each conf file (e.g. using nano) and search > for ssl=no; I'm right or there's a specific file to check? I see you replied to me only, please keep your replies on-list. Try grep -r ssl.*no /etc/dovecot Aki

4 13

Latest HG Changes (fac92b5) affect Sieve-Plugin/LMTP
by Thomas Leuxner 15 Oct '16

15 Oct '16

# 2.2.devel (c73322f): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (fac92b5) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.6 ==> /var/log/dovecot/dovecot.log <== Oct 15 09:50:15 nihlus dovecot: lmtp(11447): Connect from local Oct 15 09:50:15 nihlus dovecot: lmtp(tlx(a)leuxner.net): Panic: file lda-sieve-plugin.c: line 447 (lda_sieve_execute_scripts): assertion failed: (script != NULL) Oct 15 09:50:15 nihlus dovecot: lmtp(tlx(a)leuxner.net): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x938ae) [0x7fd161fc18ae] -> /usr/lib/dovecot/libdovecot.so.0(+0x9399c) [0x7fd161fc199c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fd161f5b6de] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3af8) [0x7fd15fdf8af8] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x49) [0x7fd16258bb39] -> dovecot/lmtp [DATA tlx(a)leuxner.net](+0x724e) [0x7fd1629bc24e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fd161fd5e4c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7fd161fd730a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fd161fd5ed5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fd161fd6078] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fd161f61be3] -> dovecot/lmtp [DATA tlx(a)leuxner.net](main+0x1a2) [0x7fd1629ba382] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fd161ba4b45] -> dovecot/lmtp [DATA tlx(a)leuxner.net](+0x5430) [0x7fd1629ba430] Oct 15 09:50:15 nihlus dovecot: lmtp(tlx(a)leuxner.net): Fatal: master: service(lmtp): child 11447 killed with signal 6 (core not dumped)

3 9

Re: First steps in Dovecot; IMAP not working
by Joseph Tam 14 Oct '16

14 Oct '16

Moi <anic297(a)mac.com> wrote: > I've made some more tests and I still can't receive mails; sending them > still works. I don't receive any error message, just the mails that are > supposed to be received won't come. > In the mail logs, I find only this relevant line: > dovecot: imap-login: Aborted login (no auth attempts in 2 secs): user=<> Did you post doveconf -n (I didn't catch the head of this thread)? That would be step 0. A good first step is to test whether you have basic authentication working (to separate out if you have a server or client issue). I assume you allow plaintext communication, but if not, substitute telnet with "openssl sclient -connect your-server:993": C: # telnet your-server 143 S: * OK [CAPABILITY ... C: x1 login testuser theirpassword If you get an OK response to this, it may be a client issue (check settings on client). If you get an error or failure, look inward: check logs and config. Joseph Tam <jtam.home(a)gmail.com>

2 1

Maildir Expunged GUID mismatch for UID
by Steven Xu 14 Oct '16

14 Oct '16

Dovecot version:2.2.25 Since we used to keep our email files on widows server, I made the following changes in maildir-storage.h #define MAILDIR_EXTRA_SEP ',' #define MAILDIR_INFO_SEP_S ":" to "+". Everything seems working except EXPUNG, The dovecot log is flooded by messages like following: imap(xxxxx): Error: Mailbox INBOX: Expunged GUID mismatch for UID 7039 Then I read the source code, and found the following lines in maildir-sync-index.c T_BEGIN { guid = maildir_uidlist_lookup_ext(ctx->mbox->uidlist, uid, MAILDIR_UIDLIST_REC_EXT_GUID); if (guid == NULL) guid = t_strcut(filename, ':'); mail_generate_guid_128_hash(guid, guid_128); } T_END; I have to change the code to guid = t_strcut(filename, '+'); So, should MAILDIR_EXTRA_SEP be used here instead of ':'? Thanks, Steven

2 1

update dovecot-acl in all subfolders in a public folder
by Lukas Henrich 14 Oct '16

14 Oct '16

Hello everyone, right now I have problem and can't find a proper solution. But first: dovecot-version: 2.2.13 Now to my problem: A client of mine uses a public folder called "groups". In this Folder are several subfolders like "Archive", "projects", "sales" und so on. Unfortunately this client (and his employees) created thousands of subfolders within these folders. The folder "groups" is stored in /data/vmail/domain.com/. So, if i type "tree -a -L 1 /data/vmail/domain.com/groups" I get the following outpout: /data/vmail/domain.com/groups/ ??? .Archive ??? .Archive.subfolder1 ??? .Archive.subfolder2 ??? .Archive.subfolder2.subfolder3 ??? .Archive.subfolder2.subfolder4 (....) ??? .projects ??? .projects.subfolder1 ??? .projects.subfolder2 ??? .projects.subfolder2.subfolder3 ??? .projects.subfolder2.subfolder4 (...) In this groups-folder are at the moment more than 3400 folders! Now to the permissions: When the folders "Archive", "projects" and so on had been created every folder got a dovecot-acl for the permission for each user, e.g.: user=user1 kxeilprwts user=user2 kxeilprwts This worked finde, as the dovecot-acl got copied from the parent folder when the employees created new subfolders. Now to my problem I'm facing right now: This client got 2 new employees. So how can I edit all these dovecot-acl files in all subfolders where these 2 new employess schould get access to? Thank you in advance! Yours sincerely, Lukas Henrich Furthermore here is the output of dovecot -n: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 4.4.6-1-pve x86_64 Debian 8.4 auth_username_format = %Ln disable_plaintext_auth = no lda_mailbox_autocreate = yes mail_home = /data/vmail/domain.com/%Ln mail_location = maildir:~ mail_plugins = " acl" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:/data/vmail/domain.com/%%n:INDEXPVT=/data/vmail/domain.com/%n/share… prefix = shared/%%n/ separator = / subscriptions = yes type = shared } namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/data/vmail/domain.com/groups:INDEXPVT=/data/vmail/domain.com/%n/gr… prefix = groups/ separator = / subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Archiv { special_use = \Archive } mailbox Archive { auto = subscribe special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Entwürfe { special_use = \Drafts } mailbox "Gelöschte Elemente" { special_use = \Trash } mailbox "Gelöschte Objekte" { special_use = \Trash } mailbox Gesendet { special_use = \Sent } mailbox "Gesendete Elemente" { special_use = \Sent } mailbox "Gesendete Objekte" { special_use = \Sent } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Papierkorb { special_use = \Trash } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / subscriptions = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = scheme=CRYPT username_format=%Ln /etc/dovecot/users driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db sieve = ~/dovecot.sieve sieve_dir = ~/sieve } postmaster_address = admin(a)domain.com protocols = " imap lmtp sieve sieve" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/certs/kmux-dovecot.intern.domain.com.crt ssl_key = </etc/ssl/private/kmux-dovecot.intern.domain.com.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=vmail gid=vmail home=/data/vmail/domain.com/%n driver = ldap } userdb { args = username_format=%Ln /etc/dovecot/users driver = passwd-file } protocol lmtp { mail_plugins = " acl sieve" } protocol lda { mail_plugins = " acl sieve" } protocol imap { mail_plugins = " acl imap_acl" }

1 0

fix SIS attachment errors
by Webert de Souza Lima 13 Oct '16

13 Oct '16

Hi, I've sent some e-mails about this before but since there was no answers I'll write it differently, with different information. I'm using SIS (Single Instance Attachment Storage). For any reason that is not relevant now, many attachments are missing and the messages can't be fetched: Error: read(attachments-connector(zlib(/dovecot/mdbox/bar.example/foo/storage/m.1))) failed: read(/dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36[base64:19 b/l]) failed: open(/dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36) failed: No such file or directory in this specific case, the /dovecot/attach/bar.example/23/ae/ director doesn't exist. In other cases, just one file is missing so I would assume the hardlink could be recreated and it would work. If I create the missing file (with touch or whatever), I get the following errors: Error: read(/dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36[base64:19 b/l]) failed: Stream is smaller than expected (0 < 483065) Error: read(attachments-connector(zlib(/dovecot/mdbox/bar.example/foo/storage/m.1))) failed: read(/dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36[base64:19 b/l]) failed: Stream is smaller than expected (0 < 483065) Error: fetch(body) failed for box=INBOX uid=15: BUG: Unknown internal error If I try to fill the file with the amount of bytes it complains about with the following command: $ dd if=/dev/zero of=/dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36 bs=1 count=483065 then I get the following error: Error: read(/dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36[base64:19 b/l]) failed: Stream is larger than expected (483928 > 483065, eof=0) Error: read(attachments-connector(zlib(/srv/dovecot/mdbox/bar.example/foo/storage/m.1))) failed: read(//dovecot/attach/bar.example/23/ae/23aed008c1f32f048afd38d9aae68c5aeae2d17a9170e28c60c75a02ec199ef4e7079cd92988ad857bd6e12cd24cdd7619bd29f26edeec842a6911bb14a86944-fb0b6a214dfa63573c1f00009331bd36[base64:19 b/l]) failed: Stream is larger than expected (483928 > 483065, eof=0) Error: fetch(body) failed for box=INBOX uid=15: BUG: Unknown internal error Based on this I have a few questions: 1. Is there a way, or a tool to scan all mailboxes to get all the messages that have compromised attachments? 2. is there a way to "fix" the missing files (even if creating fake files or removing the attachments information from the messages) 3. What I need is to migrate these boxes using doveadm backup/sync, which fails when these errors occur. Is is possible to ignore them or is there another tool that would do it? Thank you. Webert Lima Belo Horizonte, Brasil

1 1

First steps in Dovecot; IMAP not working
by Marnaud 13 Oct '16

13 Oct '16

Hello, I'm new in Dovecot and am having troubles making it working. I'm trying using Outlook and Apple's Mail as the mail clients. Outlook says it can't establish a secured connection to the server (for the IMAP protocol). I'm guessing sending e-mails works but I can't check. This is my current configuration (using dovecot -n): # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab116.1 x86_64 Debian 8.6 mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = pam } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl = no ssl_cert = </etc/ssl/certs/mail.crt ssl_key = </etc/ssl/private/mail.key userdb { driver = passwd } userdb { driver = passwd } I find abnormal I'm seeing "ssl = no" in this configuration despite the fact that I have "ssl = required" in the /etc/dovecot/conf.d/10-ssl.conf file, but I'm new to this... I have looked around the web; finally, I'm asking here, hoping it's the correct place to ask. Arnaud

2 1

SSL error
by arnaud gaboury 13 Oct '16

13 Oct '16

I run dovecot + postfix as my email server. Everything is working as expected, but I see an error in the dovecot logs: lmtp(7331): Error: SSL context initialization failed, disabling SSL: ENGINE_init(dynamic) failed Dovecot is running and emails are OK. I wonder why this error and how I can fix it? I see it is a SSL issue but no idea in which direction to look. Thank you for help

2 4

Strange subscriptions added by dsync backup
by Rik Theys 13 Oct '16

13 Oct '16

Hi, We're in the process of migrating our dovecot 1.x mail server to a Dovecot 2.2.25 server. During the migration I'm moving from mbox storage to mdbox. I use the following method to do a one-way sync from our current mail server to our new mail server (command executed on the new server): doveadm -v -o imapc_host=oldserver \ -o imapc_user=$u \ -o imapc_master_user=$masteruser \ -o imapc_password="$masterpass" \ -o imapc_port=993 -o imapc_ssl=imaps \ -o ssl_client_ca_file=/etc/pki/tls/certs/ca-bundle.crt \ -o imapc_ssl_verify=yes \ -o mail_fsync=never \ -o mail_prefetch_count=20 \ backup -R -u $u imapc: $u is replaced by the username I'm migrating. The dsync command runs and exits with code 0 (all OK). However, when I look at the subscriptions file on the new server, there seem to be additional subscriptions that are not in the subscriptions file on the old server: 7b0d681945d0fc5711560000ffff90ca 7c0d681945d0fc5711560000ffff90ca 7d0d681945d0fc5711560000ffff90ca 7e0d681945d0fc5711560000ffff90ca 7f0d681945d0fc5711560000ffff90ca 800d681945d0fc5711560000ffff90ca Where do these come from? Is something wrong with the migration? It also seems that subscriptions for IMAP folders that only contain subfolders[1] are no longer present in the new subscriptions file: # diff -u sub-old.sorted sub-new.sorted --- sub-old.sorted 2016-10-11 13:42:44.175070610 +0200 +++ sub-new.sorted 2016-10-11 13:47:53.973888462 +0200 @@ -1,26 +1,26 @@ -Archive/Administration/ +7b0d681945d0fc5711560000ffff90ca +7c0d681945d0fc5711560000ffff90ca +7d0d681945d0fc5711560000ffff90ca +7e0d681945d0fc5711560000ffff90ca +7f0d681945d0fc5711560000ffff90ca +800d681945d0fc5711560000ffff90ca Archive/Administration/Conferences Archive/Announcements -Archive/Education/ Archive/Education/E02N3A Archive/Education/I0D51A Archive/Politics -Archive/Research/ -Archive/Research/FET/ Archive/Research/FET/VPH - Virtual Physiological Human Archive/Research/Grants/ICON IBBT Call 2011 Archive/Research/Grants/Marie Curie ITN 2011 Archive/Research/Grants/Odysseus Archive/Research/Grants/SymBioSysII/Funding Archive/Research/Grants/SymBioSysII/JobApplications -Archive/Research/Manuscripts/ Archive/Research/Manuscripts/ruby-ensembl-api Archive/Research/Projects/GUNZ Archive/Research/Projects/MIQAS Archive/Research/Projects/MODY Archive/Research/Projects/ruby-ensembl-api Archives -Archive/Service/ Archive/Service/EditorORC Archive/Service/Reviewing Deleted Messages Is this expected behaviour? Regards, Rik [1] On the old server a folder can only contain either messages or subfolders, not both at the same time. -- Rik Theys System Engineer KU Leuven - Dept. Elektrotechniek (ESAT) Kasteelpark Arenberg 10 bus 2440 - B-3001 Leuven-Heverlee +32(0)16/32.11.07 ---------------------------------------------------------------- <<Any errors in spelling, tact or fact are transmission errors>>

1 0

Auto-archiving
by ＠lbutlr 13 Oct '16

13 Oct '16

I’d like to know if there is a way to tell dovecot to 1) move messages older than # days to the Archive folder 2) rebuild the indexes 3) remove any folders that are left with no mail Preferably, I’d like this to be a action I an schedule via crontab or something to fire off for any users that want it. So, I do not want it to do this across all users and mailboxes.

3 5

Disappearing message when move to Inbox subfolder
by Simon 13 Oct '16

13 Oct '16

We are using dovecot 2.0.9 on Centos 6.5 and having the following issues for one single user/single mailbox. When an Outlook (2016) user creates a folder under their Inbox, it does not create in their mailbox (checking with webmail the folder is not there). If they drag a message to that folder in Outlook, then it disappears. Ive searched their mailbox using doveadm and its simply gone. Ive tested with webmail doing essentially the same thing and it works with no issues. Any ideas here would be most well received :) Thanks in advance, Simon

1 0

dsync replication quota2 issue
by George Kontostanos 12 Oct '16

12 Oct '16

Hello list, We are testing a configuration with 2 mail servers using dsync replication (dovecot 2.2.25 ). Everything works fine except the quota2 which is calculated wrong only on one server. Quota2 resides on different databases since each server needs to update it. The problem: The local server always updates quota2 twice on each message it receives. This happens only on one server. Updates run fine on the second. SQL Debug: Query UPDATE quota2 SET bytes=bytes+2108,messages=messages+1 WHERE username = 'user(a)domain.org' Query UPDATE quota2 SET bytes=bytes+2108,messages=messages+1 WHERE username = 'user(a)domain.org' The result on the server that runs fine mysql> select * from quota2; +----------------------------+---------+----------+ | username | bytes | messages | +----------------------------+---------+----------+ | | user(a)domain.org | 2917126 | 17 | The result on the server that has the problem: mysql> select * from quota2; +----------------------------+---------+----------+ | username | bytes | messages | +----------------------------+---------+----------+ | | user(a)domain.org | 2920317 | 19 | dovecot -n is the same on both: root@mx2:/var/log # dovecot -n # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: FreeBSD 10.3-RELEASE amd64 ufs auth_mechanisms = plain login auth_verbose = yes default_client_limit = 2560 default_process_limit = 512 dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-shares-sql.conf.ext quota = mysql:/usr/local/etc/dovecot/dovecot-dict-quota-sql.conf.ext } doveadm_password = # hidden, use -P to show it doveadm_port = 12345 log_path = /var/log/dovecot.log mail_debug = yes mail_home = /usr/local/vhosts/mail/%d/%n mail_location = maildir:/usr/local/vhosts/mail/%d/%n:LAYOUT=fs mail_max_userip_connections = 70 mail_plugins = quota acl notify replication mail_privileged_group = vmail mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace { inbox = no list = children location = maildir:/usr/local/vhosts/mail/%%d/%%n:LAYOUT=fs:INDEX=/usr/local/vhosts/indexes/%d/%n/shared/%%u:INDEXPVT=/usr/local/vhosts/indexes/%d/%n/shared/%%u prefix = shared/%%d/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl mail_replica = tcp:beta.sophimail.com:12345 quota = dict:User quota::proxy::quota quota_rule2 = Trash:storage=+100M sieve = /usr/local/vhosts/mail/%d/%n/.dovecot.sieve sieve_before = /usr/local/vhosts/sieve/before.d/ sieve_dir = /usr/local/vhosts/mail/%d/%n sieve_global_dir = /usr/local/vhosts/sieve/%d sieve_global_path = /usr/local/vhosts/sieve/%d/default.sieve } protocols = imap lmtp sieve sieve service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service config { unix_listener config { user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service doveadm { inet_listener { port = 12345 } user = vmail } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service replicator { unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </usr/local/etc/postfix/keys/domain.com.crt ssl_key = </usr/local/etc/postfix/keys/domain.com.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl notify replication sieve notify replication } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = quota acl notify replication imap_quota imap_acl notify replication } protocol lda { mail_plugins = quota acl notify replication sieve acl postmaster_address = root } local 192.168.3.6 { protocol imap { ssl_cert = </usr/local/etc/postfix/keys/domain.com.crt ssl_key = </usr/local/etc/postfix/keys/domain.com.key } } dovecot-dict-quota-sql.conf.ext: connect = host=127.0.0.1 dbname=quota user=mailadmin password=********** map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } Sorry for the lengthy email, any help is very much appreciated. -- George Kontostanos ---

1 1

Detect IMAP server domain name in Dovecot IMAP proxy
by KT Walrus 12 Oct '16

12 Oct '16

I’m in the process of setting up a Dovecot IMAP proxy to handle a number of IMAP server domains. At the current time, I have my users divided into 70 different groups of users (call them G1 to G70). I want each group to configure their email client to access their mailboxes at a domain name based on the group they belong to (e.g., g1.example.com <http://g1.example.com/>, g2.example.com <http://g2.example.com/>, …, g70.example.com <http://g70.example.com/>). I will only support TLS encrypted IMAP connections to the Dovecot IMAP proxy (‘ssl=yes’ in the inet_listener). My SSL cert has alternate names for all 70 group domain names. I want the group domain to only support users that have been assigned to the group the domain name represents. That is, a user assigned to G23 would only be allowed to configure their email client for the IMAP server named g23.example.com <http://g23.example.com/>. My solution during testing has been to have the Dovecot IMAP proxy to listen on different ports: 9930-9999. I plan to purchase 70 IPs, one for each group, and redirect traffic on port 993 to the appropriate Dovecot IMAP proxy port based on the IP I assign to the group domain name in the site’s DNS. The SQL for handling the IMAP login uses the port number of the inet_listener I think this could work in production, but it will cost me extra to rent the 70 IPs and might be a pain to manage. Eventually, I would like to have over 5,000 groups so requiring an IP per group is less than ideal. I also think having Dovecot IMAP proxy have 5,000 inet_listeners might not work so well or might create too many threads/processes/ports to fit on a small proxy server. I would rather have 1 public IP for each Dovecot IMAP proxy and somehow communicate to the userdb which group domain name was configured in the email client so only the users assigned to this group can login with that username. Anyone have any ideas? For HTTP traffic, it is easy to query the host in the HTTP Request, but I don’t think IMAP traffic has such host info in it. Does the Dovecot IMAP proxy receive the hostname from the email client when exchanging SSL certs (like SNI for HTTPS)? Or, maybe I should have group domain in the username used to log in with (e.g., username+g23(a)example.com <mailto:username+g23@example.com> or username(a)g23.example.com <mailto:username@g23.example.com>). I don’t like to make the user configure their email client to log in with a name that is different than their mailbox address. It is simpler to just have them configure their email client with username(a)example.com <mailto:username@example.com> for both authorization and for the from/sender headers in the messages. Anyway, any ideas of how to set this up in production?

3 3

Outlook 2010 woes
by Bryan Holloway 12 Oct '16

12 Oct '16

Hello, everyone. We have recently begun migrating folks from an older server to a newer one, and things have been going quite well except for -- you guessed it -- Outlook 2010 users. Specifically it appears to be one customer in particular, and this particular customer has many nested mailboxes and lots of e-mail in general. Not sure if this is a factor. Old server: * Ubuntu 10.04.4 LTS * Dovecot 2.1.13 * Maildir++ * Local auth via passwd/shadow files New server: * Debian GNU/Linux 8.6 * Dovecot 2.2.13 * Maildir++ * Quotas enabled * LDAP Basically what's happening is that users are seeing large delays when navigating between different IMAP folders. So, for example, user "X" is sitting idle in their INBOX. If they then click on another folder there's a good 6-7 second delay before you can view its contents. If you immediately then navigate to other folders, you get a rapid response. But if the client then goes idle again for 10+ seconds, you will get this delay again. Some are reporting the OS saying "Outlook is not responding." (Everyone is running Windows 7.) Disclaimer: Yes, I know Outlook 2010 is a giant steaming pile of ____. However, everything worked dandy with Dovecot 2.1 and of course my customer is harping on this fact. Things I have tried/read about in the Dovecot list: * Check headers only -- doesn't seem to help. * Had a user completely remove their IMAP profile and re-add: no change. * Had a user set up an entirely new account on a new computer: same symptoms. * Someone mentioned to enable the "delay-newmail" workaround in 20-imap.conf, but this wasn't enabled in our 2.1 install, so that seems like it would not help our case. I was looking through the release notes of later Dovecots, and I noticed that in 2.2.14 there's mention of some issues with Outlook that were fixed, but it wasn't particularly specific about which versions. Should I be looking into that? And if so, is there a separate repository for newer dovecot? Currently the standard Debian 8.6 only has 2.2.13. Any help, suggestions, or pointers would be greatly appreciated. Thank you! - bryan

2 3

Problems with GSSAPI and LDAP
by Juha Koho 12 Oct '16

12 Oct '16

Hello, I have a Dovecot 2.2.25 set up with OpenLDAP back end. I was trying to set up a GSSAPI Kerberos authentication with the LDAP server but with little success. Seems no matter what I try I end up with the following error message: dovecot: auth: Error: LDAP: binding failed (dn (imap/host.example.com(a)EXAMPLE.COM)) Local error, SASL(-1): generic failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (No Kerberos credentials available (default cache: FILE:/tmp/dovecot.krb5.ccache)) I have set the import_environment in dovecot.conf: import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID LISTEN_FDS KRB5CCNAME=FILE:/tmp/dovecot.krb5.ccache And these in LDAP configuration: dn = imap/host.example.com(a)EXAMPLE.COM sasl_bind = yes sasl_mech = gssapi sasl_realm = EXAMPLE.COM sasl_authz_id = imap/host.example.com(a)EXAMPLE.COM I have tried with different values in dn and sasl_authz_id and also leaving them out completely but I always end up with the error message above. Using simple bind without GSSAPI works just fine. The credentials cache file exists and is valid for the principal imap/host.example.com(a)EXAMPLE.COM. The file is owned by dovecot user so it shouldn't be a permission problem either. GSSAPI in OpenLDAP works but I suppose it is irrelevant here since the connection attempt never reaches the LDAP server due to the error. I also have similar setup for Postfix and it works fine. Any ideas what to try next? Best regards, Juha

2 9

Managesieve port 4190 not working
by Marcio Vogel Merlone dos Santos 12 Oct '16

12 Oct '16

Hi all, I am working on a fresh install with Ubuntu 16.04 LTS and Dovecot 2.2.22-1ubuntu2.1. I am unable to open port 4190, just 2000. I have this on 20-managesieve.conf: protocols = $protocols sieve service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service managesieve { process_limit = 1024 } protocol sieve { mail_debug=yes } This way I get only port 2000, if comment out the "sieve_deprecated" section leaving just the "inet_listener sieve" I get nothing. Could not find anything useful on logs or strace. Any hint? Thanks in advance, best regards. -- *Marcio Merlone*

2 1

Quota & prefetch uiserDB questions
by Cédric ML 12 Oct '16

12 Oct '16

Hello, I'm trying to make quota work on my dovecot server. I'm using prefetch userdb (source : http://wiki2.dovecot.org/UserDatabase/Prefetch) with a database located on a remote host : passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver = prefetch } userdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } With password_query containing (source : http://wiki2.dovecot.org/Quota/Configuration) : password_query = SELECT \ username AS user, \ password, \ homedir AS userdb_home, \ maildir AS userdb_mail, \ uid AS userdb_uid, \ gid AS userdb_gid, \ CONCAT('*:bytes=', quota) AS userdb_quota_rule \ FROM mailbox \ WHERE username = '%u' When I change the quota value in DB, it's not reflected to maildirsize file of the user. If I delete maildirsize file, it's re-created but not with the quota value which is set in the DB. Questions : how is this maildirsize file created ? how is it updated ? is there a way to make maildir++ quota work with dovecot using prefetch userDB ? Or do I have to use dict quotas ? Many thanks for your help. Regards, Cédric

1 1

problem with quota warning script execution, error 75
by Ximo Mira 11 Oct '16

11 Oct '16

Hi, Im quite new to dovecot and im trying to run quota warning script with no success. Using "quota = count:User quota" and this script: ________________________ #!/bin/sh PERCENT=$1 USER=$2 cat << EOF | /usr/libexec/dovecot/dovecot-lda -d $USER -o "plugin/quota=count:User quota:noenforcing" From: support(a)company.com To: $USER Subject: Quota alert Quota usage is $PERCENT% Bye EOF ________________________ If I run the script manually from command line it works and message is delivered. If user reaches first configured limit (85%) Im getting this error. Oct 10 10:38:01 auth: Error: userdb(USER(a)DOMAIN.com): client doesn't have lookup permissions for this user: userdb reply doesn't contain uid (to bypass this check, set: service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 } }) Oct 10 10:38:01 lda(USER(a)DOMAIN.com): Error: user USER(a)DOMAIN.com: Auth USER lookup failed Oct 10 10:38:01 lda: Fatal: Internal error occurred. Refer to server log for more information. Oct 10 10:38:01 quota-warning: Fatal: master: service(quota-warning): child 24515 returned error 75 Auth is LDAP based.

2 6

latest 2.2.25 Hibernation patch raises 100% cpu usage
by Harald Leithner 07 Oct '16

07 Oct '16

Hi, I use the xi Debian packages, the current 2.2.25 auto 47 build seams to include the commit 351aa01c6e I think this commit cases a 100% cpu usage. After some time 1-5 minutes the hibernate process uses 100% and strace floods the screen with: epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164437) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164437) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164436) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164436) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164436) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164436) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164436) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164436) = 3 epoll_wait(9, {{EPOLLIN|EPOLLHUP, {u32=2609346112, u64=140044312999488}}, {EPOLLIN|EPOLLHUP, {u32=2609364288, u64=140044313017664}}, {EPOLLIN|EPOLLHUP, {u32=2609380304, u64=140044313033680}}}, 34, 164435) = 3 Maybe its a client thats incompatible, downgrading to version +46 solve the problem. bye Harald

2 1

quelques nouvelles infos
by bunkertor 07 Oct '16

07 Oct '16

Hey, Voici ce que je viens de lire et c’est quelque chose de vraiment nouveau et intéressant, vous pouvez en lire plus à <http://wetoxymo.betkers.net/xoikk> Grosses bises, bunkertor

1 0

[imap-login] SSL related crashes using the latest 2.2.25
by Adi Pircalabu 07 Oct '16

07 Oct '16

I'm running Dovecot as proxy in front of some IMAP/POP3 Dovecot & Courier-IMAP servers and in the last couple of days I've been seeing a lot of imap-login crashes (signal 11) on both 2.2.18 and 2.2.25, all SSL related. The following backtraces are taken running 2.2.25, built from source on a test system similar to the live proxy servers. OS: CentOS 6.8 64bit Packages: openssl-1.0.1e-48.el6_8.3.x86_64, dovecot-2.2.25-2.el6.x86_64 built from source RPM. Can post "doveconf -a" if required. Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 ssl_proxy_has_broken_client_cert (proxy=0x0) at ssl-proxy-openssl.c:677 677 { (gdb) bt full #0 ssl_proxy_has_broken_client_cert (proxy=0x0) at ssl-proxy-openssl.c:677 No locals. #1 0x00007fdec4e6b489 in login_proxy_ssl_handshaked (context=0x14b4170) at login-proxy.c:759 proxy = 0x14b4170 #2 0x00007fdec4e70e4b in ssl_handshake (proxy=0x169d7b0) at ssl-proxy-openssl.c:468 ret = <value optimized out> #3 ssl_step (proxy=0x169d7b0) at ssl-proxy-openssl.c:519 No locals. #4 0x00007fdec4beee0b in io_loop_call_io (io=0x13fdab0) at ioloop.c:564 ioloop = 0x12a07b0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #5 0x00007fdec4bf0407 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x12fb8d0 events = <value optimized out> event = 0x171fb20 list = 0x15f8c50 io = <value optimized out> tv = {tv_sec = 46, tv_usec = 134490} events_count = <value optimized out> msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #6 0x00007fdec4beeeb5 in io_loop_handler_run (ioloop=0x12a07b0) at ioloop.c:612 No locals. #7 0x00007fdec4bef058 in io_loop_run (ioloop=0x12a07b0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #8 0x00007fdec4b81b23 in master_service_run (service=0x12a0650, callback=<value optimized out>) at master-service.c:640 No locals. #9 0x00007fdec4e6e593 in login_binary_run (binary=<value optimized out>, argc=2, argv=0x12a0390) at main.c:486 set_pool = 0x12a0b80 login_socket = <value optimized out> c = <value optimized out> #10 0x00007fdec47dad1d in __libc_start_main (main=0x402ac0 <main>, argc=2, ubp_av=0x7ffc53ee5688, init=<value optimized out>, fini=<value optimized out>, rtld_fini=<value optimized out>, stack_end=0x7ffc53ee5678) at libc-start.c:226 result = <value optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 5496455093114277129, 4204960, 140721716614784, 0, 0, -5494405746439844599, -5477823887334535927}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x404f70, 0x7ffc53ee5688}, data = { prev = 0x0, cleanup = 0x0, canceltype = 4214640}}} not_first_call = <value optimized out> #11 0x00000000004029c9 in _start () No symbol table info available. Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 0x00007f1a58620dec in _IO_vfprintf_internal (s=<value optimized out>, format=<value optimized out>, ap=<value optimized out>) at vfprintf.c:1641 1641 process_string_arg (((struct printf_spec *) NULL)); (gdb) bt full #0 0x00007f1a58620dec in _IO_vfprintf_internal (s=<value optimized out>, format=<value optimized out>, ap=<value optimized out>) at vfprintf.c:1641 len = <value optimized out> string_malloced = <value optimized out> step0_jumps = {0, -1285, -1198, 3818, 3910, 3206, 3307, 4086, 1925, 2133, 2249, 3731, 4474, -4059, -1109, -1062, 868, 956, 968, 980, -1505, -495, 665, 755, 827, -3962, 395, 4392, -4059, 3997} space = 0 is_short = 0 use_outdigits = 0 step1_jumps = {0, 0, 0, 0, 0, 0, 0, 0, 0, 2133, 2249, 3731, 4474, -4059, -1109, -1062, 868, 956, 968, 980, -1505, -495, 665, 755, 827, -3962, 395, 4392, -4059, 0} group = 0 prec = -1 step2_jumps = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2249, 3731, 4474, -4059, -1109, -1062, 868, 956, 968, 980, -1505, -495, 665, 755, 827, -3962, 395, 4392, -4059, 0} string = <value optimized out> left = 0 is_long_double = 0 width = 0 step3a_jumps = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2336, 0, 0, 0, -1109, -1062, 868, 956, 968, 0, 0, 0, 0, 755, 0, 0, 0, 0, 0, 0} alt = 0 showsign = 0 is_long = 0 is_char = 0 pad = 32 ' ' step3b_jumps = {0 <repeats 11 times>, 4474, 0, 0, -1109, -1062, 868, 956, 968, 980, -1505, -495, 665, 755, 827, -3962, 395, 0, 0, 0} step4_jumps = {0 <repeats 14 times>, -1109, -1062, 868, 956, 968, 980, -1505, -495, 665, 755, 827, -3962, 395, 0, 0, 0} is_negative = <value optimized out> base = <value optimized out> the_arg = {pa_wchar = 0 L'\000', pa_int = 0, pa_long_int = 0, pa_long_long_int = 0, pa_u_int = 0, pa_u_long_int = 0, pa_u_long_long_int = 0, pa_double = 0, pa_long_double = 0, pa_string = 0x0, pa_wstring = 0x0, pa_pointer = 0x0, pa_user = 0x0} spec = 115 's' _buffer = {__routine = 0, __arg = 0xf583a1d84, __canceltype = 24, __prev = 0x0} _avail = <value optimized out> thousands_sep = 0x0 grouping = 0xffffffffffffffff <Address 0xffffffffffffffff out of bounds> done = 97 f = 0x7f1a58c90b0d "s" lead_str_end = 0x7f1a58c90b05 "%s:%u: %s" end_of_spec = <value optimized out> work_buffer = "\341v\361[\372\037\002\363\315\301y\017\302.\a\272\306B\267\001\377\244\276Uu\023\005\301\a\227\f\353\374\062V\002\000\000\000\000\320\006}S\375\177\000\000\340\062V\002\000\000\000\000\273\252\377W\032\177\000\000(\036f\002\000\000\000\000|\004}S\375\177\000\000\320\006}S\375\177\000\000a+\aX\032\177\000\000(\036f\002\000\000\000\000 \036f\002\000\000\000\000\360\003}S\375\177\000\000\301\025\000X\000\000\000\000\210\033f\002\000\000\000\000(\036f\002\024\000\000\000\t`\v\217~0\"\"\\\200'\217X_\331q\325o\244\210\000\000\000\000\340\062V\002\000\000\000\000\n\000\000\000\000\000\000\000Wo\020X\000\000\000\000\b\024V\002\000\000\000\000\226$\377W\032\177\000\000\001\000\000\000\000\000\000\000\211\001\000\000\000\000\000\000\260\006}S\375\177\000\000\240\257\235\003\000\000\000\000\260\006}S\375\177\000\000\200"... workstart = 0x0 workend = 0x7ffd537d0748 "" ap_save = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffd537d0b60, reg_save_area = 0x7ffd537d0aa0}} nspecs_done = 2 save_errno = 0 readonly_format = 0 args_malloced = 0x0 specs = 0xa00000001 specs_malloced = false jump_table = "\001\000\000\004\000\016\000\006\000\000\a\002\000\003\t\000\005\b\b\b\b\b\b\b\b\b\000\000\000\000\000\000\000\032\000\031\000\023\023\023\000\035\000\000\f\000\000\000\000\000\000\025\000\000\000\000\022\000\r\000\000\000\000\000\000\032\000\024\017\023\023\023\n\017\034\000\v\030\027\021\026\f\000\025\033\020\000\000\022\000\r" #1 0x00007f1a586d8c50 in ___vsnprintf_chk ( s=0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root", maxlen=<value optimized out>, flags=1, slen=<value optimized out>, format=0x7f1a58c90ad8 "proxy: Received invalid SSL certificate from %s:%u: %s", args=0x7ffd537d0a80) at vsnprintf_chk.c:65 sf = {f = {_sbf = {_f = {_flags = -72515583, _IO_read_ptr = 0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root", _IO_read_end = 0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root", _IO_read_base = 0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root", _IO_write_base = 0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root", _IO_write_ptr = 0x1fe0e99 "k/CN=AddTrust External CA Root", _IO_write_end = 0x1fe0f6d "oodvale.vic.au): disconnecting 127.0.0.1 (Disconnected by client: EOF(0s idle, in=217, out=796))", _IO_buf_base = 0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root", _IO_buf_end = 0x1fe0f6d "oodvale.vic.au): disconnecting 127.0.0.1 (Disconnected by client: EOF(0s idle, in=217, out=796))", _IO_save_base = 0x0, _IO_backup_base = 0x0, _IO_save_end = 0x0, _markers = 0x0, _chain = 0x0, _fileno = 1489493956, _flags2 = 4, _old_offset = 139751135368008, _cur_column = 0, _vtable_offset = -57 '\307', _shortbuf = "X", _lock = 0x0, _offset = 4294967673, _codecvt = 0x381f620, _wide_data = 0x7ffd537d09c0, _freeres_list = 0x0, _freeres_buf = 0x7ffd537d0ab0, _freeres_size = 140726004157144, _mode = -1, _unused2 = "\032\177\000\000\000\000\000\000\000\000\000\000\315\320e\207\000\000\000"}, vtable = 0x7f1a58966440}, _s = { _allocate_buffer = 0, _free_buffer = 0}}, overflow_buf = "\001", '\000' <repeats 15 times>, "\001\000\000\000\000\000\000\000\350V\vY\032\177\000\000\200\302g\256\333\333;\221\330\n\311X\032\177\000\000\034\n}S\375\177\000\000\002\000\000\000\000\000\000"} ret = <value optimized out> #2 0x00007f1a58a220ff in vsnprintf (format=0x7f1a58c90ad8 "proxy: Received invalid SSL certificate from %s:%u: %s", args=0x7ffd537d0a80, size_r=0x7ffd537d0a5c) at /usr/include/bits/stdio2.h:78 No locals. #3 t_noalloc_strdup_vprintf (format=0x7f1a58c90ad8 "proxy: Received invalid SSL certificate from %s:%u: %s", args=0x7ffd537d0a80, size_r=0x7ffd537d0a5c) at strfuncs.c:132 args2 = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffd537d0b60, reg_save_area = 0x7ffd537d0aa0}} tmp = 0x1fe0e38 "proxy: Received invalid SSL certificate from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315:6: k/CN=AddTrust External CA Root" init_size = 310 ret = <value optimized out> __FUNCTION__ = "t_noalloc_strdup_vprintf" #4 0x00007f1a58a221d9 in p_strdup_vprintf (pool=0x7f1a58c76830, format=<value optimized out>, args=<value optimized out>) at strfuncs.c:156 tmp = <value optimized out> buf = <value optimized out> size = <value optimized out> #5 0x00007f1a58a222ea in t_strdup_printf (format=<value optimized out>) at strfuncs.c:263 args = {{gp_offset = 32, fp_offset = 48, overflow_arg_area = 0x7ffd537d0b60, reg_save_area = 0x7ffd537d0aa0}} ret = 0x0 #6 0x00007f1a58c88548 in login_proxy_ssl_handshaked (context=0x3141260) at login-proxy.c:760 proxy = 0x3141260 #7 0x00007f1a58c8de4b in ssl_handshake (proxy=0x3498970) at ssl-proxy-openssl.c:468 ret = <value optimized out> #8 ssl_step (proxy=0x3498970) at ssl-proxy-openssl.c:519 No locals. #9 0x00007f1a58a0be0b in io_loop_call_io (io=0x322e900) at ioloop.c:564 ioloop = 0x1f817b0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #10 0x00007f1a58a0d407 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x1fdc8d0 events = <value optimized out> event = 0x34a22e8 list = 0x317b250 io = <value optimized out> tv = {tv_sec = 0, tv_usec = 614018} events_count = <value optimized out> msecs = <value optimized out> ret = 3 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #11 0x00007f1a58a0beb5 in io_loop_handler_run (ioloop=0x1f817b0) at ioloop.c:612 No locals. #12 0x00007f1a58a0c058 in io_loop_run (ioloop=0x1f817b0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #13 0x00007f1a5899eb23 in master_service_run (service=0x1f81650, callback=<value optimized out>) at master-service.c:640 No locals. #14 0x00007f1a58c8b593 in login_binary_run (binary=<value optimized out>, argc=2, argv=0x1f81390) at main.c:486 set_pool = 0x1f81b80 login_socket = <value optimized out> c = <value optimized out> #15 0x00007f1a585f7d1d in __libc_start_main (main=0x402ac0 <main>, argc=2, ubp_av=0x7ffd537d0de8, init=<value optimized out>, fini=<value optimized out>, rtld_fini=<value optimized out>, stack_end=0x7ffd537d0dd8) at libc-start.c:226 result = <value optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -6805578527007124004, 4204960, 140726004157920, 0, 0, 6806940805326362076, 6897556252474660316}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x404f70, 0x7ffd537d0de8}, data = { prev = 0x0, cleanup = 0x0, canceltype = 4214640}}} not_first_call = <value optimized out> #16 0x00000000004029c9 in _start () No symbol table info available. Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 t_strcut (str=0xffffffffffffffff <Address 0xffffffffffffffff out of bounds>, cutchar=64 '@') at strfuncs.c:294 294 for (p = str; *p != '\0'; p++) { (gdb) bt full #0 t_strcut (str=0xffffffffffffffff <Address 0xffffffffffffffff out of bounds>, cutchar=64 '@') at strfuncs.c:294 p = 0xffffffffffffffff <Address 0xffffffffffffffff out of bounds> #1 0x00007f1afa1a7d2f in get_var_expand_users (tab=0x1c37e98, user=0xffffffffffffffff <Address 0xffffffffffffffff out of bounds>) at client-common.c:523 i = <value optimized out> #2 0x00007f1afa1a7f29 in get_var_expand_table (client=0x27b85b0, msg=0x1c37e38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315@:6") at client-common.c:541 tab = 0x1c37e98 #3 client_get_log_str (client=0x27b85b0, msg=0x1c37e38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315@:6") at client-common.c:644 static_tab = {{key = 115 's', value = 0x0, long_key = 0x0}, {key = 36 '$', value = 0x0, long_key = 0x0}, {key = 0 '\000', value = 0x0, long_key = 0x0}} func_table = {{key = 0x7f1afa1b2d0c "passdb", func = 0x7f1afa1a7c70 <client_var_expand_func_passdb>}, {key = 0x0, func = 0}} tab = <value optimized out> e = <value optimized out> str = <value optimized out> str2 = <value optimized out> pos = <value optimized out> #4 0x00007f1afa1a847a in client_log_err (client=0x27b85b0, msg=0x1c37e38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315@:6") at client-common.c:692 _data_stack_cur_id = 3 #5 0x00007f1afa1ab51e in login_proxy_ssl_handshaked (context=0x237e910) at login-proxy.c:765 proxy = 0x237e910 #6 0x00007f1afa1b0e4b in ssl_handshake (proxy=0x23cb660) at ssl-proxy-openssl.c:468 ret = <value optimized out> #7 ssl_step (proxy=0x23cb660) at ssl-proxy-openssl.c:519 No locals. #8 0x00007f1af9f2ee0b in io_loop_call_io (io=0x285cf20) at ioloop.c:564 ioloop = 0x1bd87b0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f1af9f30407 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x1c338d0 events = <value optimized out> event = 0x260eac0 list = 0x227b980 io = <value optimized out> tv = {tv_sec = 0, tv_usec = 519697} events_count = <value optimized out> msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f1af9f2eeb5 in io_loop_handler_run (ioloop=0x1bd87b0) at ioloop.c:612 No locals. #11 0x00007f1af9f2f058 in io_loop_run (ioloop=0x1bd87b0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #12 0x00007f1af9ec1b23 in master_service_run (service=0x1bd8650, callback=<value optimized out>) at master-service.c:640 No locals. #13 0x00007f1afa1ae593 in login_binary_run (binary=<value optimized out>, argc=2, argv=0x1bd8390) at main.c:486 set_pool = 0x1bd8b80 login_socket = <value optimized out> c = <value optimized out> #14 0x00007f1af9b1ad1d in __libc_start_main (main=0x402ac0 <main>, argc=2, ubp_av=0x7ffcdfc7cd68, init=<value optimized out>, fini=<value optimized out>, rtld_fini=<value optimized out>, stack_end=0x7ffcdfc7cd58) at libc-start.c:226 result = <value optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -5108975228267825424, 4204960, 140724062899552, 0, 0, 5107356402929858288, 5128673613026916080}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x404f70, 0x7ffcdfc7cd68}, data = { prev = 0x0, cleanup = 0x0, canceltype = 4214640}}} not_first_call = <value optimized out> #15 0x00000000004029c9 in _start () No symbol table info available. Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 ssl_proxy_is_handshaked (proxy=0x21a930a940a43715) at ssl-proxy-openssl.c:720 720 { (gdb) bt full #0 ssl_proxy_is_handshaked (proxy=0x21a930a940a43715) at ssl-proxy-openssl.c:720 No locals. #1 0x00007f0c84b63326 in get_var_expand_table (client=0xc49c50, msg=0x8b5e38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315@:6") at client-common.c:556 ssl_state = <value optimized out> ssl_error = <value optimized out> tab = 0x8b5e98 #2 client_get_log_str (client=0xc49c50, msg=0x8b5e38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315@:6") at client-common.c:644 static_tab = {{key = 115 's', value = 0x0, long_key = 0x0}, {key = 36 '$', value = 0x0, long_key = 0x0}, {key = 0 '\000', value = 0x0, long_key = 0x0}} func_table = {{key = 0x7f0c84b6dd0c "passdb", func = 0x7f0c84b62c70 <client_var_expand_func_passdb>}, {key = 0x0, func = 0}} tab = <value optimized out> e = <value optimized out> str = <value optimized out> str2 = <value optimized out> pos = <value optimized out> #3 0x00007f0c84b6347a in client_log_err (client=0xc49c50, msg=0x8b5e38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\b\315@:6") at client-common.c:692 _data_stack_cur_id = 3 #4 0x00007f0c84b6651e in login_proxy_ssl_handshaked (context=0xf464b0) at login-proxy.c:765 proxy = 0xf464b0 #5 0x00007f0c84b6be4b in ssl_handshake (proxy=0xd5d600) at ssl-proxy-openssl.c:468 ret = <value optimized out> #6 ssl_step (proxy=0xd5d600) at ssl-proxy-openssl.c:519 No locals. #7 0x00007f0c848e9e0b in io_loop_call_io (io=0xdf5ea0) at ioloop.c:564 ioloop = 0x8567b0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #8 0x00007f0c848eb407 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x8b18d0 events = <value optimized out> event = 0xf305f0 list = 0xc4a700 io = <value optimized out> tv = {tv_sec = 0, tv_usec = 954174} events_count = <value optimized out> msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #9 0x00007f0c848e9eb5 in io_loop_handler_run (ioloop=0x8567b0) at ioloop.c:612 No locals. #10 0x00007f0c848ea058 in io_loop_run (ioloop=0x8567b0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #11 0x00007f0c8487cb23 in master_service_run (service=0x856650, callback=<value optimized out>) at master-service.c:640 No locals. #12 0x00007f0c84b69593 in login_binary_run (binary=<value optimized out>, argc=2, argv=0x856390) at main.c:486 set_pool = 0x856b80 login_socket = <value optimized out> c = <value optimized out> #13 0x00007f0c844d5d1d in __libc_start_main (main=0x402ac0 <main>, argc=2, ubp_av=0x7ffd41fc1f28, init=<value optimized out>, fini=<value optimized out>, rtld_fini=<value optimized out>, stack_end=0x7ffd41fc1f18) at libc-start.c:226 result = <value optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -3476376496289340868, 4204960, 140725710495520, 0, 0, 3475633251103023676, 3591732184888123964}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x404f70, 0x7ffd41fc1f28}, data = { prev = 0x0, cleanup = 0x0, canceltype = 4214640}}} not_first_call = <value optimized out> #14 0x00000000004029c9 in _start () No symbol table info available. Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 0x00007ff9e5e5f40b in p_malloc (pool=0x1f10c90, str=0x1f1d3d0 "4qyKMRI+AAAAAAAA") at mempool.h:76 76 return pool->v->malloc(pool, size); (gdb) bt full #0 0x00007ff9e5e5f40b in p_malloc (pool=0x1f10c90, str=0x1f1d3d0 "4qyKMRI+AAAAAAAA") at mempool.h:76 No locals. #1 p_strdup (pool=0x1f10c90, str=0x1f1d3d0 "4qyKMRI+AAAAAAAA") at strfuncs.c:43 mem = <value optimized out> len = 17 #2 0x00007ff9e60c2e9f in client_get_session_id (client=0x1f10980) at client-common.c:482 buf = 0x1f1d328 base64_buf = 0x1f1d398 tv = {tv_sec = 1475622745, tv_usec = 58530} timestamp = 1475622745058530 i = 48 #3 0x00007ff9e60c302c in get_var_expand_table (client=0x1f10980, msg=0x1f1ce38 "proxy: SSL certificate not received from (null):0") at client-common.c:568 tab = 0x1f1ce70 #4 client_get_log_str (client=0x1f10980, msg=0x1f1ce38 "proxy: SSL certificate not received from (null):0") at client-common.c:644 static_tab = {{key = 115 's', value = 0x0, long_key = 0x0}, {key = 36 '$', value = 0x0, long_key = 0x0}, {key = 0 '\000', value = 0x0, long_key = 0x0}} func_table = {{key = 0x7ff9e60cdd0c "passdb", func = 0x7ff9e60c2c70 <client_var_expand_func_passdb>}, {key = 0x0, func = 0}} tab = <value optimized out> e = <value optimized out> str = <value optimized out> str2 = <value optimized out> pos = <value optimized out> #5 0x00007ff9e60c347a in client_log_err (client=0x1f10980, msg=0x1f1ce38 "proxy: SSL certificate not received from (null):0") at client-common.c:692 _data_stack_cur_id = 3 #6 0x00007ff9e60c651e in login_proxy_ssl_handshaked (context=0x256cfb0) at login-proxy.c:765 proxy = 0x256cfb0 #7 0x00007ff9e60cbe4b in ssl_handshake (proxy=0x23f6710) at ssl-proxy-openssl.c:468 ret = <value optimized out> #8 ssl_step (proxy=0x23f6710) at ssl-proxy-openssl.c:519 No locals. #9 0x00007ff9e5e49e0b in io_loop_call_io (io=0x256cc40) at ioloop.c:564 ioloop = 0x1ebd7b0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #10 0x00007ff9e5e4b407 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x1f188d0 events = <value optimized out> event = 0x24d25f0 list = 0x2561f10 io = <value optimized out> tv = {tv_sec = 0, tv_usec = 551105} events_count = <value optimized out> msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #11 0x00007ff9e5e49eb5 in io_loop_handler_run (ioloop=0x1ebd7b0) at ioloop.c:612 No locals. #12 0x00007ff9e5e4a058 in io_loop_run (ioloop=0x1ebd7b0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #13 0x00007ff9e5ddcb23 in master_service_run (service=0x1ebd650, callback=<value optimized out>) at master-service.c:640 No locals. #14 0x00007ff9e60c9593 in login_binary_run (binary=<value optimized out>, argc=2, argv=0x1ebd390) at main.c:486 set_pool = 0x1ebdb80 login_socket = <value optimized out> c = <value optimized out> #15 0x00007ff9e5a35d1d in __libc_start_main (main=0x402ac0 <main>, argc=2, ubp_av=0x7ffe367d2178, init=<value optimized out>, fini=<value optimized out>, rtld_fini=<value optimized out>, stack_end=0x7ffe367d2168) at libc-start.c:226 result = <value optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -3428671975511032229, 4204960, 140729812590960, 0, 0, 3429075480732761691, 3429810282407657051}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x404f70, 0x7ffe367d2178}, data = { prev = 0x0, cleanup = 0x0, canceltype = 4214640}}} not_first_call = <value optimized out> #16 0x00000000004029c9 in _start () No symbol table info available. Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 0x00007f029b173314 in str_sanitize_skip_start (src=0x2f6d6f632e61636f <Address 0x2f6d6f632e61636f out of bounds>, max_bytes=64) at str-sanitize.c:13 13 for (i = 0; i < max_bytes && src[i] != '\0'; ) { (gdb) bt full #0 0x00007f029b173314 in str_sanitize_skip_start (src=0x2f6d6f632e61636f <Address 0x2f6d6f632e61636f out of bounds>, max_bytes=64) at str-sanitize.c:13 chr = 0 i = 0 #1 str_sanitize (src=0x2f6d6f632e61636f <Address 0x2f6d6f632e61636f out of bounds>, max_bytes=64) at str-sanitize.c:88 str = <value optimized out> i = <value optimized out> #2 0x00007f029b3d7f9e in get_var_expand_table (client=0x221ee70, msg=0x187fe38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\bͰ\a\202\001:6") at client-common.c:548 tab = 0x187fe98 #3 client_get_log_str (client=0x221ee70, msg=0x187fe38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\bͰ\a\202\001:6") at client-common.c:644 static_tab = {{key = 115 's', value = 0x0, long_key = 0x0}, {key = 36 '$', value = 0x0, long_key = 0x0}, {key = 0 '\000', value = 0x0, long_key = 0x0}} func_table = {{key = 0x7f029b3e2d0c "passdb", func = 0x7f029b3d7c70 <client_var_expand_func_passdb>}, {key = 0x0, func = 0}} tab = <value optimized out> e = <value optimized out> str = <value optimized out> str2 = <value optimized out> pos = <value optimized out> #4 0x00007f029b3d847a in client_log_err (client=0x221ee70, msg=0x187fe38 "proxy: SSL certificate not received from \314-A\235q\210\021\b\354\062Lzح)\367.\002 \031\233 \362w⊓\224\356K7\343\224 \002\037\364!+\266\371\277O`K\021\bͰ\a\202\001:6") at client-common.c:692 _data_stack_cur_id = 3 #5 0x00007f029b3db51e in login_proxy_ssl_handshaked (context=0x19b2530) at login-proxy.c:765 proxy = 0x19b2530 #6 0x00007f029b3e0e4b in ssl_handshake (proxy=0x195df70) at ssl-proxy-openssl.c:468 ret = <value optimized out> #7 ssl_step (proxy=0x195df70) at ssl-proxy-openssl.c:519 No locals. #8 0x00007f029b15ee0b in io_loop_call_io (io=0x216d790) at ioloop.c:564 ioloop = 0x18207b0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f029b160407 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x187b8d0 events = <value optimized out> event = 0x1df4668 list = 0x2025710 io = <value optimized out> tv = {tv_sec = 11, tv_usec = 323409} events_count = <value optimized out> msecs = <value optimized out> ret = 3 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f029b15eeb5 in io_loop_handler_run (ioloop=0x18207b0) at ioloop.c:612 No locals. #11 0x00007f029b15f058 in io_loop_run (ioloop=0x18207b0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #12 0x00007f029b0f1b23 in master_service_run (service=0x1820650, callback=<value optimized out>) at master-service.c:640 No locals. #13 0x00007f029b3de593 in login_binary_run (binary=<value optimized out>, argc=2, argv=0x1820390) at main.c:486 set_pool = 0x1820b80 login_socket = <value optimized out> c = <value optimized out> #14 0x00007f029ad4ad1d in __libc_start_main (main=0x402ac0 <main>, argc=2, ubp_av=0x7ffd637fd608, init=<value optimized out>, fini=<value optimized out>, rtld_fini=<value optimized out>, stack_end=0x7ffd637fd5f8) at libc-start.c:226 result = <value optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -4141182239951058275, 4204960, 140726272775680, 0, 0, 4142562126330825373, 4071998539020864157}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x404f70, 0x7ffd637fd608}, data = { prev = 0x0, cleanup = 0x0, canceltype = 4214640}}} not_first_call = <value optimized out> #15 0x00000000004029c9 in _start () No symbol table info available. -- Adi Pircalabu

2 2

[feature suggestion] pigeonhole - sendmail path for outgoing email
by krzf83＠gmail.com 06 Oct '16

06 Oct '16

pigeonhole seems to use /usr/sbin/sendmail for its outgoing emails - even tought that is does not seem to be documented anywhere. How about setting to specify diffrent sendmail program path and parameters?

3 4

doveadm reload kicked proxy/director users
by Peer Heinlein 06 Oct '16

06 Oct '16

We just noticed, that a doveadm reload kicked all existing imap-sessions on our Dovecot Director. We're surprised about that, because shutdown_clients is set to NO. Is there any way to reload a config change without kicking all IMAP sessions? Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

1 0

Changing Dovecot's format from Maildir to mdbox
by Kristopher Joyce 05 Oct '16

05 Oct '16

Hello, I am trying to change Dovecot's email format from Maildir to mdbox. I have changed Maildir to mdbox in Mail_location from: maildir:/var/vmail/%d/%n to: mdbox:/var/vmail/%d/%n. Nothing seems to happen after I restart Dovecot. The users are virtual users and not local users. Is there something I am missing? Thanks Kris --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 1

Connection reset by peer query
by voytek＠sbt.net.au 05 Oct '16

05 Oct '16

One of my user having trouble 'synchronizing' his mobile with his mailbox looking at logs I can see like[1]: searching around, I found some posts suggesting index corruption?? what can or what should I do ? can I force re-index ? delete index files ? which ones ? using outlook on Win7, if relevant [1] Oct 05 11:24:32 imap(aaa(a)aaa.com.au): Info: Connection closed: Connection reset by peer in=238 out=1892993 # grep aaa@aaa /var/log/dovecot.log | grep reset | wc 10 130 1117 # grep aaa@aaa /var/log/dovecot.log.1 | grep reset | wc 30 406 3582

1 0

Dovecot + SAN with dedup+compression
by María Arrea 04 Oct '16

04 Oct '16

Hello We have a big Dovecot Server (over 20 TB of mail, 40K users, over 30K iops) and we are evaluating a new SAN Array. We have competitive proposals from Pure Storage (All Flash) , HP 3Par (Hybrid), NetApp FaaS (Hybrid) & EMC Unity (Hybrid). We rely in mdbox+zlib for main storage and mdbox+lzma for secondary storage, does anybody in the list have experience with SAN-based deduplication/compression? Regards Maria.

2 1

shared folders
by Scherff 04 Oct '16

04 Oct '16

Well, these is the complete output for dovecot -n : mail:~ # dovecot -n # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.1.31-30-default x86_64 openSUSE 42.1 (x86_64) auth_mechanisms = plain login mail_gid = vmail mail_home = /var/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = " acl" mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace { hidden = no ignore_on_failure = no list = children location = maildir:%%h/mail:INDEX=%h/mail/shared/%%u:CONTROL=%h/mail/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Notes { auto = subscribe } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile:/var/vmail/dovecot-acl acl_shared_dict = file:/var/vmail/db/shared-mailboxes.db quota = maildir:User quota quota_exceeded_message = Benutzer %u hat das Speichervolumen überschritten. / User %u has exhausted allowed storage space. sieve = /var/vmail/sieve/%d/%n/active-script.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_dir = /var/vmail/sieve/%d/%n/scripts zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = required ssl_cert = </etc/fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECDH:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_dh_parameters_length = 2048 ssl_key = </etc/privkey.pem ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { imap_idle_notify_interval = 15 mins mail_max_userip_connections = 100 mail_plugins = " acl quota imap_quota zlib imap_acl" } protocol lmtp { mail_plugins = " acl sieve zlib" }

2 2

Dovecot + SAMBA4
by doys 04 Oct '16

04 Oct '16

hello, I'm new to this forum:) I couldn't found any topic with the same problem and I'm sorry for the inconvenience if there is already one. I'd like to use Dovecot with an authentification from Samba4 via Kerberos. I've followed this procedure : http://wiki2.dovecot.org/Authentication/Kerberos but I cannot connect to the domain. I have not met any difficulty with Samba ; I have others servers that are connected to the samba4 domain via samba/winbind wbinfo -u / -g et getent passwod / group works fine. I don't find the error and the logs are fruitless : Oct 4 09:03:46 mail dovecot: imap-login: Aborted login (no auth attempts in 0 secs): user=<>, rip=MY_IP, lip=IP_SERVER, session=<4ilrqQQ+2AAKaBFq> Oct 4 09:03:46 mail dovecot: imap-login: Aborted login (no auth attempts in 0 secs): user=<>, rip=MY_IP, lip=IP_SERVER, session=<7SprqQQ+2QAKaBFq> Oct 4 09:03:55 mail dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=MY_IP, lip=IP_SERVER, session=<JmjtqQQ+2gAKaBFq> Oct 4 09:03:55 mail dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=MY_IP, lip=IP_SERVER, session=<UyHuqQQ+2wAKaBFq> This is my docevot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.6 auth_default_realm = DOMAIN.COM auth_gssapi_hostname = $ALL auth_mechanisms = gssapi auth_realms = DOMAIN.COM auth_username_translation = /@ mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap pop3" ssl = no userdb { driver = static } I wish to use maildir and I wish not to have multidomain. The server is a Debian 8 with compilated samba 4.4.5 + dovecot 2.2.13 (deb file). i dovecot-core - secure POP3/IMAP server - core files i dovecot-gssapi - secure POP3/IMAP server - GSSAPI support i dovecot-imapd - secure POP3/IMAP server - IMAP daemon i dovecot-pop3d - secure POP3/IMAP server - POP3 daemon i dovecot-sieve - secure POP3/IMAP server - Sieve filters su And this is what telnet returns : telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LOGINDISABLED AUTH=GSSAPI] Dovecot ready. Can you give me a hint, please ? Thank you ! doys Messages: 1 Inscrit le: 2016-10-04 10:31 Haut -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecot-SAMBA4-tp57421.html Sent from the Dovecot mailing list archive at Nabble.com.

1 0

Re: NFSv4 and Maildir
by Joseph Tam 04 Oct '16

04 Oct '16

Noel Butler writes: >> I found the same thing, and turning off write delegation seemed >> to have solved the problem. I still don't know why, though. > > write delegation is disabled by default on NetApp with v4, or have they > changed this now? I think this is still the case: when I exported NFSv4, I also turned on both r/w delegation as well. The exported filesystem exhibited weird locking or slow write operations on NFS clients (e.g. "touch newfile" would take a second to complete). This went away when I turned off write delegation. Joseph Tam <jtam.home(a)gmail.com>

1 0

doveadm backup fails (compromised single attachment storage)
by Webert de Souza Lima 03 Oct '16

03 Oct '16

Hi, A couple of months ago I had a problem with Single Attachment Storage after infrastructure migration; All mailboxes were rsynced to another filesystem, and that may have broken Single Attachment Storage. Many, many (if not all) mailboxes show the below logs on dovecot: imap(foo(a)bar.com): Error: read(attachments-connector(zlib(/dovecotdir/mail/ bar.com/foo/mailboxes/INBOX/dbox-Mails/u.26426))) failed: read(/dovecotdir/attach/ bar.com/de/86/de8673894d6fb3f4460e3c26436eefa9a73517fa0f000452f553822367220… b/l]) failed: open(/dovecotdir/attach/ bar.com/de/86/de8673894d6fb3f4460e3c26436eefa9a73517fa0f000452f553822367220…) failed: No such file or directory When that happens, the MUA keeps syncing forever. Now, I need to migrate all mailboxes (again) to another dovecot instance (with no SAS), which works perfectly for new users but when I try to migrate users from my current dovecot server for this new server, I get such errors again, and I can't migrate: 2016-09-29T12:20:50.995934059Z Sep 29 12:20:50 dsync-server(foo(a)bar.com): Error: dsync(cf7d091311eb): read(attachments-connector(zlib(/dovecotdir/mdbox/bar.com/foo/storage/m.1))) failed: read(/dovecotdir/attach/ bar.com/0c/df/0cdf86b1920938fe3a043f87e2ee9e63dda276bd5b9fba687e4a0c63d181c… b/l]) failed: open(/dovecotdir/attach/ bar.com/0c/df/0cdf86b1920938fe3a043f87e2ee9e63dda276bd5b9fba687e4a0c63d181c…) failed: No such file or directory (last sent=mail, last recv=mail_request (EOL)) Is there a way to fix the attachments problem? (I know I can't recover such files, that's Ok) Is there a way to migrate (dsync backup) ignoring such problems? Thanks in advance.

1 2