- dovecot - dovecot.org

Re: openssl question
by Joseph Tam 09 Jan '18

09 Jan '18

> but i try to this command > > openssl s_client -connect mail.mydomain:pop3s -starttls imap > > it says CONNECTED and hang. second command is correct? Uh, "pop3s" != "imap", and IMAP/STARTTLS is not the same as IMAP/SSL (or whatever the hell the terminology is nowadays). If you're testing IMAP, try one or the other or both depending of how many flavours of SSL you got going. openssl s_client -starttls imap -connect mail.mydomain:143 openssl s_client -connect mail.mydomain:993 Joseph Tam <jtam.home(a)gmail.com>

3 2

Pathetic Upgrade Question: 2.0.9 to 2.3.0
by John Tulp 09 Jan '18

09 Jan '18

My version output is below, under the heading "My actual question". Background to my woes: =================== I installed a new virtual machine with CentOS 6.9 (I'll refer to it as xxserverxx) and included the postfix server. I configured a virtual network, did a decent job of hardening firewalls for both physical host and virtual guests. I was able to get mail / mailx to send and receive mail on the command line using postfix using Maildir delivery. Sent and received email to/from self as well as from an external email address hosted elsewhere. But not being satisfied enough with mailx mail client... wanting an IMAP client on the same 192 virtual private subnet, I used yum to install dovecot package from CentOS repositories on the virtual mail guest server. Configured mail client (Evolution installled via graphical interface on a CentOS 6.9 workstation on the same subnet), and configured dovecot, used mbox delivery, struggled with documentation to understand how server mail directories/files are actually used, fixed a problem or two, but did not have IMAP send and receive working. Then, wanting to be on the latest stable version of dovecot anyway, I downloaded dovecot 2.3.0 from dovecot.org and attempted to follow the instructions on building from source, but in the end all I could really find was the simple sequence of steps, make configure, make and make install, so that's what I did. Continued struggling with configuration (needing to be somewhat certain that defaults would not create a completely wide open mail server that would be hacked in 10 minutes, since this is on a real physical host with a public ip. I actually got an email to get appended to the users mbox file. Evolution Email client at one point actually logged into dovecot/IMAP and retrieved 3 received emails. The problem is that Email client is now failing on permissions in creating index files. I've gotten to the point of going to extreme measures to "fix" that file creation problem, but to no avail. Now unfortunately I've found an underlying problem to everything, going back to the beginning where I upgraded dovecot. My actual question: ================ I don't want troubleshooting help, but help with documentation. It appears that make install has not replaced the old 2.0.9 binaries with new 2.3.0 binaries, even though it faithfully created everying under the /usr directories, e.g., /usr/bin, etc., and make install did not set some variable or otherwise configure for the new version to run instead of the old. Well, maybe. Very scary (to me) in my maillog file, starting up and shutting down doevcot... Jan 6 16:15:59 xxserverxx dovecot: master: Dovecot v2.0.9 starting up (core dumps disabled) Jan 6 16:16:05 xxserverxx dovecot: master: Warning: Killed with signal 15 (by pid=5983 uid=0 code=kill) Jan 6 16:16:16 xxserverxx dovecot: master: Dovecot v2.0.9 starting up (core dumps disabled) Jan 6 16:21:02 xxserverxx dovecot: master: Warning: Killed with signal 15 (by pid=6056 uid=0 code=kill) Jan 6 16:23:39 xxserverxx dovecot: master: Dovecot v2.0.9 starting up (core dumps disabled) Precisely how should this 2.3.0, built from source, be properly installed and configured to actually run the new version ? Here is what I currently get from --version and -n, just running in my root directory: [root@xxserverxx ~]# dovecot --version 2.3.0 (c8b89eb) [root@xxserverxx ~]# dovecot -n # 2.3.0 (c8b89eb): /usr/local/etc/dovecot/dovecot.conf doveconf: Fatal: open(/usr/local/etc/dovecot/dovecot.conf) failed: No such file or directory (copy example configs from /usr/local/share/doc/dovecot/example-config/) Here is root's path: [root@xxserverxx ~]# env|grep -i path PATH=/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin Perhaps, of course, the new versions are running. Of course, it appears that the dovecot executable can't find config files. So why would my maillog say that the old version is running ? Perhaps it's the new executable running with some leftover config from the old version ? Obviously I have not a clue as to the following, and these are my questions: a) what determines from which directories are each and every dovecot executable runs (i.e., normal plus any oddball) ? b) under what userid is each one run ? c) what determines from which directories are each and every dovecot config file is read ? d) when I install a new version of dovecot, how do I control which versions of config and executables are used at runtime ? Is there a place in the documentation where all this is contained in one place in a nice organized table ? My mitigating workaround: ===================== I can of course start over, creating a brand new mail server VM, WITHOUT installing dovecot 2.0.6, and then JUST download the 2.3.0 and build and install it. At least then I will only have 1 version of dovecot present on the virtual machine to deal with. But the obvious question then remains: After my NEXT dovecot upgrade, I'm back in the quagmire, needing to know a) b) and c) above. I am confident that dovecot is not lacking in this department, I just can't find what I'm looking for in the documentation. Thanks in advance, John

4 3

Re: Pathetic Upgrade Question: 2.0.9 to 2.3.0
by Peter 09 Jan '18

09 Jan '18

On 09/01/18 11:46, John Tulp wrote: > Should I send a response to your message via an email to > dovecot(a)dovecot.org ? > Or just reply to you directly like this ? You should always reply to the mailing list unless told otherwise. > For CentOS version, I need to support 32-bit x86 a while longer. Ok. > Could you possibly save me some time and provide a > link on the dovecot.org site ? https://repo.dovecot.org/ > I really did not want to install from > source, I was very surprised that I did not find a link to download a > completely built backage on dovecot.org. The official dovecot repo is fairly new, but also GhettoForge has been providing dovecot packages for CentOS 6 and 7 for quite some time now. > Regarding yum update, yes, I would assume that I would not run yum > update after that build/install. That's a bad idea. You need to run updates on a regular basis to fix new vulnerabilities that are discovered such as the very recent meltdown and spectre vulnerabilities (look these up, they're serious). > I'm really perplexed as to why yum update would not just take me to > 2.3.0 ??? I guess the RedHat folks just include "certain" releases of > packages in the repositories ? See: https://access.redhat.com/security/updates/backporting Peter

1 0

openssl question
by Selcuk Yazar 08 Jan '18

08 Jan '18

Hi we are using dovecot on secure port when i try to command openssl s_client -connect mail.mydomain:pop3s it works perfect. it says ***OK Dovecot ready*** Also i check from https://www.sslshopper.com/ssl-checker.html web page i can see all correct ceritificate paths but i try to this command openssl s_client -connect mail.mydomain:pop3s -starttls imap it says CONNECTED and hang. second command is correct? also my thunderbird client doesnt work with 143 port and STARTTLS. is this general issue or have we config error? thanks in advance Selçuk YAZAR

1 0

mail delivery interrupts force-resync
by Felipe Gasper 08 Jan '18

08 Jan '18

Hi all, We have recently had some power failures have led to corrupt mdbox instances. Dovecot’s fsck appears to get caught in a loop when the recipient has a large amount of mail. In the example log output below, each “rebuilding indexes” seems to be interrupted by a new IMAP connection. Later, when our folks realized the issue and blocked access to the mailbox, the index rebuild finished in about 90 seconds. Is it possible for the fsck to “lock” the mailbox or otherwise protect against this? Thank you! -Felipe Gasper ==================== - Jan 2 13:15:13 mx1.cpanel.net dovecot: imap(kenp(a)cpanel.net): Logged out in=1657, out=9420, bytes=1657/9420 Jan 2 13:15:13 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:13 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:13 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:13 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes -- Jan 2 13:15:18 mx1.cpanel.net dovecot: imap(a.lateef(a)cpanel.net): Connection closed (LIST finished 0.121 secs ago) in=56, out=1805, bytes=56/1805 Jan 2 13:15:18 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:18 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes -- Jan 2 13:15:23 mx1.cpanel.net dovecot: imap(w.little(a)cpanel.net): Connection closed (UID FETCH finished 0.098 secs ago) in=151, out=1903, bytes=151/1903 Jan 2 13:15:24 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:24 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): msgid=<20180102142708.383C9C2042D(a)hou-1.auth.dns.prod.cpanel.net>: saved mail to INBOX Jan 2 13:15:24 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:24 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes -- Jan 2 13:15:26 mx1.cpanel.net dovecot: imap(rochelemagne(a)cpanel.net): Logged out in=38, out=535, bytes=38/535 Jan 2 13:15:28 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:28 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes -- Jan 2 13:15:32 mx1.cpanel.net dovecot: imap-login: Login: user=<l.patterson(a)cpanel.net>, method=PLAIN, rip=208.74.121.106, lip=208.74.121.68, mpid=30642, TLS, session=<g+Ex7M9hSSnQSnlq> Jan 2 13:15:33 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:33 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:33 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:33 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:33 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes -- Jan 2 13:15:40 mx1.cpanel.net dovecot: imap(michael.karr(a)cpanel.net): Logged out in=38, out=535, bytes=38/535 Jan 2 13:15:40 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:40 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes -- Jan 2 13:15:44 mx1.cpanel.net dovecot: imap-login: Disconnected (auth failed, 2 attempts in 44 secs): user=<test(a)cpanel.net>, method=PLAIN, rip=189.4.115.5, lip=208.74.121.68, TLS, session=<OkJJ6s9hM+C9BHMF> Jan 2 13:15:44 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:44 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:44 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: fscking index file /home/cpmailuser/mail/cpanel.net/aaron.stone/storage/dovecot.map.index Jan 2 13:15:44 mx1.cpanel.net dovecot: lmtp(aaron.stone(a)cpanel.net): Warning: mdbox /home/cpmailuser/mail/cpanel.net/aaron.stone/storage: rebuilding indexes ========================

1 0

Duplicate mailbox id, mailbox does not exist when attempting to give a new guid
by Daniel Botting 08 Jan '18

08 Jan '18

Hi, We have one user whose mailbox cannot replicate as below, dovecot version is: 2.2.13 mail.log shows the below for the user: Jan 3 16:20:57 hostname dovecot: dsync-server(user): Error: Duplicate mailbox GUID <guid number> for mailboxes <mailbox name.sub folder> and <mailbox name.sub folder> - giving a new GUID <guid number> to <mailbox name.subfolder> Jan 3 16:20:57 hostname dovecot: dsync-server(user): Error: Couldn't update mailbox <sub folder name> GUID: Mailbox doesn't exist: <sub folder name> Looking at their mailbox the folder does exist. If you are able to assist that would be appreciated. Kind regards Daniel Botting Codethink Ltd

1 0

Re: TLS problem after upgrading from v2.2 to v2.3
by Joseph Tam 08 Jan '18

08 Jan '18

Jan Vejvalka <jan.vejvalka(a)lfmotol.cuni.cz> writes: >> Mine are below and they work just fine: >> >> ssl_cipher_list = >> ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!3DES:!MD5:!PSK:!SSLv2:!SSLv3 I notice all the ciphers use DH, so did you a generate a permanent DH key? (https://wiki2.dovecot.org/Upgrading/2.3) ssl-parameters.dat file is now obsolete. You should use ssl_dh setting instead: ssl_dh=</etc/dovecot/dh.pem You can convert an existing ssl-parameters.dat to dh.pem: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dh -inform der > /etc/dovecot/dh.pem Joseph Tam <jtam.home(a)gmail.com>

2 1

Locks directory change
by Federico Bartolucci 08 Jan '18

08 Jan '18

Hello, it's the first time for me writing to the list, I'm trying to change the location into which the Dovecot's locks are done reserving a special temporary directory on an other partition, then adding to the dovecont.conf the line: mail_location = maildir:~/Maildir:VOLATILEDIR=/tmp_lock/%2.256Nu/%u so that through the VOLATILEDIR directive the locks should be written in this path. We observe though that the locks for many users are still done in the real maildir (NFS mounted filesystem) as if in some situations this instruction is not effective. Anybody knows if are there other things to change or to do or what could be the reason? (for instance to login in a specific way or doing a particular operation). Regards, Federico

3 3

Removing IMAP ID command
by Alex Hautequest 08 Jan '18

08 Jan '18

Hello all. Happy 2018! How can I disable the dovecot IMAP ID command, or hide the product name, so one does not eyeball what server software I am running (which happens to be v2.2.33.2)? Please see below for an example: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Ready. * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN A001 OK Pre-login capabilities listed, post-login capabilities have more. * ID ("name" "Dovecot") A002 OK ID completed. A003 BAD Error in IMAP command received by server. * BYE Logging out A004 OK Logout completed. It does not seems POP3 advertises itself: +OK Ready. +OK CAPA TOP UIDL RESP-CODES PIPELINING AUTH-RESP-CODE STLS SASL . Thanks and regards, Alex.

2 1

Mailing list content filtering changes
by Timo Sirainen 07 Jan '18

07 Jan '18

I've now disabled all content filtering in Mailman, because of the failing DKIM/DMARC issues. Hopefully that solves them for now.. Although this will mean that we'll probably start getting HTML mails to this list, which isn't ideal. I guess an alternative could be to reject any mails with text/html MIME part, but that could prevent some people from sending any mails to this list unless they switch to a different client/webmail.. Also that feature doesn't seem to be possible at least with the Mailman version we're currently using. BTW. All/most of the Gmail and Yahoo users just got disabled by mailman due to DMARC bounces. I've (hopefully) re-enabled mail for all of them.

2 1

Re: Updated Dovecot 2.3.0 now getting 2 strange log errors
by tony 07 Jan '18

07 Jan '18

I did some more digging around and found this is reproducible on multiple hosts running the same version of Dovecot/Pigeonhole/Postfix. The problem resurfaces on any host to an account with enabled Vacation/OOO response. The Vacation/OOO reply filter was created in Roundcubemail, but has been fine for years. One thing to note is in Dovecot 2.3.0 I did enable UTF8, but even if I disable UTF8 the issue remains. What I have discovered after digging around is.. * After a fresh postfix restart all expected processes are running without any postdrop process. postgrey 13080 0.0 0.2 73036 21108 ? Ss 17:23 0:00 postgrey --inet=127.0.0.1:10030 --pidfile=/run/postgrey/postgrey.pid --group=postgrey --user=postgrey --daemonize --greylist-text=Greylisted for %s seconds --auto-whitelist-clients root 13107 0.0 0.0 385700 108 ? Ssl 17:23 0:00 /usr/local/bin/pwhois_milter -i /run/pwhois_milter/pwhois_milter.pid -l /var/log/mail/mail.log -u postfix -g postfix -w global.pwhois.org root 13192 0.0 0.0 122536 5856 ? Ss 17:23 0:00 /usr/lib/postfix/bin/master -w postfix 13193 0.0 0.1 138524 8996 ? S 17:23 0:00 pickup -l -t unix -u postfix 13194 0.0 0.1 138572 9088 ? S 17:23 0:00 qmgr -l -t unix -u postfix 13320 0.0 0.1 163908 9832 ? S 17:24 0:00 proxymap -t unix -u postfix 13321 0.0 0.1 142756 9632 ? S 17:24 0:00 tlsmgr -l -t unix -u postfix 13322 0.0 0.1 138524 9280 ? S 17:24 0:00 anvil -l -t unix -u postfix 13352 0.0 0.1 168896 13520 ? S 17:24 0:00 smtpd -n smtp -t inet -u -o stress= -s 2 -o content_filter=spamassassin postfix 13539 0.0 0.1 163920 10156 ? S 17:24 0:00 trivial-rewrite -n rewrite -t unix -u postfix 14369 0.0 0.1 164300 10340 ? S 17:26 0:00 cleanup -z -t unix -u postfix 14370 0.0 0.1 124180 8844 ? S 17:26 0:00 pipe -n spamassassin -t unix user=spamd argv=/usr/bin/vendor_perl/spamc -f -e /usr/sbin/sendmail -oi -f ${sender} ${recipient} postfix 14375 0.0 0.1 142856 9344 ? S 17:26 0:00 lmtp -t unix -u vmail 14446 0.0 0.0 44008 7496 ? S 17:26 0:00 dovecot/quota-status -p postfix * During the problem where the logs are complaining about permission denied and sendmail exiting with signal 15 (caused by inbound email to an address with enabled Vacation notice filter) there is a running postdrop process and several expected processes are not running. postgrey 13080 0.0 0.2 73036 21132 ? Ss 17:23 0:00 postgrey --inet=127.0.0.1:10030 --pidfile=/run/postgrey/postgrey.pid --group=postgrey --user=postgrey --daemonize --greylist-text=Greylisted for %s seconds --auto-whitelist-clients root 13107 0.0 0.0 461572 408 ? Ssl 17:23 0:00 /usr/local/bin/pwhois_milter -i /run/pwhois_milter/pwhois_milter.pid -l /var/log/mail/mail.log -u postfix -g postfix -w global.pwhois.org root 13192 0.0 0.0 122536 5856 ? Ss 17:23 0:00 /usr/lib/postfix/bin/master -w postfix 13193 0.0 0.1 138524 8996 ? S 17:23 0:00 pickup -l -t unix -u postfix 13194 0.0 0.1 138644 9128 ? S 17:23 0:00 qmgr -l -t unix -u postfix 13321 0.0 0.1 142756 9632 ? S 17:24 0:00 tlsmgr -l -t unix -u postfix 20793 0.0 0.1 138524 9092 ? S 17:39 0:00 anvil -l -t unix -u vmail 25340 0.0 0.0 44108 7664 ? S 17:46 0:00 dovecot/quota-status -p postfix vmail 26298 0.0 0.1 122088 8536 ? S 17:49 0:00 /usr/bin/postdrop -r —— * When the issue is not present, an email TO any address with a disabled Vacation/OOO response filter is processed with no issues and stored in the respective folder moved by an existing filter not related to Vacation/OOO. Expected processes are still running (no postdrop process which when running seems to be causing the problem) * When the issue is not present, an email TO an address with a enabled Vacation/OOO response filter is processed and stored in the Inbox, but an auto-response fails to send. The result are these errors with the permission denied being repeated every ~minute. Dec 29 17:49:58 lmtp(jsomeone(a)domain.email)<26296><qbe8H6jwRlq4ZgAAUXb6+w>: Error: sieve: msgid=<CAE2c3QaGTiFDt5rdHEy2YeoSe+XBcB9Q5SGeOtknWKf2wgXZhQ(a)mail.gmail.com>: failed to send vacation response to someone(a)gmail.com: <Failed to execute sendmail> (temporary error) Dec 29 17:50:08 lmtp: Error: postdrop: warning: mail_queue_enter: create file maildrop/569031.26298: Permission denied * After the problem starts again with the errors shown in the logs a postdrop process stays running in the background. After a short while the number of postfix processes decreases. * If I kill the postdrop process then the logged errors stop and the expected processes all show up again. I am running out of ideas on why this has suddenly surfaced. - TC

5 12

quota issue - fs backend troubles with mount
by Arturo Bianchi 07 Jan '18

07 Jan '18

Hi, with the last update to version 2.2.33.2 I had problems with quota management; the plugin no longer reads the configuration correctly or something undocumented has changed! Until the version 2.2.30.2 the mount parameter work well, now no longer; so with... plugin { quota = fs:HOME:mount=/home quota2 = fs:INBOX:mount=/var/spool } ...the server no longer works and I read this in the log: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Quota root: name=HOME=fs args=mount=/home Debug: Quota grace: root=HOME bytes=0 (10%) Debug: Quota root: name=INBOX backend=fs args=mount=/var/spool Debug: Quota grace: root=INBOX bytes=0 (10%) Error: User initialization failed: Failed to initialize quota: Quota root HOME: fs quota init failed: Unknown parameter for backend fs: =/home I saw that the method for acquiring the parameters was revised in the src/plugins/quota/quota-fs.c but I still could not understand why it fails! Some advice? Do I have a formatting problem or am I missing some news about it? Thanks, Arturo. -- 73s

1 1

TLS problem after upgrading from v2.2 to v2.3
by Jan Vejvalka 07 Jan '18

07 Jan '18

Thanks for your reply; I used the defaults, both before and after the upgrade, cf. https://wiki2.dovecot.org/Upgrading/2.3 -> Setting default changes. The new defaults broke the connection. Jan > what are your settings? > > Mine are below and they work just fine: > > ssl_cipher_list = > ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!3DES:!MD5:!PSK:!SSLv2:!SSLv3

2 2

TLS problem after upgrading from v2.2 to v2.3
by Jan Vejvalka 06 Jan '18

06 Jan '18

Hi *, The change in default SSL settings between 2.2 and 2.3 cut off a few clients; Microsoft-hosted Exchange (?) being one of them: Jan 4 11:02:56 kremail dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=40.101.4.hisip, lip=myip, TLS handshaking: SSL_accept() failed: error:1408A0C1:SSL routines:SSL3_GET_CLIENT_HELLO:no shared cipher, session=<8SGob/BhTdcoZQS1> Explicitly setting ssl_cipher_list to the old defaults helped: ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL Does someone have an idea what to recommend to the poor user or should I accept that I stay with the old defaults ? The guy is cooperative, so we can find out which of the !'s in the new defaults actually breaks the connection... if you think it's worth. Thanks for your help, Jan

2 1

dovecot-2.3.0 'make check' error
by Eric Broch 05 Jan '18

05 Jan '18

Hello list, I've configured dovecot-2.3.0 on CentOS 6 with the following options. CFLAGS="-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing" \ LDFLAGS="-Wl,-z,now -Wl,-z,relro" \ ./configure \ --docdir=/usr/share/doc/dovecot-2.3.0 \ --with-lzma \ --disable-static \ --disable-rpath \ --with-nss \ --with-shadow \ --with-pam \ --with-gssapi=plugin \ --with-ldap=plugin \ --with-sql=plugin \ --with-lua=plugin \ --with-pgsql \ --with-mysql \ --with-sqlite \ --with-vpopmail=/etc/libvpopmail \ --with-zlib \ --with-libcap \ --with-libwrap \ --with-ssl=openssl \ --with-ssldir=/etc/pki/dovecot \ --with-solr \ --with-docs and compiled with the following: # make -j2 When I run a 'make check': # make check I get the following error: make[3]: Entering directory `/root/dovecot/dovecot-ce-2.3.0/src/lib-compression' for bin in test-compression; do \ if ! /bin/sh ../../run-test.sh ../.. ./$bin; then exit 1; fi; \ done compression handler gz ............................................... : ok compression handler bz2 .............................................. : ok compression handler deflate .......................................... : ok compression handler xz ............................................... : ok gz concat ............................................................ : ok gz no concat ......................................................... : ok gz large header ...................................................... : ok 0 / 7 tests failed ==4468== Conditional jump or move depends on uninitialised value(s) ==4468== at 0x3A6160ACB2: ??? (in /usr/lib64/liblzma.so.0.0.0) ==4468== by 0x3A6160AEA9: ??? (in /usr/lib64/liblzma.so.0.0.0) ==4468== by 0x3A61603121: ??? (in /usr/lib64/liblzma.so.0.0.0) ==4468== by 0x3A616061A0: ??? (in /usr/lib64/liblzma.so.0.0.0) ==4468== by 0x3A61605212: lzma_easy_encoder (in /usr/lib64/liblzma.so.0.0.0) ==4468== by 0x406ACF: o_stream_create_lzma (ostream-lzma.c:206) ==4468== by 0x403D89: test_compression_handler (test-compression.c:36) ==4468== by 0x4040BD: test_compression (test-compression.c:96) ==4468== by 0x408281: test_run_funcs (test-common.c:244) ==4468== by 0x4083E0: test_run (test-common.c:315) ==4468== by 0x40398B: main (test-compression.c:308) ==4468== Failed to run: ./test-compression make[3]: *** [check-local] Error 1 make[3]: Leaving directory `/root/dovecot/dovecot-ce-2.3.0/src/lib-compression' make[2]: *** [check-am] Error 2 make[2]: Leaving directory `/root/dovecot/dovecot-ce-2.3.0/src/lib-compression' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/root/dovecot/dovecot-ce-2.3.0/src' make: *** [check-recursive] Error 1 Has anyone seen the above error and/or, Can anyone give me a reason why it's occurring? -- Eric Broch White Horse Technical Consulting (WHTC)

1 0

Re: Bug in dovecot 2.3 virtual plugin
by Jakob Schürz 05 Jan '18

05 Jan '18

So hello back again! Am 05.01.2018 um 14:31 schrieb Jakobus Schürz: > > > Am 05.01.2018 um 10:25 schrieb Aki Tuomi: >> This is a different bug, and I suspect it might be caused by virtual >> plugin. We'll look into it. >> >> Aki > > It was a problem with selfhealing the index... I deleted all my emails and mailboxes and rebuild the tree of mailboxes again with doveadm. Then i put back email for email from the cur-folders from backup to the new-folders in the rebuild mailboxes. From the filename i cut of the part with hostname and size and flags. The archive now is in a separate namespace, because there are really a lot of emails in. Now it works great again (exept one error, i posted before) Maybe you can find something to improve dovecot in selfhealing broken index. Thanks for the great work on this server! jakob

1 0

Released Pigeonhole v0.5.0.1 for Dovecot v2.3.0.
by Stephan Bosch 05 Jan '18

05 Jan '18

Hello Dovecot users, This is a bugfix release to mend some problems that were found in v0.5.0. The imap4flags bug is actually not first seen in the 0.5.0 release (it is ancient), but I included the fix for it anyway. Changelog v0.5.0.1: - imap4flags extension: Fix binary corruption occurring when setflag/addflag/removeflag flag-list is a variable. - sieve-extprograms plugin: Fix segfault occurring when used in IMAPSieve context. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.0.1.… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.0.1.… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

2 1

Dovecot 2.3 - using doveadm as non-root?
by Rob Hoelz 04 Jan '18

04 Jan '18

Hi dovecot developers and users, I recently upgraded my server running Arch Linux to dovecot 2.3.0, and I noticed some of my cron jobs started issuing me error messages. These cron jobs run as a non-root user associated with my mail account, and they use doveadm to tidy things up (ex. purging the trash, moving old mail in certain folders into the trash). The error message is: > Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: > Permission denied I assume this is doveadm trying to participate in the new 2.3 stats process, and after reading the code a bit, I can't see way to tell doveadm to not connect to the stats writer. The socket is owned by root with 600 permissions. What would be the right way to remedy this? AFAICT, I could potentially run doveadm as root (which I would prefer to avoid), or I could change the permissions on the stats writer socket, but I would hate to introduce any sort of security vulnerability by doing so. I currently have a scrappy Perl script that just runs doveadm and filters out the error message (it doesn't seem to affect the behavior of doveadm other than the message), but that feels dirty and I would prefer a cleaner solution. Any advice? Thanks, Rob

3 2

sieve/internal error/detail subaddress and IMAP4FLAGS.
by Larry Rosenman 04 Jan '18

04 Jan '18

I'm trying to set an IMAP Flag with the detail part of an address, but getting an internal error: an 3 13:37:27 thebighonker exim[537]: 1eWoqt-00008f-4u <= ler(a)lerctr.org H=(lrosenman.local) [74.203.163.58]:4650 I=[192.147.25.65]:587 P=esmtpsa X=TLSv1.2:ECDHE-RSA-AES256-GCM-SHA3 84:256 CV=no SNI="smtp.lerctr.org" A=dovecot_login:ler S=769 id=20180103193716.oofszdaxopnkgfvd(a)lrosenman.local Jan 3 13:37:27 thebighonker dovecot: lmtp(549): Connect from local Jan 3 13:37:27 thebighonker dovecot: lmtp(ler(a)lerctr.org/549): save: box=INBOX, uid=127797, msgid=<20180103193716.oofszdaxopnkgfvd(a)lrosenman.local>, size=1033, vsize=1062, from=Larry Rosenman <ler(a)lerctr.org>, subject=testd, flags=() Jan 3 13:37:27 thebighonker dovecot: lmtp(ler(a)lerctr.org/549): sieve: msgid=<20180103193716.oofszdaxopnkgfvd(a)lrosenman.local>: stored mail into mailbox 'INBOX' (subject=testd from=le r(a)lerctr.org size=1062) Jan 3 13:37:27 thebighonker dovecot: lmtp(ler(a)lerctr.org/549): Error: sieve: !!BUG!!: Binary compiled from /home/ler/.dovecot.sieve is still corrupt; bailing out and reverting to def ault delivery Jan 3 13:37:27 thebighonker dovecot: lmtp(549): Disconnect from local: Client has quit the connection (state = READY) Jan 3 13:37:27 thebighonker exim[545]: 1eWoqt-00008f-4u == ler_testd(a)lerctr.org R=localuser T=dovecot_lmtp defer (-46): LMTP error after end of data: 451 4.2.0 <ler_testd(a)lerctr.org> BUG: Unknown internal error Jan 3 13:37:27 thebighonker dovecot: indexer-worker(ler(a)lerctr.org/536): Indexed 1 messages in INBOX (UIDs 127797..127797) .dovecot.sieve points to master.sieve (below), and the rest of the scripts (including master.sieve) are at http://www.lerctr.org/~ler/sieve. require ["fileinto","imap4flags","include","mailbox", "envelope","subaddress","variables"]; require "vnd.dovecot.debug"; global "MyFlags"; if envelope :detail "to" "freebsd" { addflag "FreeBSD"; addflag "MyFlags" "FreeBSD"; } if envelope :matches :detail "to" "*" { set "detail" "${1}"; addflag "${detail}"; addflag "MyFlags" "${detail}"; } debug_log "MyFlags=${MyFlags}, detail=${detail}"; include :personal "spam"; include :personal "freebsd"; include :personal "postgresql"; include :personal "misc"; include :personal "mailinglist"; Doveconf -n: # 2.3.0 (c8b89eb): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0 (d68c23a1) # OS: FreeBSD 11.1-STABLE amd64 auth_mechanisms = plain login auth_realms = lerctr.org thebighonker.lerctr.org tbh.lerctr.org thejonesonair.com thejonesonair.net default_vsz_limit = 1 G deliver_log_format = msgid=%m: %$ (subject=%s from=%f size=%w) doveadm_password = # hidden, use -P to show it first_valid_gid = 0 first_valid_uid = 0 lda_mailbox_autocreate = yes listen = 192.147.25.65, :: login_access_sockets = tcpwrap mail_attribute_dict = file:%h/mail/.imap/dovecot-mail-attributes mail_location = mbox:~/mail:INBOX=~/mail/INBOX mail_log_prefix = "%s(%u/%p): " mail_plugins = " fts fts_solr notify virtual" mail_privileged_group = mail mail_server_admin = mailto:ler@lerctr.org mail_server_comment = LERCTR Mail Server managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds editheader mboxmetadata servermetadata vnd.dovecot.debug imapsieve vnd.dovecot.imapsieve namespace archive { hidden = no list = no location = mbox:~/MAIL-ARCHIVE prefix = ARCHIVE/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox INBOX { auto = create } mailbox SENT { special_use = \Sent } mailbox SPAM { special_use = \Junk } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox virtual/Flagged { special_use = \Flagged } mailbox virtual/all { special_use = \All } prefix = separator = / } namespace virtual { hidden = no list = yes location = virtual:~/MAIL-VIRTUAL:INDEX=MEMORY prefix = Virtual/ separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = user=%Ln noauthenticate driver = static skip = authenticated } passdb { args = failure_show_msg=yes session=yes max_requests=20 driver = pam skip = authenticated } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://thebighonker.lerctr.org:8983/solr/dovecot/ fts_tika = http://localhost:9998/tika/ imapsieve_mailbox1_before = file:/usr/local/share/dovecot-pigeonhole/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = SPAM imapsieve_mailbox2_before = file:/usr/local/share/dovecot-pigeonhole/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = SPAM imapsieve_mailbox2_name = * imapsieve_url = sieve://thebighonker.lerctr.org mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size from subject vsize flags recipient_delimiter = +-_ sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /usr/local/share/dovecot-pigeonhole/sieve sieve_extensions = +editheader +vacation-seconds +mboxmetadata +servermetadata +vnd.dovecot.debug sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_bin_dir = /usr/local/share/dovecot-pigeonhole/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap pop3 lmtp sieve recipient_delimiter = +-_ service anvil { unix_listener anvil { group = mail mode = 0660 } } service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { mode = 0666 } } service doveadm { inet_listener http { port = 8080 ssl = yes } } service indexer-worker { drop_priv_before_exec = yes } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service stats { unix_listener stats-reader { group = mail mode = 0660 user = } unix_listener stats-writer { group = mail mode = 0660 user = } } service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } ssl_cert = </home/ler/letsencrypt-home/lerctr.org/fullchain.cer ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+AESGCM:EECDH:EDH+AESGCM:EDH+aRSA:HIGH:!MEDIUM:!LOW:!aNULL:!eNULL:!LOW:!RC4:!MD5:!EXP:!PSK:!SRP:!DSS ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = username_format=%Ln /etc/passwd driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = " fts fts_solr notify virtual sieve mail_log" } protocol lda { mail_plugins = " fts fts_solr notify virtual sieve mail_log" } protocol pop3 { mail_plugins = " fts fts_solr notify virtual mail_log" } protocol !doveadm { mail_plugins = " fts fts_solr notify virtual mail_log" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags imap_logout_format = in=%i out=%o fhc=%{fetch_hdr_count} fhb=%{fetch_hdr_bytes} fbc=%{fetch_body_count} fbb=%{fetch_body_bytes} del=%{deleted} exp=%{expunged} trash=%{trashed} imap_metadata = yes mail_max_userip_connections = 50 mail_plugins = " fts fts_solr notify virtual mail_log imap_sieve" } -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106

2 2

Re: dovecot v2.3.0: imap segfault when sieve_extprograms_plugin.so called
by Daniel Kenzelmann 04 Jan '18

04 Jan '18

That's the point, the fix was committed afterwards... https://github.com/dovecot/pigeonhole/commit/321a39be974deb2e7eff7b2a50 9a3ee6ff2e5ae1 So, any 0.5.1 release on the horizon? Thanks, Daniel Am Mittwoch, den 03.01.2018, 22:14 +0200 schrieb Aki Tuomi: > pigeonhole 0.5.0 has been already released... > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Daniel Kenzelmann <dovecot.org(a)k8n.de> > Date: 03/01/2018 21:31 (GMT+02:00) > To: Rhys Williams <lux+mailinglists(a)melted.me>, dovecot(a)dovecot.org > Subject: Re: dovecot v2.3.0: imap segfault when > sieve_extprograms_plugin.so called > > Hi, > > see the following thread: > > https://www.dovecot.org/pipermail/dovecot/2017-December/110448.html > > We need to wait for an updated pigeonhole/dovecot... :-( > > Is there maybe some ETA for an updated release? (just wondering if it > makes sense to create an updated ebuild with the patch for gentoo) > > -Daniel > > > Am Mittwoch, den 03.01.2018, 18:12 +0000 schrieb Rhys Williams: > > Hi, > > > > I have recently upgraded to dovecot v2.3 on Ubuntu 16.04.3 from > > repo.dovecot.org and I switched to IMAPSieve for rspamd with the > > guide from the wiki. When a mail is moved from Junk to another > Inbox > > or vice-versa imap segfaults. > > > > I have posted debug logs and versions below, any help will be > greatly > > appreciated. > > > > Thanks, > > Rhys Williams > > > > lux@bifrost:~$ dovecot --version > > 2.3.0 (c8b89eb) > > > > lux@bifrost:~$ uname -a > > Linux bifrost 4.10.0-43-generic #47~16.04.1-Ubuntu SMP Wed Dec 13 > > 19:23:27 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux > > > > Log of the crash: https://paste.ubuntu.com/26314370/ (https://paste > .u > > buntu.com/26314370/) > > Core dump: https://paste.ubuntu.com/26314349/ (https://paste.ubuntu > .c > > om/26314349/) > > dovecot -n: https://paste.ubuntu.com/26314365/ (https://paste.ubunt > u. > > com/26314365/)

2 1

Dovecot auth SASL for exim and plain auth issue without initial response
by Daniel Kenzelmann 04 Jan '18

04 Jan '18

Hi, I'm not entirely sure whether this issue is with exim or with dovecot. First some background: I'm using exim with dovecot-auth which in turn is using LDAP for authentication. When using AUTH PLAIN with the optional initial response argument, everything is fine. However when using AUTH PLAIN without the optional response argument, instead of getting an empty challenge ("334 ") as per RFC i am getting a "535 Incorrect authentication data". Example: Working: 220 XXXX ESMTP 2018-01-02 22:32:33+0100 EHLO test 250-XXXX Hello XXXXX [x.x.x.x] 250-SIZE 52428800 250-8BITMIME 250-PIPELINING 250-AUTH PLAIN LOGIN 250-CHUNKING 250 HELP AUTH PLAIN XXXXXXXXXXXXXXXXXXXXXXXX== 235 Authentication succeeded NOT-WORKING: 220 XXXX ESMTP 2018-01-02 22:34:37+0100 EHLO test 250-XXXX Hello XXXXX [x.x.x.x] 250-SIZE 52428800 250-8BITMIME 250-PIPELINING 250-AUTH PLAIN LOGIN 250-CHUNKING 250 HELP AUTH PLAIN 535 Incorrect authentication data Here the SASL mechanism should return an empty challenge as per RFC (i.e. "334 " in SMTP): RFC 4954 - SMTP Service Extension for Authentication 4. The AUTH Command [..] The optional initial response argument to the AUTH command is used to save a round-trip when using authentication mechanisms that support an initial client response. ====> If the initial ====> response argument is omitted and the chosen mechanism requires ====> an initial client response, the server MUST proceed as defined ====> in Section 5.1 of [SASL]. In SMTP, a server challenge that ====> contains no data is defined as a 334 reply with no text part. ====> Note that there is still a space following the reply code, so ====> the complete response line is "334 ". [..] RFC 4422 - Simple Authentication and Security Layer (SASL) 5. Mechanism Requirements SASL mechanism specifications MUST supply the following information: 1) The name of the mechanism (see Section 3.1). This name MUST be registered as discussed in Section 7.1. 2) A definition of the server-challenges and client-responses of the authentication exchange, as well as the following: a) An indication of whether the mechanism is client-first, variable, or server-first. ===> If a SASL mechanism is defined as ===> client-first and the client does not send an initial response ===> in the authentication request, then the first server challenge ===> MUST be empty (the EXTERNAL mechanism is an example of this case). If a SASL mechanism is defined as variable, then the specification needs to state how the server behaves when the initial client response in the authentication request is omitted (the DIGEST-MD5 mechanism [DIGEST-MD5] is an example of this case). If a SASL mechanism is defined as server-first, then the client MUST NOT send an initial client response in the authentication request (the CRAM-MD5 mechanism [CRAM-MD5] is an example of this case). Thanks, Daniel

2 5

Dovecot panic for one user after upgrading
by Owen B. Mehegan 04 Jan '18

04 Jan '18

The EC2 instance that I run Dovecot on (personal mail server) was forcibly "retired" yesterday, and as a result I ended up rebuilding from backups. In the process I switched from Ubuntu Precise to Ubuntu Xenial (12.04 to 16.04), and this in turn caused me to upgrade Dovecot from 2.0.19 to 2.0.22. Now, although accessing mail seems to work OK using my various clients, I am seeing these errors in my logs: Jan 3 05:56:58 -- dovecot: imap(owen): Panic: file mail-index-sync-keywords.c: line 227 (keywords_update_records): assertion failed: (data_offset >= sizeof(struct mail_index_record)) Jan 3 05:56:58 -- dovecot: imap(owen): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x7aee2) [0x7fe9c08dbee2] -> /usr/lib/dovecot/libdovecot.so.0(+0x7afcd) [0x7fe9c08dbfcd] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fe9c0880a61] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_keywords+0x828) [0x7fe9c0c1fdd8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xef) [0x7fe9c0c2079f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x238) [0x7fe9c0c21758] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x71) [0x7fe9c0c18de1] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xd28fd) [0x7fe9c0c2e8fd] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xd2f03) [0x7fe9c0c2ef03] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0x78) [0x7fe9c0c2efe8] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x92) [0x7fe9c0c08042] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5e8d2) [0x7fe9c0bba8d2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5e9b8) [0x7fe9c0bba9b8] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x37b86) [0x7fe9c0b93b86] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7fe9c0b93d00] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x20) [0x7fe9c0c073b0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x37) [0x7fe9c0b940e7] -> dovecot/imap(imap_status_get+0x77) [0x55d3b4c3f977] -> dovecot/imap(cmd_status+0x1a9) [0x55d3b4c32969] -> dovecot/imap(command_exec+0x9c) [0x55d3b4c3806c] -> dovecot/imap(+0x193e2) [0x55d3b4c363e2] -> dovecot/imap(+0x1946c) [0x55d3b4c3646c] -> dovecot/imap(client_handle_input+0x165) [0x55d3b4c36825] -> dovecot/imap(client_input+0x82) [0x55d3b4c36db2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fe9c08efc6c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7fe9c08f1101] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fe9c08efcf5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fe9c08efe98] Jan 3 05:56:59 -- dovecot: imap(owen): Fatal: master: service(imap): child 18289 killed with signal 6 (core dumped) I have deleted the dovecot.* files in the Maildir for all users (did this while Dovecot was stopped, then started it again), but the errors persist. They are especially frequent for one particular user. I can't figure out where the core file is, it doesn't seem to be in my home or in /var/run/dovecot Here's my dovecot -n output: # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-1043-aws x86_64 Ubuntu 16.04.3 LTS mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/letsencrypt/live/mydomain/cert.pem ssl_key = </etc/letsencrypt/live/mydomain/privkey.pem userdb { driver = passwd } Thanks in advance for any support you can offer!

2 2

dovecot v2.3.0: imap segfault when sieve_extprograms_plugin.so called
by Rhys Williams 03 Jan '18

03 Jan '18

Hi, I have recently upgraded to dovecot v2.3 on Ubuntu 16.04.3 from repo.dovecot.org and I switched to IMAPSieve for rspamd with the guide from the wiki. When a mail is moved from Junk to another Inbox or vice-versa imap segfaults. I have posted debug logs and versions below, any help will be greatly appreciated. Thanks, Rhys Williams lux@bifrost:~$ dovecot --version 2.3.0 (c8b89eb) lux@bifrost:~$ uname -a Linux bifrost 4.10.0-43-generic #47~16.04.1-Ubuntu SMP Wed Dec 13 19:23:27 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Log of the crash: https://paste.ubuntu.com/26314370/ (https://paste.ubuntu.com/26314370/) Core dump: https://paste.ubuntu.com/26314349/ (https://paste.ubuntu.com/26314349/) dovecot -n: https://paste.ubuntu.com/26314365/ (https://paste.ubuntu.com/26314365/)

3 3

Problem with master password
by Harald Leithner 03 Jan '18

03 Jan '18

Hi, I have a problem using the master password feature of dovecot. I'm able to login with the password but then dovecot can't select the INBOX. IMAP test: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=SCRAM-SHA-1 AUTH=CRAM-MD5] ITronic Mail Store a login user(a)itronic.at*admin password a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE NOTIFY QUOTA ACL RIGHTS=texk] Logged in a list "" "%" * LIST (\HasNoChildren) "/" INBOX a OK List completed (0.003 + 0.000 + 0.003 secs). a select INBOX a NO [SERVERBUG] Internal error occurred. Refer to server log for more information. [2017-12-28 12:32:41] (0.001 + 0.000 secs). The log with mail debuging doesn't tell me much: 2017-12-28T12:24:47+01:00 mailstore1 dovecot: imap(user(a)itronic.at): Debug: INBOX: Mailbox opened because: SELECT 2017-12-28T12:24:47+01:00 mailstore1 dovecot: imap(user(a)itronic.at): Debug: acl vfile: file /srv/storage1/vmail/itronic/6/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found 2017-12-28T12:24:47+01:00 mailstore1 dovecot: imap(user(a)itronic.at): Debug: acl vfile: file /srv/storage1/vmail/itronic/6/mdbox/mailboxes/dovecot-acl not found 2017-12-28T12:24:47+01:00 mailstore1 dovecot: imap(user(a)itronic.at): Debug: Namespace : Using permissions from /srv/storage1/vmail/itronic/6/mdbox: mode=0700 gid=default 2017-12-28T12:24:47+01:00 mailstore1 dovecot: imap(user(a)itronic.at): Error: Opening INBOX failed: Mailbox doesn't exist: INBOX If I use the password of the user it works without problems, I also tested other users, they have the same problem. dovecot -n # 2.2.devel (5af0c9f): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (6c95b56) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.10 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore1(a)itronic.at imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins imap_logout_format = bytes=%i/%o instance_name = mailstore1 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = x.y.z.0/24 mail_attachment_dir = /srv/storage1/vmail_sis mail_attachment_hash = %{sha512} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 5 mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib lazy_expunge stats acl quota mail_log notify mail_prefetch_count = 100 mail_server_admin = mailto:postmaster@itronic.at mail_server_comment = ITronic Mail System mail_shared_explicit_inbox = yes mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:~/mdbox:MAILBOXDIR=expunged:LISTINDEX=expunged.list.index prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = last-login/%u lazy_expunge = "#EXPUNGED/" lazy_expunge_only_last_instance = no mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid size flags vsize from subject quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+1024M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = file:/srv/storage1/vmail/%{userdb:accountToken}/ sieve_extensions = +vacation-seconds sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M sieve_vacation_default_period = 1d sieve_vacation_min_period = 1h stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = x.y.z.135 port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = </etc/dovecot/private/STAR.itronic.at.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 submission_host = x.y.z.198 syslog_facility = local0 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = /srv/storage1/vmail verbose_proctitle = yes protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib lazy_expunge stats imap_stats quota imap_quota acl imap_acl last_login mail_log notify } protocol lda { mail_plugins = zlib lazy_expunge stats acl sieve quota mail_log notify } protocol lmtp { mail_plugins = zlib lazy_expunge stats acl sieve quota mail_log notify } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib lazy_expunge stats acl last_login mail_log notify } ----- I would be happy for any debugging help. thx -- Harald Leithner ITronic Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner(a)itronic.at | itronic.at

2 2

sieve - Failed to store into mailbox 'INBOX/${1}': Mailbox doesn't exist: INBOX/${1}
by Ludovic Terrier 02 Jan '18

02 Jan '18

Hello, First of all, happy new year! I’ve recently configured my mail server and was using a simple sieve rule in order to store all my ‘user+pattern(a)example.xn--com-to0a ingoing email to be stored in the INBOX/pattern folder. This setup worked very well. I restarted my server this morning (don’t know if it’s related…) and since Dovecot keep storing my emails in INBOX with following errors: root@server:~# cat /var/mail/vhosts/example.com/ludovic/.dovecot.sieve.log sieve: info: started log at Jan 01 12:13:56. error: msgid=<20180101111353.C332C25386(a)server.example.com>: failed to store into mailbox 'INBOX/${1}': Mailbox doesn't exist: INBOX/${1}. Sieve script: root@server:~# cat /var/mail/vhosts/example.com/ludovic/sieve/roundcube.sieve require ["envelope","fileinto","subaddress"]; if header :contains "X-Spam-Flag" "YES" { fileinto "Junk"; } if envelope :detail :matches "to" "*" { fileinto "INBOX/${1}"; } # rule:[contact] if allof (header :contains "to" "contact(a)example.com") { fileinto "INBOX/contact"; stop; } I don’t remember having made recent change in my Dovecot config… only adding the last rule in the sieve script. Any hint? Thanks. Please find below more info of my Dovecot setup (quite long). Is it better to use some pastebin for such long info? Regards, ----------------------------------------------------------------------------------------------------------------------------------------------------------------- Info (version and dovecot -n): root@server:~# dovecot --version 2.2.27 (c0f36b0) root@helios:~# dovecot -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) doveconf: Warning: service auth { client_limit=1000 } is lower than required under max. load (1524) # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.3 auth_cache_size = 10 M auth_username_format = %Ln first_valid_uid = 999 imap_idle_notify_interval = 29 mins last_valid_uid = 999 mail_attachment_dir = /var/mail/attachments mail_attachment_min_size = 64 k mail_fsync = never mail_home = /var/mail/vhosts/%d/%n mail_location = mdbox:~/mdbox mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = create special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve-after.d sieve_before = /usr/local/etc/dovecot/sieve-before.d sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 50M } protocols = " imap lmtp sieve sieve" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1, ::1 } process_min_avail = 2 service_count = 0 vsz_limit = 1 G } service imap { process_min_avail = 2 service_count = 256 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/pem/server.example.com.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv3 !TLSv1 !TLSv1.1 TLSv1.2 userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_fsync = optimized mail_plugins = " sieve" } protocol lda { mail_fsync = optimized mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " imap_sieve » } ----------------------------------------------------------------------------------------------------------------------------------------------------------------- — Ludovic

2 2