November 2014 - dovecot

v2.2.14 released
by Timo Sirainen 26 Nov '14

26 Nov '14

http://dovecot.org/releases/2.2/dovecot-2.2.14.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.14.tar.gz.sig Looks like it took a bit longer to make this release after RC1 than I thought. I'm now in San Jose area for a few months and still jumping between apartments and trying to adjust to the new timezone. Some of the more important fixes since RC1: - Fixed several race conditions with dovecot.index.cache handling that may have caused unnecessary "cache is corrupted" errors. - auth: If auth client listed userdb and disconnected before finishing, the auth worker process got stuck (and eventually all workers could get used up and requests would start failing). Some of the larger changes since v2.2.13: * lmtp: Delivered-To: header no longer contains <> around the email address. Other MDAs don't have it either. * "Out of disk space" errors are now treated as temporary errors (not the same as "Out of disk quota"). * replication plugin: Use replication only for users who have a non-empty mail_replica setting. + lmtp proxy: Log a line about each mail delivery. + Added login_source_ips setting. This can be used to set the source IP address round-robin from a pool of IPs (in case you run out of TCP ports). + Rawlog settings can use tcp:<host>:<port> as the path. + virtual plugin: Don't keep more than virtual_max_open_mailboxes (default 64) number of backend mailboxes open. + SSL/TLS compression can be disabled with ssl_options=no_compression + acl: Global ACL file now supports "quotes" around patterns. + Added last-login plugin to set user's last-login timestamp on login. + LDAP auth: Allow passdb credentials lookup also with auth_bind=yes - IMAP: MODSEQ was sent in FETCH reply even if CONDSTORE/QRESYNC wasn't enabled. This broke at least old Outlooks. - passdb static treated missing password field the same as an empty password field. - mdbox: Fixed potential infinite looping when scanning a broken mdbox file. - imap-login, pop3-login: Fixed potential crashes when client disconnected unexpectedly. - imap proxy: The connection was hanging in some usage patterns. This mainly affected older Outlooks. - lmtp proxy: The proxy sometimes delivered empty mails in error situations or potentially delivered truncated mails. - fts-lucene: If whitespace_chars was set, we may have ended up indexing some garbage words, growing the index size unnecessarily. - -c and -i parameters for dovecot/doveadm commands were ignored if the config socket was readable. - quota: Quota recalculation didn't include INBOX in some setups. - Mail headers were sometimes added to dovecot.index.cache in wrong order. The main problem this caused was with dsync+imapc incremental syncing when the second sync thought the local mailbox had changed. - doveadm backup didn't notice if emails were missing from the middle of the destination mailbox. Now it deletes and resyncs the mailbox.

7 8

Message is missing GUID
by Ralf Hildebrandt 25 Nov '14

25 Nov '14

# doveadm force-resync -u username inbox doveadm(username): Warning: fscking index file /srv/vmail/04/05/14331/mdbox/storage/dovecot.map.index doveadm(username): Warning: mdbox /srv/vmail/04/05/14331/mdbox/storage: rebuilding indexes doveadm(username): Error: Corrupted dbox file /srv/vmail/04/05/14331/mdbox/storage/m.122 (around offset=10056504): Message is missing GUID doveadm(username): Error: mdbox rebuild: Failed to fix file /srv/vmail/04/05/14331/mdbox/storage/m.122 Can I fix this somehow? % doveadm fetch -u username body ALL > /dev/null % doveadm fetch -u ulli.achter(a)posteo.de GUID ALL > /dev/null Don't throw errors! -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

Re: failed login message
by 24x7server＠24x7server.net 25 Nov '14

25 Nov '14

thanks for your reply i intentionaly put the wrong password and checked the dovecot log and the message i got was # tail -f /var/log/dovecot.log | grep "xxx(a)yyy.com" Nov 25 08:47:46 imap-login: Info: Aborted login (auth failed, 1 attempts in 2 secs): user=<xxx(a)yyy.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured, session=<xObTWqYIwgB/AAAB> but in the squirrelmail login page instead of the message "unknown user or password incorrect" i get the message ERROR: Connection dropped by IMAP server. Query: LOGOUT in my old server where it is working correctly dovecot logs shows the error Nov 25 14:46:12 imap-login: Info: Aborted login (auth failed, 1 attempts): user=<"xxx(a)yyy.com">, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured and squirrelmail gives the error : "unknown user or password incorrect" which is correct. is there any other place i need to check or some other config file (either squirrelmail or dovecot) that i need to modify could you kindly guide me rajesh ----- Original Message ----- From: Robert Schetterer [mailto:rs@sys4.de] To: dovecot(a)dovecot.org Sent: Sun, 23 Nov 2014 17:21:29 +0100 Subject: Re: failed login message Am 23.11.2014 um 17:14 schrieb Rajesh M.: > hi > > i am using dovecot for pop3 and imap along with qmail toaster > > i had recently changed over from a 32 bit system to a 64 bit system. > > i use squirrelmail. > > the issue i face is that when the user inserts an invalid password then the message he gets is connection dropped by imap server (instead of invalid userid or password) > > such a message confuses the user. > > my earlier 32 bit version used to give the correct message > > i am posting this issue here because i am not sure if this is squirrelmail issue or a dovecot issue. > > can somebody please let me know the reason for this ? > > rajesh > yes , you may ask some magic bubble, or post your configs and related logs Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

2 1

Possible to adjust username used to determine the proxy destination?
by Andy Dills 25 Nov '14

25 Nov '14

I'm in a fairly standard cluster environment: shared storage, bunch of servers each acting as both proxies and backends. We do /bin/checkpassword authentication, allowing a great deal of flexibility...protection against brute force, billing mechanisms, but relevant to this issue, I have it set up to allow users to login with either their username (if they are in one of our default domains) or their email address. I'm realizing now that as a consequence of this, "joe" and "joe(a)xecu.net" are unique as far as dovecot is concerned. Users who login with just their username (and not the full email address) can get assigned to a different backend server than when they login with the full email address (which would also include LMTP deliveries). This has been happening for years, a few broken indexes here and there that seem to resolve themselves, so it hasn't been impacting the service, but I'd like to correct it properly. Is there a way to manipulate this? For example, if I moved the authentication to the proxy layer (it's currently proxy=y nopassword=y), and set $ENV{USER} to the full email address, will director use that for selection instead of the user-supplied username? I'm open to suggestions on how best to accomplish this. Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

3 2

doveadm backup for all users to file system
by Jeff Larsen 24 Nov '14

24 Nov '14

The wiki says that doveadm backup supports the -A option for all users, but when I specify a file-system destination (like /tmp, or an NFS mounted folder), it just rewrites each user backup to the same location overwriting the previous user's content. You end up with just the content for the last user processed. I tried the typical %u substitution but that just created folder named '%u' and had the same overwrite problem. My userdb is LDAP which works just fine for other doveadm commands. The verbose/debug output from doveadm backup shows that it is processing every user. Example: doveadm -vD backup -A sdbox:/tmp/backup My understanding is that "doveadm backup" is just a front-end for dsync. The dsync manpage on the other hand says "dsync can currently sync only one user at a time. If you want to dsync all users, you'll need to get a list of all users and execute dsync separately..." It appears that "doveadm backup -A" is doing the iteration for me, but it's not generating individual destination paths for each user. So, is this is a documentation problem for "doveadm backup"? Or am I missing something here? Is there some secret sauce for "doveadm backup -A" that I'm not finding? If all else fails, I know I can write a script to iterate over the available users and run the backup repeatedly, but I would like to keep this as simple as possible. Thanks, Jeff

1 0

Replication warnings
by Jan Behrend 24 Nov '14

24 Nov '14

Hi list, I get these warnings quite frequently. Warning: Failed to do incremental sync for mailbox INBOX, retry with a full sync Is this something to worry about? Otherwise the replication works perfectly. Cheers Jan -- MAX-PLANCK-INSTITUT fuer Radioastronomie Jan Behrend - Rechenzentrum ---------------------------------------- Auf dem Huegel 69, D-53121 Bonn Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 jbehrend(a)mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de

2 1

Outlook 2010 not connecting to secure POP3
by Robert Moskowitz 24 Nov '14

24 Nov '14

OK, I did not know that this user has a new computer with Outlook 2010. This SHOULD make it easier but... I have the computer right next to me, they brought it over. It is on the same LAN as this notebook. I can access my server with: openssl s_client -connect z9m9z.htt-consult.com:995 And then log the user in with the appropriate POP3 credentials. In Outlook 2010, in Advanced settings I have specified "This server requires an encrypted connection (SSL)" and it switches to port 995 (from 110). I try connecting and I get an error that "Your server does notg support the connection encryption type you have specified." The first time we tried this it installed my self-signed cert in the local cert store. Any idea on what is going on or how to get this working?

4 14

Strange repplication issues
by Bertrand Caplet 24 Nov '14

24 Nov '14

Hi, I know there are lots of questions about replication, but I searched and didn't find my question. I've got some problems with syncing. I've got 2 servers: A and B When a email arrives on server A sometimes it's not syncing in server B I think server A doesn't always notify server B there are new mails to sync. But I don't know how to fix it. And I spotted something, when it isn't syncing. The only thing to do is to send local or remote mail to server B and then it sync or do a "doveadm sync -A tcp:serverB.example:port" of course. My doveconf -n of the two servers are in attachements bellow. By the way both of my dovecot servers are v2.2.9 P.S.: I didn't test from server B to A but I think it's the same problem. Thanks in advance, Regards. -- CHUNKZ.NET - casual fiddler and computer technician Bertrand Caplet, Flers (FR) Feel free to send encrypted/signed messages Key ID: FF395BD9 GPG FP: DE10 73FD 17EB 5544 A491 B385 1EDA 35DC FF39 5BD9

2 2

failed login message
by Rajesh M. 23 Nov '14

23 Nov '14

hi i am using dovecot for pop3 and imap along with qmail toaster i had recently changed over from a 32 bit system to a 64 bit system. i use squirrelmail. the issue i face is that when the user inserts an invalid password then the message he gets is connection dropped by imap server (instead of invalid userid or password) such a message confuses the user. my earlier 32 bit version used to give the correct message i am posting this issue here because i am not sure if this is squirrelmail issue or a dovecot issue. can somebody please let me know the reason for this ? rajesh

2 1

Migrate Separator and prefix
by Hanns Mattes 23 Nov '14

23 Nov '14

Hi, I'm thinking of changing the separator form "." to "/" and also to allow only folders under INBOX, changing the Prefix. I have to dovecot-servers, which are synched by the replication plugin. My idea is to switch off Server B, make the necessary config-changes, delete all user maildirs, restart the server an let replication do it's work. After that (and correcting the sieve-rules of the users if necessary), I'd stop server A, delete, restart, resync. My idea is, that this will avoid dealing with subscriptions files and change them to reflect the new INBOX-Structure. Is this going to work at all and/or is there a better way for the wanted migration? Thanks in advance Hanns

1 1