- dovecot - dovecot.org

Unread Mail flag being reset frequently with dovecot -git master-2.2
by Reuben Farrelly 30 Jun '16

30 Jun '16

Hi again, I'm experiencing problems with the Dovecot git master-2.2 branch, in which mails that have been previously read are randomly appearing as unread. This happens slowly and affects more and more emails the more changes that occur to a mailbox. I am using Maildir format and on Gentoo Linux x86_64 on local disks. Usually only a few at a time change their status - and it seems to be random which ones lose their read status. Typically though they are the most recent emails that have been delivered in the past few months (I haven't yet seen this occur with any really old emails). This problem is MUA independent, it can be observed with Thunderbird as well as Roundcube. If I go in and mark all mails as read then they will show as read for a short while until they too slowly start become 'unread' again. Currently I'm running git rev from https://github.com/dovecot/core/commits/master-2.2 : f292589f4b85e02d97d974dfe34324c6c0bb9d9f (I can't run anything newer due to an SSL symbol error which I reported earlier). This rev: b1254dfe442639236f881afae85e0739520ab409 Is known to be good, so the problem started happening somewhere between these two. (I know there are a lot of in-between revisions, but bisecting that could take days of time). Dovecot config is up at: http://www.reub.net/files/dovecot/thunderstorm-dovecot.conf Rawlog debug files are at http://www.reub.net/files/dovecot/rawlogs/ Hopefully someone else may have seen this happen before. Are there any other debugs I can gather which will help get to the bottom of this? Reuben

2 2

Re[2]: External mail attachments storage cleanup
by Николай Мананков 30 Jun '16

30 Jun '16

Yes "dovecot purge" is certainly my mistake in the script but it really works completely analogous "doveadm purge" probably why I did not notice the difference before :) It looks like it just launches the doveadm in this case. Adding slashes after asterisks unfortunately they also adds to the variable and the script gives an error like "doveadm(user/(a)example.org/): Error: User doesn't exist" Thanks for the idea , I think it will be now more correctly : === #!/bin/sh cd /backup/MailRoot/dovecot/domains || exit 1 for i in * do if [ -d $i ]; then cd $i for j in * do if [ -d $j ]; then dovecot purge -u $j@$i fi done cd .. fi done === >Четверг, 30 июня 2016, 13:53 +03:00 от Alexander Moisseev <moiseev(a)mezonplus.ru>: > >On 30.06.16 12:51, Николай Мананков wrote: >> -----screenshot begin----- >> >> mail:/etc/cron.daily # cat ./dovepurge.sh >> #!/bin/sh >> >> cd /MailRoot/dovecot/domains >> >> for i in * >> do >> cd $i >> for j in *; do dovecot purge -u $j@$i; done >> cd .. >> done >> >> -----screenshot end ----- >> >It might be worth to add slashes after asterisks to process only directories. >Does "dovecot purge" actually work? > >-----screenshot begin----- > >#!/bin/sh > >cd /MailRoot/dovecot/domains || exit 1 > >for i in */ > do > cd $i > for j in */; do doveadm purge -u $j@$i; done > cd .. >done > >-----screenshot end ----- > >> It is strange that the daemon does not do this automatically, and even setting up autoexpunge option does not help. Also IMHO certainly evident mistake in the documentation about the wildcards processing by purge command.. > >I don't know how the developers themselves use Dovecot, but it lacks some obvious features like automatic purge or SIS cleanup on mailbox deletion. >

1 0

Re[2]: External mail attachments storage cleanup
by Николай Мананков 30 Jun '16

30 Jun '16

Yes "dovecot purge" is certainly my mistake in the script but it really works completely analogous "doveadm purge" probably why I did not notice the difference before :) It looks like it just launches the doveadm in this case. Adding slashes after asterisks unfortunately they also adds to the variable and the script gives an error like "doveadm(user/(a)example.org/): Error: User doesn't exist" Thanks for the idea , I think it will be now more correctly : === #!/bin/sh cd /backup/MailRoot/dovecot/domains || exit 1 for i in * do if [ -d $i ]; then cd $i for j in * do if [ -d $j ]; then dovecot purge -u $j@$i fi done cd .. fi done === >Четверг, 30 июня 2016, 13:53 +03:00 от Alexander Moisseev <moiseev(a)mezonplus.ru>: > >On 30.06.16 12:51, Николай Мананков wrote: >> -----screenshot begin----- >> >> mail:/etc/cron.daily # cat ./dovepurge.sh >> #!/bin/sh >> >> cd /MailRoot/dovecot/domains >> >> for i in * >> do >> cd $i >> for j in *; do dovecot purge -u $j@$i; done >> cd .. >> done >> >> -----screenshot end ----- >> >It might be worth to add slashes after asterisks to process only directories. >Does "dovecot purge" actually work? > >-----screenshot begin----- > >#!/bin/sh > >cd /MailRoot/dovecot/domains || exit 1 > >for i in */ > do > cd $i > for j in */; do doveadm purge -u $j@$i; done > cd .. >done > >-----screenshot end ----- > >> It is strange that the daemon does not do this automatically, and even setting up autoexpunge option does not help. Also IMHO certainly evident mistake in the documentation about the wildcards processing by purge command.. > >I don't know how the developers themselves use Dovecot, but it lacks some obvious features like automatic purge or SIS cleanup on mailbox deletion. >

1 0

[patch] Support redis AUTH
by Dave 30 Jun '16

30 Jun '16

A very minor patch to support redis AUTH (for all that's worth) using an extra password= field. I'm not sure if this will be of any value to anyone here. We're testing it in development and "it works for us" but it's yet to be used in anger. Sorry if I'm going about this the wrong way, I tried emailing this directly but heard nothing back; so I'm reposting to the list as I'm honestly not sure what established protocol is regarding code contribution. -- Dave

2 1

filtering ssl_cert
by Russell Stuart 30 Jun '16

30 Jun '16

In dovecot 1 I was able to do something like this: protocol imap { ssl_cert = cert-imap.pem ssl_key = key-imap.pem } local ww.xx.yy.zz { protocol imap { ssl_cert = cert-imap-ww.xx.yy.zz.pem ssl_key = key-imap-ww.xx.yy.zz.pem } } The intent is ww.xx.yy.zz is an externally routable IP address which has a Cert signed by a real CA, other addresses are internal which have a variety of domain names, signed by a self-signed cert. That worked in dovecot 1, but in dovecot 2 I get the error: "Conflict in setting ssl_cert found from filter". Weirdly, this works in dovecot 2: local 0.0.0.0/0 { ssl_cert = cert-imap.pem ssl_key = key-imap.pem } local ww.xx.yy.zz { ssl_cert = cert-imap-ww.xx.yy.zz.pem ssl_key = key-imap-ww.xx.yy.zz.pem } But this doesn't: local 0.0.0.0/0 { protocol imap { ssl_cert = cert-imap.pem ssl_key = key-imap.pem } } local ww.xx.yy.zz { protocol imap { ssl_cert = cert-imap-ww.xx.yy.zz.pem ssl_key = key-imap-ww.xx.yy.zz.pem } } It smells like a bug. Anyway, does anybody know of a way to port my config to dovecot 2?

1 0

External mail attachments storage cleanup
by Николай Мананков 30 Jun '16

30 Jun '16

Hi, I have set up mdbox backend witch saving mail attachments to external files option. Dovecot store attachments to external files but never delete them. Why?

3 4

ltmp, quota and quota grace
by Sylvain Allemand 30 Jun '16

30 Jun '16

Hi, i try to configure quota in dovecot. 1) I test quota with postfix and quota-status : quota is respected but quota grace is ignored... 2) i test quota with Dovecot LMTP : quota (and quota grace) are ignored i can see in log file : Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota root: name=User quota sallemantest(a)test.fr backend=count args= Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota rule: root=User quota sallemantest(a)test.fr mailbox=* bytes=1073741824 messages=0 Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota rule: root=User quota sallemantest(a)test.fr mailbox=Trash bytes=+104857600 messages=0 Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota grace: root=User quota sallemantest(a)test.fr bytes=107374182 (10%) Jun 30 11:36:39 mail1 dovecot: lmtp(sallemantest(a)test.fr): Debug: replication: Replication requested by 'transaction commit', priority=2 Jun 30 11:36:39 mail1 dovecot: lmtp(sallemantest(a)test.fr): /z7gBifodFdoXwAAs3/TQA: msgid=<fdf98d16-c557-4e15-42a6-ea019a3bae1e(a)math.u-bordeaux.fr>: saved mail to INBOX Jun 30 11:36:39 mail1 dovecot: lmtp(24424): Disconnect from 127.0.0.1: Successful quit my quota : root@mail1:~# doveadm -v quota get -u sallemantest(a)test.fr Quota name Type Value Limit % User quota sallemantest(a)test.fr STORAGE 29 10 290 User quota sallemantest(a)test.fr MESSAGE 11 - 0 my config for lmtp and quota : protocol lmtp { mail_plugins = " acl notify replication quota sieve" userdb { args = /etc/dovecot/dovecot-lmtp-ldap-userdb.conf.ext default_fields = uid=vmail gid=vmail driver = ldap name = } } plugin { quota = count:User quota %u quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_vsizes = yes } root@mail1:/etc/dovecot# dovecot --version 2.2.24 (a82c823) Help please ! Sylvain ps : sorry for my poor english

1 0

Error when searching in mailfolders
by Christoph Pleger 30 Jun '16

30 Jun '16

Hello, I just found that with my dovecot 2.2.21, when I use squirrelmail to search for something in my mailfolders, that fails with ERROR: Connection dropped by IMAP server. Query: SEARCH CHARSET ISO-8859-1 ALL FROM "someone" That happens for searches in any folder, except from INBOX. When I search in all folders, only results from INBOX are found, then the error message is shown. The log says: imap: Error: terminate called after throwing an instance of 'CLuceneError' imap(christoph): Fatal: master: service(imap): child 2834 killed with signal 6 (core dumps disabled) What can I do about that? Regards Christoph

3 3

SSL Problem with -git master-2.2 tip (24 June 16)
by Reuben Farrelly 30 Jun '16

30 Jun '16

Current master-2.2 branch of Dovecot compiles for me on Gentoo x86_64 but experiences symbol errors when starting up: Jun 24 08:38:00 thunderstorm dovecot: lmtp(8180): Fatal: Couldn't load required plugin /usr/lib64/dovecot/libssl_iostream_openssl.so: dlopen() failed: /usr/lib64/dovecot/libssl_iostream_openssl.so: undefined symbol: SSL_COMP_free_compression_methods Jun 24 08:38:00 thunderstorm dovecot: master: Error: service(lmtp): command startup failed, throttling for 16 secs I suspect that this is because I have libressl installed on my systems instead of OpenSSL. A known commit point which does not work is: f5e6b05684328b9800ccd973c73027300c832d65 However a few commits earlier this problem does not occur: f292589f4b85e02d97d974dfe34324c6c0bb9d9f Looks like commit bff052bd29dbf7175ee6cd14bd14bcea1900b869 : "lib-dcrypt, lib-ssl-iostream: Share OpenSSL init/deinit code." may have broken the tree for LibreSSL/non OpenSSL users. Reuben

2 5

[patch] Fix for returning NULL values in SQL dict lookups
by NederHost/Sebastiaan Hoogeveen 29 Jun '16

29 Jun '16

Hi, I noticed a bug doing dict lookups on an SQLite database which had NULL values in its columns; a segmentation fault occurred, probably due to a null pointer dereference in str_tabescape. The problem is that sqlite3_column_text returns a null pointer for column values which are (SQL) NULL. It seems the other database drivers do something similar. The following patch makes the dict server check for null pointers and return a 'not found' reply in those cases (I changed the order around in the decision tree to avoid having to repeat return values): diff -Naur dovecot-2.2.24/src/dict/dict-commands.c dovecot-2.2.24-patched/src/dict/dict-commands.c --- dovecot-2.2.24/src/dict/dict-commands.c 2016-04-26 15:01:20.000000000 +0200 +++ dovecot-2.2.24-patched/src/dict/dict-commands.c 2016-05-11 22:04:06.000000000 +0200 @@ -83,14 +83,14 @@ { struct dict_connection_cmd *cmd = context; - if (result->ret > 0) { + if (result->ret > 0 && result->value) { cmd->reply = i_strdup_printf("%c%s\n", DICT_PROTOCOL_REPLY_OK, str_tabescape(result->value)); - } else if (result->ret == 0) { - cmd->reply = i_strdup_printf("%c\n", DICT_PROTOCOL_REPLY_NOTFOUND); - } else { + } else if (result->ret < 0) { i_error("%s", result->error); cmd->reply = i_strdup_printf("%c\n", DICT_PROTOCOL_REPLY_FAIL); + } else { + cmd->reply = i_strdup_printf("%c\n", DICT_PROTOCOL_REPLY_NOTFOUND); } dict_connection_cmds_flush(cmd->conn); } Kind regards, -- Sebastiaan Hoogeveen NederHost https://www.nederhost.nl/ KvK: 34099781

2 1