July 2018 - dovecot - dovecot.org

[Dovecot] quota-status not working in distributed environment
by Benoit Panizzon 30 Jul '18

30 Jul '18

Hello List Quick overview of our set-up: Postfix / Dovecot (2.2.2.1) / MySQL Cluster on (at the moment) three Servers to create a HA environment where you could easily add additional servers as the demand or load grows. Circular dovecot replication is used so each server uses another one as replication partner and allowing one server to fail. Dovecot Proxy Feature being used, so we can use round-robin DNS and each server can forward the connecting user to the correct 'master' for his mailbox. So far, everything works as expected. Now we want to reject emails to 'full' mailboxes during SMTP to prevent backscatter and use the quota-status policy service from within postfix. That works fine, if the mailbox or it's replica is present on the machine where quota-status is called, but it fails if it's run on a machine where neither the mailbox or the replica is present. In our case, we get a correct SMTP 550 'Mailbox Full' Reject in two cases and a LMTP generated bounce in the later case. Also `doveadm quota get -u user(a)example.com` return the correct quota if run on the two machines which have the mailbox and it's copy locale, but return 0% used if run on the other machine. Is there a way to get quota-status to also use the proxy feature to request the quota information from the correct machine? Or is the postfix policy daemon call to the quota-status socket documented somewhere (it must be, but where?) so we could implement it from within the Milter? (we use the sendmail Milter API from postfix to filter spam and viruses, do sender/recipient rewriting, forward bounce matching, rate limmiting, login/IP statistics to block botnets abusing phished addresses and legal intercept stuff anyway) Kind regards Benoit Panizzon -- I m p r o W a r e A G - ______________________________________________________ Zurlindenstrasse 29 Tel +41 61 826 93 07 CH-4133 Pratteln Fax +41 61 826 93 02 Schweiz Web http://www.imp.ch ______________________________________________________

5 6

OT - copied maildir from 2T drive to 4T drive
by Marc Perkel 30 Jul '18

30 Jul '18

And it's taking up more space on the 4T drive. What did I miss?

2 1

[SOLR] Where is solr-schema.xml?
by Peter Nabbefeld 27 Jul '18

27 Jul '18

Hello, running dovecot 2.3.2.1 on Arch Linux, and installed solr 7.4.0. According to the wiki, there should be doc/solr-schema.xml, but I cannot find it. Tried "whereis dovecot": dovecot: /usr/bin/dovecot /usr/lib/dovecot /etc/dovecot /usr/include/dovecot /usr/share/dovecot /usr/share/man/man1/dovecot.1.gz But I cannot find any xml files using find /usr/{lib,share}/dovecot -name "*.xml" Kind regards Peter

4 5

Imap post-login script
by j.emerlik 27 Jul '18

27 Jul '18

Dovecot v.2.2.32 and I have configured two imap post-login scripts and it seems like after successfully login scripts are not closed (dovecot_node/imap imap-postlogin : multiple processes are running still) and after some times there are too many processes and the limit is reached (imap proces_limit 1500): 1) #!/bin/sh case $IP in 10.10.1[1-2][0-7].*) exec "$@" ;; 10.11.2.4[0-9]) exec "$@" ;; esac CHECK_USER=`PGPASSWORD="password" /usr/local/pg952/bin/psql -h 10.11.1.3 -q -t -U postfixuser -d mail -c "select imap_allowed from users where name = '$USER' LIMIT 1"` if [ $CHECK_USER == "t" ] ; then exec "$@" fi if [ $CHECK_USER == "f" ] ; then exit 0 fi 2) PGPASSWORD="password" /usr/local/pg952/bin/psql -U postfixuser -d mail2 -h 10.11.1.3 -c "select last_auth('$USER','$RIP2','1')" > /dev/null exec "$@" Regards, Jack

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 26 Jul '18

26 Jul '18

Hi There! I run into this problem with virtual Mailboxes on release-2.3.2 (and also in master and in older versions of dovecot) I added the core-file. Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7ffad9ac0eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffad9a2efe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7ffad9bbb1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7ffad9792b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7ffad9792d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7ffad9795f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b4602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b460 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): child 11292 killed with signal 6 (core dumped) Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: AUTH 19 PLAIN service=imap secured=tls session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 20 lport=143 rport=41758 local_name=aldebaran.xundeenergie.at ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: CONT 19 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: CONT<hidden> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: OK 19 user=jakob Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: REQUEST 2436366337 10570 19 dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 request_auth_token Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb out: USER 2436366337 jakob home=/var/mail/jakob acl_groups=home,admin auth_token=3ea3b630e131 3bf5beb0f26ff740450189f63e3e Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, mpid=11298, TLS, session=<9KKNZclxHqPAqADc> Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7fbd982b2eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbd98220fe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fbd983ad1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7fbd97f84b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7fbd97f84d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7fbd97f87f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa6602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd98411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa660 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] Jul 25 04:11:30 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): child 11298 killed with signal 6 (core dumped) jakob

4 12

doveadm who reverse dns lookups
by Michael Grant 25 Jul '18

25 Jul '18

Perhaps this is a feature request... It would be nice if the ‘doveadm who’ command printed out the reverse dns name of where the user was logged in from. Would it be possible to either add some option to doveadm who for this, or make it the do it by default and add a ‘-n’ option (like many of the other programs that look up ip addresses by default) and take a -n option to not do that? Not sure if that would break some existing thing which is why I hesitate. Might be safer to add, say, a -r option to do the rDNS lookup. However, it would definitely save me a step in figuring out where someone was logged in from to know if it’s legit. Michael Grant

3 2

Re: doveadm expunge didn't clear Trash mailbox
by Joseph Tam 25 Jul '18

25 Jul '18

On Mon, 23 Jul 2018, Michael Wagner wrote: > here works a dovecot 2.2.27 on a raspberrypi and the behaviour is as > expected. > > doveadm -f tab fetch -u <user> "uid date.saved" mailbox Trash > uid date.saved > 314 2018-06-23 00:35:59 > 315 2018-06-23 12:39:10 > 316 2018-06-24 10:32:43 > ... > > And I have a cron script that expunges the mails older than 30 days. > /usr/bin/doveadm expunge -u <user> mailbox Trash savedbefore 30d Hi Michael, Thanks for your observation. I think you probably use maildir format, yes? I think my problem stems from the fact I use mbox, so one file contains many messages, whereas maildir uses one file for each message. Dovecot, from my understanding, will use the message file's mtime for date.saved if it doesn't have it in the cached. This is probably why I am seeing multiple messages with the same value. What's confusing is that if I query a message's date.saved, that value -- whether from the cache or the mailbox's mtime -- remains in the cache, so the next query will give me that value. So running "doveadm fetch ... date.saved", will get the mailbox's mtime at the time I fetched those values. In order to get near accurate date.saved values, I would have to run "doveadm fetch ... date.saved" frequently. (I think this behaviour must have changed recently because this no longer works consistently.) However, if each message is stored in a separate file (like maildir does), then each message can have an accurate date.saved(=mtime). Once you have accurate date.saved, then the "expunge savedbefore" works correctly. Another reason I really ought to switch to maildir. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: Panic: Leaked view for index - virtual mailbox
by Jakob Schuerz 25 Jul '18

25 Jul '18

1 0