- dovecot - dovecot.org

mdbox_deleted proper syntax
by Johan Huldtgren 31 Jul '18

31 Jul '18

hello, on the wiki, https://wiki2.dovecot.org/MailboxFormat/dbox, it says that one can use either doveadm fetch or doveadm import, however I can find no correct syntax with fetch that'll actually work. Is the idea to simply override the mail_location with -o ? That seems to work for doveadm mailbox but not for doveadm fetch or search # doveadm -f table mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 1362145026 0 1 164208086 64bd9f0003af305190040000b9256959 1471825482 # doveadm -f table -o "mail_location=mdbox_deleted:~/mdbox" mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 0 0 1 0 ddb9421479f0595bf21b0100b9256959 18446744073709551615 # doveadm -f flow fetch -u johan size.virtual mailbox dovecot size.virtual=2869 size.virtual=2960 size.virtual=8023 size.virtual=6683 ... # # doveadm -f flow -o "mail_location=mdbox_deleted:~/mdbox" fetch -u johan size.virtual mailbox dovecot # # doveadm search -u johan mailbox dovecot subject "LMTP Log" 64bd9f0003af305190040000b9256959 8642 64bd9f0003af305190040000b9256959 21302 64bd9f0003af305190040000b9256959 21373 64bd9f0003af305190040000b9256959 21420 64bd9f0003af305190040000b9256959 21434 64bd9f0003af305190040000b9256959 21435 64bd9f0003af305190040000b9256959 21460 64bd9f0003af305190040000b9256959 21461 64bd9f0003af305190040000b9256959 21463 64bd9f0003af305190040000b9256959 23684 # doveadm -o "mail_location=mdbox_deleted:~/mdbox" search -u johan mailbox dovecot subject "LMTP Log" # What I'm really trying to accomplish is see if a mail which a user deleted still exists in mdbox_deleted, so I wanted to do a fetch / search to see and then try to copy / import that message back. This is on OpenBSD 6.3-current with dovecot 2.2.36, doveconf -n below. thanks, .jh --- # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: OpenBSD 6.3 amd64 # Hostname: www.example.com auth_mechanisms = plain login first_valid_gid = 0 first_valid_uid = 507 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_id_log = * last_valid_uid = 1059 listen = 127.0.0.1 mail_home = /home/vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = stats fts fts_solr mail_privileged_group = _dovecot mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = mailbox spam { auto = subscribe special_use = \Junk } mailbox drafts { auto = subscribe special_use = \Drafts } mailbox sent-mail { auto = subscribe special_use = \Sent } mailbox trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-pgsql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-pgsql2.conf driver = sql } passdb { args = cache_key=%u%r%l * driver = bsdauth } plugin { antispam_backend = mailtrain antispam_mail_notspam = learn_ham antispam_mail_sendmail = /usr/local/bin/rspamc antispam_mail_sendmail_args = -h;127.0.0.1:11334;-P;q1 antispam_mail_spam = learn_spam antispam_spam = caughtspam antispam_trash = trash fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/dovecot/sieve/before/ sieve_default = /var/dovecot/sieve/default.sieve sieve_extensions = +spamtest +spamtestplus +virustest sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = _postfix mode = 0666 user = _postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_limit = 200 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix user = _postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service stats { fifo_listener stats-mail { mode = 0666 user = _postfix } } ssl = required ssl_cert = </etc/ssl/acme/example.com/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = uid=507 gid=507 driver = static } userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = stats fts fts_solr sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = stats fts fts_solr antispam imap_stats }

2 2

Doveadm protocol; dovecot v2.2.10
by David White 31 Jul '18

31 Jul '18

Hi there, Just wondering what is considered current best practice for managing dovecot? The options I see are: Doveadm binary Doveadm protocol via socket Doveadm http protocol I’m currently on v2.2.10 and it appears the doveadm protocol command set is limited to just the “mailbox” commands and the http protocol hasn’t been implemented. Is the doveadm http protocol still experimental in v2.3.2? Thanks, David White ISP Engineer Trustpower T 021 223 6208 E david.white(a)trustpower.co.nz<mailto:david.white@trustpower.co.nz> Trustpower Limited, Private Bag 12023, Tauranga Mail Centre, Tauranga 3143 ------------------------------------------------------------------------------------ The contents of this email and any attachments are confidential and may be privileged. If you are not the intended recipient, you may not use, copy or disclose this email or its attachments. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete both emails from your system. It is your responsibility to check this email and any attachments for viruses or other harmful code before opening or sending on. Trustpower Limited and its subsidiaries (collectively, Trustpower) accepts no responsibility for any such virus or any effects of a virus on your systems or data. Trustpower does not endorse anything in this email that is not related to its official business. Please think of the environment before printing this email. ------------------------------------------------------------------------------------

2 1

2.3.2.1 - ssl_alt_key revealed with dovecot -n
by ѽ҉ᶬḳ℠ 31 Jul '18

31 Jul '18

Seems like a minor cosmetic bug with [ dovecot -n ] ssl_alt_key = </etc/pki/private/some.key.pem ssl_key = # hidden, use -P to show it

1 0

Restricting SSL/TLS protocol versions on Dovecot 2.2.22
by J Doe 30 Jul '18

30 Jul '18

Hello, I have a question regarding SSL/TLS settings for Dovecot version 2.2.22. In: 10-ssl.conf there are two parameters: ssl_protocols ssl_cipher_list ssl_protocols is commented with “SSL protocol to use” and ssl_cipher_list is commented with “SSL ciphers to use”. If I want to disable SSLv3, for example, do I need to use both parameters or will disabling SSLv3 ciphers in ssl_cipher_list do the same thing ? So is: ssl_cipher_list = !SSLv3 …equivalent to: ssl_protocols = !SSLv3 ssl_cipher_list = !SSLv3 Thanks, - J

4 4

[Dovecot] quota-status not working in distributed environment
by Benoit Panizzon 30 Jul '18

30 Jul '18

Hello List Quick overview of our set-up: Postfix / Dovecot (2.2.2.1) / MySQL Cluster on (at the moment) three Servers to create a HA environment where you could easily add additional servers as the demand or load grows. Circular dovecot replication is used so each server uses another one as replication partner and allowing one server to fail. Dovecot Proxy Feature being used, so we can use round-robin DNS and each server can forward the connecting user to the correct 'master' for his mailbox. So far, everything works as expected. Now we want to reject emails to 'full' mailboxes during SMTP to prevent backscatter and use the quota-status policy service from within postfix. That works fine, if the mailbox or it's replica is present on the machine where quota-status is called, but it fails if it's run on a machine where neither the mailbox or the replica is present. In our case, we get a correct SMTP 550 'Mailbox Full' Reject in two cases and a LMTP generated bounce in the later case. Also `doveadm quota get -u user(a)example.com` return the correct quota if run on the two machines which have the mailbox and it's copy locale, but return 0% used if run on the other machine. Is there a way to get quota-status to also use the proxy feature to request the quota information from the correct machine? Or is the postfix policy daemon call to the quota-status socket documented somewhere (it must be, but where?) so we could implement it from within the Milter? (we use the sendmail Milter API from postfix to filter spam and viruses, do sender/recipient rewriting, forward bounce matching, rate limmiting, login/IP statistics to block botnets abusing phished addresses and legal intercept stuff anyway) Kind regards Benoit Panizzon -- I m p r o W a r e A G - ______________________________________________________ Zurlindenstrasse 29 Tel +41 61 826 93 07 CH-4133 Pratteln Fax +41 61 826 93 02 Schweiz Web http://www.imp.ch ______________________________________________________

5 6

OT - copied maildir from 2T drive to 4T drive
by Marc Perkel 30 Jul '18

30 Jul '18

And it's taking up more space on the 4T drive. What did I miss?

2 1

[SOLR] Where is solr-schema.xml?
by Peter Nabbefeld 27 Jul '18

27 Jul '18

Hello, running dovecot 2.3.2.1 on Arch Linux, and installed solr 7.4.0. According to the wiki, there should be doc/solr-schema.xml, but I cannot find it. Tried "whereis dovecot": dovecot: /usr/bin/dovecot /usr/lib/dovecot /etc/dovecot /usr/include/dovecot /usr/share/dovecot /usr/share/man/man1/dovecot.1.gz But I cannot find any xml files using find /usr/{lib,share}/dovecot -name "*.xml" Kind regards Peter

4 5

Imap post-login script
by j.emerlik 27 Jul '18

27 Jul '18

Dovecot v.2.2.32 and I have configured two imap post-login scripts and it seems like after successfully login scripts are not closed (dovecot_node/imap imap-postlogin : multiple processes are running still) and after some times there are too many processes and the limit is reached (imap proces_limit 1500): 1) #!/bin/sh case $IP in 10.10.1[1-2][0-7].*) exec "$@" ;; 10.11.2.4[0-9]) exec "$@" ;; esac CHECK_USER=`PGPASSWORD="password" /usr/local/pg952/bin/psql -h 10.11.1.3 -q -t -U postfixuser -d mail -c "select imap_allowed from users where name = '$USER' LIMIT 1"` if [ $CHECK_USER == "t" ] ; then exec "$@" fi if [ $CHECK_USER == "f" ] ; then exit 0 fi 2) PGPASSWORD="password" /usr/local/pg952/bin/psql -U postfixuser -d mail2 -h 10.11.1.3 -c "select last_auth('$USER','$RIP2','1')" > /dev/null exec "$@" Regards, Jack

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 26 Jul '18

26 Jul '18

Hi There! I run into this problem with virtual Mailboxes on release-2.3.2 (and also in master and in older versions of dovecot) I added the core-file. Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7ffad9ac0eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffad9a2efe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7ffad9bbb1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7ffad9792b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7ffad9792d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7ffad9795f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b4602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b460 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): child 11292 killed with signal 6 (core dumped) Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: AUTH 19 PLAIN service=imap secured=tls session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 20 lport=143 rport=41758 local_name=aldebaran.xundeenergie.at ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: CONT 19 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: CONT<hidden> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: OK 19 user=jakob Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: REQUEST 2436366337 10570 19 dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 request_auth_token Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb out: USER 2436366337 jakob home=/var/mail/jakob acl_groups=home,admin auth_token=3ea3b630e131 3bf5beb0f26ff740450189f63e3e Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, mpid=11298, TLS, session=<9KKNZclxHqPAqADc> Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7fbd982b2eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbd98220fe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fbd983ad1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7fbd97f84b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7fbd97f84d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7fbd97f87f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa6602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd98411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa660 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] Jul 25 04:11:30 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): child 11298 killed with signal 6 (core dumped) jakob

4 12

doveadm who reverse dns lookups
by Michael Grant 25 Jul '18

25 Jul '18

Perhaps this is a feature request... It would be nice if the ‘doveadm who’ command printed out the reverse dns name of where the user was logged in from. Would it be possible to either add some option to doveadm who for this, or make it the do it by default and add a ‘-n’ option (like many of the other programs that look up ip addresses by default) and take a -n option to not do that? Not sure if that would break some existing thing which is why I hesitate. Might be safer to add, say, a -r option to do the rDNS lookup. However, it would definitely save me a step in figuring out where someone was logged in from to know if it’s legit. Michael Grant

3 2

Re: doveadm expunge didn't clear Trash mailbox
by Joseph Tam 25 Jul '18

25 Jul '18

On Mon, 23 Jul 2018, Michael Wagner wrote: > here works a dovecot 2.2.27 on a raspberrypi and the behaviour is as > expected. > > doveadm -f tab fetch -u <user> "uid date.saved" mailbox Trash > uid date.saved > 314 2018-06-23 00:35:59 > 315 2018-06-23 12:39:10 > 316 2018-06-24 10:32:43 > ... > > And I have a cron script that expunges the mails older than 30 days. > /usr/bin/doveadm expunge -u <user> mailbox Trash savedbefore 30d Hi Michael, Thanks for your observation. I think you probably use maildir format, yes? I think my problem stems from the fact I use mbox, so one file contains many messages, whereas maildir uses one file for each message. Dovecot, from my understanding, will use the message file's mtime for date.saved if it doesn't have it in the cached. This is probably why I am seeing multiple messages with the same value. What's confusing is that if I query a message's date.saved, that value -- whether from the cache or the mailbox's mtime -- remains in the cache, so the next query will give me that value. So running "doveadm fetch ... date.saved", will get the mailbox's mtime at the time I fetched those values. In order to get near accurate date.saved values, I would have to run "doveadm fetch ... date.saved" frequently. (I think this behaviour must have changed recently because this no longer works consistently.) However, if each message is stored in a separate file (like maildir does), then each message can have an accurate date.saved(=mtime). Once you have accurate date.saved, then the "expunge savedbefore" works correctly. Another reason I really ought to switch to maildir. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: Panic: Leaked view for index - virtual mailbox
by Jakob Schuerz 25 Jul '18

25 Jul '18

1 0

Re: Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 25 Jul '18

25 Jul '18

Hi Aki! Sorry. Here is the right output. # gdb /usr/local/libexec/dovecot/imap /var/core/24491 GNU gdb (Debian 8.1-3) 8.1 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/libexec/dovecot/imap...(no debugging symbols found)...done. [New LWP 24491] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap [jakob 213'. Program terminated with signal SIGABRT, Aborted. #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51 ../sysdeps/unix/sysv/linux/raise.c: Datei oder Verzeichnis nicht gefunden. (gdb) bt full #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 set = {__val = {0, 140735982403592, 140035444961075, 2331576704, 12138802451775488, 140035444733018, 206158430240, 4096, 140735982403592, 94124639053616, 4096, 443744500087950336, 2389, 2380, 2381, 94124639053616}} pid = <optimized out> tid = <optimized out> ret = <optimized out> #1 0x00007f5c8ac4e2f1 in __GI_abort () at abort.c:79 save_stage = 1 act = {__sigaction_handler = {sa_handler = 0x33580, sa_sigaction = 0x33580}, sa_mask = {__val = {2048, 140035446034307, 140035441399298, 140035443714067, 140035445631889, 140035441273723, 140035445630673, 94124639049440, 443744500087950336, 512, 140035444801458, 140735982404016, 94124639049440, 140735982404016, 140035444801849, 94124639049440}}, sa_flags = -1964120006, sa_restorer = 0x5} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007f5c8aee5daf in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00007f5c8aee5eba in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x00007f5c8ae53fe8 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x00007f5c8b08b028 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x00007f5c8b06272a in index_storage_mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #7 0x00007f5c8afe01aa in mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #8 0x00007f5c8abb7b80 in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #9 0x00007f5c8abb7d3b in virtual_backend_box_open () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #10 0x00007f5c8abbaf19 in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #11 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #12 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #13 0x00007f5c8b060ed1 in index_storage_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #14 0x00007f5c8abb6ead in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #15 0x00007f5c8b044f83 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #16 0x00007f5c8abd9602 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #17 0x00007f5c8ae0e813 in ?? () from /usr/local/lib/dovecot/lib01_acl_plugin.so No symbol table info available. #18 0x00007f5c8afe2b91 in mailbox_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #19 0x00007f5c8abbab7b in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #20 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #21 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #22 0x00007f5c8b060ed1 in index_storage_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #23 0x00007f5c8abb6ead in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #24 0x00007f5c8b044f83 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #25 0x00007f5c8abd9602 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #26 0x00007f5c8ae0e813 in ?? () from /usr/local/lib/dovecot/lib01_acl_plugin.so No symbol table info available. #27 0x00007f5c8afe2b91 in mailbox_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #28 0x00007f5c8abbab7b in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #29 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #30 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #31 0x0000559b17308ace in cmd_select_full () No symbol table info available. #32 0x0000559b17310384 in command_exec () No symbol table info available. #33 0x0000559b1730e832 in ?? () No symbol table info available. #34 0x0000559b1730e8cc in ?? () No symbol table info available. #35 0x0000559b1730ecd5 in client_handle_input () No symbol table info available. #36 0x0000559b1730f2f4 in client_input () No symbol table info available. #37 0x00007f5c8aefe009 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #38 0x00007f5c8aeff8ce in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #39 0x00007f5c8aefe10c in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #40 0x00007f5c8aefe318 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #41 0x00007f5c8ae78413 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #42 0x0000559b17300f81 in main () No symbol table info available. (gdb) quit Jakob Am 25.07.2018 um 10:01 schrieb Aki Tuomi: > Try running gdb again with corrected path for imap binary > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Jakobus Schürz <jakobus.schuerz(a)ebcont.com> > Date: 25/07/2018 10:46 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Panic: Leaked view for index - virtual mailbox > > Hi Aki! > > The config is in the attachment. > > The output from gdb is this: > > > # gdb /usr/lib/dovecot/imap /var/core/24491 > GNU gdb (Debian 8.1-3) 8.1 > Copyright (C) 2018 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <http://www.gnu.org/software/gdb/bugs/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > For help, type "help". > Type "apropos word" to search for commands related to "word"... > /usr/lib/dovecot/imap: Datei oder Verzeichnis nicht gefunden. > [New LWP 24491] > Core was generated by `dovecot/imap [jakob 213'. > Program terminated with signal SIGABRT, Aborted. > #0 0x00007f5c8ac4cf3b in ?? () > (gdb) bt full > #0 0x00007f5c8ac4cf3b in ?? () > No symbol table info available. > #1 0x0000000000000000 in ?? () > No symbol table info available. > (gdb) quit > > And i have a complex setup for virtual mailboxes... > > For Synoptic/AKTUELL it is: > > # cat /var/mail/virtual/AKTUELL/dovecot-virtual > !Real/halbjahr > all > > And for Real/halbjahr it is: > > # cat /var/mail/real/halbjahr/dovecot-virtual > !Real/Alle > all younger 15768000 > > And for Real/Alle it is: > > # cat /var/mail/real/Alle/dovecot-virtual > !INBOX > INBOX/* > -INBOX/Trash > -INBOX/Trash/* > -INBOX/Archives > -INBOX/Archives/* > -INBOX/Drafts > -INBOX/Drafts/* > -INBOX/Junk > -INBOX/Junk/* > -INBOX/SYSTEM > -INBOX/SYSTEM/* > all > > > jakob > > > Am 25.07.2018 um 09:11 schrieb Aki Tuomi: > > So the core file is not very useful... > > > > can you, instead, attach your doveconf -n and your virtual folder > configurations and also > > > > gdb /usr/lib/dovecot/imap /path/to/core > > bt full > > > > Aki > > > >> On 25 July 2018 at 09:55 Jakobus Schürz > <jakobus.schuerz(a)ebcont.com> wrote: > >> > >> > >> Hi Aki! > >> > >> This is debian buster, but a self-compiled dovecot from git! > >> > >> /usr/local/sbin/dovecot --version > >> 2.3.2.1 (0719df592) > >> > >> jakob > >> > >> > >> Am 25.07.2018 um 08:30 schrieb Aki Tuomi: > >>> And can you provide dovecot --version too, please. > >>> > >>> Aki > >>> > >>>> On 25 July 2018 at 09:18 Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > >>>> > >>>> > >>>> Hi! > >>>> > >>>> Which debian release is this? > >>>> > >>>> Aki > >>>> > >>>>> On 25 July 2018 at 05:18 Jakobus Schürz > <jakobus.schuerz(a)ebcont.com> wrote: > >>>>> > >>>>> > >>>>> Hi There! > >>>>> > >>>>> I run into this problem with virtual Mailboxes on release-2.3.2 (and > >>>>> also in master and in older versions of dovecot) > >>>>> > >>>>> I added the core-file. > >>>>> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index > >>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: > Opened > >>>>> in index-storage.c:338 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+ > >>>>> 0xceeba) [0x7ffad9ac0eba] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7ffad9a2efe8] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) > >>>>> [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s > >>>>> torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) > >>>>> [0x7ffad9bbb1aa] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 > >>>>> x7ffad9792b80] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) > >>>>> [0x7ffad9792d3b] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) > >>>>> [0x7ffad9795f1 > >>>>> 9] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7ffad9bbd6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo > >>>>> vecot-storage.so.0(index_storage_get_status+0x31) > [0x7ffad9c3bed1] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) > [0x7ffad9791ead] > >>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad > >>>>> 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7ffad97b4602] -> > /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7ffad99e9813] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox > >>>>> _get_status+0x31) [0x7ffad9bbdb91] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) > >>>>> [0x7ffad9795b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 > >>>>> x7ffad9bbd6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7ffad9bbd787] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) > >>>>> [0x7ffad9c3bed1] -> /usr/loca > >>>>> l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) > >>>>> [0x7ffad9c1ff83] -> > /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7ffad97b460 > >>>>> 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7ffad99e9813] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) > >>>>> [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug > >>>>> in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7ffad9bbd6d1] > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): > >>>>> child 11292 killed with signal 6 (core dumped) > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: > >>>>> AUTH 19 PLAIN service=imap secured=tls > >>>>> session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 > >>>>> 20 lport=143 rport=41758 > >>>>> local_name=aldebaran.xundeenergie.at > >>>>> ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 > >>>>> ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb > >>>>> out: CONT 19 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: > >>>>> CONT<hidden> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: > >>>>> passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: > user=jakob > >>>>> file=/usr/local/etc/dovecot/users > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb > >>>>> out: OK 19 user=jakob > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: > >>>>> REQUEST 2436366337 10570 19 > >>>>> dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 > request_auth_token > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: > >>>>> passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: > user=jakob > >>>>> file=/usr/local/etc/dovecot/users > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb > >>>>> out: USER 2436366337 jakob home=/var/mail/jakob > >>>>> acl_groups=home,admin auth_token=3ea3b630e131 > >>>>> 3bf5beb0f26ff740450189f63e3e > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: > >>>>> user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, > >>>>> mpid=11298, TLS, session=<9KKNZclxHqPAqADc> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index > >>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: > Opened > >>>>> in index-storage.c:338 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+ > >>>>> 0xceeba) [0x7fbd982b2eba] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7fbd98220fe8] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) > >>>>> [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s > >>>>> torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) > >>>>> [0x7fbd983ad1aa] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 > >>>>> x7fbd97f84b80] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) > >>>>> [0x7fbd97f84d3b] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) > >>>>> [0x7fbd97f87f1 > >>>>> 9] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7fbd983af6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo > >>>>> vecot-storage.so.0(index_storage_get_status+0x31) > [0x7fbd9842ded1] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) > [0x7fbd97f83ead] > >>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 > >>>>> 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7fbd97fa6602] -> > /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7fbd981db813] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox > >>>>> _get_status+0x31) [0x7fbd983afb91] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) > >>>>> [0x7fbd97f87b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 > >>>>> x7fbd983af6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7fbd983af787] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) > >>>>> [0x7fbd9842ded1] -> /usr/loca > >>>>> l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) > >>>>> [0x7fbd98411f83] -> > /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7fbd97fa660 > >>>>> 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7fbd981db813] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) > >>>>> [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug > >>>>> in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7fbd983af6d1] > >>>>> Jul 25 04:11:30 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): > >>>>> child 11298 killed with signal 6 (core dumped) > >>>>> > >>>>> > >>>>> jakob > >>>>> >

1 0

dsync: expunge from pop3 does not replicate
by Jakub Lánský 25 Jul '18

25 Jul '18

Hi, I'm using dovecot 2.3.2.1 on Xenial from upstream packages on two Dovecot servers connected with dsync over TCP. E-mails which are deleted via POP3 protocol are not correctly deleted on second server via dsync. Jul 25 09:29:19 mda11 dovecot: pop3(jakub@***)<7587><8xaJ1c1x9uEqAB7QADwAAAAAAAAAAL7v>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Nothing happened on the second machine then. After running # doveadm replicator replicate "jakub@***", e-mail got expunged immediately on second server. Jul 25 09:50:56 mda22 dovecot: dsync-local(jakub@***)<Xt6oFy8nWFsjIwAA0YRh9g>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Any ideas what to do or test? Thank you -- Jakub Lánský IT administration/support technician jakub(a)lansky.biz GSM: +420776172737 Jabber/GTalk: lenny(a)blesmrt.net

2 1

Dsync fails to connect to remote IMAP server
by Andrzej Polatyński 24 Jul '18

24 Jul '18

Hi, I'm trying to migrate from an old courier IMAP server to Dovecot 2.3.1 (8e2f634). The old server uses self signed SSL certificate. I'm using the following configuration: imapc_host = 10.1.1.3 imapc_user = %u imapc_features = rfc822.size fetch-headers imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no mail_prefetch_count = 20 mail_shared_explicit_inbox = no Launching dsync with the command: doveadm -o mail_fsync=never -o imapc_password=PASSWORD -Dv backup -R -u USER @DOMAIN <andrzej(a)datatel.net> imapc: In the output logs I get messages like below: dsync(USER@DOMAIN): Error: imapc(10.1.1.3:993): Couldn't initialize SSL context: Can't verify remote server certs without trusted CAs (ssl_client_ca_* settings) dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Created new connection dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Looking up IP address (reconnect_ok=true, last_connect=1532016643) dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Connecting to 10.1.1.3:993 dsync(USER@DOMAIN): Info: imapc(10.1.1.3:993): Connected to 10.1.1.3:993 (local 172.17.0.5:51972) dsync(USER@DOMAIN): Error: imapc(10.1.1.3:993): No SSL context dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Disconnected Am I missing some configuration parameters? -- Regards, Andrew

2 2

dovecot sometimes sends non-default SSL cert if IMAP client won't send SNI
by Martin Johannes Dauser 24 Jul '18

24 Jul '18

Hi, I recognised some funny behaviour on my server. IMAP clients which won't send an Server Name Indication (SNI) sometimes get the wrong certificate. I would expect that those clients always get the default certificate (of my new domain), instead in about 20 to 50% of connections the certificate of my old domain will be presented. (sample rate was 3 times 30 connections) Clients sending SNI always get the right certificate. A user informed me that offlineIMAP complains 'CA Cert verifying failed: no matching domain name found in certificate' So at least offlineIMAP 7.0.12 from Debain stretch won't send SNI, there is a newer version upstream though. I myself checked the server's behaviour with openssl: $ openssl s_client -showcerts -connect IP-address:993 and $ openssl s_client -showcerts -connect IP-address:993 -servername imap.domain I'm totally clueless about how come. Best regards Martin Johannes Dauser # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.5 (Maipo) ... service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } ... ssl = required # set default cert ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_cipher_list = DHE-RSA-AES256-SHA:DHE-RSA-AES128- SHA:ALL:!LOW:!SSLv2:!EXP:!aNULL:!MD5:!RC4:!DES:!3DES:!TLSv1 ssl_key = </etc/pki/dovecot/private/mail_new_domain.key ssl_protocols = !SSLv2 !SSLv3 ... # set alternativ cert for old domain local_name mail.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } local_name imap.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } local_name pop.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } # set explicit cert for new domain local_name mail.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_doman.key } local_name imap.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_domain.key } local_name pop.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_domain.key }

2 3

Namespace question
by J Doe 24 Jul '18

24 Jul '18

Hi, I have a question about the “inbox” namespace, as mentioned in: conf.d/10-mail.conf. I have written my dovecot.conf file from scratch and do not include: conf.d/10-mail.conf. I have not defined the “inbox” namespace and so I am assuming that one is created by default. When I list the dovecot defaults via “sudo doveconf -d”, I notice that no “namespace inbox” entry exists. If “namespace inbox” is not specified, is one still created by default ? Thanks, - J

2 1

anvil in 2.3.2.1?
by kevin martin 23 Jul '18

23 Jul '18

Has anvil gone away in 2.3.2.1? I ask only because I don't find an example of anvil in the conf.d files anymore and I'm migrating from 2.2.10 version to 2.3.2.1. Thanks.

1 0

doveadm expunge didn't clear Trash mailbox
by Sophie Loewenthal 23 Jul '18

23 Jul '18

Hi, Why did my 'doveadm expunge' command not clear the Trash out of a mailbox? The oldest messages was put into the Trash on the 26th June 2018 as shown in the file timestamp. -rw------- 1 vmail mail 33056 Jun 26 16:46 1530031582.M768773P18242.mx10,S=33056,W=33510:2,RS # doveadm -D expunge -u testuser(a)example.org mailbox Trash savedbefore 2d Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_lookup_dict_iterate_visible_next (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(testuser(a)example.org): Debug: Added userdb setting: mail=maildir:/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: Added userdb setting: plugin/quota=dirsize:storage= doveadm(testuser(a)example.org): Debug: Effective uid=150, gid=8, home=/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: maildir++: root=/var/vmail/example.org/testuser@example.org, index=, indexpvt=, control=, inbox=/var/vmail/example.org/testuser@example.org, alt= Sophie

3 6

Dovecot pop3d and imapd problem
by John Paul Iglesia 23 Jul '18

23 Jul '18

Hi, My dovecot version : 2.2.22 Recently, i had issues on dovecot. All packages of dovecot were installed on my system then suddenly when I checked yesterday the packages for dovecot-pop3d and dovecot-imapd were no longer on the list of app installed. Because of this dovecot service stop running. I checked the apt history log, term log and even dpkg log, there were no information about removing the packages. It just shown on my apt list the packages were not longer there. I had to reinstalled these 2 packages just to make dovecot run and for me to be able to receive and send messages. What do you think is the problem, is it dovecot bug? Please advise. Thanks, paul.tcbc

3 3

dovecot lmtp and drop privileges to specific user
by Christos Chatzaras 23 Jul '18

23 Jul '18

Is it possible when dovecot LMTP to drop privileges to a specific user instead of the e-mail account user?

2 1

Stopping login via "nologin" parameter
by J Doe 23 Jul '18

23 Jul '18

Hello, I have a basic e-mail server with Postfix 3.1 and Dovecot 2.2.22. I am using a passwd-file for both userdb and passdb: /etc/dovecot/dovecot.conf userdb { driver = passwd-file args = /etc/dovecot/passwd } passdb { driver = passwd-file args = /etc/dovecot/passwd } } In the passwd file, I want to have user account names for SMTP SASL AUTH and IMAP that are NOT e-mail addresses. For example, employee one of ABC corp would have a SMTP SASL AUTH/IMAP account name in the form: abc_company_employeeid (for example: abc_company_03284). The idea behind that is that I do not want someone outside of the company to be able to know the first half of the username and password pair just because they have an employee's e-mail address. For the e-mail address I specify something like: bob(a)abc.com however I never want someone to be able to login via their e-mail address. Originally, I specified the password field as empty, with the understanding being that the default encryption of a password is {CRYPT}. Since crypt() cannot output a null string, this meant that there was never a valid password. So passwd looked like this: /etc/dovecot/passwd # SMTP SASL AUTH and IMAP accounts abc_company_03284:::::::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_co… # IMAP bob@abc.com:vmail:vmail::/home/vmail/bob::userdb_maill=maildir:/var/mail/vhosts/abc.com/abc_company_03284 I tested SMTP SASL AUTH and IMAP via the openssl s_client and can confirm that I can login and send e-mail as well as retrieve mail only via the: abc_company_03284 account, but because an empty password field isn’t mentioned on the Dovecot wiki, I was wondering if I should add “nologin” to explicitly make it impossible for: bob(a)abc.com. “nologin” was mentioned to me in a previous e-mail to this list. So passwd would now look like this: /etc/dovecot/passwd # SMTP SASL AUTH and IMAP accounts abc_company_03284:::::::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_co… # IMAP bob@abc.com:vmail:vmail::/home/vmail/bob::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_company_03284 nologin I restarted Dovecot and tested this with openssl s_client for SMTP SASL AUTH and IMAP, but just wanted to make sure that this STOPS ANY LOGINS via the e-mail address: bob(a)abc.com ? Thanks, - J

1 1

ot: LE server conf setup/ iPhone 'expired cert' message
by Voytek Eymont 22 Jul '18

22 Jul '18

I've installed LE certs on my Dovecot a while back, and, it has been working OK since, but, today, an iPhone user said he can't get emails as iphone says 'cert is expired', searching around, I see some other iPhone similar issues reported, do I have my conf correct, I have; # cat dovecot.conf | grep ssl ssl = required verbose_ssl = no ssl_cert = </etc/letsencrypt/live/fqn.myserver/fullchain.pem ssl_key = </etc/letsencrypt/live/fqn.myserver/privkey.pem is fullchain.pem and privkey.pem is what I should be using ? anythought how to force an iphone to reload cert ? actual cert was renewed 15/7, old/previous one expired earlier today ls /etc/letsencrypt/live/fqn.myserver/ cert.pem chain.pem fullchain.pem privkey.pem (if I open mailserver host in browser, padlock shows current/valid cert) -- Voytek

6 8