- dovecot - dovecot.org

Debugging rules with Pigeonhole Sieve
by Pete Gonzalez 03 Aug '18

03 Aug '18

I have a lot of rules in my Sieve script. Sometimes an email message ends up in the wrong folder, due to a problem with one of the rules. However, this is very difficult to debug, because I have no idea which rule matched the email. A log file might be helpful, but that wouldn't be readable without shell access to the mail server. This is not a solution that would work for everyday users, who configure their rules via a web page UI. What would be great would be for the Sieve interpreter to append a custom header to each email message after it gets processed. This header would record which Sieve rules matched the email. Does this feature exist already? Or is there a way to accomplish it via the Dovecot server configuration? Thanks!

1 0

Managesieve stopped working - Undefined symbol "i_stream_read_memarea"
by Henrik Larsson 02 Aug '18

02 Aug '18

After upgrading Dovecot to 2.3.2.1 and Pigeonhole to 0.5.2, managesieve stopped working. I'm using FreeBSD ports tree, to build these. Only domains have been modified in below output. A FreeBSD bug report have also been created. But I'm not sure if this is FreeBSD ports related or Dovecot/Pigeonhole related: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=228067 %uname -a FreeBSD 10.4-RELEASE-p9 FreeBSD 10.4-RELEASE-p9 #0: Sat Jul 14 22:38:37 CEST 2018 /usr/obj/usr/src/sys/GENERIC amd64 %pkg version -v dovecot-2.3.2.1 = up-to-date with index dovecot-pigeonhole-0.5.2_2 = up-to-date with index %dmesg -a /usr/local/libexec/dovecot/managesieve: Undefined symbol "i_stream_read_memarea" doveconf: Error: managesieve-login: dump-capability process returned 1 % dovecot -n # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) /usr/local/libexec/dovecot/managesieve: Undefined symbol "i_stream_read_memarea" doveconf: Error: managesieve-login: dump-capability process returned 1 # OS: FreeBSD 10.4-RELEASE-p9 amd64 # Hostname: mail.example.com auth_mechanisms = plain login first_valid_uid = 125 hostname = mail.example.com listen = * log_path = /var/log/dovecot mail_plugins = zlib mail_privileged_group = postfix mail_temp_dir = /var/db/dovecot namespace compat { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox "Sent Items" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /home/mail/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service lmtp { executable = lmtp -L unix_listener /home/mail/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/example.com-chained.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { log_path = /var/log/dovecot-deliver mail_plugins = zlib sieve } protocol lda { mail_plugins = zlib sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib imap_zlib }

2 5

Re: LMTP error, mysterious
by Andras Kemeny 02 Aug '18

02 Aug '18

you mean i should define another, "fallback" userdb service if prefetch doesn't work for some reason? is it the problem that it's a chicken and egg scenario and with LMTP address verification (from postfix) there is no login beforehand so then dovecot needs to consult the userdb once again and having no fallback mechanism, it gives up? i can understand that, but then it would need to be emphasized in either the prefetch document or the lmtp document on the wiki. i've tried it and now it works, thank you ever so much. (but please make a mental note to add this info on the wiki.) cheers, a 2018. 08. 02. 1:10 keltezéssel, Aki Tuomi írta: > applies for ldap too if you use prefetch. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Andras Kemeny <pdx(a)pdx.hu> > Date: 02/08/2018 01:59 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: LMTP error, mysterious > > ah well, but i'm not using sql at all. > > here's doveconf -n: > > # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.16 (fed8554) > # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.4 > auth_cache_negative_ttl = 0 > auth_mechanisms = plain login > hostname = rhyno.tech > mail_debug = yes > mail_location = maildir:~/mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocols = " imap lmtp pop3" > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 0 > } > } > ssl_cert = </etc/letsencrypt/live/wc-rhyno.tech/fullchain.pem > ssl_key = # hidden, use -P to show it > submission_host = localhost:25 > userdb { > driver = prefetch > } > protocol lmtp { > mail_plugins = sieve > } > protocol lda { > mail_plugins = sieve > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > } > > > 2018. 08. 02. 0:48 keltezéssel, Aki Tuomi írta: >> protocol lmtp { >> userdb { >> driver = sql >> args = /path/to/dovecot-sql.conf.ext >> } >> } >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Andras Kemeny <pdx(a)pdx.hu> >> Date: 02/08/2018 01:35 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: LMTP error, mysterious >> >> hi (especially to you, Aki), >> >> so to solve the previous UID issue, i went the full LMTP route. however, >> i seem to be having problems with the prefetch userdb (i'm trying to >> minimize load on the LDAP server). namely, the log says: >> >> Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: >> client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik >> Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: >> message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> >> Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: >> from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) >> Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local >> Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): >> userdb lookup not possible with only userdb prefetch >> Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user >> aik(a)rhyno.tech: Auth USER lookup failed >> Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: >> to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], >> delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host >> beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> >> Internal error occurred. Refer to server log for more information. (in >> reply to RCPT TO command)) >> Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: >> Successful quit >> Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from >> localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 >> >> (the above is a transcript of a full session i've done over telneting to >> localhost 587 and auth login-ing with valid credentials) >> >> so, i've tested the actual login process, and it works flawlessly, and >> it looks like IMAP is up and running: >> >> Connected to localhost. >> Escape character is '^]'. >> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. >> 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword >> 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS >> THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN >> NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH >> ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE >> SPECIAL-USE] Logged in >> 1 list "" "%" >> * LIST (\HasNoChildren \Sent) "." Sent >> * LIST (\HasNoChildren \Trash) "." Trash >> * LIST (\HasNoChildren) "." INBOX >> 1 OK List completed (0.000 + 0.000 secs). >> 2 status INBOX (MESSAGES) >> * STATUS INBOX (MESSAGES 2) >> 2 OK Status completed (0.000 + 0.000 secs). >> >> this is how i send the test mails: >> >> Connected to localhost. >> Escape character is '^]'. >> 220 beach.rhyno.tech mail server >> ehlo x >> 250-beach.rhyno.tech >> 250-PIPELINING >> 250-SIZE 10240000 >> 250-ETRN >> 250-STARTTLS >> 250-AUTH PLAIN LOGIN >> 250-AUTH=PLAIN LOGIN >> 250-ENHANCEDSTATUSCODES >> 250-8BITMIME >> 250-DSN >> 250 SMTPUTF8 >> auth login >> 334 VXNlcm5hbWU6 >> ***obviously_masked*** >> 334 UGFzc3dvcmQ6 >> ***obviously_masked*** >> 235 2.7.0 Authentication successful >> mail from:<pdx(a)pdx.hu> >> 250 2.1.0 Ok >> rcpt to:<aik(a)rhyno.tech> >> 250 2.1.5 Ok >> data >> 354 End data with <CR><LF>.<CR><LF> >> test >> . >> 250 2.0.0 Ok: queued as 5EEF35C05C5 >> quit >> 221 2.0.0 Bye >> Connection closed by foreign host. >> >> my concern is these two: >> >> Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): >> userdb lookup not possible with only userdb prefetch >> Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user >> aik(a)rhyno.tech: Auth USER lookup failed >> >> 10-auth.conf has these settings: >> >> passdb { >> driver = ldap >> args = /etc/dovecot/dovecot-ldap.conf.ext >> } >> userdb { >> driver = prefetch >> } >> >> dovecot-ldap.conf.ext has these settings (only the relevant ones) >> >> dn = ***whatever, it works*** >> dnpass = ***whatever, it works*** >> auth_bind = no >> base = dc=rhyno,dc=tech >> pass_attrs = \ >> =user=%{ldap:uid}, \ >> =password=%{ldap:userPassword}, \ >> =userdb_home=%{ldap:homeDirectory}, \ >> =userdb_uid=%{ldap:uidNumber}, \ >> =userdb_gid=%{ldap:gidNumber} >> pass_filter = >> (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) >> >> so what am i missing? also, this format of setting variables >> (=<output_field>=%{<whatever_special_result_field>}) is never explained >> on the wiki (or am i just blind?) >> >> thanks in advance, >> a >> >

1 0

Re: LMTP error, mysterious
by Andras Kemeny 02 Aug '18

02 Aug '18

ah well, but i'm not using sql at all. here's doveconf -n: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.4 auth_cache_negative_ttl = 0 auth_mechanisms = plain login hostname = rhyno.tech mail_debug = yes mail_location = maildir:~/mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap lmtp pop3" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl_cert = </etc/letsencrypt/live/wc-rhyno.tech/fullchain.pem ssl_key = # hidden, use -P to show it submission_host = localhost:25 userdb { driver = prefetch } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep } 2018. 08. 02. 0:48 keltezéssel, Aki Tuomi írta: > protocol lmtp { > userdb { > driver = sql > args = /path/to/dovecot-sql.conf.ext > } > } > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Andras Kemeny <pdx(a)pdx.hu> > Date: 02/08/2018 01:35 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: LMTP error, mysterious > > hi (especially to you, Aki), > > so to solve the previous UID issue, i went the full LMTP route. however, > i seem to be having problems with the prefetch userdb (i'm trying to > minimize load on the LDAP server). namely, the log says: > > Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: > client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik > Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: > message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> > Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: > from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) > Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local > Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): > userdb lookup not possible with only userdb prefetch > Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user > aik(a)rhyno.tech: Auth USER lookup failed > Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: > to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], > delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host > beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> > Internal error occurred. Refer to server log for more information. (in > reply to RCPT TO command)) > Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: > Successful quit > Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from > localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 > > (the above is a transcript of a full session i've done over telneting to > localhost 587 and auth login-ing with valid credentials) > > so, i've tested the actual login process, and it works flawlessly, and > it looks like IMAP is up and running: > > Connected to localhost. > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword > 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN > NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH > ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE > SPECIAL-USE] Logged in > 1 list "" "%" > * LIST (\HasNoChildren \Sent) "." Sent > * LIST (\HasNoChildren \Trash) "." Trash > * LIST (\HasNoChildren) "." INBOX > 1 OK List completed (0.000 + 0.000 secs). > 2 status INBOX (MESSAGES) > * STATUS INBOX (MESSAGES 2) > 2 OK Status completed (0.000 + 0.000 secs). > > this is how i send the test mails: > > Connected to localhost. > Escape character is '^]'. > 220 beach.rhyno.tech mail server > ehlo x > 250-beach.rhyno.tech > 250-PIPELINING > 250-SIZE 10240000 > 250-ETRN > 250-STARTTLS > 250-AUTH PLAIN LOGIN > 250-AUTH=PLAIN LOGIN > 250-ENHANCEDSTATUSCODES > 250-8BITMIME > 250-DSN > 250 SMTPUTF8 > auth login > 334 VXNlcm5hbWU6 > ***obviously_masked*** > 334 UGFzc3dvcmQ6 > ***obviously_masked*** > 235 2.7.0 Authentication successful > mail from:<pdx(a)pdx.hu> > 250 2.1.0 Ok > rcpt to:<aik(a)rhyno.tech> > 250 2.1.5 Ok > data > 354 End data with <CR><LF>.<CR><LF> > test > . > 250 2.0.0 Ok: queued as 5EEF35C05C5 > quit > 221 2.0.0 Bye > Connection closed by foreign host. > > my concern is these two: > > Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): > userdb lookup not possible with only userdb prefetch > Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user > aik(a)rhyno.tech: Auth USER lookup failed > > 10-auth.conf has these settings: > > passdb { > driver = ldap > args = /etc/dovecot/dovecot-ldap.conf.ext > } > userdb { > driver = prefetch > } > > dovecot-ldap.conf.ext has these settings (only the relevant ones) > > dn = ***whatever, it works*** > dnpass = ***whatever, it works*** > auth_bind = no > base = dc=rhyno,dc=tech > pass_attrs = \ > =user=%{ldap:uid}, \ > =password=%{ldap:userPassword}, \ > =userdb_home=%{ldap:homeDirectory}, \ > =userdb_uid=%{ldap:uidNumber}, \ > =userdb_gid=%{ldap:gidNumber} > pass_filter = > (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) > > so what am i missing? also, this format of setting variables > (=<output_field>=%{<whatever_special_result_field>}) is never explained > on the wiki (or am i just blind?) > > thanks in advance, > a >

2 1

LMTP error, mysterious
by Andras Kemeny 02 Aug '18

02 Aug '18

hi (especially to you, Aki), so to solve the previous UID issue, i went the full LMTP route. however, i seem to be having problems with the prefetch userdb (i'm trying to minimize load on the LDAP server). namely, the log says: Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): userdb lookup not possible with only userdb prefetch Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user aik(a)rhyno.tech: Auth USER lookup failed Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: Successful quit Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 (the above is a transcript of a full session i've done over telneting to localhost 587 and auth login-ing with valid credentials) so, i've tested the actual login process, and it works flawlessly, and it looks like IMAP is up and running: Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE] Logged in 1 list "" "%" * LIST (\HasNoChildren \Sent) "." Sent * LIST (\HasNoChildren \Trash) "." Trash * LIST (\HasNoChildren) "." INBOX 1 OK List completed (0.000 + 0.000 secs). 2 status INBOX (MESSAGES) * STATUS INBOX (MESSAGES 2) 2 OK Status completed (0.000 + 0.000 secs). this is how i send the test mails: Connected to localhost. Escape character is '^]'. 220 beach.rhyno.tech mail server ehlo x 250-beach.rhyno.tech 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-AUTH PLAIN LOGIN 250-AUTH=PLAIN LOGIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250 SMTPUTF8 auth login 334 VXNlcm5hbWU6 ***obviously_masked*** 334 UGFzc3dvcmQ6 ***obviously_masked*** 235 2.7.0 Authentication successful mail from:<pdx(a)pdx.hu> 250 2.1.0 Ok rcpt to:<aik(a)rhyno.tech> 250 2.1.5 Ok data 354 End data with <CR><LF>.<CR><LF> test . 250 2.0.0 Ok: queued as 5EEF35C05C5 quit 221 2.0.0 Bye Connection closed by foreign host. my concern is these two: Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): userdb lookup not possible with only userdb prefetch Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user aik(a)rhyno.tech: Auth USER lookup failed 10-auth.conf has these settings: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } dovecot-ldap.conf.ext has these settings (only the relevant ones) dn = ***whatever, it works*** dnpass = ***whatever, it works*** auth_bind = no base = dc=rhyno,dc=tech pass_attrs = \ =user=%{ldap:uid}, \ =password=%{ldap:userPassword}, \ =userdb_home=%{ldap:homeDirectory}, \ =userdb_uid=%{ldap:uidNumber}, \ =userdb_gid=%{ldap:gidNumber} pass_filter = (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) so what am i missing? also, this format of setting variables (=<output_field>=%{<whatever_special_result_field>}) is never explained on the wiki (or am i just blind?) thanks in advance, a

2 1

[SIEVE] pipe :copy to external program with arguments
by spamvoll＠googlemail.com 02 Aug '18

02 Aug '18

Hi all, quick questions about sieve pipe: I want to pipe spam messages to an external program with additional parameters my spamlearn.sieve script: require ["vnd.dovecot.pipe", "copy", "imapsieve"]; pipe :copy "mybin" ["-h 127.0.0.1:44444" , "markspam"]; I also tried: pipe :copy "mybin" ["-h 127.0.0.1:44444 markspam"]; pipe :copy "mybin" ["-h 127.0.0.1:44444"] ["markspam"]; pipe :copy :args ["-h 127.0.0.1:44444 markspam"] "mybin" ; It never executes correct, it always ends with: Error: sieve: Execution of script /my/path/to/spamlearn.sieve failed So whats the correct syntax ? What works is a single argument: pipe :copy "myscript" ["markspam"]; Dovecot Version 2.3.2.1

3 2

Problems with Sieve and vnd.dovecot.pipe
by Haiko Hertes 02 Aug '18

02 Aug '18

Hello all! I have changed my mailserver from spamassasin and procmail to rspamd and sieve. Rspamd is working, but with some sieve script I still have problems. I have created a script to learn spam: haiko@SERVERNAME:~$ sudo cat /var/vmail/sieve/global/learn-spam.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve"]; pipe :copy "rspamd-learn-spam.sh"; If I run sieve to use this script I get this: haiko@SERVERNAME:~$ sudo sieve /var/vmail/sieve/global/learn-spam.sieve sieve: vnd.dovecot.pipe: file not found sieve: can't require vnd.dovecot.pipe Speicherzugriffsfehler I think, my configs are OK: haiko@SERVERNAME:~$ doveconf -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_debug_passwords = yes auth_mechanisms = plain login PLAIN LOGIN auth_username_format = %Ln debug_log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot.log listen = * log_path = /var/log/dovecot.log mail_gid = postfix mail_location = maildir:~/Maildir mail_privileged_group = postfix mail_uid = postfix managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacati on subaddress comparator-i;ascii-numeric relational regex imap4flags copy includ e variables body enotify environment mailbox date index ihave duplicate mime for everypart extracttext imapsieve namespace inbox { inbox = yes location = mailbox "Deleted Items" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * quota = maildir:User quota quota_exceeded_message = Benutzer %u hat das Speichervolumen überschritten. / User %u has exhausted allowed storage space. sieve = ~/.dovecot.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_implicit_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_pipe_bin_dir = /var/vmail/sieve/global sieve_plugins = sieve_imapsieve sieve_extprograms sieve_trace_level = tests sieve_user_log = ~/.dovecot.sieve.log } postmaster_address = postmaster(a)hertes.net protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imaps { address = * } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } service pop3-login { inet_listener pop3s { address = * } } ssl = required ssl_cert = </etc/letsencrypt/live/hertes.net/fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECD H:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:! RC4: !SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = passwd } userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster(a)hertes.net } protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 20 mail_plugins = " imap_quota imap_sieve quota imap_quota imap_sieve" } Does anyone of you have a hint what could be wrong here?? Thanks! Best regards, Haiko

2 1

Basic question about file permissions for sieve error log
by J Doe 02 Aug '18

02 Aug '18

Hello, I have an admittedly very basic question, but I am not able to get it to work. I store my global sieve script in: /etc/dovecot. I recently made a mistake in my global sieve script which causes Dovecot to attempt to log the errors in: /etc/dovecot/sieve-global.log In /var/log/dovecot.log I see: Jul 24 15:33:32 lmtp(test(a)example.com): Error: ABVWGAx/V1uKLAAA1B5X9w: sieve: failed to open logfile (LOGGING TO STDERR): open(/etc/dovecot/sieve-global.log) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /etc/dovecot, we're not in group 122(dovecot), dir owned by 0:122 mode=0775) …but the group membership shows: $ sudo -u vmail groups vmail dovecot …and I restarted Dovecot, but the same error happens. What am I doing wrong ? Thanks, - J

3 2

LMTP Log
by Thomas Kristensen 02 Aug '18

02 Aug '18

Hey I got a server setup where the Postfix and dovecot is on separated servers. In the postfis log is goes like this on mail in: Jul 26 10:23:13 edimailsl2 postfix/smtpd[12812]: 41blTs18Bzz40nl: client=unknown[172.0.0.12] Jul 26 10:23:21 edimailsl2 postfix/cleanup[12825]: 41blTs18Bzz40nl: message-id=<> Jul 26 10:23:21 edimailsl2 postfix/qmgr[10666]: 41blTs18Bzz40nl: from=<tk(a)multimed.dk>, size=225, nrcpt=1 (queue active) Jul 26 10:23:21 edimailsl2 postfix/lmtp[12827]: 41blTs18Bzz40nl: to=<test(a)domain.dk>, relay=172.26.248.178[172.26.248.178]:2003, delay=8.6, delays=8.5/0.06/0.01/0.08, dsn=2.0.0, status=sent (250 2.0.0 <test(a)domain.dk> oCuyJ/mEWVvFfwAAbOxY/Q Saved) Jul 26 10:23:21 edimailsl2 postfix/qmgr[10666]: 41blTs18Bzz40nl: removed And the LMTP on the Dovecot server is: Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(32709): Connect from 172.0.0.1 Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(test@ domain.dk): msgid=unspecified: saved mail to INBOX Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(32709): Disconnect from 172.0.0.1: Successful quit How can I make LMTP log the ID it gives postfix (oCuyJ/mEWVvFfwAAbOxY/Q)? So I can relate the logs from the 2 servers. Med venlig hilsen Thomas Kristensen [MM_mail_logo_3_AS] Storhaven 12 - 7100 Vejle Tlf: 75 72 54 99 - Fax: 75 72 65 33 E-mail: tk(a)multimed.dk<mailto:tk@multimed.dk>

2 1

question about using procmail
by Joe Wong 01 Aug '18

01 Aug '18

Hello, I am new to Dovecot, testing the setup with Solr FTS plugin. Currently I am using procmail to delivery email into user's mailbox. I am using maildir on file system. I found that if email is delivered via procmail, the indexer-worker is not being called. But when I move the email between folders via IMAP, indexer is involved. Is this expected? - Joe

3 5

lmtp + tcpwrap
by A. Schulze 01 Aug '18

01 Aug '18

Hello, Using the TCP Wrapper Dovecot could control access to IMAP and POP3 servers. Is it also possible to controll access to an LMTP Server listening on Port 24? Andreas

1 0

Re: Get rid of the "dbox-Mails"-folder
by Hativ 31 Jul '18

31 Jul '18

Hey Aki, DIRNAME with empty value has no effect, just like with FULLDIRNAME. "~/sdbox" instead of "~/" doesn't change that.. Greetings, Hativ Am 07.07.2018 um 20:24 schrieb Aki Tuomi: > Does it work better if you use > > mail_location=sdbox:~/sdbox:DIRNAME= > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Hativ <hativ3(a)gmail.com> > Date: 07/07/2018 20:53 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Get rid of the "dbox-Mails"-folder > > Hey again, > > sorry, but I have to correct me: Even with dot it's not working > completely. The subscriptions file is not created and the dovecot-acl > file has the wrong path, too. > > :-( > > Greetings, > > Hativ > > Am 07.07.2018 um 02:26 schrieb Hativ: >> Hey again, >> >> I've found a working configuration: mail_location = >> sdbox:~/:FULLDIRNAME=. >> >> I use a dot instead of slash or empty value. >> >> Now my folder structure looks like I want and Dovecot is working fine. >> >> Can anyone (maybe even a Dovecot developer?) say if the configuration >> is okay? I've tried to check the source code, but I don't know C as >> good as it's needed for that. >> >> Greetings, >> >> Hativ >> >> Am 06.07.2018 um 16:10 schrieb Hativ: >>> Hey to all, >>> >>> is it possible to get rid of the "dbox-Mails"-folder when using sdbox? >>> >>> Currently my folder structure looks like this (I hope the output >>> from tree would be formatted well): >>> /srv/mail/ >>> └── example.com >>> └── user >>> ├── dovecot-acl-list >>> ├── dovecot-attributes >>> ├── dovecot.list.index.log >>> ├── dovecot.mailbox.log >>> ├── dovecot-uidvalidity >>> ├── dovecot-uidvalidity.5b3f746f >>> ├── mailboxes >>> │ ├── Drafts >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ ├── INBOX >>> │ │ └── dbox-Mails >>> │ │ ├── dovecot.index.cache >>> │ │ ├── dovecot.index.log >>> │ │ └── u.1 >>> │ ├── Junk >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ ├── Sent >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ └── Trash >>> │ └── dbox-Mails >>> │ └── dovecot.index.log >>> └── subscriptions >>> >>> I would like to let it look like this: >>> /srv/mail/ >>> └── example.com >>> └── user >>> ├── dovecot-acl-list >>> ├── dovecot-attributes >>> ├── dovecot.list.index.log >>> ├── dovecot.mailbox.log >>> ├── dovecot-uidvalidity >>> ├── dovecot-uidvalidity.5b3f746f >>> ├── mailboxes >>> │ ├── Drafts >>> │ │ └── dovecot.index.log >>> │ ├── INBOX >>> │ │ └── dovecot.index.cache >>> │ │ └── dovecot.index.log >>> │ │ └── u.1 >>> │ ├── Junk >>> │ │ └──dovecot.index.log >>> │ ├── Sent >>> │ │ └── dovecot.index.log >>> │ └── Trash >>> │ └── dovecot.index.log >>> └── subscriptions >>> >>> My path configuration: >>> mail_attribute_dict = file:%h/dovecot-attributes >>> mail_home = /srv/mail/%d/%n/ >>> mail_location = sdbox:~/ >>> >>> I have tried >>> mail_location = sdbox:~/:FULLDIRNAME= >>> and >>> mail_location = sdbox:~/:FULLDIRNAME=/ >>> but it doesn't work. >>> >>> The first doesn't change anything. The second auto-creates the >>> folders after first login like I want, but after next login they are >>> greyed out and no longer accessible. >>> >>> Is it possible to get rid of the "dbox-Mails"-folder? I want this >>> because I don't like to have an unneeded deep folder structure. Or >>> is there a good reason to let the "dbox-Mails" folder in my setup? >>> >>> Greetings, >>> >>> Hativ >>> >> >

2 2

Re: uid problem
by Aki Tuomi 31 Jul '18

31 Jul '18

https://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP Aki On 31.07.2018 14:35, Andras Kemeny wrote: > > can you point me to an url regarding LTMP between postfix and dovecot? > it might be an area worth exploring for me. > > thanks, > a > > > 2018. 07. 31. 12:46 keltezéssel, Aki Tuomi írta: >> >> Well, I don't know about yuuuge security risk (not saying there isn't >> any...), but if this concerns you, you can also use LTMP instead, >> which is probably a better solution here. >> >> Aki >> >> >> On 31.07.2018 13:42, Andras Kemeny wrote: >>> >>> yeah, the only problem about that is it's a yuuuge security risk :), >>> and also, postfix simply won't let me: >>> >>> Jul 31 02:20:37 rhyno postfix/pipe[29532]: fatal: user= command-line >>> attribute specifies root privileges >>> >>> so it's entirely possible i'm knocking on the wrong door, and >>> instead i should be asking this in the postfix mailing list. >>> >>> however, i'm also worried about this: "to bypass this check, set: >>> service auth { unix_listener /var/run/dovecot/auth-userdb { >>> mode=0777 } }", as i have done what it says, and the check wasn't >>> bypassed so i'm wary about something bad coming up once i somehow >>> fix this initial UID problem. >>> >>> thanks, >>> a >>> >>> >>> 2018. 07. 31. 7:12 keltezéssel, Aki Tuomi írta: >>>> You could run dovecot-lda as root. It will setuid to correct account. >>>> >>>> >>>> >>>> --- >>>> Aki Tuomi >>>> Dovecot oy >>>> >>>> -------- Original message -------- >>>> From: Andras Kemeny <pdx(a)pdx.hu> >>>> Date: 31/07/2018 04:46 (GMT+02:00) >>>> To: dovecot(a)dovecot.org >>>> Subject: uid problem >>>> >>>> hi, >>>> >>>> contacting this mailing list is my last-ditch effort to somehow >>>> come to >>>> a working configuration where postfix "ends in" dovecot, IE for >>>> special >>>> LDAP-based users, featured in the virtual mailbox delivery, dovecot >>>> would act as LDA. >>>> >>>> here's the deal. >>>> >>>> i've set up dovecot's access to the LDAP server, and for the >>>> purposes of >>>> being an IMAP server and a SASL auth backend, dovecot works >>>> brilliantly >>>> and without a glitch. i can access my test mailbox (in maildir >>>> format), >>>> i can use the LDA as root and it delivers the message correctly >>>> (after a >>>> switch to the target user's UID), and even postfix's submission works >>>> with dovecot as its SASL backend. >>>> >>>> what does not work is dovecot as LDA from postfix. >>>> >>>> i'm getting these errors in the log: >>>> >>>> Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER >>>> lookup failed >>>> Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client >>>> doesn't >>>> have lookup permissions for this user: userdb uid (10001) doesn't >>>> match >>>> peer uid (5000) (to bypass this check, set: service auth { >>>> unix_listener >>>> /var/run/dovecot/auth-userdb { mode=0777 } }) >>>> Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. >>>> Refer to server log for more information. >>>> >>>> for the sake of clarity, i've tried the "to bypass this check" >>>> instructions, didn't help. >>>> >>>> also, for the sake of operational clarity, "aik" is the LDAP account >>>> with the following parameters: >>>> >>>> dn: uid=aik,ou=People,dc=rhyno,dc=tech >>>> objectClass: account >>>> objectClass: posixAccount >>>> objectClass: postfixUser >>>> cn: aik >>>> uid: aik >>>> uidNumber: 10001 >>>> gidNumber: 10001 >>>> homeDirectory: /home/aik >>>> loginShell: /bin/sh >>>> gecos: aik >>>> description: User account >>>> structuralObjectClass: account >>>> entryUUID: db947584-0369-1038-98b3-675e2f0cea17 >>>> creatorsName: cn=admin,dc=rhyno,dc=tech >>>> createTimestamp: 20180613152616Z >>>> email: *********** >>>> userPassword:: ************************* >>>> mailacceptinggeneralid: andras.kemeny >>>> mailacceptinggeneralid: kemeny.andras >>>> mailacceptinggeneralid: aik >>>> mailacceptinggeneralid: pdx >>>> mailacceptinggeneralid: @rhyno.tech >>>> mailacceptinggeneralid: @rhynotechnologies.com >>>> maildrop: aik >>>> >>>> and postfix's master.cf says: >>>> >>>> dovecot unix - n n - - pipe >>>> flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f >>>> ${sender} -d ${user} >>>> >>>> so i'm stuck at this point. obviously, if the LDA is spawned with >>>> vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and >>>> passwd >>>> accounts were once connected, but for security reasons, the connection >>>> has been severed -- still the /home/aik/mail dir is owned by uid >>>> 10001 etc). >>>> >>>> what am i doint wrong? >>>> >>>> thanks, >>>> a >>> >> >

1 0

Almost there with Sieve
by Danny Horne 31 Jul '18

31 Jul '18

Hi all, Dovecot - 2.2.35 Pigeonhole - 0.4.23 I've recently moved mail filtering from local filtering (using Thunderbird) to Sieve. I've got filtering into folders and flagging emails working fine, but for possibly one tiny glitch. When specifying folders to filter into I have to use the format 'INBOX/Folder name' instead of just 'Folder name'. Can this be corrected? No real biggie but would be nice if it could. [root@kepler ~]# dovecot -n # 2.2.35 (b1cb664): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.23 (b2e41927) # OS: Linux 4.17.3-200.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight) xfs # Hostname: kepler.trisect.uk auth_mechanisms = cram-md5 base_dir = /var/run/dovecot/ mail_access_groups = mail mail_home = /var/spool/vhosts/homedir/%d/%n mail_location = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/mail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=cram-md5 /etc/cram-md5.pwd driver = passwd-file } passdb { driver = pam } plugin { sieve = file:/var/spool/vhosts/sieve-scripts;active=/var/spool/vhosts/sieve-scripts/%u.sieve sieve_user_email = postmaster(a)trisect.uk } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 0 vsz_limit = 256 M } service managesieve { process_limit = 1024 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail driver = static } userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 200 } protocol sieve { mail_max_userip_connections = 25 managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } Thanks for looking

2 2

Re: uid problem
by Aki Tuomi 31 Jul '18

31 Jul '18

Well, I don't know about yuuuge security risk (not saying there isn't any...), but if this concerns you, you can also use LTMP instead, which is probably a better solution here. Aki On 31.07.2018 13:42, Andras Kemeny wrote: > > yeah, the only problem about that is it's a yuuuge security risk :), > and also, postfix simply won't let me: > > Jul 31 02:20:37 rhyno postfix/pipe[29532]: fatal: user= command-line > attribute specifies root privileges > > so it's entirely possible i'm knocking on the wrong door, and instead > i should be asking this in the postfix mailing list. > > however, i'm also worried about this: "to bypass this check, set: > service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 > } }", as i have done what it says, and the check wasn't bypassed so > i'm wary about something bad coming up once i somehow fix this initial > UID problem. > > thanks, > a > > > 2018. 07. 31. 7:12 keltezéssel, Aki Tuomi írta: >> You could run dovecot-lda as root. It will setuid to correct account. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Andras Kemeny <pdx(a)pdx.hu> >> Date: 31/07/2018 04:46 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: uid problem >> >> hi, >> >> contacting this mailing list is my last-ditch effort to somehow come to >> a working configuration where postfix "ends in" dovecot, IE for special >> LDAP-based users, featured in the virtual mailbox delivery, dovecot >> would act as LDA. >> >> here's the deal. >> >> i've set up dovecot's access to the LDAP server, and for the purposes of >> being an IMAP server and a SASL auth backend, dovecot works brilliantly >> and without a glitch. i can access my test mailbox (in maildir format), >> i can use the LDA as root and it delivers the message correctly (after a >> switch to the target user's UID), and even postfix's submission works >> with dovecot as its SASL backend. >> >> what does not work is dovecot as LDA from postfix. >> >> i'm getting these errors in the log: >> >> Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER >> lookup failed >> Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client doesn't >> have lookup permissions for this user: userdb uid (10001) doesn't match >> peer uid (5000) (to bypass this check, set: service auth { unix_listener >> /var/run/dovecot/auth-userdb { mode=0777 } }) >> Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. >> Refer to server log for more information. >> >> for the sake of clarity, i've tried the "to bypass this check" >> instructions, didn't help. >> >> also, for the sake of operational clarity, "aik" is the LDAP account >> with the following parameters: >> >> dn: uid=aik,ou=People,dc=rhyno,dc=tech >> objectClass: account >> objectClass: posixAccount >> objectClass: postfixUser >> cn: aik >> uid: aik >> uidNumber: 10001 >> gidNumber: 10001 >> homeDirectory: /home/aik >> loginShell: /bin/sh >> gecos: aik >> description: User account >> structuralObjectClass: account >> entryUUID: db947584-0369-1038-98b3-675e2f0cea17 >> creatorsName: cn=admin,dc=rhyno,dc=tech >> createTimestamp: 20180613152616Z >> email: *********** >> userPassword:: ************************* >> mailacceptinggeneralid: andras.kemeny >> mailacceptinggeneralid: kemeny.andras >> mailacceptinggeneralid: aik >> mailacceptinggeneralid: pdx >> mailacceptinggeneralid: @rhyno.tech >> mailacceptinggeneralid: @rhynotechnologies.com >> maildrop: aik >> >> and postfix's master.cf says: >> >> dovecot unix - n n - - pipe >> flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f >> ${sender} -d ${user} >> >> so i'm stuck at this point. obviously, if the LDA is spawned with >> vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and passwd >> accounts were once connected, but for security reasons, the connection >> has been severed -- still the /home/aik/mail dir is owned by uid >> 10001 etc). >> >> what am i doint wrong? >> >> thanks, >> a >

1 0

2.3.2.1 - EC keys suppport?
by ѽ҉ᶬḳ℠ 31 Jul '18

31 Jul '18

Hi, facing [ no shared cipher ] error with EC private keys. This happens when the private key is generated with [ openssl ecparam -name brainpoolP512t1 -genkey ] with OpenSSL 1.1.0hh on the same machine Dovecot is running on. Tried some variations of [ ssl_cipher_list ] but to no avail - the [ no shared cipher ] error persists. Once the key is generated with [ openssl genpkey -algorithm RSA ] however the error is gone. Thus wondering whether (1) I am missing something or (2) this a bug or (3) there is no support for EC keys?

3 21

Re: dsync: expunge from pop3 does not replicate
by Jakub Lánský 31 Jul '18

31 Jul '18

Here is it # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (5d6d7c92) # OS: Linux 4.4.0-112-generic x86_64 Ubuntu 16.04.4 LTS # Hostname: mda22 auth_cache_negative_ttl = 2 secs auth_cache_size = 16 M auth_cache_ttl = 1 mins auth_master_user_separator = / auth_mechanisms = plain login auth_verbose = yes default_client_limit = 2000 default_process_limit = 2000 default_vsz_limit = 16894 M deliver_log_format = %m %f/%e %s -> %e %p: %$ dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlsieve = mysql:/etc/dovecot/dovecot-dict-sqlsieve.conf.ext } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_rcpt_check_quota = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 10.3.13.0/24 10.3.14.0/24 mail_gid = nogroup mail_home = /datastore/maildir/%d/%n mail_location = maildir:~/ mail_plugins = " quota mail_log notify old_stats replication" mail_uid = nobody maildir_copy_with_hardlinks = no managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Inbox { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = box msgid from subject size mail_replica = tcp:10.3.13.51:54321 old_stats_command_min_time = 1 mins old_stats_domain_min_time = 12 hours old_stats_ip_min_time = 12 hours old_stats_memory_limit = 16 M old_stats_refresh = 30 secs old_stats_session_min_time = 15 mins old_stats_track_cmds = yes old_stats_user_min_time = 1 hours quota = dict:User quota::proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 50%% quota_warning = storage=95%% quota-warning 95 %u %d size quota_warning2 = messages=95%% quota-warning 95 %u %d count recipient_delimiter = + sieve = file:/datastore/sieve/%d/%n/;active=/datastore/sieve/%d/%n/active.sieve sieve_before = dict:proxy::sqlsieve;name=before_inbox_forward;bindir=/datastore/sieve/%d/%n/ sieve_max_actions = 32 sieve_max_redirects = 50 sieve_max_script_size = 1M sieve_redirect_envelope_from = recipient sieve_user_log = /datastore/sieve/%d/%n/.sieve.log } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_reuse_xuidl = yes pop3_save_uidl = yes protocols = " imap lmtp sieve pop3 sieve" replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = nobody } unix_listener replication-notify { mode = 0666 user = nobody } } service auth { inet_listener { port = 12345 ssl = yes } } service dict { unix_listener dict { group = nogroup user = nobody } } service doveadm { inet_listener { port = 54321 ssl = no } } service imap-login { process_limit = 32 process_min_avail = 8 service_count = 0 } service imap { process_limit = 16384 } service lmtp { executable = lmtp -L inet_listener lmtp { port = 24 ssl = no } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 2 service_count = 1 vsz_limit = 196 M } service managesieve { process_limit = 2048 } service old-stats { fifo_listener old-stats-mail { mode = 0666 user = nobody } inet_listener { address = 127.0.0.1 port = 24242 } } service pop3 { process_limit = 2048 } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { mode = 0666 user = nobody } user = nobody } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 user = nobody } } service stats { idle_kill = 5 mins unix_listener stats-reader { group = nogroup mode = 0666 user = nobody } unix_listener stats-writer { group = nogroup mode = 0666 user = nobody } } ssl_cert = </etc/dovecot/private/mda.vshosting.cloud/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 10.3.14.30:587 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota mail_log notify old_stats replication sieve" } protocol lda { mail_plugins = " quota mail_log notify old_stats replication sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota mail_log notify old_stats replication imap_quota imap_old_stats" } protocol sieve { managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 50 } -- Jakub Lánský IT administration/support technician jakub(a)lansky.biz GSM: +420776172737 Jabber/GTalk: lenny(a)blesmrt.net -------- Původní zpráva -------- Od: Aki Tuomi <aki.tuomi(a)dovecot.fi> Komu: Jakub Lánský <jakub(a)lansky.biz>, dovecot(a)dovecot.org Předmět: Re: dsync: expunge from pop3 does not replicate Datum: Wed, 25 Jul 2018 14:04:14 +0300 Please provide doveconf -n --- Aki Tuomi Dovecot oy -------- Original message -------- From: Jakub Lánský <jakub(a)lansky.biz> Date: 25/07/2018 11:37 (GMT+02:00) To: dovecot(a)dovecot.org Subject: dsync: expunge from pop3 does not replicate Hi, I'm using dovecot 2.3.2.1 on Xenial from upstream packages on two Dovecot servers connected with dsync over TCP. E-mails which are deleted via POP3 protocol are not correctly deleted on second server via dsync. Jul 25 09:29:19 mda11 dovecot: pop3(jakub@***)<7587><8xaJ1c1x9uEqAB7QADwAAAAAAAAAAL7v>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Nothing happened on the second machine then. After running # doveadm replicator replicate "jakub@***", e-mail got expunged immediately on second server. Jul 25 09:50:56 mda22 dovecot: dsync- local(jakub@***)<Xt6oFy8nWFsjIwAA0YRh9g>: expunge: box=INBOX, msgid=< 6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Any ideas what to do or test? Thank you

2 3

Welcome plugin - user and domain vars?
by Tony 31 Jul '18

31 Jul '18

Hi List, I have multiple mail domains and depending on the domain name was looking for a way to pass the user and domain into a welcome.sh script. I looked at the quota script and saw of the 3 vars one of them is for the user. BOUNDARY="$1" USER="$2" MSG="" For the username - could we still reference USER="$2" in order to pass the username in the welcome email or is this only supported with the quota plugin? For the domain - how could one pass the 1st time login user's mail domain to the script? I looked at the welcome-plugin.c source, but didn't find anything that might reference a domain. Ideally I was hoping maybe something similar to the quota script could work.. MSG="" if [[ "$DOMAIN" = "domain.net" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.com" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.me" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.email" ]]; then MSG="..." fi Thanks for any suggestions. Cheers, Tony

2 1

uid problem
by Andras Kemeny 31 Jul '18

31 Jul '18

hi, contacting this mailing list is my last-ditch effort to somehow come to a working configuration where postfix "ends in" dovecot, IE for special LDAP-based users, featured in the virtual mailbox delivery, dovecot would act as LDA. here's the deal. i've set up dovecot's access to the LDAP server, and for the purposes of being an IMAP server and a SASL auth backend, dovecot works brilliantly and without a glitch. i can access my test mailbox (in maildir format), i can use the LDA as root and it delivers the message correctly (after a switch to the target user's UID), and even postfix's submission works with dovecot as its SASL backend. what does not work is dovecot as LDA from postfix. i'm getting these errors in the log: Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER lookup failed Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client doesn't have lookup permissions for this user: userdb uid (10001) doesn't match peer uid (5000) (to bypass this check, set: service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 } }) Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. for the sake of clarity, i've tried the "to bypass this check" instructions, didn't help. also, for the sake of operational clarity, "aik" is the LDAP account with the following parameters: dn: uid=aik,ou=People,dc=rhyno,dc=tech objectClass: account objectClass: posixAccount objectClass: postfixUser cn: aik uid: aik uidNumber: 10001 gidNumber: 10001 homeDirectory: /home/aik loginShell: /bin/sh gecos: aik description: User account structuralObjectClass: account entryUUID: db947584-0369-1038-98b3-675e2f0cea17 creatorsName: cn=admin,dc=rhyno,dc=tech createTimestamp: 20180613152616Z email: *********** userPassword:: ************************* mailacceptinggeneralid: andras.kemeny mailacceptinggeneralid: kemeny.andras mailacceptinggeneralid: aik mailacceptinggeneralid: pdx mailacceptinggeneralid: @rhyno.tech mailacceptinggeneralid: @rhynotechnologies.com maildrop: aik and postfix's master.cf says: dovecot unix - n n - - pipe flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f ${sender} -d ${user} so i'm stuck at this point. obviously, if the LDA is spawned with vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and passwd accounts were once connected, but for security reasons, the connection has been severed -- still the /home/aik/mail dir is owned by uid 10001 etc). what am i doint wrong? thanks, a

2 1

dovecot 2.3.x, ECC and wildcard certificates, any issues
by David Mehler 31 Jul '18

31 Jul '18

Hello, Does dovecot 2.3.x have any issues recognizing or using certificates that are ECC and wildcard? I'm trying to switch my letsencrypt implementation from acme-client which does not support either of those capabilities to acme.sh which does. Since then external clients checking their email has not worked. A manual telnet to mail.example.com 993 gives a connected message but then nothing no greeting or capabilities. The certificate is for example.com with an alt name of *.example.com if that's not right let me know, i'm not sure about that one, connecting to the web sites of these pages seems noticeably slower, I'm wondering if both of these issues aren't key related? Thanks. Dave.

5 12

mdbox_deleted proper syntax
by Johan Huldtgren 31 Jul '18

31 Jul '18

hello, on the wiki, https://wiki2.dovecot.org/MailboxFormat/dbox, it says that one can use either doveadm fetch or doveadm import, however I can find no correct syntax with fetch that'll actually work. Is the idea to simply override the mail_location with -o ? That seems to work for doveadm mailbox but not for doveadm fetch or search # doveadm -f table mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 1362145026 0 1 164208086 64bd9f0003af305190040000b9256959 1471825482 # doveadm -f table -o "mail_location=mdbox_deleted:~/mdbox" mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 0 0 1 0 ddb9421479f0595bf21b0100b9256959 18446744073709551615 # doveadm -f flow fetch -u johan size.virtual mailbox dovecot size.virtual=2869 size.virtual=2960 size.virtual=8023 size.virtual=6683 ... # # doveadm -f flow -o "mail_location=mdbox_deleted:~/mdbox" fetch -u johan size.virtual mailbox dovecot # # doveadm search -u johan mailbox dovecot subject "LMTP Log" 64bd9f0003af305190040000b9256959 8642 64bd9f0003af305190040000b9256959 21302 64bd9f0003af305190040000b9256959 21373 64bd9f0003af305190040000b9256959 21420 64bd9f0003af305190040000b9256959 21434 64bd9f0003af305190040000b9256959 21435 64bd9f0003af305190040000b9256959 21460 64bd9f0003af305190040000b9256959 21461 64bd9f0003af305190040000b9256959 21463 64bd9f0003af305190040000b9256959 23684 # doveadm -o "mail_location=mdbox_deleted:~/mdbox" search -u johan mailbox dovecot subject "LMTP Log" # What I'm really trying to accomplish is see if a mail which a user deleted still exists in mdbox_deleted, so I wanted to do a fetch / search to see and then try to copy / import that message back. This is on OpenBSD 6.3-current with dovecot 2.2.36, doveconf -n below. thanks, .jh --- # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: OpenBSD 6.3 amd64 # Hostname: www.example.com auth_mechanisms = plain login first_valid_gid = 0 first_valid_uid = 507 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_id_log = * last_valid_uid = 1059 listen = 127.0.0.1 mail_home = /home/vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = stats fts fts_solr mail_privileged_group = _dovecot mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = mailbox spam { auto = subscribe special_use = \Junk } mailbox drafts { auto = subscribe special_use = \Drafts } mailbox sent-mail { auto = subscribe special_use = \Sent } mailbox trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-pgsql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-pgsql2.conf driver = sql } passdb { args = cache_key=%u%r%l * driver = bsdauth } plugin { antispam_backend = mailtrain antispam_mail_notspam = learn_ham antispam_mail_sendmail = /usr/local/bin/rspamc antispam_mail_sendmail_args = -h;127.0.0.1:11334;-P;q1 antispam_mail_spam = learn_spam antispam_spam = caughtspam antispam_trash = trash fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/dovecot/sieve/before/ sieve_default = /var/dovecot/sieve/default.sieve sieve_extensions = +spamtest +spamtestplus +virustest sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = _postfix mode = 0666 user = _postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_limit = 200 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix user = _postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service stats { fifo_listener stats-mail { mode = 0666 user = _postfix } } ssl = required ssl_cert = </etc/ssl/acme/example.com/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = uid=507 gid=507 driver = static } userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = stats fts fts_solr sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = stats fts fts_solr antispam imap_stats }

2 2

Doveadm protocol; dovecot v2.2.10
by David White 31 Jul '18

31 Jul '18

Hi there, Just wondering what is considered current best practice for managing dovecot? The options I see are: Doveadm binary Doveadm protocol via socket Doveadm http protocol I’m currently on v2.2.10 and it appears the doveadm protocol command set is limited to just the “mailbox” commands and the http protocol hasn’t been implemented. Is the doveadm http protocol still experimental in v2.3.2? Thanks, David White ISP Engineer Trustpower T 021 223 6208 E david.white(a)trustpower.co.nz<mailto:david.white@trustpower.co.nz> Trustpower Limited, Private Bag 12023, Tauranga Mail Centre, Tauranga 3143 ------------------------------------------------------------------------------------ The contents of this email and any attachments are confidential and may be privileged. If you are not the intended recipient, you may not use, copy or disclose this email or its attachments. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete both emails from your system. It is your responsibility to check this email and any attachments for viruses or other harmful code before opening or sending on. Trustpower Limited and its subsidiaries (collectively, Trustpower) accepts no responsibility for any such virus or any effects of a virus on your systems or data. Trustpower does not endorse anything in this email that is not related to its official business. Please think of the environment before printing this email. ------------------------------------------------------------------------------------

2 1

2.3.2.1 - ssl_alt_key revealed with dovecot -n
by ѽ҉ᶬḳ℠ 31 Jul '18

31 Jul '18

Seems like a minor cosmetic bug with [ dovecot -n ] ssl_alt_key = </etc/pki/private/some.key.pem ssl_key = # hidden, use -P to show it

1 0

Restricting SSL/TLS protocol versions on Dovecot 2.2.22
by J Doe 30 Jul '18

30 Jul '18

Hello, I have a question regarding SSL/TLS settings for Dovecot version 2.2.22. In: 10-ssl.conf there are two parameters: ssl_protocols ssl_cipher_list ssl_protocols is commented with “SSL protocol to use” and ssl_cipher_list is commented with “SSL ciphers to use”. If I want to disable SSLv3, for example, do I need to use both parameters or will disabling SSLv3 ciphers in ssl_cipher_list do the same thing ? So is: ssl_cipher_list = !SSLv3 …equivalent to: ssl_protocols = !SSLv3 ssl_cipher_list = !SSLv3 Thanks, - J

4 4

[Dovecot] quota-status not working in distributed environment
by Benoit Panizzon 30 Jul '18

30 Jul '18

Hello List Quick overview of our set-up: Postfix / Dovecot (2.2.2.1) / MySQL Cluster on (at the moment) three Servers to create a HA environment where you could easily add additional servers as the demand or load grows. Circular dovecot replication is used so each server uses another one as replication partner and allowing one server to fail. Dovecot Proxy Feature being used, so we can use round-robin DNS and each server can forward the connecting user to the correct 'master' for his mailbox. So far, everything works as expected. Now we want to reject emails to 'full' mailboxes during SMTP to prevent backscatter and use the quota-status policy service from within postfix. That works fine, if the mailbox or it's replica is present on the machine where quota-status is called, but it fails if it's run on a machine where neither the mailbox or the replica is present. In our case, we get a correct SMTP 550 'Mailbox Full' Reject in two cases and a LMTP generated bounce in the later case. Also `doveadm quota get -u user(a)example.com` return the correct quota if run on the two machines which have the mailbox and it's copy locale, but return 0% used if run on the other machine. Is there a way to get quota-status to also use the proxy feature to request the quota information from the correct machine? Or is the postfix policy daemon call to the quota-status socket documented somewhere (it must be, but where?) so we could implement it from within the Milter? (we use the sendmail Milter API from postfix to filter spam and viruses, do sender/recipient rewriting, forward bounce matching, rate limmiting, login/IP statistics to block botnets abusing phished addresses and legal intercept stuff anyway) Kind regards Benoit Panizzon -- I m p r o W a r e A G - ______________________________________________________ Zurlindenstrasse 29 Tel +41 61 826 93 07 CH-4133 Pratteln Fax +41 61 826 93 02 Schweiz Web http://www.imp.ch ______________________________________________________

5 6

OT - copied maildir from 2T drive to 4T drive
by Marc Perkel 30 Jul '18

30 Jul '18

And it's taking up more space on the 4T drive. What did I miss?

2 1

[SOLR] Where is solr-schema.xml?
by Peter Nabbefeld 27 Jul '18

27 Jul '18

Hello, running dovecot 2.3.2.1 on Arch Linux, and installed solr 7.4.0. According to the wiki, there should be doc/solr-schema.xml, but I cannot find it. Tried "whereis dovecot": dovecot: /usr/bin/dovecot /usr/lib/dovecot /etc/dovecot /usr/include/dovecot /usr/share/dovecot /usr/share/man/man1/dovecot.1.gz But I cannot find any xml files using find /usr/{lib,share}/dovecot -name "*.xml" Kind regards Peter

4 5

Imap post-login script
by j.emerlik 27 Jul '18

27 Jul '18

Dovecot v.2.2.32 and I have configured two imap post-login scripts and it seems like after successfully login scripts are not closed (dovecot_node/imap imap-postlogin : multiple processes are running still) and after some times there are too many processes and the limit is reached (imap proces_limit 1500): 1) #!/bin/sh case $IP in 10.10.1[1-2][0-7].*) exec "$@" ;; 10.11.2.4[0-9]) exec "$@" ;; esac CHECK_USER=`PGPASSWORD="password" /usr/local/pg952/bin/psql -h 10.11.1.3 -q -t -U postfixuser -d mail -c "select imap_allowed from users where name = '$USER' LIMIT 1"` if [ $CHECK_USER == "t" ] ; then exec "$@" fi if [ $CHECK_USER == "f" ] ; then exit 0 fi 2) PGPASSWORD="password" /usr/local/pg952/bin/psql -U postfixuser -d mail2 -h 10.11.1.3 -c "select last_auth('$USER','$RIP2','1')" > /dev/null exec "$@" Regards, Jack

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 26 Jul '18

26 Jul '18

Hi There! I run into this problem with virtual Mailboxes on release-2.3.2 (and also in master and in older versions of dovecot) I added the core-file. Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7ffad9ac0eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffad9a2efe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7ffad9bbb1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7ffad9792b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7ffad9792d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7ffad9795f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b4602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b460 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): child 11292 killed with signal 6 (core dumped) Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: AUTH 19 PLAIN service=imap secured=tls session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 20 lport=143 rport=41758 local_name=aldebaran.xundeenergie.at ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: CONT 19 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: CONT<hidden> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: OK 19 user=jakob Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: REQUEST 2436366337 10570 19 dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 request_auth_token Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb out: USER 2436366337 jakob home=/var/mail/jakob acl_groups=home,admin auth_token=3ea3b630e131 3bf5beb0f26ff740450189f63e3e Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, mpid=11298, TLS, session=<9KKNZclxHqPAqADc> Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7fbd982b2eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbd98220fe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fbd983ad1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7fbd97f84b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7fbd97f84d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7fbd97f87f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa6602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd98411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa660 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] Jul 25 04:11:30 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): child 11298 killed with signal 6 (core dumped) jakob

4 12

doveadm who reverse dns lookups
by Michael Grant 25 Jul '18

25 Jul '18

Perhaps this is a feature request... It would be nice if the ‘doveadm who’ command printed out the reverse dns name of where the user was logged in from. Would it be possible to either add some option to doveadm who for this, or make it the do it by default and add a ‘-n’ option (like many of the other programs that look up ip addresses by default) and take a -n option to not do that? Not sure if that would break some existing thing which is why I hesitate. Might be safer to add, say, a -r option to do the rDNS lookup. However, it would definitely save me a step in figuring out where someone was logged in from to know if it’s legit. Michael Grant

3 2

Re: doveadm expunge didn't clear Trash mailbox
by Joseph Tam 25 Jul '18

25 Jul '18

On Mon, 23 Jul 2018, Michael Wagner wrote: > here works a dovecot 2.2.27 on a raspberrypi and the behaviour is as > expected. > > doveadm -f tab fetch -u <user> "uid date.saved" mailbox Trash > uid date.saved > 314 2018-06-23 00:35:59 > 315 2018-06-23 12:39:10 > 316 2018-06-24 10:32:43 > ... > > And I have a cron script that expunges the mails older than 30 days. > /usr/bin/doveadm expunge -u <user> mailbox Trash savedbefore 30d Hi Michael, Thanks for your observation. I think you probably use maildir format, yes? I think my problem stems from the fact I use mbox, so one file contains many messages, whereas maildir uses one file for each message. Dovecot, from my understanding, will use the message file's mtime for date.saved if it doesn't have it in the cached. This is probably why I am seeing multiple messages with the same value. What's confusing is that if I query a message's date.saved, that value -- whether from the cache or the mailbox's mtime -- remains in the cache, so the next query will give me that value. So running "doveadm fetch ... date.saved", will get the mailbox's mtime at the time I fetched those values. In order to get near accurate date.saved values, I would have to run "doveadm fetch ... date.saved" frequently. (I think this behaviour must have changed recently because this no longer works consistently.) However, if each message is stored in a separate file (like maildir does), then each message can have an accurate date.saved(=mtime). Once you have accurate date.saved, then the "expunge savedbefore" works correctly. Another reason I really ought to switch to maildir. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: Panic: Leaked view for index - virtual mailbox
by Jakob Schuerz 25 Jul '18

25 Jul '18

1 0

Re: Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 25 Jul '18

25 Jul '18

Hi Aki! Sorry. Here is the right output. # gdb /usr/local/libexec/dovecot/imap /var/core/24491 GNU gdb (Debian 8.1-3) 8.1 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/libexec/dovecot/imap...(no debugging symbols found)...done. [New LWP 24491] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap [jakob 213'. Program terminated with signal SIGABRT, Aborted. #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51 ../sysdeps/unix/sysv/linux/raise.c: Datei oder Verzeichnis nicht gefunden. (gdb) bt full #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 set = {__val = {0, 140735982403592, 140035444961075, 2331576704, 12138802451775488, 140035444733018, 206158430240, 4096, 140735982403592, 94124639053616, 4096, 443744500087950336, 2389, 2380, 2381, 94124639053616}} pid = <optimized out> tid = <optimized out> ret = <optimized out> #1 0x00007f5c8ac4e2f1 in __GI_abort () at abort.c:79 save_stage = 1 act = {__sigaction_handler = {sa_handler = 0x33580, sa_sigaction = 0x33580}, sa_mask = {__val = {2048, 140035446034307, 140035441399298, 140035443714067, 140035445631889, 140035441273723, 140035445630673, 94124639049440, 443744500087950336, 512, 140035444801458, 140735982404016, 94124639049440, 140735982404016, 140035444801849, 94124639049440}}, sa_flags = -1964120006, sa_restorer = 0x5} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007f5c8aee5daf in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00007f5c8aee5eba in ?? () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x00007f5c8ae53fe8 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x00007f5c8b08b028 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x00007f5c8b06272a in index_storage_mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #7 0x00007f5c8afe01aa in mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #8 0x00007f5c8abb7b80 in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #9 0x00007f5c8abb7d3b in virtual_backend_box_open () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #10 0x00007f5c8abbaf19 in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #11 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #12 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #13 0x00007f5c8b060ed1 in index_storage_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #14 0x00007f5c8abb6ead in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #15 0x00007f5c8b044f83 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #16 0x00007f5c8abd9602 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #17 0x00007f5c8ae0e813 in ?? () from /usr/local/lib/dovecot/lib01_acl_plugin.so No symbol table info available. #18 0x00007f5c8afe2b91 in mailbox_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #19 0x00007f5c8abbab7b in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #20 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #21 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #22 0x00007f5c8b060ed1 in index_storage_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #23 0x00007f5c8abb6ead in ?? () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #24 0x00007f5c8b044f83 in ?? () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #25 0x00007f5c8abd9602 in ?? () from /usr/local/lib/dovecot/lib20_fts_plugin.so No symbol table info available. #26 0x00007f5c8ae0e813 in ?? () from /usr/local/lib/dovecot/lib01_acl_plugin.so No symbol table info available. #27 0x00007f5c8afe2b91 in mailbox_get_status () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #28 0x00007f5c8abbab7b in virtual_storage_sync_init () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #29 0x00007f5c8afe26d1 in mailbox_sync_init () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #30 0x00007f5c8afe2787 in mailbox_sync () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #31 0x0000559b17308ace in cmd_select_full () No symbol table info available. #32 0x0000559b17310384 in command_exec () No symbol table info available. #33 0x0000559b1730e832 in ?? () No symbol table info available. #34 0x0000559b1730e8cc in ?? () No symbol table info available. #35 0x0000559b1730ecd5 in client_handle_input () No symbol table info available. #36 0x0000559b1730f2f4 in client_input () No symbol table info available. #37 0x00007f5c8aefe009 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #38 0x00007f5c8aeff8ce in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #39 0x00007f5c8aefe10c in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #40 0x00007f5c8aefe318 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #41 0x00007f5c8ae78413 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #42 0x0000559b17300f81 in main () No symbol table info available. (gdb) quit Jakob Am 25.07.2018 um 10:01 schrieb Aki Tuomi: > Try running gdb again with corrected path for imap binary > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Jakobus Schürz <jakobus.schuerz(a)ebcont.com> > Date: 25/07/2018 10:46 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Panic: Leaked view for index - virtual mailbox > > Hi Aki! > > The config is in the attachment. > > The output from gdb is this: > > > # gdb /usr/lib/dovecot/imap /var/core/24491 > GNU gdb (Debian 8.1-3) 8.1 > Copyright (C) 2018 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <http://www.gnu.org/software/gdb/bugs/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > For help, type "help". > Type "apropos word" to search for commands related to "word"... > /usr/lib/dovecot/imap: Datei oder Verzeichnis nicht gefunden. > [New LWP 24491] > Core was generated by `dovecot/imap [jakob 213'. > Program terminated with signal SIGABRT, Aborted. > #0 0x00007f5c8ac4cf3b in ?? () > (gdb) bt full > #0 0x00007f5c8ac4cf3b in ?? () > No symbol table info available. > #1 0x0000000000000000 in ?? () > No symbol table info available. > (gdb) quit > > And i have a complex setup for virtual mailboxes... > > For Synoptic/AKTUELL it is: > > # cat /var/mail/virtual/AKTUELL/dovecot-virtual > !Real/halbjahr > all > > And for Real/halbjahr it is: > > # cat /var/mail/real/halbjahr/dovecot-virtual > !Real/Alle > all younger 15768000 > > And for Real/Alle it is: > > # cat /var/mail/real/Alle/dovecot-virtual > !INBOX > INBOX/* > -INBOX/Trash > -INBOX/Trash/* > -INBOX/Archives > -INBOX/Archives/* > -INBOX/Drafts > -INBOX/Drafts/* > -INBOX/Junk > -INBOX/Junk/* > -INBOX/SYSTEM > -INBOX/SYSTEM/* > all > > > jakob > > > Am 25.07.2018 um 09:11 schrieb Aki Tuomi: > > So the core file is not very useful... > > > > can you, instead, attach your doveconf -n and your virtual folder > configurations and also > > > > gdb /usr/lib/dovecot/imap /path/to/core > > bt full > > > > Aki > > > >> On 25 July 2018 at 09:55 Jakobus Schürz > <jakobus.schuerz(a)ebcont.com> wrote: > >> > >> > >> Hi Aki! > >> > >> This is debian buster, but a self-compiled dovecot from git! > >> > >> /usr/local/sbin/dovecot --version > >> 2.3.2.1 (0719df592) > >> > >> jakob > >> > >> > >> Am 25.07.2018 um 08:30 schrieb Aki Tuomi: > >>> And can you provide dovecot --version too, please. > >>> > >>> Aki > >>> > >>>> On 25 July 2018 at 09:18 Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > >>>> > >>>> > >>>> Hi! > >>>> > >>>> Which debian release is this? > >>>> > >>>> Aki > >>>> > >>>>> On 25 July 2018 at 05:18 Jakobus Schürz > <jakobus.schuerz(a)ebcont.com> wrote: > >>>>> > >>>>> > >>>>> Hi There! > >>>>> > >>>>> I run into this problem with virtual Mailboxes on release-2.3.2 (and > >>>>> also in master and in older versions of dovecot) > >>>>> > >>>>> I added the core-file. > >>>>> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index > >>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: > Opened > >>>>> in index-storage.c:338 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+ > >>>>> 0xceeba) [0x7ffad9ac0eba] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7ffad9a2efe8] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) > >>>>> [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s > >>>>> torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) > >>>>> [0x7ffad9bbb1aa] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 > >>>>> x7ffad9792b80] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) > >>>>> [0x7ffad9792d3b] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) > >>>>> [0x7ffad9795f1 > >>>>> 9] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7ffad9bbd6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo > >>>>> vecot-storage.so.0(index_storage_get_status+0x31) > [0x7ffad9c3bed1] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) > [0x7ffad9791ead] > >>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad > >>>>> 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7ffad97b4602] -> > /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7ffad99e9813] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox > >>>>> _get_status+0x31) [0x7ffad9bbdb91] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) > >>>>> [0x7ffad9795b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 > >>>>> x7ffad9bbd6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7ffad9bbd787] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) > >>>>> [0x7ffad9c3bed1] -> /usr/loca > >>>>> l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) > >>>>> [0x7ffad9c1ff83] -> > /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7ffad97b460 > >>>>> 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7ffad99e9813] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) > >>>>> [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug > >>>>> in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7ffad9bbd6d1] > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): > >>>>> child 11292 killed with signal 6 (core dumped) > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: > >>>>> AUTH 19 PLAIN service=imap secured=tls > >>>>> session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 > >>>>> 20 lport=143 rport=41758 > >>>>> local_name=aldebaran.xundeenergie.at > >>>>> ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 > >>>>> ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb > >>>>> out: CONT 19 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: > >>>>> CONT<hidden> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: > >>>>> passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: > user=jakob > >>>>> file=/usr/local/etc/dovecot/users > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb > >>>>> out: OK 19 user=jakob > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: > >>>>> REQUEST 2436366337 10570 19 > >>>>> dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 > request_auth_token > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: > >>>>> passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: > user=jakob > >>>>> file=/usr/local/etc/dovecot/users > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb > >>>>> out: USER 2436366337 jakob home=/var/mail/jakob > >>>>> acl_groups=home,admin auth_token=3ea3b630e131 > >>>>> 3bf5beb0f26ff740450189f63e3e > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: > >>>>> user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, > >>>>> mpid=11298, TLS, session=<9KKNZclxHqPAqADc> > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index > >>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: > Opened > >>>>> in index-storage.c:338 > >>>>> Jul 25 04:11:29 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(+ > >>>>> 0xceeba) [0x7fbd982b2eba] -> > >>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7fbd98220fe8] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) > >>>>> [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s > >>>>> torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) > >>>>> [0x7fbd983ad1aa] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 > >>>>> x7fbd97f84b80] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) > >>>>> [0x7fbd97f84d3b] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) > >>>>> [0x7fbd97f87f1 > >>>>> 9] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7fbd983af6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo > >>>>> vecot-storage.so.0(index_storage_get_status+0x31) > [0x7fbd9842ded1] -> > >>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) > [0x7fbd97f83ead] > >>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 > >>>>> 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7fbd97fa6602] -> > /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7fbd981db813] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox > >>>>> _get_status+0x31) [0x7fbd983afb91] -> > >>>>> > /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) > >>>>> [0x7fbd97f87b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 > >>>>> x7fbd983af6d1] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) > >>>>> [0x7fbd983af787] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) > >>>>> [0x7fbd9842ded1] -> /usr/loca > >>>>> l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> > >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) > >>>>> [0x7fbd98411f83] -> > /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) > >>>>> [0x7fbd97fa660 > >>>>> 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) > >>>>> [0x7fbd981db813] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) > >>>>> [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug > >>>>> in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> > >>>>> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) > >>>>> [0x7fbd983af6d1] > >>>>> Jul 25 04:11:30 aldebaran dovecot[10573]: > >>>>> imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): > >>>>> child 11298 killed with signal 6 (core dumped) > >>>>> > >>>>> > >>>>> jakob > >>>>> >

1 0

dsync: expunge from pop3 does not replicate
by Jakub Lánský 25 Jul '18

25 Jul '18

Hi, I'm using dovecot 2.3.2.1 on Xenial from upstream packages on two Dovecot servers connected with dsync over TCP. E-mails which are deleted via POP3 protocol are not correctly deleted on second server via dsync. Jul 25 09:29:19 mda11 dovecot: pop3(jakub@***)<7587><8xaJ1c1x9uEqAB7QADwAAAAAAAAAAL7v>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Nothing happened on the second machine then. After running # doveadm replicator replicate "jakub@***", e-mail got expunged immediately on second server. Jul 25 09:50:56 mda22 dovecot: dsync-local(jakub@***)<Xt6oFy8nWFsjIwAA0YRh9g>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Any ideas what to do or test? Thank you -- Jakub Lánský IT administration/support technician jakub(a)lansky.biz GSM: +420776172737 Jabber/GTalk: lenny(a)blesmrt.net

2 1

Dsync fails to connect to remote IMAP server
by Andrzej Polatyński 24 Jul '18

24 Jul '18

Hi, I'm trying to migrate from an old courier IMAP server to Dovecot 2.3.1 (8e2f634). The old server uses self signed SSL certificate. I'm using the following configuration: imapc_host = 10.1.1.3 imapc_user = %u imapc_features = rfc822.size fetch-headers imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no mail_prefetch_count = 20 mail_shared_explicit_inbox = no Launching dsync with the command: doveadm -o mail_fsync=never -o imapc_password=PASSWORD -Dv backup -R -u USER @DOMAIN <andrzej(a)datatel.net> imapc: In the output logs I get messages like below: dsync(USER@DOMAIN): Error: imapc(10.1.1.3:993): Couldn't initialize SSL context: Can't verify remote server certs without trusted CAs (ssl_client_ca_* settings) dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Created new connection dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Looking up IP address (reconnect_ok=true, last_connect=1532016643) dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Connecting to 10.1.1.3:993 dsync(USER@DOMAIN): Info: imapc(10.1.1.3:993): Connected to 10.1.1.3:993 (local 172.17.0.5:51972) dsync(USER@DOMAIN): Error: imapc(10.1.1.3:993): No SSL context dsync(USER@DOMAIN): Debug: imapc(10.1.1.3:993): Disconnected Am I missing some configuration parameters? -- Regards, Andrew

2 2

dovecot sometimes sends non-default SSL cert if IMAP client won't send SNI
by Martin Johannes Dauser 24 Jul '18

24 Jul '18

Hi, I recognised some funny behaviour on my server. IMAP clients which won't send an Server Name Indication (SNI) sometimes get the wrong certificate. I would expect that those clients always get the default certificate (of my new domain), instead in about 20 to 50% of connections the certificate of my old domain will be presented. (sample rate was 3 times 30 connections) Clients sending SNI always get the right certificate. A user informed me that offlineIMAP complains 'CA Cert verifying failed: no matching domain name found in certificate' So at least offlineIMAP 7.0.12 from Debain stretch won't send SNI, there is a newer version upstream though. I myself checked the server's behaviour with openssl: $ openssl s_client -showcerts -connect IP-address:993 and $ openssl s_client -showcerts -connect IP-address:993 -servername imap.domain I'm totally clueless about how come. Best regards Martin Johannes Dauser # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.5 (Maipo) ... service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } ... ssl = required # set default cert ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_cipher_list = DHE-RSA-AES256-SHA:DHE-RSA-AES128- SHA:ALL:!LOW:!SSLv2:!EXP:!aNULL:!MD5:!RC4:!DES:!3DES:!TLSv1 ssl_key = </etc/pki/dovecot/private/mail_new_domain.key ssl_protocols = !SSLv2 !SSLv3 ... # set alternativ cert for old domain local_name mail.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } local_name imap.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } local_name pop.old.domain { ssl_cert = </etc/pki/dovecot/certs/mail_old_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_old_domain.key } # set explicit cert for new domain local_name mail.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_doman.key } local_name imap.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_domain.key } local_name pop.new.domain { ssl_cert = </etc/pki/dovecot/certs/mail_new_domain-chained.cert ssl_key = </etc/pki/dovecot/private/mail_new_domain.key }

2 3

Namespace question
by J Doe 24 Jul '18

24 Jul '18

Hi, I have a question about the “inbox” namespace, as mentioned in: conf.d/10-mail.conf. I have written my dovecot.conf file from scratch and do not include: conf.d/10-mail.conf. I have not defined the “inbox” namespace and so I am assuming that one is created by default. When I list the dovecot defaults via “sudo doveconf -d”, I notice that no “namespace inbox” entry exists. If “namespace inbox” is not specified, is one still created by default ? Thanks, - J

2 1

anvil in 2.3.2.1?
by kevin martin 23 Jul '18

23 Jul '18

Has anvil gone away in 2.3.2.1? I ask only because I don't find an example of anvil in the conf.d files anymore and I'm migrating from 2.2.10 version to 2.3.2.1. Thanks.

1 0

doveadm expunge didn't clear Trash mailbox
by Sophie Loewenthal 23 Jul '18

23 Jul '18

Hi, Why did my 'doveadm expunge' command not clear the Trash out of a mailbox? The oldest messages was put into the Trash on the 26th June 2018 as shown in the file timestamp. -rw------- 1 vmail mail 33056 Jun 26 16:46 1530031582.M768773P18242.mx10,S=33056,W=33510:2,RS # doveadm -D expunge -u testuser(a)example.org mailbox Trash savedbefore 2d Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_lookup_dict_iterate_visible_next (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(testuser(a)example.org): Debug: Added userdb setting: mail=maildir:/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: Added userdb setting: plugin/quota=dirsize:storage= doveadm(testuser(a)example.org): Debug: Effective uid=150, gid=8, home=/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/example.org/testuser@example.org doveadm(testuser(a)example.org): Debug: maildir++: root=/var/vmail/example.org/testuser@example.org, index=, indexpvt=, control=, inbox=/var/vmail/example.org/testuser@example.org, alt= Sophie

3 6

Dovecot pop3d and imapd problem
by John Paul Iglesia 23 Jul '18

23 Jul '18

Hi, My dovecot version : 2.2.22 Recently, i had issues on dovecot. All packages of dovecot were installed on my system then suddenly when I checked yesterday the packages for dovecot-pop3d and dovecot-imapd were no longer on the list of app installed. Because of this dovecot service stop running. I checked the apt history log, term log and even dpkg log, there were no information about removing the packages. It just shown on my apt list the packages were not longer there. I had to reinstalled these 2 packages just to make dovecot run and for me to be able to receive and send messages. What do you think is the problem, is it dovecot bug? Please advise. Thanks, paul.tcbc

3 3

dovecot lmtp and drop privileges to specific user
by Christos Chatzaras 23 Jul '18

23 Jul '18

Is it possible when dovecot LMTP to drop privileges to a specific user instead of the e-mail account user?

2 1

Stopping login via "nologin" parameter
by J Doe 23 Jul '18

23 Jul '18

Hello, I have a basic e-mail server with Postfix 3.1 and Dovecot 2.2.22. I am using a passwd-file for both userdb and passdb: /etc/dovecot/dovecot.conf userdb { driver = passwd-file args = /etc/dovecot/passwd } passdb { driver = passwd-file args = /etc/dovecot/passwd } } In the passwd file, I want to have user account names for SMTP SASL AUTH and IMAP that are NOT e-mail addresses. For example, employee one of ABC corp would have a SMTP SASL AUTH/IMAP account name in the form: abc_company_employeeid (for example: abc_company_03284). The idea behind that is that I do not want someone outside of the company to be able to know the first half of the username and password pair just because they have an employee's e-mail address. For the e-mail address I specify something like: bob(a)abc.com however I never want someone to be able to login via their e-mail address. Originally, I specified the password field as empty, with the understanding being that the default encryption of a password is {CRYPT}. Since crypt() cannot output a null string, this meant that there was never a valid password. So passwd looked like this: /etc/dovecot/passwd # SMTP SASL AUTH and IMAP accounts abc_company_03284:::::::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_co… # IMAP bob@abc.com:vmail:vmail::/home/vmail/bob::userdb_maill=maildir:/var/mail/vhosts/abc.com/abc_company_03284 I tested SMTP SASL AUTH and IMAP via the openssl s_client and can confirm that I can login and send e-mail as well as retrieve mail only via the: abc_company_03284 account, but because an empty password field isn’t mentioned on the Dovecot wiki, I was wondering if I should add “nologin” to explicitly make it impossible for: bob(a)abc.com. “nologin” was mentioned to me in a previous e-mail to this list. So passwd would now look like this: /etc/dovecot/passwd # SMTP SASL AUTH and IMAP accounts abc_company_03284:::::::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_co… # IMAP bob@abc.com:vmail:vmail::/home/vmail/bob::userdb_mail=maildir:/var/mail/vhosts/abc.com/abc_company_03284 nologin I restarted Dovecot and tested this with openssl s_client for SMTP SASL AUTH and IMAP, but just wanted to make sure that this STOPS ANY LOGINS via the e-mail address: bob(a)abc.com ? Thanks, - J

1 1

ot: LE server conf setup/ iPhone 'expired cert' message
by Voytek Eymont 22 Jul '18

22 Jul '18

I've installed LE certs on my Dovecot a while back, and, it has been working OK since, but, today, an iPhone user said he can't get emails as iphone says 'cert is expired', searching around, I see some other iPhone similar issues reported, do I have my conf correct, I have; # cat dovecot.conf | grep ssl ssl = required verbose_ssl = no ssl_cert = </etc/letsencrypt/live/fqn.myserver/fullchain.pem ssl_key = </etc/letsencrypt/live/fqn.myserver/privkey.pem is fullchain.pem and privkey.pem is what I should be using ? anythought how to force an iphone to reload cert ? actual cert was renewed 15/7, old/previous one expired earlier today ls /etc/letsencrypt/live/fqn.myserver/ cert.pem chain.pem fullchain.pem privkey.pem (if I open mailserver host in browser, padlock shows current/valid cert) -- Voytek

6 8

Dbox lost messages
by Fineware PM 20 Jul '18

20 Jul '18

Hello, I use dovecot with dbox storage system. Today I receive 2 mail (I see that in the maillog ) but I don't find in INBOX using my IMAP client. I look in the files m.* and I find the message that I receive. But I cannot find it in any IMAP folder. I try to run "doveadm force-resync -u user inbox" but nothing change. I export all email using the command "doveadm backup -u user mbox:/tmp/mail:INDEX:/tmp/imap:LAYOUT:maildir++ and in the mbox file for inbox I found the 2 mails arrived. How I can understand why I cannot see the messages ? or how I can recover it ? Bet regards.

2 5

OT: 'lost' emails
by Voytek 20 Jul '18

20 Jul '18

I suspect this is mail client issue, but looking for any suggestions: user with Thunderbird says " I'm losing emails, mail is not in inbox, but, when I search, that email shows in search result, but, I can't open the email body" i don't fully understand what he was trying to say, and, won't be able to look at his PC till Monday. Looking at inbox's 'cur' directory, I can see the'missing' email amongst the other 2000 emails in 'cur' Is there any indexing I should do on the user's email folder, how? or, is this purely Thunderbird issue, and, I need to re index Thunderbird? V -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

3 2

SIS: dovecot creates duplicated attachments (sometimes)
by Alexander Moisseev 20 Jul '18

20 Jul '18

SIS deduplication was broken in 2.2.16 and has been fixed with https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c84158… but still sometimes (just several times in a month or so) dovecot creates duplicated attachments. As you can see in directory listings below all attachments was created at (about) the same time, but one of them has different inode number. It easy to discover using https://github.com/moisseev/doveadm-tools/blob/master/bin/dsisck # dsisck -n mail_uid=vmail mail_attachment_dir=/vmail/attachments ==> Checking SIS... # ln -f ./30/b3/30b367c584a123eee59478adf3e4f4c9e1226545-c56eae04a67c3157287f01003d96bafd ./30/b3/30b367c584a123eee59478adf3e4f4c9e1226545-7ad0a411d17c31572b7a01003d96bafd # mkdir -p -m 700 ./64/8f/hashes && ln ./64/8f/648f5cfa27af6d20c8570fdcaeab997663e15105-55430d2cd4432c571cb600003d96bafd ./64/8f/hashes/648f5cfa27af6d20c8570fdcaeab997663e15105 # ln -f ./6f/3f/6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-b1935817ed753557546700003d96bafd ./6f/3f/6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-72da1f32e38e3557947b00003d96bafd # ln -f ./dd/d9/ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-6bf7c122fefb3157ad3500003d96bafd ./dd/d9/ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-90fd1415e7e53157112800003d96bafd -------------------------------------------------------------- Unexpected objects found: 0 Attachments processed: 43500 Different attachments with similar hashes skipped: 0 Attachments deduplicated: 3 File system blocks freed up: 1800 Attachment deduplication attempts failed: 0 Hash files created: 1 Hash files creation attempts failed: 0 Hash files re-linked: 0 Hash files re-link attempts failed: 0 Orphaned hash files: 0 Invalid hash files (not a regular file): 0 -------------------------------------------------------------- # cd /vmail/attachments # ls -li ./30/b3/ ./30/b3/hashes/ ./30/b3/: total 1996 7464083 -rw------- 1 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-7ad0a411d17c31572b7a01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-bb6eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-bd6eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-bf6eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-c36eae04a67c3157287f01003d96bafd 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545-c56eae04a67c3157287f01003d96bafd 7464084 drwx------ 2 vmail vmail 512 May 10 09:16 hashes ./30/b3/hashes/: total 332 7464082 -rw------- 6 vmail vmail 337719 May 10 09:16 30b367c584a123eee59478adf3e4f4c9e1226545 # ls -li ./6f/3f/ ./6f/3f/hashes/ ./6f/3f/: total 644 15088414 -rw------- 1 vmail vmail 326656 May 13 11:23 6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-72da1f32e38e3557947b00003d96bafd 15088422 -rw------- 2 vmail vmail 326656 May 13 11:23 6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe-b1935817ed753557546700003d96bafd 15088448 drwx------ 2 vmail vmail 512 May 13 11:23 hashes ./6f/3f/hashes/: total 320 15088422 -rw------- 2 vmail vmail 326656 May 13 11:23 6f3fa3e4d374a9c80d07af54960ce0e7adb2e0fe # ls -li ./dd/d9/ ./dd/d9/hashes/ ./dd/d9/: total 748 80548 -rw------- 3 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-68f7c122fefb3157ad3500003d96bafd 80548 -rw------- 3 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-6bf7c122fefb3157ad3500003d96bafd 80547 -rw------- 1 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b-90fd1415e7e53157112800003d96bafd 80549 drwx------ 2 vmail vmail 512 May 10 18:19 hashes ./dd/d9/hashes/: total 248 80548 -rw------- 3 vmail vmail 250640 May 10 18:19 ddd97aa6f624d4f54968d2c4956fc3a9d796b31b # doveconf -n # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: FreeBSD 10.3-RELEASE i386 auth_default_realm = example.com auth_mechanisms = digest-md5 cram-md5 plain apop doveadm_password = # hidden, use -P to show it first_valid_gid = 1000 first_valid_uid = 1000 lda_mailbox_autosubscribe = yes listen = * mail_attachment_dir = /vmail/attachments mail_gid = vmail mail_home = /vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = quota zlib acl mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = mdbox:%%h/mdbox:INDEXPVT=~/mdbox/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archives { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = scheme=plain username_format=%n /usr/local/etc/dovecot/dovecot.auth/%d.passwd driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/vmail/shared-mailboxes.db antispam_backend = mailtrain antispam_mail_notspam = report_ham antispam_mail_sendmail = /usr/local/libexec/dovecot/dovecot-lda antispam_mail_sendmail_args = -d;spam(a)example.com;-m antispam_mail_spam = report_spam antispam_spam = Junk antispam_trash = Trash;train_ham;train_prob;train_spam quota = dict:User quota::file:%h/dovecot-quota quota_rule = *:storage=2G quota_rule2 = Trash:storage=+10%% quota_rule3 = Spam:storage=+20%% quota_status_nouser = DUNNO quota_status_success = DUNNO sieve_after = /usr/local/etc/dovecot/sieve/sieve.after sieve_before = /usr/local/etc/dovecot/sieve/sieve.before sieve_vacation_min_period = 0 zlib_save = gz zlib_save_level = 3 } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve pop3 quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { user = vmail } } service config { unix_listener config { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 0 } process_limit = 200 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service pop3-login { inet_listener pop3s { port = 0 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } ssl_cert = </etc/ssl/certs/mx.example.com.crt ssl_key = </etc/ssl/private/mx.example.com.key userdb { args = username_format=%n /usr/local/etc/dovecot/dovecot.auth/%d.passwd driver = passwd-file } verbose_proctitle = yes protocol imap { mail_plugins = quota zlib acl antispam imap_quota imap_zlib imap_acl } protocol lmtp { mail_plugins = quota zlib acl sieve }

1 1

folders not visible on copied mail folders
by Mark Foley 20 Jul '18

20 Jul '18

We had a user quit recently. Three days ago I copied his entire Maildir folder to another user to that user's Maildir/.JoesEmail. I changed ownership and made the permission 'chmod -R og-rwx .', just like all the other files/directories of the new owner. This didn't work to show the new folder. Today, in his Thunderbird client, I subscribed to the 'JoesEmail' folder. I restarted dovecot and restarted Thunderbird. In Thunderbird, the 'JoesEmail' folder now shows, but it is empty and shows none of the subordinate mail folders. I ran 'doveadm index -u newowner JoesEmail' and 'doveadm force-resync -u newowner JoesEmail'. This didn't help. I did this once before with a previous user who quit and only changed ownership, no subscribing, no doveadm, and that worked. What am I doing wrong? THX --Mark

4 9

100% Dovecot MTA Replacement Setup
by David Favor 19 Jul '18

19 Jul '18

Working out upgrade of old 1.x + 2.x Dovecot installs to latest 2.3.2.1 out of Ubuntu Bionic repositories. _______ https://wiki.dovecot.org/Services suggests Dovecot can be used for full mail infrastructure, avoiding the complexity of exim4 or other MTA setup/management. Let me know if I understand this correctly. 1) https://wiki.dovecot.org/Submission can be used to listen on port 25 + port 587 (with auth). 2) https://wiki.dovecot.org/Pigeonhole can be used for filtering, including forwarding email to other machines. 3) https://wiki.dovecot.org/Pigeonhole/ManageSieve/Configuration can be used to forward off machine email, for example flowing through a relay service like MailGun, using a simple script or service like ESMTPD. 4) https://wiki.dovecot.org/LMTP can be used to deposit messages into filesystem as Maildir or dbox or mdbox backing stores.

2 1