- dovecot - dovecot.org

Dovecot quota and Postfix smtpd_recipient_restrictions?
by Davide Marchi 20 Mar '19

20 Mar '19

Hi Friends, a doubt: I would like to enable (the same) quota (count) for all (virtual)users, on Debian Stretch, Postfix 3.1.8, Dovecot 2.2.27, and is not clear for me if I need to tell Postfix to communicate with the service in /etc/postfix/main.cf as here: smtpd_recipient_restrictions = ... check_policy_service inet:mailstore.example.com:12340 My current Postfix "smtpd_recipient_restrictions": -o smtpd_recipient_restrictions=reject_non_fqdn_recipient,reject_unknown_recipient_domain,permit_sasl_authenticated,reject Currently I've edited: conf.d/10-mail.conf: # Space separated list of plugins to load for all services. Plugins specific to # IMAP, LDA, etc. are added to this list in their own .conf files. mail_plugins = $mail_plugins quota conf.d/20-imap.conf: protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_quota } conf.d/90-quota.conf: (for use with the quota-status service) plugin { quota_grace = 10%% # 10% is the default quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } /etc/dovecot/conf.d/90-quota.conf: plugin { quota = maildir quota_rule = *:storage=3G quota_rule2 = Trash:storage=+100M # LDA/LMTP allows saving the last mail to bring user from under quota to # over quota, if the quota doesn't grow too high. Default is to allow as # long as quota will stay under 10% above the limit. Also allowed e.g. 10M. #quota_grace = 10%% # 10% is the default quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota #quota = fs:User quota quota = count:User quota # This is required - it uses "virtual sizes" rather than "physical sizes" for quota counting: quota_vsizes = yes } plugin { #quota = dict:user::proxy::quota #quota2 = dict:domain:%d:proxy::quota_domain #quota_rule = *:storage=102400 #quota2_rule = *:storage=1048576 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = dovecot unix_listener quota-warning { user = vmail } } service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } Many many thanks!! Davide

3 2

4sec latency when using director
by Erik de Waard 19 Mar '19

19 Mar '19

Hi, I've been running dovecot for many years, but now i've hit a strange problem. when retrieving imap there is sometimes in 1 of 4 imap requests a 4sec latency. * notes: - connected directly to the backends this latency disappears - removing a director from the loadbalancer(lvs) so i'm the only connected to the director this latency disappears too I would appreciate some feedback of where to look because i tried various options. (client_limit,process_limit) perhaps its just as simple as to add more directors but any feedback would be welcome. Thank you. This is the setup: -- Internet -> LVS -> 3 Directors -> 9 Backends. doveadm director status mail server ip tag vhosts state state changed users 10.0.10.110 100 up - 3309 10.0.10.111 100 up - 3412 10.0.10.112 100 up - 3458 10.0.10.113 100 up - 3437 10.0.10.115 100 up - 3368 10.0.10.116 100 up - 3320 10.0.10.117 100 up - 3305 10.0.10.118 100 up - 3291 10.0.10.223 100 up - 3280 #Director doveconf -n # Pigeonhole version 0.4.22 (22940fb7) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.4 # Hostname: server312.company.com auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 days auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 3000 director_mail_servers = 10.0.10.223 10.0.10.110 10.0.10.111 10.0.10.112 10.0.10.113 10.0.10.115 10.0.10.116 10.0.10.117 10.0.10.118 director_servers = 10.0.10.114 10.0.10.181 10.0.10.182 director_user_expire = 1 days disable_plaintext_auth = no info_log_path = /dev/null lmtp_proxy = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e encryption=%k secured=%c mail_max_userip_connections = 100 passdb { args = proxy=y nopassword=y driver = static } protocols = imap lmtp service director { fifo_listener login/proxy-notify { mode = 0600 user = $default_login_user } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { client_limit = 6000 executable = imap-login director process_limit = 4 process_min_avail = 4 service_count = 0 vsz_limit = 600 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } } ssl_cert = </etc/ssl-certificates/MDC_company_com.crt ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4:!SEED@STRENGTH ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes protocol lmtp { auth_socket_path = director-userdb } #backend doveconf -n # 2.2.34 (874deae): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.22 (22940fb7) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.4 # Hostname: server250.company.com auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 days auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 1500 default_vsz_limit = 600 M disable_plaintext_auth = no info_log_path = /dev/null listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_max_userip_connections = 100 mail_privileged_group = mail mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { sieve_execute_bin_dir = /etc/dovecot/sieve-executables sieve_global_extensions = +vnd.dovecot.execute sieve_plugins = sieve_extprograms } protocols = imap lmtp service anvil { unix_listener anvil-auth-penalty { mode = 0600 } } service auth { user = root } service imap-login { client_limit = 6000 process_limit = 4 process_min_avail = 4 service_count = 0 vsz_limit = 600 M } service imap { client_limit = 1 process_limit = 1024 service_count = 50 } service lmtp { inet_listener lmtp { port = 24 } } ssl = no ssl_cert = </etc/dovecot/dovecot.crt ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " sieve" plugin { sieve = ~/filters.sieve sieve_after = /etc/dovecot/sieve/after.sieve sieve_before = /etc/dovecot/sieve/before.sieve } userdb { args = /etc/dovecot/dovecot-sql-lmtp.conf driver = sql name = } }

1 1

Way to remove FTS indexes
by Peter Mogensen 19 Mar '19

19 Mar '19

Hi, I was wondering if there was anyway to remove FTS indexes in other to have them rebuild on the next BODY search? All the doveadm commands I can find seem to result in fully build indexes. (which is nice if that's what you want). /Peter

2 1

Re: Upgrade from 2.1.17 2.2.36
by lty 19 Mar '19

19 Mar '19

I use the MAC Foxmail client, v2.2.36 can't receive mail, but v2.1.17 can receive mail. I grabbed the network package and found that Foxmail was not processing the next step after sending the D LIST "" * command. I suspect that because of the time of return, Foxmail is not recognized, so I want to remove this time. 在 2019-03-18 18:03，Aki Tuomi 写道： > On 18.3.2019 12.00, lty via dovecot wrote: > >> v2.1.1 >> >> v2.2.36 >> >> The screenshot is the result returned by imap. >> >> I don't want to want dovecot to return time, can I close it? > > Why do you want this? > > Aki

2 3

AD ldap, filter to exclude various kinds of expired, disabled etc etc users
by mj 19 Mar '19

19 Mar '19

Hi, I was revising our AD ldap user_filter and pass_filter to exclude more types of expired / disabled accounts. I started adding things like: > (&(objectclass=person)(sAMAccountName=%n)(!useraccountcontrol=514)(!(useraccountcontrol=546))(!(useraccountcontrol=66050))(!(useraccountcontrol=8388608))) but then I thought, why not simply do: > (&(objectclass=person)(sAMAccountName=%n)(userAccountControl=512)) as 512 would your regular active user accounts only, excluding all other account types. Looking here (https://support.microsoft.com/en-gb/help/305144/how-to-use-useraccountcontr…) there are some many different userAccountControl to check, that it might be smarter to only allow userAccountControl=512, or....? Any ideas on this..? (or examples of how you do it?) MJ

2 1

Dovecot logrotation - old journal files are still in use
by Denis V Razumovskiy 19 Mar '19

19 Mar '19

2 2

dovecot-openssl-common.c and [-Wincompatible-pointer-types]
by Rupert Gallagher 18 Mar '19

18 Mar '19

Warnings from clang 7.0 when compiling dovecot-openssl-common.c from dovecot 2.3.5 with openssl 1.1.1a. This is dovecot's configuration: > config_options="--prefix=$prefix \ > --sysconfdir=$prefix/etc \ > --datarootdir=$prefix/share \ > --mandir=$man \ > --docdir=$doc \ > --with-docs \ > --with-ssl=openssl --with-ssldir=$prefix/etc \ > --with-sodium \ > --with-libiconv-prefix=/opt/libiconv \ > \ > --with-bzlib=no \ > --with-gssapi=no \ > --with-ldap=no \ > --with-lucene=no \ > --with-lz4=no \ > --with-lzma=no \ > --with-pam=no \ > --with-solr=no \ > --with-sql=no \ > --with-vpopmail=no \ > --with-zlib=no \ > \ > --enable-dependency-tracking"; Note on passing: --with-ssldir=$prefix/etc is ignored by the configurator, as it forces $prefix/etc/dovecot.

1 0

Dovecot logrotation - old journal files are still in use (second attempt)
by Denis V Razumovskiy 18 Mar '19

18 Mar '19

Hi all Sorry, it is the second attempt due to wrong format of the first message. In my Dovecot there are 3 files of logging (debug, info and .log) While executing logrotation, the new files are created, but the previos ones, namely dovecot.*.1 are still in use by the process Here is the logger process in memory: root 19140 0.0 0.0 4140 1576 ? S Mar12 0:06 dovecot/log Here the files it uses after the daily logrotation had happened: # lsof -p19140 |grep log ... log 19140 root 33w REG 9,3 811 417675 /var/log/dovecot.log.1 log 19140 root 34w REG 9,3 2842123 417681 /var/log/dovecot.info.1 log 19140 root 35w REG 9,3 14853918 417683 /var/log/dovecot.debug.1 ... After the manual issue 'doveadm log reopen` command the files are changed to # lsof -p19140 |grep dovecot\\\. ... log 19140 root 33w REG 9,3 0 417651 /var/log/dovecot.log log 19140 root 34w REG 9,3 121374 417690 /var/log/dovecot.info log 19140 root 35w REG 9,3 916153 417691 /var/log/dovecot.debug as it is expected to be. I use the logrotate config for dovecot instance: /var/log/dovecot.log /var/log/dovecot.info /var/log/dovecot.debug { daily rotate 14 missingok notifempty compress delaycompress sharedscripts postrotate doveadm log reopen chmod 666 /var/log/dovecot.log chmod 666 /var/log/dovecot.info chmod 666 /var/log/dovecot.debug endscript } At the same time, dovecot itself still uses previous logs: # lsof |grep var\/log\/dovecot\. dovecot 19138 root 8w REG 9,3 12962 417613 /var/log/dovecot.log.1 (deleted) dovecot 19138 root 9w REG 9,3 4097250 416836 /var/log/dovecot.info.1 (deleted) dovecot 19138 root 10w REG 9,3 23816347 417603 /var/log/dovecot.debug.1 (deleted) What can be the root of the issue? I use Dovecot as LDA for Postfix with system users, mbox mail format. System Slackware 12.0 x86, Postfix 2.4.5, Dovecot 2.2.36. Interconnect Postfix-Dovecot has been made via `mailbox_command = ...' Dovecot was compiled from sources Logging configuration (file conf.d/10-logging.conf) contains the following: log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot.info debug_log_path = /var/log/dovecot.debug auth_verbose = yes auth_verbose_passwords = yes auth_debug = yes mail_debug = yes verbose_ssl = yes plugin { } Could the fact, that Postfix require Dovecot logs to be accessible someway, result in such a weird behavior? To allow other processes to access Dovecot logs I had to chmod 0666 all the current logs while integrating Dovecot into Postfix delivery (please see `chmod' commands in the logrotate config above) Please ignore my previos post https://dovecot.org/pipermail/dovecot/2019-March/115075.html Thank you Denis Razoumovskiy

2 1

child-wait.c and [-Wnull-pointer-arithmetic]
by Rupert Gallagher 18 Mar '19

18 Mar '19

Attached warnings from clang 7.0 when compiling child-wait.c from dovecot 2.3.5: "arithmetic on a null pointer treated as a cast from integer to pointer is a GNU extension [-Wnull-pointer-arithmetic]".

2 2

LDAP users issue
by Anushka Bandara 18 Mar '19

18 Mar '19

Hi Team, I have enabled LDAP authentication with webmail client and it works successfully. But I found an error with LDAP user's mail. Email is not loaded when I log with an LDAP user. Login phase is successful and mail box is the issue. I created a mail user without including LDAP and that user works fine. Issue comes only with LDAP users. *Anushka Bandara* Research Engineer Lanka Software Foundation +94715846018

3 4

Upgrade from 2.1.17 2.2.36
by lty 18 Mar '19

18 Mar '19

v2.1.1 v2.2.36 The screenshot is the result returned by imap. I don't want to want dovecot to return time, can I close it?

2 1

`Spam' folder creation for multiple users
by Marek Kozlowski 17 Mar '19

17 Mar '19

:-) I've just added pigeonhole and a simple sieve script: ------------------------------------------------- require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } ------------------------------------------------- If a user has this folder (`Spam') it works fine. If they haven't it results in an error. 1. Can I modify the script to create this folder if the need arise? 2. If not - what's the most recommended way of adding this folder for all users (~1000)? Thanks! Best regards, Marek

3 2

MikroTik Users Contact List
by Kathleen Brown 17 Mar '19

17 Mar '19

Hello, Hope you're having a great day! I just wanted to know if you're looking to acquire MikroTik Users Contact List for your marketing efforts? Information Field: Names, Title, Email, Phone, Company Name, Company URL, Company physical address, SIC Code, Industry and Company Size (Revenue and Employee). Kindly review and let me know of your target interest so that I can get back to you with the exact counts and sample file. Do let me know if you have any questions for me. Regards, Kathleen Brown Database Executive If you do not wish to receive these emails. Please respond Exit.

2 1

lda: Unknown mail storage driver maildir
by Rob De Langhe 17 Mar '19

17 Mar '19

hi all, I have a successful (self-compiled from source code) Dovecot v2.2.16 setup active on my Solaris-10 server, with mails stored in user's $HOME/Maildir The mails are fetched from the ISP with "fetchmail", using a "cron" job fetchmail -f $HOME/etc/pop3.myisp where the file "$HOME/etc/pop3.myisp" contains set logfile fetchmail.log poll pop.myisp.be with proto POP3 user myIspmailLogin there with password myIspPwd is rob here nokeep mda "/programs-3.2/amd64/64/libexec/dovecot/deliver" Now I want to get it also running on a Debian server, with the same Dovecot version, and exactly the same config files, but here I get the following messages in "/var/log/mail.log" when launching a "fetchmail" attempt : Mar 17 14:36:20 apps_b dovecot: lda(rob): Debug: Effective uid=1000, gid=1000, home=/home/rob Mar 17 14:36:20 apps_b dovecot: lda(rob): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Mar 17 14:36:20 apps_b dovecot: lda(rob): Error: User initialization failed: Namespace '': Unknown mail storage driver maildir Mar 17 14:36:20 apps_b dovecot: lda(rob): Fatal: Invalid user settings. Refer to server log for more information. So it seems to be complaining about "maildir" storage driver ?! My config is: # /programs/3.4/x86_64/64/sbin/dovecot -n -c /usr/local/dovecot/dovecot.conf # 2.2.16: /usr/local/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.4 disable_plaintext_auth = no first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 1500 last_valid_uid = 2000 mail_debug = yes mail_location = maildir:~/Maildir namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = * driver = pam } postmaster_address = rob(a)mydomain.be ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd }

2 1

LMTP Proxy failure using master login via destuser field
by Dirk 17 Mar '19

17 Mar '19

Hi list, I set up dovecot as IMAP proxy using a master user to login into the backend and it works beautifully. 👍🏻 Next I set out to do LMTP proxying and I struggled (initially). I got the log message: Mar 17 11:23:44 mail postfix/lmtp[2665]: 99A3F219C8: to=<johnny(a)doe.com>, relay=10.15.1.2[10.15.1.2]:24, delay=5.1, delays=4.9/0.05/0.01/0.07, dsn=5.1.1, status=bounced (host 10.15.1.2[10.15.1.2] said: 550 5.1.1 <"johnny(a)doe.com*director"@mail.server.com> User doesn't exist: "johnny(a)doe.com*director"@mail.server.com (in reply to RCPT TO command)) My director's passdb setting looked like this: passdb { driver = sql args = /etc/dovecot/sql/my-passdb.conf result_success = continue-ok result_failure = return-fail result_internalfail = return-fail } # Add director master user credentials if above succeeded passdb { driver = static args = proxy=y starttls=any-cert \ destuser=%u*director(a)example.com \ pass=correcthorsebatterystaple \ nopassword=y skip = unauthenticated } In the end I found that setting the `master` field instead of `destuser` solves the issue. It looks like LMTP does not know how to handle the master user separator although set. I this known/wanted behavior? Maybe this is something to mention on the wiki page, it took a while to figure this out... Kind regards, Dirk Mit freundlichen Grüßen Dirk Weise DevOps Engineer -- bitloft GmbH | Schulstraße 2 | D-42551 Velbert www.bitloft.de | weise(a)bitloft.de Telefon: +49 2051 40514-32 Geschäftsführer: Robin Clemens, Franz-Josef Wieneke Amtsgericht Wuppertal HRB 17297 | USt-IDNr. DE121540053

1 0

testing dovecot LMTP with postfix/spamassassin
by Marek Kozlowski 17 Mar '19

17 Mar '19

:-) My postfix configuration is quite complex with a lot of special cases and rules. However I'd like to make an anti-spam configuration as simple and lightweight as possible (KISS). /etc/postfix/master.cf ------------------------------------------------------------------------ smtp inet n - n - - smtpd -o content_filter=spamassassin spamassassin unix - n n - - pipe user=nobody argv=/usr/bin/vendor_perl/spamc -e /usr/sbin/sendmail -oi -f ${sender} ${recipient} ------------------------------------------------------------------------ then the simplest sieve rule I can think of: ------------------------------------------------------------------------ require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } ------------------------------------------------------------------------ I'd like to make this rule active for only local deliveries via dovecot LMTP with sieve plugin and setting postfix `mailbox_transport' to dovecot LMTP. I believe it is so simple it should work (am I wrong?). But... It would be more convenient to do some tests before applying changes to a production environment config. The problem is: I have no separate testing environment with my strange configuration I'm able to test a spamassassin score for an e-mail manually. How about dovecot LMTP? Can I test local mail delivery by dovecot LMTP manually? I mean: to simulate "I'm the Postfix" and produce for some testing e-mail the same effect as postfix granting it via `local_transport' to dovecot? Best regards, Marek

4 6

LMTP: Undelivered Mail Returned to Sender: User doesn't exist! :-(
by Marek Kozlowski 17 Mar '19

17 Mar '19

:-) I'm using postfix for mail delivery and dovecot for mailbox access imaps pop3s. Postfix resolves, verifies and overwrites users' addresses by numerous subtle LDAP queries. However users are visible as local ones (openldap, pam, nss) in the sense I can run `id' or `finger' queries and receive replies. Dovecot handles all mailboxes over imap/pop correctly with no additional configuration for LDAP. Just (10-mail.conf): mail_location = maildir:/mailboxes/%u and it works fine. Because I'd like to use pigeonhole I'm trying to make local delivery via dovecot LMTP (https://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP) I've configured the socket and added to `/etc/postfix/main.cf' the line: mailbox_transport = lmtp:unix:/var/spool/postfix/private/dovecot-lmtp I think that id dovecot handles mailboxes correctly over imap/pop it can easily find the users and their mailboxes so it doesn't need any additional configuration for LDAP. Unfortunately it doesn't work and results in: Undelivered Mail Returned to Sender: User doesn't exist! :-( What's the thing I've missed? Best regards, Marek

2 2

How to create sent items, drafts and so on
by Sakuma, Koshiro 17 Mar '19

17 Mar '19

Hello, I've setup Dovecot and Postfix mailing systems. The protocol is imap. Now, I've realized that there are no "sent items, drafts" boxed under Maildir for each users. I would like to take back up Inbox, sent items, draft boxes. For sent items box, it seems to be stored in outlook client file which is "ost". The configuration parameters and version is as follows. I can see that "namespace" has been configured. How can I setup to see these folders? Thank you for your support! 1. Dovecot version ->2.2.36 2. dovecot -n ----------------------------------------------------------------------------------------------------------- #2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-957.5.1.el7.x86_64 x86_64 CentOS Linux release 7.6.1810 (Core) # Hostname: mail.corp-associe.com auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 1000 listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=CRAM-MD5 username_format=%u /etc/dovecot/users driver = passwd-file } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/letsencrypt/fullchain1.pem ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } userdb { args = uid=vmail gid=vmail home=/var/spool/virtual/%d/%n driver = static }

4 9

Re: Unable to set quota-fs plugin
by Eric Grammatico 17 Mar '19

17 Mar '19

Hi there, Well.. I didn't find a way to strace imap. If I well understood, the faulty IMAP is launched by dovecot from or after a succesfull imap-login process. I have executed manually '/usr/libexec/dovecot/imap -u eric' and typed getquotaroot "INBOX" which didn't reproduce the error seen in the dovecot logs and reported the correct quota. Any idea how to find the imap command generating the error imap(eric)<3085></M5VXfCBwJejrKVa>: Error: Failed to get quota resource STORAGE: quota-fs: quotactl(Q_GETQUOTA, /dev/vda1) failed: No such file or directory Thanks and regards, - Eric Grammatico _/) 14 mars 2019 11:46 "Eric Grammatico" <e.grammatico(a)gmail.com> a écrit: > I use sendmail and quota-status is not running in background. > > Fully aligned with you about focusing on imap... will try to get other strace and report there. > > thanks and regards, > > - > Eric Grammatico _/) > > 14 mars 2019 11:37 "Yassine Chaouche via dovecot" <dovecot(a)dovecot.org> a écrit: > >> On 3/14/19 9:53 AM, Yassine Chaouche via dovecot wrote: >> >>> On 3/13/19 2:10 PM, Eric Grammatico via dovecot wrote: >>>> Thanks Aki, >>>> >>>> Please find attached strace for imap and quota-status which report an >> error at the end. >>>> >>>> Regards, >>> >>> write(2, "/usr/libexec/dovecot/quota-statu"..., > 57/usr/libexec/dovecot/quota-status: invalid >>> option -- 'u' >>> >>> Please retry with the good options (-u is invalid) >>> >>> Yassine. >> >> Ah, that seems to be the service that is called by the MTA before delivering the mail to the LDA, >> in case the user is over quota, so that the MTA may bounce the e-mail right away instead of >> accepting it first then bouncing afterwards (after the LDA refuses the message). >> >> But according to the error message you posted on your first e-mail, the error happens with imap, I >> don't know if quota-status is involved here (might be) ? >> >> In any case, I would concentrate on imap and not quota-status. Nothing in the imap strace shows any >> trace of errors. Particulary, I was looking for a quotactl line in the strace, but I couldn't find >> it. >> >> In the other hand, it is present in the doveadm quota strace, and has completed successfully >> >> dovecot.strace:quotactl(QCMD(Q_GETQUOTA, USRQUOTA), "/dev/vda1", 1000, {dqb_bhardlimit=4194304, >> dqb_bsoftlimit=3170304, dqb_curspace=638853120, dqb_ihardlimit=0, dqb_isoftlimit=0, >> dqb_curinodes=12784, ...}) = 0 >> >> Someone has to tell us under what conditions will the imap daemon check for quota (at login ? at >> delivery or any other action involving moving mail around like copying or expunging ?) >> >> For the quota-status libexec, I have set it to run with quota-status -f postfix but your setup may >> vary (if it's every configured). If it is running, you can just grep it's pid with pgrep >> quota-status then strace -p $PID and see how it behaves (wait until a quota operation is needed). >> >> Yassine.

2 6

ssl_dh
by sergio 16 Mar '19

16 Mar '19

https://wiki.dovecot.org/SSL/DovecotConfiguration says: "Since v2.3.3+ Diffie-Hellman parameters have been made optional, and you are encouraged to disable non-ECC DH algorithms completely." and a bit later: "From version 2.3, you must specify path to DH parameters file using ssl_dh=</path/to/dh.pem" So. 1. Is ssl_dh an optional or a must? 2. I've disabled ssl_dh in my config. Dovecot works fine except it shows warnings: doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd ... I'm using dovecot version 2.3.4.1-1~bpo9+1 from debian stretch-backports -- sergio.

3 5

regarding ssl certificates
by mick crane 15 Mar '19

15 Mar '19

Excuse dopey question. I'm not exactly clear about certificates. Apache2 default install has this snake oil certificate Can make a new one for apache Can make one for dovecot Can make one for ssl Is there supposed to be the one (self signed ) certificate pair in one place for the machine that each process hands out ? Can they be moved to another machine ? mick -- Key ID C7D6E24C

12 16

lua policy for Weakforce and web mail failed login attempts
by Robert Kudyba 15 Mar '19

15 Mar '19

The good news is I believe I got Weakforce running 1) curl -X GET http://127.0.0.1:8084/?command=ping -u wforce:ourpassword {"status":"ok"}[ 2) after running the sample for loop: for a in {1..101}; do curl -X POST -H "Content-Type: application/json" --data '{"login":"ahu", "remote": "127.0.0.1", "pwhash":"1234'$a'", "success":"false"}' http://127.0.0.1:8084/?command=report -u wforce:ourpassword; done The result is: {"status":"ok"}{"status":"ok"}{"status":"ok"}{ 3) So checking the stats: curl -X POST -H "Content-Type: application/json" --data '{"ip":"127.0.0.1"}' http://127.0.0.1:8084/?command=getDBStats -u wforce:ourpassword {"bl_expire": "", "bl_reason": "", "blacklisted": false, "ip": "127.0.0.1", "stats": {"OneHourDB": {"diffFailedPasswords": 93}}} Notice the 93. 4) the reset works but I believe there's a bug in Getdbstats v2.0.0 where "blacklisted" is always shown: curl -X POST -H "Content-Type: application/json" --data '{"ip":"127.0.0.1"}' http://127.0.0.1:8084/?command=getDBStats -u wforce:ourpassword {"bl_expire": "", "bl_reason": "", "blacklisted": false, "ip": "127.0.0.1", "stats": {"OneHourDB": {"diffFailedPasswords": 0}}}[ 5) wforce -c Read configuration from '/usr/local/etc/wforce.conf' Connecting to 127.0.0.1:4004 > stats() 101 reports, 0 allow-queries (0 denies) The 3 big questions I have: a: how do I know IP's are being banned/rejected? Is there an alert creation or a way to see in the logs that the rules are in affect? b: since I installed via Git and ran "make" how to I get wforce --daemon to start on reboot? Is there a systemd file available? c: How do I create a lua policy that would catch these web dovecot login attempts? Feb 27 08:19:53 ourserver auth[15085]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 08:19:53 ourserver auth[15085]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser= user(a)ourserver.ourdomain.edu rhost=177.72.0.158 Feb 27 08:20:35 ourserver auth[15085]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 08:20:35 ourserver auth[15085]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=user rhost=213.156.111.236 Feb 27 08:27:07 ourserver auth[16831]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 08:27:07 ourserver auth[16831]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser= nobody(a)ourserver.ourdomain.edu rhost=79.106.35.59 Feb 27 08:27:27 ourserver auth[16831]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=nobody rhost=95.38.212.65 user=nobody Feb 27 08:27:27 ourserver auth[16831]: pam_succeed_if(dovecot:auth): requirement "uid >= 1000" not met by user "nobody" Feb 27 08:31:12 ourserver auth[17875]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 08:31:12 ourserver auth[17875]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser= ouruser(a)ourserver.ourdomain.edu rhost=80.78.70.1 Feb 27 08:31:33 ourserver auth[17875]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=ouruser rhost=45.225.236.198 user=ouruser Feb 27 09:32:22 ourserver auth[32689]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 09:32:22 ourserver auth[32689]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser= nobody(a)ourserver.ourdomain.edu rhost=37.205.81.41 Feb 27 09:32:42 ourserver auth[32689]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=nobody rhost=201.148.100.198 user=nobody Feb 27 09:32:42 ourserver auth[32689]: pam_succeed_if(dovecot:auth): requirement "uid >= 1000" not met by user "nobody" Feb 27 09:44:09 ourserver auth[3271]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 09:44:09 ourserver auth[3271]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser= otheruser(a)ourserver.ourdomain.edu rhost=177.69.145.193 Feb 27 09:44:35 ourserver auth[3271]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 09:44:35 ourserver auth[3271]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=otheruser rhost=175.143.51.221 Feb 27 09:47:32 ourserver auth[4048]: pam_unix(dovecot:auth): check pass; user unknown Feb 27 09:47:32 ourserver auth[4048]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser= yetanotheruser(a)ourserver.ourdomain.edu rhost=162.245.81.231 Feb 27 09:47:56 ourserver auth[4048]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=yetanotheruser rhost=83.243.88.236 user=yetanotheruser Feb 27 20:44:41 ourserver auth[5828]: pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=ouruser rhost=166.171.184.200 user=ouruser

1 0

Re: ACL Folders are open but not being displayed ? [2.3.3]
by Aki Tuomi 15 Mar '19

15 Mar '19

It's a file, `touch subscriptions` Aki On 15.3.2019 11.36, Kunal A. wrote: > Oh okay. How do correct this? Create the file/folder for this? ie > mkdir suscriptions ? > > > On Fri, Mar 15, 2019 at 5:29 AM Aki Tuomi <aki.tuomi(a)open-xchange.com > <mailto:aki.tuomi@open-xchange.com>> wrote: > > Nevertheless, the subscriptions file needs to be there. > > Aki > > On 15.3.201911.28, Kunal A. wrote: >> Dear Aki, >> Got it corrected. Many thanks for pointing it out. There is >> another error about suscriptions. I don't have any folder with >> subscriptions. See the error below :- >> >> Mar 15 05:22:10 machine dovecot[4804]: imap(email1(a)example.com >> <mailto:email1@example.com>)<4970><XjWwkh6EBsAAAAAAAAAAAAAAAAAAAAAB>: >> Error: stat(/mnt/computer/Email/fastmail/subscriptions) failed: >> Permission denied >> >> dr-xr-xr-x root root / >> drwxr-xr-x root root mnt >> drwxr-xr-x vmail vmail computer >> drwxrwxr-x vmail vmail Email >> drwxrwxr-x vmail vmail fastmail >> subscriptions - No such file or directory >> >> Best Regards >> >> >> On Fri, Mar 15, 2019 at 3:02 AM Aki Tuomi >> <aki.tuomi(a)open-xchange.com <mailto:aki.tuomi@open-xchange.com>> >> wrote: >> >> >> On 15.3.2019 8.40, Kunal A. via dovecot wrote: >>> Hey, >>> Could someone help figure out whats wrong with my config >>> based on the debug below? >>> >>> What I am trying to achieve is to get email1(a)example.com >>> <mailto:email1@example.com> to read emails in the Public >>> directory that is stored on >>> /run/media/computer/Storage/Email/fastmail/Archive with the >>> preface Public/Archive . >>> >>> The ACL has been set for anyone with permissions to >>> lookup,read,write as shown below:- >>> >>> doveadm acl get -u email1(a)example.com >>> <mailto:email1@example.com> Public/Archive >>> ID Global >>> Rights >>> anyone lookup read write >>> >>> But when I try to access the emails for email1(a)example.com >>> <mailto:email1@example.com> , there are no folders. >>> Could someone here help review my debug log and advise what >>> could be causing this (dovecot -n output is provided below >>> the debug message) >>> >>> Many thanks for assistance. >>> Thanks >>> >> >>> Mar 15 01:29:28 machine dovecot[2100]: >>> imap(email1(a)example.com >>> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >>> Error: >>> open(/run/media/computer/Storage/Email/fastmail/dovecot-acl-list) >>> failed: Permission denied >> >>> Mar 15 01:29:28 machine dovecot[2100]: >>> imap(email1(a)example.com >>> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >>> Error: stat(/run/media/computer/Storage/Email/fastmail) >>> failed: Permission denied (euid=5000(vmail) egid=5000(vmail) >>> missing +w perm: /run/media/computer/Storage/Email/fastmail >>> stat(/run/media/computer/Storage/Email/fastmail) failed: >>> Permission denied, dir owned by 0:0 mode=0775) >> >>> Mar 15 01:29:28 machine dovecot[2100]: >>> imap(email1(a)example.com >>> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >>> Error: >>> stat(/run/media/computer/Storage/Email/fastmail/.temp.e480machine.5167.a6506e27bd37a68a) >>> failed: Permission denied >> >>> Mar 15 01:30:14 machine dovecot[2100]: >>> imap(email1(a)example.com >>> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >>> Error: mkdir(/run/media/computer/Storage/Email/fastmail) >>> failed: Permission denied (euid=5000(vmail) egid=5000(vmail) >>> missing +w perm: /run/media/computer, we're not in group >>> 0(root), dir owned by 0:0 mode=0775) >>> >> >> Maybe try fix these? >> >> >> Aki >>

2 1

Double quota calulation when special folder is present
by Bernd Wurst 15 Mar '19

15 Mar '19

Hello, we're operating dovecot on a small server. Some years ago, we migrated from courier IMAP to dovecot. Therefore, we defined our default Namespace "inbox" with prefix "INBOX." to have this compatible. I found this in some migration docs those days. Generally, everything worked as expected. Our only namespace is configured like this: namespace inbox { separator = . prefix = INBOX. inbox = yes } Regularly, there is no folder named INBOX or .INBOX in the file system, I suppose this is correct. But I found a special corner case today when it comes to quota calculation. When - for whatever reason - a folder .INBOX.foo (for arbitrary values of foo) exists, the whole mailbox is counted twice in quota recalculation. Just creating .INBOX does nothing but a subfolder triggers the problem. This is my shell view (replaced username and file path and deleted unnecessary debug output) $ cat maildirsize 268435456S 14697 17 $ maildirmake .INBOX.foo $ sudo doveadm -D quota recalc -u <user> [...] doveadm(<user>): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/.../test doveadm(<user>): Debug: maildir++: root=/home/.../test, index=, indexpvt=, control=, inbox=/home/.../test, alt= doveadm(<user>): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(<user>): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>): Debug: Quota root User quota: Recalculated relative rules with bytes=268435456 count=0. Now grace=26843545 doveadm(<user>): Debug: Namespace INBOX.: Using permissions from /home/.../test: mode=0700 gid=default $ cat maildirsize 268435456S 29394 34 So the used quota has exactly been doubled by just creating an empty subfolder. Do you have any pointers for fixing my configuration or is this a bug in dovecot? regards, Bernd

2 1

Upgrading to 2.3
by ＠lbutlr 15 Mar '19

15 Mar '19

I haven't upgraded to dovecot 2.3 yet, but am looking into doing it. I thought there was a link to some of the issues and changes you needed to make to your configuration to go from 2.2 to 2.3, but now I cannot find it. -- Science is the foot that kicks magic square in the nuts.

4 4

Re: ACL Folders are open but not being displayed ? [2.3.3]
by Aki Tuomi 15 Mar '19

15 Mar '19

Nevertheless, the subscriptions file needs to be there. Aki On 15.3.201911.28, Kunal A. wrote: > Dear Aki, > Got it corrected. Many thanks for pointing it out. There is another > error about suscriptions. I don't have any folder with subscriptions. > See the error below :- > > Mar 15 05:22:10 machine dovecot[4804]: imap(email1(a)example.com > <mailto:email1@example.com>)<4970><XjWwkh6EBsAAAAAAAAAAAAAAAAAAAAAB>: > Error: stat(/mnt/computer/Email/fastmail/subscriptions) failed: > Permission denied > > dr-xr-xr-x root root / > drwxr-xr-x root root mnt > drwxr-xr-x vmail vmail computer > drwxrwxr-x vmail vmail Email > drwxrwxr-x vmail vmail fastmail > subscriptions - No such file or directory > > Best Regards > > > On Fri, Mar 15, 2019 at 3:02 AM Aki Tuomi <aki.tuomi(a)open-xchange.com > <mailto:aki.tuomi@open-xchange.com>> wrote: > > > On 15.3.2019 8.40, Kunal A. via dovecot wrote: >> Hey, >> Could someone help figure out whats wrong with my config based on >> the debug below? >> >> What I am trying to achieve is to get email1(a)example.com >> <mailto:email1@example.com> to read emails in the Public >> directory that is stored on >> /run/media/computer/Storage/Email/fastmail/Archive with the >> preface Public/Archive . >> >> The ACL has been set for anyone with permissions to >> lookup,read,write as shown below:- >> >> doveadm acl get -u email1(a)example.com <mailto:email1@example.com> >> Public/Archive >> ID Global Rights >> anyone lookup read write >> >> But when I try to access the emails for email1(a)example.com >> <mailto:email1@example.com> , there are no folders. >> Could someone here help review my debug log and advise what could >> be causing this (dovecot -n output is provided below the debug >> message) >> >> Many thanks for assistance. >> Thanks >> > >> Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com >> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >> Error: >> open(/run/media/computer/Storage/Email/fastmail/dovecot-acl-list) >> failed: Permission denied > >> Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com >> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >> Error: stat(/run/media/computer/Storage/Email/fastmail) failed: >> Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w >> perm: /run/media/computer/Storage/Email/fastmail >> stat(/run/media/computer/Storage/Email/fastmail) failed: >> Permission denied, dir owned by 0:0 mode=0775) > >> Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com >> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >> Error: >> stat(/run/media/computer/Storage/Email/fastmail/.temp.e480machine.5167.a6506e27bd37a68a) >> failed: Permission denied > >> Mar 15 01:30:14 machine dovecot[2100]: imap(email1(a)example.com >> <mailto:email1@example.com>)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: >> Error: mkdir(/run/media/computer/Storage/Email/fastmail) failed: >> Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w >> perm: /run/media/computer, we're not in group 0(root), dir owned >> by 0:0 mode=0775) >> > > Maybe try fix these? > > > Aki >

1 0

ACL Folders are open but not being displayed ? [2.3.3]
by Kunal A. 15 Mar '19

15 Mar '19

Hey, Could someone help figure out whats wrong with my config based on the debug below? What I am trying to achieve is to get email1(a)example.com to read emails in the Public directory that is stored on /run/media/computer/Storage/Email/fastmail/Archive with the preface Public/Archive . The ACL has been set for anyone with permissions to lookup,read,write as shown below:- doveadm acl get -u email1(a)example.com Public/Archive ID Global Rights anyone lookup read write But when I try to access the emails for email1(a)example.com , there are no folders. Could someone here help review my debug log and advise what could be causing this (dovecot -n output is provided below the debug message) Many thanks for assistance. Thanks Debug Message: Mar 15 01:26:47 machine dovecot[2100]: imap-login: Login: user=< email1(a)example.com>, method=PLAIN, rip=::1, lip=::1, mpid=5167, secured, session=<i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB> Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Loading modules from directory: /usr/lib64/dovecot Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Module loaded: /usr/lib64/dovecot/lib02_imap_acl_plugin.so Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Effective uid=5000, gid=5000, home=/var/mail/vhosts/ example.com/email1 Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: quota: No quota setting - plugin disabled Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Namespace inbox: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: maildir++: root=/var/mail/vhosts/example.com/email1/Maildir, index=, indexpvt=, control=, inbox=/var/mail/vhosts/example.com/email1/Maildir, alt= Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl: initializing backend with data: vfile Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl: acl username = email1(a)example.com Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl: owner = 1 Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl vfile: Global ACLs disabled Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/run/media/computer/Storage/Email/fastmail:LAYOUT=fs Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: fs: root=/run/media/computer/Storage/Email/fastmail, index=, indexpvt=, control=, inbox=, alt= Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl: initializing backend with data: vfile Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl: acl username = email1(a)example.com Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl: owner = 0 Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl vfile: Global ACLs disabled Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none Mar 15 01:26:47 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Mar 15 01:28:37 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Mailbox INBOX: Mailbox opened because: SELECT Mar 15 01:28:37 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl vfile: file /var/mail/vhosts/ example.com/email1/Maildir/dovecot-acl not found Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Mailbox Public/Archive: Mailbox opened because: SELECT Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl vfile: no access to file /run/media/computer/Storage/Email/fastmail/Archive/dovecot-acl Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Error: open(/run/media/computer/Storage/Email/fastmail/dovecot-acl-list) failed: Permission denied Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Error: stat(/run/media/computer/Storage/Email/fastmail) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /run/media/computer/Storage/Email/fastmail stat(/run/media/computer/Storage/Email/fastmail) failed: Permission denied, dir owned by 0:0 mode=0775) Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Namespace Public/: Using permissions from /run/media/computer/Storage/Email/fastmail: mode=0700 gid=default Mar 15 01:29:28 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Error: stat(/run/media/computer/Storage/Email/fastmail/.temp.e480machine.5167.a6506e27bd37a68a) failed: Permission denied Mar 15 01:29:35 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: Mailbox INBOX/Public/Archive: Mailbox opened because: SELECT Mar 15 01:29:35 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl vfile: file /var/mail/vhosts/ example.com/email1/Maildir/.Public.Archive/dovecot-acl not found Mar 15 01:30:14 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Debug: acl vfile: file /var/mail/vhosts/ example.com/email1/Maildir/.Trash/dovecot-acl not found Mar 15 01:30:14 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Error: mkdir(/run/media/computer/Storage/Email/fastmail) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /run/media/computer, we're not in group 0(root), dir owned by 0:0 mode=0775) Mar 15 02:00:14 machine dovecot[2100]: imap(email1(a)example.com)<5167><i8fdSBuE8uMAAAAAAAAAAAAAAAAAAAAB>: Disconnected for inactivity in=155 out=1494 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 dovecot -n Output : # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # OS: Linux 4.20.14-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty Nine) # Hostname: machine auth_mechanisms = plain login mail_debug = yes mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = acl quota mail_privileged_group = mail mail_uid = vmail mbox_write_locks = fcntl namespace { list = children location = maildir:/run/media/computer/Storage/Email/fastmail:LAYOUT=fs prefix = Public/ separator = / subscriptions = yes type = public } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/mail/vhosts/example.com/Sharedbox } postmaster_address = postmaster at example.com protocols = imap pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = quota acl sieve quota } protocol lda { mail_plugins = quota acl sieve } protocol imap { mail_plugins = acl quota imap_acl quota acl imap_quota }

2 1

dovecot.conf "local hostname" uses only one resolved value
by James 14 Mar '19

14 Mar '19

https://wiki.dovecot.org/SSL/DovecotConfiguration#Different_certificates_pe… says: local 192.0.2.10 { # instead of IP you can also use hostname, which will be resolved However if the name resolves to multiple values only one is used. Test. Choose any name with multiple values, I created a local name: $ nslookup multi.lan Server: 127.0.0.1 Address: 127.0.0.1#53 Name: multi.lan Address: 192.168.1.2 Name: multi.lan Address: 192.168.1.3 Name: multi.lan Address: 192.168.1.1 Minimal dovecot.conf: local multi.lan { protocol imap { ssl_cert = </path/to/certs/multi.lan.crt ssl_key = </path/to/certs/multi.lan.key } } $ dovecot -n -c dovecot.conf # 2.3.5 (513208660): dovecot.conf ... local 192.168.1.2 { protocol imap { ssl_cert = </path/to/certs/multi.crt ssl_key = # hidden, use -P to show it } } Only 192.168.1.2 appears. In my real case with A and AAAA records, only the AAAA record is used. Testing with "openssl s_client -starttls imap ..." gives me the wrong certificate for the IPv4 address. Workaround: specify all addresses and do not use lookup. James.

1 0

dovecot/config processes one more time - which are safe to kill?
by Arkadiusz Miśkiewicz 14 Mar '19

14 Mar '19

Hello. The problem with dovecot/config processes never ending and spawning new one on each reload (https://www.dovecot.org/list/dovecot/2016-November/106058.html) is becoming a problem here: # ps aux|grep dovecot/config|wc -l 206 That's a lot of wasted memory - dovecot/config processes ate over 30GB of ram on 64GB box. Before killing dovecot/config processes: # free -m total used free shared buff/cache available Mem: 64437 61656 483 0 2297 after: # free -m total used free shared buff/cache available Mem: 64437 23676 37822 0 2939 Currently on dovecot 2.3.3. I guess it's very low priority to handle that, so: how can I figure out which dovecot/config processes are safe to be killed by external script? Does "all beside 2 newest ones" rule look sane? Thanks, -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

3 5

Quota questions
by Peter Hudec 14 Mar '19

14 Mar '19

Hi all, I’m a little bit confused about the quota plugin in dovecot and fighting the the issues the people had years ago. I spent readingg the old archives and the mailing list for 3 days and not able to get work some features. Single user quota is fine and simple, the group quota /for example domain based/ makes me unhappy. Setup: CentOS7, dovecot comunity repo, dovecot 2.3.5 1) domain quota recalc domain quota recalc do not work properly. The domain qouta usage is worknig well, hwhen receiving/deleting mail, generaly if the operations are incremental. But if I run domain quota recalc, the doveadm is setting the domain quota after each user calculation, that means the domain quota is set to the last user. 2) multiple quota roots and rules According the documentation, there could be possible, from the sample configuration file # Multiple quota roots are also possible, for example this gives each user # their own 100MB quota and one shared 1GB quota within the domain plugin { quota = dict:User quota::proxy::quota quota2 = dict:Group quota:%d:proxy::quota_domain quota_rule = *:storage=1024M quota2_rule = *:storage=2048M } But If I run [TEST] root(a)mail-store01.test.host.sk: /etc/dovecot # doveadm quota get -u '*' Username Quota name Type Value Limit % test01(a)test.host.sk User quota STORAGE 1 1024 0 test01(a)test.host.sk User quota MESSAGE 1 - 0 test01(a)test.host.sk Group quota STORAGE 7 - 0 test01(a)test.host.sk Group quota MESSAGE 3 - 0 test03(a)test.host.sk User quota STORAGE 7 1024 0 test03(a)test.host.sk User quota MESSAGE 3 - 0 test03(a)test.host.sk Group quota STORAGE 7 - 0 test03(a)test.host.sk Group quota MESSAGE 3 - 0 The idea is to have overall domain quota, but for user able to set it’s personal quota. regards Peter

2 3

dovecot-keywords are not preserved any more when moving mails between folders
by Piper Andreas 14 Mar '19

14 Mar '19

Hello, after an upgrade of dovecot-2.2.5 to dovecot-2.3.4 the dovecot-keywords, which in my case are set by thunderbird, are not preserved any more when moving a mail between folders. Are there any ideas, what may be the reason. Thanks for any hints on that, Andreas 'doveconf -n' gives: # 2.3.4 (0ecbaf23d): /etc/opt/csw/dovecot/dovecot.conf # Pigeonhole version 0.5.4 (60b0f48d) # OS: SunOS 5.11 i86pc # Hostname: xxxxx.hrz.uni-marburg.de auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_master_user_separator = * auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_ auth_username_format = %u auth_worker_max_count = 1024 base_dir = /var/run/dovecot/ default_vsz_limit = 1 G first_valid_gid = 30000 first_valid_uid = 30000 imap_max_line_length = 640 k mail_debug = yes mail_location = maildir:%h/.maildir mail_plugins = " mail_log notify" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { hidden = no inbox = yes list = yes location = maildir:%h/.maildir prefix = separator = / subscriptions = yes type = private } namespace inbox { hidden = yes inbox = no list = no location = maildir:%h/.maildir prefix = mail/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot.deny deny = yes driver = passwd-file } passdb { args = /etc/opt/csw/dovecot/private/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/opt/csw/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_default = /var/lib/dovecot/default.sieve } pop3_uidl_format = %08Xv%08Xu postmaster_address = postmaster(a)hrz.uni-marburg.de protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 6000 } service imap-login { process_min_avail = 64 service_count = 0 } service imap { process_limit = 4096 } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/opt/csw/ssl/certs/imap+pop.hrz.uni-marburg.de.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/opt/csw/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 25 ssl_cert = </etc/opt/csw/ssl/certs/imap+pop.hrz.uni-marburg.de.pem ssl_key = # hidden, use -P to show it } protocol lmtp { mail_plugins = " mail_log notify sieve" } protocol pop3 { ssl_cert = </etc/opt/csw/ssl/certs/imap+pop.hrz.uni-marburg.de.pem ssl_key = # hidden, use -P to show it }

5 8

replication dropped imap flags
by Patrick Cernko 14 Mar '19

14 Mar '19

Hi list, I think, I found a bug in the replication setup, that drops (custom) flags like Thunderbird labels. I have set up a simple 2 node setup to reproduce and explain it: Host adove.mpi-klsb.mpg.de and bdove.mpi-klsb.mpg.de (doveconf -n attached) have dovecot-imapd (from repo.dovecot.org) installed on an ext4 filesystem. They only have one account "test" via /etc/dovecot/userdb ("test:testpassword:::Test User::/bin/bash:"). It's mailbox contains one message, that is flagged with "$label1": doveadm -f flow fetch -u test 'guid flags' ALL guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent $label1 Now I simulate a node reinstall on adove by uninstalling dovecot, removing all remnants, reinstalling and configuring it again: apt purge dovecot-core dovecot-imapd rm -rf /var/vmail /var/lib/dovecot /etc/dovecot apt install dovecot-imapd # disable system auth : > /etc/dovecot/conf.d/auth-system.conf.ext # create /var/vmail install -d -o nobody -g nogroup -m 700 /var/vmail # create userdb echo 'test:testpassword:::Test User::/bin/bash:' > /etc/dovecot/userdb # create /etc/dovecot/local.conf # not described here, the resulting doveconf -n is attached! service dovecot restart When I check the flags of the mail of user test now, the "$label1" is disapeared on both machines, even after "doveadm replicator replicate -f test": doveadm -f flow fetch -u test 'guid flags' ALL guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent Any hints what I am doing wrong here or is this really a bug? Best, -- Patrick Cernko <pcernko(a)mpi-klsb.mpg.de> +49 681 9325 5815 Joint Administration: Information Services and Technology Max-Planck-Institute fuer Informatik & Softwaresysteme

1 2

Am I right to assume certificate renewal with the same filename requires a dovecot reload/restart
by Guido Goluke, MajorLabel 14 Mar '19

14 Mar '19

Running dovecot 2.2, apologies if this question has been asked before: I've done the research but couldn't find anything. I run a server that uses dovecot as a MUA for Postfix and have a Let's Encrypt certificate that auto-renews through certbot on Ubuntu server 16.04. Dovecot did not pick up on the new certificate for the hostname. It did after a restart. To be clear: Let's Encrypt overwrites the previous certificate using the same path and filename. Am I right to assume that Dovecot needs a reload/restart after the certificate has been renewed in order to 'pick up' on the new certificate and if so, would I require a reload or a restart? Thank you in advance -- MajorLabel

4 8

Unable to set quota-fs plugin
by Eric Grammatico 14 Mar '19

14 Mar '19

Hello There, I am try desperatly to setup quota-fs plugin in Dovecot. I have the following configuration in place: /etc/dovecot/conf.d/10-mail.conf:mail_plugins = $mail_plugins quota zlib /etc/dovecot/conf.d/20-imap.conf: mail_plugins = $mail_plugins imap_quota /etc/dovecot/conf.d/90-quota.conf: plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota #quota = fs:User quota:user quota = fs:user } The logs report the following error each time quota is requested: Mar 11 17:56:20 mail.xxxxxxx.xx dovecot[4923]: imap(xxxx): Error: Failed to get quota resource STORAGE: quota-fs: quotactl(Q_GETQUOTA, /dev/vda1) failed: No such file or directory I have no idea of which file or directory is missing. Any advice is welcome. Thanks and best regards, - Eric Grammatico _/)

3 11

rsync /old/server new/server ?
by Voytek Eymont 14 Mar '19

14 Mar '19

I have Centos 7 with dovecot/postfix/mysql Maildir I want to bring in a new server, new server will have same hostname as current, but, different IP I was intending to rsync -avzhe ssh vmail@oldserver:/var/vmail/vmail1 /var/vmail/vmail1 and, then, re run as necessary when/if mail still arrives on old server is that "a good plan" ...? TIA, V

4 3

recipient bcc and dovecot
by ＠lbutlr 13 Mar '19

13 Mar '19

I have a recipient_bcc_maps which contains a bcc map that is updated everyday: rbcc.pcre: if !/backup.*@/ /^([^+_]*).*(a)([^.]*)/ backup+071.${1}-${2}(a)adomain.tld endif the 071 portion is changed each day to the current day of the year. Everything works, but I get an error from dovecot on every message: lda(backup(a)adomain.tld): Error: User initialization failed: Namespace '': Ambiguous mail location setting, don't know what to do with it: /usr/local/virtual/backup(a)adomain.tld (try prefixing it with mbox: or maildir:) The mail is delivered two the right directory anyway, but after a temporary failure. I'd like to eliminate the error. the backup user is not a 'real' user (it is not in the lookup map) so should I bypass dovecot entirely in delivering these messages? (and if so, how) If not, where/how would I add the prefix maildir: Is there something I can add to dovecot to specifically deal with messages coming in to backup(a)adomain.tld and add the maildir: specification there? (Still on dovecot 2.2.35) -- And sometimes there's a short cut. A door or a gate. Some standing stones. A tree cleft by lightning, a filing cabinet. Maybe just a spot on some moorland somewhere... A place where THERE is very nearly HERE... If some people knew where such a spot was, if they had experience of what happens when here and there become entangled, then they might - if they knew how - mark such a spot with certain stones. In the hope that enough daft buggers would take it as a warning and keep away. (Lords and Ladies)

2 3

sieve vacation to an alias group
by Monis Monther 13 Mar '19

13 Mar '19

Hi, We have an alias group named xyz(a)example.com, this alias group has 3 actual users a(a)example.com, b(a)example.com and c(a)example.com We set vacation rule on the generic sieve rule, the problem is that 3 responses are sent to the original sender. (obviously because the rule is being executed with each user in the alias group) Is it possible to set auto response only once, we tried the ( :days 1) option but still all 3 respond back. How can such a setup be achieved. (Single auto response to an alias group) CentOS 7.5 dovecot-pigeonhole-2.3.4.1-1.x86_64 dovecot-2.3.4.1-1.x86_64 postfix 2.10-1 -- Best Regards Monis

4 14

Delayed flags changes over IDLE
by Kostya Vasilyev 13 Mar '19

13 Mar '19

Hello, I'm experiencing slow flags changes over IMAP IDLE: - If I start an IDLE session / command - Change the flags of some messages via another email app - Dovecot can take a minute or more to notify the IDLE connection about flags changes If I use another email app to add or remove a message, Dovecot sends that (EXISTS / EXPUNGE) instantly and also flushes the (so far delayed) flags changes. So it does "know" already. The system is Debian Testing, 64 bit, file system is ext4. Dovecot is 2.3.4.1 (f79e8e7e4) - I believe from Debian repos (I had Dovecot's own repo added at some point, disabled now). My mail is stored under ~/mail/.imap (not sure what this format is called), I mean not "single file mbox". I have not changed any IDLE related config settings: doveconf | grep -i idle default_idle_kill = 1 mins director_ping_idle_timeout = 30 secs imap_idle_notify_interval = 2 mins imapc_max_idle_time = 29 mins mailbox_idle_check_interval = 30 secs What can I do to make Dovecot notify IDLE clients about flags changes - more quickly? Preferably near-instant? -- Kostya Vasilyev kman(a)fastmail.com

3 9

“doveadm mailbox” command fails with UTF-8 mailboxes
by Felipe Gasper 13 Mar '19

13 Mar '19

Hello, I’ve got a strange misconfiguration where the following command: doveadm -f pager mailbox status -u spamutf8 'messages vsize guid' INBOX 'INBOX.*' … fails with error code 68, saying that it can’t find one of the mailboxes. (It lists the user’s other mailboxes.) The name of the mailbox in question is saved to disk in UTF-8 rather than mUTF-7, but strace shows that doveadm is stat()ing the mUTF-7 path; the failure of that stat() is, assumedly, what causes doveadm to report the error status. I’ve tried to paw through the source code to see what might be causing this but haven’t made much headway. Can someone here point out where the misconfiguration might be that is causing doveadm to stat() the mUTF-7 path rather than UTF-8? Or perhaps offer any tips as to how I might diagnose what’s going on? What causes doveadm to stat() one path or the other? Thank you! -Felipe Gasper Mississauga, ON

5 9

Inbox quota usage doubled when mailbox_list_index enabled, under some circumstances
by Chris Dillon 13 Mar '19

13 Mar '19

Hello, I searched through the list archives for anything that appeared to be similar to this but I didn't find any good matches. I apologize if this has been brought up before. Beginning with Dovecot 2.2.34, reported quota usage of a user's inbox can be doubled when the following criteria are met: 1) quota plugin is enabled 2) mailbox_list_index=yes 3) A sub-folder of the inbox exists whose name also matches the prefix (for example, "INBOX.Test"), even if that folder has no contents. (Apparently, some mail clients such as K-9 Mail on Android can create these folders automatically) Downgrading to 2.2.33.2 allows this configuration to work normally. I looked through the changes in git between 2.2.33.2 and 2.2.34 and they appeared extensive, so unfortunately I wasn't able to pinpoint a specific change that caused this. Reproduced on a CentOS 7 server with Dovecot 2.2.34 built from git sources according to https://wiki2.dovecot.org/CompilingSource#Compiling_Dovecot_From_Git using the following minimal configuration: ========== root@centos7 [~]# dovecot -n # 2.2.34 (874deae): /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.9.1.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) # Hostname: centos7.local mail_location = maildir:~/Maildir mail_plugins = quota mailbox_list_index = yes namespace inbox { inbox = yes location = prefix = INBOX. separator = . } passdb { driver = pam } plugin { quota = maildir:Mailbox } userdb { driver = passwd } ========== With the system user "myuser" and a minimal Maildir setup containing 1 email in the inbox, and one sub-folder named "INBOX.Test": ========== root@centos7 [~]# ls -lAR /home/myuser/Maildir /home/myuser/Maildir: total 4 drwxr-xr-x. 2 myuser myuser 77 Jul 25 09:36 cur drwxr-xr-x. 5 myuser myuser 56 Jul 25 15:19 .INBOX.Test -rw-r--r--. 1 myuser myuser 14 Jul 25 15:19 maildirsize drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 new drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 tmp /home/myuser/Maildir/cur: total 12416 -rw-r--r--. 1 myuser myuser 12712627 Jul 25 09:07 1532529376.M543965P58007.centos7.local,S=12712627,W=12877782:2,S /home/myuser/Maildir/.INBOX.Test: total 0 drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 cur -rw-r--r--. 1 myuser myuser 0 Jul 25 09:36 maildirfolder drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 new drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 tmp /home/myuser/Maildir/.INBOX.Test/cur: total 0 /home/myuser/Maildir/.INBOX.Test/new: total 0 /home/myuser/Maildir/.INBOX.Test/tmp: total 0 /home/myuser/Maildir/new: total 0 /home/myuser/Maildir/tmp: total 0 ========== Given this configuration, when "mailbox_list_index" is enabled, after quota recalculation, quota reports that there are 2 messages and that double the amount of storage is used: ========== root@centos7 [~]# doveadm quota recalc -u myuser; doveadm quota get -u myuser Quota name Type Value Limit % Mailbox STORAGE 24830 - 0 Mailbox MESSAGE 2 - 0 ========== When "mailbox_list_index" is disabled and quota is recalculated, it will report the message and storage counts correctly: ========== root@centos7 [~]# doveadm -o 'mailbox_list_index=no' quota recalc -u myuser; doveadm quota get -u myuser Quota name Type Value Limit % Mailbox STORAGE 12415 - 0 Mailbox MESSAGE 1 - 0 ========== I am hoping that someone with much more familiarity with the code path involved here could take a look at this issue and possibly submit a fix for it -- that would be greatly appreciated. Please let me know if you need any more details regarding the replication steps, though I hope that I didn't miss anything. Thank you! -- Chris Dillon Technical Analyst III Migrations Specialist cPanel, Inc.

2 3

Dovecot 2.3.4 crash
by azurit＠pobox.sk 13 Mar '19

13 Mar '19

Hi, is this a know problem? Newest Dovecot 2.3.4 package from repo.dovecot.org , Debian Stretch (fully upgraded). Nov 29 14:25:11 server00 dovecot: lmtp(16854): Panic: file ostream-dot.c: line 208 (o_stream_dot_sendv): assertion failed: ((size_t)ret == sent + added) Nov 29 14:25:11 server00 dovecot: lmtp(16854): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xd25e1) [0x7fa5f7b655e1] -> /usr/lib/dovecot/libdovecot.so.0(+0xd2681) [0x7 fa5f7b65681] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fa5f7acd093] -> /usr/lib/dovecot/libdovecot.so.0(+0xbb97b) [0x7fa5f7b4e97b] -> /usr/lib/dovecot/libdovecot.so.0(+0x fa4ae) [0x7fa5f7b8d4ae] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_sendv+0x2e) [0x7fa5f7b8da3e] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_copy+0x52) [0x7fa5f7b8e512] -> /usr /lib/dovecot/libdovecot.so.0(o_stream_send_istream+0x58) [0x7fa5f7b8e008] -> /usr/lib/dovecot/libdovecot.so.0(smtp_client_command_send_more+0x1b1) [0x7fa5f7ad7351] -> /usr/lib/dov ecot/libdovecot.so.0(+0x4a096) [0x7fa5f7add096] -> /usr/lib/dovecot/libdovecot.so.0(+0xfd0c3) [0x7fa5f7b900c3] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x75) [0x7fa5f7b 7e5d5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7fa5f7b7ffd9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x56) [0x7fa5f7b7e6e6] -> / usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fa5f7b7e8f8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fa5f7af2d43] -> dovecot/lmtp [local DATA](main+ 0x240) [0x565287c30f70] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7fa5f77142e1] -> dovecot/lmtp [local DATA](_start+0x2a) [0x565287c310ca] Nov 29 14:25:11 server00 dovecot: lmtp(16854): Fatal: master: service(lmtp): child 16854 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) azur

3 5

Crash in director for secure lmtp proxy connections
by Marcus Fenner 13 Mar '19

13 Mar '19

Hi, After updating some of our director servers from 2.2.36 to 2.3.3 (dcead646b) we experience crashes in about 1/5000 mails in lmtp delivery: Nov 13 12:23:36 Fatal: lmtp(113620): master: service(lmtp): child 113620 killed with signal 6 (core dumped) Nov 13 12:23:36 Panic: lmtp(113623): file ostream-dot.c: line 208 (o_stream_dot_sendv): assertion failed: ((size_t)ret == sent + added) Nov 13 12:23:36 Error: lmtp(113623): Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xe34fb) [0x7f31d89134fb] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe3597) [0x7f31d8913597] -> /usr/lib64/dovecot/libdovecot.so.0(+0x51207) [0x7f31d8881207] -> /usr/lib64/dovecot/libdovecot.so.0(+0x4eeef) [0x7f31d887eeef] -> /usr/lib64/dovecot/libdovecot.so.0(+0x107cf8) [0x7f31d8937cf8] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0x32) [0x7f31d89382c2] -> /usr/lib64/dovecot/libdovecot.so.0(io_stream_copy+0x5a) [0x7f31d8938b6a] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send_istream+0x53) [0x7f31d8938873] -> /usr/lib64/dovecot/libdovecot.so.0(smtp_client_command_send_more+0x145) [0x7f31d8890805] -> /usr/lib64/dovecot/libdovecot.so.0(+0x660dd) [0x7f31d88960dd] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa7e1) [0x7f31d864a7e1] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a558) [0x7f31d893a558] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x73) [0x7f31d892a203] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x136) [0x7f31d892b8b6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) [0x7f31d892a2b0] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x48) [0x7f31d892a418] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x17) [0x7f31d88a95a7] -> dovecot/lmtp(main+0x245) [0x555b8b59cea5] -> /lib64/libc.so.6(__libc_start_main+0xf3) [0x7f31d867c413] -> dovecot/lmtp(_start+0x2e) [0x555b8b59cfbe] Nov 13 12:23:36 Fatal: lmtp(113623): master: service(lmtp): child 113623 killed with signal 6 (core dumped) On the backend servers the only message is lmtp(9571): Disconnect from 192.168.1.56: Connection closed (in DATA) This happens for every server with this version every time postfix tries to resend the mail. After removing "starttls=y" from the static passdb entry, the mail is sent successfully. Starting with version 2.3.2 the lmtp proxy uses starttls as well, therefore the error seems to be there. I've not been able to figure out, if this has to do with the content of the mails, because they are from many different sources. Thanks! Marcus

3 2

lmtp 2.3.2.1 segfault with backtrace
by Tom Sommer 13 Mar '19

13 Mar '19

lmtp on Director crash with 2.3.2.1 # gdb /usr/libexec/dovecot/lmtp /var/core/60174 GNU gdb (GDB) Red Hat Enterprise Linux (7.2-92.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/lmtp...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/lmtp.debug...done. done. [New Thread 60174] Reading symbols from /usr/lib64/dovecot/libdovecot-lda.so.0...Reading symbols from /usr/lib/debug/usr/lib64/dovecot/libdovecot-lda.so.0.0.0.debug...done. done. Loaded symbols for /usr/lib64/dovecot/libdovecot-lda.so.0 Reading symbols from /usr/lib64/dovecot/libdovecot-storage.so.0...Reading symbols from /usr/lib/debug/usr/lib64/dovecot/libdovecot-storage.so.0.0.0.debug...done. done. Loaded symbols for /usr/lib64/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/lib64/dovecot/libdovecot.so.0...Reading symbols from /usr/lib/debug/usr/lib64/dovecot/libdovecot.so.0.0.0.debug...done. done. Loaded symbols for /usr/lib64/dovecot/libdovecot.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /usr/lib64/dovecot/libssl_iostream_openssl.so...Reading symbols from /usr/lib/debug/usr/lib64/dovecot/libssl_iostream_openssl.so.debug...done. done. Loaded symbols for /usr/lib64/dovecot/libssl_iostream_openssl.so Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssl.so.10 Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libcrypto.so.10 Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libgssapi_krb5.so.2 Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5.so.3 Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcom_err.so.2 Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libk5crypto.so.3 Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5support.so.0 Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libkeyutils.so.1 Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libresolv.so.2 Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libselinux.so.1 Core was generated by `dovecot/lmtp'. Program terminated with signal 11, Segmentation fault. #0 smtp_client_command_set_replies (cmd=0x0, replies=1) at smtp-client-command.c:401 401 i_assert(cmd->replies_expected == 1 || Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.212.el6.x86_64 keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-65.el6.x86_64 libcom_err-1.41.12-24.el6.x86_64 libselinux-2.0.94-7.el6.x86_64 openssl-1.0.1e-57.el6.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt full #0 smtp_client_command_set_replies (cmd=0x0, replies=1) at smtp-client-command.c:401 __func__ = "smtp_client_command_set_replies" #1 0x00007f5d14f40f3f in smtp_client_transaction_data_cb (reply=0x7ffe5cd19650, trans=0x7f5d176ae2b8) at smtp-client-transaction.c:658 conn = 0x7f5d176ade80 rcpt = 0x7f5d176ae560 i = <value optimized out> count = 1 #2 0x00007f5d14f3e941 in smtp_client_command_fail_reply (_cmd=<value optimized out>, reply=0x7ffe5cd19650) at smtp-client-command.c:299 cmd = 0x7f5d17600d18 tmp_cmd = <value optimized out> conn = 0x7f5d176ade80 state = <value optimized out> callback = 0x7f5d14f40e80 <smtp_client_transaction_data_cb> #3 0x00007f5d14f4113f in smtp_client_transaction_fail_reply (trans=0x7f5d176ae2b8, reply=0x7ffe5cd19650) at smtp-client-transaction.c:365 conn = 0x7f5d176ade80 rcpts = <value optimized out> i = <value optimized out> count = <value optimized out> __func__ = "smtp_client_transaction_fail_reply" #4 0x00007f5d14f41442 in smtp_client_transaction_timeout (trans=0x7f5d176ae2b8) at smtp-client-transaction.c:419 reply = {status = 451, enhanced_code = {x = 4, y = 4, z = 0}, text_lines = 0x7f5d1759c090} #5 0x00007f5d14fdbe7b in io_loop_handle_timeouts_real (ioloop=0x7f5d175a4c80) at ioloop.c:641 timeout = 0x7f5d176299d0 tv = {tv_sec = 0, tv_usec = 0} tv_call = {tv_sec = 1534202969, tv_usec = 770866} t_id = 3 item = 0x7f5d176299d0 #6 io_loop_handle_timeouts (ioloop=0x7f5d175a4c80) at ioloop.c:655 _data_stack_cur_id = 2 #7 0x00007f5d14fdd667 in io_loop_handler_run_internal (ioloop=0x7f5d175a4c80) at ioloop-epoll.c:195 ctx = 0x7f5d175af300 events = <value optimized out> event = <value optimized out> list = <value optimized out> io = <value optimized out> tv = {tv_sec = 34, tv_usec = 105308} events_count = <value optimized out> msecs = <value optimized out> ret = 0 i = <value optimized out> call = <value optimized out> __func__ = "io_loop_handler_run_internal" #8 0x00007f5d14fdb7c5 in io_loop_handler_run (ioloop=0x7f5d175a4c80) at ioloop.c:726 __func__ = "io_loop_handler_run" #9 0x00007f5d14fdb9e8 in io_loop_run (ioloop=0x7f5d175a4c80) at ioloop.c:699 __func__ = "io_loop_run" #10 0x00007f5d14f58963 in master_service_run (service=0x7f5d175a4b10, callback=<value optimized out>) at master-service.c:767 No locals. #11 0x00007f5d159eb584 in main (argc=1, argv=0x7f5d175a48a0) at main.c:158 set_roots = {0x7f5d15262e20, 0x7f5d157c2040, 0x7f5d15bf1540, 0x0} service_flags = <value optimized out> storage_service_flags = <value optimized out> tmp_base_dir = 0x7f5d1759c040 "erver not answering (transaction timed out while waiting for reply to DATA)" c = <value optimized out> error = <value optimized out> -- Tom

3 3

2.3.3: Panic: file ostream-zlib.c: line 37 (o_stream_zlib_close): assertion failed
by Tom Sommer 13 Mar '19

13 Mar '19

I see this in my logs after 2.3.3: using zlib plugin, ofc. Oct 02 10:01:39 imap(user(a)example.com)<50643></2k4Sjp3vMqC496W>: Panic: file ostream-zlib.c: line 37 (o_stream_zlib_close): assertion failed: (zstream->ostream.finished || zstream->ostream.ostream.stream_errno != 0 || zstream->ostream.error_handling_disabled) Oct 02 10:01:39 imap(user(a)example.com)<50643></2k4Sjp3vMqC496W>: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xce56a) [0x7f442487556a] -> /usr/lib64/dovecot/libdovecot.so.0(+0xce5b1) [0x7f44248755b1] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3d941) [0x7f44247e4941] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x5cdf) [0x7f44233c4cdf] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf4b46) [0x7f442489bb46] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_destroy+0x13) [0x7f442489be83] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x173) [0x7f4424b93973] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x36) [0x7f4424b68696] -> dovecot/imap [user(a)example.com X.X.X.X APPEND](+0xede9) [0x55a9d7e86de9] -> dovecot/imap [user(a)example.com X.X.X.X APPEND](command_exec+0x65) [0x55a9d7e956e5] -> dovecot/imap [user(a)example.com X.X.X.X APPEND](+0xf9e6) [0x55a9d7e879e6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x55) [0x7f442488c275] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbf) [0x7f442488e13f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x55) [0x7f442488c365] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f442488c588] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f4424808053] -> dovecot/imap [user(a)example.com X.X.X.X APPEND](main+0x32d) [0x55a9d7ea20dd] -> /lib64/libc.so.6(__libc_start_main+0x100) [0x7f4424431d20] -> dovecot/imap [user(a)example.com X.X.X.X APPEND](+0xe419) [0x55a9d7e86419] No clue how to reproduce -- Tom

3 2

submission-login: Fatal: master: service(submission-login):
by Marcelo Coelho 13 Mar '19

13 Mar '19

Hi everyone! I’m using dovecot 2.3.5. submission-login is crashing many times in a day: Here is a sample error message: dovecot: submission-login: Fatal: master: service(submission-login): child 34247 killed with signal 11 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service submission-login { drop_priv_before_exec=yes }) After I added drop_priv_before_exec, I got these error messages: submission-login: Error: master-service: cannot get filters: net_connect_unix(/var/run/dovecot/config) failed: Permission denied dovecot: master: Error: service(submission-login): command startup failed, throttling for 2 secs How to get submission core dumps properly? Thank you. — Marcelo Coelho

3 2

imap-hibernate not working
by Marcelo Coelho 13 Mar '19

13 Mar '19

Hi, I follow different setup instructions and I can't make imap-hibernate work. I've tried vmail and dovecot as users, tried to set mode to 0666, without success. I'm using FreeBSD 11.2. Is imap-hibernate compatible with FreeBSD 11.2? My operational system: # uname -v FreeBSD 11.2-RELEASE-p9 #0: Tue Feb 5 15:30:36 UTC 2019 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC Here are my logs: Mar 8 15:30:57 servername dovecot: imap(user@domain.com:52.125.128.90): Error: kevent(-1) for notify remove failed: Bad file descriptor Mar 8 15:30:57 servername dovecot: imap(user@domain.com:52.125.128.90): Error: close(-1) for notify remove failed: Bad file descriptor Mar 8 15:30:57 servername dovecot: imap-hibernate: Error: Failed to parse client input: Invalid peer_dev_minor value: 18446744073709486335 Mar 8 15:30:57 servername dovecot: imap(user@domain.com:52.125.128.90): Error: /opt/dovecot/2.3.5/var/run/dovecot/imap-hibernate returned failure: Failed to parse client input: Invalid peer_dev_minor value: 18446744073709486335 Mar 8 15:30:57 servername dovecot: imap: Error: Here are my processes: # ps aux | grep imap dovenull 68264 0.0 0.0 12012 8292 - S 10:15 0:00.06 imap-login: (imap-login) dovenull 68274 0.0 0.0 12012 8272 - S 10:15 0:00.06 imap-login: (imap-login) dovenull 68275 0.0 0.0 12012 8356 - S 10:15 0:00.11 imap-login: (imap-login) dovenull 68276 0.0 0.0 12012 8468 - S 10:15 0:00.16 imap-login: (imap-login) dovenull 68277 0.0 0.0 12012 8328 - S 10:15 0:00.09 imap-login: (imap-login) dovenull 68278 0.0 0.0 12012 8368 - S 10:15 0:00.11 imap-login: (imap-login) dovenull 68279 0.0 0.0 12012 8272 - S 10:15 0:00.05 imap-login: (imap-login) dovenull 68280 0.0 0.0 12012 8288 - S 10:15 0:00.06 imap-login: (imap-login) dovenull 68281 0.0 0.0 12012 8316 - S 10:15 0:00.08 imap-login: (imap-login) dovenull 68282 0.0 0.0 12012 8312 - S 10:15 0:00.10 imap-login: (imap-login) dovenull 68283 0.0 0.0 12012 8356 - S 10:15 0:00.14 imap-login: (imap-login) dovenull 68286 0.0 0.0 12012 8312 - S 10:15 0:00.08 imap-login: (imap-login) dovenull 68287 0.0 0.0 14060 9024 - S 10:15 0:01.31 imap-login: [0 pre-login + 2 TLS proxies] (imap-login) dovenull 68288 0.0 0.0 12012 8392 - S 10:15 0:00.24 imap-login: [11.11.11.11 TLS proxy] (imap-login) dovenull 68289 0.0 0.0 14060 9116 - S 10:15 0:01.75 imap-login: [11.11.11.11 TLS proxy] (imap-login) dovenull 68290 0.0 0.0 14060 9208 - S 10:15 0:01.84 imap-login: [0 pre-login + 4 TLS proxies] (imap-login) nobody 68475 0.0 0.0 14404 6020 - I 10:19 0:00.08 /usr/local/sbin/in.imapproxyd -f /usr/local/etc/imapproxyd.conf vmail 76108 0.0 0.0 21612 17700 - S 14:30 0:00.12 imap: [user(a)domain.com 11.11.11.11 IDLE] (imap) vmail 76332 0.0 0.0 21536 17612 - I 14:41 0:00.16 imap: [user(a)domain.com 11.11.11.11 IDLE] (imap) vmail 77127 0.0 0.0 21516 17396 - S 15:17 0:00.07 imap: [user(a)domain.com 11.11.11.11] (imap) vmail 77170 0.0 0.0 21516 17380 - I 15:19 0:00.06 imap: [user(a)domain.com 11.11.11.11] (imap) vmail 77438 0.0 0.0 21516 17396 - S 15:31 0:00.05 imap: [user(a)domain.com 11.11.11.11] (imap) vmail 77536 0.0 0.0 21548 17400 - S 15:35 0:00.05 imap: [user(a)domain.com 11.11.11.11 IDLE] (imap) vmail 77539 0.0 0.0 21516 17256 - I 15:35 0:00.03 imap: [user(a)domain.com 11.11.11.11] (imap) vmail 77594 0.0 0.0 8892 4760 - S 15:38 0:00.01 imap-hibernate: [0 connections] (imap-hibernate) vmail 77620 0.0 0.0 21516 17256 - I 15:39 0:00.03 imap: [user(a)domain.com 11.11.11.11] (imap) My build options: Install prefix . : /opt/dovecot/2.3.5 File offsets ... : 64bit I/O polling .... : kqueue I/O notifys .... : kqueue SSL ............ : yes (OpenSSL) GSSAPI ......... : no passdbs ........ : static passwd passwd-file pam checkpassword sql CFLAGS ......... : -std=gnu99 -O2 -pipe -fno-strict-aliasing -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 : -shadow -bsdauth -sia -ldap -vpopmail userdbs ........ : static prefetch passwd passwd-file checkpassword sql : -ldap -vpopmail SQL drivers .... : mysql : -pgsql -sqlite -cassandra Full text search : squat lucene : -solr Configure command: ./configure '--prefix=/opt/dovecot/2.3.5' --without-docs '--without-shadow' '--without-docs' '--without-gssapi' '--without-vpopmail' '--without-ldap' --without-shadow --with-ssl=openssl --with-mysql --with-zlib --with-libwrap --with-lucene --with-stemmer --with-textcat --with-icu --without-cdb --without-lua --disable-silent-rules --build=amd64-portbld-freebsd11.2 'CC=cc' 'CFLAGS=-O2 -pipe -fno-strict-aliasing' 'LDFLAGS= -L/usr/local/lib' 'CPPFLAGS=-I/usr/local/include' 'CPP=cpp' 'CXX=c++' 'CXXFLAGS=-O2 -pipe -fno-strict-aliasing' My dovecot version: # dovecot --version 2.3.5 (513208660) My config: service imap-hibernate { chroot = client_limit = 0 drop_priv_before_exec = no executable = imap-hibernate extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 0 type = unix_listener imap-hibernate { group = $default_internal_group mode = 0660 user = vmail } user = vmail vsz_limit = 18446744073709551615 B }

4 4

question about %u and %h used in mail_location
by Joe Wong 12 Mar '19

12 Mar '19

Hello, I have defined the following: mail_location = maildir:~:INBOX=~/Maildir:LAYOUT=fs:INDEX=%u %u is retrieve via database in that my username contain ":", in which it create some confusion to dovecot: doveadm index -u user1:site@domain iNBOX doveadm(user1:site@domain): Error: remote(192.168.10.22:24245): Namespace '': Unknown setting: site@domain I cannot change the value in DB so is there a workaround to this problem? TIA. - Joe

2 1

Suggestions for dovecot-submission (XCLIENT NAME attribute)
by Marcelo Coelho 12 Mar '19

12 Mar '19

Hi, Currently, Dovecot Submission doesn't forward NAME attribute when XCLIENT is enable: Received: from server.example.org (localhost [1.2.3.4]) (Authenticated sender: test(a)example.org) by localhost (Postfix) with ESMTPA id AAAAAAAAAA for <user(a)domain.com>; Fri, 8 Mar 2019 12:28:02 Postfix adds a header with the sender IP address (1.2.3.4), but with localhost as hostname. It would be great if Dovecot Submission send NAME attribute, with the resolved hostname of the sender IP (ADDR attribute). Thank you! -- Marcelo Coelho

2 1

Sieve scripts not triggered on IMAP inbound messages using IMAPC
by Fred 12 Mar '19

12 Mar '19

Good morning. I am using Dovecot as an IMAP proxy -- using IMAPC -- and the system is working great. Thank you for contributing such great software to the community! I'm using Dovcot 2.3.5 and Pigeonhole 0.5.5. My server is located behind a content-filtering firewall that will mark incoming messages by adding "[SPAM]" to the subject line. I'm trying to use Sieve to identify those messages and move them into the Spam folder. I have a basic Sieve script that looks like this: require ["fileinto"]; if anyof (header :contains "Subject" "[SPAM]", header :contains "X-Spam-Flag" "Yes") { fileinto "Spam"; stop; } I can see in the logs that Sieve is loaded, and also the imapsieve_plugin Debug: sieve: Pigeonhole version 0.5.5 (2483b085) initializing Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.5 (2483b085) loaded Sieve detects outbound messages (from the log: Debug: imapsieve: mailbox INBOX.Sent: APPEND event) but nothing registers for inbound, and my spam_rule is never triggered. Any suggestions? Here is the output from "Dovecot -n": # 2.3.5 (513208660): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.5 (2483b085) # OS: Linux 3.10.0-957.5.1.el7.x86_64 x86_64 CentOS Linux release 7.6.1810 (Core) xfs # Hostname: <redacted> auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN auth_verbose_passwords = plain deliver_log_format = from=%{from}, envelope_sender=%{from_envelope}, subject=%{subject}, msgid=%m, size=%{size}, %$ dict { acl = pgsql:/etc/dovecot/dovecot-share-folder.conf quotadict = pgsql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 imapc_features = fetch-bodystructure fetch-headers imapc_host = <redacted> imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no last_valid_uid = 2000 listen = * [::] mail_debug = yes mail_gid = 2000 mail_home = /var/mail/imapc/home/%d/%n mail_location = imapc:/var/mail/imapc/%d/%n mail_plugins = mailbox_alias mail_log notify mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes list = yes location = prefix = separator = . type = private } passdb { args = host=<redacted> default_fields = userdb_imapc_user=%u userdb_imapc_password=#hidden_use-P_to_show# driver = imap } passdb { args = /etc/dovecot/dovecot-master-users driver = passwd-file master = yes } plugin { imapsieve_default = /var/vmail/sieve/global/spam_rule.sieve mail_log_events = delete undelete expunge mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from subject mailbox_alias_new = Sent Messages mailbox_alias_new2 = Sent Items mailbox_alias_old = Sent mailbox_alias_old2 = Sent sieve_global_dir = /var/vmail/sieve/global/ sieve_max_redirects = 30 sieve_plugins = sieve_imapsieve sieve_trace_debug = yes sieve_trace_dir = /var/log/dovecot sieve_trace_level = matching } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 port = 24 } process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } ssl = required ssl_cert = </etc/letsencrypt/live/mgrids.dynu.com/fullchain.pem ssl_cipher_list = ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+ 3DES:RSA+AESGCM:RSA+AES:RSA+3DES:!aNULL:!MD5 ssl_client_ca_file = /etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes syslog_facility = local5 userdb { driver = prefetch } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 mail_plugins = mailbox_alias mail_log notify imap_sieve } protocol sieve { info_log_path = /var/log/dovecot/sieve-info.log log_path = /var/log/dovecot/sieve-err.log managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_line_length = 65536 }

2 2

dovecot Connection closed IDLE running
by Adrian Minta 11 Mar '19

11 Mar '19

Hello, sometimes I get lines like this on mail log. Mar 11 07:57:14 mail2 dovecot: imap(john.one(a)domain.ro): Connection closed (IDLE running for 0.006 + waiting input for 1765.640 secs, 0.001 in locks, 2 B in + 10+0 B out, state=wait-input) in=323201 out=3177999 Mar 11 07:58:56 mail3 dovecot: imap(john.two(a)domain.ro): Connection closed (IDLE running for 0.005 + waiting input for 3535.348 secs, 0.001 in locks, 2 B in + 10+0 B out, state=wait-input) in=1627 out=14872 Mar 11 08:38:50 mail2 dovecot: imap(sam(a)domain.ro): Connection closed (IDLE running for 2.225 + waiting input for 267.413 secs, 0.005 in locks, 2 B in + 10+0 B out, state=wait-input) in=7212 out=2503 Mar 11 09:01:23 mail2 dovecot: imap(john.one(a)domain.ro): Connection closed (FETCH running for 8.784 + waiting input for 0.001 secs, 0.008 in locks, 24 B in + 6291+6291 B out, state=wait-input) in=196 out=43968 Mar 11 09:02:57 mail1 dovecot: imap(bush(a)domain.ro): Connection closed (IDLE running for 0.006 + waiting input for 1031.530 secs, 0.001 in locks, 2 B in + 10+0 B out, state=wait-input) in=9157 out=381003 Mar 11 09:33:31 mail2 dovecot: imap(john.one(a)domain.ro): Connection closed (IDLE running for 0.008 + waiting input for 1737.458 secs, 0.001 in locks, 2 B in + 41+0 B out, state=wait-input) in=7871 out=322122 Our dovecot version is 2.2.27 and the mail storage is maildir. What is the cause ? Could this negatively affects the users ? -- Best regards, Adrian Minta

1 0

Assistance with doveadm backup...
by SH Development 11 Mar '19

11 Mar '19

I am having trouble locating examples of how to use doveadm backup. All the examples I see are for sync. I simply want to create a backup to a network volume of the email server's vmail folders. The goal here is to have a reasonably current backup should the main drive on the email server go south. We currently authenticate our users from a mysql database. User’s mailboxes are stored as domainname/username/Maildir I assume what I will wind up on the network volume is a duplicate directory structure as the vmail folder on the email server? Can someone help get me started here? Jeff

7 13

readonly archive folders using squashfs
by Natu 11 Mar '19

11 Mar '19

I have a dovecot server running under CentOS using maildir format. Due to the issue with minimum blocksize for files I would like to offer some kind of readonly archive using something like the compressed squashfs where I would move messages to be archived to a maildir folder and then convert "cur" directory into a squashfs and mount it in place of the original directory so my biggest users could have readonly access to older messages without it using so much disk space. Has anyone tried anything like this before and is dovecot likely to complain about the readonly cur directory? If the complaints are minimal and didn't cause other problems it might be ok. Any better ideas to implement something like this? Thank You, Natu

2 2

Re: Auto MX Email Client configuration, the right way?
by Davide Marchi 10 Mar '19

10 Mar '19

> Now I've seen the new RFC 6186 specification > (https://tools.ietf.org/html/rfc6186) that describe a "DNS way" to > achieve the same goal. > > [..] > again: > [..] > When a user identifier is required, MUAs MUST first > use the full email address provided by the user, and if that > results > in an authentication failure, SHOULD fall back to using the "local- > part" extracted from the email address. This is in line with the > guidance outlined in Section 5. If both these user identifiers > result in authentication failure, the MUA SHOULD prompt the user > for > a valid identifier. > [..] > > here I have the biggest doubt, in fact Thunderbird often uses only the > username and not the whole email address, both for incoming and > outgoing > server... > Is any of you using this second way? And possibly, do you kniw if it > works with different clients (desktop and mobile)? I've made some tests and this solution seems very serviceable, for the only exception for the user name on Thunderbird. Unlike what is stated in this RFC, Thunderbird "takes" only the name and not the entire email address as the username. Anyone knows if is it possible to communicate the username type via RFC? Many thanks again! Davide

2 1

GSSAPI and usernames, not Kerberos ticket names
by Dmitry Donskih 09 Mar '19

09 Mar '19

Hi all, I've got a Dovecot v2.3.3 IMAP with GSSAPI auth set up. This server is in main domain, 'contoso.com'. I also have several subdomains. My problem is usernames with GSSAPI authentication: When I try to login as 'user' or as 'user(a)CONTOSO.COM' - everything works. But, 'user(a)contoso.com' auth fails. But when I try to login as subdomain user, 'user2' - it fails to login. 'user2(a)sub.contoso.com' fails also. However, 'user2(a)SUB.CONTOSO.COM' works ok. It looks like PAM uses domain part of login as Kerberos realm name, regardless of Kerberos domain-realm mapping. Also, if domain part is not specified, PAM (Kerberos?) fails to determine non-default realm. What am I missing? Is there a way to use traditional 'user@domain' login names with PAM/GSSAPI, instead of Kerberos ticket names? Or maybe to tell PAM module to convert domain part of username to uppercase before using? Thanks on any help or advice. ===== dovecot.conf: ===== auth_mechanisms = gssapi plain login external auth_gssapi_hostname = "$ALL" auth_krb5_keytab = /etc/krb5.keytab auth_default_realm = passdb { driver = pam args = cache_key=%d%r%n failure_show_msg=yes dovecot } userdb { driver = static args = uid=502 gid=502 home=/var/vmail/%L{auth_domain}/%L{auth_username} mail=maildir:/var/vmail/%L{auth_domain}/%L{auth_username}/Maildir allow_all_users=yes } ===== ===== pam.d/dovecot: ===== auth sufficient pam_krb5.so use_first_pass account [default=bad success=ok user_unknown=ignore] pam_krb5.so password sufficient pam_krb5.so use_authtok session optional pam_krb5.so ===== ===== krb5.conf: ===== [libdefaults] default_realm = CONTOSO.COM dns_lookup_realm = true dns_lookup_kdc = true [realms] CONTOSO.COM = { kdc = dc.contoso.com:88 admin_server = dc.contoso.com:749 } [domain_realm] contoso.com = CONTOSO.COM .contoso.com = CONTOSO.COM sub.contoso.com = CONTOSO.COM .sub.contoso.com = CONTOSO.COM SUB.CONTOSO.COM = CONTOSO.COM .SUB.CONTOSO.COM = CONTOSO.COM [appdefaults] pam = { ticket_lifetime = 36000 renew_lifetime = 36000 forwardable = true krb4_convert = false } ===== klist server ==== Default principal: imap/mail2.contoso.com(a)CONTOSO.COM ===== klist client ==== Default principal: user2(a)SUB.CONTOSO.COM ===== Logging in with user2(a)SUB.CONTOSO.COM - OK: ===== auth: Debug: client in: AUTH 1 GSSAPI service=imap secured=tls session=.... auth: Debug: gssapi(?,192.168.....,<MR1yvq6DftfAqAoP>): Using all keytab entries auth: Debug: client passdb out: CONT 1 auth: Debug: client in: CONT<hidden> auth: Debug: gssapi(user2(a)sub.contoso.com,192.168....,<MR1yvq6DftfAqAoP>): security context state completed. auth: Debug: client passdb out: CONT 1 YIGVB.... auth: Debug: client in: CONT<hidden> auth: Debug: gssapi(user2(a)sub.contoso.com,192.168.....,<MR1yvq6DftfAqAoP>): Negotiated security layer auth: Debug: client passdb out: CONT 1 BQQF/..... auth: Debug: client in: CONT<hidden> auth: Debug: pam(user2(a)sub.contoso.com,192.168.....,<MR1yvq6DftfAqAoP>): passdb doesn't support credential lookups auth: Debug: gssapi(user2(a)sub.contoso.com,192.168.....,<MR1yvq6DftfAqAoP>): skipping passdb: mechanism filtered auth: Debug: client passdb out: OK 1 user=user2(a)sub.contoso.com original_user=user2(a)SUB.CONTOSO.COM ===== Logging in with user2(a)sub.contoso.com - FAIL: ===== auth: Debug: client in: AUTH 1 GSSAPI service=imap secured=tls session=... auth: Debug: gssapi(?,192.168....,<Hgh4zq6DhNfAqAoP>): Using all keytab entries auth: Debug: client passdb out: CONT 1 auth: Debug: client in: CONT<hidden> auth: Debug: gssapi(user2(a)sub.contoso.com,192.168....,<Hgh4zq6DhNfAqAoP>): security context state completed. auth: Debug: client passdb out: CONT 1 YIGVB..... auth: Debug: client in: CONT<hidden> auth: Debug: gssapi(user2(a)sub.contoso.com,192.168....,<Hgh4zq6DhNfAqAoP>): Negotiated security layer auth: Debug: client passdb out: CONT 1 BQQF/..... auth: Debug: client in: CONT<hidden> auth: Debug: pam(user2(a)sub.contoso.com,192.168.....,<Hgh4zq6DhNfAqAoP>): passdb doesn't support credential lookups auth: Debug: gssapi(user2(a)sub.contoso.com,192.168.....,<Hgh4zq6DhNfAqAoP>): skipping passdb: mechanism filtered auth: Debug: client passdb out: FAIL 1 user=user2(a)sub.contoso.com original_user=user2(a)SUB.CONTOSO.COM

1 0

Auto MX Email Client configuration, the right way?
by Davide Marchi 09 Mar '19

09 Mar '19

Hi Friends! An opinion. I would like to facilitate the configuration of one's mail client (desktop or mobile) to my users server. Some time ago I asked the same question and you suggested me to use "Automx". So I started of good will and I looked for the Automx documentation. And here the problems started as I found several inconsistencies, even parameters (in official documentation) that produce Apache errors.. to complicate things, different path between deb packages and official version :-) Now I've seen the new RFC 6186 specification (https://tools.ietf.org/html/rfc6186) that describe a "DNS way" to achieve the same goal. [..] 4. Guidance for MUAs By using SRV records as above, MUAs need initially only to prompt the user for their email address [RFC5322]. The "local-part" and "domain" portions are then extracted from the email address by the MUA. The MUA uses the "domain" portion as the service domain to perform SRV lookups for the services it wants to configure. If the SRV lookup is successful, the target FQDN and port for the service can be determined and used to complete MUA configuration. If an SRV record is not found, the MUA will need to prompt the user to enter the FQDN and port information directly, or use some other heuristic. In the case of multiple SRV records returned for a particular service, the MUA MUST use the priority and weight fields in the record to determine which one to use (as per [RFC2782]). [..] again: [..] When a user identifier is required, MUAs MUST first use the full email address provided by the user, and if that results in an authentication failure, SHOULD fall back to using the "local- part" extracted from the email address. This is in line with the guidance outlined in Section 5. If both these user identifiers result in authentication failure, the MUA SHOULD prompt the user for a valid identifier. [..] here I have the biggest doubt, in fact Thunderbird often uses only the username and not the whole email address, both for incoming and outgoing server... Is any of you using this second way? And possibly, do you kniw if it works with different clients (desktop and mobile)? Many many thanks! Davide

3 2

Dovecot v2.3.5 released
by Aki Tuomi 08 Mar '19

08 Mar '19

Hi! We are happy to release dovecot v2.3.5. Please find sources at https://dovecot.org/releases/2.3/dovecot-2.3.5.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.5.tar.gz.sig You can find precompiled binaries at https://repo.dovecot.org/ NEWS: + Lua push notification driver: mail keywords and flags are provided in MessageNew and MessageAppend events. + submission: Implement support for plugins. + auth: When auth_policy_log_only=yes, only log what the policy server response would do without actually doing it. + auth: Always log policy server decisions with auth_verbose=yes - v2.3.[34]: doveadm log errors: Output was missing user/session - lda: Debug log lines could have shown slightly corrupted - login proxy: Login processes may have crashed in various ways when login_proxy_max_disconnect_delay was set. - imap: Fix crash with Maildir+zlib if client disconnects during APPEND - lmtp proxy: Fix potential assert-crash - lmtp/submission: Fix crash when SMTP client transaction times out - submission: Split large XCLIENT commands to 512 bytes per command, so Postfix accepts them. - submission: Fix crash when client sends invalid BURL command - submission: relay backend: VRFY command: Avoid forwarding 500 and 502 replies back to client. - lib-http: Fix potential assert-crash when DNS lookup fails - lib-fts: Fix search query generation when one language ignores a token (e.g. via stopwords). --- Aki Tuomi Open-Xchange Oy

3 5

Re: Removing a mailbox from a dovecot cluster
by Francis 08 Mar '19

08 Mar '19

Le mar. 26 févr. 2019 à 22:58, David Myers <david.myers.24j74(a)gmail.com> a écrit : > Hello Francis, > > I wonder if this is due to how a cluster is configured to function > internally. > > Tell us more about the cluster, is it one of those ‘fancy pants’ high > availability, auto backup heart beat things, or is it more a traditional > multi server (master slave style) setup. > > Either way you may need to disconnect the servers from one another and > delete the offending files / directories either via dove or or via the os > (although reading your original email it sounds like you are already > attempting this). > > If you have a fancy cluster this may actually be more difficult than it > sounds and have interesting (unwanted) side effects, also the underlying > database (if you are storing emails that way) may have a method to remove > data > > I assume you are keeping back up copies of all those emails somewhere, > just in case you need them in the future. > > See this wiki article to better understand what I mean by the ‘fancy > pants’ clusters : > https://en.m.wikipedia.org/wiki/High-availability_cluster > They sound very cool, but I suspect are overkill for a mail server, unless > your database is already inside one then it would make sense I guess. > > Hello, I just use the cluster/replication functionality integrated into dovecot, nothing more. There is no database involved. I use LDAP for the authentication. The mails are stored locally on each server and replicated with the replication feature of dovecot. I followed this wiki article: https://wiki.dovecot.org/Replication Thanks! -- Francis

2 8

imap segfault in libc.so with CLucene FTS backend enabled
by Alexander Miroshnichenko 08 Mar '19

08 Mar '19

Steps to reproduce: - Enable CLucene FTS in Dovecot; - Open mailbox with MUA; - Search for message with any text; - IMAP session crash. OS: Gentoo Base System release 2.6 Version: FTS: dev-cpp/clucene-2.3.3.4-r6 IMAP: net-mail/dovecot-2.3.2.1 LIBC: sys-libs/musl-1.1.21 Dovecot FTS config: plugin { fts = lucene fts_lucene = whitespace_chars=@. normalize no_snowball fts_autoindex=yes fts_autoindex_max_recent_msgs=80 fts_index_timeout=90 } dmesg: [260150.192294] imap[18221]: segfault at 6578772cca98 ip 000063e7f1b10397 sp 00007945d5822970 error 6 in libc.so[63e7f1ae8000+a4000] [260150.192316] Code: 0f 84 44 02 00 00 48 39 ca 0f 84 62 02 00 00 48 8b 43 08 48 89 4a 10 48 89 51 18 48 89 c2 48 83 e0 fe 48 83 ca 01 48 89 53 08 <48> 83 0c 03 01 41 8b 07 48 8d 6b 10 85 c0 0f 84 68 ff ff ff 31 c0 bt full: Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 unbin (i=0, c=0x1908553de10) at src/malloc/malloc.c:195 195 src/malloc/malloc.c: No such file or directory. (gdb) bt full #0 unbin (i=0, c=0x1908553de10) at src/malloc/malloc.c:195 No locals. #1 malloc (n=<optimized out>, n@entry=4) at src/malloc/malloc.c:320 mask = <optimized out> c = 0x1908553de10 i = 0 j = 0 #2 0x000063e7f1b4984f in wcsdup (s=0x63e7ed7d0c58 L"") at src/string/wcsdup.c:7 l = 0 d = <optimized out> #3 0x000063e7eda98308 in lucene::index::Term::Term (this=0x1908553df80) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/Term.cpp:26 No locals. #4 0x000063e7edad5f25 in lucene::index::SegmentTermEnum::readTerm(lucene::index::Term*) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/SegmentTermEnum.cpp:351 start = 1 length = 4 totalLength = 5 field = <optimized out> fieldname = 0x1908553d180 L"\142\157\144\171" #5 0x000063e7edad5f7c in lucene::index::SegmentTermEnum::next (this=0x19085524460) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/SegmentTermEnum.cpp:180 tmp = <optimized out> this = 0x19085524460 tmp = <optimized out> tmp = <optimized out> #6 0x000063e7edad5be9 in lucene::index::SegmentTermEnum::scanTo (this=this@entry=0x19085524460, term=term@entry=0x7945d5822dc0) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/SegmentTermEnum.cpp:218 No locals. #7 0x000063e7edad959c in lucene::index::TermInfosReader::scanEnum (this=<optimized out>, term=term@entry=0x7945d5822dc0) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/TermInfosReader.cpp:422 enumerator = 0x19085524460 #8 0x000063e7edad96a4 in lucene::index::TermInfosReader::get (this=<optimized out>, term=term@entry=0x7945d5822dc0) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/TermInfosReader.cpp:246 enumerator = <optimized out> #9 0x000063e7edab9071 in lucene::index::SegmentReader::docFreq (this=0x19085500ae0, t=0x7945d5822dc0) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/index/SegmentReader.cpp:518 ti = <optimized out> #10 0x000063e7edae2620 in lucene::search::Similarity::idf (this=0x19085526e60, term=0x7945d5822dc0, searcher=0x190855007a0) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/Similarity.cpp:184 No locals. #11 0x000063e7edaeda51 in lucene::search::TermWeight::TermWeight(lucene::search::Searcher*, lucene::search::TermQuery*, lucene::index::Term*) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/TermQuery.cpp:117 No locals. #12 0x000063e7edaeda99 in lucene::search::TermQuery::_createWeight(lucene::search::Searcher*) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/TermQuery.cpp:240 No locals. #13 0x000063e7edafa2dc in lucene::search::BooleanWeight::BooleanWeight(lucene::search::Searcher*, lucene::util::CLVector<lucene::search::BooleanClause*, lucene::util::Deletor::Object<lucene::search::BooleanClause> >*, lucene::search::BooleanQuery*) () at /usr/lib/gcc/x86_64-gentoo-linux-musl/8.2.0/include/g++-v8/bits/stl_vector.h:930 i = 1 i = <optimized out> #14 0x000063e7edafa351 in lucene::search::BooleanQuery::_createWeight(lucene::search::Searcher*) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/BooleanQuery.cpp:66 No locals. #15 0x000063e7edaef926 in lucene::search::Query::weight (this=this@entry=0x7945d5822da0, searcher=searcher@entry=0x190855007a0) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/SearchHeader.cpp:121 query = <optimized out> weight = <optimized out> sum = <optimized out> norm = <optimized out> #16 0x000063e7edaf0cd7 in lucene::search::IndexSearcher::_search(lucene::search::Query*, lucene::search::Filter*, int) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/IndexSearcher.cpp:222 weight = <optimized out> scorer = <optimized out> bits = <optimized out> hq = <optimized out> totalHits = <optimized out> hitCol = {<lucene::search::HitCollector> = {<lucene::debug::LuceneVoidBase> = {_vptr.LuceneVoidBase = 0x2}, <No data fields>}, minScore = -1.75304399e+30, bits = 0x30, hq = 0xffffffffffffffff, nDocs = 40, totalHits = 0x63e7eda6f2cc <lucene::util::Compare::WChar::operator()(wchar_t const*, wchar_t const*) const+20>} scoreDocsLength = <optimized out> scoreDocs = <optimized out> totalHitsInt = <optimized out> wq = <optimized out> #17 0x000063e7edaf4344 in lucene::search::Hits::getMoreDocs(unsigned long) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/Hits.cpp:120 _min = <optimized out> n = <optimized out> topDocs = 0x0 scoreDocs = <optimized out> scoreDocsLength = <optimized out> scoreNorm = <optimized out> ---Type <return> to continue, or q <return> to quit--- #18 0x000063e7edaf443e in lucene::search::Hits::Hits (this=0x1908553a1a0, s=0x190855007a0, q=<optimized out>, f=<optimized out>, _sort=<optimized out>) at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/Hits.cpp:60 No locals. #19 0x000063e7edaef7fc in lucene::search::Searcher::search(lucene::search::Query*, lucene::search::Filter*) () at /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r6/work/clucene-core-2.3.3.4/src/core/CLucene/search/SearchHeader.cpp:188 No locals. #20 0x000063e7edd7edf0 in lucene_index_search(lucene_index*, array__lucene_query&, fts_result*, array__seq_range*) () at lucene-wrapper.cc:1361 hits = <optimized out> last_uid = <optimized out> score = <optimized out> ret = 0 query = {<lucene::search::Query> = {<lucene::util::NamedObject> = {_vptr.NamedObject = 0x63e7edd6e970 <vtable for lucene::search::BooleanQuery+16>}, boost = 1}, clauses = 0x190855007e0, static maxClauseCount = 1024, static allowDocsOutOfOrder = false, disableCoord = false, minNrShouldMatch = 0} mailbox_term = {<lucene::debug::LuceneBase> = {_vptr.LuceneBase = 0x63e7edd68e80 <vtable for lucene::index::Term+16>, __cl_refcount = 2}, cachedHashCode = 0, _field = 0x190854bd7c0 L"\142\157\170", _text = 0x1908553a0a0 L"\142\146\064\141\067\066\061\060\146\062\070\143\063\142\065\143\066\145\060\062\060\060\060\060\065\143\146\143\061\141\061\064", textLenBuf = 32, textLen = 32, internF = true} mailbox_query = {<lucene::search::Query> = {<lucene::util::NamedObject> = {_vptr.NamedObject = 0x63e7edd6d918 <vtable for lucene::search::TermQuery+16>}, boost = 1}, term = 0x7945d5822dc0} #21 0x000063e7edd7ff54 in lucene_index_lookup (index=0x190854ee8e0, args=args@entry=0x1908553b468, flags=flags@entry=(unknown: 0), result=result@entry=0x7945d5823000) at lucene-wrapper.cc:1421 uids_arr = <optimized out> arg = 0x0 def_queries = {arr = {buffer = 0x190854b2438, element_size = 16}, v = 0x190854b2438, v_modifiable = 0x190854b2438} have_definites = true maybe_queries = {arr = {buffer = 0xc, element_size = 18446744073709551612}, v = 0xc, v_modifiable = 0xc} have_maybies = <optimized out> #22 0x000063e7edd7c0d4 in fts_backend_lucene_lookup () at fts-backend-lucene.c:489 _data_stack_cur_id = 5 backend = 0x190854ee780 ret = <optimized out> #23 0x000063e7f09a85dd in fts_backend_lookup (backend=0x190854ee780, box=0x190854fc148, args=args@entry=0x1908553b468, flags=flags@entry=(unknown: 0), result=result@entry=0x7945d5823000) at fts-api.c:353 No locals. #24 0x000063e7f09acd92 in fts_search_lookup_level_single (and_args=<optimized out>, args=0x1908553b468, fctx=0x190854f5520) at fts-search.c:50 flags = (unknown: 0) level = <optimized out> result = {box = 0x0, definite_uids = {arr = {buffer = 0x19085528378, element_size = 8}, v = 0x19085528378, v_modifiable = 0x19085528378}, maybe_uids = {arr = {buffer = 0x190855284b8, element_size = 8}, v = 0x190855284b8, v_modifiable = 0x190855284b8}, scores = {arr = {buffer = 0x190855285f8, element_size = 8}, v = 0x190855285f8, v_modifiable = 0x190855285f8}, scores_sorted = false} flags = <optimized out> level = <optimized out> result = <optimized out> #25 fts_search_lookup_level () at fts-search.c:210 _data_stack_cur_id = 4 ret = <optimized out> #26 0x000063e7f09ad32c in fts_search_lookup_level () at fts-search.c:220 ret = 0 #27 0x000063e7f09ad48e in fts_search_lookup () at fts-search.c:360 last_uid = 622 seq1 = 544 seq2 = 807 __func__ = "fts_search_lookup" #28 0x000063e7f09af460 in fts_mailbox_search_init () at fts-storage.c:250 ft = 0x19085511e60 fbox = <optimized out> flist = <optimized out> ctx = 0x190854f5240 fctx = 0x190854f5520 #29 0x000001905d983992 in imap_search_start () at imap-search.c:586 cmd = 0x190854e9628 __func__ = "imap_search_start" #30 0x000001905d9753e5 in cmd_search (cmd=<optimized out>) at cmd-search.c:48 ctx = 0x190854e9830 sargs = 0x1908553b308 args = 0x19085527620 charset = 0x190854f3860 "utf-8" ret = 1 #31 0x000001905d97cad4 in command_exec () at imap-commands.c:201 hook = 0x1905db9cda0 finished = <optimized out> __func__ = "command_exec" #32 0x000001905d97b262 in client_command_input () at imap-client.c:1152 client = 0x190854e89c8 command = <optimized out> __func__ = "client_command_input" #33 0x000001905d97b305 in client_command_input () at imap-client.c:1215 client = 0x190854e89c8 command = <optimized out> __func__ = "client_command_input" ---Type <return> to continue, or q <return> to quit--- #34 0x000001905d97b6cd in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x190854e89c8) at imap-client.c:1257 No locals. #35 client_handle_input () at imap-client.c:1271 _data_stack_cur_id = 3 ret = <optimized out> remove_io = false handled_commands = false ret = <optimized out> remove_io = <optimized out> __func__ = "client_handle_input" client = 0x190854e89c8 handled_commands = <optimized out> _data_stack_cur_id = <optimized out> ret = <optimized out> remove_io = <optimized out> __func__ = "client_handle_input" _data_stack_cur_id = <optimized out> #36 0x000001905d97bb9e in client_input () at imap-client.c:1317 cmd = 0x190854cfba0 output = 0x190854e9440 bytes = 80 __func__ = "client_input" #37 0x000063e7f14f8c58 in io_loop_call_io () at ioloop.c:674 ioloop = 0x63e7f1ae7f20 t_id = 2 __func__ = "io_loop_call_io" #38 0x000063e7f14fa116 in io_loop_handler_run_internal () at ioloop-epoll.c:222 ctx = 0x1905db9cfc0 events = <optimized out> event = 0x190854bc360 list = 0x190854bd1a0 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999332} events_count = <optimized out> msecs = <optimized out> ret = <optimized out> i = 0 j = <optimized out> call = <optimized out> __func__ = "io_loop_handler_run_internal" #39 0x000063e7f14f8cfa in io_loop_handler_run () at ioloop.c:726 __func__ = "io_loop_handler_run" #40 0x000063e7f14f8e68 in io_loop_run () at ioloop.c:699 __func__ = "io_loop_run" #41 0x000063e7f1480dbb in master_service_run (service=0x63e7f1ae7de0, callback=callback@entry=0x1905d987e60 <client_connected>) at master-service.c:767 No locals. #42 0x000001905d96dfc4 in main () at main.c:521 set_roots = {0x1905db9aa20 <smtp_submit_setting_parser_info>, 0x1905db9a740 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x190854b2060 "\003", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x1905d9886b0 <login_client_connected>, failure_callback = 0x1905d987f28 <login_client_failed>, request_auth_token = true} service_flags = <optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_NO_NAMESPACES username = 0x0 auth_socket_path = <optimized out> c = <optimized out> error = 0x4cd0 <error: Cannot access memory at address 0x4cd0> #43 0x000063e7f1b0506b in libc_start_main_stage2 (main=0x1905d96dc80 <main>, argc=1, argv=0x7945d5823688) at src/env/__libc_start_main.c:94 envp = 0x7945d5823698 #44 0x000001905d96e168 in _start_c () at imap-client.c:1433 No symbol table info available. #45 0x0000000000000000 in ?? () No symbol table info available. (gdb) -- Alexander Miroshnichenko

1 0

Re: rsync /old/server new/server ?
by Aki Tuomi 08 Mar '19

08 Mar '19

On 8.3.2019 14.07, Voytek Eymont wrote: > On Fri, March 8, 2019 10:45 pm, Aki Tuomi via dovecot wrote: >> On 8.3.2019 13.44, Voytek Eymont via dovecot wrote: >> >>> I have Centos 7 with dovecot/postfix/mysql Maildir >>> >>> >>> I want to bring in a new server, new server will have same hostname as >>> current, but, different IP >>> >>> I was intending to >>> rsync -avzhe ssh vmail@oldserver:/var/vmail/vmail1 /var/vmail/vmail1 >>> >>> and, then, re run as necessary when/if mail still arrives on old server >>> >>> >>> is that "a good plan" ...? >>> >>> TIA, V >>> >>> >> Yeah, it's ok as long as you haven't switched to new server. > Aki, thanks > > I'm not certain I understand your comment properly > > I currently have server 'geko' > > intention was to change A record to assign geko to new IP/server, assign > new hostname to oldserver A record > > I guess I;ll still get some emails delivered to oldserver with new > hostname/old ip for 24 hours or so after aA record change ? > > so, I was going to re run rsync 2 or 3 times over the first 24 hours or so ? > > are you saying NOT to rsync once A record changed ? > > sorry for being slow > > You could configure old server's MTA to deliver mail to new server's MTA instead? After there has been activity on the new server, running rsync from old server can cause problems. Aki

2 1

Re: rsync /old/server new/server ?
by Voytek Eymont 08 Mar '19

08 Mar '19

On Fri, March 8, 2019 10:45 pm, Aki Tuomi via dovecot wrote: > > On 8.3.2019 13.44, Voytek Eymont via dovecot wrote: > >> I have Centos 7 with dovecot/postfix/mysql Maildir >> >> >> I want to bring in a new server, new server will have same hostname as >> current, but, different IP >> >> I was intending to >> rsync -avzhe ssh vmail@oldserver:/var/vmail/vmail1 /var/vmail/vmail1 >> >> and, then, re run as necessary when/if mail still arrives on old server >> >> >> is that "a good plan" ...? >> >> TIA, V >> >> > Yeah, it's ok as long as you haven't switched to new server. Aki, thanks I'm not certain I understand your comment properly I currently have server 'geko' intention was to change A record to assign geko to new IP/server, assign new hostname to oldserver A record I guess I;ll still get some emails delivered to oldserver with new hostname/old ip for 24 hours or so after aA record change ? so, I was going to re run rsync 2 or 3 times over the first 24 hours or so ? are you saying NOT to rsync once A record changed ? sorry for being slow (sorry for sending not to list...)

1 0

how to enable PowerDNS/Weakforced with Fedora and sendmail
by Robert Kudyba 07 Mar '19

07 Mar '19

We have dovecot-1:2.3.3-1.fc29.x86_64 running on Fedora 29. I'd like to test wforce, from https://github.com/PowerDNS/weakforced. I see instructions at the Authentication policy support page, https://wiki2.dovecot.org/Authentication/Policy I see the Required Minimum Configuration: auth_policy_server_url = http://example.com:4001/ auth_policy_hash_nonce = localized_random_string But when I search for these directives, they're not found: grep auth_policy_server_url /etc/dovecot/conf.d/* Are these to be added to the /etc/dovecot/conf.d/10-auth.conf file? Does anyone know if a good tutorial?

2 6

Strange behaviour with BLF-CRYPT and SHA*-CRYPT pasword schemas
by Kristijan Savic - ratiokontakt GmbH 07 Mar '19

07 Mar '19

Greetings, this is less of a bug report or a help request, but we would like to know if someone can explain the following: Environment: Centos 7 with Dovecot 2.3.4-2 default_pass_scheme = BLF-CRYPT password hash in database : BLF-CRYPT login = works default_pass_scheme = SHA512 or SHA256-CRYPT password hash in database : BLF-CRYPT login = also works default_pass_scheme = BLF-CRYPT password hash in database : SHA512-CRYPT login = does not work Can someone explain these discrepancies? -- Kind regards, Kristijan Savic -------------------------------------------------------- ratiokontakt GmbH Biegenhofstr. 13 96103 Hallstadt Telefon: +49 (0) 951 9 35 35 - 0 Telefax: +49 (0) 951 9 35 35 - 902 Internet: www.ratiokontakt.de Geschäftsführer: Dr. Nils Kaufmann, Stefan Kraft Amtsgericht Bamberg - HRB 3757 -------------------------------------------------------- ratiokontakt ist zertifiziert nach DIN ISO/IEC 27001

2 4

Sieve fileinto copies messages instead of moving them
by Michael Goth 07 Mar '19

07 Mar '19

Hi, we're running Doveocot 2.3.4.1 with Pigeonhole, from repo.webflow.org. As far as I understand the RFC for 'fileinto', the following Sieve script should move a message either into the folder "SPAM" or "MaybeSPAM": require ["fileinto"]; # rule:[SPAM] if header :contains "subject" "SPAMSPAM" { fileinto "SPAM"; } # rule:[SPAMSPAM] if header :contains "subject" "SPAM" { fileinto "MaybeSPAM"; } But when I receive a message with subject "SPAMSPAM", the message turns up in "SPAM" and "MaybeSPAM". Is this expected behaviour? Thanks! Michael -- Michael Goth .webflow GmbH Geschäftsführer: Andreas Schrei Wasserburger Straße 4 D - 83352 Altenmarkt a. d. Alz Amtsgericht Traunstein HRB 18537 E-Mail: mg(a)webflow.de Tel: +49 (0) 8621 - 99989 - 26 Fax: +49 (0) 8621 - 99989 - 28 Web: www.webflow.de

3 2

Director 2.3.5: openssl_iostream_handle_error
by Tom Sommer 07 Mar '19

07 Mar '19

Thanks for 2.3.5 - it fixed a lot of stuff :) I see this Panic in my Director logs now, randomly and rarely: Mar 07 11:01:29 pop3-login: Panic: file iostream-openssl.c: line 586 (openssl_iostream_handle_error): assertion failed: (errno != 0) Mar 07 11:01:29 auth: Warning: auth client 13625 disconnected with 19 pending requests: EOF Mar 07 11:01:29 pop3-login: Fatal: master: service(pop3-login): child 13625 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set /proc/sys/fs/suid_dumpable to 2) Hoping the above is enough to debug -- Tom

2 1

director in rings
by Maciej Milaszewski IQ PL 07 Mar '19

07 Mar '19

Hi Maby stupid question :) It possible to have 3 directors (frontend) but without rings ? All directors connect to this same dovecot (backend) - all backad have this same login_trusted_networks -- Maciej Miłaszewski IQ PL Sp. z o.o. Starszy Administrator Systemowy

2 2

doveadm expunge recursive?
by Maria Arrea 07 Mar '19

07 Mar '19

2 1

Probleme with replication and shared mailbox
by Laurent BRAULT (OSILOG) 06 Mar '19

06 Mar '19

Hi Folks ! I finaly resolve my problem ! 😊 First of all I had to modify namespaces : ####################################################### namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / subscriptions = yes type = private } namespace partage { list = children location = maildir:/mnt/mail/vmail/%%d/%%n:INDEXPVT=/mnt/mail/vmail/%d/%n/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } ####################################################### Also change the « replication_dsync_parameters » in aim to syncronize only the Private namespace : ==> replication_dsync_parameters = -d -n inbox -l 30 -U I change the sharing command from « acl set » to « acl add » AND THE MOST IMPORTANT ==> RUN THE COMMAND ON THE 2 SERVER because of active/active réplication… ==> doveadm acl add -u user2(a)exemple.fr INBOX user=user1(a)exemple.fr admin create delete expunge insert lookup post read write write-deleted write-seen Hope this may help if someone is faced to the same problem Best regards Laurent

1 0

“Message cannot be displayed because of the way it is formatted” iOS
by James Brown 06 Mar '19

06 Mar '19

Have updated our mail server and are now running Dovecot 2.3.4. Things are mostly working OK, but occasionally I have users on latest iOS getting this message: “this message cannot be displayed because of the way it is formatted. Ask the sender to send it again using a different format or email program. multipart/alternative” The email seems to open OK on the macOS version of Mail.app. Also getting “Loading...” displayed in body section of the app with content never displayed. Most emails are fine, but just get this strange ones occasionally. Our previous mail server was much older, with older version of Dovecot, etc. This server never used to have these issues. Just wondering if anyone has any ideas or suggestions? Can’t see anything in the logs. Thanks, James.

2 1

getrandom() before forking daemon is blocking init system
by Axel Burri 05 Mar '19

05 Mar '19

Hello When booting from a slow machine, I can observe dovecot blocking the whole boot process. I traced it down to the getrandom() system call in lib/randgen.c, which blocks until the random number generator is initialized (dmesg "random: crng init done"). This can take up to three minutes (!) on my machine, as there is not much entropy available (no hardware RNG, network VPN is also waiting for random). Unfortunately dovecot calls getrandom() before forking a daemon, which as a consequence blocks the whole init process (OpenRC on Gentoo Linux). I believe this behavior has changed in kernel 4.14: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?h=… Quoting getrandom(2): "If the urandom source has not yet been initialized, then getrandom() will block, unless GRND_NONBLOCK is specified in flags." Dovecot: 2.3.4.1 (f79e8e7e4) Linux: 4.19.26-gentoo #2 SMP Thu Feb 28 20:30:23 CET 2019 x86_64 AMD G-T40E Processor AuthenticAMD GNU/Linux Regards, Axel

3 3

Pigeonhole v0.5.5 released
by Aki Tuomi 05 Mar '19

05 Mar '19

Hi! We are happy to release pigeonhole v0.5.5 for dovecot v2.3.5. Please find sources at https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.5.ta… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.5.ta… (Please note that the signing key has been changed for 0.5.5, see https://pigeonhole.dovecot.org/download.html for details.) You can find precompiled binaries at https://repo.dovecot.org/ NEWS: + IMAPSieve: Add new plugin/imapsieve_expunge_discarded setting which causes messages discarded by an IMAPSieve script to be expunged immediately, rather than only being marked as "\Deleted" (which is still the default behavior). - IMAPSieve: Fix panic crash occurring when a COPY command copies messages from a virtual mailbox where the source messages originate from more than a single real mailbox. - imap4flags extension: Fix deleting all keywords. When the action resulted in all keywords being removed, no changes were actually applied. - variables extension: Fix truncation of UTF-8 variable content. The maximum size of Sieve variables was enforced by truncating the variable string content bluntly at the limit, but this does not consider UTF-8 code point boundaries. This resulted in broken UTF-8 strings. This problem also surfaced for variable modifiers, such as the ":encodeurl" modifier provided by the Sieve "enotify" extension. In that case, the resulting URI escaping could also be truncated inappropriately. - IMAPSieve, IMAP FILTER=SIEVE: Fix replacing a modified message. Sieve scripts running in IMAPSIEVE or IMAP FILTER=SIEVE context that modify the message, stored the message a second time, rather than replacing the originally stored unmodified message. - Fix segmentation fault occurring when both the sieve_extprograms plugin (for the Sieve interpreter) and the imap_filter_sieve plugin (for IMAP) are loaded at the same time. A symbol was defined by both plugins, causing a clash when both were loaded. --- Aki Tuomi Open-Xchange Oy

1 0

quota_max_mail_size no tips
by 默认 05 Mar '19

05 Mar '19

When the link dovecot imports the message, after the rejection, there is no prompt in the log. I want to get the prompt log of the import failure, what should I do? > [root@test5 dovecot]# dovecot --version > 2.2.36 (1f10bfa63) > plugin { > quota_max_mail_size = 100M > }

2 1

two lots of dovecot files
by mick crane 04 Mar '19

04 Mar '19

hello is debian buster I have 2 sets of dovecot files, I don't know why. one in /etc/dovecot and one in /usr/share/dovecot they are not links they are actual files. if I rename /etc/dovecot and restart service then I get connection refused when use roundcube. Some time ago my roundcube installation stopped working properly for the web configuration options. Should I have these 2 directories or just want the one ? If want only one it's likely then that I configure wrong file with same name when I thought my ssl certificate has expired. Is OK to delete /etc/dovecot and check configuration in /usr/share/dovecot ? -- Key ID C7D6E24C

2 2

Pigeonhome Sieve: check existence of a folder?
by AvV 03 Mar '19

03 Mar '19

Dear All, Thanks ofr the great job so far. I have crawled the doc & web, and did not find oh to check for the presence of a folder ina a mailbox? I know about "fileinto :create" of course, but the purpose is slightly different: I want to automate the move into a folder based on some rules but *only if* an associated folder is present (which name is based on the rule), otherwise I will do a form of catch-all. Example: - INBOX +- abc +- def - Rule detects "aaa" in someheader field: folder "aaa" not present" -> continue; - Rule detect "def" in some header field: "def exists" -> fileinto "def" ; stop; Any help appreciated. Cheers, A/

2 2

migrating/cloning 2.2 > 2.3?
by Voytek Eymont 03 Mar '19

03 Mar '19

I have 2.2 installation on Centos 7, and, I'm trying to setup a new server, and, 'clone' existing setup: Dovecot/Postfix/Mysql on new Centos 7 installed from RPM 2.3.4.1 (3c0b8769e) I then copied/overwrote from old to new /etc/dovecot/*.conf (but not conf.d files), created self certs in place of old server certs and, started Dovecot is that totally dumb, and, how should I do this, or ? upon starting dovecot and, trying to access mailbox from K9 client I see in the log [1]: what's my best way forward with this ? I also see this in postfix log: Mar 3 03:15:02 geko postfix/pipe[28482]: 302494188091: to=<postmaster(a)sbt.net.au>, orig_to=<root>, relay=dovecot, delay=0.22, delays=0/0.01/0/0.21, dsn=2.0.0, status=sent (delivered via dovecot service (lda(postmaster(a)sbt.net.au,)Error: net_connect_unix(/var/run/dovecot/stats-writer) failed: Permission)) [1] Mar 03 11:29:42 master: Info: Dovecot v2.3.4.1 (3c0b8769e) starting up for pop3, imap, sieve (core dumps disabled) Mar 03 11:30:09 config: Warning: please set ssl_dh=</etc/dovecot/dh.pem Mar 03 11:30:09 config: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem Mar 03 11:30:12 auth-worker(32307): Warning: sqlpool(mysql): Query failed, retrying: Unknown column 'mailbox.enableimaptls' in 'where clause' Mar 03 11:30:12 auth-worker(32307): Error: sql(voytek(a)sbt.net.au,110.175.246.167,<jZs3viWDz7xur/an>): User query failed: Unknown column 'mailbox.enableimaptls' in 'where clause' Mar 03 11:30:12 imap: Error: Internal auth failure (auth connected 0 msecs ago, handshake 0 msecs ago, request took 0 msecs, client-pid=32301 client-id=1) Mar 03 11:30:12 imap-login: Info: Internal login failure (pid=32301 id=1): user=<voytek(a)sbt.net.au>, method=PLAIN, rip=110.175.246.167, lip=103.106.168.106, mpid=32310, TLS, session=<jZs3viWDz7xur/an> Mar 03 11:30:12 auth-worker(32307): Warning: sqlpool(mysql): Query failed, retrying: Unknown column 'mailbox.enableimaptls' in 'where clause' Mar 03 11:30:12 auth-worker(32307): Error: sql(voytek(a)sbt.net.au,110.175.246.167,<xBk6viWDzrRur/an>): User query failed: Unknown column 'mailbox.enableimaptls' in 'where clause' Mar 03 11:30:12 imap: Error: Internal auth failure (auth connected 0 msecs ago, handshake 0 msecs ago, request took 0 msecs, client-pid=32304 client-id=1) Mar 03 11:30:12 imap-login: Info: Internal login failure (pid=32304 id=1): user=<voytek(a)sbt.net.au>, method=PLAIN, rip=110.175.246.167, lip=103.106.168.106, mpid=32311, TLS, session=<xBk6viWDzrRur/an> -- Voytek

2 2

Unexpected behavior with sieve_vacation_to_header_ignore_envelope = yes
by Matthias Petermann 03 Mar '19

03 Mar '19

Hello, we face an issue with the vacation extension of pigeonhole. Our upstream mail server (from which we pull our E-Mails with POP3) uses SPF and performs a SRS re-write of the Return Path. Once the mail is processed via our local postfix, it is delivered via dovecot deliver (using the lda). When the recipient has a vacation rule enabled in sieve, the out-of-office note cannot be sent, as pigeonhole tries to use the Return-Path (which is not accepted as sender by the mail server). We are using the following dovecot / pigeonhole versions: dovecot-2.3.2.1 dovecot-pigeonhole-0.5.2 As of my understanding, the problem was addressed in pigeonhole version v0.4.21 by introducing the sieve_vacation_to_header_ignore_envelope setting. Anyway - even when this is set to "yes" pigeonhole still uses the Return-Path instead of the "From:" header which I had expected: Feb 27 13:22:26 mail dovecot: lda(customer)<48383><3o+yOQGBdlz/vAAAZU03Dg>: Error: sieve: msgid=<e081d2ba-21d5-c32b-3750-69fe0c8a76d2(a)petermann-it.de>: failed to send vacation response to SRS0=gwGXg6ad=RC=petermann-it.de=matthias(a)example.com: <Sendmail program returned error> (temporary error) Are my expectations wrong or did I miss some precondition? Best regards, Matthias 1) This is the email which I use to test (I replaced the actual domain with example.com) ------>8------------------------------------------------------------------------------ Return-Path: <SRS0=gwGXg6ad=RC=petermann-it.de=matthias(a)example.com> Delivered-To: customer[[(a)example.com]] To: Customer <customer(a)example.com> From: Matthias Petermann <matthias(a)petermann-it.de> Subject: Test Message-ID: <e081d2ba-21d5-c32b-3750-69fe0c8a76d2(a)petermann-it.de> Date: Wed, 27 Feb 2019 05:21:45 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.1 Test message ------8<------------------------------------------------------------------------------ 2) The related excerpt of the configuration: ------>8------------------------------------------------------------------------------ mail /usr/local/etc/dovecot/conf.d >doveconf | grep -A 10 -B 10 to_header_ignore_envelope result_failure = continue result_internalfail = continue result_success = return-ok skip = never username_filter = } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes sieve = file:/srv/vmail/%u/sieve;active=/srv/vmail/%u/active.sieve sieve_vacation_to_header_ignore_envelope = yes } pop3_client_workarounds = pop3_delete_type = default pop3_deleted_flag = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no ------8<------------------------------------------------------------------------------ -- Matthias Petermann <matthias(a)petermann-it.de>

2 2

same account imap and pop3
by James 02 Mar '19

02 Mar '19

I have an imap and pop3 for the same account. When I delete a message from imap and then fetch the mail from the pop3 account, it retrieves the deleted message. I am using thunderbird for the MTA. Does anyone know why it happens? It could be a timing issue.

3 2

dovecot[1511]: auth-worker: Fatal: master: service(auth-worker): child 17009 killed with signal 11
by Patrik 28 Feb '19

28 Feb '19

This bug report is similar to this issue: https://www.dovecot.org/list/dovecot/2017-May/108116.html <https://www.dovecot.org/list/dovecot/2017-May/108116.html> I know it is not enough info, but every kill follows with this info: Feb 28 16:57:50 server dovecot[1511]: auth-worker: Fatal: master: service(auth-worker): child 17009 killed with signal 11 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) Feb 28 16:57:50 server kernel: traps: auth[17009] general protection ip:7fd5d3ae9a64 sp:7fff0a781dc0 error:0 in libmariadb.so.3[7fd5d3add000+26000] It looks like the error is related to the libmariadb.so, of course I am using integration with auth sql. The configuration is like this: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-2-amd64 x86_64 Debian buster/sid ext4 # Hostname: p3x-dc.example.com auth_mechanisms = plain login mail_location = maildir:/var/mail/vhosts/%d/%n mail_plugins = quota mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_grace = 10%% quota_max_mail_size = 100M quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M sieve = /etc/dovecot/sieve.conf } protocols = imap lmtp pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } ssl = required ssl_ca = </etc/ssl/example.com/ca.cer ssl_cert = </etc/ssl/example.com/fullchain.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota } *Patrik* WWW <https://patrikx3.com> | GitHub <https://github.com/patrikx3/> | NPM <https://www.npmjs.com/~patrikx3> | Corifeus <https://corifeus.com> | +36 20 342 8046

2 2

Dovecot Logging and Shell Script Hang
by Asai 28 Feb '19

28 Feb '19

Greetings, We have a PHP based shell script that runs a doveadm backup routine. This script was running just fine, and then we turned on more logging for Dovecot (enabled the mail_log plugin). For some reason, once this was done, the shell script would run for a few minutes and then hang, as it added more log messages to the dsync STDOUT. Once the mail_log plugin was disabled, it ran without hanging. Is there any way to run doveadm and temporarily suspend the mail_log plugin? Or is there a better way to do this? Thanks for the insights. Asai

3 3

Dovecot 2.3.3 Mailbox does not exist
by Kunal A. 27 Feb '19

27 Feb '19

HI, I would deeply aprechiate if someone here could help me address a problem with ACL. I would personally refrain from e-mailing ever so often as I understand other users have more important issues to discuss about. Anyways I hope someone here could help. When I run ;- doveadm acl get -A Public/Archive I keep getting an error that says Mailbox does not exist . See erorr message below : - Error: Can't open mailbox Public/Archive: Mailbox doesn't exist: Public/Archive In the fastmail folder there is a folder called Archive, why isn't it being read? The folder is drwxr-xr-x. with vmail as owner. Deeply appreciate if someone could help with this. Many thanks dovecot -n output :- # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty Nine) # Hostname: machine auth_mechanisms = plain login mail_location = maildir:~/Maildir mail_plugins = acl mail_privileged_group = mail mbox_write_locks = fcntl namespace { list = children location = maildir:/run/media/computer/Storage/Email/fastmail/ prefix = Public/ separator = / subscriptions = yes type = public } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile } postmaster_address = postmaster at example.com protocols = imap pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol imap { mail_plugins = acl imap_acl }

2 2

Re: performance issue with UID SEARCH
by Aki Tuomi 27 Feb '19

27 Feb '19

Without FTS, dovecot needs to open *each* and *every* email when doing text searches, which is understandably rather slow process. Aki On 27.2.2019 10.43, Marc Roos wrote: > > > I am not sure if this any help. From what I understand of maildir it has > lots of separate files, thus uid/gid lookups. Try running something like > nscd, that will cache these lookups? > > > > > -----Original Message----- > From: Aki Tuomi via dovecot [mailto:dovecot@dovecot.org] > Sent: 27 February 2019 06:24 > To: Ben Burke; Dovecot Mailing List > Subject: Re: performance issue with UID SEARCH > > > On 27 February 2019 03:27 Ben Burke via dovecot < > dovecot(a)dovecot.org> wrote: > > > Hi, > > I'm running dovecot 2.2.x and I'm having an issue where I see many > dovecot processes use all the available IO on a server. According > to > iotop the worst offenders seem to be in this state (NOTE: I swapped > in > phony username & IP info): > > dovecot/imap [someusername 123.456.789.012 UID SEARCH] > > The server in question is running with Maildirs on top of an XFS > filesystem. Is there anything I can do to optimize "UID SEARCH" or > find > out why it's being a problem? I've read > https://wiki2.dovecot.org/PerformanceTuning and the linked pages. > > By "being a problem" I mean iostat -xmt 1 /dev/diskdevice shows > 100% > utilization for long periods and in some cases io service times are > > taking many seconds... which causes thunderbird to timeout when > doing > things like appending messages to user "Sent" mailboxes. > > Any ideas? > > Thanks, > Ben Burke > > > Are you using FTS? If not, you should. See > https://wiki.dovecot.org/Plugins/FTS > --- > Aki Tuomi > >

1 0

CASifying dovecot and webmail
by Juan Carlos Sánchez 27 Feb '19

27 Feb '19

Hello: I'm trying to authenticate webmail (roundcube) and dovecot with Apereo CAS. I don't find any good guide and everything I have found is some years old. Has any of you done a recent integration with CAS and can share the details ? Best regards -- ------------------------------------------------------ Juan Carlos Sanchez Hernandez Servicio de Infraestructura e Innovación Universidad Politecnica de Madrid - www.upm.es Rectorado Avda. Ramiro de Maeztu 7 28040 Madrid ------------------------------------------------------

3 2

Re: Linking mailboxes
by Aki Tuomi 27 Feb '19

27 Feb '19

drwx-----x kunal kunal Storage I'm guessing this point is being more restrictive. Can you try changing this into 0755? Also suddenly you are no longer using vmail but random user IDs. This only works with vmail. Aki > On 25 February 2019 19:56 Kunal A. <kunal.oa(a)gmail.com> wrote: > > > Hi, > Yes. Output ;- > > dr-xr-xr-x root root / > drwxr-xr-x root root run > drwxr-xr-x root root media > drwxr-x--x root root computer > drwx-----x kunal kunal Storage > drwx------ vmail vmail Email > drwx------ vmail vmail tmp > > > > On Mon, Feb 25, 2019 at 12:53 PM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > Can you run > > > > namei -vl /run/media/computer/Storage/Email/tmp > > > > the + at the end does not mean that, it means there is an extended POSIX ACL. > > > > Aki > > > > > On 25 February 2019 19:50 Kunal A. <kunal.oa(a)gmail.com> wrote: > > > > > > > > > Hey Aki, > > > Sorry for the trouble but I am still unable to get it working. The file permissions for upper files are now drwxr-xr-x. but I think they need to be drwxr-x--x+ ? > > > Any idea how to change it to that? > > > > > > > > > Error log is below:- > > > > > > doveadm(lightdm): Error: Can't open mailbox Storage/Email: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=976(lightdm) egid=976(lightdm) missing +x perm: /run/media/computer/Storage/Email, dir owned by 5000:5000 mode=0700) > > > doveadm(setroubleshoot): Error: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=975(setroubleshoot) egid=975(setroubleshoot) missing +x perm: /run/media/computer/Storage/Email, dir owned by 5000:5000 mode=0700) > > > doveadm(setroubleshoot): Error: Can't open mailbox Storage/Email: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=975(setroubleshoot) egid=975(setroubleshoot) missing +x perm: /run/media/computer/Storage/Email, dir owned by 5000:5000 mode=0700) > > > doveadm(dovenull): Error: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=974(dovenull) egid=973(dovenull) missing +x perm: /run/media/computer/Storage/Email, dir owned by 5000:5000 mode=0700) > > > ~ > > > > > > > > > > > > > > > On Mon, Feb 25, 2019 at 11:58 AM Kunal A. <kunal.oa(a)gmail.com> wrote: > > > > Dear Aki, > > > > Many thanks again. Thanks for explaining this. > > > > Very grateful for your assistance. > > > > Thanks a bunch ! > > > > Kunal > > > > > > > > > > > > > > > > On Mon, Feb 25, 2019 at 11:56 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > > At minimum directories > > > > > > > > > > /run/media/computer/Storage/ > > > > > > > > > > need to have o+x, so you can do > > > > > > > > > > chmod o+x /run /run/media /run/media/computer /run/media/computer/Storage > > > > > > > > > > and > > > > > > > > > > chown -R vmail:vmail /run/media/computer/Storage/Email > > > > > > > > > > Aki > > > > > > > > > > > On 25 February 2019 18:47 Kunal A. via dovecot <dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > > > > Dear Aki, > > > > > > I have given permission to the folders Storage/Email to vmail. > > > > > > But the upper hierarchy is not under vmail . > > > > > > > > > > > > Full directory = /run/media/computer/Storage/Email > > > > > > > > > > > > /run/media/computer = not vmail > > > > > > Storage/Email = vmail > > > > > > > > > > > > How do I get this corrected ? It seems like vmail needs access through all through run/media/computer . > > > > > > > > > > > > Please excuse my ignorance as I am not very familiar with filesystem permissions. :-/ > > > > > > > > > > > > Sincere apologies for the trouble. > > > > > > > > > > > > Thanks > > > > > > Kunal A. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Mon, Feb 25, 2019 at 11:36 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > > > > I would only run it for the mail folders to be safe. > > > > > > > > > > > > > > Aki > > > > > > > > > > > > > > > On 25 February 2019 18:34 Kunal A. via dovecot <dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > > > > > > > > > > Dear Aki, > > > > > > > > Many thanks for your feedback. Its what I figured I should do but I was not sure how safe it was. > > > > > > > > > > > > > > > > Would it make sense to execute the following to /run/media/computer so that the user/group is vmail? > > > > > > > > sudo chown -R vmail:vmail to the /run folder ? > > > > > > > > > > > > > > > > Also if this practice is safe to perform? > > > > > > > > > > > > > > > > Thanks > > > > > > > > Kunal A > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Mon, Feb 25, 2019 at 11:20 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > > > > > > > > > > > > > > > > On 25 February 2019 18:19 Aki Tuomi via dovecot <dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 25 February 2019 17:56 Kunal A. via dovecot <dovecot(a)dovecot.org> wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hey Guys! > > > > > > > > > > > Many thanks for your feedback. I have kind of gotten it to work but I just struggling to get the permissions of the folder correct. Highly appreciate if someone could help me set the correct permission settings for it . Terribly sorry for my ignorance. > > > > > > > > > > > > > > > > > > > > > > My error msg is listed below : - > > > > > > > > > > > > > > > > > > > > > > doveadm(vmail): Error: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +x perm: /run/media/computer, dir owned by 0:0 mode=0750) > > > > > > > > > > > doveadm(vmail): Error: Can't open mailbox Storage/Email: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +x perm: /run/media/computer, dir owned by 0:0 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > You need to give write permissions to vmail on /run/media/computer/Storage/Email > > > > > > > > > > > > > > > > > > > > You can > > > > > > > > > > - change owner to vmail > > > > > > > > > > - change group to vmail and add rwx for group > > > > > > > > > > - use posix ACLs > > > > > > > > > > - change mode to 0777 (unsafe) > > > > > > > > > > > > > > > > > > > > Aki > > > > > > > > > > > > > > > > > > And the same applies for all files & directories under /run/media/computer/Storage/Email > > > > > > > > > > > > > > > > > > Aki > > > > > > > > > > > > > > > > > > > > > > >

3 2

performance issue with UID SEARCH
by Ben Burke 27 Feb '19

27 Feb '19

Hi, I'm running dovecot 2.2.x and I'm having an issue where I see many dovecot processes use all the available IO on a server. According to iotop the worst offenders seem to be in this state (NOTE: I swapped in phony username & IP info): dovecot/imap [someusername 123.456.789.012 UID SEARCH] The server in question is running with Maildirs on top of an XFS filesystem. Is there anything I can do to optimize "UID SEARCH" or find out why it's being a problem? I've read https://wiki2.dovecot.org/PerformanceTuning and the linked pages. By "being a problem" I mean iostat -xmt 1 /dev/diskdevice shows 100% utilization for long periods and in some cases io service times are taking many seconds... which causes thunderbird to timeout when doing things like appending messages to user "Sent" mailboxes. Any ideas? Thanks, Ben Burke

2 1

new Centos server install yum dependancy error
by Voytek Eymont 26 Feb '19

26 Feb '19

I'm installing a new Centos 7 server, following repo.dovecot.org/ page, but, get this: (I've opted to install all BUT pgsql (use mysql), not sure I really need all other packages..?) should I just go for "dovecot dovecot-mysql dovecot-pigeonhole" ?? tried # yum install dovecot dovecot-debuginfo dovecot-devel dovecot-imaptest dovecot-imaptest-debuginfo dovecot-lua dovecot-mysql dovecot-pigeonhole dovecot-pigeonhole-debuginfo dovecot-pigeonhole-devel ... --> Finished Dependency Resolution Error: Package: 2:dovecot-lua-2.3.4.1-1.x86_64 (dovecot-2.3-latest) Requires: dovecot = 2:2.3.4.1-1 Available: 1:dovecot-2.2.36-3.el7.i686 (base) dovecot = 1:2.2.36-3.el7 Error: Package: 2:dovecot-pigeonhole-devel-2.3.4.1-1.x86_64 (dovecot-2.3-latest) Requires: dovecot-pigeonhole = 2:2.3.4.1-1 Installing: 1:dovecot-pigeonhole-2.2.36-3.el7.x86_64 (base) dovecot-pigeonhole = 1:2.2.36-3.el7 Error: Package: 2:dovecot-imaptest-2.3.4.1-1.x86_64 (dovecot-2.3-latest) Requires: dovecot = 2:2.3.4.1-1 Available: 1:dovecot-2.2.36-3.el7.i686 (base) dovecot = 1:2.2.36-3.el7 You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest -- Voytek

4 12

Removing a mailbox from a dovecot cluster
by Francis 26 Feb '19

26 Feb '19

Hello, How should I remove a mailbox from a dovecot cluster? I have two dovecot in a cluster. I tried to remove one user's mailbox with theses commands I found with a little google search: doveadm flags add -u user(a)domain.tld "\\Deleted" ALL doveadm expunge -u user(a)domain.tld mailbox "*" DELETED doveadm purge -u user(a)domain.tld rm -fr /var/vmail/domains/domain.tld/user If I do theses commands in a script (so one command after one, very quick), the data just keep coming back from the other server in the cluster (I suppose this is what's happening). If I do theses commands manually, so more slowly, the mailbox is created again but empty this time. If I connect from an IMAP client, I see an empty mailbox. Same thing if I connect an IMAP client to the second server from the cluster. But I still see the data in the storage (mdbox) of the second server (the "m.#" files are still there an they waste space on disks). I tried to do a "doveadm purge" on the second server, but it did nothing more, the data is still keep on the disks. I'm running dovecot 2.2.33.2 on ubuntu 18.04 on both servers. Thanks! -- Francis

1 1

Virus scan + removal on a mdbox mail storage
by Christoph Haas 26 Feb '19

26 Feb '19

Hi, I need advice on how virus scan and removal can be done on a _mdbox_ mail storage? On a maildir storage the virus scanner (e.g. clamav etc.) can detect and remove a email that is infected, since every email and attachment are stored in separate files. But in mdbox the emails and attachments are compressed together in one ore more mdbox-files ... I am anxious to convert my mail storage for virus scanning into maildir format, since I don't know if a virus or crypto trojan con be activated with this converting action =:-o Cheers Christoph. -- Christoph Haas

3 6

Linking mailboxes
by Kunal A. 25 Feb '19

25 Feb '19

Hi, I am new to Dovecot and I am trying to link an email account folder to another Maildir(its a backup of the older email). I want the email account to be able to access the older emails. I am assuming this is done by creating a symlink? Currently reading instructions on this page:- https://wiki.dovecot.org/SharedMailboxes/Symlinks At the moment I have the folder:- /var/mail/vhosts/example.com/email1/Maildir/.INBOX.newfolder Inside the folder:- drwx------. 2 vmail vmail 4096 Feb 23 13:39 cur -rw-------. 1 vmail vmail 232 Feb 23 13:43 dovecot.index.log -rw-------. 1 vmail vmail 51 Feb 23 13:43 dovecot-uidlist -rw-------. 1 vmail vmail 0 Feb 23 13:39 maildirfolder drwx------. 2 vmail vmail 4096 Feb 23 13:39 new lrwxrwxrwx. 1 root root 45 Feb 23 13:46 Other -> /run/media/computer/Storage/Email/mail/Other drwx------. 2 vmail vmail 4096 Feb 23 13:39 tmp lrwxrwxrwx. 1 root root 5 Feb 23 13:46 Users -> Users I am not able to access the folders in the Other folder structure(inside other there are other email inboxes ie(email1@example.com,email2@example.com,etc.). I want to get access to all the email subfolders. Could someone here advise how to do this or point me to some tutorials for this. Sincere apologies for this and many thanks in advance for helping... Dovecot -n output :- # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty Nine) # Hostname: computer auth_mechanisms = plain login mail_location = maildir:~/Maildir mail_privileged_group = mail mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = postmaster at example.com protocols = imap pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static }

3 12

Corrupted transaction log and redownloading
by azurit＠pobox.sk 25 Feb '19

25 Feb '19

Hi, today we had to hard-reboot one of our dovecot proxy backends and after boot up, lot's of accounts were showing this error and appeard empty: Error: Corrupted transaction log file ... After deleting the indexes (not uid file, problem wasn't in deleting indexes, i'm doing this often), e-mails showed up ok but e-mail clinets started to download them again. Why this happened and how to prevent it (other than 'not hard-rebooting')? I know that reboot could cause corruption of uid files in some cases but this time it looks like this was caused by corrupted indexes - how index corruption can cause redownloading and why? Thanks for any info. azur

2 1

Probleme with replication and shared mailbox
by Laurent BRAULT (OSILOG) 25 Feb '19

25 Feb '19

Dear Dovecot Users/Admins/Mailing-List First of all I would give a big thanks for your great work ! I may need your help to find out what’s going on with my replication and shared mailbox problem. I setup a full active/active servers with : * Postfix * Dovecot * MariaDB (automaticaly balanced/failover between the 2 host within DRBD and Heartbeat) * SpamAssassin * Clamav * Sieve * Webmail * IMAP Over SSL and SMTP Over TLS * Fail2ban ################################################################################################## <dovecot –version> ################################################################################################## 2.2.27 (c0f36b0) ==> DEBIAN 9 Stretch (no back ports) ################################################################################################## Everythink works fine until I activate a share on a mailbox. I run the following command to share the full mailbox « websentinel » to « lbrault » (because of « acl_defaults_from_inbox = yes » set in conf) : ==> doveadm acl set -u websentinel(a)example.fr INBOX user=lbrault(a)example.fr admin create delete expunge insert lookup post read write write-deleted write-seen Just after activation of share and connect through webmail client (Horde in this case but tried Roundcube also) I get this kind of error messages on logs : ################################################################################################## Feb 25 15:59:50 mx01 dovecot: imap(lbrault(a)example.fr): Error: /mnt/mail/vmail/example.fr/lbrault/shared/websentinel(a)example.fr/.INBOX/dovecot.index.pvt reset, view is now inconsistent Feb 25 15:59:50 mx01 dovecot: imap(lbrault(a)example.fr): Error: /mnt/mail/vmail/example.fr/lbrault/shared/websentinel(a)example.fr/.INBOX/dovecot.index.pvt view is inconsistent Feb 25 15:59:50 mx01 dovecot: imap(lbrault(a)example.fr): Error: /mnt/mail/vmail/example.fr/lbrault/shared/websentinel(a)example.fr/.INBOX/dovecot.index.pvt view is inconsistent Feb 25 15:59:50 mx01 dovecot: imap(lbrault(a)example.fr): BUG: Unknown internal error in=293 out=119712 ################################################################################################## In parallele to this error some new folders are created on the mailboxes root with name containing « nonexistent mailbox… » : ################################################################################################## 16:00:37 root@mx01 /mnt/mail/vmail # lla total 48 drwxr-xr-x 12 vmail vmail 4096 févr. 25 16:00 . drwxr-xr-x 3 root root 4096 févr. 11 12:13 .. drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=47376e22c8876e5cff5b000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=48376e22c8876e5cff5b000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=49376e22c8876e5cff5b000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=5c72c71b3f896e5c615c000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=809fff0046896e5c665c000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=a1895d0c36866e5c865b000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=c14aaa38d1846e5c285b000036d82855) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=ed909808b1846e5c523b01006b8a5dcb) drwx------ 2 vmail vmail 4096 févr. 25 16:00 (nonexistent mailbox with GUID=fa9d41114b896e5c6b5c000036d82855) drwx------ 4 vmail vmail 4096 févr. 21 11:57 example.fr ################################################################################################## When I look at the GUID it seems this GUID are linked to the folder into the shared mailbox (websentinel) I tried to change dsync params with the following command into 10-master.conf to exclude the shared folder from replication but it seems having no effect with the TCP replication : ==> replication_dsync_parameters = -d -N -l 30 -U -x shared Here is my dovecot -n report : ################################################################################################## <dovecot -n> : ################################################################################################## # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-8-amd64 x86_64 Debian 9.7 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes doveadm_password = # hidden, use -P to show it doveadm_port = 12345 mail_attribute_dict = file:/mnt/mail/vmail/%d/%n/dovecot-attributes mail_debug = yes mail_location = maildir:/mnt/mail/vmail/%d/%n mail_plugins = " quota notify replication acl" mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader vnd.dovecot.pipe vnd.dovecot.filter vnd.dovecot.execute namespace { list = children location = maildir:/mnt/mail/vmail/%%d/%%n:INDEXPVT=/mnt/mail/vmail/%d/%n/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db mail_replica = tcp:mx02.example.fr quota = maildir:User quota quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_status_overquota = 552 5.2.2 Mailbox is full sieve = /mnt/mail/vmail/%d/%n/.dovecot.sieve sieve_after = /etc/dovecot/sieve/spamfilter.sieve sieve_dir = /mnt/mail/vmail/%d/%n/sieve sieve_execute_bin_dir = /usr/lib/dovecot/sieve-execute sieve_extensions = +editheader +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute sieve_filter_bin_dir = /usr/lib/dovecot/sieve-filter sieve_pipe_bin_dir = /usr/lib/dovecot/sieve-pipe sieve_plugins = sieve_extprograms } protocols = " imap lmtp sieve" replication_dsync_parameters = -d -N -l 30 -U -x shared replication_max_conns = 50 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service doveadm { inet_listener { port = 12345 } user = vmail } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/letsencrypt/live/mx01.example.fr/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol lmtp { mail_plugins = " quota notify replication acl sieve" postmaster_address = lbrault(a)example.fr } protocol lda { mail_plugins = " quota notify replication acl sieve" } protocol imap { imap_metadata = yes mail_plugins = " quota notify replication acl imap_quota imap_acl" } ################################################################################################## ################################################################################################## <dovecot-sql.conf.ext> : ################################################################################################## driver = mysql connect = host=192.168.1.512 dbname=postfix user=mailman password=MySuperPassword default_pass_scheme = SHA512-CRYPT password_query = \ SELECT email as username, pwd AS password, \ concat('*:bytes=', quota_limit_bytes) AS userdb_quota_rule \ FROM addresses WHERE email = '%u' AND active = 1 user_query = \ SELECT 5000 AS uid, 5000 as gid, email, \ '/mnt/mail/vmail/%d/%n' AS home, \ concat('*:bytes=', quota_limit_bytes) AS quota_rule \ FROM addresses WHERE email = '%u' AND active = 1 iterate_query = SELECT email AS user FROM addresses WHERE active = 1 ################################################################################################## I would share a special thanks for Community help 😊 If more conf files needed (ie postfix main.cf) please ask me for them. Best regards Laurent

1 0

password protected ssl key seems unsupported after update to 2.3.4.1
by admin＠f-hamelin.fr 25 Feb '19

25 Feb '19

Hi, On a debian server after an update to dovecot to 2.3.4.1 imaps mail client stop working. I’ve applied necessary migration for ssl_dh (cf https://wiki.dovecot.org/Upgrading/2.3 <https://wiki.dovecot.org/Upgrading/2.3> ) but that was not enough. The workaround I’ve setup was to remove password protection from the ssl_key file. All tests with ssl_key_password parameter failled (direct password, <path-file-with-password) searching I’ve found a message reporting a problem with that parameter and Stephan said it was tracked internally as DOP-851 Hope this will help. Regards, Franck debian updade from dovecot-core:amd64 (1:2.2.34-2~bpo9+1, 1:2.3.4.1-1~bpo9+1) # dovecot -n # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.19.0-0.bpo.2-amd64 x86_64 Debian 9.8 xfs …/… The error message in the log prior to the workaround was : "dovecot: imap-login: Error: Failed to initialize SSL server context: Couldn't parse private SSL key: error:06065064:digital envelope routines:EVP_DecryptFinal_ex:bad decrypt, error:23077074:PKCS12 routines:PKCS12_pbe_crypt:pkcs12 cipherfinal error, error:2306A075:PKCS12 routines:PKCS12_item_decrypt_d2i:pkcs12 pbe crypt error, error:0907B00D:PEM routines:PEM_read_bio_PrivateKey:ASN1 lib: user=<>, rip=192.168.0.254, lip=192.168.0.51, session=<thtmP6iCc9jAqAD+> »

2 2

permission denied errors with INDEX=MEMORY and trees plugin
by John McKay 24 Feb '19

24 Feb '19

I am using the trees[1] plugin to encrypt the mail on my disk. Because I don't want it to store any metadata in plaintext, I've also set INDEX=MEMORY in my mail_location configuration. However, whenever I get new mail I get errors like the following showing up in the journal: lmtp(john(a)octet.space)<21780><QDkrBqTXclwUVQAAQHGRUQ>: Error: Mailbox INBOX: Saving mail: read(/var/vmail/octet.space/john/Maildir/tmp/1551030180.M508113P21780.toaster.octet.space) failed: Permission denied (read reason=header Subject (Cache file is unusable)) It's like it's trying to read the message after it's been delivered, but is not able to because it's been encrypted. I seem to be able to get email just fine despite the error message. This happens both if I deliver mail using dovecot-lda or lmtp. Is there any way to fix this or at the very least suppress the error message? I have included my dovecot configuration below. [1] https://0xacab.org/riseuplabs/trees [root@toaster ~]# dovecot --version 2.3.4.1 (f79e8e7e4) [root@toaster ~]# dovecot -n # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 (60b0f48d) # OS: Linux 4.20.8-arch1-1-ARCH x86_64 ext4 # Hostname: toaster.octet.space base_dir = /run/dovecot/ hostname = toaster.octet.space mail_gid = vmail mail_home = /var/vmail/%d/%n mail_location = maildir:/var/vmail/%d/%n/Maildir:UTF-8:INDEX=MEMORY mail_plugins = " quota trash zlib trees notify replication" mail_privileged_group = vmail mail_uid = vmail mailbox_list_index_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus imapflags notify imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = maildir:/var/vmail/%d/%n/Maildir:UTF-8:INDEX=MEMORY mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = create autoexpunge = 30 days special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/var/lib/dovecot/imapsieve/before/report-spam.sieve imapsieve_mailbox1_causes = COPY FLAG imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/lib/dovecot/imapsieve/before/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * quota = maildir:User quota quota_max_mail_size = 100M quota_rule = *:storage=15G quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/before/ sieve_extensions = +spamtest +spamtestplus +notify +imapflags sieve_filter_socket_dir = sieve-pipe sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.filter sieve_pipe_socket_dir = sieve-pipe sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 4M sieve_spamtest_max_header = X-Spam-Score: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spam-Score: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score trash = /etc/dovecot/dovecot-trash.conf.ext zlib_save = xz zlib_save_level = 6 } protocols = imap lmtp service auth-worker { group = smtpd user = $default_internal_user } service auth { unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dovecot-lda { executable = script /usr/lib/dovecot/dovecot-lda.sh unix_listener sieve-pipe/dovecot-lda { mode = 0600 user = vmail } user = vmail } service filter_rspamc { executable = script /usr/lib/dovecot/filter_rspamc.sh group = vmail unix_listener sieve-pipe/filter_rspamc { mode = 0600 user = vmail } user = vmail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service learn_ham { executable = script /usr/lib/dovecot/learn_ham.sh group = vmail unix_listener sieve-pipe/learn_ham { mode = 0600 user = vmail } user = vmail } service learn_spam { executable = script /usr/lib/dovecot/learn_spam.sh group = vmail unix_listener sieve-pipe/learn_spam { mode = 0600 user = vmail } user = vmail } service lmtp { unix_listener lmtp { group = vmail mode = 0660 user = vmail } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-warning { executable = script /usr/lib/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } ssl = required ssl_cert = </etc/acme/fullchain.cer ssl_cipher_list = TLS_CHACHA20_POLY1305_SHA256:TLS_AES_128_GCM_SHA256:TLS_AES_256_GCM_SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256 ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " quota trash zlib trees notify replication sieve zlib" } protocol imap { mail_plugins = " quota trash zlib trees notify replication imap_quota imap_sieve imap_zlib zlib" } protocol lmtp { mail_plugins = " quota trash zlib trees notify replication sieve zlib" }

1 0

Problem with shared Mailbox
by Asterisk 24 Feb '19

24 Feb '19

Hi I am using dovecot 2.3.4.1, is working in thunderbird, but it does not work in outlook 2016 or mail. a list "" "*" * LIST (\HasNoChildren \UnMarked \Drafts) "/" Drafts * LIST (\HasNoChildren \UnMarked \Sent) "/" Sent * LIST (\HasNoChildren \Junk) "/" Junk * LIST (\HasNoChildren \Trash) "/" Trash * LIST (\Noselect \HasChildren) "/" partage * LIST (\HasNoChildren) "/" partage/sysadmin * LIST (\HasNoChildren) "/" INBOX here the configuration auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1:6 hostname = imap_idle_notify_interval = 29 mins lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_gid = docker mail_location = maildir:/var/mail/%n mail_plugins = acl quota mail_privileged_group = docker mail_uid = docker managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify vnd.dovecot.pipe vnd.dovecot.filter namespace { disabled = no hidden = no list = children location = maildir:/var/mail/%%n:INDEX=/var/mail/%%n:INDEXPVT=/var/mail/%%n prefix = partage/%%n/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/mail/%d/shared-mailboxes.db quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags +vnd.dovecot.pipe +vnd.dovecot.filter sieve_filter_bin_dir = /usr/lib/dovecot/sieve-filter sieve_pipe_bin_dir = /usr/lib/dovecot/sieve-pipe sieve_plugins = sieve_extprograms } postmaster_address = postmaster@ protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = docker mode = 0666 user = docker } unix_listener auth-master { group = docker mode = 0600 user = docker } unix_listener auth-userdb { group = docker mode = 0666 user = docker } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { group = postfix mode = 0660 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/letsencrypt/live//fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl quota sieve } protocol lda { mail_plugins = acl quota sieve } protocol imap { mail_plugins = acl quota imap_acl imap_quota }

2 1

Dmarc
by Latin Bishop 23 Feb '19

23 Feb '19

Trying to implement dmarc and looking at configuration file Wondering if one should change reject failures to true and how can I get this before I start rejecting emails AuthservID mail.example.com PidFile /var/run/opendmarc.pid #Debian default RejectFailures false Syslog true TrustedAuthservIDs mail.example.com,mail2.example.com UMask 0002 UserID opendmarc:opendmarc IgnoreHosts /etc/opendmarc/ignore.hosts HistoryFile /var/run/opendmarc/opendmarc.dat #for testing: SoftwareHeader true Sent from my iPad

1 0

LMTP and public mailboxes?
by Eric Abrahamsen 22 Feb '19

22 Feb '19

Hi, I've been using postfix and dovecot for a few years, and have been doing public mailboxes with dovecot-lda, using a postfix transport that looks like (line wrapped for the mailer): my-public-transport unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/bin/spamc -u <me> -e \ /usr/lib/dovecot/dovecot-lda -f ${sender} -d <me> -m public/${user} So messages first passed to spamassassin, using my own personal config for bayes rules, then to dovecot-lda, using my user for auth, and finally delivering to a public/* mailbox, with acl rules for access. I'm moving spamassassin to a mimedefang milter, so that's out of the equation; and LDA to LMTP, so the postfix config simply becomes: virtual_transport = lmtp:unix:private/dovecot-lmtp That's much nicer, but I'm not sure how to handle the public mailbox using LMTP. How are people doing this? While Googling I saw a recommendation to create a virtual user for the public mailboxes, and then presumably Postfix would map "info(a)mydomain.com" to "publicuser+info(a)mydomain.com" and I would go from there. But that seems a little weird: I don't want anyone to be able to log in as publicuser, nor to send mail as that user (Postfix uses Dovecot for auth). Yet I don't seem to be able to pass other arguments to lmtp, that might indicate which user to use for auth. Does anyone have a clean solution for this? Thanks in advance, Eric

1 1

Troubles with Dovecot 2.3.3 - mkdir permission denied due to +w perm: /var, dir owned by 0:0 mode=0755)
by Kunal A. 22 Feb '19

22 Feb '19

Hi, I am quite new to Dovecot and I followed a tutorial on Linode to set up Dovecot, Postfix and MySql on the following site:- https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-my… Everything seems to work fine(telnet etc) except dovecot does not create mailboxes. Highly appreciate if someone could check the error messages and the dovecot -n on the bottom and provide some advise. I was unable to get the SQL config but I don't think its related to SQL but more of permission related. Please help Thanks Kevin Dovecot Version: 2.3.3 Error Message: Feb 22 08:54:42 computer dovecot[2224]: imap(email1(a)example.com)<4452><TTHt3nuC+rIAAAAAAAAAAAAAAAAAAAAB>: Server shutting down. in=16 out=539 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Feb 22 08:54:42 computer dovecot[4870]: master: Dovecot v2.3.3 (dcead646b) starting up for imap, pop3 Feb 22 08:55:06 computer dovecot[4872]: imap-login: Login: user=< email1(a)example.com>, method=PLAIN, rip=::1, lip=::1, mpid=4878, secured, session=<PfIL8HuCnLMAAAAAAAAAAAAAAAAAAAAB> Feb 22 08:55:14 computer dovecot[4872]: imap(email1(a)example.com)<4878><PfIL8HuCnLMAAAAAAAAAAAAAAAAAAAAB>: Error: mkdir(/var/vmail/email1(a)example.com/Maildir) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /var, dir owned by 0:0 mode=0755) Feb 22 08:55:14 computer dovecot[4872]: imap(email1(a)example.com)<4878><PfIL8HuCnLMAAAAAAAAAAAAAAAAAAAAB>: Error: mkdir(/var/vmail/email1(a)example.com/Maildir) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /var, dir owned by 0:0 mode=0755) Feb 22 08:55:14 computer dovecot[4872]: imap(email1(a)example.com)<4878><PfIL8HuCnLMAAAAAAAAAAAAAAAAAAAAB>: Error: Mailbox INBOX: Failed to autocreate mailbox: Internal error occurred. Refer to server log for more information. [2019-02-22 08:55:14] Feb 22 09:25:14 computer dovecot[4872]: imap(email1(a)example.com)<4878><PfIL8HuCnLMAAAAAAAAAAAAAAAAAAAAB>: Disconnected for inactivity in=16 out=546 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Output of dovecot -n : # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty Nine) # Hostname: computer auth_mechanisms = plain login mail_location = maildir:~/Maildir mail_privileged_group = mail mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = postmaster at example.com protocols = imap pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/vmail/%u driver = static }

2 2

dovecot Buch 2014 vs 2016
by Heiko Schlittermann 22 Feb '19

22 Feb '19

Moin, Es geht um das Dovecot-Buch. Ich nehme an, daß hier mindestens einer, der sich auskennt, mitliest: Gibt es - außer der Sprache und dem Preis - einen Unterschied zwischen der ersten (und einzigen?) deutschen Auflage von 2014 und der englischen Auflage von 2016? -- Heiko

3 3

Sieve vnd.dovecot.filter hanging issue
by Scott M. 22 Feb '19

22 Feb '19

I am trying to add a signature to all messages and it should be possible via vnd.dovecot.filter, the problem is that any script I try to filter through just hangs. I am running on FreeBSD 11.2 and I tried with dovecot 2.2.32 & pigeonhole 0.4.19 and with dovecot 2.3.2 && pigeonhole 0.5.2. In both cases, the output from dovecot is the same: Feb 19 18:24:22 mx13 dovecot: lda(user1): Debug: sieve: action filter: running program: append Feb 19 18:24:22 mx13 dovecot: lda(user1): Debug: Mailbox stdin: Opened mail UID=1 because: mail stream Feb 19 18:24:22 mx13 dovecot: lda(user1): Debug: waiting for program `/usr/local/gtech/sieve/append' to finish after 3 msecs Feb 19 18:25:22 mx13 dovecot: lda(user1): Debug: program `/usr/local/gtech/sieve/append'(55055) execution timed out after 60000 milliseconds: sending TERM signal Feb 19 18:25:27 mx13 dovecot: lda(user1): Debug: program `/usr/local/gtech/sieve/append' (55055) did not die after 5000 milliseconds: sending KILL signal at first I tried using my actual script but since it was failing I switched to a simple shell script: #!/bin/sh cat /dev/null echo "hey" exit 0 I got that idea after reading: http://dovecot.2317879.n4.nabble.com/execute-sieve-command-fails-to-notice-… (http://dovecot.2317879.n4.nabble.com/execute-sieve-command-fails-to-notice-…) The result is unfortunately the same. From what I can gather ( ran it inside strace/truss too), dovecot-lda hangs on the output. Is this accurate ? How can I get this to work ?

2 1

Using SHA256/512 for SQL based password
by Robert Moskowitz 21 Feb '19

21 Feb '19

I have trying to find how to set the dovecot-sql.conf for using SHA256/512. I am going to start clean with the stronger format, not migrate from the old MD5. It seems all I need is: driver = mysql connect = host=/var/lib/mysql/mysql.sock dbname=postfix user=postfix password=$Postfix_Database_Password default_pass_scheme = SHAxxx-CRYPT # following should all be on one line. password_query = SELECT username as user, password, concat('/home/vmail/', maildir) as userdb_home, concat('maildir:/home/vmail/', maildir) as userdb_mail, 101 as userdb_uid, 12 as userdb_gid FROM mailbox WHERE username = '%u' AND active = '1' # following should all be on one line user_query = SELECT concat('/home/vmail/', maildir) as home, concat('maildir:/home/vmail/', maildir) as mail, 101 AS uid, 12 AS gid, CONCAT('*:messages=30000:bytes=', quota) as quota_rule FROM mailbox WHERE username = '%u' AND active = '1' where xxx is either 256 or 512. All the rest I have been finding in my searches concern converting the format and are not needed for a clean start? thanks

13 30

Re: Assistance with doveadm backup...
by SH Development 21 Feb '19

21 Feb '19

Here is my command: [root@mail maelstrombackups] #mkdir -p vmailbackup [root@mail vmail]# chown: vmail:vmail /mnt/maelstrombackups/vmailbackup [root@mail vmail]# doveadm backup -u jeff maildir:/mnt/maelstrombackups/vmailbackup Only gives me the usage list, doesn’t work. Jeff > On Feb 21, 2019, at 1:29 AM, Sami Ketola <Sami.Ketola(a)Open-Xchange.com> wrote: > > > >> On 21 Feb 2019, at 7.04, SH Development via dovecot <dovecot(a)dovecot.org> wrote: >> >> Not really. The suggestions in the post seemed to be: >> >> 1. Tar the whole directory, which I have tried in the past, but a 130G directory takes over 18 hours to tar. >> 2. It was also suggested to rsync the directory, but the question was brought up, and not answered, about whether it was advisable to copy live mail, thus the need for doveadm sync/backup. >> >> Based on what I’ve read about doveadm backup, this is what I need, I am just having a hard time formulating the syntax for the command. >> > > root@ketola ~]# mkdir -p /backup/sami > root@ketola ~]# chown vmail:vmail /backup/sami > root@ketola ~]# doveadm backup -u sami Maildir:/backup/sami > <snip> > root@ketola ~]# du -hs /backup/sami > 211M /backup/sami > > does this help? > > Sami

1 0

Re: Assistance with doveadm backup...
by SH Development 21 Feb '19

21 Feb '19

Sorry for being such a newbie when it comes to scripting. Created a directory for the backups on the network mounted volume. Changed the appropriate path and am getting this: dsync(root): Error: user nfsnobody: Initialization failed: Namespace 'INBOX.': mkdir(/mnt/maelstrombackups/vmailbackup/nfsnobody) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /mnt/maelstrombackups/vmailbackup, euid is not dir owner) dsync(root): Fatal: User init failed Backup done for user: nfsnobody ... dsync(root): Error: user vmail: Initialization failed: Namespace 'INBOX.': mkdir(/mnt/maelstrombackups/vmailbackup/vmail) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /mnt/maelstrombackups/vmailbackup, euid is not dir owner) dsync(root): Fatal: User init failed Backup done for user: vmail … After running the script, I suddenly have two new directories in my vmail folder, “nfsnobody” and “vmail”. What are these users? Jeff > On Feb 20, 2019, at 10:32 PM, Kenren Taisho <toushin.taishi(a)gmail.com> wrote: > > No worries, that simple script should get you to a start though. Just replace the path with a mounted NFS share if you want it to reside in a network volume. > > On Thu, Feb 21, 2019 at 12:10 PM SH Development <listaccount(a)starionline.com> wrote: > My apologies, you are absolutely right. Will post this in the correct forum. > > Spent the last couple of hours poring through the postfix list and just forgot where I was at. > > Jeff > > > >> On Feb 20, 2019, at 8:55 PM, Kenren Taisho <toushin.taishi(a)gmail.com> wrote: >> >> Hi Jeff, >> >> This should be better off to dovecot's mailing list. >> But just to get you started, this is the first thing that came to mind: >> >> example: >> >> for users in `doveadm user "*"`; do >> LOCALPART=${users%%@*} >> dsync -v -f -u $users backup maildir:/tmp/backup/$LOCALPART >> echo "Backup done for user: $users ..." >> done >> >> HTH >> >> >> On Thu, Feb 21, 2019 at 9:55 AM SH Development <listaccount(a)starionline.com> wrote: >> I am having trouble locating examples of how to use doveadm backup. All the examples I see are for sync. I simply want to create a backup to a network volume of the email server's vmail folders. The goal here is to have a reasonably current backup should the main drive on the email server go south. >> >> We currently authenticate our users from a mysql database. User’s mailboxes are stored as domainname/username/Maildir >> >> I assume what I will wind up on the network volume is a duplicate directory structure as the vmail folder on the email server? >> >> Can someone help get me started here? >> >> Jeff >

1 0