- dovecot - dovecot.org

Re: lda fails in parse_angle_addr if sieve is enabled
by Stephan Bosch 12 Apr '18

12 Apr '18

Op 12-4-2018 om 15:52 schreef Leo Gaspard: > Here are the first two headers of the mail you just sent, delivered with > the rolled-back-into dovecot 2.3.0.1: > > Return-Path: stephan(a)rename-it.nl > Delivered-To: dovecot(a)leo.gaspard.io > > Does that clear the facts? The Return-Path appears to not have <>, which > appears to be opposed to RFC5322. So I guess dovecot could as before > accept it, and a bug should be reported upstream (I guess to opensmtpd, > as rspamd should not touch the Return-Path) so that it puts the expected > <> around the address. What do you think about this? Yes, I will make Dovecot more lenient in this regard. Regards, Stephan. > > On 04/12/2018 12:24 PM, Stephan Bosch wrote: >> Hi, >> >> This code path is only executed when there is a return-path header. >> Given the fact that this fails consistently, can you provide an example >> of a message successfully delivered using an older version of Dovecot; >> i.e., as it is stored in the mailbox? There should be a return-path >> header there. >> >> Alternatively, you could temporarily wrap dovecot-lda in a shell script >> that copies the message to some file you can read after. >> >> I just need one example to confirm my suspicions. >> >> Regards, >> >> >> Stephan. >> >> >> Op 12-4-2018 om 11:54 schreef Leo Gaspard: >>> (sorry for the absence of In-Reply-To, I could neither find it on the ML >>> interface nor figure out a way to customize it in Thunderbird, and am >>> not subscribed) >>> >>> Just wanted to chime in to say I've hit the same issue with the upgrade >>> from 2.3.0.1 to 2.3.1. My setup is an opensmtpd sending mail to rspamd, >>> that then delivers to dovecot LDA. >>> >>> In the logs, I see (slightly reformated and censored): >>> >>> Panic: file message-address.c: line 147 (parse_angle_addr): assertion >>> failed: (*ctx->parser.data == '<') >>> Error: Raw backtrace: >>> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] >>> -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] >>> -> >>> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(i_fatal+0) […] >>> -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] >>> -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] >>> -> >>> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(message_address_parse_path+[…]) >>> >>> […] >>> -> >>> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot-lda.so.0(mail_deliver_get_return_address+[…]) >>> >>> […] >>> -> /etc/dovecot/modules/lib90_sieve_plugin.so(+[…]) […] >>> -> >>> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot-lda.so.0(mail_deliver+[…]) >>> >>> [0x7f04e2d08e20] >>> -> /nix/store/[…]-dovecot-2.3.1/libexec/dovecot/deliver(main+[…]) […] >>> -> >>> /nix/store/[…]-glibc-2.26-131/lib/libc.so.6(__libc_start_main+[…]) […] >>> -> /nix/store/[…]-dovecot-2.3.1/libexec/dovecot/deliver(_start+[…]) […] >>> >>> For some reason there are not many symbols, but hope that helps!

1 0

Re: lda fails in parse_angle_addr if sieve is enabled
by Stephan Bosch 12 Apr '18

12 Apr '18

Hi, This code path is only executed when there is a return-path header. Given the fact that this fails consistently, can you provide an example of a message successfully delivered using an older version of Dovecot; i.e., as it is stored in the mailbox? There should be a return-path header there. Alternatively, you could temporarily wrap dovecot-lda in a shell script that copies the message to some file you can read after. I just need one example to confirm my suspicions. Regards, Stephan. Op 12-4-2018 om 11:54 schreef Leo Gaspard: > (sorry for the absence of In-Reply-To, I could neither find it on the ML > interface nor figure out a way to customize it in Thunderbird, and am > not subscribed) > > Just wanted to chime in to say I've hit the same issue with the upgrade > from 2.3.0.1 to 2.3.1. My setup is an opensmtpd sending mail to rspamd, > that then delivers to dovecot LDA. > > In the logs, I see (slightly reformated and censored): > > Panic: file message-address.c: line 147 (parse_angle_addr): assertion > failed: (*ctx->parser.data == '<') > Error: Raw backtrace: > /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] > -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] > -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(i_fatal+0) […] > -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] > -> /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(+[…]) […] > -> > /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot.so.0(message_address_parse_path+[…]) > […] > -> > /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot-lda.so.0(mail_deliver_get_return_address+[…]) > […] > -> /etc/dovecot/modules/lib90_sieve_plugin.so(+[…]) […] > -> > /nix/store/[…]-dovecot-2.3.1/lib/dovecot/libdovecot-lda.so.0(mail_deliver+[…]) > [0x7f04e2d08e20] > -> /nix/store/[…]-dovecot-2.3.1/libexec/dovecot/deliver(main+[…]) […] > -> /nix/store/[…]-glibc-2.26-131/lib/libc.so.6(__libc_start_main+[…]) […] > -> /nix/store/[…]-dovecot-2.3.1/libexec/dovecot/deliver(_start+[…]) […] > > For some reason there are not many symbols, but hope that helps!

1 0

lda fails in parse_angle_addr if sieve is enabled
by Bernard Spil 12 Apr '18

12 Apr '18

Hi, Since updating to 2.3.1 on my FreeBSD mailserver mail delivery using lda is broken if I have sieve enabled. (Before updating this was 2.2 and pigeonhole 0.4) FreeBSD 11.1-p8 amd64 Dovecot 2.3.1 Pigeonhole 0.5.1 Mailflow is OpenSMTPd as MTA, using mda delivery to rspamc which utlimately delivers using dovecot-lda. smtpd.conf deliver to mda "rspamc -h scan --mime -e \"/usr/local/libexec/dovecot/deliver -d %{user.username}\"" %{user.username} is the local user after virtusers, aliases etc. verified using a shell wrapper and capturing the username. conf.d/15-lda.conf protocol lda { mail_plugins = $mail_plugins sieve } maillog: Apr 8 19:36:54 email smtpd[6390]: smtp-in: Accepted message 9db769b1 on session 81939f0d30337a47: from=<user1(a)example.org>, to=<user2(a)example.net>, size=2871, ndest=1, proto=ESMTP Apr 8 19:36:54 email smtpd[6390]: smtp-in: Closing session 81939f0d30337a47 Apr 8 19:36:55 email dovecot: lda(user2)<21091><Ljv6JzdTylpjUgAAWr0fMA>: Panic: file message-address.c: line 147 (parse_angle_addr): assertion failed: (*ctx->parser.data == '<') Apr 8 19:36:55 email smtpd[6390]: delivery: TempFail for 9db769b13edef5a7: from=<user1(a)example.org>, to=<user2(a)example.net>, user=bernard, method=mda, delay=1s, stat=Error ("") Apr 8 19:36:57 email smtpd[6390]: smtp-out: Closing session 81939f0c09f5140b: 1 message sent. Apr 8 19:37:04 email dovecot: lda(user2)<21102><vAChMkBTylpuUgAAWr0fMA>: Panic: file message-address.c: line 147 (parse_angle_addr): assertion failed: (*ctx->parser.data == '<') Apr 8 19:37:04 email smtpd[6390]: delivery: TempFail for 9db769b13edef5a7: from=<user1(a)example.org>, to=<user2(a)example.net>, user=bernard, method=mda, delay=10s, stat=Error ("") Removing sieve from mail_plugins configuration and restarting Apr 8 19:37:32 email dovecot: master: Warning: Killed with signal 15 (by pid=21106 uid=0 code=kill) Apr 8 19:37:32 email dovecot: imap(user2)<21085><WGCXullpKzasEQIC>: Server shutting down. in=774 out=5373 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Apr 8 19:37:32 email dovecot: master: Dovecot v2.3.1 (8e2f634) starting up for imap, lmtp, sieve Apr 8 19:37:35 email dovecot: lda(user2)<21134><tNPZHl9TylqOUgAAWr0fMA>: msgid=<32984450d041e5c2f887bed5f6512c92(a)example.org>: saved mail to INBOX Apr 8 19:37:35 email smtpd[6390]: delivery: Ok for 9db769b13edef5a7: from=<user1(a)example.org>, to=<user2(a)example.net>, user=user2, method=mda, delay=41s, stat=Delivered Mail gets delivered. Don't understand why it is looking for a <>-address if sieve is enabled. Cheers, Bernard Spil.

2 6

two unrelated issues, lastlogin, and an out of memory fatal error
by David Mehler 11 Apr '18

11 Apr '18

Hello, I've got a few misc issues that I'm trying to get a handle on. I'm having what is probably a simple error with last logins. It's not working, unable to write values to the database. Here's the log lines: 2018-04-10 10:43:34 imap-login: Info: Login: user=<user(a)domain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=75934, TLS, session=<db0EjH9pOix/AAAB> 2018-04-10 10:43:34 imap(user(a)domain.com)<75934><db0EjH9pOix/AAAB>: Error: last_login_dict: Failed to write value for user user(a)domain.com: dict-server returned failure: sql dict: commit failed: Field 'name' doesn't have a default value (reply took 0.013 secs (0.000 in dict wait, 0.012 in other ioloops, 0.000 in locks, async-id reply 0.002 secs ago, started on dict-server 0.005 secs ago, took 0.005 secs)) Here's an excerpt from my dovecot-dict-sql.conf.ext file: map { pattern = shared/last-login/$user table = accounts value_field = last_login value_type = uint fields { username = $user } } and the relevant database table: describe accounts; +------------+------------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra | +------------+------------------+------+-----+---------+----------------+ | id | int(10) unsigned | NO | PRI | NULL | auto_increment | | name | varchar(255) | NO | | NULL | | | username | varchar(64) | NO | MUL | NULL | | | domain | varchar(255) | NO | MUL | NULL | | | password | varchar(255) | NO | | NULL | | | quota | int(10) unsigned | YES | | 0 | | | enabled | tinyint(1) | YES | | 0 | | | sendonly | tinyint(1) | YES | | 0 | | | last_login | int(11) | YES | | NULL | | Second issue, I've used imapsync to download my gmail messages to dovecot. I am atempting to access these messages and getting: 2018-04-08 11:11:58 indexer-worker(user(a)domain.com)<44193><4GzoqFdpisJ/AAAB:StoZDD4xylqhrAAA0J78UA>: Info: Indexed 0 messages in INBOX 2018-04-08 11:11:58 indexer-worker(user(a)domain.com)<44193><4GzoqFdpisJ/AAAB:0AaXFD4xylqhrAAA0J78UA>: Info: Indexed 0 messages in INBOX 2018-04-08 11:11:58 indexer-worker(user(a)domain.com)<44193><4GzoqFdpisJ/AAAB:CP3TIT4xylqhrAAA0J78UA>: Info: Indexed 0 messages in INBOX 2018-04-08 11:11:58 indexer-worker(user(a)domain.com)<44193><4GzoqFdpisJ/AAAB:eNEWMT4xylqhrAAA0J78UA>: Info: Indexed 0 messages in INBOX 2018-04-08 11:15:28 imap(user(a)domain.com)<21374><4GzoqFdpisJ/AAAB>: Fatal: block_alloc(8388608): Out of memory 2018-04-08 11:15:28 imap(user(a)domain.com)<21374><4GzoqFdpisJ/AAAB>: Fatal: master: service(imap): child 21374 returned error 83 (Out of memory (service imap { vsz_limit=256 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) when I atempt to do so. For completeness the imapsync command I used was: imapsync --host1 imap.gmail.com --user1 Username --password1 Password --host2 localhost --user2 username --password2 Password --ssl1 --useheader 'Message-Id' --regextrans2 's/\[Gmail\]/user\@domain/' Any help appreciated on either issue. Thanks. Dave. doveconf -n # 2.3.1 (8e2f634): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: FreeBSD 11.1-RELEASE-p4 amd64 # Hostname: localhost auth_cache_size = 24 M auth_cache_ttl = 18 hours auth_default_realm = domain.com auth_mechanisms = plain login dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext lastlogin = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 999 first_valid_uid = 999 hostname = xxxx.xxxx.xxxx imap_idle_notify_interval = 10 mins last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = 127.0.0.1 xxx.xxx.xxx.xxx log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_access_groups = vmail mail_gid = vmail mail_home = /home/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = acl mail_log notify quota trash virtual welcome zlib mail_privileged_group = vmail mail_server_admin = mailto:postmaster@davemehler.com mail_uid = vmail mailbox_idle_check_interval = 59 secs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest editheader imapflags notify imapsieve vnd.dovecot.imapsieve namespace { location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEX=~/mail/public mailbox office { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / type = private } namespace virtual { location = virtual:/usr/local/etc/dovecot/virtual:INDEX=~/virtual:CONTROL=~/virtual prefix = virtual/ separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_globals_only = yes acl_shared_dict = proxy::acl fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. normalize no_snowball imapsieve_mailbox1_before = file:/home/vmail/sieve/global/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/home/vmail/sieve/global/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = proxy::lastlogin last_login_key = last-login/%n mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags +spamtest +spamtestplus +virustest +editheader sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.environment sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /home/vmail/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_user_log = /home/vmail/sieve/sieve_error.log sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u postmaster@%d welcome_wait = yes } postmaster_address = postmaster@xxx protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } user = root } service imap-login { inet_listener imap { address = 127.0.0.1 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap-postlogin { executable = script-login /usr/local/etc/dovecot/trackauth.sh user = vmail } service imap { executable = imap imap-postlogin } service lmtp { executable = lmtp unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ssl/acme/davemehler.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot/dovecot-lmtp.log log_path = /var/log/dovecot/dovecot-lmtp-errors.log mail_plugins = acl mail_log notify quota trash virtual welcome zlib sieve } protocol lda { mail_plugins = acl mail_log notify quota trash virtual welcome zlib sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl mail_log notify quota trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login fts fts_lucene } protocol sieve { info_log_path = /var/log/dovecot/dovecot-sieve.log log_path = /var/log/dovecot/dovecot-sieve-errors.log }

4 4

dovecot, imap sieve, roundcube markasjunk2 plugin
by David Mehler 10 Apr '18

10 Apr '18

Hello, Does anyone have the above combination going? Per the wiki: https://wiki.dovecot.org/HowTo/AntispamWithSieve I have configured Dovecot for imap sieve and rspamd setting up the learn sieve and shell scripts. This is working. Now i'd like to integrate roundcube's markasjunk2 plugin. Looking at it's config file I am uncertain as to which options to enable. If anyone has a working markasjunk2 roundcube config that works with dovecot and imap sieve i'd appreciate seeing it. Thanks. Dave.

1 0

IMAP_ID_LOG
by j.emerlik 10 Apr '18

10 Apr '18

Hi, there in configuration is possibile to set imap_id_log for logging Client ID e.g.: ID sent: name=Thunderbird, version=52.7.0. Is possible to set same but for POP3 or SMTP Auth ? Ideally, it would be possible to log in to the database e.g. using postlogin script. Regards, MattX

3 3

Filesystem level backups?
by Steve Atkins 09 Apr '18

09 Apr '18

Up until now I've been backing up my IMAP server by taking an atomic snapshot of the entire VM, so I've not really had to worry about it. I'm moving to hosting where I have neither VM snapshots nor a filesystem that can take snapshots, so I need to think about consistent backups a bit more. Will a simple backup of all the files of an multi-dbox give me a consistent state when I recover, or do I need to do something (e.g. lock writes to the mailbox) while I run a backup? (I could use doveadm backup if I were backing up to local storage I controlled, but I'm pushing it to offsite buckets so I'd prefer to avoid backing up the entire thing locally, then copying that offsite). Cheers, Steve

4 5

Raw Backtrace Error when backing up specific user
by Marius Fassbender 09 Apr '18

09 Apr '18

Hi, probably since the update to 2.3.1 I can't backup a specific users mailbox. For backup I use the command 'dsync -o plugin/quota= -f -u user@domain backup dbox:/backup/dir' When I execute this command with the -D option, I get to see (above only Debug messages) dsync(user@domain): Panic: file mailbox-attribute.c: line 362 (mailbox_attribute_get_stream): assertion failed: (value_r->value != NULL || value_r->value_stream != NULL) dsync(user@domain): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xcc724) [0x7f0f15364724] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f0f1536476a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0f152d524b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x566ac) [0x7f0f156686ac] -> doveadm(dsync_mailbox_import_attribute+0x4d) [0x5581a663bf4d] -> doveadm(dsync_brain_sync_mails+0x2ef) [0x5581a66377ff] -> doveadm(dsync_brain_run+0x2b0) [0x5581a6632e90] -> doveadm(+0x2960c) [0x5581a661a60c] -> doveadm(+0x2b4f7) [0x5581a661c4f7] -> doveadm(+0x2c0dc) [0x5581a661d0dc] -> doveadm(doveadm_mail_try_run+0x205) [0x5581a661da75] -> doveadm(main+0x475) [0x5581a660cce5] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f0f14ca3c05] -> doveadm(+0x1be65) [0x5581a660ce65] cancelled my dovecot -n output: # 2.3.1 (0580a21bf): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: Linux 3.10.0-693.21.1.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs doveconf: Warning: please set ssl_dh=</etc/dovecot/dh.pem doveconf: Warning: You can generate it with: dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem auth_cache_negative_ttl = 0 auth_cache_size = 100 M auth_master_user_separator = * auth_mechanisms = login plain auth_verbose = yes auth_verbose_passwords = sha1:16 deliver_log_format = msgid=%m from=%f subject=%s psize=%p status=%$ first_valid_gid = 5000 first_valid_uid = 5000 hostname = imap_capability = +XLIST imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 5000 last_valid_uid = 5000 lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes mail_attachment_dir = /storage/mail/attachments mail_attachment_hash = %{sha512} mail_gid = 5000 mail_home = /storage/mail/settings/%Ld/%Ln mail_location = sdbox:/storage/mail/mails/%Ld/%Ln mail_plugins = zlib quota acl listescape fts fts_lucene mail_server_admin = mailto:postmaster@domain mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { list = children location = sdbox:/storage/mail/mails/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archive { special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox "Gesendete Objekte" { special_use = \Sent } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/storage/mail/settings/global-acls:cache_secs=300 acl_shared_dict = file:/storage/mail/settings/shared-mailboxes fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. imapsieve_mailbox1_before = file:/usr/lib64/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/lib64/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_fields = uid box msgid size subject quota = dict:User quota::file:%h/dovecot-quota quota_grace = 5%% quota_rule = Trash:storage=+5%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = file:%h/sieve;active=%h/.dovecot.sieve sieve_execute_bin_dir = /usr/lib64/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_bin_dir = /usr/lib64/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster@domain protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0600 user = postfix } unix_listener auth-userdb { group = dovemail mode = 0600 user = dovemail } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = dovemail } user = dovecot } ssl = required ssl_cert = </etc/pki/tls/certs/cert.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = master_user=%u driver = ldap } protocol lmtp { mail_plugins = zlib quota acl listescape fts fts_lucene sieve postmaster_address = postmaster@domain } protocol imap { mail_plugins = zlib quota acl listescape fts fts_lucene imap_acl imap_quota imap_sieve imap_zlib } I tried to rebuild the settings files of this mailbox by deleting them and restart the service but this didnt help. A reboot did neither. I dont know where to start fixing this problem, does anyone has an advice? Thanks in advance

1 0

Re: 2.3.1 Replication is throwing scary errors
by Reuben Farrelly 08 Apr '18

08 Apr '18

Hi, [Formatting is a bit rough, replying from a trimmed digest email] > Message: 1 > Date: Fri, 6 Apr 2018 15:04:35 +0200 > From: Michael Grimm <trashcan(a)ellael.org> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: 2.3.1 Replication is throwing scary errors > Message-ID: <E7E7A927-68F8-443F-BA59-E66CED8FE878(a)ellael.org> > Content-Type: text/plain; charset=utf-8 > > Reuben Farrelly wrote: >> From: Michael Grimm <trashcan(a)ellael.org> > >>> [This is Dovecot 2.3.1 at FreeBSD STABLE-11.1 running in two jails at distinct servers.] >>> I did upgrade from 2.2.35 to 2.3.1 today, and I do become pounded by error messages at server1 (and vice versa at server2) as follows: >>> | Apr 2 17:12:18 <mail.err> server1.lan dovecot: doveadm: Error: dsync(server2.lan): I/O has stalled, \ >>> no activity for 600 seconds (last sent=mail_change, last recv=mail_change (EOL)) >>> | Apr 2 17:12:18 <mail.err> server1.lan dovecot: doveadm: Error: Timeout during state=sync_mails \ >>> (send=changes recv=mail_requests) >>> [?] >>> | Apr 2 18:59:03 <mail.err> server1.lan dovecot: doveadm: Error: dsync(server2.lan): I/O has stalled, \ >>> no activity for 600 seconds (last sent=mail, last recv=mail (EOL)) >>> | Apr 2 18:59:03 <mail.err> server1.lan dovecot: doveadm: Error: Timeout during state=sync_mails \ >>> (send=mails recv=recv_last_common) >>> I cannot see in my personal account any missing replications, *but* I haven't tested this thoroughly enough. I do have customers being serviced at these productive servers, *thus* I'm back to 2.2.35 until I do understand or have learned what is going on. > > In my reply to this statement of mine I mentioned that I have seen those timeouts quite some times during the past year. Thus, I upgraded to 2.3.1 again, and boom: after some hours I ended up in hanging processes [1] like (see Remko's mail in addition) ... > > doveadm-server: [IP4/6 <USER1> SOME/MAILBOX import:0/0] (doveadm-server) > > ? at server2 paired with a file like ? > > -rw------- 1 vmail dovecot uarch 0 Apr 3 16:52 /home/to/USER1/.dovecot-sync.lock > > Corresponding logfile entries at server2 are like ? > > Apr 3 17:10:49 <mail.err> server2.lan dovecot: doveadm: Error: Couldn't lock /home/to/USER1/.dovecot-sync.lock: \ > fcntl(/home/to/USER1/.dovecot-sync.lock, write-lock, F_SETLKW) locking failed: Timed out after 30 seconds \ > (WRITE lock held by pid 51110) > > [1] Even stopping dovecot will not end those processes. One has to manually kill those before restarting dovecot. > > After one day of testing 2.3.1 with a couple of those episodes of locking/timeout, and now missing mails depending with server your MUA will connect to, I went back to 2.2.35. After two days at that version I never had such an episode again. > >> It's not just you. This issue hit me recently, and it was impacting >> replication noticeably. I am following git master-2.3 . > [...] >> There is also a second issue of a long standing race with replication >> occurring somewhere whereby if a mail comes in, is written to disk, is >> replicated and then deleted in short succession, it will reappear >> again to the MUA. I suspect the mail is being replicated back from >> the remote. A few people have reported it over the years but it's not >> reliable or consistent, so it has never been fixed. >> And lastly there has been an ongoing but seemingly minor issue >> relating to locking timing out after 30s particularly on the remote >> host that is being replicated to. I rarely see the problem on my >> local disk where almost all of the mail comes in, it's almost always >> occurring on the replicate/remote system. > > It might be time to describe our setups in order to possibly find common grounds that might trigger this issue you describe and Rimko and myself ran into as well. > > Servers: Cloud Instances (both identical), around 25ms latency apart. > Intel Core Processor (Haswell, no TSX) (3092.91-MHz K8-class CPU) > Both servers are connected via IPsec/racoon tunnels > OS: FreeBSD 11.1-STABLE (both servers) > Filesystem: ZFS > MTA: postfix 3.4-20180401 (postfix delivers via dovecot's LMTP) > IMAP: dovecot running in FreeBSD jails (issues with 2.3.1, fine with 2.2.35) > Replication: unsecured tcp / master-master > MUA: mainly iOS or macOS mail.app, rarely roundcube For me: Servers: Main: VM on a VMWare ESXi local system (light load), local SSD disks (no NFS) Redundant: Linode VM in Singapore, around 250ms away Also no NFS. Linode use SSDs for IO. There is native IPv6 connectivity between both VMs. As I am using TCPs I don't have a VPN between them - just raw IPv6 end to end. OS: Gentoo Linux x86_64 kept well up to date Filesystem: EXT4 for both MTA: Postfix 3.4-x (same as you) IMAP: Dovecot running natively on the machine (no jail/chroot) Replication: Secured TCP / master-master (but only one master is actively used for SMTP and MUA access) MUA: Thunderbird, Maildroid, MS Mail, Gmail client, Roundcube, LG Mail client on handset etc > I believe it is worthwhile to mention here that I run a poor man's fail-over approach (round-robin DNS) as follows: > > DNS: mail.server.tld resolves to one IP4 and one IP6 address of each server, thus 4 IP addresses in total For me I have a simple pair of servers that replicate mail to each other. Clients connect to the main server only, which is where mail comes in. The second one that experiences the problem with locking is only a redundant server which is a secondary MX, that only gets occasional SMTP deliveries from time to time. So the amount of replication back from the "secondary" is very minimal; the vast bulk of the replication is the primary replicating changes out. Reuben

1 0

changed behavior for dovecot-lda in 2.3.x
by Martin Waschbüsch 08 Apr '18

08 Apr '18

Hi all, Hey all, I upgraded to dovecot 2.3.1 (from 2.2.34) and noticed that the behavior for dovecot-lda changed. Apparently it no longer accepts -f "" or -f "<>? With 2.2.34, both were accepted now I get: root@mail:~# /usr/local/libexec/dovecot/dovecot-lda -f "<>" lda(root): Fatal: Invalid -f parameter: Null path not allowed or root@mail:~# /usr/local/libexec/dovecot/dovecot-lda -f "" lda(root): Fatal: Invalid -f parameter: Path is empty string I guess this must be a bug? I mean, envelope sender *must* be empty for bounces. Thanks, Martin

2 2

Can’t authenticate any users after upgrade.
by Kevin Cummings 08 Apr '18

08 Apr '18

I’m in the process of upgrading an old server from Fedora 21 to something more modern. Now, Dovecot won’t let any client login to get their email. PAM audit_log_acct_message() failed: Operation not permitted imap-login: Disconnected (AUTH failed, 2 attempts in 10 secs): user=<username>, method=PLAIN, rip=192.168.1.94 lip=192.168.1.94, TLS, session=<sessionid> # 2.3.1 (8e2f634): /etc/dovecot/dovecot.conf # OS: Linux 4.4.14-200.fc22.x86_64 x86_64 Fedora release 22 (Twenty Two) # Hostname: kjchome.homeip.net mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } -- Kevin J. Cummings cummings(a)kjchome.homeip.net cummings(a)kjc386.framingham.ma.us kjchome(a)icloud.com Registered Linux User #1232 (http://www.linuxcounter.net/)

4 8

sharing a folder with all users in a domain
by David Mehler 08 Apr '18

08 Apr '18

Hello, I'm wanting to make a shared folder that anyone in a domain can get to, but not anyone in any other domain. Here's my dovecot shared namespace: namespace { type = shared separator = / prefix = shared/%%u/ location = maildir:%%h:INDEX=~/shared/%%u subscriptions = no list = yes } The dovecot-dict-sql.conf.ext file has: map { pattern = shared/shared-boxes/user/$to/$from table = user_shares value_field = dummy fields { from_user = $from to_user = $to } } map { pattern = shared/shared-boxes/anyone/$from table = anyone_shares value_field = dummy fields { from_user = $from } } and in my global acl file I have: shared/office@ user(a)domain.com lrwstipekxa shared/office@ user2(a)domain.com lrwstipekxa Thanks. Dave.

1 0

Warning message about quota.conf
by forums＠mehl-family.fr 06 Apr '18

06 Apr '18

Hi, In my maillog I see this warning message at every reception of e-mail: _STATUS=SENT (DELIVERED VIA DOVECOT SERVICE (DOVECONF: WARNING: /ETC/DOVECOT/CONF.D/90-QUOTA.CONF LINE 39: GLOBAL SETTING MAIL_PLUGINS WON'T CHAN....._ It is just a warning, the e-mail was delivered. I don't find where is the problem. Thank's.

1 0

Dsync from multiple IMAPs -- personal/local dovecot setup
by Kim ALLAMANDOLA 06 Apr '18

06 Apr '18

Hello list, new aspiring user here, if I'm not in the wright place sorry, I do not fund any other option for now... As from subject I'm looking for a *personal* *standalone* dovecot setup, especially I'm looking for a DSync from multiple IMAP accounts to a local maildir (to being compatible with notmuch). My actual mail setup is: OfflineIMAP that sync different mailboxes in a personal taxonomy ~/mail/$mailboxName/... and notmuch-emacs + various scripts as MUA. Local postfix just to avoid emacs freeze during send, muchsync to support It does work but is slow, buggy and sometime complicated to kept up to date (I have many homegrow spaghetti-code scripts and snippets in zsh, elisp, python etc stratified in years). My dream is switch to a local Dovecot that DSync from multiple IMAPs instead of OfflineIMAP, with sieve filters instead of homegrow scripts that wrap notmuch search --output=files | xargs ... For the MUA part I'd like to stick with notmuch. So my questions are: is possible to dsync from multiple IMAPS to a maildir? if yes does dovecot accept physical messages moves if I refile (archive etc) them via notmuch? Thanks! -- Kim ALLAMANDOLA

1 0

Re: 2.3.1 Replication is throwing scary errors
by Reuben Farrelly 06 Apr '18

06 Apr '18

Hi, > ------------------------------ > > Message: 2 > Date: Mon, 2 Apr 2018 22:06:07 +0200 > From: Michael Grimm <trashcan(a)ellael.org> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: 2.3.1 Replication is throwing scary errors > Message-ID: <29998016-D62F-4348-93D1-613B13DA90DB(a)ellael.org> > Content-Type: text/plain; charset=utf-8 > > Hi > > [This is Dovecot 2.3.1 at FreeBSD STABLE-11.1 running in two jails at distinct servers.] > > I did upgrade from 2.2.35 to 2.3.1 today, and I do become pounded by error messages at server1 (and vice versa at server2) as follows: > > | Apr 2 17:12:18 <mail.err> server1.lan dovecot: doveadm: Error: dsync(server2.lan): I/O has stalled, \ > no activity for 600 seconds (last sent=mail_change, last recv=mail_change (EOL)) > | Apr 2 17:12:18 <mail.err> server1.lan dovecot: doveadm: Error: Timeout during state=sync_mails \ > (send=changes recv=mail_requests) > [?] > | Apr 2 18:59:03 <mail.err> server1.lan dovecot: doveadm: Error: dsync(server2.lan): I/O has stalled, \ > no activity for 600 seconds (last sent=mail, last recv=mail (EOL)) > | Apr 2 18:59:03 <mail.err> server1.lan dovecot: doveadm: Error: Timeout during state=sync_mails \ > (send=mails recv=recv_last_common) > > I cannot see in my personal account any missing replications, *but* I haven't tested this thoroughly enough. I do have customers being serviced at these productive servers, *thus* I'm back to 2.2.35 until I do understand or have learned what is going on. > > Any ideas/feedback? > > FYI: I haven't seen such errors before. Replication has been working for years now, without any glitches at all. > > Regards, > Michael It's not just you. This issue hit me recently, and it was impacting replication noticeably. I am following git master-2.3 . Here's a last known reasonably good point in the tree where things worked quite well: EGIT_REPO_URI="https://github.com/dovecot/core.git" EGIT_BRANCH="master-2.3" EGIT_COMMIT="d9a1a7cbec19f4c6a47add47688351f8c3a0e372" So something after that (which could have gone into 2.3.1) has caused this. There is also a second issue of a long standing race with replication occurring somewhere whereby if a mail comes in, is written to disk, is replicated and then deleted in short succession, it will reappear again to the MUA. I suspect the mail is being replicated back from the remote. A few people have reported it over the years but it's not reliable or consistent, so it has never been fixed. And lastly there has been an ongoing but seemingly minor issue relating to locking timing out after 30s particularly on the remote host that is being replicated to. I rarely see the problem on my local disk where almost all of the mail comes in, it's almost always occurring on the replicate/remote system. For me it seems very unlikely that on an unloaded/idle VPS there are legitimate problems obtaining a lock in under 30s. This is with the default locking configuration. This problem started happening a lot more after the breakage in (1) above. These replication issues are similar, and could possibly be related. My system is Gentoo Linux keeping up with the latest kernels, and on an EXT4 FS. I am using TCPS based replication. My remote replicate is also on Gentoo Linux with EXT4 but on a Linode VPS (around 250ms latency away). I know in a later post you've said that you don't think it has anything to do with dovecot-2.3.1, so I'd be interested to know what really is the cause in that case. Reuben

4 3

Compatibility of Submission in 2.3.1
by Paul Hecker 06 Apr '18

06 Apr '18

Hi, Dovecot 2.3.1 (8e2f634). When using submission one client of mine can not send messages. Directly sending through exim works. Seems that dovecot is too picky or follow the RFC too precise here to be compatible. Here is the debug log (note the space between “From:" and "<user2(a)host.com>”): Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: Received new command: MAIL From: <user(a)host.com> Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: command MAIL; 501 reply: Submitted Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: command MAIL: Ready to reply Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: Trigger output Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: Timeout stop Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: Sending replies Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: command MAIL; 501 reply: Sent: 501 5.5.4 Invalid FROM: Missing '<' at beginning of path Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: command MAIL: Destroy Apr 6 12:02:08 mail dovecot: submission(user(a)host.com)<14972><ko4tJitpt9JYSSSC>: Debug: smtp-server: conn 22.73.xx.144:53943 [0]: command MAIL; 501 reply: Destroy Is there a chance that you will incorporate a fix (be more compatible but less stringent)? Thanks, Paul

3 3

dovecot welcome scripts for multiple domains
by David Mehler 06 Apr '18

06 Apr '18

Hello, I've got dovecot 2.3 going, and it uses welcome scripts successfully. My question is does anyone have a script that is multi-domain capable? Currently mine sends it's welcome message from say postmaster(a)domain1.com, well I've got five domains, can I set this script up so that it's smart about them? If user(a)domain3.com logs in it would send a message from postmaster(a)domain3.com? If anyone has any welcome scripts i'm curious to take a look. Thanks. Dave.

2 1

issue with sieve forwarding after upgrade to 0.5.1
by Christos Chatzaras 05 Apr '18

05 Apr '18

Finally I found a workaround to not depend on sendmail to forward messages using sieve: In postfix main.cf I have: authorized_submit_users = root, filter (I want only root and filter to use sendmail and block other users to send e-mails from system accounts. Only allow users to send e-mails from virtual accounts and after smtp authentication. Username filter is used for bogofilter and needs access to sendmail) And in dovecot.conf: submission_host = 138.201.248.xxx The same workaround maybe works for NoNewPrivileges too as the authorized_submit_users setting in postfix has similar result.

1 0

GFS2 writes extremely slow
by DurgaPrasad - DatasoftComnet 05 Apr '18

05 Apr '18

Hello all, We are facing extremely slow GFS2 issues in Redhat 7 64 bit. Backend is 16 Gbps FC SAN so no issues there. I have scoured the entire (anyways most of the) Internet and arrived at the following settings. mmap_disable = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes mmap_disable = yes lock_method = fcntl Did a systemctl restart dovecot and did not find any major improvement. Can you please help. Regards Durga Prasad --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 1

Lmtp issues on dovecot 2.3.x with big messages
by Ricardo Machini Barbosa 05 Apr '18

05 Apr '18

Hello, After update dovecot to version 2.3.x, LMTP stopped to receive big messages ( > 45 MB ). Messages are being sent to dovecot LMTP by postfix. If I change this email to another server with dovecot 2.2.x the same message are delivered immediately. Log with mail_debug = yes: Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Connect from 10.0.5.3 Apr 4 13:36:13 mailsrv01 dovecot: lmtp(mailto:mailsrv01@dominio.com.br)<190031><tkOqEv3+xFpP5gIAZCVTkw>: Debug: Loading modules from directory: /usr/lib64/dovecot Apr 4 13:36:13 mailsrv01 dovecot: lmtp(mailto:mailsrv01@dominio.com.br)<190031><tkOqEv3+xFpP5gIAZCVTkw>: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Apr 4 13:36:13 mailsrv01 dovecot: lmtp(mailto:mailsrv01@dominio.com.br)<190031><tkOqEv3+xFpP5gIAZCVTkw>: Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Apr 4 13:36:13 mailsrv01 dovecot: lmtp(mailto:mailsrv01@dominio.com.br)<190031><tkOqEv3+xFpP5gIAZCVTkw>: Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Apr 4 13:36:13 mailsrv01 dovecot: lmtp(mailto:mailsrv01@dominio.com.br)<190031><tkOqEv3+xFpP5gIAZCVTkw>: Debug: auth USER input: mailto:mailsrv01@dominio.com.br home=/mail/data/dovecot/mailbox/dominio.com.br/m/h4/mailsrv01 quota_rule=*:bytes=53687091200 Apr 4 13:36:13 mailsrv01 dovecot: lmtp(mailto:mailsrv01@dominio.com.br)<190031><tkOqEv3+xFpP5gIAZCVTkw>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=53687091200 Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Effective uid=1000, gid=1000, home=/mail/data/dovecot/mailbox/dominio.com.br/m/h4/mailsrv01 Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Quota root: name=User quota backend=count args= Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Quota rule: root=User quota mailbox=Itens Excluídos bytes=+209715200 messages=0 Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Quota warning: bytes=51002736640 (95%) messages=0 reverse=no command=quota-warning 95 mailto:mailsrv01@dominio.com.br Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Quota warning: bytes=42949672960 (80%) messages=0 reverse=no command=quota-warning 80 mailto:mailsrv01@dominio.com.br Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Quota grace: root=User quota bytes=5368709120 (10%) Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox:ALT=/altstorage/mail/data/dovecot/mailbox/dominio.com .br/m/h4/mailsrv01/mdbox Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: fs: root=/mail/data/dovecot/mailbox/dominio.com.br/m/h4/mailsrv01/mdbox, index=, indexpvt=, control=, inbox=, alt=/altstorage/mail/data/dovecot/mailbox/dominio.com.br/m/h4/mailsrv01/mdbo x Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Apr 4 13:36:13 mailsrv01 dovecot: lmtp(190031): Debug: INBOX: Mailbox opened because: quota count Apr 4 13:36:14 mailsrv01 dovecot: lmtp(190031): Error: lmtp-server: conn 10.0.5.3:41579 [0]: Connection lost during data transfer: read(10.0.5.3:41579 [0]) failed: <no error> Apr 4 13:36:14 mailsrv01 dovecot: lmtp(190031): Disconnect from 10.0.5.3: Read failure (state = DATA) Strace on this process (final lines): 190074 read(15, "4SJuCeSNxH05pyfK+aO5hKKkrPY8n8TeBNH\r\ngvJ5LrV54YxgtG6Blkx0wfTIxWZ4Z1PU9R1a 7hs7YQadaqfMkPIc5wCP8Ko69eXE8GoRSySpCh2g\r\ns/UA8Hn8K6nwrpscXhd5Vupfttw/mqFX 5WTqCD6DvxUSxdTeTM5YSFvdVhmueK/7Mguba8mkmuY/\r\nlAC580Zxn6CuP8GeLrq31oWOhotx cXzYkVlGVj7n0yMn9Kf4h0LXZ7o393p8U1o5UnbMPnVsDIz2\r\n9R1617R8H/BWl2vhnxDfXUcF rqYnVYJBuJxySB6ZwPzonKMlZkU4SjscV4puNW1a/nkvWZPscZij\r\nUqR5YI569WP+FeWx+FUs oY573fCzjIJbdux3OD1r3zWPEVpYmRbyyS6WJljjkcbizsOOnQ8155q3\r\nhnWdVkkQMbKKF1fa w+6vpj19q3o01y3RhiPi1J9H8KwavaKn2mFFGwGUEEkH3PGOD9K9bvrzwvpk\r\neu29rrs"..., 8192) = 8192 190074 write(8, "4SJuCeSNxH05pyfK+aO5hKKkrPY8n8TeBNH\r\ngvJ5LrV54YxgtG6Blkx0wfTIxWZ4Z1PU9R1a 7hs7YQadaqfMkPIc5wCP8Ko69eXE8GoRSySpCh2g\r\ns/UA8Hn8K6nwrpscXhd5Vupfttw/mqFX 5WTqCD6DvxUSxdTeTM5YSFvdVhmueK/7Mguba8mkmuY/\r\nlAC580Zxn6CuP8GeLrq31oWOhotx cXzYkVlGVj7n0yMn9Kf4h0LXZ7o393p8U1o5UnbMPnVsDIz2\r\n9R1617R8H/BWl2vhnxDfXUcF rqYnVYJBuJxySB6ZwPzonKMlZkU4SjscV4puNW1a/nkvWZPscZij\r\nUqR5YI569WP+FeWx+FUs oY573fCzjIJbdux3OD1r3zWPEVpYmRbyyS6WJljjkcbizsOOnQ8155q3\r\nhnWdVkkQMbKKF1fa w+6vpj19q3o01y3RhiPi1J9H8KwavaKn2mFFGwGUEEkH3PGOD9K9bvrzwvpk\r\neu29rrs"..., 8192) = 8192 190074 read(15, "S5huvLRmJ+YBc8A8nI9/x5cXQxLfNS28t\r\nylCLVmfo3Yx/BdrhLHxbpXgiwexjAiNsEtnuXA /iJdWCtn5vmPXGK/HZfENnL8atQ8S6d4T0nwwh\r\nvHFz9ohKouSTuj+UdQRjqAcHNey6vH4wjg fWP+Fl6v8AbpY2juXFskrwRnkg7shznJ5FfPfjX4ly\r\nz29npvibXtE1S+tSFhvmkWM5IIGB/D 9O3A5r6PhaEnUlCoua/RnNivcjzRR6/wDFLx9BqKXV7f8A\r\njz+0tE07TxENOewK7GUHaHnJ+c k56DGNtfPngz4gazr1pa2XhN3tdbZwTE7FlgkJ/hVvlUFR745r\r\ngZPDWsapqF7/AGrL4g1TTb tlMdzBumjI6DbjIwMfoa1tc+C/xI8E2SfEX4fWl1rnhnTWKXN2iGK5\r\nsWxkBouSzE9COPpX0V Xhyp9h2NqWbwSSmdzHqPjG91lNN+IV9PbS27M4jtZF8pmznDAYH489K+m/\r\nAb6NqEGoX"..., 8192) = 8192 190074 write(8, "S5huvLRmJ+YBc8A8nI9/x5cXQxLfNS28t\r\nylCLVmfo3Yx/BdrhLHxbpXgiwexjAiNsEtnuXA /iJdWCtn5vmPXGK/HZfENnL8atQ8S6d4T0nww", 110) = 110 190074 write(2, "\1\004190074 lmtp-server: conn 10.0.5.3:47019 [0]: Connection lost during data transfer: read(10.0.5.3:47019 [0]) failed: <no error>\n", 129) = 129 190074 epoll_ctl(12, EPOLL_CTL_DEL, 15, {0, {u32=3831903536, u64=140298938627376}}) = 0 190074 write(2, "\1\002190074 Disconnect from 10.0.5.3: Read failure (state = DATA)\n", 63) = 63 190074 close(15) = 0 190074 close(8) = 0 190074 brk(0x7f99e469a000) = 0x7f99e469a000 190074 brk(0x7f99e4697000) = 0x7f99e4697000 190074 brk(0x7f99e4692000) = 0x7f99e4692000 190074 close(7) = 0 190074 munmap(0x7f99df5ae000, 2106232) = 0 190074 munmap(0x7f99df7b1000, 2190784) = 0 190074 munmap(0x7f99df3a8000, 2118896) = 0 190074 munmap(0x7f99df0f8000, 2817696) = 0 190074 munmap(0x7f99deea7000, 2426160) = 0 190074 munmap(0x7f99dec98000, 2155816) = 0 190074 munmap(0x7f99dea7e000, 2201520) = 0 190074 munmap(0x7f99de831000, 2410344) = 0 190074 munmap(0x7f99de605000, 2276480) = 0 190074 munmap(0x7f99de2c2000, 3417832) = 0 190074 munmap(0x7f99de095000, 2280176) = 0 190074 munmap(0x7f99dde91000, 2109704) = 0 190074 munmap(0x7f99ddc8c000, 2113912) = 0 190074 munmap(0x7f99dda4e000, 2350304) = 0 190074 munmap(0x7f99dd817000, 2318816) = 0 190074 munmap(0x7f99dd614000, 2105520) = 0 190074 epoll_ctl(12, EPOLL_CTL_DEL, 11, {0, {u32=3831812352, u64=140298938536192}}) = 0 190074 close(11) = 0 190074 close(10) = 0 190074 epoll_ctl(12, EPOLL_CTL_DEL, 6, {0, {u32=3831812672, u64=140298938536512}}) = 0 190074 epoll_ctl(12, EPOLL_CTL_DEL, 13, {0, {u32=3831839376, u64=140298938563216}}) = 0 190074 close(13) = 0 190074 close(14) = 0 190074 munmap(0x7f99e13d1000, 2145864) = 0 190074 munmap(0x7f99e1165000, 2538792) = 0 190074 munmap(0x7f99e0d80000, 4083672) = 0 190074 munmap(0x7f99e0b3c000, 2373600) = 0 190074 munmap(0x7f99e0855000, 3041984) = 0 190074 munmap(0x7f99e0651000, 2109872) = 0 190074 munmap(0x7f99e0425000, 2273704) = 0 190074 munmap(0x7f99e020f000, 2183696) = 0 190074 munmap(0x7f99e0004000, 2139216) = 0 190074 munmap(0x7f99dfe01000, 2105424) = 0 190074 munmap(0x7f99dfbe7000, 2202248) = 0 190074 munmap(0x7f99df9c8000, 2221912) = 0 190074 close(12) = 0 190074 brk(0x7f99e4691000) = 0x7f99e4691000 190074 close(9) = 0 190074 close(4) = 0 190074 exit_group(0) = ? 190074 +++ exited with 0 +++ Some informations: uname -a Linux mailsrv01 2.6.32-696.23.1.el6.x86_64 #1 SMP Tue Mar 13 22:44:18 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux dovecot --version 2.3.1 (c5a5c0c82) dovecot -n # 2.3.1 (c5a5c0c82): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.devel (61b47828) # OS: Linux 2.6.32-696.23.1.el6.x86_64 x86_64 CentOS release 6.9 (Final) # Hostname: mailsrv01 auth_master_user_separator = * auth_verbose_passwords = sha1 default_client_limit = 2000 deliver_log_format = subject=%s from:%f sender:%e to: %{to_envelope} size:%p msgid=%m status=%$ delivery_time=%{delivery_time} session_time=%{session_time} disable_plaintext_auth = no doveadm_allowed_commands = quota get,dsync-server,kick,purge,fts rescan,altmove,mailbox list,expunge,mailbox status doveadm_password = # hidden, use -P to show it lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_rcpt_check_quota = yes login_greeting = IMAP4. login_trusted_networks = x.x.x.x/24 mail_fsync = never mail_gid = xxx mail_location = mdbox:~/mdbox:ALT=/altstorage%h/mdbox mail_plugins = quota quota_clone fts fts_solr zlib mail_uid = xxx managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vnd.dovecot .filter namespace inbox { inbox = yes list = yes location = mailbox "Itens Enviados" { auto = subscribe special_use = \Sent } mailbox "Itens Excluídos" { auto = subscribe special_use = \Trash } mailbox Rascunhos { auto = subscribe special_use = \Drafts } mailbox Spam { auto = subscribe special_use = \Junk } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = solr fts_solr = url=http://x.x.x.x:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/antispam/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/etc/dovecot/antispam/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = redis:host=x.x.x.x:port=6379 quota = count:User quota quota_clone_dict = redis:host=x.x.x.x:port=6379 quota_rule = *:bytes=0 quota_rule2 = Itens Excluídos:storage=+xM quota_vsizes = yes quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/audit.sieve sieve_before2 = /etc/dovecot/sieve/duplicate.sieve sieve_before3 = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/antispam sieve_plugins = sieve_imapsieve sieve_extprograms sieve_vacation_default_period = 7d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1h } protocols = imap pop3 lmtp sieve service anvil { client_limit = 2000 } service auth { client_limit = 2000 } service doveadm { inet_listener { port = 9011 } inet_listener http { port = 9010 } vsz_limit = 768 M } service imap-login { process_limit = 800 process_min_avail = 200 service_count = 1 vsz_limit = 512 M } service imap-postlogin { executable = script-login dovecot-postlogin imap unix_listener imap-postlogin { user = mail } user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 20000 vsz_limit = 768 M } service indexer-worker { vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = * port = 24 } vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 10 } service managesieve { process_limit = 512 } service pop3-postlogin { executable = script-login dovecot-postlogin pop3 unix_listener pop3-postlogin { user = mail } user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script quota-warning unix_listener quota-warning { user = mail } } service stats { chroot = empty client_limit = 20000 drop_priv_before_exec = no executable = stats extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats-reader { group = mode = 0600 user = } unix_listener stats-writer { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } ssl = no submission_host = x.x.x.x userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_plugins = quota quota_clone sieve } protocol imap { imap_max_line_length = 128 k mail_max_userip_connections = 30 mail_plugins = quota quota_clone fts fts_solr zlib imap_quota last_login imap_sieve } protocol lmtp { mail_fsync = optimized mail_plugins = quota quota_clone sieve } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = quota quota_clone fts fts_solr zlib last_login pop3_logout_format = in=%i out=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = yes pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } Regards, Ricardo

2 2

dovecot Digest, Vol 180, Issue 6
by SAAHIL IFTEKHAR 04 Apr '18

04 Apr '18

Repost ------------ Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit https://dovecot.org/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." Today's Topics: 1. Re: issue with sieve forwarding after upgrade to 0.5.1 (Stephan Bosch) 2. Use of separate storage for mail delivery (SAAHIL IFTEKHAR) 3. Re: issue with sieve forwarding after upgrade to 0.5.1 (B. Reino) 4. Re: issue with sieve forwarding after upgrade to 0.5.1 (Helmut K. C. Tessarek) 5. Re: issue with sieve forwarding after upgrade to 0.5.1 (Aki Tuomi) 6. Saving Drafts with Roundcube marks old Mails in INBOX as unread. (sk(a)tyrion.de) ---------------------------------------------------------------------- Message: 2 Date: Wed, 04 Apr 2018 04:45:49 +0000 From: SAAHIL IFTEKHAR <response2saahil(a)gmail.com> To: dovecot(a)dovecot.org Subject: Use of separate storage for mail delivery Message-ID: <CAM5TiAQgw5xQKFyDYYHpB_CxtgjH2+sF9A1DNOE-R5iKykLd2g(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi I am facing one issue which is mostly about concepts. I have to be clear on that to move forward. I have tried finding solutions about it but couldn't find anything which talks about it. We have a setup which includes postfix and dovecot. We are using lmtp and delivery of mail is happening through dovecot. We want that delivery of mail should happen in a separate node. I was able to achieve it through lmtp by providing ip address and using port 24. But now I have been asked to just try to deliver to a separate storage medium and not node. That means it will have an ip address but no dovecot or other software running. This is in relation to incorporation of storage area network (SAN) later on. Is it possible? I thought there must be some way as many running mail systems are using message store and SAN. All i can find that was close was mailbox sharing and email archiving. Please help me about this as I have already spent 3 days to it with no luck. I just want the right direction to move forward on this. Regards

1 0

Doveadm backup issues on dovecot 2.3.1
by Ricardo Machini Barbosa 04 Apr '18

04 Apr '18

Hello, After update dovecot from 2.3.0.1 to 2.3.1 the doveadm backup stopped to work. Command line: doveadm -D backup -u email(a)dominio.com.br -R tcp:mailsrv01:9011 I updated dovecot on mailsrv01 to 2.3.1. Process on mailsrv01 (the count message stop and process stay this way until be killed - this occurs on different mailboxs) dovecot/doveadm-server [10.0.10.5 email(a)dominio.com.br Cotacao Fornecedores export:6/86] Strace on this process: [pid 15644] epoll_wait(7, {}, 2, 4816) = 0 [pid 15644] epoll_wait(7, {}, 2, 5000) = 0 [pid 15644] close(22) = 0 [pid 15644] munmap(0x7f2927aeb000, 872) = 0 [pid 15644] close(25) = 0 [pid 15644] close(21) = 0 [pid 15644] munmap(0x7f2927aec000, 10744) = 0 [pid 15644] close(20) = 0 [pid 15644] munmap(0x7f2927ad4000, 37540) = 0 [pid 15644] close(23) = 0 [pid 15644] close(19) = 0 [pid 15644] close(11) = 0 [pid 15644] epoll_wait(7, {}, 2, 20174) = 0 Some informations: uname -a Linux mailsrv01 2.6.32-696.23.1.el6.x86_64 #1 SMP Tue Mar 13 22:44:18 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux dovecot --version 2.3.1 (c5a5c0c82) dovecot -n # 2.3.1 (c5a5c0c82): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.devel (61b47828) # OS: Linux 2.6.32-696.23.1.el6.x86_64 x86_64 CentOS release 6.9 (Final) # Hostname: mailsrv01 auth_master_user_separator = * auth_verbose_passwords = sha1 default_client_limit = 2000 deliver_log_format = subject=%s from:%f sender:%e to: %{to_envelope} size:%p msgid=%m status=%$ delivery_time=%{delivery_time} session_time=%{session_time} disable_plaintext_auth = no doveadm_allowed_commands = quota get,dsync-server,kick,purge,fts rescan,altmove,mailbox list,expunge,mailbox status doveadm_password = # hidden, use -P to show it lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_rcpt_check_quota = yes login_greeting = IMAP4. login_trusted_networks = x.x.x.x/24 mail_fsync = never mail_gid = xxx mail_location = mdbox:~/mdbox:ALT=/altstorage%h/mdbox mail_plugins = quota quota_clone fts fts_solr zlib mail_uid = xxx managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vnd.dovecot .filter namespace inbox { inbox = yes list = yes location = mailbox "Itens Enviados" { auto = subscribe special_use = \Sent } mailbox "Itens Excluídos" { auto = subscribe special_use = \Trash } mailbox Rascunhos { auto = subscribe special_use = \Drafts } mailbox Spam { auto = subscribe special_use = \Junk } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = solr fts_solr = url=http://x.x.x.x:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/antispam/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/etc/dovecot/antispam/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = redis:host=x.x.x.x:port=6379 quota = count:User quota quota_clone_dict = redis:host=x.x.x.x:port=6379 quota_rule = *:bytes=0 quota_rule2 = Itens Excluídos:storage=+xM quota_vsizes = yes quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/audit.sieve sieve_before2 = /etc/dovecot/sieve/duplicate.sieve sieve_before3 = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/antispam sieve_plugins = sieve_imapsieve sieve_extprograms sieve_vacation_default_period = 7d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1h } protocols = imap pop3 lmtp sieve service anvil { client_limit = 2000 } service auth { client_limit = 2000 } service doveadm { inet_listener { port = 9011 } inet_listener http { port = 9010 } vsz_limit = 768 M } service imap-login { process_limit = 800 process_min_avail = 200 service_count = 1 vsz_limit = 512 M } service imap-postlogin { executable = script-login dovecot-postlogin imap unix_listener imap-postlogin { user = mail } user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 20000 vsz_limit = 768 M } service indexer-worker { vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = * port = 24 } vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 10 } service managesieve { process_limit = 512 } service pop3-postlogin { executable = script-login dovecot-postlogin pop3 unix_listener pop3-postlogin { user = mail } user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script quota-warning unix_listener quota-warning { user = mail } } service stats { chroot = empty client_limit = 20000 drop_priv_before_exec = no executable = stats extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats-reader { group = mode = 0600 user = } unix_listener stats-writer { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } ssl = no submission_host = x.x.x.x userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_plugins = quota quota_clone sieve } protocol imap { imap_max_line_length = 128 k mail_max_userip_connections = 30 mail_plugins = quota quota_clone fts fts_solr zlib imap_quota last_login imap_sieve } protocol lmtp { mail_fsync = optimized mail_plugins = quota quota_clone sieve } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = quota quota_clone fts fts_solr zlib last_login pop3_logout_format = in=%i out=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = yes pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } Regards, Ricardo

2 2

issue with sieve forwarding after upgrade to 0.5.1
by Christos Chatzaras 04 Apr '18

04 Apr '18

Hello, After I upgrade dovecot 2.2.35 to 2.3.1 and pigeonhole 0.4.23 to 0.5.1 when I use sieve to forward a message to other address using "redirect :copy" I get this: (host server1.myserver.com <http://server1.myserver.com/>[private/dovecot-lmtp] said: 451 4.2.0 <chris(a)mydomain.com <mailto:chris@mydomain.com>> Execution of Sieve filters was aborted due to temporary failure (in reply to end of DATA command)) And in sieve log I see: failed to redirect message to <chris(a)mydomain.com <mailto:chris@mydomain.com>>: Sendmail program returned error (temporary failure). Any idea what is wrong? Kind regards, Christos Chatzaras

5 9

Saving Drafts with Roundcube marks old Mails in INBOX as unread.
by sk＠tyrion.de 04 Apr '18

04 Apr '18

Hello List, I have a problem with the client Roundcube. Whenever I save a draft to the Folder INBOX.Drafts a old mail in my INBOX will be marked as unread. Here are the IMAP Logs from Roundcube and Dovecot debug logs. I have no idea why it happens. The IMAP protocol looks normal to me but as you can see in the second to last line in the Dovecot log Dovecot is changing the flag of an old E-Mail in INBOX that has the same UID as the Mail that was just created in INBOX.Drafts. [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE XLIST +NAMESPACE METADATA QUOTA AUTH=PLAIN AUTH=LOGIN] CENSORED - ready. [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0001 ID ("name" "Roundcube" "version" "1.1.3" "php" "5.6.33" "os" "Linux" "command" "/?_task=mail&_unlock=loading1522741802861&_lang=de&_framed=1") [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * ID ("name" "Dovecot") [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0001 OK ID completed. [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0002 AUTHENTICATE PLAIN ****** [37] [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0002 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE XLIST +NAMESPACE METADATA QUOTA SPECIAL-USE QUOTA] Logged in [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0003 SETMETADATA NIL (0 "CLIENT_IP" 1 "X.X.X.X") [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0003 BAD Error in IMAP command SETMETADATA: METADATA disabled (0.000 + 0.000 secs). [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0004 LSUB "" INBOX.Drafts [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * LSUB (\Drafts) "." INBOX.Drafts [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0004 OK Lsub completed (0.000 + 0.000 secs). [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0005 LIST "" INBOX.Drafts [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * LIST (\HasNoChildren \Drafts) "." INBOX.Drafts [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0005 OK List completed (0.000 + 0.000 secs). [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0006 APPEND INBOX.Drafts (\Seen) {75743+} [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: MIME-Version: 1.0^M [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0006 OK [APPENDUID 1506921305 58] Append completed (0.001 + 0.042 secs). [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0007 SELECT INBOX [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft Junk $MDNSent) [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft Junk $MDNSent \*)] Flags permitted. [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * 682 EXISTS [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * 0 RECENT [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * OK [UNSEEN 48] First unseen. [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * OK [UIDVALIDITY 1506921304] UIDs valid [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * OK [UIDNEXT 881] Predicted next UID [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0007 OK [READ-WRITE] Select completed (0.000 + 0.000 secs). [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0008 UID STORE 58 -FLAGS.SILENT (\Seen) [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0008 OK Store completed (0.003 + 0.000 + 0.002 secs). [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] C: A0009 LOGOUT [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: * BYE Logging out [03-Apr-2018 09:50:03 +0200]: <6c472a00> [8095] S: A0009 OK Logout completed (0.000 + 0.000 secs). Apr 3 09:50:03 HOST dovecot: imap-login: Login: user=<USER_1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3272652, TLS, session=<MDhE9OxoTKl/AAAB> Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Loading modules from directory: /usr/lib/dovecot/modules Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Module loaded: /usr/lib/dovecot/modules/lib90_stats_plugin.so Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_stats_plugin.so Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Effective uid=5678, gid=345, home=/var/www/usermail/USER_1 Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Quota root: name=USER_1(soft quota) backend=fs args= Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Quota grace: root=USER_1(soft quota) bytes=0 (10%) Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir:CONTROL=/opt/dovecot/control/USER_1-control:INDEX=/opt/dovecot/index/USER_1 Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: maildir++: root=/var/www/usermail/USER_1/Maildir, index=/opt/dovecot/index/USER_1, indexpvt=, control=/opt/dovecot/control/USER_1-control, inbox=/var/www/usermail/USER_1/Maildir, alt= Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: fs quota add mailbox dir = /var/www/usermail/USER_1/Maildir Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: fs quota block device = /dev/sda2 Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: fs quota mount point = /storage Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: fs quota mount type = ext4 Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Quota root USER_1(soft quota): Recalculated relative rules with bytes=6291456000 count=0. Now grace=629145600 Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: quota: quota_over_flag check: STORAGE ret=1 value=2134020 limit=6144000 Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: quota: quota_over_flag=0((null)) vs currently overquota=0 Apr 3 09:50:03 HOST dovecot: imap(USER_1): save: box=INBOX.Drafts, uid=58, msgid=<8a36c2d8f5ce6f094789b39352cb4172(a)webmail-HOST.mailserver.tld>, size=74708, subject=unread test, flags=(\Seen) Apr 3 09:50:03 HOST dovecot: imap(USER_1): Debug: Mailbox INBOX: Opened mail UID=58 because: header Message-ID (Mail has other cached fields, reset_id=1506921306) Apr 3 09:50:03 HOST dovecot: imap(USER_1): flag_change: box=INBOX, uid=58, msgid=<CENSORED(a)CENSORED.TLD>, size=129564, subject=CENSORED SUBJECT, flags=() Apr 3 09:50:03 HOST dovecot: imap(USER_1): Logged out in=75975 out=1225 Information about dovecot: dovecot --version 2.2.27 (c0f36b0) dovecot -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.44-040944-generic x86_64 Debian 8.10 auth_mechanisms = plain login default_client_limit = 32000 default_process_limit = 8000 disable_plaintext_auth = no listen = * login_greeting = CENSORED - ready. mail_debug = yes mail_location = maildir:~/Maildir:CONTROL=/opt/dovecot/control/%n-control:INDEX=/opt/dovecot/index/%n mail_plugins = " stats quota mail_log notify" namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . } passdb { args = dovecot-%s driver = pam } plugin { cgroup_debug = false cgroup_path = /sys/fs/cgroup mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size subject flags quota = fs:%n(soft quota) sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = no stats_user_min_time = 24 hours } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { ssl = yes } } service imap-postlogin { executable = script-login /etc/dovecot/post-login/expire.sh } service imap { executable = imap imap-postlogin process_limit = 4096 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3-postlogin { executable = script-login /etc/dovecot/post-login/expire.sh } service pop3 { executable = pop3 pop3-postlogin } service quota-status { executable = quota-status -p postfix unix_listener /var/spool/postfix/private/quota { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0666 user = dovecot } } ssl_ca = </etc/ssl.crt/ca-admin.crt ssl_cert = </etc/ssl.crt/admin.crt ssl_cipher_list = ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:DHE-DSS-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA:AES256-GCM-SHA384:AES256-SHA256:AES256-SHA ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } protocol imap { imap_capability = +XLIST +NAMESPACE METADATA QUOTA imap_idle_notify_interval = 1 mins mail_max_userip_connections = 500 mail_plugins = " stats quota mail_log notify imap_quota imap_stats" } protocol pop3 { mail_max_userip_connections = 500 mail_plugins = " stats quota mail_log notify" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh }

3 2

Use of separate storage for mail delivery
by SAAHIL IFTEKHAR 04 Apr '18

04 Apr '18

Hi I am facing one issue which is mostly about concepts. I have to be clear on that to move forward. I have tried finding solutions about it but couldn't find anything which talks about it. We have a setup which includes postfix and dovecot. We are using lmtp and delivery of mail is happening through dovecot. We want that delivery of mail should happen in a separate node. I was able to achieve it through lmtp by providing ip address and using port 24. But now I have been asked to just try to deliver to a separate storage medium and not node. That means it will have an ip address but no dovecot or other software running. This is in relation to incorporation of storage area network (SAN) later on. Is it possible? I thought there must be some way as many running mail systems are using message store and SAN. All i can find that was close was mailbox sharing and email archiving. Please help me about this as I have already spent 3 days to it with no luck. I just want the right direction to move forward on this. Regards

1 0