- dovecot - dovecot.org

Dovecot Index Corruption and dovecot-uidlist Issues
by Billy Luedtke 25 Oct '19

25 Oct '19

Hello, We have recently implemented dovecot directors to resolve an ongoing NFS lock/corruption issue. Everything was working great! So we updated our servers from centos 7.3 to 7.7 and dovecot 2.2.10 to 2.3.8 This was a bit of a failure and we were getting spammed with corrupt index files and logs. After we clear the index files with rm rf/mail/d/e/username/Maildir/dovecot*, they just come back in. From: dovecot-mysql-2.3.8-4.x86_64 dovecot-2.3.8-4.x86_64 dovecot-pigeonhole-2.3.8-4.x86_64 To: dovecot-2.2.10-8.el7.x86_64 dovecot-mysql-2.2.10-8.el7.x86_64 dovecot-pigeonhole-2.2.10-8.el7.x86_64 We rolled back nfs-utils and libs due to a case on redhats bug report "https://bugzilla.redhat.com/show_bug.cgi?id=1521071" libnfsidmap-0.25-19.el7.x86_64 nfs-utils-1.3.0-0.65.el7.x86_64 to libnfsidmap-0.25-15.el7.x86_64 nfs-utils-1.3.0-0.33.el7.x86_64 We rolled back our dovecot version to 2.2.10 and are still getting the following logs. Any advice would help Network view: |Dovecot Directors x 3| | |Dovecot servers x4| Storage is shared between all 4 servers | |Netapp NFSv3 Storage| Nothing changed here Oct 25 01:33:25 <IP> dovecot: imap(<username>): Error: Log synchronization error at seq=89,offset=32340 for /mail/j/k/<username>/Maildir/dovecot.index: Extension record update for invalid uid=6798 Oct 25 01:33:25 <IP> dovecot: imap(<username>): Error: Log synchronization error at seq=89,offset=32384 for /mail/j/k/<username>/Maildir/dovecot.index: Extension record update for invalid uid=6798 Oct 25 01:33:25 <IP> dovecot: imap(<username>): Error: Synchronization corrupted index header /mail/j/k/<username>/Maildir/dovecot.index: first_recent_uid 6799 > next_uid 6798 Oct 25 01:33:25 <IP> dovecot: imap(<username>): Warning: fscking index file /mail/j/k/<username>/Maildir/dovecot.index Oct 25 01:33:25 <IP> dovecot: imap(<username>): Error: Fixed index file /mail/j/k/<username>/Maildir/dovecot.index: first_recent_uid 6799 -> 6798 Oct 25 01:33:26 <IP> dovecot: imap(<username>): Error: Broken file /mail/j/k/<username>/Maildir/dovecot-uidlist line 6461: Invalid data: Oct 25 01:33:26 <IP> dovecot: imap(<username>): Error: Log synchronization error at seq=89,offset=32488 for /mail/j/k/<username>/Maildir/dovecot.index: Append with UID 6798, but next_uid = 6799 Oct 25 01:33:26 <IP> dovecot: imap(<username>): Warning: fscking index file /mail/j/k/<username>/Maildir/dovecot.index Oct 25 01:47:14 <IP> dovecot: imap(<username>): Warning: fscking index file /mail/d/e/<username>/Maildir/dovecot.index Oct 25 01:47:14 <IP> dovecot: imap(<username>): Error: Failed to map transaction log /mail/d/e/<username>/Maildir/dovecot.index.log at sync_offset=9900 after locking: pread() failed: Stale file handle Oct 25 01:47:14 <IP> dovecot: imap(<username>): Error: Index /mail/d/e/<username>/Maildir/dovecot.index: Lost log for seq=16 offset=192: Missing middle file seq=16 (between 16..4294967295, we have seqs 14): Requested newer log than exists: Log inode is unchanged (initial_mapped=1, reason=Index mapped) Oct 25 01:51:14 <IP> dovecot: imap(<username>): Error: Broken file /mail/d/e/<username>/Maildir/dovecot-uidlist line 65: Invalid data: Dovecot -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1062.1.2.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no first_valid_uid = 300 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /mail/sieve/global/ sieve_global_path = /mail/sieve/default.sieve } postmaster_address = postmaster@%d protocols = imap pop3 lmtp sieve service auth { client_limit = 0 inet_listener { port = 11010 } process_limit = 1 process_min_avail = 0 service_count = 0 } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 2 process_min_avail = 2 service_count = 0 } service imap { client_limit = 1 executable = imap process_limit = 2048 process_min_avail = 50 service_count = 1 } service lmtp { client_limit = 1 process_limit = 0 process_min_avail = 0 service_count = 0 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 2 process_min_avail = 2 service_count = 0 } service pop3 { client_limit = 1 executable = pop3 process_limit = 256 process_min_avail = 25 service_count = 1 } ssl_ca = </etc/ssl/mdc/mdc.ca ssl_cert = </etc/ssl/mdc/mdc.crt ssl_cipher_list = !RC4:HIGH:MEDIUM:+TLSv1:!MD5:!SSLv2:+SSLv3:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM ssl_key = </etc/ssl/mdc/mdc.key ssl_protocols = !SSLv2 !SSLv3 userdb { args = /etc/dovecot/sql.conf.ext driver = sql override_fields = plain_pass=%w } protocol lmtp { mail_plugins = " quota sieve" } protocol imap { mail_max_userip_connections = 40 } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } Billy Luedtke, Microsoft MCP System Administrator II, WIN

1 0

subscription namespace
by Daniel Miller 25 Oct '19

25 Oct '19

The current documentation makes mention of a "special" subscription namespace. The example given: namespace subscriptions { subscriptions = yes prefix = "" list = no hidden = yes } namespace inbox { inbox = yes location = subscriptions = no [...] results in a startup error as both namespaces have the same prefix. Was the intent for the "inbox" namespace to have an explicit "INBOX/" prefix? If this is configured for an existing server that previously had no such "INBOX/" prefix namespace - will clients need to be reconfigured? -- Daniel

1 0

Still trying to get past authorization problems
by Steve Matzura 24 Oct '19

24 Oct '19

Got all the Postfix errors fixed but maybe one, so I don't think that's involved in this mix any more. I had a domain definition problem, got that sorted. The accounts' logins are correct. I tried several from the shell, and they let me in. Here's the minus-n output, not very different from the first time I posted it: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-64-generic x86_64 Ubuntu 18.04.3 LTS ext4 base_dir = /var/run/dovecot/ first_valid_gid = 109 first_valid_uid = 105 last_valid_gid = 109 last_valid_uid = 105 log_path = /var/log/dovecot.log mail_gid = postfix mail_location = maildir:/var/mail/vmail/%d/%n mail_uid = postfix namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap lmtp" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service lmtp { unix_listener lmtp { mode = 0666 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 1024 } ssl = required ssl_cert = </etc/ssl/private/tgv2018.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd } These from dovecot.log just keep going round and round. Oct 24 02:23:57 imap-login: Info: Aborted login (auth failed, 1 attempts in 3 secs): user=<chrissie(a)theglobalvoice.info>, method=PLAIN, rip=86.148.44.160, lip=95.142.174.193, TLS, session=<7SCVuZ6VScBWlCyg> Oct 24 02:25:55 imap-login: Info: Disconnected (auth failed, 2 attempts in 132 secs): user=<yourvoice(a)theglobalvoice.info>, method=PLAIN, rip=108.41.57.11, lip=95.142.174.193, TLS, session=<ZErquJ6VpMpsKTkL> Oct 24 02:25:55 imap-login: Info: Disconnected (auth failed, 2 attempts in 132 secs): user=<yourvoice(a)theglobalvoice.info>, method=PLAIN, rip=108.41.57.11, lip=95.142.174.193, TLS, session=<6bnquJ6VpcpsKTkL> Oct 24 02:57:58 imap-login: Info: Disconnected (auth failed, 4 attempts in 43 secs): user=<yourvoice(a)theglobalvoice.info>, method=PLAIN, rip=108.41.57.11, lip=95.142.174.193, TLS, session=<CRHUMJ+V59JsKTkL> Oct 24 03:06:23 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=49.51.34.136, lip=95.142.174.193, session=<jGWJUZ+VAM8xMyKI> Oct 24 03:06:24 imap-login: Info: Disconnected: Too many invalid commands (no auth attempts in 0 secs): user=<>, rip=49.51.34.136, lip=95.142.174.193, session=<agCMUZ+V8JMxMyKI> Oct 24 03:07:55 imap-login: Info: Disconnected (auth failed, 2 attempts in 13 secs): user=<yourvoice(a)theglobalvoice.info>, method=PLAIN, rip=108.41.57.11, lip=95.142.174.193, TLS, session=<ivc4Vp+V79VsKTkL>

3 3

RE: dovecot disk space settings
by Marc Roos 22 Oct '19

22 Oct '19

Ok, what about placing a dummy file of 5GB or so on the partition, that you can remove when necessary? -----Original Message----- Subject: Re: dovecot disk space settings >> I don't want to restrict each mailbox size. It's just to prevent > running out space completely. > > Why? (If I may ask) > > To provide mailboxes with unlimited space. And to make it easier to administrate. My question is about an emergency option if someone has forgotten to migrate to new hardware. It's possible but a bit harder if the partition is out of space and there is no free byte left. Best, Marcel

4 3

dovecot.conf from problem installation
by Steve Matzura 22 Oct '19

22 Oct '19

*** dovecot.conf *** ## Dovecot configuration file # If you're in a hurry, see http://wiki2.dovecot.org/QuickConfiguration # "doveconf -n" command gives a clean output of the changed settings. Use it # instead of copy&pasting files when posting to the Dovecot mailing list. # '#' character and everything after it is treated as comments. Extra spaces # and tabs are ignored. If you want to use either of these explicitly, put the # value inside quotes, eg.: key = "# char and trailing whitespace " # Most (but not all) settings can be overridden by different protocols and/or # source/destination IPs by placing the settings inside sections, for example: # protocol imap { }, local 127.0.0.1 { }, remote 10.0.0.0/8 { } # Default values are shown for each setting, it's not required to uncomment # those. These are exceptions to this though: No sections (e.g. namespace {}) # or plugin settings are added by default, they're listed only as examples. # Paths are also just examples with the real defaults being based on configure # options. The paths listed here are for configure --prefix=/usr # --sysconfdir=/etc --localstatedir=/var # Enable installed protocols !include_try /usr/share/dovecot/protocols.d/*.protocol # A comma separated list of IPs or hosts where to listen in for connections. # "*" listens in all IPv4 interfaces, "::" listens in all IPv6 interfaces. # If you want to specify non-default ports or anything more complex, # edit conf.d/master.conf. #listen = *, :: # Base directory where to store runtime data. #base_dir = /var/run/dovecot/ # Name of this instance. In multi-instance setup doveadm and other commands # can use -i <instance_name> to select which instance is used (an alternative # to -c <config_path>). The instance name is also added to Dovecot processes # in ps output. #instance_name = dovecot # Greeting message for clients. #login_greeting = Dovecot ready. # Space separated list of trusted network ranges. Connections from these # IPs are allowed to override their IP addresses and ports (for logging and # for authentication checks). disable_plaintext_auth is also ignored for # these networks. Typically you'd specify your IMAP proxy servers here. #login_trusted_networks = # Space separated list of login access check sockets (e.g. tcpwrap) #login_access_sockets = # With proxy_maybe=yes if proxy destination matches any of these IPs, don't do # proxying. This isn't necessary normally, but may be useful if the destination # IP is e.g. a load balancer's IP. #auth_proxy_self = # Show more verbose process titles (in ps). Currently shows user name and # IP address. Useful for seeing who are actually using the IMAP processes # (eg. shared mailboxes or if same uid is used for multiple accounts). #verbose_proctitle = no # Should all processes be killed when Dovecot master process shuts down. # Setting this to "no" means that Dovecot can be upgraded without # forcing existing client connections to close (although that could also be # a problem if the upgrade is e.g. because of a security fix). #shutdown_clients = yes # If non-zero, run mail commands via this many connections to doveadm server, # instead of running them directly in the same process. #doveadm_worker_count = 0 # UNIX socket or host:port used for connecting to doveadm server #doveadm_socket_path = doveadm-server # Space separated list of environment variables that are preserved on Dovecot # startup and passed down to all of its child processes. You can also give # key=value pairs to always set specific settings. #import_environment = TZ ## ## Dictionary server settings ## # Dictionary can be used to store key=value lists. This is used by several # plugins. The dictionary can be accessed either directly or though a # dictionary server. The following dict block maps dictionary names to URIs # when the server is used. These can then be referenced using URIs in format # "proxy::<name>". dict { #quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext #expire = sqlite:/etc/dovecot/dovecot-dict-sql.conf.ext } # Most of the actual configuration gets included below. The filenames are # first sorted by their ASCII value and parsed in that order. The 00-prefixes # in filenames are intended to make it easier to understand the ordering. !include conf.d/*.conf # A config file can also tried to be included without giving an error if # it's not found: !include_try local.conf log_path = /var/log/dovecot.log passdb { driver = static args = noauthenticate temp_user=%u user=%Ln } passdb { driver = pam } passdb { driver = static args = noautenticate user=%{passdb:temp_user} skip = unauthenticated } *** End *** If I try to start the daemon, or even attempt 'dovecot -n output', I get: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 107: Expecting '{' Line 107 is where the first passdb block begins. If I remove the three passdb blocks--everything below line 106--I get a clean startup, but the log looks like this: *** Begin *** Oct 22 12:22:04 auth-worker(13722): Info: pam(yourvoice(a)theglobalvoice.info,108.41.57.11,<BXn+2H6VKelsKTkL>): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: redacted) Oct 22 12:22:06 auth: Debug: client passdb out: FAIL 1 user=yourvoice(a)theglobalvoice.info Oct 22 12:22:06 auth: Debug: client in: AUTH 2 PLAIN service=imap secured session=BXn+2H6VKelsKTkL lip=95.142.174.193 rip=108.41.57.11 lport=993 rport=59689 local_name=mail.theglobalvoice.info resp=AHlvdXJ2b2ljZUB0aGVnbG9iYWx2b2ljZS5pbmZvAFRoJEJvYTQxMFlu (previous base64 data may contain sensitive data) Oct 22 12:22:10 auth-worker(13722): Debug: pam(yourvoice(a)theglobalvoice.info,108.41.57.11,<BXn+2H6VKelsKTkL>): lookup service=dovecot Oct 22 12:22:10 auth-worker(13722): Debug: pam(yourvoice(a)theglobalvoice.info,108.41.57.11,<BXn+2H6VKelsKTkL>): #1/1 style=1 msg=Password: Oct 22 12:22:12 auth-worker(13722): Info: pam(yourvoice(a)theglobalvoice.info,108.41.57.11,<BXn+2H6VKelsKTkL>): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: redacted) Oct 22 12:22:14 auth: Debug: client passdb out: FAIL 2 user=yourvoice(a)theglobalvoice.info Oct 22 12:22:14 imap-login: Debug: SSL alert: close notify [108.41.57.11] Oct 22 12:22:14 imap-login: Debug: SSL alert: close notify [108.41.57.11] Oct 22 12:22:14 imap-login: Info: Disconnected (auth failed, 2 attempts in 12 secs): user=<yourvoice(a)theglobalvoice.info>, method=PLAIN, rip=108.41.57.11, lip=95.142.174.193, TLS, session=<BXn+2H6VKelsKTkL>

1 0

dovecot disk space settings
by marcel bendler 22 Oct '19

22 Oct '19

Hi, is there an option to leave some disk space free? Let's say, don't store new mails if the storage mount point has less than 1% free disk space. What's the way to go? I don't want to restrict each mailbox size. It's just to prevent running out space completely. Thanks! Best regards, Marcel

4 3

More on problems with new install
by Steve Matzura 22 Oct '19

22 Oct '19

Sorry for having lost the original chain of this problem. It's been a very long day. New output from 'dovecot -n output', including the contents of dovecot.conf, conf.d/10-master.conf, conf.d/10-mail.conf and conf.d/10-ssl.conf: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-64-generic x86_64 Ubuntu 18.04.3 LTS ext4 auth_debug = yes auth_debug_passwords = yes first_valid_gid = 109 first_valid_uid = 105 last_valid_gid = 109 last_valid_uid = 105 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = postfix mail_location = maildir:/var/mail/vmail/%d/%n mail_uid = postfix namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap lmtp" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service lmtp { unix_listener lmtp { mode = 0666 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 1024 } ssl = required ssl_cert = </etc/ssl/private/tgv2018.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd } verbose_ssl = yes The two key files are where it says they are, although the hidden one isn't shown, it's there and properly owned and permissioned. Here's the only thing from tailing the log: Oct 22 07:24:50 master: Info: Dovecot v2.2.33.2 (d6601f4ec) starting up for imap, lmtp (core dumps disabled) This may help - from a message delivery failure email: *** Begin *** Message Delivery Failure This is an automatically generated Delivery Status Notification. Delivery to the following recipients failed permanently: * rock(a)theglobalvoice.info Reason: There was an error while attempting to deliver your message with [Subject: "Testing again"] to rock(a)theglobalvoice.info. MTA p3plsmtpa11-09.prod.phx3.secureserver.net received this response from the destination host IP - 95.142.174.193 - 550 , 550 5.1.1 <rock(a)theglobalvoice.info>: Recipient address rejected: User unknown in local recipient table . Reporting-MTA: dns; p3plsmtpa11-09.prod.phx3.secureserver.net [68.178.252.101] Received-From-MTA: dns; [192.168.1.140] [108.41.57.11] Arrival-Date: Mon, 21 Oct 2019 23:39:25 -0700 Final-recipient: rfc822; rock(a)theglobalvoice.info Diagnostic-Code: smtp; 550 5.1.1 <rock(a)theglobalvoice.info>: Recipient address rejected: User unknown in local recipient table Last-attempt-Date: Tue, 22 Oct 2019 00:23:38 -0700 Received: from [192.168.1.140] ([108.41.57.11]) by :SMTPAUTH: with ESMTPSA id MnpFiaSdxUnHgMnpFiYE6m; Mon, 21 Oct 2019 23:39:25 -0700 To: rock(a)theglobalvoice.info From: Steve Matzura <number6(a)noisynotes.com> Subject: Testing again Message-ID: <61b4f0c2-89fa-c4de-8288-871a8708f2d0(a)noisynotes.com> Date: Tue, 22 Oct 2019 02:39:26 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-CMAE-Envelope: MS4wfC8H5kkZhXB1zicGDqvcQlC1Tl3lMTOcElvh0Efz70YGRgQalgb4N6/9XVLjnqOVd5XtxwgTWuvuCEhwp/JZ2oHrdLkl4d7unSyOefbSkgcd/M5tlQn5 m+FMjUC5HJopO89WJXHQNp0ruK6VmVwHwxMAn0YDVu4FQQqVIUkN6KVyOfdC/TYD6t6vxOqv2OUxKQ== Subject: Testing again From: Steve Matzura <number6(a)noisynotes.com> Date: 10/22/2019, 2:39 AM To: rock(a)theglobalvoice.info Let's see what happens now. *** End *** There is no user 'rock', it's just a Postfix mailbox.

2 6

Problems with new installation
by Steve Matzura 22 Oct '19

22 Oct '19

I had Dovecot running very well on Ubuntu 14.04. Then I decided that since That version of Ubuntu was now out of support, I would build a new server on 18.04, which has been done. I thought I could take the old dovecot.conf and everything in conf.d that had been customized and drop it in place, and everything would just work. That has proven not to be correct. The files that had been edited were the main /etc/dovecot/dovecot.conf, and in conf.d, 10-master.conf, 10-ssl.conf, and 10-mail.conf. I have restored the original package-supplied versions of these files and restarted Dovecot, but still no one can connect. Here's my configuration, with the version number at the top: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-64-generic x86_64 Ubuntu 18.04.3 LTS auth_debug = yes auth_debug_passwords = yes mail_debug = yes mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap lmtp" userdb { driver = passwd } verbose_ssl = yes The edits that were made to the aforementioned files were not actually done by me, so I can't explain why certain choices were made, except for obvious ones such as SSL key paths. But I figured the system should work at least on a vanilla configuration. Postfix is also involved in this, so the problems may not at all be with Dovecot, but with Postfix. I think I just need to draw the line between them and be able to know definitely that at least one half of the system is functioning correctly so I know I can mark that part as working, and proceed with debugging the other. My bet at this point is that it's not a Dovecot problem, but I'm not clear on how to determine this, with or without my changed files. Thanks in advance.

2 1

Dovecot v2.3.8 released
by Aki Tuomi 20 Oct '19

20 Oct '19

https://dovecot.org/releases/2.3/dovecot-2.3.8.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.8.tar.gz.sig Binary packages in https://repo.dovecot.org/ Changes + Added mail_delivery_started and mail_delivery_finished events, see https://doc.dovecot.org/admin_manual/list_of_events/ for details. + dsync-replication: Don't replicate users who have "noreplicate" extra field in userdb. + doveadm service status: Show total number of processes created. + When logging to syslog, use instance_name setting's value for the ident. This commonly is added as a log prefix. + Base64 encoding/decoding code was rewritten with additional features. It shouldn't cause any user visible changes. - v2.3.7 regression: If a folder only receives new mails without any other mail access, dovecot.index.log keeps growing forever and dovecot.index keeps being rewritten for every mail delivery. - dsync-replication may lose keywords after syncing mails restored from another replica. This only happened if the mail only had keywords and no system flags. - event filters: Non-textual event fields could not be filtered using wildcards. - auth: Scope parameter was missing from OAuth password grant request. - doveadm client-server communication may hang in some situations. It is also using unnecessarily small TCP/IP packet sizes. - doveadm who and kick did not flush protocol output correctly. - imap: SETMETADATA with literal value would delete the metadata value instead of updating it. - imap: When client issues FETCH PREVIEW (LAZY=FUZZY) command, the caching decisions should be updated so that newly saved mails will have the preview cached. - With mail_nfs_index=yes and/or mail_nfs_storage=yes setuid/setgid permission bits in some files may have become dropped with some NFS servers. Changed NFS flushing to now use chmod() instead of chown(). - quota: warnings did not work if quota root was noenforcing - acl: Global ACL file ignored the last line if it didn't end with LF. - doveadm stats dump: With JSON formatter output numbers using the number type instead of as strings - lmtp_proxy: Ensure that real_* variables are correctly set when using lmtp_proxy. - event exporter: http-post driver had hardcoded timeout and did not support DNS lookups or TLS connections. - auth: Fix user iteration to work with userdb passwd with glibc v2.28. - auth: auth service can crash if auth-policy JSON response is invalid or returned too fast. - In some rare situations "ps" output could have shown a lot of "?" characters after Dovecot process titles. - When dovecot.index.pvt is empty, an unnecessary error is logged: Error: .../dovecot.index.pvt reset, view is now inconsistent - SMTP address encoder duplicated initial double quote character when the localpart of an address ended in '..'. For example "user+..(a)example.com" became ""user+.."@example.com in a sieve redirect. --- Aki Tuomi Open-Xchange Oy

5 9

BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
by Alex Ha 20 Oct '19

20 Oct '19

Hi all! I have two dovecot servers with dsync replication over tcp. Replication works fine except for one user. # doveadm replicator status username priority fast sync full sync success sync failed customer(a)example.com none 00:00:33 07:03:23 03:22:31 y If i run dsync manually, i get the following error message: dsync-local(customer(a)example.com): Debug: brain M: -- Mailbox renamed, restart sync -- dsync-local(customer(a)example.com): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting dsync-local(customer(a)example.com): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.' For more info see the attached sync_loop.log Thanks for your help, Alex

3 5

Coredump v2.3.8 specific msg fetch, corrupted record in index cache, Broken physical size
by Erik de Waard 20 Oct '19

20 Oct '19

Hi, i'm getting a coredump on a specific msg, i've attached the gdb. file on disk i noticed W=<vsize> is missing. 1571209735.M744550P1608.rwvirtual65,S=15886:2,S Best regards, mail.log Oct 18 14:41:39 rwvirtual10 dovecot: imap(johndoe(a)company.nl)<15868><qjTFpy6VPsMKAAok>: Error: Mailbox INBOX.Debug: UID=1041: read(/data/mail/ company.nl/users/johndoe/Maildir/.Debug/cur/1571209735.M744550P1608.rwvirtual65,S=15886:2,S) failed: Cached message size smaller than expected (15886 < 16367, box=INBOX.Debug, UID=1041) (read reason=mail stream) Oct 18 14:41:39 rwvirtual10 dovecot: imap(johndoe(a)company.nl)<15868><qjTFpy6VPsMKAAok>: Error: Corrupted record in index cache file /data/indexes/ johndoe(a)company.nl/.Debug/dovecot.index.cache: UID 1041: Broken physical size in mailbox INBOX.Debug: read(/data/mail/ company.nl/users/johndoe/Maildir/.Debug/cur/1571209735.M744550P1608.rwvirtual65,S=15886:2,S) failed: Cached message size smaller than expected (15886 < 16367, box=INBOX.Debug, UID=1041) Oct 18 14:41:39 rwvirtual10 dovecot: imap(johndoe(a)company.nl)<15868><qjTFpy6VPsMKAAok>: Panic: file istream.c: line 315 (i_stream_read_memarea): assertion failed: (old_size <= _stream->pos - _stream->skip) Oct 18 14:41:39 rwvirtual10 dovecot: imap(johndoe(a)company.nl)<15868><qjTFpy6VPsMKAAok>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe5c31) [0x7f5237d8cc31] -> /usr/lib/dovecot/libdovecot.so.0(+0xe5cd1) [0x7f5237d8ccd1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f5237ce4103] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x300) [0x7f5237d9abd0] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x35) [0x7f5237d9aca5] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f5237d9b64d] -> /usr/lib/dovecot/libdovecot.so.0(+0xc4da1) [0x7f5237d6bda1] -> /usr/lib/dovecot/libdovecot.so.0(+0xc5d4b) [0x7f5237d6cd4b] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x65) [0x7f5237d6da05] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_body+0x31) [0x7f5237d6dcf1] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xc19d4) [0x7f52381099d4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x3aa) [0x7f5238109e9a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x74b25) [0x7f52380bcb25] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream_because+0x70) [0x7f52380833a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x748d7) [0x7f52380bc8d7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_virtual_size+0x44) [0x7f5238082ea4] -> dovecot/imap [johndoe(a)company.nl 10.0.10.36 FETCH](+0x21523) [0x561f6425f523] -> dovecot/imap [johndoe(a)company.nl 10.0.10.36 FETCH](+0x1f759) [0x561f6425d759] -> dovecot/imap [ johndoe(a)company.nl 10.0.10.36 FETCH](imap_fetch_more+0x39) [0x561f6425eb99] -> dovecot/imap [johndoe(a)company.nl 10.0.10.36 FETCH](cmd_fetch+0x342) [0x561f6424ef32] -> dovecot/imap [johndoe(a)company.nl 10.0.10.36 FETCH](command_exec+0x7c) [0x561f6425bb0c] -> dovecot/imap [ johndoe(a)company.nl 10.0.10.36 FETCH](+0x1bb72) [0x561f64259b72] -> dovecot/imap [johndoe(a)company.nl 10.0.10.36 FETCH](+0x1bc04) [0x561f64259c04] -> dovecot/imap [johndoe(a)company.nl 10.0.10.36 FETCH](client_handle_input+0x1a5) [0x561f6425a025] -> dovecot/imap [ johndoe(a)company.nl 10.0.10.36 FETCH](client_input+0x82) [0x561f6425a6c2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x75) [0x7f5237da6845] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x11b) [0x7f5237da825b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x59) [0x7f5237da6959] Oct 18 14:41:39 rwvirtual10 dovecot: imap(johndoe(a)company.nl)<15868><qjTFpy6VPsMKAAok>: Fatal: master: service(imap): child 15868 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps)

2 2

dovecot 2.3.7.2-1~bionic: Performance issues caused by excessive IO to ~/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.tmp
by Ralf Hildebrandt 16 Oct '19

16 Oct '19

I set up system copying all mails to a backup system. This used to work without a hitch - now in the last few days mails would pile up in the Postfix Queue, waiting to be delivered using the lmtp transport into dovecot. So dovecot was being slow, but why? After all, nothing changed. After reading some articles on stackoverflow I found a way of finding out which file gets the most IO: % sysdig -c topfiles_bytes; This command quickly pointed to ~/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.tmp That file was written excessively. I then put ~/mdbox/mailboxes/INBOX/dbox-Mails/ into tmpfs and alas, the queue would drain quickly. But why is that? Why would the index file be updated so often? This is dovecot 2.3.7.2-1~bionic # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # OS: Linux 5.0.0-29-generic x86_64 Ubuntu 18.04.3 LTS default_vsz_limit = 2 G lmtp_user_concurrency_limit = 10000 mail_attachment_dir = /home/copymail/attachments mail_attachment_hash = %{sha256} mail_fsync = never mail_location = mdbox:~/mdbox mail_plugins = zlib fts fts_lucene mdbox_rotate_size = 128 M namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = username_format=%u /etc/dovecot/passwd driver = passwd-file } plugin { fts = lucene fts_languages = de,en fts_lucene = whitespace_chars=@. } protocols = " imap lmtp" service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 10.0.5.208 port = 1025 } process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_ca = /etc/ssl/certs/ca-certificates.crt ssl_cert = </etc/ssl/certs/mail-cbf.pem ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = username_format=%u /etc/dovecot/passwd driver = passwd-file } protocol lmtp { mail_plugins = zlib fts fts_lucene } -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

3 9

Vacation Fcc
by Gregory Heytings 14 Oct '19

14 Oct '19

Hi list, I use Dovecot's Pigeonhole Sieve implementation, and there is one little feature I'm missing: When a vacation message is sent, I'd like to keep a copy of that message in my "sent" mailbox. There is an RFC draft (draft-ietf-extra-sieve-fcc-09) for this, which adds a ":fcc" argument to vacation, but apparently it's not supported by Pigeonhole. I have two questions: Will ":fcc" be supported in the future? In the meantime (or if supporting ":fcc" is not planned), is it possible to achieve the same result with the existing Sieve extensions? (I can imagine a way to do this at the MTA level by checking the presence of the "Auto-Submitted:" header, but did not test it.) Thanks, Gregory

2 3

Sieve replication - Debian 9.11 - Dovecot 2.2.7 - script changes not replicated
by Daniel Botting 14 Oct '19

14 Oct '19

Hi, I am trying to setup Sieve replication, it is almost working: 1/ Create a script - sync'd across 2/ Activate/de-activate a script - change sync'd 3/ Delete a script - change sync'd But if I make a change to a script it is not replicated, unless I de-activate and activate again. I am seeing in the logs the below during this process (de-activating/activating): Oct 9 17:01:39 hostname dovecot: dsync-local(a_user): Debug: doveadm-sieve: Iterating Sieve mailbox attribute: vendor/vendor.dovecot/pvt/server/sieve/files/0910-active-1640 Oct 9 17:01:39 hostname dovecot: dsync-local(a_user): Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/default' (last change: 2019-10-09 17:01:37) # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-3-amd64 x86_64 Debian 9.11 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes default_vsz_limit = 0 doveadm_password = # hidden, use -P to show it first_valid_gid = 8 first_valid_uid = 8 last_valid_gid = 8 last_valid_uid = 8 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes mail_gid = 8 mail_location = maildir:~/Maildir mail_plugins = " notify replication" mail_uid = 8 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader imapflags namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcps:replication_server_url:port_number sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +editheader +imapflags } protocols = " imap sieve pop3" replication_max_conns = 4 service aggregator { fifo_listener replication-notify-fifo { user = mail } unix_listener replication-notify { user = mail } } service auth { unix_listener /var/run/dovecot-exim-bridge { mode = 0660 user = Debian-exim } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 512 process_min_avail = 4 service_count = 1 } service imap { process_limit = 1024 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 8 vsz_limit = 256 M } service managesieve { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </path/certs/a_domain/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap override_fields = home=/var/mail/%u uid=mail gid=mail } verbose_ssl = yes protocol lda { mail_plugins = " notify replication sieve" } protocol imap { mail_max_userip_connections = 32 mail_plugins = " notify replication" } protocol sieve { mail_max_userip_connections = 10 managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 } Kind regards -- Daniel Botting

2 1

Password issue
by ＠lbutlr 13 Oct '19

13 Oct '19

One of my accounts was having login failures when trying to send mail, but was able to check mail. I tried everything I could think of to see what the issue might be, but eventually went in and reset the password in the sql database (I knew the password, so I reset it to the same password). {SHA256-CRYPT}$5$VuS… {SHA256-CRYPT}$5$VI7… So the password was updated properly. Clients can still login to check mail, but are failing to send mail, so the password was not the issue. First, logins in to check mail and succeeds > Oct 09 16:02:16 imap-login: Info: Login: user=<myuser(a)covisp.net>, xx.xx.xx.xx, PLAIN, TLS Sends device MUA info > Oct 09 16:02:16 imap(myuser(a)covisp.net)<84553><bP4acIGUJttJDqGg>: Info: ID sent: name=iPad Mail, version=17A860, os=iOS, os-version=13.1.2 (17A860) Fails to send mail > Oct 09 16:02:50 imap-login: Info: Aborted login (auth failed, 5 attempts in 33 secs): user=<myuser(a)covisp.net>, xx.xx.xx.xx, PLAIN, TLS Postfix logs "Client host rejected: Access denied” but as I said, other accounts can submit and there’s nothing special in the submission service in master.cf. Passwords are all copied/pasted so identical in both IMAP (p993) and SMTP (p587) settings. Settings for the SMTP server are identical to the other accounts using the same server. I don’t know how to login to IMAP via the openssl command line interface, but this is what happens when I login to the submission port.  % openssl s_client -connect mail.covisp.net:587 -starttls smtp … auth login 334 VXNlcm5hbWU6 base64(username)= 334 UGFzc3dvcmQ6 base64(pasword)= DONE (Same results without the terminating ‘=‘) I’m sure I am missing something really obvious? -- Lithium will no longer be available on credit

6 12

Error: SSL_accept() syscall failed
by C. James Ervin 11 Oct '19

11 Oct '19

In setting up my new mail server, I am getting the following in the logs: Oct 11 07:10:59 kumo dovecot[5704]: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=24.53.79.10, lip=172.26.12.90, *TLS handshaking: SSL_accept() syscall failed: Success*, session=<B9OokqCUD+UYNU8K> I have tried various ssl_protocols entries, but for now have defaulted back to ssl_protocols = !SSLv3 (the "out of the box" setting). The certificate (ssl_cert = </etc/ssl/certs/certificate_and_key.crt) is valid and the same one used by postfix. However, I belive the error appeared only after removing the self signed certificate and installing the one I purchased. Warning: though I was a sysadmin a long long time, it has been a while! I have not run a mail server in 15 years, but am moving my mail back "in-house" as I approach retirement! I searched for a forum where I could post this issue, but only found this list. # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-1051-aws x86_64 Ubuntu 18.04.1 LTS auth_mechanisms = plain login mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/certificate_and_key.crt ssl_cipher_list = ALL:!ADH:!LOW:!EXP:!aNULL:+HIGH:+MEDIUM ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh }

3 3

Re: Broken link on doc.dovecot.org
by Karen Woodman 11 Oct '19

11 Oct '19

Hi again, I wanted to check in and see if you got my note about the broken link on your site. Thanks! Karen On Monday, October 7, 2019 at 5:05 PM, Karen Woodman <karen(a)getmailbird.co> wrote: > Hi there, > > I noticed that you have a broken link to a website called Qmail.org. That > site was first published 23 years ago (back in 1996!) but unfortunately, it > is no longer a working website. > > You link to Qmail.org on this page: > https://doc.dovecot.org/configuration_manual/authentication/checkpassword/ > > We just published an article that explores what happened to the site. I think > it's an interesting story, and it could be useful to your readers. > > In addition, since all of the original articles are gone, we included a > curated list of the best Qmail resources and mirrors. > > Here's the article if you want to take a look: > https://www.getmailbird.com/what-resources-are-available-now-that-qmail-org… > > Would you consider swapping out the broken link for our article? > > Please let me know if you have any questions and thank you for your time. > > Sincerely, > -Karen > > -- > Karen Woodman, Editor > 5 Ross Rd > Durham, NH 03824 > > By the way, if you didn't like getting this email you can unsubscribe > <http://ec2-52-26-194-35.us-west-2.compute.amazonaws.com/x/u?u=df0298ca-a3e4…> and > I won't email you anymore. :) >

2 1

Using maldet
by Ignacio García 10 Oct '19

10 Oct '19

Hi there. Sometimes I notice that some malware gets through amavis+clamav+postfix and lands in the user's maildir files. I wonder if it would make sense, or even if it would be advisable to scan and clean those files using a program as maldet Thanks for your help. Ignacio

1 0

Case sensitivity in :addresses in sieve vacation scripts
by Julian Kippels 10 Oct '19

10 Oct '19

Hi, I have recently updated from Dovecot 2.2 to 2.3. Since I have noticed that vacation responses from sieve are not working the same anymore. For example, my sieve script looks like this: vacation :days 1 :addresses ["Kippels(a)hhu.de","julian.kippels(a)hhu.de"] it used to be that I got a vacation response if I sent a mail to kippels(a)hhu.de and Kippels(a)hhu.de. Now I only get a response for Kippels(a)hhu.de, not for kippels(a)hhu.de. I cant say for sure, but I suppose this behaviour changed with the update. If not, why could this have happened? And in any case, how can I enable case insensitivity? Thanks Julian

2 2

Show messages within 60 days
by jacky HU 10 Oct '19

10 Oct '19

Hello, Can my inbox be set up, for example, only for messages within 60 days? I don't want to create a new virtual mailbox. Can anyone help me?

2 1

Dovecot core debug
by MediumDave 10 Oct '19

10 Oct '19

Hi all, I have a Dovecot core that I am trying to track down, in an attempt to replicate so I can log a bug report, and am hoping others might be able to help me as I’m reaching my limit. My working theory is that two user sessions are active at the same time, one of the sessions is “mid-search” (or perhaps in idle state) on a virtual folder where the number of results is zero (due to a null results array), when another session either performs an append or perhaps a new message arrives in the virtual view and qualifies for the search. It seems that the current list of UID’s in the search results is zero (null), and new messages are being appended to the search results, which results in a divide by zero. But I have not been able to create a scenario to replicate this on my test box, but is occurring regularly (every hour or so) on my mail server. I have been able to replicate on my test box using a single account by performing many random operations over and over again, with multiple sessions, but took over 24 hours and I can’t isolate the action that caused it. Dovecot version is 2.2.36 (1f10bfa63) as shipped with Centos 7 (latest update). If I can reproduce, I can then test the latest 2.3 and see if this is still a problem in that version. Here is the full back trace: #0 0x00007f8d40636e58 in array_count_i (array=0x557be80cc168) at array.h:155 No locals. #1 array_get_i (count_r=<synthetic pointer>, array=0x557be80cc168) at array.h:209 No locals. #2 seq_range_lookup (array=0x557be80cc168, seq=2222, idx_r=0x7ffead4141d4) at seq-range-array.c:14 data = <optimized out> idx = <optimized out> left_idx = <optimized out> right_idx = <optimized out> count = <optimized out> #3 0x00007f8d406379ae in seq_range_exists (array=array@entry=0x557be80cc168, seq=seq@entry=2222) at seq-range-array.c:391 idx = 32766 #4 0x00007f8d408fd3d9 in mailbox_search_result_add (result=result@entry=0x557be80cc150, uid=2222) at mailbox-search-result.c:121 __FUNCTION__ = "mailbox_search_result_add" #5 0x00007f8d40962f30 in index_search_result_update_appends (result=result@entry=0x557be80cc150, old_messages_count=<optimized out>) at index-search-result.c:168 t = 0x557be7fb1820 search_ctx = 0x557be7fef860 mail = 0x557be8100198 search_arg = {next = 0x557be7fab460, type = SEARCH_SEQSET, value = {subargs = 0x0, seqset = {arr = {buffer = 0x557be7f69208, element_size = 8}, v = 0x557be7f69208, v_modifiable = 0x557be7f69208}, str = 0x0, time = 0, size = 0, flags = 0, search_flags = (unknown: 0), date_type = 0, thread_type = MAIL_THREAD_NONE, modseq = 0x0, search_result = 0x0, mime_part = 0x0}, initialized = {search_args = 0x0, keywords = 0x0, mailbox_glob = 0x0}, context = 0x0, hdr_field_name = 0x0, match_not = 0, match_always = 0, nonmatch_always = 0, fuzzy = 0, no_fts = 0, result = -1} message_count = 2008 ret = <optimized out> __FUNCTION__ = "index_search_result_update_appends" #6 0x00007f8d4096dc37 in search_result_update (result=0x557be80cc150, ctx=0x557be7ff8950) at index-sync-search.c:78 No locals. #7 index_sync_search_results_update (ctx=ctx@entry=0x557be7ff8950) at index-sync-search.c:88 results = 0x557be7f9d480 i = <optimized out> count = <optimized out> #8 0x00007f8d4096e4b4 in index_mailbox_sync_deinit (_ctx=0x557be7ff8950, status_r=0x557be7ff0108) at index-sync.c:353 ctx = 0x557be7ff8950 sync_rec = {seq1 = 0, seq2 = 0, type = MAILBOX_SYNC_TYPE_EXPUNGE} delayed_expunges = false ret = <optimized out> #9 0x00007f8d40950400 in mailbox_list_index_sync_deinit (ctx=0x557be7ff8950, status_r=0x557be7ff0108) at mailbox-list-index.c:976 ---Type <return> to continue, or q <return> to quit--- ibox = 0x557be7fd0bf0 box = 0x557be7f9d078 #10 0x00007f8d408ed568 in mailbox_sync_deinit (_ctx=<optimized out>, status_r=<optimized out>) at mail-storage.c:1953 ctx = <optimized out> box = <optimized out> errormsg = <optimized out> error = MAIL_ERROR_NONE ret = <optimized out> #11 0x0000557be6613431 in imap_sync_finish (ctx=ctx@entry=0x557be7ff0090, aborting=aborting@entry=false) at imap-sync.c:279 client = 0x557be7f8a6d8 ret = 0 #12 0x0000557be6613fed in imap_sync_more (ctx=0x557be7ff0090) at imap-sync.c:594 str = <optimized out> ret = 1 __FUNCTION__ = "imap_sync_more" #13 0x0000557be6614676 in cmd_sync_continue (sync_cmd=0x557be7f8be88) at imap-sync.c:629 cmd = 0x557be7f75e40 prev = <optimized out> client = 0x557be7f8a6d8 ctx = 0x557be7ff0090 ret = <optimized out> __FUNCTION__ = "cmd_sync_continue" #14 0x0000557be6614b34 in cmd_sync_client (sync_cmd=0x557be7f8be88) at imap-sync.c:720 ctx = <optimized out> flags = <optimized out> client = 0x557be7f8a6d8 imap_flags = <optimized out> no_newmail = <optimized out> #15 cmd_sync_delayed_real (client=0x557be7f8a6d8) at imap-sync.c:833 cmd = <optimized out> first_expunge = <optimized out> first_nonexpunge = <optimized out> #16 cmd_sync_delayed (client=client@entry=0x557be7f8a6d8) at imap-sync.c:841 _data_stack_cur_id = 3 #17 0x0000557be6607a18 in client_handle_input (client=client@entry=0x557be7f8a6d8) at imap-client.c:1233 remove_io = <optimized out> handled_commands = <optimized out> __FUNCTION__ = "client_handle_input" #18 0x0000557be6607eb5 in client_input (client=0x557be7f8a6d8) at imap-client.c:1264 ---Type <return> to continue, or q <return> to quit--- cmd = 0xcfee4 output = 0x557be7f8bd90 bytes = 2052 __FUNCTION__ = "client_input" #19 0x00007f8d40624be2 in io_loop_call_io (io=0x557be7f84cb0) at ioloop.c:600 ioloop = 0x557be7f719c0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #20 0x00007f8d406262cf in io_loop_handler_run_internal (ioloop=ioloop@entry=0x557be7f719c0) at ioloop-epoll.c:223 ctx = 0x557be7f734e0 events = <optimized out> list = 0x557be7f74f40 io = <optimized out> tv = {tv_sec = 1795, tv_usec = 114881} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #21 0x00007f8d40624c7c in io_loop_handler_run (ioloop=ioloop@entry=0x557be7f719c0) at ioloop.c:649 No locals. #22 0x00007f8d40624e38 in io_loop_run (ioloop=0x557be7f719c0) at ioloop.c:624 __FUNCTION__ = "io_loop_run" #23 0x00007f8d405a9c03 in master_service_run (service=0x557be7f71860, callback=callback@entry=0x557be6614e30 <client_connected>) at master-service.c:724 No locals. #24 0x0000557be65fa262 in main (argc=1, argv=0x557be7f715f0) at main.c:484 set_roots = {0x557be6825700 <imap_setting_parser_info>, 0x7f8d40df95a0, 0x0} login_set = {auth_socket_path = 0x557be7f69048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x557be6615600 <login_client_connected>, failure_callback = 0x557be6614f40 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 auth_socket_path = <optimized out> c = <optimized out> And the output of array in frame #0: (gdb) f 0 #0 0x00007f8d40636e58 in array_count_i (array=0x557be80cc168) at array.h:155 155 return array->buffer->used / array->element_size; (gdb) p *array $2 = {buffer = 0x0, element_size = 0} Here is the virtual folder config in use: # cat /etc/dovecot/virtual/combined/dovecot-virtual !INBOX INBOX/Sent INBOX/Drafts all Any help would be greatly appreciated in diagnosing the cause here. Thanks, Dave

1 0

Panic at "doveadm backup" (mailbox_symlink_exists): assertion failed: (ret > 0)
by Alex La 09 Oct '19

09 Oct '19

Hi. I try to sync from a dovecot server to another server via the following command. doveadm -D -o mail_fsync=never -o imapc_user=info(a)DOMAIN.COM -o imapc_password='PASS' backup -R -u info(a)DOMAIN.COM imapc: After some short runtime I get the following panic. ``` dsync(info(a)DOMAIN.COM): Panic: file mailbox-alias-plugin.c: line 77 (mailbox_symlink_exists): assertion failed: (ret > 0) dsync(info(a)DOMAIN.COM): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xa17ce) [0x7ff2f4da77ce] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7ff2f4da783a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff2f4d36dd7] -> /usr/lib64/dovecot/lib20_mailbox_alias_plugin.so(+0x133e) [0x7ff2f3afa33e] -> /usr/lib64/dovecot/lib20_mailbox_alias_plugin.so(+0x14d4) [0x7ff2f3afa4d4] -> /usr/lib64/dovecot/lib01_acl_plugin.so(+0xf2aa) [0x7ff2f432a2aa] -> /usr/lib64/dovecot/lib01_acl_plugin.so(+0xf908) [0x7ff2f432a908] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x44) [0x7ff2f50ec5e4] -> doveadm(dsync_mailbox_tree_fill+0x19b) [0x558004586e5b] -> doveadm(dsync_brain_mailbox_trees_init+0x124) [0x55800457b204] -> doveadm(dsync_brain_run+0x3d7) [0x558004578317] -> doveadm(+0x29b71) [0x55800455eb71] -> doveadm(+0x2bd2c) [0x558004560d2c] -> doveadm(+0x2c92a) [0x55800456192a] -> doveadm(doveadm_mail_try_run+0x215) [0x558004562285] -> doveadm(main+0x46a) [0x5580045513fa] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7ff2f495a505] -> doveadm(+0x1c565) [0x558004551565] ``` There is this message in the archive wich mention that similar directory names could be a problem. https://dovecot.org/list/dovecot/2016-December/106528.html I have cleanuped the similar directories but I still get the panic. This are the main folders in the Account ``` ... some custom folders =Trash =Sent Messages =Junk =Drafts =Coaching =Archiv =INBOX ``` Dovecot version # 2.2.36.4 (baf9232c1): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24.2 (aaba65b7) # OS: Linux 3.10.0-1062.1.2.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) Thanks for any help Regards Alex

1 0

Recommendations for shared storage
by Dan 09 Oct '19

09 Oct '19

Hello all, This email is by no means an "Educate me step by step" query, But more of an inquiry about which direction to go based on your experience. I've been working with Dovecot for some years now, so the configuration of that piece is no stranger. However, Choosing the right style of shared storage has proven to be somewhat of a challenge. A bit of background of what I need to provide service for: ~80,000 users, that will potentially grow throughout the future ~100 unique domains Ability to scale horizontally. As resources grow, adding a node (or group of nodes) with the exact configuration as the other nodes. Director should be able to send the connection to a node that has the same data as it's neighbors, Allowing high availability. What I've experimented with so far: _Server pairs, using dsync to replicate data between the nodes - Director to send users to a specific pair (director_tag returned from passdb) _ Pros: - Easy way to replicate data, without the need for external tools Cons: - Limited to one pair of nodes - dsync doesn't replicate all sieve files, for example, one file that tracks out of office replies has not been replicated in my experience _NFS storage managed by corosync and pacemaker - Director to send users to any backend _ Pros: - One location for all data. New nodes that get stood up will be easy to configure Cons: - Complex to set up In your experience, what did you choose for mail storage? Thanks.

1 0

Buster packages available
by Aki Tuomi 09 Oct '19

09 Oct '19

Hi! We have now buster packages available starting from 2.3.8. You can find them from https://repo.dovecot.org/ In related news, we are planning on dropping packages for Debian Jessie, Ubuntu 18 and CentOS6 starting from 2.3.9. --- Aki Tuomi Open-Xchange oy

2 2

CentOS 8 / 7
by Günther J. Niederwimmer 08 Oct '19

08 Oct '19

Hello List, I have to install a "new" system, what is the best way for this. I like to install a CentOS System but I only found dovecot for CentOS 7 is this compatible for CentOS 8 or have I to setup a CentOS 7 System ? The onboard dovecot is 2.2.36-5 :-( Thanks for a answer, -- mit freundlichen Grüßen / best regards Günther J. Niederwimmer

3 2

Pigeonhole v0.5.8 released
by Aki Tuomi 08 Oct '19

08 Oct '19

https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.8.ta… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.8.ta… Binary packages in https://repo.dovecot.org/ Changes - Sieve may leak resources in rare cases when a redirect, vacation or report action fails to send the message. This mainly applies when Sieve is executed in IMAP context; i.e., for the IMAPSIEVE or FILTER=SIEVE capabilities. --- Aki Tuomi Open-Xchange Oy

1 0

ITERINDEX not showing subfolders.
by Erik de Waard 08 Oct '19

08 Oct '19

# 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf Hello, we're using mail on NFS and the indexes on localdisk, with a director setup. (18K+ users) now to get more performance i thought to use the ITERINDEX option. however this has the side-effect on some mailboxes that it doesn't show the subfolders under INBOX. they seem 'disappeared'. Removing the ITERINDEX option fixes this again. Deleting the local indexes to be recreated doesn't solve the problem. What could cause this? and how to fix it. # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 # Hostname: somemail.host.domain auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 days auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 1500 default_vsz_limit = 1 G disable_plaintext_auth = no info_log_path = /dev/null listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_trusted_networks = 10.0.10.0/24 mail_fsync = never mail_max_userip_connections = 100 mail_prefetch_count = 10 mail_privileged_group = mail mailbox_list_index_include_inbox = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = username_format=%{rip} /etc/dovecot/passdb default_fields = noauthenticate=y driver = passwd-file } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { sieve_execute_bin_dir = /etc/dovecot/sieve-executables sieve_global_extensions = +vnd.dovecot.execute sieve_plugins = sieve_extprograms } protocols = imap lmtp service anvil { unix_listener anvil-auth-penalty { mode = 0600 } } service auth { user = root } service imap-login { client_limit = 6000 process_limit = 4 process_min_avail = 4 service_count = 0 vsz_limit = 600 M } service imap { client_limit = 1 process_limit = 1024 service_count = 50 } service lmtp { inet_listener lmtp { port = 24 } } ssl = no ssl_cert = </etc/dovecot/dovecot.crt ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lmtp { mail_fsync = optimized mail_plugins = " sieve" plugin { sieve = ~/filters.sieve sieve_after = /etc/dovecot/sieve/after.sieve sieve_before = /etc/dovecot/sieve/before.sieve } userdb { args = /etc/dovecot/dovecot-sql-lmtp.conf driver = sql name = } } dovecot-sql.conf driver = mysql connect = host=10.0.10.150 dbname=maildb user=mail password=5ecret! default_pass_scheme = SHA password_query = select login as user, crypt_sha1 as password, home as userdb_home, uid AS userdb_uid, gid AS userdb_gid, concat('maildir:',maildir,':INDEX=/data/indexes/',login,':ITERINDEX',':VOLATILEDIR=/data/indexes/',login) as userdb_mail from mailbox left join aliases on aliases.systemid = aliasid where login = '%u' and inactive = 0; user_query = select home, maildir as mail, uid, gid from mailbox left join aliases on aliases.systemid = aliasid where login = '%u' and inactive = 0; iterate_query = select distinct login as user from mailbox;

2 1

Is imap "list" required before imap "select" for shared folder?
by Gene Smith 08 Oct '19

08 Oct '19

I set up a shared mailbox with dovecot and it basically works. However, before I can imap SELECT or STATUS the shared mailbox I have to first do an imap LIST, i.e, . list "" * If list is not done first, the imap select or status command on the shared mailbox results in a "NO" response with "mailbox doesn't exist" response text. I can provide more information if this is not expected behavior. -gene

2 2

Sieve redirect is broken in 2.3.7.2 - signal 11
by Demonhost 07 Oct '19

07 Oct '19

Hi, If we use sieve redirect under dovecot 2.3.7.2 we end up with Oct 04 03:30:31 dockerhost docker[12154]: 2019-10-04T03:30:31 53ac2ae27650 postfix: 0605F207B0F36: to=<xxxx(a)xxxx.xx>, relay=127.0.0.1[127.0.0.1]:10024, delay=1.5, delays=0.36/0/0/1.1, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 6FC89207B0F38) Oct 04 03:30:31 dockerhost docker[12154]: 2019-10-04T03:30:31 53ac2ae27650 postfix: 6FC89207B0F38: to=<xxxx(a)xxxx.xx>, relay=dovecot, delay=0.31, delays=0.05/0/0/0.26, dsn=4.3.0, status=deferred (Command died with signal 11: "/usr/libexec/dovecot/dovecot-lda") Using docker with official alpine image. / # cat /etc/alpine-release 3.8.4 / # apk info -v | grep dovecot WARNING: Ignoring APKINDEX.adfa7ceb.tar.gz: No such file or directory WARNING: Ignoring APKINDEX.efaa1f73.tar.gz: No such file or directory dovecot-2.3.7.2-r0 dovecot-fts-solr-2.3.7.2-r0 dovecot-ldap-2.3.7.2-r0 dovecot-pigeonhole-plugin-2.3.7.2-r0 dovecot-pigeonhole-plugin-ldap-2.3.7.2-r0 Sieve rule is: # rule:[test] if header :contains "subject" "test" { redirect "testemail(a)gmail.com"; } In host's dmesg we found the following: [213184.882341] traps: dovecot-lda[6128] general protection ip:7ff6cf8144f7 sp:7fff5f800b30 error:0 in libdovecot.so.0.0.0[7ff6cf724000+360000] Sorry, not knowledgeable enough on how to do the GBD debug. ----------------- We went back to previous version and issue disappeared. 8b45bb255b67:/# cat /etc/alpine-release 3.8.4 8b45bb255b67:/# apk info -v | grep dovecot WARNING: Ignoring APKINDEX.adfa7ceb.tar.gz: No such file or directory WARNING: Ignoring APKINDEX.efaa1f73.tar.gz: No such file or directory dovecot-2.3.6-r0 dovecot-fts-solr-2.3.6-r0 dovecot-ldap-2.3.6-r0 dovecot-pigeonhole-plugin-2.3.6-r0 dovecot-pigeonhole-plugin-ldap-2.3.6-r0 Anyone else already had this problem or you know how to fix it? Thanks in advance.

2 10

Dovecot proxying to some backend using LOGIN proxy_mech
by Sébastien Riccio 06 Oct '19

06 Oct '19

Hello list, I am currently testing a setup for a PoC wit this configuration. - 1 x Frontend dovecot for proxying IMAP/POP3/LMTP/ManageSieve/Submission - 2 x Backend dovecot with local mail storage The frontend does the user authentification and communicate with the backends using a master password The fronted accepts PLAIN and LOGIN auth mechanisms and talk with backends using PLAIN auth mechanism (with the master password). This works very well, it's cool. Then, I've added to this setup an existing mail server (running another mailserver software) as a 3rd backend, and would like the frontend to also proxy for this, but this time not using master password. This is working for IMAP/POP3 when it uses PLAIN auth, but not for Submission. The backend server in this case only accepts LOGIN auth and not PLAIN on port 587. So I found out there is a field in the passdb we can add (proxy_mech), and I've set it to LOGIN. The frontend seems to now use LOGIN auth mech to talk to this 3rd backend, but the authentication still fails. According to the backend logs, tt seems dovecot proxy is now using LOGIN auth, but sends garbage as username and/or password. Also IMAP that was working when using PLAIN doesn't work anymore with LOGIN. Might this be a bug or this setup shouldn't be supported at all ? Passdb MySQL table on frontend: mysql> describe users; +-------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +-------------+--------------+------+-----+---------+-------+ | user | varchar(255) | NO | PRI | NULL | | | domain | varchar(255) | NO | PRI | NULL | | | password | varchar(255) | YES | | NULL | | | displayname | varchar(255) | YES | | NULL | | | host | varchar(16) | NO | | NULL | | | usemaster | tinyint(1) | NO | | 1 | | | proxy_mech | varchar(20) | YES | | NULL | | | starttls | varchar(20) | YES | | NULL | | +-------------+--------------+------+-----+---------+-------+ mailstore-01/02 are dovecot backends otherhost is the other mailserver I also would like to proxy through dovecot proxy +---------+-----------------+-----------------------------------------+----------------+--------------+-----------+------------+----------+ | user | domain | password | displayname | host | usemaster | proxy_mech | starttls | +---------+-----------------+-----------------------------------------+----------------+--------------+-----------+------------+----------+ | user1 | somedomain.com | {SHA512-CRYPT}<some_crypted_pass> | Joe Black | mailstore-01 | 1 | NULL | NULL | | user2 | otherdomain.com | {SHA512-CRYPT}<some_crypted_pass> | Mr. Smith | mailstore-02 | 1 | NULL | NULL | | user3 | area13.com | NULL | Donald Duck | otherhost | 0 | LOGIN | any-cert | | user4 | area13.com | NULL | Thanks Obama | otherhost | 0 | LOGIN | any-cert | +---------+-----------------+-----------------------------------------+----------------+--------------+-----------+------------+----------+ Passdb query : password_query = \ SELECT concat(user, '@', domain) AS user, password, host, 'Y' AS proxy, \ IF(usemaster is TRUE, 'supermasteruserl', NULL) as master, \ IF(usemaster is TRUE, 'supermasterpassword', pass) as pass, \ IF(usemaster is FALSE, 'Y', NULL) as nopassword, \ proxy_mech, \ starttls \ FROM users WHERE user = '%n' AND domain = '%d' Some questions I'm asking myself: Is proxying using LOGIN proxy_mech supported at all to auth on backends ? Is dovecot proxying to "otherhost" supposed to decode original client auth (using PLAIN) and translate it to LOGIN format to auth with "otherhost" ? # otherhost port 587 log Without specifying proxy_mech [2019.09.19] 09:27:22.167 [192.168.60.220][3070269] cmd: EHLO dovecotproxy.local.domain [2019.09.19] 09:27:22.167 [192.168.60.220][3070269] rsp: 250-dovecotproxy.local.domain Hello [192.168.60.220]250-SIZE 52428800250-AUTH LOGIN CRAM-MD5250-STARTTLS250-8BITMIME250-DSN250 OK [2019.09.19] 09:27:22.167 [192.168.60.220][3070269] cmd: AUTH PLAIN <base64string> [2019.09.19] 09:27:22.167 [192.168.60.220][3070269] rsp: 504 Unrecognized authentication type. When using proxy_mech LOGIN [2019.09.20] 08:24:45.201 [192.168.60.220][24148464] cmd: AUTH LOGIN = [2019.09.20] 08:24:45.201 [192.168.60.220][24148464] Exception: The input is not a valid Base-64 string as it contains a non-base 64 character, more than two padding characters, or an illegal character among the padding characters. [2019.09.20] 08:24:45.201 [192.168.60.220][24148464] rsp: 535 Authentication failed # otherhost port 143 log Works without specyfing proxy_mech When using proxy_mech LOGIN (fails) [2019.09.20] 03:37:20.896 [192.168.60.220][26310645] connected at 20.09.2019 03:37:20 [2019.09.20] 03:37:20.896 [192.168.60.220][26310645] command: C CAPABILITY [2019.09.20] 03:37:20.896 [192.168.60.220][26310645] response: * CAPABILITY IMAP4rev1 AUTH=CRAM-MD5 AUTH=PLAIN UIDPLUS QUOTA XLIST CHILDREN ENABLE IDLE STARTTLS [2019.09.20] 03:37:20.896 [192.168.60.220][26310645] response: C OK CAPABILITY completed [2019.09.20] 03:37:20.896 [192.168.60.220][26310645] command: L AUTHENTICATE LOGIN [2019.09.20] 03:37:20.927 [192.168.60.220][26310645] disconnected at 20.09.2019 03:37:20 I hope I explained my setup so it's kinda understandable. I'm not good at explaining things :) Thank you for your help! root@mailfront-01:~# dovecot --version 2.3.7.2 (3c910f64b) Sébastien RICCIO SYSTEM ADMINISTRATOR

2 2

imapsieve administrator scripts are not executed in the order they are defined
by frankagainstthemachine＠gmx.de 06 Oct '19

06 Oct '19

Dear dovecot developers, I have an issue with the Pigeonhole IMAPSieve Plugin and the order in which administrator scripts are executed. Although I cannot find anything about the order in which the scripts are executed, I would expect they are executed in the order they are defined: the one defined by imapsieve_mailbox1_* before the one defined by imapsieve_mailbox2_* in case both match. I defined several administrator scripts; among them one that should be executed when copying a mail to mailbox "Inbox", and one that should be executed when copying a mail from a mailbox "*.Spam" to any other mailbox. No matter in which order I define the two scripts, the one related to "Inbox" is always executed first when I move a mail from "blah.Spam" to "Inbox", see the snipped from my logs below. I guess there might be a bug in file imap-sieve-storage.c, function imap_sieve_mailbox_rules_match(...): The comment in this function states "Insert sorted by rule index", but in case the index of the rule to be inserted is higher than any index already in the "rules" array, the rule is inserted in position 0 instead of being appended to the end, because "insert_idx" is initialized with 0. Since the rule for "*.Spam" is a pattern rule, it is the first rule to be inserted into "rules" (in imap_sieve_mailbox_rules_match_patterns(...)). Afterwards the rule for "Inbox" is always inserted at position 0 (in imap_sieve_mailbox_rules_match(...)), no matter if its rule index is higher or lower than the index of the other rule. The following change could fix this: - unsigned int insert_idx = 0; + unsigned int insert_idx = array_count(rules); Best regards, Frank ----- log ----- [...] Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: imapsieve: mailbox INBOX: MOVE event Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: Pigeonhole version 0.5.7.2 (7372921a) initializing Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.7.2 (7372921a) loaded Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`*.Spam' from=`*' causes=(COPY) => before=`file:/usr/lib/dovecot/sieve/spamassassin-learn- spam.sieve' after=(none) Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`*.Spam' causes=(COPY) => before=`file:/usr/lib/dovecot/sieve/spamassassin-learn- ham.sieve' after=(none) Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: imapsieve: Static mailbox rule [3]: mailbox=`INBOX' from=`*' causes=(COPY APPEND) => before=`file:~/.dovecot.sieve' after=(none) Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: imapsieve: Matched static mailbox rule [2] Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: imapsieve: Matched static mailbox rule [3] Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: file storage: Using Sieve script path: /var/spool/mail/ user/.dovecot.sieve Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: file script: Opened script `.dovecot' from `/var/spool/mail/ user/.dovecot.sieve' Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: file storage: Using Sieve script path: /usr/lib/dovecot/sieve/ spamassassin-learn-ham.sieve Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: file script: Opened script `spamassassin-learn-ham' from `/usr/ lib/dovecot/sieve/spamassassin-learn-ham.sieve' Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: Opening script 1 of 2 from `/var/spool/mail/user/.dovecot.sieve' Oct 4 23:51:12 somehost dovecot[22918]: imap(user)<22927><oLq3sRyU0t/AqLwV>: Debug: sieve: Loading script /var/spool/mail/user/.dovecot.sieve [...] ----- dovecot -n ----- # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 (7372921a) # OS: Linux 5.1.18-gentoo x86_64 Gentoo Base System release 2.6 ext4 # Hostname: somehost.de auth_username_format = %Ln mail_debug = yes mail_home = /var/spool/mail/%u mail_location = maildir:/var/spool/mail/%u/mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovec ot.debug namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/spamassassin-learn- spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = *.Spam imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/spamassassin-learn- ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = *.Spam imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:~/.dovecot.sieve imapsieve_mailbox3_causes = COPY APPEND imapsieve_mailbox3_name = Inbox mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append sieve = file:~/sieve;active=~/.dovecot.sieve sieve_execute_bin_dir = /usr/lib/dovecot/sieve sieve_extensions = +vnd.dovecot.debug sieve_filter_bin_dir = /usr/lib/dovecot/sieve sieve_filter_exec_timeout = 300s sieve_filter_input_eol = lf sieve_global = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.filter sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_pipe_exec_timeout = 300s sieve_pipe_input_eol = lf sieve_plugins = sieve_extprograms } postmaster_address = postmaster(a)frankagainstthemachine.de protocols = imap lmtp sieve sieve service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } ssl = required ssl_cert = </etc/ssl/dovecot/somehost.cert.pem ssl_cipher_list = ALL:!DH:!kRSA:!SRP:!kDHd:!DSS:!aNULL:!eNULL:!EXPORT:!DES:! 3DES:!MD5:!PSK:!RC4:!ADH:!LOW@STRENGTH ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } verbose_ssl = yes protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = sieve } protocol imap { mail_plugins = " imap_sieve" } protocol sieve { mail_debug = yes }

2 1

Is it possible to create and use some lookup table to replace (for instance) %u in mail_location?
by Gerben Wierda 06 Oct '19

06 Oct '19

Suppose my mail_location is: mail_location = maildir:/private/var/mail/nl.rna.mail/%u But I would like to use a simple lookup table to replace %u with another value, say '8DB4E345-9144-4F92-8C9F-9D47BB61CBF8’ instead of ‘username’. Is there a (simple) way to do this? Gerben Wierda Chess and the Art of Enterprise Architecture <http://enterprisechess.com/> Mastering ArchiMate <http://masteringarchimate.com/> Architecture for Real Enterprises <https://www.infoworld.com/blog/architecture-for-real-enterprises/> at InfoWorld On Slippery Ice <https://eapj.org/on-slippery-ice/> at EAPJ

2 1

Home Directory Creation
by Asai 06 Oct '19

06 Oct '19

Hello, I hate to have to ask this, but... why isn't the home directory being created automatically? Due to legacy compatibility we've had to use this type of home dir config: mail_location = maildir:/vmail/%d/%n mail_home = /vmail/%d/%n/home We're in the middle of upgrading to new hardware, and so I'm migrating configs to the new server, Dovecot 2.3.7 and Postfix 3.4.6 On our old server (Dovecot 2.2, Postfix 2.11) the home directory gets created automatically with a new user, but not on this one. The Dovecot debug logs just say "home dir not found." Can anyone point me in the right direction? Thank you, Asai

5 17

UNSEEN flag issues with multiple clients
by John Stoffel 04 Oct '19

04 Oct '19

Hi all, I've been bugged by this issue for a while, and while I see that the \UNSEEN flag is specified in the RFC to be reset once *any* client connects and looks at a mailbox, I was wondering if there's a way to change the behavior so that it's tracked on a per-client basis? Or if there's even some way to turn it off so that both my iPhone mail client and my main emacs viewmail mail client don't stomp over each other when looking at my mail folder counts of unread messages. My mail server is running Debian 9.11, which has dovecot 2.2.27-3+deb9u5 as the version. I'm only running IMAP, no POP at all. Thanks, John

2 5

Dovecote IMAPSieve user scripts
by Alexander Mankuta 03 Oct '19

03 Oct '19

Hello, I wonder how to configure IMAPSieve with user scripts. I can't find much information on the internet. I have Sieve and IMAPSieve for spam configured as described in the wiki and it works. Documentation mentions that imapsieve_url has to be set to appropriate ManageSieve server but no further explanation is given. What I want to achieve: let users create their own sieve scripts and execute them each time a message is being moved/copied between their mailboxes. I saw mentions of "association of user scripts with mailboxes" but I'm not sure what that means or if it's supported by Thuderbird Sieve extension (or any other software out there). Please advice. -- Regards, Alex

3 3

Doveadm error during store - segfault clucene
by Domenico Pastore 03 Oct '19

03 Oct '19

Hi, during the store of the messages, I find the following doveadm errors: 2019-10-02 09:22:19 auth: Debug: ldap(test.pop(a)test.xxx.it,10.11.47.60<mailto:test.pop@test.xxx.it,10.11.47.60>): result: mailMessageStore=1/1/2/0/8/7/2/1120872_91093 mailQuota=52428800; mailQuota,mailMessageStore unused 2019-10-02 09:22:19 auth: Debug: ldap(test.pop(a)test.xxx.it,10.11.47.60<mailto:test.pop@test.xxx.it,10.11.47.60>): Finished userdb lookup 2019-10-02 09:22:19 auth: Debug: userdb out: USER 1 test.pop(a)test.xxx.it<mailto:test.pop@test.xxx.it> home=/store/mailbox/mailbox_test/1/1/2/0/8/7/2/1120872_91093 quota_rule=*:bytes=52428800 mail_plugins+= 2019-10-02 09:22:19 doveadm(test.pop(a)test.xxx.it<mailto:test.pop@test.xxx.it>)<180667><MO3BGytQlF27wQIAxhuf8Q>: Fatal: master: service(doveadm): child 180667 killed with signal 11 (core dumped) 2019-10-02 09:22:19 auth: Debug: master in: USER 1 test.pop(a)test.xxx.it<mailto:test.pop@test.xxx.it> service=doveadm lip=192.160.10.100 lport=924 rip=10.11.47.60 rport=56515 2019-10-02 09:22:19 auth: Debug: ldap(test.pop(a)test.xxx.it,10.11.47.60<mailto:test.pop@test.xxx.it,10.11.47.60>): Performing userdb lookup This problem occurs only with the quota plugin enabled. Can you help me? Best regards Domenico ----------------------------------------------------- (gdb) #0 clear (this=0x0) at /usr/src/debug/clucene-core-2.3.3.4/src/core/CLucene/util/VoidMap.h:123 #1 lucene::search::FieldSortedHitQueue::_shutdown () at /usr/src/debug/clucene-core-2.3.3.4/src/core/CLucene/search/FieldSortedHitQueue.cpp:60 #2 0x00007f4b37a62e96 in _lucene_shutdown () at /usr/src/debug/clucene-core-2.3.3.4/src/core/CLucene/StdHeader.cpp:33 #3 0x00007f4b3b2f2fbb in module_dir_deinit (modules=<optimized out>) at module-dir.c:578 #4 0x00007f4b3b2f3001 in module_dir_unload (modules=modules@entry=0x7f4b3b8e1380 <mail_storage_service_modules>) at module-dir.c:590 #5 0x00007f4b3b5dd264 in mail_storage_service_deinit (_ctx=_ctx@entry=0x55ea409b7838) at mail-storage-service.c:1730 #6 0x000055ea3f4a3d35 in doveadm_mail_cmd_exec (ctx=ctx@entry=0x55ea409b77f8, wildcard_user=wildcard_user@entry=0x0) at doveadm-mail.c:673 #7 0x000055ea3f4a4bbd in doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=<optimized out>) at doveadm-mail.c:1144 #8 0x000055ea3f4b5c98 in doveadm_cmd_run_ver2 (argc=argc@entry=1, argv=argv@entry=0x55ea40997150, cctx=cctx@entry=0x7fff9a1cb990) at doveadm-cmd.c:574 #9 0x000055ea3f4ba020 in doveadm_cmd_server_run_ver2 (cctx=0x7fff9a1cb990, argv=0x55ea40997150, argc=1, conn=0x55ea409ebbd8) at client-connection-tcp.c:178 #10 doveadm_cmd_handle (cctx=0x7fff9a1cb990, argv=0x55ea40997150, argc=1, cmd_name=<optimized out>, conn=0x55ea409ebbd8) at client-connection-tcp.c:342 #11 client_handle_command (args=<optimized out>, conn=0x55ea409ebbd8) at client-connection-tcp.c:415 #12 client_connection_tcp_input (conn=0x55ea409ebbd8) at client-connection-tcp.c:561 #13 0x00007f4b3b2e855f in io_loop_call_io (io=0x55ea409c5b10) at ioloop.c:704 #14 0x00007f4b3b2e9fa3 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55ea4099fcb0) at ioloop-epoll.c:221 #15 0x00007f4b3b2e8666 in io_loop_handler_run (ioloop=ioloop@entry=0x55ea4099fcb0) at ioloop.c:756 #16 0x00007f4b3b2e8888 in io_loop_run (ioloop=0x55ea4099fcb0) at ioloop.c:729 #17 0x00007f4b3b25b2d3 in master_service_run (service=0x55ea4099fb40, callback=callback@entry=0x55ea3f4bd260 <client_connected>) at master-service.c:781 #18 0x000055ea3f493421 in main (argc=1, argv=0x55ea4099f890) at main.c:151 (gdb) bt full #0 clear (this=0x0) at /usr/src/debug/clucene-core-2.3.3.4/src/core/CLucene/util/VoidMap.h:123 No locals. #1 lucene::search::FieldSortedHitQueue::_shutdown () at /usr/src/debug/clucene-core-2.3.3.4/src/core/CLucene/search/FieldSortedHitQueue.cpp:60 No locals. #2 0x00007f4b37a62e96 in _lucene_shutdown () at /usr/src/debug/clucene-core-2.3.3.4/src/core/CLucene/StdHeader.cpp:33 No locals. #3 0x00007f4b3b2f2fbb in module_dir_deinit (modules=<optimized out>) at module-dir.c:578 _data_stack_cur_id = 4 module = 0x55ea40a048b0 rev = 0x55ea4099ac18 i = <optimized out> count = 6 #4 0x00007f4b3b2f3001 in module_dir_unload (modules=modules@entry=0x7f4b3b8e1380 <mail_storage_service_modules>) at module-dir.c:590 module = <optimized out> next = <optimized out> #5 0x00007f4b3b5dd264 in mail_storage_service_deinit (_ctx=_ctx@entry=0x55ea409b7838) at mail-storage-service.c:1730 ctx = 0x55ea409f0bf8 #6 0x000055ea3f4a3d35 in doveadm_mail_cmd_exec (ctx=ctx@entry=0x55ea409b77f8, wildcard_user=wildcard_user@entry=0x0) at doveadm-mail.c:673 cctx = <optimized out> cli = <optimized out> ret = <optimized out> error = 0x7f4b3b22d2f7 <__x86_return_thunk+5> "\363\220\017\256\350\353\371H\215d$\b\303\350\a" #7 0x000055ea3f4a4bbd in doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=<optimized out>) at doveadm-mail.c:1144 mctx = 0x55ea409b77f8 wildcard_user = <optimized out> fieldstr = 0x55ea40997310 "͒\t7K\177" pargv = {arr = {buffer = 0x55ea409b7a28, element_size = 8}, v = 0x55ea409b7a28, v_modifiable = 0x55ea409b7a28} full_args = {arr = {buffer = <optimized out>, element_size = 8}, v = <optimized out>, v_modifiable = <optimized out>} i = <optimized out> cli = <optimized out> tcp_server = <optimized out> mail_cmd = {alloc = 0x7f4b37098d00 <cmd_quota_get_alloc>, name = 0x7f4b370992b6 "quota get", usage_args = 0x7f4b37099291 ""} dashdash = 0x55ea3f4e07ca "--" args_pos = 1 #8 0x000055ea3f4b5c98 in doveadm_cmd_run_ver2 (argc=argc@entry=1, argv=argv@entry=0x55ea40997150, cctx=cctx@entry=0x7fff9a1cb990) at doveadm-cmd.c:574 param = <optimized out> pargv = {arr = {buffer = 0x55ea40997410, element_size = 104}, v = 0x55ea40997410, v_modifiable = 0x55ea40997410} opts = {arr = {buffer = <optimized out>, element_size = 32}, v = <optimized out>, v_modifiable = <optimized out>} pargc = 4 c = -1 li = 102607314 pool = 0x55ea40997240 optbuf = 0x55ea40997258 __func__ = "doveadm_cmd_run_ver2" #9 0x000055ea3f4ba020 in doveadm_cmd_server_run_ver2 (cctx=0x7fff9a1cb990, argv=0x55ea40997150, argc=1, conn=0x55ea409ebbd8) at client-connection-tcp.c:178 No locals. #10 doveadm_cmd_handle (cctx=0x7fff9a1cb990, argv=0x55ea40997150, argc=1, cmd_name=<optimized out>, conn=0x55ea409ebbd8) at client-connection-tcp.c:342 mail_cmd = <optimized out> mctx = <optimized out> cmd_ver2 = <optimized out> prev_ioloop = 0x55ea4099fcb0 cmd = 0x0 #11 client_handle_command (args=<optimized out>, conn=0x55ea409ebbd8) at client-connection-tcp.c:415 cctx = {cmd = 0x55ea409b53d8, argc = 4, argv = 0x55ea40997448, username = 0x55ea40997119 "test.pop(a)test.xxx.it"<mailto:test.pop@test.xxx.it>, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "\300\240\nd", '\000' <repeats 11 times>, __u6_addr16 = {41152, 25610, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1678418112, 0, 0, 0}}}, ip4 = { s_addr = 1678418112}}}, remote_ip = {family = 2, u = {ip6 = {__in6_u = {__u6_addr8 = "\n\v/<", '\000' <repeats 11 times>, __u6_addr16 = {2826, 15407, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1009715978, 0, 0, 0}}}, ip4 = {s_addr = 1009715978}}}, local_port = 924, remote_port = 54042, conn_type = DOVEADM_CONNECTION_TYPE_TCP, input = 0x55ea409b0db0, output = 0x55ea409b6cf0} flags = <optimized out> cmd_name = <optimized out> argc = <optimized out> ---Type <return> to continue, or q <return> to quit--- #12 client_connection_tcp_input (conn=0x55ea409ebbd8) at client-connection-tcp.c:561 args = <optimized out> _data_stack_cur_id = 3 line = <optimized out> ok = true minor = 0 #13 0x00007f4b3b2e855f in io_loop_call_io (io=0x55ea409c5b10) at ioloop.c:704 ioloop = 0x55ea4099fcb0 t_id = 2 __func__ = "io_loop_call_io" #14 0x00007f4b3b2e9fa3 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55ea4099fcb0) at ioloop-epoll.c:221 ctx = 0x55ea409a57a0 events = <optimized out> list = 0x55ea409e9e80 io = <optimized out> tv = {tv_sec = 2147483, tv_usec = 0} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __func__ = "io_loop_handler_run_internal" #15 0x00007f4b3b2e8666 in io_loop_handler_run (ioloop=ioloop@entry=0x55ea4099fcb0) at ioloop.c:756 __func__ = "io_loop_handler_run" #16 0x00007f4b3b2e8888 in io_loop_run (ioloop=0x55ea4099fcb0) at ioloop.c:729 __func__ = "io_loop_run" #17 0x00007f4b3b25b2d3 in master_service_run (service=0x55ea4099fb40, callback=callback@entry=0x55ea3f4bd260 <client_connected>) at master-service.c:781 No locals. #18 0x000055ea3f493421 in main (argc=1, argv=0x55ea4099f890) at main.c:151 set_roots = {0x7f4b3b57cd00 <master_service_ssl_setting_parser_info>, 0x55ea3f7026a0 <doveadm_setting_parser_info>, 0x0} input = {roots = 0x7fff9a1cbb70, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x55ea3f4dcd3a "doveadm", service = 0x55ea3f4dcd3a "doveadm", username = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = { ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_name = 0x0} output = {specific_services = 0x0, service_uses_local = false, service_uses_remote = false, used_local = false, used_remote = false, permission_denied = false} error = 0x7f4b3aca3ca7 "__vdso_getcpu" c = <optimized out> (gdb) # 2.3.7.2 (3c910f64b): /new_config/dovecot/dovecot_test/dovecot.conf # Pigeonhole version 0.5.7.2 (7372921a) # OS: Linux 3.10.0-957.21.3.el7.x86_64 x86_64 CentOS Linux release 7.6.1810 (Core) # Hostname: pop10 auth_debug = yes auth_master_user_separator = * auth_username_format = base_dir = /data/dovecot/var/run/dovecot_test default_vsz_limit = 768 M dict { sqlquota = mysql:/new_config/dovecot/common/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /LOGS/dovecot/dovecot_test.log instance_name = dovecot_test listen = dovecot_test log_path = /LOGS/dovecot/dovecot_test.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = 101 mail_location = maildir:%h/Maildir mail_max_userip_connections = 50 mail_plugins = quota mail_log notify virtual fts fts_lucene mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.debug mbox_write_locks = fcntl namespace { hidden = yes list = no location = virtual:/new_config/dovecot/common/virtual:INDEX=~/virtual:SUBSCRIPTIONS=.subscriptions/%u prefix = Messaggi in arrivo. separator = . subscriptions = no } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /new_config/dovecot/common/passwd.masterusers driver = passwd-file master = yes } passdb { args = /new_config/dovecot/dovecot_test/dovecot-ldap.conf driver = ldap } passdb { args = /new_config/dovecot/common/dovecot-ldap-multiuser.conf driver = ldap master = yes } passdb { args = /new_config/dovecot/common/dovecot-ldap-webmaillight.conf.ext driver = ldap master = yes } plugin { fts = lucene fts_autoindex = yes fts_autoindex_max_recent = 1000 fts_lucene = mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid size flags quota = dict:User quota::proxy::sqlquota quota_rule2 = INBOX.Trash:storage=+100M sieve_default = /new_config/dovecot/common/default.sieve sieve_extensions = +vnd.dovecot.debug } postmaster_address = posta(a)fooo.it<mailto:posta@fooo.it> service anvil { client_limit = 8000 } service auth { client_limit = 12000 unix_listener auth-userdb { mode = 0600 } } service dict { process_limit = 7500 process_min_avail = 10 unix_listener dict { mode = 0600 user = dovecot } } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 inet_listener { port = 924 } privileged_group = process_limit = 0 process_min_avail = 10 protocol = service_count = 100 type = unix_listener doveadm-server { group = mode = 0600 user = } user = } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 5000 process_min_avail = 10 } service imap { drop_priv_before_exec = yes process_limit = 5000 process_min_avail = 10 } service lmtp { inet_listener lmtp { port = 24 } process_limit = 2500 process_min_avail = 10 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 1000 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 1000 process_min_avail = 5 } ssl_cert = </new_config/dovecot/common/certs/dovecot.pem ssl_key = # hidden, use -P to show it userdb { args = /new_config/dovecot/dovecot_test/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota mail_log notify sieve virtual } protocol lda { mail_plugins = quota mail_log notify sieve virtual } protocol imap { mail_plugins = quota imap_quota mail_log notify virtual } protocol pop3 { mail_plugins = quota mail_log notify virtual pop3_uidl_format = UID%u-%v }

2 1

sieve cli
by Matthew Broadhead 03 Oct '19

03 Oct '19

i am using dovecot-2.2.36-3.el7_7.1.x86_64 on centos 7 is it possible to activate / deactivate a sieve script for a mailbox from the command line? my mailboxes are currently stores in /../vmail/domain.tld/username if i activate / deactivate a filter set using roundcube (webmail system) then it creates or deletes a symbolic link /../vmail/domain.tld/username/dovecot.sieve which points to a file /../vmail/domain.tld/username/sieve/managesieve.sieve. if i create this symbolic link manually it doesn't seem to work

3 4

Tool to give information about IP's that logged into the accounts
by Jorge Bastos 03 Oct '19

03 Oct '19

Howdy, I'm looking for a tool that can give me the information about the IP's that have logged in the accounts, for history purpose. Is there something that can grab the logs and create a database and give me this information in some nice web interface or so? Thanks in advanced, Jorge,

1 0

Problem with converting mdbox to MailDir
by Adam Raszkiewicz 03 Oct '19

03 Oct '19

I have a problem to convert mdbox to MailDir. Log from that process looks like: /bin/dsync -Dv -u user(a)domian.com mirror maildir:/tmp/destination/mailboxes/user@domian.com Debug: Loading modules from directory: /lib/dovecot Debug: Module loaded: /lib/dovecot/lib01_acl_plugin.so Debug: Loading modules from directory: /lib/dovecot/doveadm Debug: Module loaded: /lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(user(a)domian.com): Debug: Effective uid=503, gid=503, home=/var/mailboxes/%2Mu/%2.2Mu/%u doveadm(user(a)domian.com): Debug: Home dir not found: /var/mailboxes/%2Mu/%2.2Mu/%u doveadm(user(a)domian.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/var/mailboxes/64/b1/user@domian.com doveadm(user(a)domian.com): Debug: fs: root=/var/mailboxes/64/b1/user(a)domian.com, index=, indexpvt=, control=, inbox=, alt= doveadm(user(a)domian.com): Debug: acl: initializing backend with data: vfile doveadm(user(a)domian.com): Debug: acl: acl username = user(a)domian.com doveadm(user(a)domian.com): Debug: acl: owner = 1 doveadm(user(a)domian.com): Debug: acl vfile: Global ACLs disabled doveadm(user(a)domian.com): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=mdbox:/var/mailboxes/%2Mu/%2.2Mu/%u doveadm(user(a)domian.com): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(user(a)domian.com): Debug: acl: initializing backend with data: vfile doveadm(user(a)domian.com): Debug: acl: acl username = user(a)domian.com doveadm(user(a)domian.com): Debug: acl: owner = 0 doveadm(user(a)domian.com): Debug: acl vfile: Global ACLs disabled doveadm(user(a)domian.com): Debug: acl vfile: file /var/mailboxes/64/b1/user(a)domian.com/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(user(a)domian.com): Debug: acl vfile: file /var/mailboxes/64/b1/user(a)domian.com/mailboxes/Drafts/dbox-Mails/dovecot-acl not found doveadm(user(a)domian.com): Debug: acl vfile: file /var/mailboxes/64/b1/user(a)domian.com/mailboxes/Sent/dbox-Mails/dovecot-acl not found doveadm(user(a)domian.com): Debug: acl vfile: file /var/mailboxes/64/b1/user(a)domian.com/mailboxes/Trash/dbox-Mails/dovecot-acl not found doveadm(user(a)domian.com): Debug: Namespace : Using permissions from /var/mailboxes/64/b1/user(a)domian.com: mode=0700 gid=default dsync(user(a)domian.com): Debug: Effective uid=503, gid=503, home=/var/mailboxes/%2Mu/%2.2Mu/%u dsync(user(a)domian.com): Debug: Home dir not found: /var/mailboxes/%2Mu/%2.2Mu/%u dsync(user(a)domian.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/tmp/destination/mailboxes/user@domian.com dsync(user(a)domian.com): Debug: maildir++: root=/tmp/destination/mailboxes/user(a)domian.com, index=, indexpvt=, control=, inbox=/tmp/destination/mailboxes/user(a)domian.com, alt= dsync(user(a)domian.com): Debug: Namespace : /tmp/destination/mailboxes/user(a)domian.com doesn't exist yet, using default permissions dsync(user(a)domian.com): Debug: Namespace : Using permissions from /tmp/destination/mailboxes/user(a)domian.com: mode=0700 gid=default dsync(user(a)domian.com): Debug: acl: initializing backend with data: vfile dsync(user(a)domian.com): Debug: acl: acl username = user(a)domian.com dsync(user(a)domian.com): Debug: acl: owner = 1 dsync(user(a)domian.com): Debug: acl vfile: Global ACLs disabled dsync(user(a)domian.com): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=mdbox:/var/mailboxes/%2Mu/%2.2Mu/%u dsync(user(a)domian.com): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= dsync(user(a)domian.com): Debug: acl: initializing backend with data: vfile dsync(user(a)domian.com): Debug: acl: acl username = user(a)domian.com dsync(user(a)domian.com): Debug: acl: owner = 0 dsync(user(a)domian.com): Debug: acl vfile: Global ACLs disabled dsync(user(a)domian.com): Error: User initialization failed: namespace configuration error: All list=yes namespaces must use the same separator but when I will specify namespace to the inbox like /bin/dsync -Dv -u user(a)domian.com mirror maildir:/tmp/destination/mailboxes/user@domian.com -n inbox it throws different error: doveadm(user(a)domian.com): Debug: Namespace : Using permissions from /var/mailboxes/64/b1/user(a)domian.com: mode=0700 gid=default doveadm(user(a)domian.com): Fatal: execvp(maildir:/tmp/destination/mailboxes/user@domian.com) failed: No such file or directory dsync-local(user(a)domian.com): Error: read(remote) failed: EOF (version not received when /tmp/destination/mailboxes/user(a)domian.com directory exists What I’m doing wrong in the process? -- Adam

1 2

lmtp and virtual users
by David Wells - Alfavinil S.A. 02 Oct '19

02 Oct '19

Good afternoon. I have dovecot setup to authenticate virtual users using either gssapi or doind a bind to an ldap server to achieve a single sign on capable imap server connected to a samba active directory DC. What I am also trying to achieve is to have dovecot's lmtp daemon handle the mails passed from postfix. However, the only way I've gotten this to work is setting allow_all_users = yes in the userdb but this causes lmtp to deliver mails to non existant accounts without rejection. I've been searching but haven't found a way to set this same thing up but having dovecots lmtp check the validity of the mails recipient against the same samba AD DC through ldap before delivering it and rejecting unknown email addresses. Could someone please provide some insight into how to achieve this? Thank you very much in advance. Best regards, David Wells.

3 7

Unable to connect/authenticate after Debian SSL update
by paul 02 Oct '19

02 Oct '19

Just applied Debian SSL updates, due to vulnerabilities reported: "Package : openssl CVE ID : CVE-2019-1547 CVE-2019-1549 CVE-2019-1563 Three security issues were discovered in OpenSSL: A timing attack against ECDSA, a padding oracle in PKCS7_dataDecode() and CMS_decrypt_set1_pkey() and it was discovered that a feature of the random number generator (RNG) intended to protect against shared RNG state between parent and child processes in the event of a fork() syscall was not used by default. For the oldstable distribution (stretch), these problems have been fixed in version 1.1.0l-1~deb9u1. For the stable distribution (buster), these problems have been fixed in version 1.1.1d-0+deb10u1." I am running Buster. Upon installing these updates, Dovecot immediately stopped allowing authentication: Oct 1 16:47:11 relay monit[539]: 'dovecot' failed protocol test [IMAP] at [localhost]:993 [TCP/IP TLS] -- SSL connection error: error:00000000:lib(0):func(0):reason(0) Oct 1 16:50:22 relay monit[539]: 'dovecot' failed protocol test [IMAP] at [localhost]:993 [TCP/IP TLS] -- SSL connection error: error:00000000:lib(0):func(0):reason(0) and Oct 01 16:51:18 imap-login: Info: Disconnected: TLS initialization failed. (no auth attempts in 0 secs): user=<>, rip=71.198.57.170, lip=10.0.0.81, session=<0EdTB+KT+/NHxjmq> Each time this occurs, dovecot restarts: Oct 01 16:50:23 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) Oct 01 16:50:42 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) Oct 01 16:51:10 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) Oct 01 16:53:35 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) Oct 01 16:56:46 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) Oct 01 16:59:57 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) Oct 01 17:03:08 master: Info: Dovecot v2.3.7.2 (3c910f64b) starting up for pop3, imap (core dumps disabled) I am at a loss. Dovecot had been working fine for ages. It's not clear to me why a routine SSL update would completely break it. I'm unclear how to proceed. This is a small personal server, but nevertheless I have a number of people using it who rely on it. Here is my local.conf ( I added the ssl_protocols and ssl_min_protocol entries just a few minutes ago while attempting to resolve) auth_cache_size = 100 k auth_cache_ttl = 12 hours auth_cache_negative_ttl = 12 hours auth_cache_verify_password_with_worker=yes auth_verbose = yes auth_failure_delay = 7 secs default_client_limit = 500 default_process_limit = 50 default_vsz_limit = 100 M verbose_proctitle = yes protocols = pop3 imap pop3_uidl_format = %08Xu%08Xv imap_idle_notify_interval = 244 secs info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot-error.log maildir_very_dirty_syncs=yes mail_location = maildir:~/Maildir mailbox_idle_check_interval = 244 secs mailbox_list_index = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = passwd-file args = /etc/dovecot/deny deny = yes } passdb { driver = pam } userdb { driver = passwd } service auth { unix_listener auth-client { mode = 0660 user = Debian-exim } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } protocol imap { mail_max_userip_connections = 20 } service imap { unix_listener imap-master { user = dovecot } } imap_hibernate_timeout = 1 mins service imap { extra_groups = dovenull } service imap-hibernate { unix_listener imap-hibernate { mode = 0660 group = dovenull } } ssl = required ssl_protocols = TLSv1 TLSv1.1 TLSv1.2 ssl_min_protocol=TLSv1 ssl_dh=</etc/dovecot/dh.pem ssl_cert = </etc/letsencrypt/live/relay.anastrophe.com/fullchain.pem ssl_key = </etc/letsencrypt/live/relay.anastrophe.com/privkey.pem

1 1

Lost mails with sieve "duplicate" extension in case of failure
by Hanno Stock 01 Oct '19

01 Oct '19

Hi! we just experienced the following issue: We have a global sieve_before script using the duplicate extension. require ["duplicate", "imap4flags"]; if duplicate { discard; } Now the storage of our mailbox store got full and lmtp deliveries started to fail. This resulted in logs like this: Sep 25 16:14:56 mail-rc1 dovecot: lmtp(USERNAME): Error: o_stream_send_istream(/var/mail/vhosts/mail.COMPANY.com/USERNAME/.dovecot/t… failed: No space left on device Sep 25 16:14:56 mail-rc1 dovecot: lmtp(USERNAME): Error: write(/var/mail/vhosts/mail.COMPANY.com/USERNAME/.dovecot/tmp/1569420896.M6… failed: No space left on device Sep 25 16:14:56 mail-rc1 dovecot: lmtp(USERNAME): Error: KT9HJGB2i128FgAATXMPig: sieve: msgid=<redmine.journal-441799.20190925141453.94a97fd570706f2f(a)mail.COMPANY.com>: failed to store into mailbox 'INBOX': Internal error occurred. Refer to server log for more information. [2019-09-25 16:14:56] Sep 25 16:14:56 mail-rc1 dovecot: lmtp(USERNAME): Error: KT9HJGB2i128FgAATXMPig: sieve: Execution of script /mnt/data/var/mail/vhosts/mail.COMPANY.com/USERNAME/.sieve/.dovecot.sieve was aborted due to temporary failure (user logfile /mnt/data/var/mail/vhosts/mail.COMPANY.com/USERNAME/.sieve/.dovecot.sieve.log may reveal additional details) Sep 25 16:14:56 mail-rc1 postfix/lmtp[5851]: 4D27690AC: to=<USERNAME(a)mail.COMPANY.com>, orig_to=<USER.NAME(a)COMPANY.com>, relay=mail-rc1.bvd.COMPANY.x[private/dovecot-lmtp], delay=1.3, delays=1.3/0/0/0.01, dsn=4.2.0, status=deferred (host mail-rc1.bvd.COMPANY.x[private/dovecot-lmtp] said: 451 4.2.0 <USERNAME(a)mail.COMPANY.com> Internal error occurred. Refer to server log for more information. [2019-09-25 16:14:56] (in reply to end of DATA command)) So far, so good... A 451 response is what we wanted. However on the next delivery attempt the following happens: Sep 25 16:24:00 mail-rc1 postfix/lmtp[7040]: 4D27690AC: to=<USERNAME(a)mail.COMPANY.com>, orig_to=<USER.NAME(a)COMPANY.com>, relay=mail-rc1.bvd.COMPANY.x[private/dovecot-lmtp], delay=545, delays=545/0.09/0.02/0.01, dsn=2.0.0, status=sent (250 2.0.0 <USERNAME(a)mail.COMPANY.com> DBcCEYB4i11qGwAATXMPig Saved) Sep 25 16:24:00 mail-rc1 dovecot: lmtp(USERNAME): DBcCEYB4i11qGwAATXMPig: sieve: msgid=<redmine.journal-441799.20190925141453.94a97fd570706f2f(a)mail.COMPANY.com>: marked message to be discarded if not explicitly delivered (discard action) Sep 25 16:24:00 mail-rc1 postfix/lmtp[7040]: 4D27690AC: to=<USERNAME(a)mail.COMPANY.com>, orig_to=<USER.NAME(a)COMPANY.com>, relay=mail-rc1.bvd.COMPANY.x[private/dovecot-lmtp], delay=545, delays=545/0.09/0.02/0.01, dsn=2.0.0, status=sent (250 2.0.0 <USERNAME(a)mail.COMPANY.com> DBcCEYB4i11qGwAATXMPig Saved) As the duplicate extension has already seen the mail, it is now immediately discarded. RFC 7352 however explicitly states: Implementations MUST only update the internal duplicate-tracking list when the Sieve script execution finishes successfully. If failing script executions add the unique ID to the duplicate-tracking list, all "duplicate" tests in the Sieve script would erroneously yield "true" for the next delivery attempt of the same message. Dovecot seems not to honour this specification. Maybe this is because the "before_script" is not the script that fails, but the subsequent scripts fail? Am I missing some configuration option that would propagate the subsequent failure back to the before_script? Or is this a general limitation of the before_script mechanism? Any help appreciated how to alleviate this issue! Best regards Hanno --- Filesystem: ext4 Dovecot config: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 auth_cache_negative_ttl = 0 auth_cache_size = 1 M auth_cache_ttl = 2 hours auth_mechanisms = plain login auth_username_format = %Ln mail_gid = vmail mail_home = /var/mail/vhosts/mail.COMPANY.com/%n mail_location = maildir:~/.dovecot mail_plugins = " acl" mail_privileged_group = vmail mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader imapflags notify namespace { hidden = yes list = no location = maildir:~/.dovecot-top-namespace prefix = separator = . subscriptions = yes type = private } namespace { location = maildir:/var/mail/vhosts/mail.COMPANY.com/%%n/.dovecot:INDEXPVT=/var/mail/v… prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db sieve = file:/var/mail/vhosts/mail.COMPANY.com/%n/.sieve/sieve;active=/var/mail/vho… sieve_after = /var/mail/sieve/global-after.sieve sieve_before = /var/mail/sieve/global-before.sieve sieve_default = /var/mail/sieve/global.sieve sieve_extensions = +imapflags +notify +editheader sieve_global = /var/mail/sieve } protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0600 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_limit = 9000 } service imap { process_limit = 9000 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.COMPANY.com/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 30 mail_plugins = " acl imap_acl" } protocol sieve { mail_debug = yes }

2 2

Mailbox INBOX sync: mailbox_delete failed
by Alex La 01 Oct '19

01 Oct '19

Hi. When I run the backup I always get this error. ``` [root@mail.DOMAIN.com:~]# doveadm -o mail_fsync=never backup -D -R -u office(a)DOMAIN.com imapc: dsync(office(a)DOMAIN.com): Info: imapc(imap.mailbox.org:993): Connected to 2001:67c:2050:106::143:199:993 (local 2a01:4f8:c2c:6d05::1:59928) dsync(office(a)DOMAIN.com): Info: Mailbox deleted: Drafts dsync(office(a)DOMAIN.com): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. ``` The suggested solution from this mail works, but is this still the best solution for the error above? https://dovecot.org/pipermail/dovecot/2016-January/102988.html My versions are # 2.2.36.4 (baf9232c1): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24.2 (aaba65b7) # OS: Linux 3.10.0-1062.1.1.el7.x86_64 x86_64 CentOS Linux release 7.7.1908 (Core) Best regards Alex

2 2

Migration
by Hans Brage 01 Oct '19

01 Oct '19

Hi! I'm currently running an small imap-server on Dovecot 2.2.4 but will retire that server. I've set up an new server with Dovecot 2.3.4 and will migrate the mailboxes (maildir-format) from the old to the new server. I'm planning to restructure the accounts a bit when migrating so I need to move them one by one. Its only a few so thats not a big issue. Both servers are using virtual accounts (users file). I've understood that best method for migration is to run doveadm backup -R from the new server. But I really cant figure out what other parameters or settings that I need to perform that task and if it should be run as user vmail or root. Would be greatful for any tips, hints, links or similiar. Regards, Hans

6 9

Best way to move mail from one server to another
by James Brown 01 Oct '19

01 Oct '19

I’d like to migrate to a new server. I only need to transfer the mail store, have already done the users. I’ve seen different recommendations: IMAP-Sync Rsync Doveadmin backup and dsync What are the pros and cons of each? What would be best for me? I’m thinking that Doveadmin backup is the way to go. Both old and new servers are on same network. New server is running Dovecot 2.3.2.1, old server is 2.2.32. macOS X. Does anyone have any advice or examples? Thanks, James.

13 29

courier to dovecot migration
by tovises 01 Oct '19

01 Oct '19

I have a quite old home server based on Debian 6.x packages using courier imap server (exim4, fetchmail, courier, apache2, squirrelmail) to keep my and my wife emails (about 25G). I want renew my server to Debian 10 (buster) and got a recommendation to use dovecot instead of courier. For this purpose I'm using a different PC as a sandbox. Debian 10 currently offer dovecot version 2.3.4.1 Installation was "peaceful" but stuck with the migration. I have choose migration using dsync, from Wiki I was choose this command: For per-user user/passwords use: doveadm -o imapc_user=foo -o pop3c_user=foo -o imapc_password=bar -o pop3c_password=bar backup -R -u user@domain imapc: (foo and bar placed real username and password) But I get error: doveadm(tovis(a)nusi.tovis-lab.mydomain.org): Error: User doesn't exist Strongly I have no real domain, I'm using "freedns". "nusi" is the local name of my old server, "tovis-lab" is conjunction with "mydomain.org" choose from freedns. I was trying short as "nusi" which is in /etc/hosts file even ip address but the same result. 143 and 943 ports are working only inside the firewall (OpenWrt). I was checked using telnet courier on the "remote" box and dovecot on the localhost. I was able to login. What should I use as "user@domain" in this situation? tovis

4 10

Mail-crypt won't encrypt emails
by Serveria Support 01 Oct '19

01 Oct '19

Hi, We're running Dovecot 2.2.36 and we need to set up the mail-crypt plugin to encrypt all incoming and outgoing emails. Outgoing emails seem to get encrypted fine but the incoming ones don't. We tried everything including this config: mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_plugins = $mail_plugins mail_crypt plugin { mail_crypt_global_private_key = <ecprivkey.pem mail_crypt_global_public_key = <ecpubkey.pem mail_crypt_save_version = 2 } also this one: plugin { mail_crypt_curve = prime256v1 mail_crypt_save_version = 2 } but to no avail. There are no visible errors, Dovecot restarts fine and outgoing emails get encrypted. Any ideas?

1 0

Sieve replication - does not replicate
by Daniel Botting 30 Sep '19

30 Sep '19

Hi, I have two servers replicating mail as required, the directory structure (per user), however they will not replicate the sieve scripts directory: server 1 Maildir sieve server 2 Maildir Output of doveconf -n on server 1: # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -Pn > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/conf.d/10-ssl.conf:51: ssl_protocols has been replaced by ssl_min_protocol doveconf: Error: Could not find a minimum ssl_min_protocol setting from ssl_protocols = !SSLv2 !SSLv3: Unrecognized protocol 'SSLv2' doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -Pn > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/conf.d/10-ssl.conf:51: ssl_protocols has been replaced by ssl_min_protocol doveconf: Error: Could not find a minimum ssl_min_protocol setting from ssl_protocols = !SSLv2 !SSLv3: Unrecognized protocol 'SSLv2' # OS: Linux 4.19.0-6-amd64 x86_64 Debian 10.1 # Hostname: a_tld auth_verbose = yes default_vsz_limit = 0 doveadm_password = # hidden, use -P to show it first_valid_gid = 8 first_valid_uid = 8 last_valid_gid = 8 last_valid_uid = 8 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_gid = 8 mail_location = maildir:~/Maildir mail_plugins = " notify replication" mail_uid = 8 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader imapflags namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcps:a_tld:12345 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +editheader +imapflags } protocols = " imap sieve pop3" replication_max_conns = 4 service aggregator { fifo_listener replication-notify-fifo { user = mail } unix_listener replication-notify { user = mail } } service auth { unix_listener /var/run/dovecot-exim-bridge { mode = 0660 user = Debian-exim } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 512 process_min_avail = 4 service_count = 1 } service imap { process_limit = 1024 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 8 vsz_limit = 256 M } service managesieve { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </where/the_cert_is_installed/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap override_fields = home=/var/mail/%u uid=mail gid=mail } protocol lda { mail_plugins = " notify replication sieve" } protocol imap { mail_max_userip_connections = 32 mail_plugins = " notify replication" } protocol sieve { mail_max_userip_connections = 10 managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 } The only error message I can see in the logs (/var/log/mail.err) is, this is not for every user and is only occasionally: Sep 30 14:46:34 imap2 dovecot: lda(a_user)<1306><f0JXJjoHkl0aBQAAZJ7A9A>: Error: sieve: Failed to initialize script execution: Invalid postmaster_address: invalid address `postmaster@' specified for the postmaster_address setting Any suggestions would be much appreciated. Cheers -- Daniel

2 1

Only some encrypted mailboxes
by filbar＠centrum.cz 29 Sep '19

29 Sep '19

Hello I'm looking in plugin for encrypting mailboxes. Is possible to have encrypted only some of mailboxes and other not? Thanks, Filip Bartmann

1 0

dsync having problems with @-sign in mailbox names
by Philip Iezzi 28 Sep '19

28 Sep '19

Hi there We are running Cyrus-to-Dovecot migrations using dsync on destination Dovecot server (Debian Stretch / latest Dovecot 2.3.7.2 from community repo) like this: $ doveadm -o mail_fsync=never backup -R -u <username> imapc: For imapc configuration to connect to remote Cyrus server, see below [1]. While this works great for hundreds of mailaccounts, dsync fails with the following error on accounts with @-sign in mailbox names: dsync(<username>): Error: Failed to access mailbox INBOX/entrance/admin@example: Invalid mailbox name I can confirm, Dovecot supports @-sign in mailbox names and no client (tested with Thunderbird, Apple Mail, Roundcube webmail) has issue with this character. Also Cyrus was always supporting this. So I guess this is an issue with dsync. Can we somehow tune charset (UTF-8 ?) in imapc configuration? Thanks, Philip [1] /etc/dovecot/conf.d/90-migration.conf: ## IMAP imapc_host = imap.example.com imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = yes imapc_user = %u imapc_master_user = cyrus imapc_password = ********** imapc_features = rfc822.size fetch-headers mail_prefetch_count = 20 imapc_list_prefix = INBOX ## POP3 pop3c_host = pop3.example.com pop3c_port = 995 pop3c_ssl = pop3s pop3c_ssl_verify = yes pop3c_user = %u pop3c_master_user = cyrus pop3c_password = ********** namespace { prefix = POP3-MIGRATION-NS/ location = pop3c: list = no hidden = yes } protocol doveadm { mail_plugins = $mail_plugins pop3_migration } plugin { pop3_migration_mailbox = POP3-MIGRATION-NS/INBOX }

2 5