- dovecot - dovecot.org

Issue with POP3s TLS/SSL on port 995 on Outlook 2016
by Bhushan Bhosale 26 Apr '17

26 Apr '17

Dear Team, I'm facing issue with POP3s TLS/SSL on port 995 only for outlook2016. It's working fine with dovecot v2.2.28 on test environment. Is the dovecot v2.2.28 is stable released? I can upgrade the version from v2.1.17 to v2.2.28 on production if its stable version. Kindly confirm and provide the proper solution. Thanks and Regards, Bhushan Previous Mail:==========I have faced issue with email downloading in the email client by using pop3s SSL port 995 in dovecot v2.1.17 for outlook client 2016 on production environment. As per my troubleshooting on my test environment, I have upgraded dovecot version v2.2.28, and changed paramer "ssl_dh_parameters_length = 2048" and "verbose_ssl = yes", The issue seems to be resolved in dovecot v2.2.28. What can i do to resolve this issue in dovecot v2.1.17? Kindly help.

4 5

building Dovecot in Debian 9
by KT Walrus 26 Apr '17

26 Apr '17

I’m trying to build Dovecot 2.2.29.1 in a Docker container today and have the following error in ./configure: checking for shadow.h... yes checking for pam_start in -lpam... no checking for auth_userokay... no checking for mysql_config... mysql_config checking for mysql_init in -lmysqlclient... no configure: error: Can't build with MySQL support: libmysqlclient not found #> find / -name libmysqlclient\* /usr/share/doc/libmysqlclient20 /usr/share/lintian/overrides/libmysqlclient20 /usr/lib/x86_64-linux-gnu/libmysqlclient.so.20.3.5 /usr/lib/x86_64-linux-gnu/libmysqlclient.so.20 /var/lib/dpkg/info/libmysqlclient20:amd64.triggers /var/lib/dpkg/info/libmysqlclient20:amd64.shlibs /var/lib/dpkg/info/libmysqlclient20:amd64.list /var/lib/dpkg/info/libmysqlclient20:amd64.md5sums I have installed MySQL 5.7.18 Debian 9 packages (including the libmysqlclient-dev package) from the MySQL repo. I’m not an expert, but is there a bug in the "./configure --prefix=/usr --sysconfdir=/etc --with-mysql”? I’ve been building Dovecot with this Dockerfile using Ubuntu 16.04 for a while now without issue. Do I need some extra ./configure option to get it to find libmysqlclient.so.20? Kevin

2 7

Streaming out?
by Michael Segel 26 Apr '17

26 Apr '17

Hi, Has anyone tried to write out a mail stream to Kafka? Are there any good write ups on this feature? Can you split the mail so that you still write to a MailDir and also write to a stream? Thx -Mike

1 0

fts error recovery
by Daniel Miller 26 Apr '17

26 Apr '17

When a message is received, that is supposed to be added to the fts index, and an fts error occurs (like the Solr server is offline for some reason) - Dovecot logs that error and stores the message. Later, the fts system is available and new messages are added to the fts index without issue. Will the "missed" messages get added? Or would this require a manual re-indexing? -- Daniel

1 0

namespace alias issues?
by Kelsey Cummings 25 Apr '17

25 Apr '17

The Courier IMAP backwards compatibility section in the Namespaces wiki suggests that hidden aliased namespace can cause problems for some clients but doesn't quantify the extent or likelihood of running into these problems. Does anyone with real world experience with similar configurations have any feedback? -- kelsey.cummings(a)sonic.com sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

1 0

Host ... is being updated before previous update had finished
by Mark Moseley 24 Apr '17

24 Apr '17

We just had a bunch of backend boxes go down due to a DDoS in our director cluster. When the DDoS died down, our director ring was a mess. Each box had thousands (and hundreds per second, which is a bit much) of log lines like the following: Apr 03 19:59:29 director: Warning: director(10.1.20.10:9090/left): Host 10.1.17.15 is being updated before previous update had finished (up -> down) - setting to state=down vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.10:9090/left): Host 10.1.17.15 is being updated before previous update had finished (down -> up) - setting to state=up vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.10:9090/left): Host 10.1.17.15 is being updated before previous update had finished (up -> down) - setting to state=down vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.10:9090/left): Host 10.1.17.15 is being updated before previous update had finished (down -> up) - setting to state=up vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.10:9090/left): Host 10.1.17.15 is being updated before previous update had finished (up -> down) - setting to state=down vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.2:9090/right): Host 10.1.17.15 is being updated before previous update had finished (down -> up) - setting to state=up vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.2:9090/right): Host 10.1.17.15 is being updated before previous update had finished (up -> down) - setting to state=down vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.2:9090/right): Host 10.1.17.15 is being updated before previous update had finished (down -> up) - setting to state=up vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.2:9090/right): Host 10.1.17.15 is being updated before previous update had finished (up -> down) - setting to state=down vhosts=100 Apr 03 19:59:29 director: Warning: director(10.1.20.2:9090/right): Host 10.1.17.15 is being updated before previous update had finished (down -> up) - setting to state=up vhosts=100 This was on every director box and the status of all of the directors in 'doveadm director ring status' was 'handshaking'. Here's a sample packet between directors: 19:51:23.552280 IP 10.1.20.10.56670 > 10.1.20.1.9090: Flags [P.], seq 4147:5128, ack 0, win 0, options [nop,nop,TS val 1373505883 ecr 1721203906], length 981 Q. [f.|.HOST 10.1.20.10 9090 1006732 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006733 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006734 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006735 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006736 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006737 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006738 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006739 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006740 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006741 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006742 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006743 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006744 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006745 10.1.17.15 100 U1491260800 HOST 10.1.20.10 9090 1006746 10.1.17.15 100 D1491260800 HOST 10.1.20.10 9090 1006747 10.1.17.15 100 U1491260800 SYNC 10.1.20.10 9090 1011840 7 1491263483 3377546382 I'm guessing that D1491260800 is the user hash (with D for down), and the U version is for 'up'. I'm happy to provide the full tcpdump (and/or doveconf -a), though the tcpdump is basically all identical the one I pasted (same hash, same host). This seems pretty fragile. There should be some sort of tie break for that, instead of bringing the entire cluster to its knees. Or just drop the backend host completely. Or something, anything besides hosing things pretty badly. This is 2.2.27, on both the directors and backend. If the answer is upgrade to 2.2.28, then I'll upgrade immediately. I see commit a9ade104616bbb81c34cc6f8bfde5dab0571afac mentions the same error but the commit predates 2.2.27 by a month and a half. In the meantime, is there any doveadm command I could've done to fix this? I tried removing the host (doveadm director remove 10.1.17.15) but that didn't do anything. I didn't think to try to flush the mapping for that user till just now. I suspect that with the ring unsync'd, flushing the user wouldn't have helped. The only remedy was to kill dovecot on every box in the director cluster and then (with dovecot down on *all* of them) start dovecot back up. Restarting each director's dovecot (with other directors' dovecots still running) did nothing. Only by brining the entire cluster down did dovecot stop furiously logging "Host ... is being updated before previous update had finished" on every director host. Any advice is most welcome.

2 3

System load spike on dovecot reload
by dave＠evilcigi.eu 24 Apr '17

24 Apr '17

Hi everyone, I'm running dovecot with quite a lot of users and lots of active imap connections (like 20'000). I'm using different user IDs for users, so I need to have imap {service_count=1} - i.e. I have a lots of imap processes running. Everything works fine, until I reload dovecot configuration. When that happen, every client is forced to relogin in the same time and that causes a huge system load spike (2-3000 5 min load). I was thinking that it would be great, if dovecot wouldn't kick all the users in the same time during reload, but somehow gradually, during specified interval. I'm aware of the shutdown_clients directive that could help, but I don't like it - I do want the clients get disconnected on dovecot shutdown and also I want them to relogin in reasonably short time after reload. Is something like that possible with dovecot or does it make sense to implement that in the future versions? Thank you. Dave.

5 4

Feature Request - Director Balance
by Webert de Souza Lima 24 Apr '17

24 Apr '17

Hi, often I run into the situation where a dovecot server goes down for maintenance, and all users get concentrated in the remaining dovecot server (considering I have 2 dovecot servers only). When that dovecot server comes back online, director server will send new users to it, but the dovecot server that was up all the time will still have tons of clients mapped to it. I suggest the director servers to always try to balance load between servers, in the way: - if a server has several more connections than other, mark it to re-balance - when a user connected to this loaded server disconnects, map it to another server (that is per definition not the same server) immediately. that way it would gracefully re-balance, not killing existing connections, just waiting for them to finish. Thank you for your time. Webert Lima MAV Tecnologia Belo Horizonte, Brasil.

2 2

Dovecot 2.3 ?
by Reuben Farrelly 24 Apr '17

24 Apr '17

Hi, Is anyone here running dovecot-2.3 from hg? I'm just interested in finding out how people are going with it, how stable is it and are there any interesting features that make it worth spending time looking at. I'm in a position where I can test with semi-live data (backed up and moderately important but not mission critical) but before I take the plunge I'd like to find out what the general consensus is. I see pretty much all bugfixes from 2.2 are going into 2.3 as well... Is there any timeframe on a beta release? Thanks, Reuben

3 4

Public Folder Problems
by Kevin 24 Apr '17

24 Apr '17

Hi, I've been trying to get a Public Folder namespace working, so far without any luck. I've tried in my home folder, outside my home folder, with and without acl. I can see the namespace (PUBLIC) in Roundcube, but that's as far as I get. I've put a .FirstFolder under the location, but it never appears. I've added dirs cur, new, and tmp but no difference. No hints from the maillog. Could some kind soul please put me out of my misery! # 2.2.28 (bed8434): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-642.15.1.el6.x86_64 x86_64 CentOS release 6.9 (Final) auth_cache_size = 8 k auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" dict { expire = sqlite:/usr/local/cpanel/etc/dovecot/dovecot-dict-expire.conf.ext } first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes mail_access_groups = dovecot mail_location = maildir:~/mail mail_plugins = quota quota_clone mail_prefetch_count = 20 mailbox_list_index = yes maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = no special_use = \Trash } mailbox not-Spam { auto = create } prefix = INBOX. separator = . type = private } namespace one { list = yes location = maildir:/var/spool/pubmail prefix = PUBLIC. separator = . type = public } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } plugin { acl = vfile expire = Trash expire2 = Deleted Messages expire3 = INBOX.Deleted Messages expire4 = INBOX.Trash expire_cache = yes expire_dict = proxy::expire quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded zlib_save = gz } protocols = lmtp imap service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 500 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota expire imap_zlib quota_clone virtual namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota expire quota quota_clone virtual namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone postmaster_address = root quota_full_tempfail = no }

1 1

[BUG] client state / Message count mismatch with imap-hibernate and mixed POP3/IMAP access
by Christian Balzer 24 Apr '17

24 Apr '17

Hello, this is on Debian Jessie box, dovecot 2.2.27 from backports, imap-hibernate obviously enabled. I've been seeing a few of these since starting this cluster (see previous mail), they all follow the same pattern, a user who accesses their mailbox with both POP3 and IMAP deletes mails with POP3 and the IMAP (imap-hibernate really) is getting confused and upset about this: --- Apr 6 09:55:49 mbx11 dovecot: imap-login: Login: user=<redacted(a)gol.com>, method=PLAIN, rip=xxx.xxx.x.46, lip=xxx.xxx.x.113, mpid=951561, secured, session=<2jBV+HRM1Pbc9w8u> Apr 6 10:01:06 mbx11 dovecot: pop3-login: Login: user=<redacted(a)gol.com>, method=PLAIN, rip=xxx.xxx.x.46, lip=xxx.xxx.x.41, mpid=35447, secured, session=<uZw7C3VM9vfc9w8u> Apr 6 10:01:07 mbx11 dovecot: pop3(redacted(a)gol.com): Disconnected: Logged out top=0/0, retr=0/0, del=1/1, size=20674 session=<uZw7C3VM9vfc9w8u> Apr 6 10:01:07 mbx11 dovecot: imap(redacted(a)gol.com): Error: imap-master: Failed to import client state: Message count mismatch after handling expunges (0 != 1) Apr 6 10:01:07 mbx11 dovecot: imap(redacted(a)gol.com): Client state initialization failed in=0 out=0 head=<0> del=<0> exp=<0> trash=<0> session=<2jBV+HRM1Pbc9w8u> Apr 6 10:01:15 mbx11 dovecot: imap-login: Login: user=<redacted(a)gol.com>, method=PLAIN, rip=xxx.xxx.x.46, lip=xxx.xxx.x.113, mpid=993303, secured, session=<6QC6C3VMF/jc9w8u> Apr 6 10:07:42 mbx11 dovecot: imap-hibernate(redacted(a)gol.com): Connection closed in=85 out=1066 head=<0> del=<0> exp=<0> trash=<0> session=<6QC6C3VMF/jc9w8u> --- Didn't see these errors before introducing imap-hibernate, but then again this _could_ be something introduced between 2.2.13 (previous generation of servers) and .27, but I highly doubt it. My reading of the log is that the original IMAP session (<2jBV+HRM1Pbc9w8u>) fell over and terminated, resulting in the client to start up a new session. If so and with no false data/state transmitted to the client it would be not ideal, but not a critical problem either. Would be delighted if Aki or Timo could comment on this. If you need any further data, let me know. Christian -- Christian Balzer Network/Systems Engineer chibi(a)gol.com Global OnLine Japan/Rakuten Communications http://www.gol.com/

2 5

How to query for headers by regexp?
by Ralf Hildebrandt 23 Apr '17

23 Apr '17

I need to find all mails with a certain numerical range in my quarantine: X-Spam-Status: No, score=4.5 tagged_above=2 required=4.6 ... Assume I'd be looking for 4.5-6.0; so I tried searching for doveadm import -u restore mdbox:/home/quarantine/mdbox "" \ mailbox INBOX header X-Spam-Status "No, score=4.5" doveadm import -u restore mdbox:/home/quarantine/mdbox "" \ mailbox INBOX header X-Spam-Status "No, score=4.6" etc. Which would only return 2 Mails, with score score=4.5 What am I doing wrong here? Can I search using regular expressions? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

2 1

Is there a tool similar to pflogsumm for Dovecot?
by Paolo 22 Apr '17

22 Apr '17

I tried to find a similar tool for Dovecot, but couldn't. Is there such a thing? Also tried to hack a little the logwatch plugin, but I am not a per programmer ... Thanks, P.

1 0

imap service count>1 (was System load spike ...)
by Joseph Tam 22 Apr '17

22 Apr '17

> I'm running dovecot with quite a lot of users and lots of active imap > connections (like 20'000). I'm using different user IDs for users, so I > need to have imap {service_count=1} - i.e. I have a lots of imap > processes running. I had a misconception this service's service_count was non-adjustable. (https://wiki.dovecot.org/Services on imap service) service_count can be changed from 1 if only a single UID is used for mail users. This is improves performance, but it's less secure, because bugs in code may leak email data from another user's earlier connection. How easy would it be to implement a hybrid solution that maps all imap service for a unique UID to a single worker process. It would result in modest performance gain for busy servers, and data leakage security would be minimal. Joseph Tam <jtam.home(a)gmail.com>

1 0

Pipe to PHP script using Sieve Extprograms
by Thomas 21 Apr '17

21 Apr '17

Hello, I seem to be having some issues trying to setup a pipe to PHP scripts using Sieve Extprograms. I am trying to allow each individual mailbox to setup its own PHP pipe rules (in other words, each user should be able to pipe incoming emails to a user defined PHP script). I have the following lines in my main Sieve configuration file (/etc/dovecot/conf.d/90-sieve.conf): sieve_extensions = +vnd.dovecot.pipe sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_plugins = sieve_extprograms I have configured a Sieve service that looks like this (/etc/dovecot/conf.d/90-sieve-extprograms.conf): service php { # Define the executed script as parameter to the sieve service executable = /var/run/dovecot/sieve-pipe/php.sh # Use some unprivileged user for executing the program user = dovenull # The unix socket located in the sieve_pipe_socket_dir (as defined in the # plugin {} section above) unix_listener sieve-pipe/php { # LDA/LMTP must have access user = vmail mode = 0600 } } Contents of /var/run/dovecot/sieve-pipe/php.sh: #!/usr/bin/php Sieve script for one of my mailboxes: require ["fileinto", "regex", "date", "relational", "vacation"]; require ["mailbox", "imap4flags", "vnd.dovecot.pipe"]; # Move spam to spam folder if header :contains "X-Spam-Flag" "YES" { fileinto "Junk"; # Stop here so that we do not reply on spams stop; } pipe :try "php /var/www/web2/piping.php support(a)example.com" keep; This results however in the following error in my log file: main script: line 5: error: require command: unknown Sieve capability `vnd.dovecot.pipe'. main script: line 14: error: unknown command 'pipe' (only reported once at first occurence). main script: error: validation failed. I am also not quite confident I have set this up correctly. Am I heading in the right direction for what I am trying to achieve? Dovecot version: 2.2.10 dovecot -n: # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.16.1.el7.x86_64 x86_64 CentOS Linux release 7.3.1611 (Core) auth_mechanisms = plain login disable_plaintext_auth = no listen = *,[::] log_timestamp = "%Y-%m-%d %H:%M:%S " mail_plugins = " quota" mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot-sql.conf driver = sql } plugin { quota = dict:user::file:/var/vmail/%d/%n/.quotausage sieve = /var/vmail/%d/%n/.sieve } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service imap-login { client_limit = 1000 process_limit = 500 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/postfix/smtpd.cert ssl_key = </etc/postfix/smtpd.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /etc/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = sieve quota postmaster_address = root@localhost } protocol lmtp { mail_plugins = quota sieve postmaster_address = webmaster@localhost }

2 2

namespace assertion failed
by Elisamuel Resto 21 Apr '17

21 Apr '17

Hello, I'm trying to figure out if this is a configuration issue or an actual bug. Dovecot does start, but if anybody tries to log in or if you run sievec you get an assertion fail and a coredump. --- sievec(root): Panic: file mail-namespace.c: line 709 (mail_namespace_find): assertion failed: (ns != NULL) sievec(root): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9c3a2) [0x7ff70e2133a2] -> /usr/lib/dovecot/libdovecot.so.0(+0x9c429) [0x7ff70e213429] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff70e1a5e41] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_namespace_find+0xc8) [0x7ff70e4e03a8] -> /usr/lib/dovecot/modules/lib11_trash_plugin.so(+0x1e56) [0x7ff70d5ace56] -> /usr/lib/dovecot/libdovecot-storage.so.0(hook_mail_user_created+0x1eb) [0x7ff70e4ecfeb] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_init+0x206) [0x7ff70e4f1fb6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_service_next+0x438) [0x7ff70e4f00c8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_service_lookup_next+0x4c) [0x7ff70e4f068c] -> sievec(sieve_tool_init_finish+0xc1) [0x403371] -> sievec(main+0xd2) [0x402cb2] -> /usr/lib/libc.so.6(__libc_start_main+0xf1) [0x7ff70ddf3511] -> sievec(_start+0x2a) [0x402f3a] Aborted (core dumped) --- Coredump as follows: --- #0 0x00007ff70de06a10 in raise () from /usr/lib/libc.so.6 #1 0x00007ff70de0813a in abort () from /usr/lib/libc.so.6 #2 0x00007ff70e21339a in ?? () from /usr/lib/dovecot/libdovecot.so.0 #3 0x00007ff70e213429 in default_fatal_handler () from /usr/lib/dovecot/libdovecot.so.0 #4 0x00007ff70e1a5e41 in i_panic () from /usr/lib/dovecot/libdovecot.so.0 #5 0x00007ff70e4e03a8 in mail_namespace_find () from /usr/lib/dovecot/libdovecot-storage.so.0 #6 0x00007ff70d5ace56 in ?? () from /usr/lib/dovecot/modules/lib11_trash_plugin.so #7 0x00007ff70e4ecfeb in hook_mail_user_created () from /usr/lib/dovecot/libdovecot-storage.so.0 #8 0x00007ff70e4f1fb6 in mail_user_init () from /usr/lib/dovecot/libdovecot-storage.so.0 #9 0x00007ff70e4f00c8 in mail_storage_service_next () from /usr/lib/dovecot/libdovecot-storage.so.0 #10 0x00007ff70e4f068c in mail_storage_service_lookup_next () from /usr/lib/dovecot/libdovecot-storage.so.0 #11 0x0000000000403371 in sieve_tool_init_finish () #12 0x0000000000402cb2 in main () --- Any help appreciated! -Sam

3 3

[BUG] config-parser.c: line 89 - crash on comma in namespace mailbox
by Alek 21 Apr '17

21 Apr '17

Hi! On the latest versions (2.2.28, 2.2.29.x) we get crash on dovecot config parse. Error in config parser when checking namespace mailbox name. Reason: comma in mailbox name. Worked well in versions < 2.2.22. Do not know if it was working on 2.2.23-2.2.27, skipped this versions. Example: namespace inbox { mailbox "&BB4EQgQ,BEAEMAQyBDsENQQ9BD0ESwQ1-" { special_use = \Sent } } Error: # dovecot -n # 2.2.29.1 (e0b76e3): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.18 (29cc74d) doveconf: Panic: file config-parser.c: line 89 (config_add_type): assertion failed: (ret > 0) doveconf: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9b89a) [0x7fa1f8cc789a] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7fa1f8cc81d2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x2f81a) [0x7fa1f8c5b81a] -> /usr/bin/doveconf() [0x40b213] -> /usr/bin/doveconf(config_parser_apply_line+0x763) [0x40b983] -> /usr/bin/doveconf(config_parse_file+0x821) [0x40c351] -> /usr/bin/doveconf(main+0x255) [0x406845] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7fa1f88b6d1d] -> /usr/bin/doveconf() [0x4051f9] doveconf: Error: managesieve-login: dump-capability process killed with signal 6 doveconf: Panic: file config-parser.c: line 89 (config_add_type): assertion failed: (ret > 0) doveconf: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9b89a) [0x7f6dfa20489a] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f6dfa2051d2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x2f81a) [0x7f6dfa19881a] -> /usr/bin/doveconf() [0x40b213] -> /usr/bin/doveconf(config_parser_apply_line+0x763) [0x40b983] -> /usr/bin/doveconf(config_parse_file+0x821) [0x40c351] -> /usr/bin/doveconf(main+0x255) [0x406845] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f6df9df3d1d] -> /usr/bin/doveconf() [0x4051f9] Info: &BB4EQgQ,BEAEMAQyBDsENQQ9BD0ESwQ1- - is a valid mailbox name for russian Outlook folder "Отправленные".

2 1

LDAP schema ?
by Dave Dodd 21 Apr '17

21 Apr '17

Hi, I am trying to determine the correct LDAP schema I need to use to have either mailLocation or mailboxPath available ? Should I be just adding this to one of my own custom objectClasses ? -- Dave

4 5

javamail imap listing
by Matthew Broadhead 20 Apr '17

20 Apr '17

Hi, i am using dovecot-2.2.10-7.el7.x86_64 on centos-release-7-3.1611.el7.centos.x86_64. if i follow this tutorial https://delog.wordpress.com/2011/05/10/access-imap-server-from-the-command-… i can login to my server and successfully list the folders using tag LIST "" "*" * LIST (\HasNoChildren) "." INBOX tag OK List completed. no folders are listed using tag LIST / "*" tag OK List completed. when i request a folder listing using JavaMail it similarly sends the following command and no folders are listed a97 LIST / "*" a97 OK List completed. if i follow the tutorial again and use my gmail account instead of my dovecot installation i can successfully list folders using both methods tag LIST / "*" * LIST (\HasNoChildren) "/" "youtube" tag OK List completed. is there some way to make dovecot list folders when it receives the command LIST / "*" i note that in the listings my dovecot installation has "." in the middle and gmail has a "/"

3 5

JavaMail setFlags on readonly folder
by Gabriele Bulfon 20 Apr '17

20 Apr '17

Hi, I'm facing a strange issue using JavaMail, where Dovecot let me open "READ_WRITE" a folder with readonly ACLs (same happens on other imap servers), but then doesn't issue any error when if try to setFlags(...) on that folder. The result is that the code thinks the folder marked the messages (deleted, flagged, etc), while it actually did not. Just refreshing the folder from the java client, you get back your original messages as they were before the operation. Is there any known issue about this? Gabriele ---------------------------------------------------------------------------------------- Sonicle S.r.l. : http://www.sonicle.com Music: http://www.gabrielebulfon.com Quantum Mechanics : http://www.cdbaby.com/cd/gabrielebulfon

2 1

Dovecot not listening when testing connection
by Alvaro Lacerda 20 Apr '17

20 Apr '17

Hi, This is my environment: SMTP: Exim 4.89 with Mailscanner 5.0.3 IMAP: Dovecot 2.2.10 At the moment I'm just trying to test out my Dovecot to check if it's listening on port 993. *netstat -tuln:* Shows that my machine is listening on ports 143 and 993. *telnet localhost 993: *This is my issue, I get the following message: # telnet localhost 993 Trying ::1... Connected to localhost. Escape character is '^]'. Connection closed by foreign host. According to the wiki.dovecot test installation page I should be getting this instead: https://wiki.dovecot.org/TestInstallation Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. When I run doveconf this is what I get: # doveconf protocols listen protocols = imap pop3 lmtp listen = *, :: Does anyone have an idea of what I'm missing here? Thanks. -- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of this information by persons or entities other than the intended recipient is prohibited. If you receive this in error, please contact the sender and delete this material from any computer. Cantella does not permit execution of trades requested by email. Please call to ensure prompt execution of orders, as we are not responsible for orders transmitted through email. Investing involves risk and you may incur a profit or a loss. Please carefully consider investment objectives, risks, charges, and expenses before investing. Cantella & Co., Inc. does not provide legal or tax advice. For legal or tax advice, please seek the services of a qualified professional. The performance data featured represents past performance, which is no guarantee of future results. Mutual funds and UITs are sold by prospectus only. Please carefully consider the fund's investment objective, risks, charges and expenses applicable to a continued investment in the fund before investing. For this and other information, call or write for a free prospectus, or view one online. Read it carefully before you invest or send money. Fixed income is subject to availability and change in price. Bonds are subject to market and interest rate risk if sold prior to maturity. Interest rate increases can cause the price of a debt security to decrease. Interest income may be subject to federal, state, local, and/or alternative minimum tax. In accordance with industry regulations, all messages are retained and are subject to monitoring. This message has been scanned for viruses and dangerous content and is believed to be clean. Securities offered through Cantella & Co., Inc., Member FINRA/SIPC. Home Office: 28 State St 40th Floor, Boston, MA 02109 Telephone: (800)652-8358

3 8

Using filter in an imapsieve script?
by Tobi 20 Apr '17

20 Apr '17

Hello list I currently have an issue with an imapsieve script on my dovecot server CentOS Linux release 7.3.1611 (Core) Dovecot 2.2.26.0 (23d1de6) Pigeonhole 2.2.26.0 The goal is to "fire" an imapsieve script upon mailclient saves message to sent folder I setup the following in 90-plugin.conf: plugin { sieve_plugins = sieve_imapsieve sieve_extprograms sieve_extensions = +vnd.dovecot.filter +vnd.dovecot.pipe +vnd.dovecot.execute sieve_filter_bin_dir = /etc/dovecot/sieve-filters sieve_pipe_bin_dir = /etc/dovecot/sieve-filters sieve_execute_bin_dir = /etc/dovecot/sieve-filters sieve_filter_exec_timeout = 10000 sieve_pipe_exec_timeout = 10000 sieve_execute_exec_timeout = 10000 imapsieve_mailbox1_name = Sent imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/home/vmail/domain/user/dovecot-crypt-sent.sieve } and the content of the sieve script is: require ["environment", "vnd.dovecot.filter", "variables", "imapsieve", "vnd.dovecot.pipe", "vnd.dovecot.execute"]; if anyof (environment :is "imap.cause" "APPEND", environment :is "imap.cause" "COPY") { filter "gpgit" "myuser(a)mydomain.tld"; } gpgit is a perl script that encrypts a given message using the users pub key and returns back the encrypted message As a sieve script for lmtp/lda it works fine and encrypted messages show up in the mailbox. But it does not work if it is used as imap sieve script There is nothing in the logs that indicates a problem with the imap sieve script. Is it possible that 'filter' is not supported for imapsieve as it changes the content of a message? Thanks for any hint tobi

2 6

RSA key not found
by Michael Segel 20 Apr '17

20 Apr '17

I’ve got a couple of issues with a new mail server set up… I’m getting the following error: warning: cannot get RSA certificate from file /etc/pki/dovecot/certs/<mycert>.pem: disabling TLS support The problem is that <mycert>.pem isn’t an RSA ticket, but a X509 certificate. The RSA ticket is in /etc/pki/dovecot/private directory. I checked both files and they are good certificates. I’m using webmin to manage my server. In webmin, the TLS certificate file is the X509 and the private key is the RSA file. So why does Postfix check the certificate link for the RSA file and not the X509? Thx -Mike

2 1

Adding secure POP3?
by ＠lbutlr 20 Apr '17

20 Apr '17

I have a working server that only allows connections over secure IMAP (port 993) and secured submission (587). However, I have one account that has been forwarding mail to gmail for many years and that is getting to be more and more of a problem as more large sites enforce DMARC. So, the only way that gmail will pull mail is via pop3, so I need to add pop3 access. 1) How do I add a secure (TLS) POP3 service to dovecot 2) can I restrict access to that to specific users? Domains? OT, but someone probably knows, is secured POP3 going to work with gmail? ===BEGIN passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ===END I did read <https://wiki.dovecot.org/SSL/DovecotConfiguration> but it’s about adding ssl to an existing setup. -- Apple broke AppleScripting signatures in Mail.app, so no random signatures.

3 5

help
by Bhushan Bhosale 20 Apr '17

20 Apr '17

Dear Team I have faced issue with email downloading in the email client by using pop3 SSL port 995 in dovecot v2.1.17 for outlook client 2016 on production environment. As per my troubleshooting on my test environment, I have upgraded dovecot version v2.2.28, and changed paramer "ssl_dh_parameters_length = 2048" and "verbose_ssl = yes", The issue seems to be resolved in dovecot v2.2.28. What can i do to resolve this issue in dovecot v2.1.17 in Production environment? Kindly help. Thanks a lot in advance. Regards, Bhushan Bhosale

4 3

my domain in both my destination and virtual_mailbox_domains?
by Michael Segel 20 Apr '17

20 Apr '17

I’m doing a new dovecot mail server for my domain. Here’s yet another thing I mucked up. I wanted to set up virtual mailboxes. One reason was that I wanted to set up virtual users for the domain so I don’t need to create user accounts just mail accounts. I followed one of the many examples / tutorials out there and I end up with the following warning message. postfix/trivial-rewrite[8818]: warning: do not list domain <machine>.<domain>.com in BOTH mydestination and virtual_mailbox_domains I checked my configuration, I don’t see where I’ve set up anything for mydestination in postfix. I’m trying to work thru the log file issues that I can find… this is just one more. To add to the confusion, I’m using webmin as my server admin UI to make life easier… yet it seems to much things up a bit Any suggestions? Thx -Mike

4 3

[Configuration question] Shared Folders: sql dict - missing information
by dovecot＠avv.solutions 19 Apr '17

19 Apr '17

Hello Community, I have implemented shared folders/acl using the 'file' driver sucessfully. Now, I want to move the shared folders information to my sql DB where I have moved all user/nets/quota information. I have read carefully the documentation (https://wiki.dovecot.org/SharedMailboxes/Shared) but, as far as I can see, only the $to and $from (+ dummy) are handled in the DB? I was expecting the same granularity (per folder + explicit rights) than found using the actual solution. Did I miss something? Or how should I implement this? (Running version 2.2.13) Than you already for your help and feedback. Cheers, A

2 1

Extension record update for invalid uid=
by Luca Bertoncello 18 Apr '17

18 Apr '17

Hi list yesterday I got many of these errors: Error: Log synchronization error at seq=832,offset=2348 for indexes/.INBOX/dovecot.index: Extension record update for invalid uid=29175 But just for __ONE__ user. I couldn't find any misconfiguration for this user, it's just all other... Can someone say what it happens and how can I fix it? Thanks Luca Bertoncello (lucabert(a)lucabert.de)

1 0

v2.2.29.1 released
by Timo Sirainen 17 Apr '17

17 Apr '17

https://dovecot.org/releases/2.2/dovecot-2.2.29.1.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.29.1.tar.gz.sig Mainly because I had missed one cherry-pick from the release, which caused unit tests to also fail. And I didn't notice that, because make distcheck had been broken for some years now when it ran clang static analyzer, although I had assumed it would have run make check already before it failed.. On a related note, we're looking for a test engineer :) http://avoimettyopaikat.monster.fi/v2/job/View?JobID=182881783 - imapc reconnection fix was forgotten from 2.2.29 release, which also made "make check" fail in a unit test - dict-sql: Merging multiple UPDATEs to a single statement wasn't actually working. - Fixed building with vpopmail

5 5

Re: several misc questions, public folders and sharing, quota, ssl
by Aki Tuomi 16 Apr '17

16 Apr '17

Please keep responses on the list. Thank you. =) Without ACL plugin there is no way to restrict access, it's free for all. my site is a very tiny few user site, but ... auth_mechanisms = login plain mail_attribute_dict = file:%h/Mail/dovecot-attributes mail_location = sdbox:~/Mail mail_plugins = stats quota fts fts_lucene namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = lucene fts_lucene = whitespace_chars=@. imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * quota = count:User quota quota_vsizes = yes recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms stats_refresh = 30 } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } user = $default_internal_user } service doveadm { inet_listener http { address = 127.0.0.1 port = 38080 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 8025 } } service stats { fifo_listener stats-mail { mode = 0666 } } ssl = required ssl_cert = # ssl_cipher_list = ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES256-GCM-SHA384:AES256-SHA256:AES256-SHA:AES128-SHA ssl_dh_parameters_length = 4096 ssl_key = # ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 submission_host = 127.0.0.1:25 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = stats quota fts fts_lucene imap_stats imap_sieve } protocol lmtp { mail_plugins = stats quota fts fts_lucene sieve } protocol lda { mail_plugins = stats quota fts fts_lucene sieve } Aki > On April 14, 2017 at 7:21 PM David Mehler <dave.mehler(a)gmail.com> wrote: > > > Hello Aki, > > Thank you for your reply. > > I've implemented your changes and thanks for the @STRENGTH reminder, I > had forgotten about that one. > > I'll check out the acl plugin. Is it required when sharing a public > folder or are public folders usable by all? I know it is for shared > folders. > > The TestFolder1 is still not showing up in public not sure why > everything looks good. > > My configuration was migrated from 2.0 to 2.1 then 2.2, various ports > along the way. > > I was wondering if I could take a look at your dovecot configuration > files and a doveconf -n output? > > Thanks. > Dave. > > > On 4/14/17, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > > > >> On April 14, 2017 at 3:04 AM David Mehler <dave.mehler(a)gmail.com> wrote: > >> > >> > >> Hello, > >> > >> I'm running dovecot 2.29 on a freebsd 10.3 system. I'm wanting to > >> optimize how the system is running and have a few misc questions. > >> > >> First ssl, is my cipher list good? I'm trying for pfs and wanting to > >> ensure these cipherlist is appropriate: > >> > >> ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH > >> > > > > I would add @STRENGTH to the end, so it'll get sorted by strengthness. > > > >> Next, a new feature that I'm trying for is virtual folders that store > >> All messages. My understanding of this is that it stores a version of > >> every received message in one place? I've got the virtual plugin > >> loaded and have: > >> > >> mailbox virtual/All { > >> comment = All my messages > >> special_use = \All > >> } > >> > >> I've got a directory /home/vmail/example.com/username/virtual under > >> which is an ALL folder both directories are accessible to the vmail > >> user, yet there's no contents in this folder and it's showing up > >> nowhere. > >> > > > > Configuring virtual all folder: > > > > namespace { > > prefix = virtual > > location = virtual:/etc/dovecot/virtual:INDEX=%h/virtual > > comment = All my messages > > special_use = \All > > mailbox All { > > auto = subscribe > > } > > } > > > > ==== /etc/dovecot/virtual/All/dovecot-virtual ==== > > * > > all > > ==== EOF === > > > >> Next, quota warnings, are not being sent at all. I set up a testuser > >> with a quota of 2 mb, then sent a message to that user getting the box > >> to 95% full, and no message. Took the user overquota with the next > >> message, still nothing, and a third message did trigger my custom > >> quota exceeded message and the message was bounced. > >> > > > > I would recommend you using > > > > mail_plugins = $mail_plugins quota quota_clone > > > > plugin { > > quota = count:User quota > > quota_clone_dict = proxy::sqlquota > > quota_vsizes = true > > } > > > > Also, > > > > "Note that the warning is ONLY executed at the exact time when the limit is > > being crossed, so when you're testing it you have to do it by crossing the > > limit by saving a new mail. If something else besides Dovecot updates quota > > so that the limit is crossed, the warning is never executed." > > > >> I'm wanting to implement public folders. My mailboxes are all > >> virtual, and they are stored under /home/vmail/example.com/username > >> and /home/vmail/example.org/username in the maildir format. I've got > >> one user uid and gid of 999 name of vmail who owns all the mailboxes. > >> I've separated out public folders storing them under > >> /home/vmail/public. I've created one mailbox called TestFolder and > >> new, cur, and tmp directories under it. This is what it looks like: > > > > <snip /> > > > >> The public/TestFolder is showing up fine and I can switch to it. The > >> public/TestFolder1 is not showing up at all so I'm not seeing it and > >> can't switch to it. Any ideas? > >> > > > > Not sure why it's not showing up, *but*, you could add :INDEXPVT=%h/public > > to the folder, to keep per-user indexes separate. > > > >> My second question involves public folders and domain sharing. Are > >> public folders accessible to all users and all domains? I've got two > >> domains example.com and example.org i'd like to create a folder that > >> some users in example.com can share with some users in example.org, > >> not necessarily all users in those domains should be able to see the > >> folders. > >> > > > > Dovecot does not, as per such, care about your domains. It cares about user > > names. If you want to do this kind of thing, please consult ACL plugin. > > https://wiki2.dovecot.org/ACL > > > >> Ideas welcome. > >> > >> Thanks. > >> Dave. > >> > > > > Some other comments, if you are using SSL, you can drop cram-md5 as auth > > mech, it's not storage-safe. > > > > you should use mail_location = maildir:~/maildir:LAYOUT=fs > > > > to avoid your other things in user's home being interprepted as mail > > directories. > > > > why are you setting these? > > maildir_broken_filename_sizes = yes > > maildir_empty_new = yes > > maildir_very_dirty_syncs = yes > > > > and in general I see lots of overconfiguring, dovecot defaults are usually > > right, and setting various things just for the fun of it, can cause > > problems. > > > > Aki > >

3 3

several misc questions, public folders and sharing, quota, ssl
by David Mehler 15 Apr '17

15 Apr '17

Hello, I'm running dovecot 2.29 on a freebsd 10.3 system. I'm wanting to optimize how the system is running and have a few misc questions. First ssl, is my cipher list good? I'm trying for pfs and wanting to ensure these cipherlist is appropriate: ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH Next, a new feature that I'm trying for is virtual folders that store All messages. My understanding of this is that it stores a version of every received message in one place? I've got the virtual plugin loaded and have: mailbox virtual/All { comment = All my messages special_use = \All } I've got a directory /home/vmail/example.com/username/virtual under which is an ALL folder both directories are accessible to the vmail user, yet there's no contents in this folder and it's showing up nowhere. Next, quota warnings, are not being sent at all. I set up a testuser with a quota of 2 mb, then sent a message to that user getting the box to 95% full, and no message. Took the user overquota with the next message, still nothing, and a third message did trigger my custom quota exceeded message and the message was bounced. I'm wanting to implement public folders. My mailboxes are all virtual, and they are stored under /home/vmail/example.com/username and /home/vmail/example.org/username in the maildir format. I've got one user uid and gid of 999 name of vmail who owns all the mailboxes. I've separated out public folders storing them under /home/vmail/public. I've created one mailbox called TestFolder and new, cur, and tmp directories under it. This is what it looks like: ls -la /home/vmail/public total 24 drwx------ 4 vmail vmail 512 Apr 13 18:23 ./ drwx------ 8 vmail vmail 512 Mar 15 10:34 ../ drwxr-xr-x 5 vmail vmail 512 Apr 13 18:16 TestFolder/ drwxr-xr-x 5 vmail vmail 512 Apr 13 18:25 TestFolder1/ -rw------- 1 vmail vmail 8 Apr 13 18:15 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 Apr 13 18:15 dovecot-uidvalidity.58eff89a -rw------- 1 vmail vmail 688 Apr 13 18:24 dovecot.list.index.log ls -la /home/vmail/public/TestFolder total 28 drwxr-xr-x 5 vmail vmail 512 Apr 13 18:16 ./ drwx------ 4 vmail vmail 512 Apr 13 18:23 ../ drwxr-xr-x 2 vmail vmail 512 Apr 13 18:13 cur/ -rw-r--r-- 1 vmail vmail 51 Apr 13 18:16 dovecot-uidlist -rw-r--r-- 1 vmail vmail 304 Apr 13 18:16 dovecot.index.log drwxr-xr-x 2 vmail vmail 512 Apr 13 18:13 new/ drwxr-xr-x 2 vmail vmail 512 Apr 13 18:13 tmp/ ls -la /home/vmail/public/TestFolder1 total 20 drwxr-xr-x 5 vmail vmail 512 Apr 13 18:25 ./ drwx------ 4 vmail vmail 512 Apr 13 18:23 ../ drwxr-xr-x 2 vmail vmail 512 Apr 13 18:25 cur/ drwxr-xr-x 2 vmail vmail 512 Apr 13 18:25 new/ drwxr-xr-x 2 vmail vmail 512 Apr 13 18:25 tmp/ The public/TestFolder is showing up fine and I can switch to it. The public/TestFolder1 is not showing up at all so I'm not seeing it and can't switch to it. Any ideas? My second question involves public folders and domain sharing. Are public folders accessible to all users and all domains? I've got two domains example.com and example.org i'd like to create a folder that some users in example.com can share with some users in example.org, not necessarily all users in those domains should be able to see the folders. Ideas welcome. Thanks. Dave. doveconf -n # 2.2.29 (13ebc01): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.18 (29cc74d) # OS: FreeBSD 10.3-RELEASE-p11 amd64 ufs auth_cache_size = 8 k auth_default_realm = example.com auth_mechanisms = plain login cram-md5 auth_realms = example.com example.org auth_socket_path = /var/run/dovecot/auth-userdb dict { sqlquota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 999 first_valid_uid = 999 hostname = mail.example.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 xxx.xxx.xxx.xxx mail_fsync = never mail_gid = vmail mail_home = /home/vmail/%d/%n/home mail_location = maildir:/home/vmail/%d/%n:LAYOUT=fs mail_plugins = acl mail_log notify quota trash virtual welcome zlib mail_server_admin = mailto:postmaster@example.com mail_uid = vmail mailbox_list_index = yes maildir_broken_filename_sizes = yes maildir_empty_new = yes maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=/home/vmail/public/:INDEX=/home/vmail/public/ prefix = public/ separator = / subscriptions = yes type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = redis:host=127.0.0.1:port=6379 last_login_key = last-login/%u mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::sqlquota quota2 = maildir:Shared quota:ns=public/ quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = /home/vmail/%d/%n/sieve/scripts;active=/home/vmail/%d/%n/sieve/.dovecot.sieve sieve_before = /usr/local/etc/dovecot/sieve/dovecot.sieve sieve_default = /usr/local/etc/dovecot/sieve/dovecot.sieve sieve_dir = /usr/local/etc/dovecot/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /usr/local/etc/dovecot/sieve/ sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/%d/%n/sieve/sieve_error.log trash = /usr/local/etc/dovecot/dovecot-trash.conf.ext welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)example.com protocols = imap sieve sendmail_path = /usr/local/sbin/sendmail service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 1 } service imap { client_limit = 1 } service lmtp { unix_listener dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 127.0.0.1 port = 12345 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0666 user = vmail } user = vmail } service welcome { executable = script /usr/local/bin/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl_cert = </usr/local/etc/letsencrypt/live/mail.example.com/fullchain.pem ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = static } protocol lmtp { mail_plugins = acl mail_log notify quota trash virtual welcome zlib sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota trash virtual welcome zlib quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = acl mail_log notify quota trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } /usr/local/etc/dovecot/dovecot-dict-sql.conf.ext connect = host=/tmp/mysql.sock dbname=dbname user=user password=password # CREATE TABLE quota ( # username varchar(100) not null, # bytes bigint not null default 0, # messages integer not null default 0, # primary key (username) # ); map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } # CREATE TABLE expires ( # username varchar(100) not null, # mailbox varchar(255) not null, # expire_stamp integer not null, # primary key (username, mailbox) # ); #map { #pattern = shared/expire/$user/$mailbox #table = expires #value_field = expire_stamp #fields { #username = $user #mailbox = $mailbox #} #}

3 2

Accessing Shared Mailbox, FQDN not appended to user
by Ed Nitido 15 Apr '17

15 Apr '17

Hey all long time, I recently upgraded Dovecot from 2.1.15 to 2.2.29.1 on my Debian Wheezy box and thought I'd tackle shared mailboxes. I can grant fine, using SETACL in telnet . SETACL mine vsun(a)test.domain.com lr . OK Setacl complete (0.596 + 0.000 + 0.595 secs). . GETACL mine * ACL mine vsun(a)test.domain.com lr edward(a)test.domain.com lrwstipekxacd However, logging in as vsun(a)test.domain.com, the logs shows the MASTER IN user doesn't get FQDN. Instead of edward(a)test.domain.com it just shows edward@test How come it only show's a partial domain? Thanks! Here's my config: # 2.2.29.1 (e0b76e3): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.18 (29cc74d) # OS: Linux 2.6.32-5-openvz-amd64 i686 Debian 7.11 auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-userdb debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no info_log_path = /var/log/dovecot-debug.log listen = * log_path = /var/log/dovecot-debug.log mail_debug = yes mail_gid = vmail mail_location = maildir:%h/Maildir mail_plugins = " quota" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = maildir:%%h/Maildir:INDEX=%h/Maildir/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/home/%d/shared-mailboxes quota = maildir:User quota quota_rule = *:storage=1G quota_warning = storage=95%% quota-warning 95 %u %d quota_warning2 = storage=80%% quota-warning 80 %u %d sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve.d/after/ sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 0 } postmaster_address = postmaster(a)test.domain.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { inet_listener { port = 12345 } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service imap-postlogin { executable = script-login /usr/local/bin/postlogin.sh } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl = no userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota quota sieve" } protocol lda { mail_plugins = " quota sieve" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " quota imap_quota imap_acl acl" } protocol sieve { mail_debug = yes mail_max_userip_connections = 10 mail_plugins = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = managesieve_sieve_capability = } protocol pop3 { mail_max_userip_connections = 20 mail_plugins = " quota quota" } Here's my log: Apr 15 07:17:44 auth: Debug: client in: AUTH 1 PLAIN service=imap session=7Fq7Wi9N84DAqAzk lip=192.168.12.229 rip=192.168.12.228 lport=143 rport=33011 Apr 15 07:17:44 auth: Debug: client passdb out: CONT 1 Apr 15 07:17:44 auth: Debug: client in: CONT<hidden> Apr 15 07:17:44 auth: Debug: ldap(vsun(a)test.domain.com,192.168.12.228,<7Fq7Wi9N84DAqAzk>): pass search: base=dc=nitido,dc=com scope=subtree filter=(&(|(uid= vsun@test.domain.com)(mailAlternateAddress=vsun@test.domain.com))(nimPimUserStatus=active)) fields=uid,userPassword Apr 15 07:17:44 auth: Debug: ldap(vsun(a)test.domain.com,192.168.12.228,<7Fq7Wi9N84DAqAzk>): result: userPassword=<hidden> uid=vsun(a)test.domain.com; uid,userPassword unused Apr 15 07:17:44 auth: Debug: ldap(vsun(a)test.domain.com,192.168.12.228,<7Fq7Wi9N84DAqAzk>): result: userPassword=<hidden> uid=vsun(a)test.domain.com Apr 15 07:17:44 auth: Debug: client passdb out: OK 1 user= vsun(a)test.domain.com Apr 15 07:17:44 auth: Debug: master in: REQUEST 2978611201 18284 1 c7599d3e61eb73c5f88a0faa9c510d86 session_pid=18285 request_auth_token Apr 15 07:17:44 auth: Debug: ldap(vsun(a)test.domain.com,192.168.12.228,<7Fq7Wi9N84DAqAzk>): user search: base=dc=nitido,dc=com scope=subtree filter=(&(|(uid= vsun@test.domain.com)(mailAlternateAddress=vsun@test.domain.com))(nimPimUserStatus=active)) fields=homeDirectory,quotaMailSoft Apr 15 07:17:44 auth: Debug: ldap(vsun(a)test.domain.com,192.168.12.228,<7Fq7Wi9N84DAqAzk>): result: quotaMailSoft=2048 homeDirectory=/home/ test.domain.com/vsun@test.domain.com; homeDirectory,quotaMailSoft unused Apr 15 07:17:44 auth: Debug: ldap(vsun(a)test.domain.com,192.168.12.228,<7Fq7Wi9N84DAqAzk>): result: quotaMailSoft=2048 homeDirectory=/home/ test.domain.com/vsun@test.domain.com Apr 15 07:17:44 auth: Debug: master userdb out: USER 2978611201 vsun(a)test.domain.com home=/home/test.domain.com/vsun@test.domain.com quota_rule=*:storage=2048M auth_token=f594cf479e39a82a1175d26368186c2e8c938630 Apr 15 07:17:44 imap-login: Info: Login: user=<vsun(a)test.domain.com>, method=PLAIN, rip=192.168.12.228, lip=192.168.12.229, mpid=18285, session=<7Fq7Wi9N84DAqAzk> Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Loading modules from directory: /usr/local/lib/dovecot Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Added userdb setting: plugin/master_user=vsun(a)test.domain.com Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Added userdb setting: plugin/quota_rule=*:storage=2048M Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Effective uid=1021, gid=1021, home=/home/test.domain.com/vsun@test.domain.com Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=2147483648 messages=0 Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota warning: bytes=2040109465 (95%) messages=0 reverse=no command=quota-warning 95 vsun(a)test.domain.com test.domain.com Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota warning: bytes=1717986918 (80%) messages=0 reverse=no command=quota-warning 80 vsun(a)test.domain.com test.domain.com Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota grace: root=User quota bytes=214748364 (10%) Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/ test.domain.com/vsun@test.domain.com/Maildir Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: maildir++: root=/home/ test.domain.com/vsun@test.domain.com/Maildir, index=, indexpvt=, control=, inbox=/home/test.domain.com/vsun@test.domain.com/Maildir, alt= Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl: initializing backend with data: vfile Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl: acl username = vsun(a)test.domain.com Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl: owner = 1 Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: Global ACLs disabled Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Namespace : type=shared, prefix=shared.%u., sep=., inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/Maildir:INDEX=/home/ test.domain.com/vsun@test.domain.com/Maildir/shared/%u Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl: initializing backend with data: vfile Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl: acl username = vsun(a)test.domain.com Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl: owner = 0 Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: Global ACLs disabled Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/dovecot-acl not found Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/.Sent/dovecot-acl not found Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/.Sent Messages/dovecot-acl not found Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/.Trash/dovecot-acl not found Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/.Drafts/dovecot-acl not found Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/.Deleted Messages/dovecot-acl not found Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: acl vfile: file /home/ test.domain.com/vsun@test.domain.com/Maildir/.Spam/dovecot-acl not found Apr 15 07:17:44 auth: Debug: master in: USER 1 edward@test service=imap Apr 15 07:17:44 auth: Debug: ldap(edward@test): user search: base=dc=nitido,dc=com scope=subtree filter=(&(|(uid=edward@test )(mailAlternateAddress=edward@test))(nimPimUserStatus=active)) fields=homeDirectory,quotaMailSoft Apr 15 07:17:44 auth: Debug: ldap(edward@test): no fields returned by the server Apr 15 07:17:44 auth: Info: ldap(edward@test): unknown user Apr 15 07:17:44 auth: Debug: userdb out: NOTFOUND 1 Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: auth USER input: Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=2147483648 messages=0 Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota warning: bytes=2040109465 (95%) messages=0 reverse=no command=quota-warning 95 edward@test test Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota warning: bytes=1717986918 (80%) messages=0 reverse=no command=quota-warning 80 edward@test test Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Quota grace: root=User quota bytes=214748364 (10%) Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: shared: Tried to access mails of nonexistent user edward@test Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: maildir++: root=/usr/local/var/run/dovecot/user-not-found/edward@test, index=, indexpvt=, control=, inbox=/usr/local/var/run/dovecot/user-not-found/edward@test, alt= Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Namespace : /usr/local/var/run/dovecot/user-not-found/edward@test doesn't exist yet, using default permissions Apr 15 07:17:44 imap(vsun(a)test.domain.com): Debug: Namespace : Using permissions from /usr/local/var/run/dovecot/user-not-found/edward@test: mode=0700 gid=default

1 0

Test error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address
by Ruga 14 Apr '17

14 Apr '17

macOS 10.12.4 clang 4.0.0 (official, non apple version) libressl 2.5.3 ... 0 / 11 tests failed /Applications/Xcode.app/Contents/Developer/usr/bin/make check-am make[3]: Nothing to be done for `check-am'. Making check in lib-imap-client for bin in test-imapc-client; do \ if ! ./$bin; then exit 1; fi; \ done Error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address Warning: imapc(127.0.0.1:0): No more IP address(es) to try - reconnecting (delay 10 ms) Error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address Error: imapc(127.0.0.1:0): No more IP address(es) to try - disconnecting test: random seed #1 was 1492961683 imapc connect failed ................................................. : FAILED Warning: imapc(127.0.0.1:65275): connect(127.0.0.1, 65275) timed out after 0 seconds - reconnecting (delay 0 ms) Error: imapc(127.0.0.1:65275): connect(127.0.0.1, 65275) timed out after 0 seconds - disconnecting imapc banner hangs ................................................... : ok Warning: imapc(127.0.0.1:55425): Authentication timed out after 0 seconds - reconnecting (delay 0 ms) Error: imapc(127.0.0.1:55425): Authentication failed: Disconnected from server imapc login hangs .................................................... : ok imapc reconnect ...................................................... : ok imapc reconnect resend commands ...................................... : ok imapc reconnect resend commands failed ............................... : ok imapc reconnect mailbox .............................................. : ok 1 / 7 tests failed make[2]: *** [check-test] Error 1 make[1]: *** [check-recursive] Error 1 make: *** [check-recursive] Error 1 >cd /opt/src/dovecot-2.2.29.1/src/lib-imap-client >./test-imapc-client test: random seed #1 was 1492323309 Error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address Warning: imapc(127.0.0.1:0): No more IP address(es) to try - reconnecting (delay 10 ms) Error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address Error: imapc(127.0.0.1:0): No more IP address(es) to try - disconnecting imapc connect failed ................................................. : FAILED Warning: imapc(127.0.0.1:50987): connect(127.0.0.1, 50987) timed out after 0 seconds - reconnecting (delay 0 ms) Error: imapc(127.0.0.1:50987): connect(127.0.0.1, 50987) timed out after 0 seconds - disconnecting imapc banner hangs ................................................... : ok Warning: imapc(127.0.0.1:62023): Authentication timed out after 0 seconds - reconnecting (delay 0 ms) Error: imapc(127.0.0.1:62023): Authentication failed: Disconnected from server imapc login hangs .................................................... : ok imapc reconnect ...................................................... : ok imapc reconnect resend commands ...................................... : ok imapc reconnect resend commands failed ............................... : ok imapc reconnect mailbox .............................................. : ok 1 / 7 tests failed >search -cv net_connect . ./imapc-connection.c:1715: fd = net_connect_ip(ip, conn->client->set.port, NULL); ./imapc-connection.c:1722: i_error("net_connect_ip(%s:%u) failed: %m", >search -cv 127.0.0.1 . ./test-imapc-client.c:43: .host = "127.0.0.1", ... static struct imapc_client_settings test_imapc_default_settings = { .host = "127.0.0.1", .username = "testuser", .password = "testpass", .dns_client_socket_path = "", .temp_path_prefix = ".test-tmp/", .rawlog_dir = "", .connect_timeout_msecs = 500, .connect_retry_count = 3, .connect_retry_interval_msecs = 10, .max_idle_time = 10000, }; The client fails if the server is not listening... Is the test server listening? static int test_open_server_fd(in_port_t *bind_port) { int fd = net_listen(&bind_ip, bind_port, 128); if (debug) i_debug("server listening on %u", *bind_port); if (fd == -1) { i_fatal("listen(%s:%u) failed: %m", net_ip2addr(&bind_ip), *bind_port); } fd_set_nonblock(fd, FALSE); return fd; } Forcing debug... >grep 'static bool debug =' test-imapc-client.c static bool debug = TRUE; >make clean >make >./test-imapc-client test: random seed #1 was 1492955953 Error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address Warning: imapc(127.0.0.1:0): No more IP address(es) to try - reconnecting (delay 10 ms) Error: net_connect_ip(127.0.0.1:0) failed: Can't assign requested address Error: imapc(127.0.0.1:0): No more IP address(es) to try - disconnecting imapc connect failed ................................................. : FAILED Warning: imapc(127.0.0.1:57648): connect(127.0.0.1, 57648) timed out after 0 seconds - reconnecting (delay 0 ms) Error: imapc(127.0.0.1:57648): connect(127.0.0.1, 57648) timed out after 0 seconds - disconnecting imapc banner hangs ................................................... : ok Warning: imapc(127.0.0.1:61221): Authentication timed out after 0 seconds - reconnecting (delay 0 ms) Error: imapc(127.0.0.1:61221): Authentication failed: Disconnected from server imapc client disconnected unexpectedly: EOF imapc login hangs .................................................... : ok imapc reconnect ...................................................... : ok imapc reconnect resend commands ...................................... : ok imapc reconnect resend commands failed ............................... : ok imapc reconnect mailbox .............................................. : ok 1 / 7 tests failed Nope, test server is not running.

1 0

Cutting down on sql connections
by David Mehler 14 Apr '17

14 Apr '17

Hello, I'm running dovecot 2.29 on a freebsd 10.3 system. I'm trying to cut down queries to my database and tried to do a userdb static and prefetch. I modified the password query to pull in userdb_quota and got an error that that was not valid. Is this behavior normal? Apr 13 17:22:15 hostname dovecot: master: Dovecot v2.2.29 (13ebc01) starting up for imap, sieve Apr 13 17:22:24 hostname dovecot: imap-login: Login: user=<username(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=66452, secured, session=<TYjM6xJNnqp/AAAB> Apr 13 17:22:24 hostname dovecot: imap(username(a)example.com): Logged out in=102 out=3020 Apr 13 17:22:24 hostname dovecot: imap-login: Login: user=<username(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=68924, secured, session=<4xDQ6xJNht1/AAAB> Apr 13 17:22:24 hostname dovecot: imap(username Thanks. Dave.

2 1

Cutting down on sql connections
by David Mehler 14 Apr '17

14 Apr '17

Hello, I'm running dovecot 2.29 on a freebsd 10.3 system. I'm trying to cut down queries to my database and tried to do a userdb static and prefetch. I modified the password query to pull in userdb_quota and got an error that that was not valid. Is this behavior normal? Apr 13 17:22:15 hostname dovecot: master: Dovecot v2.2.29 (13ebc01) starting up for imap, sieve Apr 13 17:22:24 hostname dovecot: imap-login: Login: user=<username(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=66452, secured, session=<TYjM6xJNnqp/AAAB> Apr 13 17:22:24 hostname dovecot: imap(username(a)example.com): Logged out in=102 out=3020 Apr 13 17:22:24 hostname dovecot: imap-login: Login: user=<username(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=68924, secured, session=<4xDQ6xJNht1/AAAB> Apr 13 17:22:24 hostname dovecot: imap(username Thanks. Dave.

1 0

Trouble setting up dovecot/postfix/mysql with virtual mailboxes..
by Michael Segel 14 Apr '17

14 Apr '17

Hi, I’m building a new linux box to replace my current DNS/Mail server for my SOHO. I was going to set up postfix/dovecot/mysql so I can support virtual users. I also use Webmin to make admin easier. I ran in to a couple of snags. When I first got it set up, mail went to the virtmail user and I could use my Mac mail client to read the mail. Everything was working when testing it. I was working on my TLS certificates and I broke something. I don’t know what I did, but now it’s going to the local mailbox instead. (MailDir folder) Since most of my time is doing other things, I am hoping someone could point me in the right direction. Thx

2 3

Trouble compiling 2.2.29.1
by Marc Perkel 13 Apr '17

13 Apr '17

Not sure what I'm doing wrong but I run this: ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --enable-maintainer-mode --with-mysql and it forks thousands of copies of config.guess and will eventually lock up the computer. What am I doing wrong?

1 0

Can sieve feed mails to a pipe like procmail can?
by Peter Kielbasiewicz 13 Apr '17

13 Apr '17

Currently I use procmail to filter mails according to specific tokens and trigger certain actions. For that I feed mails which match certain criteria to a pipe which then post processes the mail right when it arrives. >From what I found I could use a workaround with sieve by storing mails somewhere and then work on those at certain intervals. But this is an awkward solution which causes delays and extra work for locking and post processing. I read that sieve be the more modern system but without the post-processing feature it is no replacement for procmail to me. Peter

2 1

dovecot & iOS
by Dirk Laurenz 12 Apr '17

12 Apr '17

Hello List, i have a working dovecot imap service running with multiple clients running fine, even iOS. What's anying is, that only on iOS ( ) i see a huge bunch of .CONTROL directories - marked grey. It seems to be a copy of the existing folder structure. I don't see this on thunderbird, outlook or even roundcube. Is there any chance to configure dovecot to hide those folders to iOS? Here's some extended Information.... Attached: Screenshot from iOS, where you can see, what i mean dovecot Version: 2.1.7 root@mail01:~# dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 4.9.14+ armv6l Debian 7.11 lda_mailbox_autocreate = yes listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/Inbox:LAYOUT=fs:CONTROL=~/Maildir/.CONTROL:INDEX=~/Maildir/.INDEX namespace { inbox = yes location = mailbox { special_use = \Drafts name = Drafts } mailbox { special_use = \Junk name = Junk } mailbox { special_use = \Sent name = Sent } mailbox { special_use = \Sent name = Sent Messages } mailbox { special_use = \Trash name = Trash } prefix = name = inbox } passdb { driver = pam } plugin { antispam_debug_target = syslog antispam_signature = X-DSPAM-Signature antispam_spam = SPAM antispam_verbose_debug = 1 } postmaster_address = postmaster@domain protocols = " imap" service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap { name = imap-login } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } ssl_cert = </etc/dovecot/fullchain.pem ssl_key = </etc/dovecot/private/privkey.pem userdb { driver = passwd } protocol lmtp { service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap { name = imap-login } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } } protocol lda { info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda.log service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap { name = imap-login } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } } protocol imap { mail_plugins = antispam service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap { name = imap-login } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } }

3 6

Released Pigeonhole v0.4.18 for Dovecot v2.2.29.
by Stephan Bosch 12 Apr '17

12 Apr '17

Hello Dovecot users, Here's the definitive 0.4.18 release. There were no changes since the release candidate. Changelog v0.4.18: + imapsieve plugin: Implemented the copy_source_after rule action. When this is enabled for a mailbox rule, the specified Sieve script is executed for the message in the source mailbox during a "COPY" event. This happens only after the Sieve script that is executed for the corresponding message in the destination mailbox finishes running successfully. + imapsieve plugin: Added non-standard Sieve environment items for the source and destination mailbox. - multiscript: The execution of the discard script had an implicit "keep", rather than an implicit "discard". The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.18.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.18.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Vpopmail Error
by Bobber 12 Apr '17

12 Apr '17

I'm trying to compile the latest Dovecot (v2.2.29) and when I run make I get this error: > auth-userdb-vpopmail.o: In function `userdb_vpopmail_get_quota': > /usr/local/src/dovecot-2.2.29/src/auth/userdb-vpopmail.c:64: undefined > reference to `var_expand_table_build' > collect2: error: ld returned 1 exit status > Makefile:932: recipe for target 'auth' failed > make[3]: *** [auth] Error 1 > make[3]: Leaving directory '/usr/local/src/dovecot-2.2.29/src/auth' > Makefile:496: recipe for target 'all-recursive' failed > make[2]: *** [all-recursive] Error 1 > make[2]: Leaving directory '/usr/local/src/dovecot-2.2.29/src' > Makefile:619: recipe for target 'all-recursive' failed > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory '/usr/local/src/dovecot-2.2.29' > Makefile:463: recipe for target 'all' failed > make: *** [all] Error 2 I'm using Debian Jessie and it's up to date. Just to make sure it wasn't something in Jessie I went back into v2.2.28 (which I've been using since it was released) and did a clean build successfully. I've never had any problems compiling dovecot up until now. Any ideas on how to fix this? -- *Bob Wooldridge* Blog: http://kc0dxf.net/blog/

4 8

v2.2.29.rc1 released
by Timo Sirainen 11 Apr '17

11 Apr '17

http://dovecot.org/releases/2.2/rc/dovecot-2.2.29.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.29.rc1.tar.gz.sig Planning to release v2.2.29 on Monday. Please find and report any bugs before that. * When Dovecot encounters an internal error, it logs the real error and usually logs another line saying what function failed. Previously the second log line's error message was a rather uninformative "Internal error occurred. Refer to server log for more information." Now the real error message is duplicated in this second log line. * lmtp: If a delivery has multiple recipients, run autoexpunging only for the last recipient. This avoids a problem where a long autoexpunge run causes LMTP client to timeout between the DATA replies, resulting in duplicate mail deliveries. * config: Don't stop the process due to idling. Otherwise the configuration is reloaded when the process restarts. * mail_log plugin: Differentiate autoexpunges from regular expunges * imapc: Use LOGOUT to cleanly disconnect from server. * lib-http: Internal status codes (>9000) are no longer visible in logs * director: Log vhost count changes and HOST-UP/DOWN + quota: Add plugin { quota_max_mail_size } setting to limit the maximum individual mail size that can be saved. + imapc: Add imapc_features=delay-login. If set, connecting to the remote IMAP server isn't done until it's necessary. + imapc: Add imapc_connection_retry_count and imapc_connection_retry_interval settings. + imap, pop3, indexer-worker: Add (deinit) to process title before autoexpunging runs. + Added %{encrypt} and %{decrypt} variables + imap/pop3 proxy: Log proxy state in errors as human-readable string. + imap/pop3-login: All forward_* extra fields returned by passdb are sent to the next hop when proxying using ID/XCLIENT commands. On the receiving side these fields are imported and sent to auth process where they're accessible via %{passdb:forward_*}. This is done only if the sending IP address matches login_trusted_networks. + imap-login: If imap_id_retain=yes, send the IMAP ID string to auth process. %{client_id} expands to it in auth process. The ID string is also sent to the next hop when proxying. - fts-tika: Fixed crash when parsing attachment without Content-Disposition header. Broken by 2.2.28. - trash plugin was broken in 2.2.28 - auth: When passdb/userdb lookups were done via auth-workers, too much data was added to auth cache. This could have resulted in wrong replies when using multiple passdbs/userdbs. - auth: passdb { skip & mechanisms } were ignored for the first passdb - oauth2: Various fixes, including fixes to crashes - dsync: Large Sieve scripts (or other large metadata) weren't always synced. - Index rebuild (e.g. doveadm force-resync) set all mails as \Recent - imap-hibernate: %{userdb:*} wasn't expanded in mail_log_prefix - doveadm: Exit codes weren't preserved when proxying commands via doveadm-server. Almost all errors used exit code 75 (tempfail). - ACLs weren't applied to not-yet-existing autocreated mailboxes. - Fixed a potential crash when parsing a broken message header. - cassandra: Fallback consistency settings weren't working correctly. - doveadm director status <user>: "Initial config" was always empty - imapc: Various reconnection fixes.

3 10

How to use quota with dovecot
by Mik J 11 Apr '17

11 Apr '17

Hello, I would like to use quotas with dovecot and things are not clear to me. I read this page https://wiki2.dovecot.org/Quota 1) I did this # ls /usr/local/lib/dovecot/lib10_quota_plugin.so /usr/local/lib/dovecot/lib10_quota_plugin.so # grep mail_plugins /etc/dovecot/conf.d/10-mail.conf mail_plugins = notify replication quota Then the page tells about 20-imap.conf but an explanation is written # Space separated list of plugins to load (default is global mail_plugins). So what is that default global mail_plugins ? Is it the one coming from 10-mail.conf ? 2) I tried both use this mail_plugins = $mail_plugins quota in 20-imap.conf or comment it. And restarted dovecot each time Then commented out in 90-quota.conf quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } But I have this message # doveadm quota recalc -u user(a)mydomain.org doveadm(user(a)mydomain.org): Error: Quota not enabled Does anyone knows why ?

4 5

v2.2.29 released
by Timo Sirainen 11 Apr '17

11 Apr '17

https://dovecot.org/releases/2.2/dovecot-2.2.29.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.29.tar.gz.sig * passdb/userdb dict: Don't double-expand %variables in keys. If dict was used as the authentication passdb, using specially crafted %variables in the username could be used to cause DoS (CVE-2017-2669) * When Dovecot encounters an internal error, it logs the real error and usually logs another line saying what function failed. Previously the second log line's error message was a rather uninformative "Internal error occurred. Refer to server log for more information." Now the real error message is duplicated in this second log line. * lmtp: If a delivery has multiple recipients, run autoexpunging only for the last recipient. This avoids a problem where a long autoexpunge run causes LMTP client to timeout between the DATA replies, resulting in duplicate mail deliveries. * config: Don't stop the process due to idling. Otherwise the configuration is reloaded when the process restarts. * mail_log plugin: Differentiate autoexpunges from regular expunges * imapc: Use LOGOUT to cleanly disconnect from server. * lib-http: Internal status codes (>9000) are no longer visible in logs * director: Log vhost count changes and HOST-UP/DOWN + quota: Add plugin { quota_max_mail_size } setting to limit the maximum individual mail size that can be saved. + imapc: Add imapc_features=delay-login. If set, connecting to the remote IMAP server isn't done until it's necessary. + imapc: Add imapc_connection_retry_count and imapc_connection_retry_interval settings. + imap, pop3, indexer-worker: Add (deinit) to process title before autoexpunging runs. + Added %{encrypt} and %{decrypt} variables + imap/pop3 proxy: Log proxy state in errors as human-readable string. + imap/pop3-login: All forward_* extra fields returned by passdb are sent to the next hop when proxying using ID/XCLIENT commands. On the receiving side these fields are imported and sent to auth process where they're accessible via %{passdb:forward_*}. This is done only if the sending IP address matches login_trusted_networks. + imap-login: If imap_id_retain=yes, send the IMAP ID string to auth process. %{client_id} expands to it in auth process. The ID string is also sent to the next hop when proxying. + passdb imap: Use ssl_client_ca_* settings for CA validation. - fts-tika: Fixed crash when parsing attachment without Content-Disposition header. Broken by 2.2.28. - trash plugin was broken in 2.2.28 - auth: When passdb/userdb lookups were done via auth-workers, too much data was added to auth cache. This could have resulted in wrong replies when using multiple passdbs/userdbs. - auth: passdb { skip & mechanisms } were ignored for the first passdb - oauth2: Various fixes, including fixes to crashes - dsync: Large Sieve scripts (or other large metadata) weren't always synced. - Index rebuild (e.g. doveadm force-resync) set all mails as \Recent - imap-hibernate: %{userdb:*} wasn't expanded in mail_log_prefix - doveadm: Exit codes weren't preserved when proxying commands via doveadm-server. Almost all errors used exit code 75 (tempfail). - ACLs weren't applied to not-yet-existing autocreated mailboxes. - Fixed a potential crash when parsing a broken message header. - cassandra: Fallback consistency settings weren't working correctly. - doveadm director status <user>: "Initial config" was always empty - imapc: Various reconnection fixes.

4 6

How to migration my mails from another server ?
by Mik J 10 Apr '17

10 Apr '17

Hello, I would like to host my mails and I would like to retrieve my existing mailbox content from my ISP My ISP ====== I don't have root access on the server The server seem to use Dovecot according to the banner. My machine ========== I have root access on the server I use Dovecot 2.2.21 I use Maildir I read this page multiple times but it's not clear to me https://wiki2.dovecot.org/Migration/Dsync "Set up configuration for the IMAP server you wish to migrate from" Is it my ISP's server or my server ? In which configuration file should I do this ? The same for this option dsync_features = empty-header-workaroundwhere is it supposed to be configured ? My most important case is quite "simple": the mailboxes (there are 2 or 3) I want to migrate don't exist on my machine, so there is no such problems as merge existing mails. Will this migration use imap and retrieve the content of the mails ? Will it use port 143 or 993 ? I'll use the backup option I have another case which there are mails on both servers. So I would like to keep existing mails on my machine. I'll use the sync -1 option ? Thank you

3 3

Re: abrt reported "imap killed by SIGBUS"
by Hongying Liu 10 Apr '17

10 Apr '17

Sorry for late response. This issue occurs ran randomly. So I don't know how to run valgrind command. 2017-04-10 17:14 GMT+08:00 Hongying Liu <hongyliu(a)redhat.com>: > Sorry for late response. > > This issue occurs ran randomly. So I don't know how to run valgrind > command. > > I upload the coredump. > > The version of dovecot is dovecot-2.2.10-7.el7.x86_64. > > 2017-04-07 14:07 GMT+08:00 Aki Tuomi <aki.tuomi(a)dovecot.fi>: > >> Please keep responses on list. >> >> Can you please run valgrind on this, as it appears to be some sort of >> memory corruption issue. >> >> Aki >> >> > On April 7, 2017 at 5:37 AM Hongying Liu <hongyliu(a)redhat.com> wrote: >> > >> > >> > Thanks for your response. >> > >> > (gdb) p cache >> > $1 = (struct mail_cache *) 0x7fc4a811a320 >> > (gdb) p cache->hdr >> > $2 = (const struct mail_cache_header *) 0x7fc4a6ddb000 >> > (gdb) p cache->hdr->file_seq >> > Cannot access memory at address 0x7fc4a6ddb008 <---- >> > (gdb) p reset_id >> > $3 = 1488892251 >> > >> > >> > 2017-04-06 19:34 GMT+08:00 Aki Tuomi <aki.tuomi(a)dovecot.fi>: >> > >> > > Hi! >> > > >> > > Responses in middle. >> > > >> > > Aki >> > > >> > > On 06.04.2017 06:05, Hongying Liu wrote: >> > > > Hi sbr-services, >> > > > >> > > > Could you give me some idea? >> > > > >> > > > ### abrt reported the error as below. >> > > > [root@cupop4 log]# abrt-cli list --since 1488267244 id >> > > > ad716dbfd3a68bbe0f055e32ebfe562f4f75df43 >> > > > reason: imap killed by SIGBUS >> > > > time: Sun Mar 19 2017 10:58:27 AM JST >> > > > cmdline: dovecot/imap >> > > > package: dovecot-2.2.10-7.el7 >> > > > uid: 80180 (acaa2325) >> > > > count: 2 >> > > > Directory: /var/spool/abrt/ccpp-2017-03-19-10:58:27-4904 >> > > > 'abrt-cli report を実行する/var/spool/abrt/ccpp-2017 >> -03-19-10:58:27-4904' >> > > > >> > > > >> > > > ### /var/log/messages >> > > > Mar 19 10:58:27 cupop4 abrt-hook-ccpp: Process 4904 (imap) of user >> 80180 >> > > > killed by SIGBUS - dumping core >> > > > >> > > > And, there are lots of ldap error in /var/log/messages. Dovecot >> uses the >> > > > ldap as userdb and passwddb. >> > > > Is the ldap error related to imap crash? >> > > > >> > > > Mar 19 10:58:21 cupop4 nslcd[1534]: [a378de] >> <group/member="postfix"> >> > > > ldap_result() failed: Invalid DN syntax: Invalid DN >> > > >> > > This looks like an invalid DN syntax. >> > > >> > > > >> > > > ### /var/log/dovecot >> > > > >> > > > Mar 19 10:58:27 cupop4 dovecot: imap(acaa2325): Fatal: master: >> > > > service(imap): child 4904 killed with signal 7 (core dumped) >> > > > >> > > Can you do p cache, p cache->hdr, p cache->hdr->file_seq and p >> reset_id >> > > >> > > > ### gdb >> > > > >> > > > Core was generated by `dovecot/imap'. >> > > > Program terminated with signal 7, Bus error. >> > > > #0 0x00007fc4a69f293e in mail_cache_lookup_offset >> (cache=0x7fc4a811a320, >> > > > view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry >> > > > =0x7ffe23a98900) >> > > > at mail-cache-lookup.c:95 >> > > > 95 while (cache->hdr->file_seq != reset_id) { >> > > > (gdb) bt >> > > > #0 0x00007fc4a69f293e in mail_cache_lookup_offset >> (cache=0x7fc4a811a320, >> > > > view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry >> > > > =0x7ffe23a98900) >> > > > at mail-cache-lookup.c:95 >> > > > #1 0x00007fc4a69f2afa in mail_cache_lookup_iter_init >> > > > (view=view@entry=0x7fc4a81332b0, >> > > > seq=<optimized out>, ctx_r=ctx_r@entry=0x7ffe23a988e0) >> > > > at mail-cache-lookup.c:154 >> > > > #2 0x00007fc4a69f2f8f in mail_cache_seq (seq=<optimized out>, >> > > > view=0x7fc4a81332b0) at mail-cache-lookup.c:322 >> > > > #3 mail_cache_field_exists (view=view@entry=0x7fc4a81332b0, >> > > seq=seq@entry=760, >> > > > field=field@entry=4) at mail-cache-lookup.c:352 >> > > > #4 0x00007fc4a69f3151 in mail_cache_lookup_field >> (view=0x7fc4a81332b0, >> > > > dest_buf=dest_buf@entry=0x7ffe23a98a00, seq=760, >> > > field_idx=field_idx@entry >> > > > =4) >> > > > at mail-cache-lookup.c:413 >> > > > #5 0x00007fc4a69d9439 in index_mail_cache_lookup_field >> > > > (mail=mail@entry=0x7fc4a8128cd0, >> > > > buf=buf@entry=0x7ffe23a98a00, field_idx=field_idx@entry=4) >> > > > at index-mail.c:68 >> > > > #6 0x00007fc4a69d94a7 in index_mail_get_fixed_field >> > > (mail=0x7fc4a8128cd0, >> > > > field=<optimized out>, data=<optimized out>, data_size=8) at >> > > > index-mail.c:130 >> > > > #7 0x00007fc4a69d9fed in index_mail_get_cached_virtual_size >> > > > (mail=mail@entry=0x7fc4a8128cd0, size_r=size_r@entry=0x7ffe23a98b20) >> at >> > > > index-mail.c:403 >> > > > #8 0x00007fc4a6987c1b in maildir_mail_get_virtual_size >> > > > (_mail=0x7fc4a8128cd0, size_r=0x7ffe23a98b20) at maildir-mail.c:388 >> > > > #9 0x00007fc4a69d9719 in index_mail_update_access_parts >> > > > (mail=mail@entry=0x7fc4a8128cd0) >> > > > at index-mail.c:1490 >> > > > #10 0x00007fc4a69dbb93 in index_mail_set_seq (_mail=0x7fc4a8128cd0, >> > > > seq=760, saving=<optimized out>) at index-mail.c:1521 >> > > > #11 0x00007fc4a69e28cb in search_more_with_mail >> (mail=0x7fc4a8128cd0, >> > > > ctx=0x7fc4a8132730) at index-search.c:1507 >> > > > #12 search_more_with_prefetching (mail_r=<optimized out>, >> ctx=<optimized >> > > > out>) at index-search.c:1579 >> > > > #13 search_more (ctx=ctx@entry=0x7fc4a8132730, >> > > > mail_r=mail_r@entry=0x7ffe23a98c20) >> > > > at index-search.c:1650 >> > > > #14 0x00007fc4a69e2ff4 in index_storage_search_next_nonblock >> > > > (_ctx=0x7fc4a8132730, mail_r=0x7fc4a81120d8, >> tryagain_r=0x7ffe23a98c87) >> > > at >> > > > index-search.c:1674 >> > > > #15 0x00007fc4a69bc4ef in mailbox_search_next_nonblock >> > > > (ctx=ctx@entry=0x7fc4a8132730, >> > > > mail_r=mail_r@entry=0x7fc4a81120d8, >> > > > tryagain_r=tryagain_r@entry=0x7ffe23a98c87) at >> mail-storage.c:1787 >> > > > #16 0x00007fc4a69bc55d in mailbox_search_next (ctx=0x7fc4a8132730, >> > > > mail_r=mail_r@entry=0x7fc4a81120d8) at mail-storage.c:1773 >> > > > #17 0x00007fc4a6e97874 in imap_fetch_more_int (ctx=ctx@entry >> > > =0x7fc4a8112078, >> > > > cancel=false) at imap-fetch.c:479 >> > > > #18 0x00007fc4a6e98852 in imap_fetch_more (ctx=0x7fc4a8112078, >> > > > cmd=cmd@entry=0x7fc4a8111ed0) >> > > > at imap-fetch.c:556 >> > > > #19 0x00007fc4a6e8c17d in cmd_fetch (cmd=0x7fc4a8111ed0) at >> > > cmd-fetch.c:284 >> > > > #20 0x00007fc4a6e9601c in command_exec (cmd=cmd@entry=0x7fc4a8111ed0) >> at >> > > > imap-commands.c:158 >> > > > #21 0x00007fc4a6e94f1f in client_command_input (cmd=cmd@entry >> > > =0x7fc4a8111ed0) >> > > > at imap-client.c:780 >> > > > #22 0x00007fc4a6e95005 in client_command_input (cmd=0x7fc4a8111ed0) >> at >> > > > imap-client.c:841 >> > > > #23 0x00007fc4a6e952fd in client_handle_next_command >> > > > (remove_io_r=<synthetic pointer>, client=0x7fc4a8111530) at >> > > > imap-client.c:879 >> > > > #24 client_handle_input (client=client@entry=0x7fc4a8111530) at >> > > > imap-client.c:891 >> > > > #25 0x00007fc4a6e956c5 in client_input (client=0x7fc4a8111530) at >> > > > imap-client.c:933 >> > > > #26 0x00007fc4a66e1a87 in io_loop_call_io (io=0x7fc4a811edd0) at >> > > > ioloop.c:388 >> > > > #27 0x00007fc4a66e290f in io_loop_handler_run >> > > > (ioloop=ioloop@entry=0x7fc4a80fc750) >> > > > at ioloop-epoll.c:220 >> > > > #28 0x00007fc4a66e15d8 in io_loop_run (ioloop=0x7fc4a80fc750) at >> > > > ioloop.c:412 >> > > > #29 0x00007fc4a668e9e3 in master_service_run >> (service=0x7fc4a80fc5e0, >> > > > callback=callback@entry=0x7fc4a6e9ed70 <client_connected>) at >> > > > master-service.c:571 >> > > > #30 0x00007fc4a6e89324 in main (argc=1, argv=0x7fc4a80fc390) at >> > > main.c:400 >> > > > >> > > > Thank you. >> > > > >> > > > Best regards, >> > > > Hongying Liu >> > > >> > > >> > >

1 0

[Bug] FTS invalid address parsing
by azurit＠pobox.sk 10 Apr '17

10 Apr '17

Hi, i found another bug in FTS while parsing quoted-printable/base64-encoded sender's name inside 'From' header (again, i was figuring out why some of messages cannot be searched). Header: From: =?UTF-8?Q?A=2CB?= <test(a)example.com> Data send to Solr by Dovecot: <field name="from">A@, B &lt;test(a)example.com&gt;</field> Header: From: =?UTF-8?Q?A_B=2CC?= <test(a)example.com> Data send to Solr by Dovecot: <field name="from">A@</field> Header: From: =?UTF-8?B?QSBCLEMK?= <test(a)example.com> Data send to Solr by Dovecot: <field name="from">A@</field> Dovecot 2.2.27. azur

2 2

[Bug] FTS double escaping
by azurit＠pobox.sk 09 Apr '17

09 Apr '17

Hi, i'm trying to resolve few problems with indexing 'From' headers using FTS/Solr. I was tcpdumping the communication between Dovecot and Jetty/Solr and noticed that 'From' headers, which includes also sender's name, are double escaped. This is what was Dovecot sending to Solr: </field><field name="from">Name Surname &lt;test(a)example.com&gt;</field></doc></add> As you can see, characters < and > were escaped to < and > which were, again, escaped to &lt; and &gt;. This is doing problems while trying to index whole e-mail address, as Solr sees it as '<test(a)example.com>'. I spend hours trying to figure out why i'm able to search in all parts of e-mail addresses but searching for full and exact e-mail address was successfull ONLY for messages which doesn't include sender's name in 'From' header. Finally, after i found this bug, this fixed all search problems: <filter class="solr.PatternReplaceFilterFactory" pattern="&lt;" replacement=""/> <filter class="solr.PatternReplaceFilterFactory" pattern="&gt;" replacement=""/> I hope that, at least, this bug, reported by me, will be fixed. Thank you. azur

3 5

sieve does not seem to be working
by Robert Moskowitz 09 Apr '17

09 Apr '17

my local.conf has: # 90-sieve.conf plugin { sieve_before = /home/sieve/globalfilter.sieve } and cat /home/sieve/globalfilter.sieve require ["fileinto","mailbox"]; if anyof ( header :contains "X-Spam-Flag" "YES", header :contains "subject" "***SPAM***" ) { fileinto :create "Spam"; } There IS a globalfilter.svbin when I tried: sendmail -i testit3(a)test.htt-consult.com < sample-spam-GTUBE-junk.txt amavis is flagging it as ***Spam*** but it stays in inbox. So I tried: sieve-test -e -l /home/vmail/test.htt-consult.com/testit3/ /home/sieve/globalfilter.sieve /home/vmail/test.htt-consult.com/testit3/cur/1491512409.M371278P6513.z9m9z.test.htt-consult.com\,S\=1823\,W\=1868\:2\, info: msgid=<GTUBE1.1010101(a)example.net>: stored mail into mailbox 'Spam'. sieve-test(root): Info: final result: success And it DID get copied to Spam, not moved. I am now seeing it in inbox and Spam. Of course ownership on the message in Spam were wrong (root:root instead of vmail:mail, but I fixed that). So two questions, probably linked: Why did sieve not work. Is the subject test case sensitive? If it is case sensitive, why did the sieve-test work? thanks

2 2

Pigeonhole Sieve Extprograms Plugin
by KT Walrus 09 Apr '17

09 Apr '17

Just discovered the Pigeonhole Sieve Extprograms plugin (https://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms <https://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms>)… I currently have Postfix configured to run a script to store all incoming messages into a Mysql DB and a batch job that retrieves the messages in the DB, processes them and delivers them to the recipients' Dovecot servers. Seems to me it might be better to have Postfix deliver all incoming messages directly to a single Dovecot mailbox and use this Sieve plugin to do the whole job of updating the DB, processing the message, and delivering to the recipients. Also, I have a need to implement updating the DB when the recipient reads a message for the first time (setting the \Seen flag). Would this work best to execute a script using this Sieve plugin from a IMAP Sieve script that watches for \Seen flag changes? This might be a whole lot better than the way I was thinking of doing it before. I’m basically implementing mailing lists where the senders receive a notification reply with a link to a web page where the message may be edited/deleted before it is sent to recipients (after a fixed amount of time has elapsed). This gives the sender the opportunity to change his mind before it is too late or to send to recipients immediately (by marking the message as Urgent). Also, even after the message has been sent out, I want to allow the sender to be able to delete it in the recipients mailboxes if they have not read it yet (downloaded it to their email client) or to see which recipients have read the message (and when they read/downloaded it for the first time). Both the sender and the recipients will have Dovecot mailboxes so I want to give more control over the messages for their entire lifetimes (both for senders and for recipients) than normal email does. Any thoughts? Kevin

1 0

Released Pigeonhole v0.4.18.rc1 for Dovecot v2.2.29.rc1.
by Stephan Bosch 09 Apr '17

09 Apr '17

Hello Dovecot users, This is a rather small release. It fixes one important bug in the new discard script feature. It also adds a couple of new features for IMAPSieve. Changelog v0.4.18: + imapsieve plugin: Implemented the copy_source_after rule action. When this is enabled for a mailbox rule, the specified Sieve script is executed for the message in the source mailbox during a "COPY" event. This happens only after the Sieve script that is executed for the corresponding message in the destination mailbox finishes running successfully. + imapsieve plugin: Added non-standard Sieve environment items for the source and destination mailbox. - multiscript: The execution of the discard script had an implicit "keep", rather than an implicit "discard". The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.18… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.18… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Updating mysql db when messages first read by IMAP user
by KT Walrus 09 Apr '17

09 Apr '17

I need to implement updating a mysql db when the \SEEN flag is set by IMAP. New message delivery is done by having Postfix store all new inbound messages in a mysql db and a batch job watching the db for new messages and delivering them to the correct Dovecot server for the recipients. The batch job leaves a log entry in the db (for each recipient) with the current timestamp and adds a header with the log id to the outgoing message that is sent to Dovecot. The log table has a column for the first read timestamp which is set to 0 initially. I plan on implementing a Sieve IMAP script that watches for changes to the \SEEN flag and sends a mailto: notify message that contains the log id (from the message header) and the current date to a mail address dedicated for keep track of \SEEN flag changes. The notify message will be delivered to this mail address where a batch job watches that mail address and updates the db for the log id in the notify message with the timestamp and the current date if the row in the log table has a first read timestamp of 0. I plan on providing a web page that the sender can use to see whether the messages they have sent have been seen by the recipients. The web page will show other info too, but the part that I need to implement next is updating the db when a sent message has been read by the recipients of the message. Is this a good way to do this? Or, is there a better way than using an IMAP Sieve script to send notify messages? Is there any other way to have a Sieve script update a mysql database? Or, is there some other mechanism in Dovecot to use instead of an IMAP Sieve script? Kevin

1 0

IMAPSieve Changed flags cause?
by MRob 09 Apr '17

09 Apr '17

RFC 6785 says I should be able to run scripts when a command changes flags on a message but I can't understand what to put in imapsieve_mailboxXXX_causes. Dovecot logs something like STORE as an invalid cause. How do I run an administrator Sieve script caused from change in flags?

2 5

LAYOUT=fs and subfolders listing
by Dovecot＠9livesdata 07 Apr '17

07 Apr '17

dovecot-2.2.28-1.el6_31.wing.x86_64 I've created this public shared namespace with namespace public2 { type = public separator = . prefix = Public2. location = maildir:/mail/public2:INDEX=/mail/%u/public:LAYOUT=fs:DIRNAME=.store subscriptions = no } and I'm using the "imap_client_workarounds = tb-extra-mailbox-sep" and filesystem structure listed at the end. The problem is that with this configuration thunderbird (and roundcubemail) shows the Public2 namespace but empty - without any folders. I've tried with another DIRNAME=StoR - same effect If I will not use DIRNAME at all(and no .stor directories) TB sees the f1 f2 folders but not the f2/s1 subfolder. Just like it would not list any subfolders for subscription. Within TB I can create subfolder say f1/mysub1 but after it's unsubscribed cannot be subscribed again(not shown in listing) Can You provide any hints? I can live without the DIRNAME= but it has to list subfolders for subscription. BTW: it works well without LAYOUT=fs - but it's kind of requirement here. /mail/public2/: drwxrwsr-x 4 nobody havemail 4096 Apr 7 15:07 f1 drwxrwsr-x 3 nobody havemail 4096 Apr 7 15:02 f2 /mail/public2/f1: -rw-r--r-- 1 root havemail 42 Apr 7 15:07 dovecot-acl -r--r--r-- 1 nobody havemail 0 Oct 14 2015 dovecot-shared -rw-rw-r-- 1 nobody havemail 0 Oct 15 2015 dovecot-uidlist drwxrwsr-x 3 nobody havemail 4096 Apr 7 15:02 s1 drwxrws--- 5 nobody havemail 4096 Apr 7 15:02 .store /mail/public2/f1/s1: -rw-r--r-- 1 root havemail 40 Oct 16 2015 dovecot-acl -r--r--r-- 1 nobody havemail 0 Oct 14 2015 dovecot-shared -rw-rw-r-- 1 nobody havemail 0 Oct 15 2015 dovecot-uidlist drwxrws--- 5 nobody havemail 4096 Apr 7 15:02 .store /mail/public2/f1/s1/.store: drwxrws--- 2 nobody havemail 4096 Oct 15 2015 cur drwxrws--- 2 nobody havemail 4096 Oct 15 2015 new drwxrws--- 2 nobody havemail 4096 Oct 15 2015 tmp /mail/public2/f1/.store: drwxrws--- 2 nobody havemail 4096 Oct 15 2015 cur drwxrws--- 2 nobody havemail 4096 Oct 15 2015 new drwxrws--- 2 nobody havemail 4096 Oct 15 2015 tmp /mail/public2/f2: -rw-r--r-- 1 root havemail 40 Oct 16 2015 dovecot-acl -r--r--r-- 1 nobody havemail 0 Oct 14 2015 dovecot-shared -rw-rw-r-- 1 nobody havemail 0 Oct 15 2015 dovecot-uidlist drwxrws--- 5 nobody havemail 4096 Apr 7 15:02 .store /mail/public2/f2/.store: drwxrws--- 2 nobody havemail 4096 Oct 15 2015 cur drwxrws--- 2 nobody havemail 4096 Oct 15 2015 new drwxrws--- 2 nobody havemail 4096 Oct 15 2015 tmp

1 0

Running sievec as user vmail
by Robert Moskowitz 07 Apr '17

07 Apr '17

My sieve problem ended up a permissions problem. I ran sievec as root and .svbin needs vmail:mail ownership. I could always just add the chown command to my process, but I wonder if there is some 'clean' way to run sievec as user vmail while logged in as root? thanks

2 2

Doubt with imap/imap-login processes in proxy server
by Angel L. Mateo 07 Apr '17

07 Apr '17

Hi, I have a question I have not cleared after reading https://wiki.dovecot.org/LoginProcess. I'm developing a proxy server (without director, because the backend server is specified by a ldap lookup). My question is: the limit of imap (or pop3) concurrently users that the proxy can handle is determined by the imap-login limit or the imap one? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 2

Re: abrt reported "imap killed by SIGBUS"
by Aki Tuomi 07 Apr '17

07 Apr '17

Please keep responses on list. Can you please run valgrind on this, as it appears to be some sort of memory corruption issue. Aki > On April 7, 2017 at 5:37 AM Hongying Liu <hongyliu(a)redhat.com> wrote: > > > Thanks for your response. > > (gdb) p cache > $1 = (struct mail_cache *) 0x7fc4a811a320 > (gdb) p cache->hdr > $2 = (const struct mail_cache_header *) 0x7fc4a6ddb000 > (gdb) p cache->hdr->file_seq > Cannot access memory at address 0x7fc4a6ddb008 <---- > (gdb) p reset_id > $3 = 1488892251 > > > 2017-04-06 19:34 GMT+08:00 Aki Tuomi <aki.tuomi(a)dovecot.fi>: > > > Hi! > > > > Responses in middle. > > > > Aki > > > > On 06.04.2017 06:05, Hongying Liu wrote: > > > Hi sbr-services, > > > > > > Could you give me some idea? > > > > > > ### abrt reported the error as below. > > > [root@cupop4 log]# abrt-cli list --since 1488267244 id > > > ad716dbfd3a68bbe0f055e32ebfe562f4f75df43 > > > reason: imap killed by SIGBUS > > > time: Sun Mar 19 2017 10:58:27 AM JST > > > cmdline: dovecot/imap > > > package: dovecot-2.2.10-7.el7 > > > uid: 80180 (acaa2325) > > > count: 2 > > > Directory: /var/spool/abrt/ccpp-2017-03-19-10:58:27-4904 > > > 'abrt-cli report を実行する/var/spool/abrt/ccpp-2017-03-19-10:58:27-4904' > > > > > > > > > ### /var/log/messages > > > Mar 19 10:58:27 cupop4 abrt-hook-ccpp: Process 4904 (imap) of user 80180 > > > killed by SIGBUS - dumping core > > > > > > And, there are lots of ldap error in /var/log/messages. Dovecot uses the > > > ldap as userdb and passwddb. > > > Is the ldap error related to imap crash? > > > > > > Mar 19 10:58:21 cupop4 nslcd[1534]: [a378de] <group/member="postfix"> > > > ldap_result() failed: Invalid DN syntax: Invalid DN > > > > This looks like an invalid DN syntax. > > > > > > > > ### /var/log/dovecot > > > > > > Mar 19 10:58:27 cupop4 dovecot: imap(acaa2325): Fatal: master: > > > service(imap): child 4904 killed with signal 7 (core dumped) > > > > > Can you do p cache, p cache->hdr, p cache->hdr->file_seq and p reset_id > > > > > ### gdb > > > > > > Core was generated by `dovecot/imap'. > > > Program terminated with signal 7, Bus error. > > > #0 0x00007fc4a69f293e in mail_cache_lookup_offset (cache=0x7fc4a811a320, > > > view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry > > > =0x7ffe23a98900) > > > at mail-cache-lookup.c:95 > > > 95 while (cache->hdr->file_seq != reset_id) { > > > (gdb) bt > > > #0 0x00007fc4a69f293e in mail_cache_lookup_offset (cache=0x7fc4a811a320, > > > view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry > > > =0x7ffe23a98900) > > > at mail-cache-lookup.c:95 > > > #1 0x00007fc4a69f2afa in mail_cache_lookup_iter_init > > > (view=view@entry=0x7fc4a81332b0, > > > seq=<optimized out>, ctx_r=ctx_r@entry=0x7ffe23a988e0) > > > at mail-cache-lookup.c:154 > > > #2 0x00007fc4a69f2f8f in mail_cache_seq (seq=<optimized out>, > > > view=0x7fc4a81332b0) at mail-cache-lookup.c:322 > > > #3 mail_cache_field_exists (view=view@entry=0x7fc4a81332b0, > > seq=seq@entry=760, > > > field=field@entry=4) at mail-cache-lookup.c:352 > > > #4 0x00007fc4a69f3151 in mail_cache_lookup_field (view=0x7fc4a81332b0, > > > dest_buf=dest_buf@entry=0x7ffe23a98a00, seq=760, > > field_idx=field_idx@entry > > > =4) > > > at mail-cache-lookup.c:413 > > > #5 0x00007fc4a69d9439 in index_mail_cache_lookup_field > > > (mail=mail@entry=0x7fc4a8128cd0, > > > buf=buf@entry=0x7ffe23a98a00, field_idx=field_idx@entry=4) > > > at index-mail.c:68 > > > #6 0x00007fc4a69d94a7 in index_mail_get_fixed_field > > (mail=0x7fc4a8128cd0, > > > field=<optimized out>, data=<optimized out>, data_size=8) at > > > index-mail.c:130 > > > #7 0x00007fc4a69d9fed in index_mail_get_cached_virtual_size > > > (mail=mail@entry=0x7fc4a8128cd0, size_r=size_r@entry=0x7ffe23a98b20) at > > > index-mail.c:403 > > > #8 0x00007fc4a6987c1b in maildir_mail_get_virtual_size > > > (_mail=0x7fc4a8128cd0, size_r=0x7ffe23a98b20) at maildir-mail.c:388 > > > #9 0x00007fc4a69d9719 in index_mail_update_access_parts > > > (mail=mail@entry=0x7fc4a8128cd0) > > > at index-mail.c:1490 > > > #10 0x00007fc4a69dbb93 in index_mail_set_seq (_mail=0x7fc4a8128cd0, > > > seq=760, saving=<optimized out>) at index-mail.c:1521 > > > #11 0x00007fc4a69e28cb in search_more_with_mail (mail=0x7fc4a8128cd0, > > > ctx=0x7fc4a8132730) at index-search.c:1507 > > > #12 search_more_with_prefetching (mail_r=<optimized out>, ctx=<optimized > > > out>) at index-search.c:1579 > > > #13 search_more (ctx=ctx@entry=0x7fc4a8132730, > > > mail_r=mail_r@entry=0x7ffe23a98c20) > > > at index-search.c:1650 > > > #14 0x00007fc4a69e2ff4 in index_storage_search_next_nonblock > > > (_ctx=0x7fc4a8132730, mail_r=0x7fc4a81120d8, tryagain_r=0x7ffe23a98c87) > > at > > > index-search.c:1674 > > > #15 0x00007fc4a69bc4ef in mailbox_search_next_nonblock > > > (ctx=ctx@entry=0x7fc4a8132730, > > > mail_r=mail_r@entry=0x7fc4a81120d8, > > > tryagain_r=tryagain_r@entry=0x7ffe23a98c87) at mail-storage.c:1787 > > > #16 0x00007fc4a69bc55d in mailbox_search_next (ctx=0x7fc4a8132730, > > > mail_r=mail_r@entry=0x7fc4a81120d8) at mail-storage.c:1773 > > > #17 0x00007fc4a6e97874 in imap_fetch_more_int (ctx=ctx@entry > > =0x7fc4a8112078, > > > cancel=false) at imap-fetch.c:479 > > > #18 0x00007fc4a6e98852 in imap_fetch_more (ctx=0x7fc4a8112078, > > > cmd=cmd@entry=0x7fc4a8111ed0) > > > at imap-fetch.c:556 > > > #19 0x00007fc4a6e8c17d in cmd_fetch (cmd=0x7fc4a8111ed0) at > > cmd-fetch.c:284 > > > #20 0x00007fc4a6e9601c in command_exec (cmd=cmd@entry=0x7fc4a8111ed0) at > > > imap-commands.c:158 > > > #21 0x00007fc4a6e94f1f in client_command_input (cmd=cmd@entry > > =0x7fc4a8111ed0) > > > at imap-client.c:780 > > > #22 0x00007fc4a6e95005 in client_command_input (cmd=0x7fc4a8111ed0) at > > > imap-client.c:841 > > > #23 0x00007fc4a6e952fd in client_handle_next_command > > > (remove_io_r=<synthetic pointer>, client=0x7fc4a8111530) at > > > imap-client.c:879 > > > #24 client_handle_input (client=client@entry=0x7fc4a8111530) at > > > imap-client.c:891 > > > #25 0x00007fc4a6e956c5 in client_input (client=0x7fc4a8111530) at > > > imap-client.c:933 > > > #26 0x00007fc4a66e1a87 in io_loop_call_io (io=0x7fc4a811edd0) at > > > ioloop.c:388 > > > #27 0x00007fc4a66e290f in io_loop_handler_run > > > (ioloop=ioloop@entry=0x7fc4a80fc750) > > > at ioloop-epoll.c:220 > > > #28 0x00007fc4a66e15d8 in io_loop_run (ioloop=0x7fc4a80fc750) at > > > ioloop.c:412 > > > #29 0x00007fc4a668e9e3 in master_service_run (service=0x7fc4a80fc5e0, > > > callback=callback@entry=0x7fc4a6e9ed70 <client_connected>) at > > > master-service.c:571 > > > #30 0x00007fc4a6e89324 in main (argc=1, argv=0x7fc4a80fc390) at > > main.c:400 > > > > > > Thank you. > > > > > > Best regards, > > > Hongying Liu > > > >

1 0

Spam instead of Junk folder
by Robert Moskowitz 07 Apr '17

07 Apr '17

Traditionally I have used 'Spam' as the folder name for all those emails that get tagged as, well Spam. But it seems that the standard is now 'Junk' as from 15-mailboxes.conf # Space separated list of IMAP SPECIAL-USE attributes as specified by # RFC 6154: \All \Archive \Drafts \Flagged \Junk \Sent \Trash #special_use = If I have in local.conf # 15-mailboxes.conf namespace inbox { mailbox Spam { special_use = \Junk } } This would auto make Spam, but: Would Junk (and all the others specified in 15-mailboxes.conf) still get created? What actually controls which folders get created?

1 1

Maybe it is an sql config error?
by Robert Moskowitz 06 Apr '17

06 Apr '17

I am looking at these messages in maillog: Apr 6 15:46:58 z9m9z dovecot: dict: Error: mysql(localhost): Connect failed to database (postfix): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (13) - waiting for 25 seconds before retry Apr 6 15:46:58 z9m9z dovecot: dict: Error: mysql(localhost): Connect failed to database (postfix): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (13) - waiting for 1 seconds before retry Apr 6 15:46:58 z9m9z dovecot: dict: Error: dict sql lookup failed: Not connected to database and wondering if my config is wrong. Here is what I have: in local.conf: # dovecot.conf protocols = imap pop3 lmtp sieve dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } # 10-auth.conf !include conf.d/auth-sql.conf.ext # auth-sql.conf.ext userdb { driver = prefetch } # 90-quota.conf plugin { quota = dict:user::proxy::sqlquota trash = /etc/dovecot/dovecot-trash.conf.ext } dovecot-sql.conf.ext: driver = mysql connect = host=localhost dbname=postfix user=postfix password=mailpassword default_pass_scheme = MD5-CRYPT # following should all be on one line. password_query = SELECT username as user, password, concat('/home/vmail/', maild ir) as userdb_home, concat('maildir:/home/vmail/', maildir) as userdb_mail, 101 as userdb_uid, 12 as userdb_gid FROM mailbox WHERE username = '%u' AND active = '1' # following should all be on one line user_query = SELECT concat('/home/vmail/', maildir) as home, concat('maildir:/ho me/vmail/', maildir) as mail, 101 AS uid, 12 AS gid, CONCAT('*:messages=30000:by tes=', quota) as quota_rule FROM mailbox WHERE username = '%u' AND active = '1' [root@z9m9z dovecot]# dovecot-dict-sql.conf.ext: connect = host=localhost dbname=postfix user=postfix password=mailserv map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } Users ARE getting authenticated: # openssl s_client -connect z9m9z.test.htt-consult.com:993 CONNECTED(00000003) .... Cert stuff cut --- SSL handshake has read 1676 bytes and written 405 bytes --- New, TLSv1/SSLv3, Cipher is ECDHE-RSA-AES256-GCM-SHA384 .... Cert stuff cut --- * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. a login faxit(a)test.htt-consult.com faxitpaaswd a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA] Logged in b list "" * * LIST (\HasNoChildren \Sent) "." Sent * LIST (\HasNoChildren \Trash) "." Trash * LIST (\HasNoChildren \Drafts) "." Drafts * LIST (\HasNoChildren) "." Spam * LIST (\HasNoChildren) "." INBOX b OK List completed. ====== So perhaps it is with the quota sql on sending/recv mail? thanks

1 0

Dovecot impatient with mysql?
by Robert Moskowitz 06 Apr '17

06 Apr '17

It seems dovecot is impatient with connecting with mysql, as I see in maillog entries like: Apr 6 11:48:30 z9m9z dovecot: dict: Error: mysql(localhost): Connect failed to database (postfix): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (13) - waiting for 5 seconds before retry Apr 6 11:48:35 z9m9z dovecot: dict: Error: mysql(localhost): Connect failed to database (postfix): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (13) - waiting for 25 seconds before retry I suspect it does connect eventually. This is a test system with only 1GB of memory and free reports: total used free shared buff/cache available Mem: 1025484 696344 24556 21528 304584 251552 Swap: 524284 92168 432116 The production box has 2GB, so if the problem is mysql is swapping out, that will be 'fixed', if it is processor, well this is an ARMv7 duo core, as is the production box. I am considering buying the new quad core. Is there anything I can do to get dovecot more patient with mysql, or just ignore there messages? thank you

3 4

abrt reported "imap killed by SIGBUS"
by Hongying Liu 06 Apr '17

06 Apr '17

Hi sbr-services, Could you give me some idea? ### abrt reported the error as below. [root@cupop4 log]# abrt-cli list --since 1488267244 id ad716dbfd3a68bbe0f055e32ebfe562f4f75df43 reason: imap killed by SIGBUS time: Sun Mar 19 2017 10:58:27 AM JST cmdline: dovecot/imap package: dovecot-2.2.10-7.el7 uid: 80180 (acaa2325) count: 2 Directory: /var/spool/abrt/ccpp-2017-03-19-10:58:27-4904 'abrt-cli report を実行する/var/spool/abrt/ccpp-2017-03-19-10:58:27-4904' ### /var/log/messages Mar 19 10:58:27 cupop4 abrt-hook-ccpp: Process 4904 (imap) of user 80180 killed by SIGBUS - dumping core And, there are lots of ldap error in /var/log/messages. Dovecot uses the ldap as userdb and passwddb. Is the ldap error related to imap crash? Mar 19 10:58:21 cupop4 nslcd[1534]: [a378de] <group/member="postfix"> ldap_result() failed: Invalid DN syntax: Invalid DN ### /var/log/dovecot Mar 19 10:58:27 cupop4 dovecot: imap(acaa2325): Fatal: master: service(imap): child 4904 killed with signal 7 (core dumped) ### gdb Core was generated by `dovecot/imap'. Program terminated with signal 7, Bus error. #0 0x00007fc4a69f293e in mail_cache_lookup_offset (cache=0x7fc4a811a320, view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry =0x7ffe23a98900) at mail-cache-lookup.c:95 95 while (cache->hdr->file_seq != reset_id) { (gdb) bt #0 0x00007fc4a69f293e in mail_cache_lookup_offset (cache=0x7fc4a811a320, view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry =0x7ffe23a98900) at mail-cache-lookup.c:95 #1 0x00007fc4a69f2afa in mail_cache_lookup_iter_init (view=view@entry=0x7fc4a81332b0, seq=<optimized out>, ctx_r=ctx_r@entry=0x7ffe23a988e0) at mail-cache-lookup.c:154 #2 0x00007fc4a69f2f8f in mail_cache_seq (seq=<optimized out>, view=0x7fc4a81332b0) at mail-cache-lookup.c:322 #3 mail_cache_field_exists (view=view@entry=0x7fc4a81332b0, seq=seq@entry=760, field=field@entry=4) at mail-cache-lookup.c:352 #4 0x00007fc4a69f3151 in mail_cache_lookup_field (view=0x7fc4a81332b0, dest_buf=dest_buf@entry=0x7ffe23a98a00, seq=760, field_idx=field_idx@entry =4) at mail-cache-lookup.c:413 #5 0x00007fc4a69d9439 in index_mail_cache_lookup_field (mail=mail@entry=0x7fc4a8128cd0, buf=buf@entry=0x7ffe23a98a00, field_idx=field_idx@entry=4) at index-mail.c:68 #6 0x00007fc4a69d94a7 in index_mail_get_fixed_field (mail=0x7fc4a8128cd0, field=<optimized out>, data=<optimized out>, data_size=8) at index-mail.c:130 #7 0x00007fc4a69d9fed in index_mail_get_cached_virtual_size (mail=mail@entry=0x7fc4a8128cd0, size_r=size_r@entry=0x7ffe23a98b20) at index-mail.c:403 #8 0x00007fc4a6987c1b in maildir_mail_get_virtual_size (_mail=0x7fc4a8128cd0, size_r=0x7ffe23a98b20) at maildir-mail.c:388 #9 0x00007fc4a69d9719 in index_mail_update_access_parts (mail=mail@entry=0x7fc4a8128cd0) at index-mail.c:1490 #10 0x00007fc4a69dbb93 in index_mail_set_seq (_mail=0x7fc4a8128cd0, seq=760, saving=<optimized out>) at index-mail.c:1521 #11 0x00007fc4a69e28cb in search_more_with_mail (mail=0x7fc4a8128cd0, ctx=0x7fc4a8132730) at index-search.c:1507 #12 search_more_with_prefetching (mail_r=<optimized out>, ctx=<optimized out>) at index-search.c:1579 #13 search_more (ctx=ctx@entry=0x7fc4a8132730, mail_r=mail_r@entry=0x7ffe23a98c20) at index-search.c:1650 #14 0x00007fc4a69e2ff4 in index_storage_search_next_nonblock (_ctx=0x7fc4a8132730, mail_r=0x7fc4a81120d8, tryagain_r=0x7ffe23a98c87) at index-search.c:1674 #15 0x00007fc4a69bc4ef in mailbox_search_next_nonblock (ctx=ctx@entry=0x7fc4a8132730, mail_r=mail_r@entry=0x7fc4a81120d8, tryagain_r=tryagain_r@entry=0x7ffe23a98c87) at mail-storage.c:1787 #16 0x00007fc4a69bc55d in mailbox_search_next (ctx=0x7fc4a8132730, mail_r=mail_r@entry=0x7fc4a81120d8) at mail-storage.c:1773 #17 0x00007fc4a6e97874 in imap_fetch_more_int (ctx=ctx@entry=0x7fc4a8112078, cancel=false) at imap-fetch.c:479 #18 0x00007fc4a6e98852 in imap_fetch_more (ctx=0x7fc4a8112078, cmd=cmd@entry=0x7fc4a8111ed0) at imap-fetch.c:556 #19 0x00007fc4a6e8c17d in cmd_fetch (cmd=0x7fc4a8111ed0) at cmd-fetch.c:284 #20 0x00007fc4a6e9601c in command_exec (cmd=cmd@entry=0x7fc4a8111ed0) at imap-commands.c:158 #21 0x00007fc4a6e94f1f in client_command_input (cmd=cmd@entry=0x7fc4a8111ed0) at imap-client.c:780 #22 0x00007fc4a6e95005 in client_command_input (cmd=0x7fc4a8111ed0) at imap-client.c:841 #23 0x00007fc4a6e952fd in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x7fc4a8111530) at imap-client.c:879 #24 client_handle_input (client=client@entry=0x7fc4a8111530) at imap-client.c:891 #25 0x00007fc4a6e956c5 in client_input (client=0x7fc4a8111530) at imap-client.c:933 #26 0x00007fc4a66e1a87 in io_loop_call_io (io=0x7fc4a811edd0) at ioloop.c:388 #27 0x00007fc4a66e290f in io_loop_handler_run (ioloop=ioloop@entry=0x7fc4a80fc750) at ioloop-epoll.c:220 #28 0x00007fc4a66e15d8 in io_loop_run (ioloop=0x7fc4a80fc750) at ioloop.c:412 #29 0x00007fc4a668e9e3 in master_service_run (service=0x7fc4a80fc5e0, callback=callback@entry=0x7fc4a6e9ed70 <client_connected>) at master-service.c:571 #30 0x00007fc4a6e89324 in main (argc=1, argv=0x7fc4a80fc390) at main.c:400 Thank you. Best regards, Hongying Liu

2 1

Replication for Pigeonhole ManageSieve
by Joe Nahmias 06 Apr '17

06 Apr '17

Hello, I currently have one machine running postfix SMTP server as MTA along with dovecot IMAP server for email. Although it only supports a handful of users, email service is important to us all; so I'm looking to make this a more fault-tolerant / highly-available system. To that end, I'm planning on configuring postfix to use deliver/dovecot-lda as my MDA (using procmail at the moment), spinning up another machine with postfix/dovecot and setting up master/master replication using dsync/doveadm-sync. My reading on the subject suggests that this should (given appropriate MX & SRV dns records) make traffic balanced across both nodes, and the system should be resilient if one of the nodes should fail without the need for much/any human intervention. In order to replace the functionality that procmail currently provides as MDA, I was thinking to use Sieve. Fortunately, it seems the Pigeonhole project provides almost everything I need on the server side to make this work. The one potential gap I have identified is the syncing of the sieve scripts between the two machines. Has any one dealt with this and come up with a good solution? Does dsync already handle this and I just haven't figured it out? Let me know if my question is best directed elsewhere. Thanks in advance for any help, --Joe PS - please cc me as I don't subscribe to this list.

2 1

Re: Getting error on port 995
by Joseph Tam 05 Apr '17

05 Apr '17

>> As a wild ass guess, I think maybe the client is using used "STARTTLS" >> intead of "SSL", or some other SSL requirement disagreement. > > I believe it has more to do with the encryption method (plain, login, > cram-md5) than with the TLS. The TLS encryption happens on the network > layer whereas the encryption method is used at the IMAP level. Those are authentication methods. However, Googling the heck out of the error message, it appears the OP's error message is a common problem fixed by resetting the PopProxy configuration https://social.technet.microsoft.com/Forums/ie/en-US/40eb0164-0bcf-499a-940… https://blog.zubairalexander.com/outlook-error-0x800ccc1/ Joseph Tam <jtam.home(a)gmail.com>

1 0

Problem with Dovecot and BlackBerry
by Luca Bertoncello 05 Apr '17

05 Apr '17

Hi all, i've got a strange behaviour with a BlackBerry Classic Phone (BBOS 10.3.2.2876) in combination with Dovecot 2.2.13 while trying to fetch mails. Before burying myself into debugging sessions, i try to get an understanding if the following is a Client- or a Server-specific error in the behaviour: CIGA8 UID FETCH 10009:10035 (UID FLAGS) (CHANGEDSINCE NOMODSEQ) CIGA8 BAD Error in IMAP command UID FETCH: Invalid CHANGEDSINCE modseq. Following the full conversation. ---- * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot on xxx ready. CIGA1 CAPABILITY * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 CIGA1 OK Pre-login capabilities listed, post-login capabilities have more. CIGA2 ID ("os" "BlackBerry 10" "os-version" "10.3.2.2876" "vendor" "rim" "device" "Classic" "name" "bbimap") * ID ("name" "Dovecot") CIGA2 OK ID completed. CIGA3 LOGIN xxx xxx * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE CIGA3 OK Logged in CIGA4 CAPABILITY * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE CIGA4 OK Capability completed. CIGA5 LIST "" "" * LIST (\Noselect) "." "" CIGA5 OK List completed. CIGA6 LIST "" "*" * LIST (\HasNoChildren) "." folder_a * LIST (\HasNoChildren) "." folder_b * LIST (\HasNoChildren) "." folder_c * LIST (\HasNoChildren) "." sent-mail * LIST (\HasNoChildren) "." folder_d * LIST (\HasNoChildren) "." folder_e * LIST (\HasNoChildren \Trash) "." Trash * LIST (\HasNoChildren \Drafts) "." Drafts * LIST (\HasNoChildren) "." folder_f * LIST (\HasNoChildren) "." folder_g * LIST (\HasNoChildren) "." INBOX CIGA6 OK List completed. CIGA7 SELECT INBOX (CONDSTORE) * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 7 EXISTS * 0 RECENT * OK [UIDVALIDITY 1391686038] UIDs valid * OK [UIDNEXT 10036] Predicted next UID * OK [HIGHESTMODSEQ 1608] Highest CIGA7 OK [READ-WRITE] Select completed (0.000 secs). CIGA8 UID FETCH 10009:10035 (UID FLAGS) (CHANGEDSINCE NOMODSEQ) CIGA8 BAD Error in IMAP command UID FETCH: Invalid CHANGEDSINCE modseq. CIGA9 LOGOUT * BYE Logging out CIGA9 OK Logout completed. ---- Thanks in advance! Luca Bertoncello (lucabert(a)lucabert.de)

4 3

Problem with acl and shared mailboxes
by Fabian 04 Apr '17

04 Apr '17

Hi there, we are currently have the following problem: User gustav(a)agreatdomain.de shares his INBOX to brunhilde(a)agreatdomain.com. But brunhilde can't subscribe that mailbox. host:~ # more //var/spool/mail/agreatdomain.com/gustav/Maildir/dovecot-acl owner akxeilprwts user=brunhilde(a)agreatdomain.com lprws host:~ # Doveadm acl debug request: host:~ # doveadm acl debug -u sieglinde(a)agreatdomain.com shared/gustav doveadm(sieglinde(a)agreatdomain.com): Error: Mailbox 'shared.gustav' in namespace 'shared/gustav/' doesn't exist in /var/spool/mail/agreatdomain.com/gustav//Maildir/.shared.gustav host:~ # In the debug logfile I can see the following message: Apr 03 10:29:18 imap(brunhilde(a)agreatdomain.com): Debug: acl: acl username = brunhilde(a)agreatdomain.com Apr 03 10:29:18 imap(brunhilde(a)agreatdomain.com): Debug: acl: owner = 0 Apr 03 10:29:18 imap(brunhilde(a)agreatdomain.com): Debug: acl vfile: Global ACLs disabled Apr 03 10:29:18 imap(brunhilde(a)agreatdomain.com): Debug: acl vfile: file /var/spool/mail/agreatdomain.com/gustav/Maildir/.shared.gustav/dovecot-acl not found Apr 03 10:29:18 imap(brunhilde(a)agreatdomain.com): Debug: acl: No lookup right to mailbox: shared/gustav Why is dovecot searching in .shared/.gustav instead of Maildir/ directly? Any ideas? My configuration: host:~ # doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.12.67-60.64.24-default x86_64 SUSE Linux Enterprise Server 12 (x86_64) ext3 auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.debug dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 480 lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_gid = vmail mail_location = maildir:/var/spool/mail/%d/%u/Maildir:LAYOUT=fs mail_plugins = acl quota listescape mail_privileged_group = vmail mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = yes inbox = yes list = no location = prefix = separator = / subscriptions = yes } namespace { list = yes location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace Public { list = children location = maildir:/var/mail/%d/public:INDEXPVT=~/public:LAYOUT=fs prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { inbox = no location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/masteruser.%s driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/spool/mail/%d/shared-mailboxes.db quota = dict:User quota::proxy::sqlquota quota2 = dict:Shared quota::proxy::sqlquota quota_rule2 = INBOX/Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)d8ox1.int.pro-ite.de protocols = imap pop3 lmtp sieve service auth-worker { user = dovecot } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0660 user = dovecot } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl quota listescape acl quota sieve } protocol lda { mail_plugins = acl quota listescape acl sieve } protocol imap { mail_plugins = acl quota listescape imap_quota imap_acl } host:~ # -- Kind regards, Fabian

2 3

Meaning of "protocol !indexer-worker"
by Angel L. Mateo 04 Apr '17

04 Apr '17

Hello, I'm configuring dovecot 2.2.28. Comparing with previous versions I have found now in 10-mail.conf the config: protocol !indexer-worker { # If folder vsize calculation requires opening more than this many mails from # disk (i.e. mail sizes aren't in cache already), return failure and finish # the calculation via indexer process. Disabled by default. This setting must # be 0 for indexer-worker processes. #mail_vsize_bg_after_count = 0 } I can see that indexer-worker is the index service in dovecot. But I don't what the '!' means in front of the service name. Any who can explain it to me? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 2

Users home path inside a sieve script
by Mark Constable 04 Apr '17

04 Apr '17

Perhaps I have not looked hard enough but is it possible to get at the current users auth userdb "home" (or $HOME) variable from inside a sieve script? Example?

3 3

Error: Virtual mailbox loops, Dovecot version 2.2.10
by dan＠redchops.com 03 Apr '17

03 Apr '17

I'm trying to follow the guide at https://wiki.dovecot.org/Plugins/Virtual for the 'Conversation' style virtual mailbox, but with a small change. I'd like the virtual mailboxes to be 'top level', which I found while searching through this list is accomplishable by putting the dovecot-virtual file in the root of the namespace location. My issue is this works perfectly fine for the All Mail virtual mailbox, but the Threaded mailbox fails with the error above. I tried creating a RealMail namespace, but that doesn't solve the issue either. I feel like I must be overlooking something simple; I could get this setup working if the virtual mailboxes shared a namespace and were subfolders, but I don't like that setup much (I'm trying to get my companies GMail users on to our own webmail client, it's features like this that I need to replicate with dovecot or they'll never leave their POP3 setups). I've attached the output of dovecot -n, and my virtual mailboxes look like this: # cat Threaded/dovecot-virtual All inthread refs x-mailbox INBOX # cat all/dovecot-virtual RealMail RealMail/* -RealMail/Trash -RealMail/Trash/* -RealMail/Spam -RealMail/Spam/* all I'd appreciate any insight in to this issue. If I try to access the Threaded Inbox through IMAP, I get this error specifically: a select "Threaded Inbox" a NO [SERVERBUG] Virtual mailbox open failed because of mailbox All: Internal error occurred. Refer to server log for more information. [2017-04-03 00:24:28] The relevant line being: Apr 3 00:24:28 mail dovecot: imap(dan(a)redchops.com): Error: Virtual mailbox loops: No information before or after. Thanks, -Dan

2 1

Re: Getting error on port 995
by Joseph Tam 03 Apr '17

03 Apr '17

Bhushan Bhosale writes: > I'm getting issue with port 995 by using Microsoft Outlook 2016 only. > The error on Microsoft Outlook showing "Your server does not support > the connection encryption type. Try changing the encryption method". > The error is only who is using Microsoft outlook2016. Kindly help. Help us help you. Please include output of "dovecot -n" and any relevant log entries. As a wild ass guess, I think maybe the client is using used "STARTTLS" intead of "SSL", or some other SSL requirement disagreement. Joseph Tam <jtam.home(a)gmail.com>

2 1

Mail list empty on my mailserver
by Philippe Forums 03 Apr '17

03 Apr '17

Hello, After changing NAS, I meet a problem when I go on my e-mail box with my webmail. Either e-mails do not appear anymore, or they appear but are "empty". When I look in the directory of the e-mails of my mailserver, these e-mails are present. I tried to rename files "dovecot.index*" and to restart dovecot but nothing can be done. To make the seesaw of a NAS towards an other one, I copied all the directory of mailserver to an external storage, and made the copy the other way on my new NAS. This directory is a mount to a NAS. Having well to look, it would seem whether it is a date problem, because the copy did not keep the real dates of e-mails and they thus find themselves dated the day of the copy. I know not at all how to get back all my e-mails in my webmail. Thank's for your help. PS : I'm french, sorry for my english. -- ##################### Philippe - Forums

2 2

Getting error on port 995
by Bhushan Bhosale 02 Apr '17

02 Apr '17

Dear Team, I'm getting issue with port 995 by using Microsoft Outlook 2016 only. The error on Microsoft Outlook showing "Your server does not support the connection encryption type. Try changing the encryption method". The error is only who is using Microsoft outlook2016. Kindly help. Thanks and Regards, Bhushan Bhosale

2 1

dsync replication
by George Dimakopoulos 31 Mar '17

31 Mar '17

Is it stable for dovecot 2.2.27 to implement DRBD (or HAST) on block level for maildir data replication instead of using dsync plugin? Regards, George

2 1

Slow performance with large folders over the Internet
by Shawn Heisey 31 Mar '17

31 Mar '17

Dovecot package version is 1:1.2.15-7+deb6u1. It is in Debian 6.0.10, using the Debian package. The server is in my basement at home, and is exposed to the Internet so I can fully access my mail from anywhere. I use IMAP for reading mail. I have a number of folders in my mailbox that have thousands of messages in them, from mailing lists. When I'm at home, I have a LAN connection to the server. It goes through a Cisco firewall that limits the connection speed to 100Mb/s. In this situation, I can open a folder with 25000 messages in it, click on the next unread message that Thunderbird did not know about before, and within a second or two, the message will download, allowing me to view it and reply. When I'm at work, with highly variable network latency between Thunderbird and the server, doing exactly the same thing takes a LOT longer. I have seen it take as long as 15 minutes for a single message. If I open a folder with only a few messages in it, it is fast. The server is not overloaded -- I can log into it with ssh and use "mutt -f" to open a folder directly. Loading thousands of messages into mutt takes a while, but I have no difficulty using the ssh connection and running commandline programs. This suggests that the IMAP communication between the server and the client involves a large amount of back and forth communication when the message count in the folder is high, possibly something for every message in the folder. It happens quickly on a LAN but crawls on a connection with high latency. I can understand it taking a few seconds longer on a high-latency link, but it takes minutes. I do plan on building a new server and migrating to Dovecot 2.x, but I haven't had the time to work on that. Is this a known problem? If so, is it fixed in 2.x? Thanks, Shawn

3 2

Studying dovecot source code (searching for mail_deliver_hook_set)
by chaouche yacine 30 Mar '17

30 Mar '17

Hello dovecot, I would like to study how dovecot manages quota, especially how it deals with the maildirsize file if one chooses to implement quota according to the maildir++ specification. I made a number of assumptions : 1. mail is (always/sometimes) delivered with the dovecot-lda binary, which source code is in src/lda. 2. mail is sent with the mail_deliver function which is called from src/lda/main.c and is defined in src/lib-lda/mail-deliver.c 3. mail_deliver function calls the deliver_mail function (it seems to be pointer to a function) 4. according to src/lib-lda/mail-deliver.h, deliver_mail is set with the mail_deliver_hook_set function. Here's what the comment says /* Sets the deliver_mail hook and returns the previous hook, which the new_hook should call if it's non-NULL. */ deliver_mail_func_t *mail_deliver_hook_set(deliver_mail_func_t *new_hook); The problem at this point is that I can't find where is this function called. A grep on the sources only reveals two results : -*- mode: grep; default-directory: "~/DOWNLOADS/APPS/dovecot-2.2.13/src/" -*- Grep started at Tue Mar 28 17:01:50 grep -nH -e 'mail_deliver_hook_set' -r . ./lib-lda/mail-deliver.c:428:deliver_mail_func_t *mail_deliver_hook_set(deliver_mail_func_t *new_hook) ./lib-lda/mail-deliver.h:103:deliver_mail_func_t *mail_deliver_hook_set(deliver_mail_func_t *new_hook); Grep finished (matches found) at Tue Mar 28 17:01:50 According to the changelog this function has been introduced back in 2010. I don't know if it's really used ? * I am working on the 2.2.13 sources because that's what's installed on my server. * I couldn't find a developers mailling listed in http://www.dovecot.org/mailinglists.html so I'm just posting this here. -- Yassine.

3 5

Email Push to Iphone
by mca＠caloro.ch 30 Mar '17

30 Mar '17

Hello Please exist in Dovecot 2.2.13 the E-Mail Push function? So that the Email on me Iphone are available at this moment that will be transfered, I see or found any other 3part software "Z-push", but it's this function are not included on dovecot? Thanks and regards Mauri

3 2

Using SpamProbe via only sieve scripts
by Mark Constable 30 Mar '17

30 Mar '17

FWIW this took me days to get right, and still needs tinkering, but it might make for a good starting point for anyone else needing something similar (ie; I don't use or need the overhead of spamassassin or rspamd). https://gist.github.com/markc/eeeb66ce30ea805af62631656cf86c4d Any comments or corrections on that page would be appreciated.

2 1

Re: cannot login to imap under load
by Gerard Ranke 29 Mar '17

29 Mar '17

Hi Maria, It does indeed run from systemd, so this is what's currently in the dovecot unit file ( /etc/systemd/system/dovecot.service ): [Unit] Description=Dovecot IMAP/POP3 email server After=local-fs.target network.target [Service] Type=simple ExecStart=/usr/sbin/dovecot -F NonBlocking=yes TasksMax=10000 LIMIT_NOFILE=10000 [Install] WantedBy=multi-user.target Unfortunately, it doesn't seem to work... Best, gerard On 29-03-17 13:13, María Arrea wrote: > > If you are running dovecot via systemd, increase NOFILES in the > dovecot startup script > > El 29/03/17 a las 13:07, Gerard Ranke escribió: >> Hi Steffen, >> >> On 29-03-17 12:38, Steffen Kaiser wrote: >>> On Tue, 28 Mar 2017, Gerard Ranke wrote: >>> >>>> dovecot: master: Error: service(imap): fork() failed: Resource >>>> temporarily unavailable >>>> dovecot: master: Error: service(imap): command startup failed, >>>> throttling for 2 secs >>> check out the ulimits for the Dovecot process. >>> >>> -- Steffen Kaiser >> Here they are: >> >> dovecot@mail:~> ulimit -a >> core file size (blocks, -c) 0 >> data seg size (kbytes, -d) unlimited >> scheduling priority (-e) 0 >> file size (blocks, -f) unlimited >> pending signals (-i) 256942 >> max locked memory (kbytes, -l) 64 >> max memory size (kbytes, -m) unlimited >> open files (-n) 10000 >> pipe size (512 bytes, -p) 8 >> POSIX message queues (bytes, -q) 819200 >> real-time priority (-r) 0 >> stack size (kbytes, -s) 8192 >> cpu time (seconds, -t) unlimited >> max user processes (-u) 256942 >> virtual memory (kbytes, -v) unlimited >> file locks (-x) unlimited >> >> This looks ok to me, but on startup, I still get: >> >> dovecot[9309]: Warning: fd limit (ulimit -n) is lower than required >> under max. load (1024 < 10000), because of service auth { client_limit } >> >> Strange thing is that dovecot still complains about the fd limit being >> 1024, while I set it to 10000. And how can a ulimit be too low 'because >> of service auth'? I don't get that at all. Thanks for your interest! >> >> gerard > >

3 3

cannot login to imap under load
by Gerard Ranke 29 Mar '17

29 Mar '17

Dear list, We moved our dovecot installation to a new vm, and ever since there are problems logging in to our imap server during office hours. ( Evenings and weekends are fine. ) Both the new and the old machine are dovecot 2.2.13. Symptoms: Logging in via imap gives: . OK Pre-login capabilities listed, post-login capabilities have more. a login <loginname> <passwd> * OK Waiting for authentication master process to respond.. closed whereas using the same credentials with pop3: +OK Dovecot ready. user <loginname> +OK pass <passwd> +OK Logged in. Our mail.err log gives lots of: dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) dovecot: imap: Error: Login client disconnected too early dovecot: auth: Error: Master request 24000.918 not found dovecot: master: Error: service(imap): fork() failed: Resource temporarily unavailable dovecot: master: Error: service(imap): command startup failed, throttling for 2 secs Note thate we our users almost exclusively use imap. Normally we would have some 7 or 800 imap processes running and only a few pop3. Our doveconf -n output: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 4.4.38-93-default x86_64 SUSE Linux Enterprise Server 12 (x86_64) auth_mechanisms = plain login default_client_limit = 2000 default_process_limit = 2000 default_vsz_limit = 512 M disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep import_environment = TZ DEBUG_OUTOFMEM DOVECOT_HOSTDOMAIN mail_location = maildir:~/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service anvil { client_limit = 8003 } service auth { client_limit = 10000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = dovecot mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 4 service_count = 0 } service imap { process_limit = 2048 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 4 service_count = 0 } service pop3 { process_limit = 2048 } ssl_cert = </etc/ssl/certs/hkuwildcardthawte.crt ssl_key = </etc/ssl/certs/hkuwildcardthawte.key ssl_protocols = !SSLv2 !SSLv3 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } protocol lmtp { mail_plugins = " quota sieve" } protocol lda { mail_plugins = " quota sieve" } protocol imap { mail_max_userip_connections = 10 mail_plugins = " quota imap_quota" } Thank you all for any insight, it will be much appreciated! Best regards, gerard

3 5

pigeonhole / vacation
by A. Schulze 29 Mar '17

29 Mar '17

Hello, we use the sieve vacation module to answer messages for certain mailboxes. vacation send back answers to most but not all messages wich is fine and intended. .dovecot.sieve looks like this: require ["vacation", "variables"]; if header :matches "subject" "*" { vacation :subject "Automatic response to: ${1}" "thanks for your message"; keep; } But now I would like to distinct messages that where answered from those where the vacation module did not send back a message. Is it possible to store answered messages in one folder and unanswered in an other? # probably invalid sieve syntax if vacation .... { fileinto "answered/"; stop; else fileinto "unanswered/"; stop; } After reading RFC 5230 I feel it's not possible at all :-/ Andreas

2 1

Re: Email Push to Iphone
by Ricardo Branco 29 Mar '17

29 Mar '17

there is this plugin to use APNS to notify phones, its a faf though as you need a legal OSX Server to generate the signing keys, I never ended up implementing it. https://github.com/st3fan/dovecot-xaps-daemon Aki Tuomi wrote on 29/03/2017 07:29: > > On 29.03.2017 07:24, mca(a)caloro.ch wrote: >> Hello >> >> >> >> Please exist in Dovecot 2.2.13 the E-Mail Push function? >> >> >> >> So that the Email on me Iphone are available at this moment that will be >> transfered, I see or found any other 3part software "Z-push", but it's this >> function are not included on dovecot? >> >> >> >> Thanks and regards >> >> Mauri >> >> > There exists a push notification framework for dovecot, but it does not support iPhone push directly. See https://wiki2.dovecot.org/Plugins/PushNotification > > Aki

1 0

Tip: update dovecot MD5 password from PAM
by Steinar Bang 29 Mar '17

29 Mar '17

This is a PAM module that listens for password changes, and will update the MD5 password for a user, in a file that dovecot can read, when the user's password is changed: https://github.com/steinarb/pam_dovecotmd5pwd Caveat emptor! (Works for me...! :-) )

5 9

The challenge of customizing Dovecot
by Robert Moskowitz 29 Mar '17

29 Mar '17

I have been running Dovecot for sometime, but I have just used someone else efforts on customizing it. Many of these throw out the dovecot/conf.d files for a single dovecot.conf with no explanation on what does what. So tell you a few conf.d files to edit. So over the past few days, I have rolled up my sleeves and did my best to work out how to modify the proper conf.d files. To 'stay true' to the Dovecot maintainer's config organization. The target is Centos7 with Dovecot 2.2.10-7 It was HARD! Besides dovecot.conf, I had to modify 13 conf.d files. Add 3 .ext files in /etc/dovecot, and set up sieve. I will soon have my total instructions available on my server, but to share with you what I have done for Dovecot customization and maybe to get some recommendations on improvements. For the most part, I have used SED to modify the conf files. I use a few env variables: your_domain_tld= your_host_only= your_host_tld=$your_host_only.$your_domain_tld Postfix_Database_Password= What follows are the pieces of my customization, all comments welcomed (this is NOT adequately tested! That is later in the week!): sed -i -e "/^#protocols/s/$/ sieve/w /dev/stdout" /etc/dovecot/dovecot.conf sed -i -e "s/^#protocols/protocols/w /dev/stdout" /etc/dovecot/dovecot.conf sed -i -e "s/#quota = /sqlquota = /w /dev/stdout" /etc/dovecot/dovecot.conf sed -i -e "/^auth_mechanisms/s/$/ login/w /dev/stdout" /etc/dovecot/conf.d/10-auth.conf sed -i -e 's/^#!include auth-sql.conf.ext/!include auth-sql.conf.ext/w /dev/stdout' /etc/dovecot/conf.d/10-auth.conf sed -i -e "0,/#userdb {/ s/#userdb {/userdb {/w /dev/stdout" /etc/dovecot/conf.d/auth-sql.conf.ext sed -i -e "s/# driver = prefetch/ driver = prefetch\n }/w /dev/stdout" /etc/dovecot/conf.d/auth-sql.conf.ext sed -i -e "/^#mail_location/s/$/maildir:\/home\/vmail\/%d\/%n/w /dev/stdout" /etc/dovecot/conf.d/10-mail.conf sed -i -e "s/^#mail_location/mail_location/w /dev/stdout" /etc/dovecot/conf.d/10-mail.conf sed -i -e "s/first_valid_uid = 1000/first_valid_uid = 101/w /dev/stdout" /etc/dovecot/conf.d/10-mail.conf sed -i -e "s/#first_valid_gid = 1/first_valid_gid = 12/w /dev/stdout" /etc/dovecot/conf.d/10-mail.conf sed -i "/unix_listener auth-userdb/ a mode = 0666\n user = vmail\n group = mail" /etc/dovecot/conf.d/10-master.conf sed -i "/#unix_listener \/var\/spool/ a mode = 0666\n user = postfix\n group = postfix\n }" /etc/dovecot/conf.d/10-master.conf sed -i -e "s/#unix_listener \/var\/spool/unix_listener \/var\/spool/w /dev/stdout" /etc/dovecot/conf.d/10-master.conf sed -i "/unix_listener dict/ a mode = 0666\n user = vmail\n group = mail" /etc/dovecot/conf.d/10-master.conf sed -i -e "s/^mode/ mode/w /dev/stdout" /etc/dovecot/conf.d/10-master.conf sed -i -e "s/dovecot\/certs\/dovecot.pem/tls\/certs\/$your_host_tld.crt/w /dev/stdout" /etc/dovecot/conf.d/10-ssl.conf sed -i -e "s/dovecot\/private\/dovecot.pem/tls\/private\/$your_host_tld.key/w /dev/stdout" /etc/dovecot/conf.d/10-ssl.conf sed -i -e "/^#postmaster_address/s/$/ postmaster@$your_domain_tld/w /dev/stdout" /etc/dovecot/conf.d/15-lda.conf sed -i -e "s/^#postmaster_address/postmaster_address/w /dev/stdout" /etc/dovecot/conf.d/15-lda.conf sed -i "/#mail_plugins/ a mail_plugins = quota sieve" /etc/dovecot/conf.d/15-lda.conf sed -i -e "s/^mail_plugins/ mail_plugins/w /dev/stdout" /etc/dovecot/conf.d/15-lda.conf sed -i -e "s/^#lda_mailbox_autocreate = no/lda_mailbox_autocreate = yes/w /dev/stdout" /etc/dovecot/conf.d/15-lda.conf sed -i -e "s/^#lda_mailbox_autosubscribe = no/lda_mailbox_autosubscribe = yes/w /dev/stdout" /etc/dovecot/conf.d/15-lda.conf sed -i "/#mail_plugins / a mail_plugins = quota imap_quota trash" /etc/dovecot/conf.d/20-imap.conf sed -i -e "s/^mail_plugins/ mail_plugins/w /dev/stdout" /etc/dovecot/conf.d/20-imap.conf sed -i "/#imap_client_workarounds/ a imap_client_workarounds = delay-newmail" /etc/dovecot/conf.d/20-imap.conf sed -i "/#mail_plugins/ a mail_plugins = sieve" /etc/dovecot/conf.d/20-lmtp.conf sed -i -e "s/^mail_plugins/ mail_plugins/w /dev/stdout" /etc/dovecot/conf.d/20-lmtp.conf sed -i -e "s/^#lmtp_save_to_detail_mailbox = no/lmtp_save_to_detail_mailbox = yes/w /dev/stdout" /etc/dovecot/conf.d/20-lmtp.conf sed -i -e "s/#service managesieve-login/service managesieve-login/w /dev/stdout" /etc/dovecot/conf.d/20-managesieve.conf sed -i -e "s/#inet_listener sieve {/inet_listener sieve {/w /dev/stdout" /etc/dovecot/conf.d/20-managesieve.conf sed -i -e "s/# port = 4190/ port = 4190\n }/w /dev/stdout" /etc/dovecot/conf.d/20-managesieve.conf sed -i "/#vsz_limit/ a }" /etc/dovecot/conf.d/20-managesieve.conf sed -i "/#mail_plugins/ a mail_plugins = quota" /etc/dovecot/conf.d/20-pop3.conf sed -i -e "s/^mail_plugins/ mail_plugins/w /dev/stdout" /etc/dovecot/conf.d/20-pop3.conf sed -i "/#pop3_client_workarounds/ a pop3_client_workarounds = outlook-no-nuls oe-ns-eoh" /etc/dovecot/conf.d/20-pop3.conf sed -i -e "s/#acl = /acl = /w /dev/stdout" /etc/dovecot/conf.d/90-acl.conf sed -i -e "s/#sieve_before =/sieve_before = \/home\/sieve\/globalfilter.sieve/w /dev/stdout" /etc/dovecot/conf.d/90-sieve.conf cat <<EOF>>/etc/dovecot/conf.d/90-quota.conf || exit 1 plugin { quota = dict:user::proxy::sqlquota trash = /etc/dovecot/dovecot-trash.conf.ext } EOF cat <<EOF>/etc/dovecot/dovecot-trash.conf.ext || exit 1 # Spam mailbox is emptied before Trash 1 Spam # Trash mailbox is emptied before Sent # 2 Trash # If both Sent and "Sent Messages" mailboxes exist, the next oldest message # to be deleted is looked up from both of the mailboxes. # 3 Sent # 3 Sent Messages EOF cat <<EOF>/etc/dovecot/dovecot-sql.conf.ext || exit 1 driver = mysql connect = host=localhost dbname=postfix user=postfix password=$Postfix_Database_Password default_pass_scheme = MD5-CRYPT # following should all be on one line. password_query = SELECT username as user, password, concat('/home/vmail/', maildir) as userdb_home, concat('maildir:/home/vmail/', maildir) as userdb_mail, 101 as userdb_uid, 12 as userdb_gid FROM mailbox WHERE username = '%u' AND active = '1' # following should all be on one line user_query = SELECT concat('/home/vmail/', maildir) as home, concat('maildir:/home/vmail/', maildir) as mail, 101 AS uid, 12 AS gid, CONCAT('*:messages=30000:bytes=', quota) as quota_rule FROM mailbox WHERE username = '%u' AND active = '1' EOF cat <<EOF>/etc/dovecot/dovecot-dict-sql.conf.ext || exit 1 connect = host=localhost dbname=postfix user=postfix password=$Postfix_Database_Password map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } EOF mkdir /home/sieve cat <<EOF>/home/sieve/globalfilter.sieve || exit 1 require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } if header :contains "subject" "***SPAM***" { fileinto "Spam"; } EOF sievec /home/sieve/globalfilter.sieve chown -R vmail:mail /home/sieve

4 8

Re: UID Purge?
by Aki Tuomi 28 Mar '17

28 Mar '17

On 28.03.2017 10:55, Kevin Myers wrote: >> Does this happen if you do this on wire? >> >> telnet localhost 143 >> a LOGIN username password >> s SELECT INBOX >> s STORE 1:1 FLAGS (\Deleted) # or some other message-set >> n NOOP >> l LOGOUT >> >> Aki > Good point. No. And if I just delete it in Thunderbird (my client) it > does as it's told and just marks it deleted. Maybe it's a > Thunderbird/Dovecot thing? you could try looking at https://wiki2.dovecot.org/Debugging/Rawlog to find out. Aki

3 4

UID Purge?
by Kevin 28 Mar '17

28 Mar '17

Hi, I've just migrated to Dovecot from cyrus-imapd, and I notice that when I move emails from one folder to another they appear to be automatically marked deleted (expected) and also purged (not expected). With cyrus, I am used to emails being marked deleted, but still existing until a manual purge (expunge). Is this normal behaviour with Dovecot, and is it configurable? Thanks. Kevin.

2 1

replicator crashing - oom
by Daniel Miller 24 Mar '17

24 Mar '17

I have the following in my log: Mar 21 14:46:59 bubba dovecot: replicator: Panic: data stack: Out of memory when allocating 1073741864 bytes Mar 21 14:46:59 bubba dovecot: replicator: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x97c90) [0x7f4638a7cc90] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x97d6e) [0x7f4638a7cd6e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4638a14322] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x95e3f) [0x7f4638a7ae3f] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x9608b) [0x7f4638a7b08b] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xb15f8) [0x7f4638a965f8] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x93c42) [0x7f4638a78c42] -> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x74) [0x7f4638a78fb4] -> dovecot/replicator(replicator_queue_push+0x13b) [0x40519b] -> dovecot/replicator() [0x4049c2] -> dovecot/replicator() [0x4040a8] -> dovecot/replicator() [0x404275] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f4638a907d2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe7) [0x7f4638a91d17] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0x7f4638a9086c] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f4638a90a28] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f4638a1dfc3] -> dovecot/replicator(main+0x17a) [0x40342a] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f4638640ec5] -> dovecot/replicator() [0x4034c5] Mar 21 14:47:00 bubba dovecot: replicator: Fatal: master: service(replicator): child 15650 killed with signal 6 (core dumped) -- Daniel

4 7

One way dsync replication with dsync -R
by Wolfgang Hennerbichler 24 Mar '17

24 Mar '17

Hi dovecot users, I’ve found the -R parameter for dsync. Does this enable one-way syncing if enabled on the slave in replication_dsync_parameters? The documentation doesn’t mention much what happens if I enable this on the “replciation slave”. Before you ask: Two way synchronisation causes issues in my installation (see the unanswered thread here: http://www.dovecot.org/list/dovecot/2017-March/107431.html) it causes unread, deleted messages to re-appear. I would hope that one-way synchronisation would avoid this, but I’d also like to know if the -R parameter is safe to use. I am also still wondering if anybody has a perfectly working 2-way-synchronised dovecot installation (and I’m interested in your dovecot -n). wogri

2 5

FTS on shared/virtual folders
by Daniel Miller 24 Mar '17

24 Mar '17

A question on how FTS is implemented with regards to shared & virtual mailbox. In particular - with Solr. Does Dovecot treat each shared and virtual mailbox as completely independent - which means Solr would reindex each appearance independently? If that's the case, has any thought been given to potentially identifying such queries and passing them to Solr against the "native" or private mailboxes that are referenced? -- Daniel

1 0

"Connection queue full" error
by Mark Moseley 24 Mar '17

24 Mar '17

Just a quickie: why is "Connection queue full" logged under Info, instead of something like error? Or at least have the word 'error' in it? Seems like a pretty error-ish thing to happen. Anything that causes the connection to fail from the server side should show up in a grep -i for error. I.e. I don't care about clients failing to match up SSL cipher suites; that's fine as Info (SSL errors ironically do have 'error' in them, though I assume that's coming from the ssl libs). But the server dropping connections due to running out of available daemons (and any other "server isn't working right" conditions) is definitely worthy of Error.

1 0

dsync with namespaces
by Tom Sommer 23 Mar '17

23 Mar '17

I have a major dsync headache which I am hoping someone can help me with. I have to migrate mails from a 'namespace/inbox/prefix=INBOX.' server to a 'namespace/inbox/prefix=' server. So I'm trying # dsync -o 'namespace/inbox/prefix=' sync -1 -f -u xx(a)xx.com tcp:1.2.3.4 It works fine for some accounts, however for others many hundreds and sometimes thousands of mails go missing from the destination inbox, and a resync doesn't pick them up. The debug output doesn't recognize these either. If I remove the 'namespace/inbox/prefix=' part, then I get 'Error: Couldn't find namespace for mailbox X' errors. Both source and destination is running 2.2.27 I can't imapsync :S Thanks. -- Tom

1 0

Re: Can't verify remote server certs without trusted CAs (ssl_client_ca_* settings)
by Ralf Hildebrandt 23 Mar '17

23 Mar '17

* Aki Tuomi <aki.tuomi(a)dovecot.fi>: > Could you send us the gdb bt full backtrace for the core file? Currently I can't get it to create coredumps doveconf -n: # 2.2.devel (3f97702): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (023f391) # OS: Linux 4.4.0-65-generic x86_64 Ubuntu 16.04.2 LTS auth_mechanisms = plain login default_vsz_limit = 1 G imapc_host = exchange-imap.charite.de imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no listen = *,:: mail_gid = imapproxy mail_home = /home/imapproxy/%u mail_location = imapc:~/imapc mail_plugins = mail_log notify mail_uid = imapproxy passdb { args = host=exchange-imap.charite.de port=993 ssl=imaps default_fields = userdb_imapc_user=%u userdb_imapc_password=%w userdb_imapc_host=exchange-imap.charite.de userdb_imapc_ssl=imaps userdb_imapc_port=993 driver = imap } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap service auth { inet_listener { address = 127.0.0.1 port = 12345 } } ssl = required ssl_ca = </etc/ssl/certs/ca-certificates.crt ssl_cert = </etc/dovecot/dovecot.pem ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 ssl_client_ca_file = /etc/ssl/certs/ca-certificates.crt ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } verbose_proctitle = yes Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

3 4

Ubuntu Dovecot 2.2.9 several Errors, Transaction log as well as BUG message
by Kein Name 23 Mar '17

23 Mar '17

Hello List, I am running an Ubuntu 14.04.5 LTS Server with Dovecot 2.2.9, only local filesystems and authentication done via mysql backend. Server is a Strato Virtual Server running 2.6.32-042stab120.11 #1 SMP Fri Mar 10 16:52:50 MSK 2017 i686 i686 i686 GNU/Linux Sometimes I see errors in the log like this for one user: Error: Transaction log /var/vmail/ example.net/jena/Maildir/.Archives.2017/dovecot.index.log: duplicate transaction log sequence (2) After seeing these, some time later, (mostly 2h), Dovecot starts to deny login from all clients with messages like this: Mar 23 01:32:27 h2312250 dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: REQUEST?1804861441?19318?1?9ce500129289a0237e4e85a6c880a047?session_pid=19323... Mar 23 01:32:27 h2312250 dovecot: imap: Error: Authentication server didn't send valid SPID as expected: MECH#011PLAIN#011plaintext Mar 23 01:32:27 h2312250 dovecot: imap: Error: Disconnected from auth server, aborting (client-pid=19318 client-id=1) Mar 23 01:32:27 h2312250 dovecot: imap-login: Internal login failure (pid=19318 id=1) (internal failure, 1 successful auths): user=< user(a)example.net>, method=PLAIN, rip=X, lip=X, mpid=19323, session=<G9f4AltL4ABRqZ4X> I do not know if these problems have something to do with each other or not. But it happened several times now (maybe once or twice every month or so). When I restart Dovecot, the error seems gone for the moment, until it comes back in a month or some weeks. For reference, here is the running config: dovecot.conf # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab120.11 i686 Ubuntu 14.04.5 LTS auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { quota = maildir:User quota quota_rule = *:bytes=10M sieve = ~/dovecot.sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = root } ssl_cert = </etc/postfix/sslcert/mailserver.crt ssl_key = </etc/postfix/sslcert/mailserver.key userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol imap { mail_plugins = quota imap_quota } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve quota postmaster_address = postmaster(a)example.net quota_full_tempfail = yes } dovecot-mysql.conf driver = mysql connect = host=localhost dbname=mail user=user password=XXX default_pass_scheme = CRYPT password_query = SELECT password FROM users WHERE email = '%u' user_query = SELECT CONCAT('/var/vmail/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/') AS home, CONCAT('maildir:/var/vmail/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/Maildir/') AS mail, 5000 AS uid, 5000 AS gid, concat('*:bytes=', quota) AS quota_rule FROM users WHERE email = '%u' Any help is appreciated. Thanks Stefan Koenig

2 2

dovecot configuration oops
by Liam Parker 23 Mar '17

23 Mar '17

Hi, I've just transitioned from using courier to dovecot. Thanks for making this possible. During the 'quite simple' transition process, I didn't do much prep as I'm in more of a more of a fix-compile-fix-compile mode rather than a 'read all the docs first' so you may just want to give up now :) If you are still with me, I just wanted to say, it wasn't completely obvious that I needed a password and a user database [PAM not virtual]. Maybe that's just me but anyway, I spent longer than I should have trying to get PAM to work before eventually realising 'internal error check server logs' meant 'where's your user database'. I guess I assumed PAM could cover it all. If you are in to that kind of thing (usability), it might be sensible to have some kind of "basic errors" check during the config file parse phase which picks up stuff like this and points out a more specific error. I did check the logs vigorously and I even turn on every kind of debug_ (to the extent I started getting plain text passwords in the log!) but the 'internal server error check logs' was actually the only log entry for this issue. In case the point is still unclear, I would have spent less time running in the wrong direction if the error message had been "At least one user database must be configured" or some such. I completely understand if your philosophy is "read the manual or suffer the consequences" and it wasn't a complete fail but a simple up front config check could have helped. Thanks for your time today, Kind Regards, Liam

2 1

Understanding quotas
by Robert Moskowitz 23 Mar '17

23 Mar '17

Just to level-set, I am using Centos7-arm which supplies Dovecot 2.2.10. I don't have access to a arm build or mock environment and use what is available (I DID try to install them but had dependency issues). Much of what I have is from campworld, but some I have picked up from other Centos mailserver builders. Also I am using Postfixadmin which provides quotas per user in mysql database. To access those quotas for dovecot, I have the following script: cat <<EOF>/etc/dovecot/dovecot-dict-quota.conf || exit 1 connect = host=localhost dbname=postfix user=postfix password=$Postfix_Database_Password map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } EOF Where $Postfix_Database_Password is an env variable in my install howto. I am setting up quota plugins as follows: sed -i "/#mail_plugins/ a mail_plugins = quota sieve" /etc/dovecot/conf.d/15-lda.conf sed -i "/#mail_plugins / a mail_plugins = quota imap_quota trash" /etc/dovecot/conf.d/20-imap.conf sed -i "/#mail_plugins/ a mail_plugins = quota" /etc/dovecot/conf.d/20-pop3.conf But I am having 'challenges' with how to actually enable quotas and understanding 90-quota.conf. I am starting from campworld's 'reduced' dovecot.conf seeing: dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } and plugin { quota = dict:user::proxy::quotadict acl = vfile:/etc/dovecot/acls trash = /etc/dovecot/trash.conf sieve_global_path = /home/sieve/globalfilter.sieve sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /home/sieve/ #sieve_extensions = +notify +imapflags sieve_max_script_size = 1M } I have put the sieve plugin lines into the 90-sieve.conf and the acl into 10-acl.conf. Trash is a separate matter for a later question... So I am looking for guidance as to how to integrate the Postfixadmin quota information properly into 90-quota.conf thank you

2 3

Re: replicator crashing - oom
by Daniel Miller 22 Mar '17

22 Mar '17

Think I got it: #0 0x00007fddaf597c37 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #1 0x00007fddaf59b028 in __GI_abort () at abort.c:89 #2 0x00007fddaf9c0c86 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:201 #3 0x00007fddaf9c0d6e in i_internal_fatal_handler (ctx=0x7fff7197d000, format=<optimized out>, args=<optimized out>) at failures.c:670 #4 0x00007fddaf958322 in i_panic (format=format@entry=0x7fddafa047b8 "data stack: Out of memory when allocating %lu bytes") at failures.c:275 #5 0x00007fddaf9bee3f in mem_block_alloc (min_size=536870912) at data-stack.c:341 #6 0x00007fddaf9bf08b in t_malloc_real (size=size@entry=536870912, permanent=permanent@entry=true) at data-stack.c:396 #7 0x00007fddaf9bf0ca in t_malloc (size=size@entry=536870912) at data-stack.c:442 #8 0x00007fddaf9da5f8 in pool_data_stack_realloc (pool=<optimized out>, mem=0x7fdd99f59038, old_size=268435449, new_size=536870912) at mempool-datastack.c:126 #9 0x00007fddaf9bcc42 in p_realloc (new_size=<optimized out>, old_size=<optimized out>, mem=<optimized out>, pool=<optimized out>) at mempool.h:88 #10 buffer_alloc (buf=buf@entry=0xf849a8, size=536870912) at buffer.c:36 #11 0x00007fddaf9bcfb4 in buffer_check_limits (data_size=32, pos=268435424, buf=0xf849a8) at buffer.c:75 #12 buffer_write (_buf=0xf849a8, pos=268435424, data=0xfa0420, data_size=32) at buffer.c:187 #13 0x000000000040519b in array_append_i (count=1, data=0xfa0420, array=<synthetic pointer>) at ../../../src/lib/array.h:168 #14 replicator_queue_handle_sync_lookups (user=0xfa3fc0, queue=0xf92260) at replicator-queue.c:278 ---Type <return> to continue, or q <return> to quit--- #15 replicator_queue_push (queue=0xf92260, user=0xfa3fc0) at replicator-queue.c:296 #16 0x00000000004049c2 in dsync_callback (reply=DSYNC_REPLY_OK, state=0xf84590 "AQAAAHX+sC3O3gNSjAoAAOEwx0RQoclMAwAAAAQ", 'A' <repeats 20 times>, "DAAAAEu2cNfSIZk0oMgAAO8QcX0yhyUwDAAAAlg", 'A' <repeats 20 times>, "IAAADFjqMEUPIEU+IlAACdtazLUaHJTAcAAAAI", 'A' <repeats 20 times>, "BwAAAEfYPTqXct9VYRMAAJ21"..., context=0xfa1560) at replicator-brain.c:121 #17 0x00000000004040a8 in dsync_callback (client=0xfa14a0, state=<optimized out>, reply=DSYNC_REPLY_OK) at dsync-client.c:65 #18 0x0000000000404275 in dsync_input_line (line=0xf84988 "+", client=0xfa14a0) at dsync-client.c:132 #19 dsync_input (client=0xfa14a0) at dsync-client.c:153 #20 0x00007fddaf9d47d2 in io_loop_call_io (io=0xfa15a0) at ioloop.c:599 #21 0x00007fddaf9d5d17 in io_loop_handler_run_internal (ioloop=ioloop@entry=0xf8c720) at ioloop-epoll.c:223 #22 0x00007fddaf9d486c in io_loop_handler_run (ioloop=ioloop@entry=0xf8c720) at ioloop.c:648 #23 0x00007fddaf9d4a28 in io_loop_run (ioloop=0xf8c720) at ioloop.c:623 #24 0x00007fddaf961fc3 in master_service_run (service=0xf8c5c0, callback=callback@entry=0x404720 <client_connected>) at master-service.c:641 #25 0x000000000040342a in main (argc=1, argv=0xf8c390) at replicator.c:112 Daniel On 3/22/2017 9:11 AM, Daniel Miller wrote: > Where would I find the core file? I'm not finding anything obvious. > > The replicator path is /usr/local/libexec/dovecot/replicator > > Daniel > > On 3/22/2017 12:52 AM, Aki Tuomi wrote: >> Can you provide us gdb bt full dump? >> >> gdb /usr/libexec/dovecot/replicator /path/to/core >> >> on some systems, it's /usr/lib/dovecot/replicator >> >> Aki >> >> On 21.03.2017 23:48, Daniel Miller wrote: >>> I have the following in my log: >>> >>> Mar 21 14:46:59 bubba dovecot: replicator: Panic: data stack: Out of >>> memory when allocating 1073741864 bytes >>> Mar 21 14:46:59 bubba dovecot: replicator: Error: Raw backtrace: >>> /usr/local/lib/dovecot/libdovecot.so.0(+0x97c90) [0x7f4638a7cc90] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(+0x97d6e) [0x7f4638a7cd6e] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4638a14322] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(+0x95e3f) [0x7f4638a7ae3f] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(+0x9608b) [0x7f4638a7b08b] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(+0xb15f8) [0x7f4638a965f8] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(+0x93c42) [0x7f4638a78c42] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(buffer_write+0x74) >>> [0x7f4638a78fb4] -> dovecot/replicator(replicator_queue_push+0x13b) >>> [0x40519b] -> dovecot/replicator() [0x4049c2] -> dovecot/replicator() >>> [0x4040a8] -> dovecot/replicator() [0x404275] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) >>> [0x7f4638a907d2] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe7) >>> >>> [0x7f4638a91d17] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) >>> [0x7f4638a9086c] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) >>> [0x7f4638a90a28] -> >>> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) >>> [0x7f4638a1dfc3] -> dovecot/replicator(main+0x17a) [0x40342a] -> >>> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) >>> [0x7f4638640ec5] -> dovecot/replicator() [0x4034c5] >>> Mar 21 14:47:00 bubba dovecot: replicator: Fatal: master: >>> service(replicator): child 15650 killed with signal 6 (core dumped) >>>

1 0

Permission denied when logrotating dovecot.log
by Michael Heuberger 22 Mar '17

22 Mar '17

Hello guys Having headaches here how to make logrotation for dovecot log files work. Having permission issues: michael.heuberger@xxx /e/l/daily ❯❯❯ sudo logrotate -fv dovecot.daily ⏎ reading config file dovecot.daily Handling 1 logs rotating pattern: /var/log/dovecot*.log forced from command line (10 rotations) empty log files are rotated, old logs are removed considering log /var/log/dovecot.log error: skipping "/var/log/dovecot.log" because parent directory has insecure permissions (It's world writable or writable by group which is not "root") Set "su" directive in config file to tell logrotate which user/group should be used for rotation. This is my current logrotation conf for dovecot: /var/log/dovecot*.log { rotate 10 missingok sharedscripts postrotate doveadm log reopen endscript } And the /var/log folder has these permissions: drwxrwxr-x 12 root syslog 4.0K Mar 19 12:43 log Any clues what's wrong? Thanks Michael -- Binary Kitchen Michael Heuberger 1/33 Parrish Road Sandringham Auckland 1025 (New Zealand) Mobile (text only) ... +64 21 261 89 81 Email ................ michael(a)binarykitchen.com Website .............. http://www.binarykitchen.com

5 9

SIS and mailbox restore
by Jean-Luc Oms 22 Mar '17

22 Mar '17

Still on the problem with dovecot 2.2.27 .... I use the single instance storage, and mdbox format. I use 2 zfs file systems, one for mailboxes, the other for attachements. I use znapzend to generate many zfs snapshots for backup purpose (inode numbers are preserved but it is unusefull). When I try to restore a deleted/purged mailbox with doveadm import I get the error of the first attachement missing in the SIS and the process stops. Option 1: the python script is working but it's really too long. * I restore all the SIS missing files since the snapshot date, preserving hard link count; * I restore the mailbox * I purge all the mailbox to delete the large number of unnecessery files restored Option 2: looking in the list archive I see that doveadm dump can guive me the msg.ext-ref that was missing to my knowledge. I try this use of doveadm dump: doveadm dump /MySnapShot/vmail/user/mdbox/storage/m.* Is this correct to get all the information I need ? I have to write a script to get msg.ext-ref for a particular msf.guid, or a specific mailbox Is there a way with doveadm dump to extract this type of information for a particular mailbox ? Thanks for your support. -- __________________________________________ Jean-Luc Oms STI-RéseauX - LIRMM - CNRS/UM2 161 rue Ada - BAT 4 - CC 477 34095 Montpellier cedex 5 Tel +33 4 67 41 85 93 Urg +33 6 32 01 04 17 __________________________________________

1 0

[Sieve] Is the way to run external script to get attachment?
by Konstantin Shalygin 22 Mar '17

22 Mar '17

Hello. Read all about Extprograms, but have a question. Use case: Every day we have couple messages with attachment (from one sender, this is one-way communication). This attachment is uploads to ownCloud. By hand... need some automation. As I see, pipe cat execute scripts with text data USER/FROM/SUBJECT - and I think with variables it can be any text data, how about attachment? How I see this: script executes and as arg receives from sieve attachment file, or message file and we can parse it for attachment. When we have attachment - upload to ownCloud via RESTapi and purge message. Found some realization for encrypt messages https://github.com/EtiennePerot/gpgit/blob/master/encmaildir.sh but for me more easy just connect to IMAP and do what I want (but I love sieve). Thanks. <http://wiki.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms>

2 2

Problem with sieve_before
by Ger Hooton Scoil Chroí Íosa Blarney 22 Mar '17

22 Mar '17

Hi All, I cannot get the sieve_before to work. I have dovecot & sieve installed on Debian 7 as follows /etc/dovecot/conf.d/90-sieve.conf : plugin { # The path to the user's main active script. If ManageSieve is used, this the # location of the symbolic link controlled by ManageSieve. sieve = ~/.dovecot.sieve # The default Sieve script when the user has none. This is a path to a global # sieve script file, which gets executed ONLY if user's private Sieve script # doesn't exist. Be sure to pre-compile this script manually using the sievec # command line tool. # --> See sieve_before fore executing scripts before the user's personal # script. sieve_default = /var/lib/dovecot/sieve/default.sieve # Directory for :personal include scripts for the include extension. This # is also where the ManageSieve service stores the user's scripts. sieve_dir = ~/sieve/ # Directory for :global include scripts for the include extension. sieve_global_dir = /var/lib/dovecot/sieve/ # Path to a script file or a directory containing script files that need to be # executed before the user's script. If the path points to a directory, all # the Sieve scripts contained therein (with the proper .sieve extension) are # executed. The order of execution within a directory is determined by the # file names, using a normal 8bit per-character comparison. Multiple script # file or directory paths can be specified by appending an increasing number. sieve_before = /var/lib/dovecot/sieve/before #####sieve_before2 = /var/lib/dovecot/sieve/before/default2.sieve #sieve_before3 = (etc...) # Identical to sieve_before, only the specified scripts are executed after the # user's script (only when keep is still in effect!). Multiple script file or # directory paths can be specified by appending an increasing number. #sieve_after = #sieve_after2 = #sieve_after2 = (etc...) # Which Sieve language extensions are available to users. By default, all # supported extensions are available, except for deprecated extensions or # those that are still under development. Some system administrators may want # to disable certain Sieve extensions or enable those that are not available # by default. This setting can use '+' and '-' to specify differences relative # to the default. For example `sieve_extensions = +imapflags' will enable the # deprecated imapflags extension in addition to all extensions were already # enabled by default. #sieve_extensions = +notify +imapflags ................................. In /var/lib/dovecot/sieve/before I have : drwxrwxrwx 3 mail mail 4096 Mar 20 23:47 .. -rw-rw-rw- 1 root root 195 Mar 21 09:57 default2.svbin -rwxrwxrwx 1 mail mail 157 Mar 21 11:12 default2.sieve default2.sieve is as follows: require ["fileinto"]; if allof (header :matches "subject" "*JUNK*") { fileinto "INBOX.Junk"; } The users personal filters work. Thanks for your help. __________________________________________________ Please consider the environment before printing this email. Ger

3 13

getmail with dovecot delivering problems
by Samuel Reina Calvo 22 Mar '17

22 Mar '17

Hi there, I put together a mail server with postfix+dovecot+mysql with virtual users and it works just fine as internal mail server, but when i put ir under a multidrop email server it sends ok but so far coulnd make getmail to deliver mails correctly. the use of getmail + dovecot downloads email via pop3 but then put all the emails in the same inbox. my maildir is /var/vmail/[domain] getmalirc conf is [retriever]type = MultidropPOP3Retriver server username password envelope_recipient = delivered-to:1 [destination] type = MDA_external path = /usr/local/libexec/dovecot/deliverthen when i run sudo -H -u vmail bash -c 'getmail -g /etc/.getmail -r /etc/.getmail/getmailrc' i get all the time all the messages delivered into /var/vmail/vmail (being vmail the linux user who handles my virtual users) __________ Información de ESET NOD32 Antivirus, versión de la base de firmas de virus 14929 (20170213) __________ ESET NOD32 Antivirus ha comprobado este mensaje. http://www.eset.com

2 1

last_login LDAP - killed with signal 11 (core dumped)
by Leon Kyneur 22 Mar '17

22 Mar '17

Hi I am trying to configure the last_login plugin with LDAP dictionary which is causing dict service to crash. Not sure if this is a bug or some configuration parameter I'm getting wrong? Running latest dovecot but was having the same problem in earlier version 2.2.25 # dovecot --version 2.2.28 (bed8434) I have configured dovecot like so: dovecot.conf (before conf.d/*.conf: dict { #quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext #expire = sqlite:/etc/dovecot/dovecot-dict-sql.conf.ext lastlogin = ldap:/etc/dovecot/dovecot-ldap-dict.conf.ext } conf.d/10-master.conf service dict { # If dict proxy is used, mail processes should have access to its socket. # For example: mode=0660, group=vmail and global mail_access_groups=vmail unix_listener dict { mode = 0660 user = vmail group = vmail } } conf.d/20-imap.conf: protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins last_login # Maximum number of IMAP connections allowed for a user from each IP address. # NOTE: The username is compared case-sensitively. #mail_max_userip_connections = 10 } 90-plugins.conf plugin { #setting_name = value #last_login_dict = proxy::lastlogin last_login_dict = proxy:dict:lastlogin zlib_save = gz zlib_save_level = 6 } dovecot-ldap-dict.conf.ext: uri = ldap://ldap.internal bind_dn = cn=Manager,dc=mail,dc=com password = XXXX tls = no debug = 1 map { pattern = last-login/$user filter = (&(mail=%{user})(objectClass=mailUser)) # the () is required base_dn = o=domains,dc=mail,dc=com username_attribute = mail value_attribute = lastLoginTime fields { mail=$user } } I don't see dovecot ever making a connection to the LDAP server I've configured in the dovecot-ldap-dict.conf.ext file. Log shows ==> /var/log/dovecot.log <== Mar 22 07:49:30 imap-login: Info: Login: user=<leon(a)mail.com>, method=PLAIN, rip=X.X.X.X, lip=X.X.X.X, mpid=36105, secured, session=<o0Lu/0xL4N3LhgGR> Mar 22 07:49:30 dict: Fatal: master: service(dict): child 36107 killed with signal 11 (core dumped) Mar 22 07:49:30 imap(leon(a)mail.com): Error: dict-client: Commit may have failed: Connection closed (reply took 0.015 secs) Mar 22 07:49:30 imap(leon(a)mail.com): Error: last_login_dict: Write was unconfirmed (timeout or disconnect) for user leon(a)mail.com Backtrace: # gdb /var/core/36107 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-94.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... [New LWP 36107] Reading symbols from /usr/libexec/dovecot/dict...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/dict.debug...done. done. Missing separate debuginfo for Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/b0/07fede01895dec1aca9d8b8993fe27d70a3a20 [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/dict'. Program terminated with signal 11, Segmentation fault. #0 0x0000000000000000 in ?? () (gdb) bt full #0 0x0000000000000000 in ?? () No symbol table info available. #1 0x00007fbcf11bd04f in cmd_begin (cmd=0x7fbcf2c02910, line=<optimized out>) at dict-commands.c:365 trans = 0x7fbcf2c029a0 id = 1 #2 0x00007fbcf11bdef8 in dict_command_input (conn=conn@entry=0x7fbcf2bf24d0, line=line@entry=0x7fbcf2bf48cb "B1") at dict-commands.c:625 cmd_func = 0x7fbcf13c85c0 <cmds+32> cmd = 0x7fbcf2c02910 ret = <optimized out> #3 0x00007fbcf11bc6ee in dict_connection_input_more (conn=0x7fbcf2bf24d0) at dict-connection.c:117 _data_stack_cur_id = 3 line = 0x7fbcf2bf48cb "B1" ret = <optimized out> #4 0x00007fbcf11bc7d2 in dict_connection_input (conn=0x7fbcf2bf24d0) at dict-connection.c:167 line = <optimized out> conn = 0x7fbcf2bf24d0 #5 0x00007fbcf0d1b2d2 in io_loop_call_io (io=0x7fbcf2bf2890) at ioloop.c:599 ioloop = 0x7fbcf2be0740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #6 0x00007fbcf0d1c95f in io_loop_handler_run_internal (ioloop=ioloop@entry=0x7fbcf2be0740) at ioloop-epoll.c:223 ctx = 0x7fbcf2beded0 events = <optimized out> list = 0x7fbcf2bf28f0 io = <optimized out> tv = {tv_sec = 2147483, tv_usec = 0} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #7 0x00007fbcf0d1b36c in io_loop_handler_run (ioloop=ioloop@entry=0x7fbcf2be0740) at ioloop.c:648 No locals. #8 0x00007fbcf0d1b528 in io_loop_run (ioloop=0x7fbcf2be0740) at ioloop.c:623 __FUNCTION__ = "io_loop_run" #9 0x00007fbcf0ca4603 in master_service_run (service=0x7fbcf2be05e0, callback=callback@entry=0x7fbcf11be150 <client_connected>) at master-service.c:641 No locals. #10 0x00007fbcf11bbff9 in main (argc=1, argv=0x7fbcf2be0390) at main.c:161 set_roots = {0x7fbcf13c88a0 <dict_setting_parser_info>, 0x0} error = 0x0

2 3