- dovecot - dovecot.org

moving from mysql to pgsql
by Magnus 06 Oct '17

06 Oct '17

Hello, I hope that this mailing list is "alive", since I am looking for a solution for my problem for a long time. I would like to migrate my existing dovecot installation from mysql to pgsql. But I have problems with the passwords when using pgsql. The existing and working mysql-based installation looks like this: dovecot-sql.conf.ext: driver = mysql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,ENCRYPT('Test'),'mws(a)alpenjodel.de'); This setup is working, which I can verify like this: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test OK Now let's take a look at the pgsql version of the setup: dovecot-sql.conf.ext: driver = pgsql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,crypt('Test',gen_salt('des')),'mws(a)alpenjodel.de'); This setup is not working: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test a NO [AUTHENTICATIONFAILED] Authentication failed. Assumptions: - I believe that the mysql encrypt function uses the crypt system call, which in turn uses the DES algorithm with a random salt. - I believe that the same is done with the pgsql function call crypt('Test',gen_salt('des')). But obviously some of these assumptions must be wrong. Besides that, the variable "default_pass_scheme" is set to "SHA512-CRYPT" in both cases. But obviously, not SHA but DES is used by the working mysql-based setup. I don't understand that. Could someone please explain the relationship between the default_pass_scheme variable and the encryption/hashing algorithm used to store the user passwords? And finally: What can I do to migrate to pgsql? Thank you Magnus

4 3

v2.2.33 release candidate released
by Timo Sirainen 05 Oct '17

05 Oct '17

https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz.sig There are a couple more small changes still coming, but this should be very close to the final release. I'm especially interested in hearing if there are any problems with doveadm log proxying or with director. We've improved our automated director tests quite a lot now, and fixed some rarely occurring bugs. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails.

1 0

Issue with imap folder structure
by absolutely_free＠libero.it 05 Oct '17

05 Oct '17

Hi, I use Dovecot 2.2.32 I just migrated spool from another server (by copying filesystem, I use maildir), this is an example of mailbox's content: drwx------ 20 postfix postfix 30 Oct 4 18:38 . drwx------ 3 postfix postfix 3 Nov 16 2012 .. drwx------ 5 postfix postfix 11 Jun 19 18:22 .Deleted Items drwx------ 5 postfix postfix 11 Sep 29 09:27 .Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Sent drwx------ 5 postfix postfix 9 Oct 3 18:01 .INBOX.Trash drwx------ 5 postfix postfix 12 Sep 29 09:27 .Junk drwx------ 5 postfix postfix 8 Dec 9 2014 .Junk E-mail drwx------ 5 postfix postfix 8 Nov 11 2015 .Archive drwx------ 5 postfix postfix 9 Oct 2 14:18 .Posta indesiderata drwx------ 5 postfix postfix 9 Jun 19 18:22 .Posta inviata drwx------ 5 postfix postfix 10 Oct 4 12:27 .Sent drwx------ 5 postfix postfix 10 Oct 4 18:01 .Trash drwx------ 2 postfix postfix 215 Oct 4 18:00 cur -rw------- 1 postfix postfix 53 Feb 16 2017 dovecot-keywords -rw------- 1 postfix postfix 13963 Oct 4 16:45 dovecot-uidlist -rw------- 1 postfix postfix 8 Oct 3 18:01 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Nov 27 2015 dovecot-uidvalidity.5658162a -r--r--r-- 1 postfix postfix 0 Sep 27 18:18 dovecot-uidvalidity.59cbcf5c -rw------- 1 postfix postfix 7200 Sep 29 01:19 dovecot.index -rw------- 1 postfix postfix 63336 Oct 4 18:00 dovecot.index.cache -rw------- 1 postfix postfix 6436 Oct 4 18:38 dovecot.index.log -rw------- 1 postfix postfix 216 Oct 3 18:01 dovecot.mailbox.log drwx------ 2 postfix postfix 2 Oct 4 16:45 new -rw------- 1 postfix postfix 96 Oct 3 18:01 subscriptions drwx------ 2 postfix postfix 2 Oct 4 16:12 tmp and this is my Dovecot's conf: auth_mechanisms = plain login digest-md5 cram-md5 disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 mail_gid = 1003 mail_location = maildir:/var/spool/virtual/domains mail_privileged_group = postfix mail_uid = 1003 namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/wildcard.domain.net_bundle.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql It seems I have duplicate folder (for example during webmail access, I use Roundcube). What is wrong with my setup? Thank you

3 4

STAT command error
by Andrew Charnley 04 Oct '17

04 Oct '17

Hi, Unsure if my previous message made it through as didn't see it on a digest. I'm using Claws Email and 3 of 4 email accounts keep giving; [10:50:45] POP< +OK Dovecot ready. [10:50:45] POP> USER sales [10:50:45] POP< +OK [10:50:45] POP> PASS ******** [10:50:45] POP< +OK Logged in. [10:50:45] POP> STAT [10:50:45] POP< -ERR Unknown command: *** error occurred on POP session *** Error occurred while processing mail. I've turned on as much logging as I can find in Dovecot but nothing useful is coming out, it honestly does believe STAT is invalid - I can see the connection close rather than disconnect. It's strange how it works for one account but not others, the settings are identical - I went through them with a fine tooth comb. Any suggestions appreciated. Regards, Andrew

2 1

ACL permission: give permission to move email into different folder
by Davide Marchi 03 Oct '17

03 Oct '17

Hi friends, I've set ACL for two user (two primary email address, no alias), where these users must not be able to delete email from imap server. Now I would like to add (from the client) the ability to move any incoming mail into different directory, if possible into an existing directory chosen by me. These are the settings on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip is it possible? I've read https://wiki2.dovecot.org/ACL but I've not found a solution. many many thanks! Davide

1 0

Postfix + saslauthd SASL With Kerberos (FreeIPA) unable to send mail
by Anvar Kuchkartaev 03 Oct '17

03 Oct '17

Hello I just finished setting up FreeIPA with Dovecot + Postfix + Saslauthd. I can easily access to mails using imap via dovecot with gssapi authentication and postfix also delivering mails very well. But I cannot send email from postfix using gssapi authentication (plain and login authentication working fine) because saslauthd is not specifying realm when requesting service from freeipa domain. warning: SASL authentication failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (No key table entry found matching smtp/mx0.aegisnet.eu@) right form of request is smtp/mx0.aegisnet.eu(a)AEGISNET.EU I googled alot but couldn't find any solution to solve this problem. How to configure saslauthd well that it will use realm to contact with freeipa. Best Regards...

2 3

file-solr
by Siarhei Chystsiakou 02 Oct '17

02 Oct '17

Hi, I have installed dovecot 2.2.31 and settings fts-solr, when I run command doveadm -v index -A "*" sometimes in logs I see information: doveadm(user(a)domain.com): Warning: fts-solr(user(a)domain.com): Mailbox INBOX UID=2028 header size is huge, truncating Does it influence the work of plugin and its functions?

1 0

dovecot listening imaps external interface
by David Mehler 02 Oct '17

02 Oct '17

Hello, I'm trying to get dovecot to listen on specific interfaces. On the server itself I've got webmail going so am needing imap on 143. I do not want this on the external server interface, so I am wanting imaps port 993 external only. The configuration looks right, but Dovecot isn't showing anything listening on port 993 at all. Unrelated, my public and shared folders are not working. Can anyone suggest fixes for either of these issues? Thanks. Dave. # 2.2.32 (dfbe293d4): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: FreeBSD 10.3-RELEASE-p20 amd64 auth_default_realm = domain.com auth_mechanisms = plain login auth_realms = domain.com domain2.com dict { acl = mysql:/usr/local/etc/dovecot/shared-folders.conf sqlquota = mysql:/usr/local/etc/dovecot/quota.conf } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.domain.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 xxx.xxx.xxx.xxx lmtp_rcpt_check_quota = yes mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/mail/:LAYOUT=fs:INDEX=~/mail/ mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib mail_server_admin = mailto:postmaster@domain.com mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:~/mail/:INDEX=~/mail/shared/%%Ld/%%Ln prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = virtual:/usr/local/etc/dovecot/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } prefix = virtual/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/sieve/sieve_error.log trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)domain.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap-postlogin { executable = script-login /usr/local/etc/dovecot/last_login_imap.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = no ssl_cert = </usr/local/etc/ssl/acme/domain.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256@STRENGTH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib sieve } protocol imap { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login }

2 1

Quota - frustrated trying to configure ...
by Garry Glendown 02 Oct '17

02 Oct '17

Hi, after fighting Dovecot almost every step of the way, I have finally gotten most of the functions configured on a customer box (used Cyrus on a previous install, but it was dropped from SLES 12 ...) The mail server setup uses LDAP for user authentication, has a central maildir tree (.../dovecot/maildir/<USER>/...) that is used for all users' mail, sieve is also running well. The users themselves are just virtual users, they do not have a local home directory or anything. I was now trying to get Quota to work ... Looking at the Wiki more or less showed the same "spotty" results of the rest of the Wiki. Fine for anybody that needs the documentation just as a reference, but somewhat lacking for someone that does not have experience in setting up Dovecot. I tried following the wiki, as well as checking on other web pages I came across. In order to keep the setup simple, and not have to jump through hoops to set up any SQL backup etc., I tried using a file-based storage of the quota entries, as in: dict { quota = file:/data/dovecot/db/quota.db } I also added quota entries in the other places I believe are necessary, and set up a rule like this: plugin { quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M } I got through dovecot restart without errors, and IMAP still answers. But attempting to do a recalculation of the current quota usage ends up with this error: doveadm(root): Error: chdir(/root/) failed: Permission denied (euid=479(dovecot) egid=478(dovecot) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(root): Error: chdir(/root) failed: Permission denied It looks like dovecot doesn't actually attempt to look at the central maildir, but instead seems to attempt to enter the current user's homedir (which, in this case, is root). What am I (possibly) missing here? Is this way of setting it up even viable? While I need a general per-user-quota, I also need the ability to overwrite each user's default quota ... is there any recommendable more detailed documentation on how to set up quota? Thanks, -garry

3 6

[PATCH] lib-mail: Set missing invalid_syntax to TRUE
by Pali Rohár 02 Oct '17

02 Oct '17

route is already set to "INVALID_ROUTE" when fill_missing is true, but setting invalid_syntax was not done yet. --- src/lib-mail/message-address.c | 1 + 1 file changed, 1 insertion(+) diff --git a/src/lib-mail/message-address.c b/src/lib-mail/message-address.c index 29cac2b..96584e2 100644 --- a/src/lib-mail/message-address.c +++ b/src/lib-mail/message-address.c @@ -153,6 +153,7 @@ static int parse_angle_addr(struct message_address_parser_context *ctx) if (parse_domain_list(ctx) <= 0 || *ctx->parser.data != ':') { if (ctx->fill_missing) ctx->addr.route = "INVALID_ROUTE"; + ctx->addr.invalid_syntax = TRUE; if (ctx->parser.data == ctx->parser.end) return -1; /* try to continue anyway */ -- 1.7.9.5

1 1