May 2020 - dovecot - dovecot.org

"/etc/dovecot/dovecot.conf: passdb is missing driver"
by Laura Smith 17 May '20

17 May '20

Hi, I'm trying to get dovecot working with postgres, I'm on Debian 10 and have installed dovecot-pgsql from the Dovecot repo (https://repo.dovecot.org/ce-2.3-latest/debian/....) I have the following in my local.conf : passdb sql { args = /etc/dovecot/local_sql_users.conf } And the following in the referenced file: driver = pgsql connect = host=localhost dbname=foobar user=bar password=foo default_pass_scheme = ARGON2ID password_query = select dovecot_username as user,password from get_user('%u') iterate_query = select dovecot_username as user from get_users() So surely it should work ? doveconf -n just to complete the picture .... # 2.3.10 (0da0eff44): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.10 (bf8ef1c2) # OS: Linux 4.19.0-9-amd64 x86_64 Debian 10.4 xfs # Hostname: foobar.example.com auth_verbose = yes auth_verbose_passwords = sha1:7 doveadm_password = # hidden, use -P to show it mail_location = maildir:/foobar/mail/%d/%n/Maildir mail_plugins = " notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/local_sql_users.conf name = sql } plugin { mail_replica = tcps:standby.example.com:11867 sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap lmtp replication_dsync_parameters = -1 -d -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { user = foobar } unix_listener replication-notify { user = foobar } } service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } vsz_limit = 2 G } service doveadm { inet_listener { port = 11867 ssl = yes } } service imap-login { process_min_avail = 5 service_count = 1 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = foobar } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieves { address = port = 5190 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = foobar } } ssl = required ssl_ca = </etc/foobar/ssl/example.com.chain ssl_cert = </etc/foobar/ssl/example.com.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = passwd } userdb { args = uid=foobar gid=foobar home=/foobar/mail/%d/%n driver = static } protocol lmtp { mail_plugins = sieve postmaster_address = foobar(a)example.com } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { mail_max_userip_connections = 20 }

2 1

Fallback driver after autodection
by Bjoern Koenig 16 May '20

16 May '20

Dear developers and dovecot users, I am running a dovecot with virtual users that have a mailbox using the Maildir format. mail_location = maildir:/usr/local/virtual/%d/%n New mailboxes are created on-the-fly if a new user logs in. I had the wish that the mailboxes of new users are created using the sdbox format and old mailboxes remain in Maildir format. In case the Maildir and sdbox mailboxes already exist, it is easy to use the "auto" driver which detects the correct format. But it is not possible to create mailboxes with the "auto" driver because there is no way to tell dovecot the preferred mailbox format. I wrote some lines of code which add the possibility to specify a fallback driver that will be used if a mailbox is created with the "auto" driver. mail_location = auto:/usr/local/virtual/%d/%n:FALLBACK=sdbox In case you like the idea you might want to develop it further. I am aware of the fact that there are some caveats if you mix it with other settings like LAYOUT. It won't work in any case. Best regards Bjoern --------------------------------------------------------------------------- diff -ruN src.bak/lib-storage/mail-storage.c src/lib-storage/mail-storage.c --- src/lib-storage/mail-storage.c.bak 2020-03-05 15:35:53.000000000 +0100 +++ src/lib-storage/mail-storage.c 2020-05-15 22:35:40.975992000 +0200 @@ -144,6 +144,10 @@ return classes[i]; } } + + if (set->fallback_driver != NULL) + return mail_storage_find_class(set->fallback_driver); + return NULL; } @@ -216,8 +220,10 @@ } storage_class = mail_storage_autodetect(ns, list_set); - if (storage_class != NULL) + if (storage_class != NULL) { + storage_class->v.get_list_settings(ns, list_set); return storage_class; + } (void)mail_user_get_home(ns->user, &home); if (home == NULL || *home == '\0') home = "(not set)"; diff -ruN src.bak/lib-storage/mailbox-list.c src/lib-storage/mailbox-list.c --- src/lib-storage/mailbox-list.c.bak 2020-03-05 15:35:53.000000000 +0100 +++ src/lib-storage/mailbox-list.c 2020-05-15 22:34:44.329802000 +0200 @@ -173,6 +173,8 @@ list->set.inbox_path = p_strdup(list->pool, set->inbox_path); list->set.subscription_fname = p_strdup(list->pool, set->subscription_fname); + list->set.fallback_driver = + p_strdup(list->pool, set->fallback_driver); list->set.list_index_fname = p_strdup(list->pool, set->list_index_fname); list->set.list_index_dir = @@ -360,6 +362,8 @@ else if (strcmp(key, "FULLDIRNAME") == 0) { set_r->index_control_use_maildir_name = TRUE; dest = &set_r->maildir_name; + } else if (strcmp(key, "FALLBACK") == 0) { + dest = &set_r->fallback_driver; } else if (strcmp(key, "BROKENCHAR") == 0) { if (strlen(value) != 1) { *error_r = "BROKENCHAR value must be a single character"; diff -ruN src.bak/lib-storage/mailbox-list.h src/lib-storage/mailbox-list.h --- src/lib-storage/mailbox-list.h.bak 2020-03-05 15:35:53.000000000 +0100 +++ src/lib-storage/mailbox-list.h 2020-05-15 22:35:01.251579000 +0200 @@ -121,6 +121,7 @@ const char *inbox_path; const char *subscription_fname; + const char *fallback_driver; const char *list_index_fname; /* Mailbox list index directory. NULL defaults to index directory. The path may be relative to the index directory. */ ---------------------------------------------------------------------------

1 0

SSL Error
by Brandon Roa 15 May '20

15 May '20

I just installed a certificate on my mail server to Postfix and Dovecot. The certificate is functional on Postfix, but for some reason I keep getting this error. Any suggestions on how to fix it? mail dovecot: imap-login: Error: SSL: Stacked error: error:1408A10B:SSL routines:ssl3_get_client_hello:wrong version number Here is my configuration: # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-45-generic x86_64 Ubuntu 16.04.6 LTS ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain cram-md5 login auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_debug = yes mail_gid = 5000 mail_location = maildir:/home/vmail/%d/%n mail_plugins = quota mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_rule = *:storage=5G sieve = /etc/dovecot/sieve/default.sieve sieve_default = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl_cert = </etc/ssl/certs/example.pem ssl_key = </etc/ssl/private/example.key userdb { args = uid=5000 gid=5000 home=/home/vmail/%d/%n driver = static } verbose_ssl = yes protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota }

2 3

converting old uucp buffer files to maildir
by mh＠mike.franken.de 15 May '20

15 May '20

Hi *, besides my dovecot maildir structure, that has been migrated from an Exchange server, I have an even older mail structure in an ancient uucp style. The program named CrossPoint I used for this isn't wideley known, but it used so called mpuffer files in a plain text format. It is the program I still use to write for example this mail. I wonder if there already exists a program or script to convert the files from this program to the Dovecot maildir structure or some Howto for writing it myself. The format of these files looks like shown below. Mails are separated by two new lines. ------------------------< snip snip snip >----------------------------- EMP: /archiv/net/dovecot^M KOP: <some_recipient>^M OEM: dovecot(a)dovecot.org^M ABS: ricardomachini(a)gmail.com (Ricardo Machini Barbosa)^M WAB: dovecot-bounces(a)dovecot.org^M BET: Header search on Dovecot with SOLR^M ROT: perth.mydomain.de!localhost!perth.hirmke.de!aqua.hirmke.de!elvis.otherdomain.de!rachael.otherdomain.de!talvi.dovecot.org!talvi.dovecot.org!mail-qk1-x72e.google.com!smtp.gmail.com!DESKTOP4CIJMB3^M MID: 078901d61d7e$0964bcd0$1c2e3670$(a)gmail.com^M EDA: 20200428165659W-03^M LEN: 6112^M MAILER: Microsoft Outlook 16.0^M X-XP-Boundary: ----=_NextPart_000_078A_01D61D64.E4184820^M MIME-Type: multipart/alternative; boundary="----=_NextPart_000_078A_01D61D64.E4184820"^M U-Content-Type: multipart/alternative; boundary="----=_NextPart_000_078A_01D61D64.E4184820"^M U-Sender: dovecot-bounces(a)dovecot.org^M U-Received: from localhost (localhost [127.0.0.1]) by perth.mydomain.de (Postfix) with ESMTP id 245AF862DA8 for <<some_recipient>>; Tue, 28 Apr 2020 18:58:11 +0200 (CEST)^M U-Authentication-Results: perth.mydomain.de (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com^M U-Received: from perth.mydomain.de ([127.0.0.1]) by localhost (perth.hirmke.de [127.0.0.1]) (amavisd-new, port 10024) with LMTP id RVP0-5mmK3XH for <<some_recipient>>; Tue, 28 Apr 2020 18:58:09 +0200 (CEST)^M U-Received: from aqua.mydomain.de (aqua.hirmke.de [192.168.1.11]) by perth.hirmke.de (Postfix) with ESMTP id 66A8B862D97 for <<some_recipient>>; Tue, 28 Apr 2020 18:58:07 +0200 (CEST)^M U-Received: by aqua.mydomain.de (Postfix, from userid 10) id 56D88506E; Tue, 28 Apr 2020 18:58:07 +0200 (CEST)^M U-Received: from rachael.otherdomain.de ([193.175.24.38]) by elvis.otherdomain.de with esmtp (Exim 3.36 #1) id 1jTTYK-0007WE-00 for <some_recipient>; Tue, 28 Apr 2020 18:57:48 +0200^M U-Received: from talvi.dovecot.org (talvi.dovecot.org [94.237.25.159]) by rachael.otherdomain.de (Postfix) with ESMTPS id 9C19510642C45 for <<some_recipient>>; Tue, 28 Apr 2020 18:57:46 +0200 (CEST)^M U-Received: from talvi.dovecot.org (localhost.localdomain [127.0.0.1]) by talvi.dovecot.org (Postfix) with ESMTP id 12ABD2B3C9F; Tue, 28 Apr 2020 19:57:06 +0300 (EEST)^M X-Original-To: dovecot(a)dovecot.org^M U-Delivered-To: dovecot(a)dovecot.org^M U-Received: from mail-qk1-x72e.google.com (mail-qk1-x72e.google.com [IPv6:2607:f8b0:4864:20::72e]) by talvi.dovecot.org (Postfix) with ESMTPS id D48EB2B3C6F for <dovecot(a)dovecot.org>; Tue, 28 Apr 2020 19:57:03 +0300 (EEST)^M U-Received: by mail-qk1-x72e.google.com with SMTP id c63so22534959qke.2 for <dovecot(a)dovecot.org>; Tue, 28 Apr 2020 09:57:03 -0700 (PDT)^M U-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id:mime-version:thread-index :content-language; bh=u9iSrDj6VaHxbCoUFYZ7Zp0PHd/EPA66NRtYVeLn0+Q=; b=QUqHsAo0P6JkAidluC5utFcRyQ3AaJXn6GJwM/l+wJE0XM40Ks/0A5uNE16l76pTNU 37Uu5RETZXTMIvyJHkCgJXDVQS5RPep8U0Bw//DMBSC09XMaxVDVu0hVln2UQvNhFkZy 3DvfA1z1HOMmUlVpyYuAVgJa1FUd7VB34jmKmyrB4+0PS39Cbo9+rVZvyKNxHj/z8Kh+ l/ivk5e35L2eq1cUiomqhcus8m7vZ3edA0wEQbU4Z5p3oGBQcGb/5pe3NczjRjJ0oF1q 5OEcIXAxiREMU3DuiYkJCQE28hPMFf10/1/NtGLwlFGdLTseq8LwMM9hY9h8aKmkFAyB Xrvg==^M X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :thread-index:content-language; bh=u9iSrDj6VaHxbCoUFYZ7Zp0PHd/EPA66NRtYVeLn0+Q=; b=VvYSZ0dCKbTlD3JWsIM+c/IvKn4ODGwMBBDIlHSpKHVjLOX3bAQk5NLCdJgsVrHTH3 eX+fCHmwyIgoaa2bMZK45aURu0H/kELwUc4k/ToQ+MLikNLe7J1GEcDeG2R0Mzk6oOCs wX3JHFLfpK0shX+XRLiJju8Xmk+dFnPWZcQKYVEsBsSIG4y4LaOEE9NCCWcUfmlwqXIH CUBJ/xVHAvrA/Tc4krWhLgjR6M0m8pKM+hX0XvlEcQM9aNgFOzVUJDyM0AgW/hWvurNb fPqEgehT3b2YieMUR90+aYHybQddNGb0PSaD33ocmNb4jhNyuQIWx/B2niV/lRhd68Mm 2IaQ==^M X-Gm-Message-State: AGi0Pub1W8n/ZsL3XKsrqZB7wN3LxZgnRvleyGc7wO5LZcvfpihQoI5H tsYQUwckNuvUN4/JneVuDEGcKyPY^M X-Google-Smtp-Source: APiQypIGqpcSdvRH6NE1wbVeWc8EFZqdGP6OWn+bpMR2BCfPfi4m+swvYIadz5cfAuOe3TXSjYk1Jg==^M X-Received: by 2002:a37:9ad0:: with SMTP id c199mr26948945qke.472.1588093022024; Tue, 28 Apr 2020 09:57:02 -0700 (PDT)^M U-Received: from DESKTOP4CIJMB3 ([2804:14c:90:81be:7d50:c076:9537:75cb]) by smtp.gmail.com with ESMTPSA id w42sm14281733qtj.63.2020.04.28.09.57.00 for <dovecot(a)dovecot.org> (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 28 Apr 2020 09:57:01 -0700 (PDT)^M U-Thread-Index: AdYdffFdO2elBIGpSdyo3M9jdQ9BUQ==^M U-Content-Language: pt-br^M U-Content-Language: pt-br^M U-ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=dovecot.org; s=arc; t=1588093024; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: dkim-signature; bh=u9iSrDj6VaHxbCoUFYZ7Zp0PHd/EPA66NRtYVeLn0+Q=; b=Kfs/zrLFMMS+arGz8yJqX9KfjGpJWquL0QP4ccnziaPKOvpksDppuzM8snn/PS7bvhyiyr eDHKtsVFML1EME6QvvwTAbtUBDfaUN72KdIZsVSUs6raqIXWSNoXyIgH/1YmhSr1ClnY+E x5bNCnH/+rBbn0domw7lyZOLB672jMZsrz0qPOQekATrf7ISyFvwwXeWFO4PasT9R+F2Ci vlac2RY52IojdAiB7SF1E46WEhn6vVTnurM0z3G+lGSYI5UGQSKNkzfYAdyg7sXc1Bjd6f EV5zeNRkDyTpFbgIZWkT/VleWH3pKxzfboMpw6PZByMFJpo/+TgSJG/YiLY58A==^M U-ARC-Seal: i=1; s=arc; d=dovecot.org; t=1588093024; a=rsa-sha256; cv=none; b=grcJhp/zviK1BBKPNhz59Ktlw8wnbtBy/YamNS+vADIvfhbWKxTtQ+2MDQeri7sYFIjbG1 5wP5Ogs2mwF6BX4Ifjdv8Qj96FVD2RMcwVlv4xKH4gDoq/mJE9/lE0LJ2gouBBgt98dX54 itEhXRhSw+oe8bkMXljoV5GTVQEJeJaz5GAg35+XV/I1vbkFrrTVnUOw+JNKNSiFnBswk0 kxWaWOQXZTMJdg6WvKZ/Ru/iiaiiXzyG0q4gdU1Az8FQZ2HoXtZmjtvCOGw2gmXMmQn+Fi sMKbrvzDTeF8lS6L53ZVey0P2mAN172XsMXyaaCuZb7fQFyZvrCBNoXi5mV+TA==^M U-ARC-Authentication-Results: i=1; talvi.dovecot.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=QUqHsAo0; spf=pass (talvi.dovecot.org: domain of ricardomachini(a)gmail.com designates 2607:f8b0:4864:20::72e as permitted sender) smtp.mailfrom=ricardomachini(a)gmail.com^M X-BeenThere: dovecot(a)dovecot.org^M X-Mailman-Version: 2.1.15^M U-Precedence: list^M U-List-Id: Dovecot Mailing List <dovecot.dovecot.org>^M U-List-Unsubscribe: <https://dovecot.org/mailman/options/dovecot>, <mailto:dovecot-request@dovecot.org?subject=unsubscribe>^M U-List-Archive: <https://dovecot.org/pipermail/dovecot/>^M U-List-Post: <mailto:dovecot@dovecot.org>^M U-List-Help: <mailto:dovecot-request@dovecot.org?subject=help>^M U-List-Subscribe: <https://dovecot.org/mailman/listinfo/dovecot>, <mailto:dovecot-request@dovecot.org?subject=subscribe>^M U-Errors-To: dovecot-bounces(a)dovecot.org^M X-XP-NTP: 40^M ^M This is a multipart message in MIME format.^M ^M ------=_NextPart_000_078A_01D61D64.E4184820^M Content-Type: text/plain;^M charset="us-ascii"^M Content-Transfer-Encoding: 7bit^M ... ------------------------< snip snip snip >----------------------------- TIA. Bye. Michael. -- Michael Hirmke

2 1

doveadm sync backup from old to new server
by Gregory Sloop 15 May '20

15 May '20

So I've done quite a lot of searching on the list and on the web - and perhaps my google-fu is really bad - but I can't find any real recipes on how to sync mail from the old server to the new. As an FYI - the old server is a CPanel/WHM setup on a VPS. The new is mailcow - which uses docker. However, I don't think either of these platforms is what's causing the issue - but I'm certainly not sure of that. --- I've tried several things - but have lost track of all the things I've tried. This seemed like the best of all the things I've tried. This particular mailbox/user+domain is setup on both servers. doveadm backup -D -u mc-user(a)abc.net ssh root(a)abc.net -p2200 doveadm dsync-server -u cp-user(a)abc.net mc-user(a)abc.net is the MC/NEW mailbox/domain cp-user(a)abc.net is the CPanel/OLD user/domain account The SSH server of the remote system is running on port 2200. However when I try this, I get: WARNING: The WATCHDOG_NOTIFY_EMAIL variable is not set. Defaulting to a blank string. dsync-local(user(a)abc.net)<v44NFyRWvF5efgAAb6OASA>: Error: read(remote) failed: EOF (version not received) doveadm(user(a)abc.net): Fatal: execvp(ssh) failed: No such file or directory The process appears to hang, and a Ctrl+C stops it. I'd love to get pointed at a reasonable recipe on how to make this work. I don't really get/understand the docs much at all. [And either everyone else understands it just fine, and never thinks to write a document on how to do it - or, and I think this is a lot more likely - they're using something like imapsync to do it. I found numerous places where others were, essentially, "Dovecot's tool is way too complicated and I can't get it to work right, so I used imapsync." I suppose I should probably just do that too, but it does seem a shame to do that when the dovecot tool is almost certainly the best tool for the job, but I can't figure out how to use it.] If someone can help me grok what's going on, I'm glad to write it up for the list and or a blog entry so it's more accessible. TIA -Greg

3 14

Can't connect to Managesieve Server - what´s wrong?
by Anton Blau 15 May '20

15 May '20

Hi, please excuse my bad english language. But I am not a native speaker. I have installed dovecot including sieve and managesieve on a ubuntu 18.04 lts. When I try to access the filter with roundcube (from another vm) I get the error message "Cannot connect to Managesieve-Server". If I try a "telnet myserver.dynvpn.de 4190" from the roundcube-vm I get Trying 188.194.95.63... Connected to myserver.dynvpn.de. Escape character is '^]'. "IMPLEMENTATION" "Dovecot (Ubuntu) Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparat or-i;ascii-numeric relational regex imap4flags copy include variables body enoti fy environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve" "NOTIFY" "mailto" "SASL" "" "STARTTLS" "VERSION" "1.0" OK "Dovecot (Ubuntu) ready." So I think that dovecot managesieve is running. In /var/log/syslog I get with sieve: ... May 13 23:56:04 firstmail dovecot: imap(debian(a)firstmail.locallan): Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so ... When I try with telnet I get: ... May 14 00:00:30 firstmail dovecot: managesieve-login: Debug: SSL: elliptic curve secp384r1 will be used for ECDH and ECDHE key exchanges May 14 00:00:30 firstmail dovecot: managesieve-login: Debug: SSL: elliptic curve secp384r1 will be used for ECDH and ECDHE key exchanges ... What can I do to get connect from Roundcube to dovecot-managemsieve? Thank you! Tony ---> 20-imap.conf protocol imap { mail_plugins = $mail_plugins imap_sieve } ---> 20-lmtp.conf protocol lmtp { postmaster_address = administrator@locallan # required mail_plugins = $mail_plugins sieve } ---> 20-managesieve.conf protocols = $protocols sieve service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { # Max. number of ManageSieve processes (connections) process_limit = 1024 } protocol sieve { } ---> 90-sieve.conf plugin { sieve_plugins = sieve_imapsieve sieve_extprograms sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve = file:/var/vmail/sieve/%u;active=/var/vmail/sieve/%u/active-script.sieve sieve_default = /var/vmail/sieve/default/default.sieve sieve_global = /var/vmail/sieve/global/ imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_before = file:/var/vmail/sieve/global/report-spam.sieve imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_before = file:/var/vmail/sieve/global/report-ham.sieve sieve_pipe_bin_dir = /usr/bin sieve_global_extensions = +vnd.dovecot.pipe } ---> 90-sieve-extprograms.conf plugin { }

3 6

[Dovecot v2.3.9.3] HTTP API Endpoint for mailbox cryptokey operations
by Thibault HUTTIN-PASSERON 14 May '20

14 May '20

Hello everyone, I successfully set up the mail_crypt plugin using folder keys, and require user's key to be encrypted with a password using mail_crypt_require_encrypted_user_key = yes. As I'm trying to streamline the process of creating a user, and want to develop an application in PHP to help me in that process, I'm very interested in the doveadm HTTP API. Although the mail_crypt plugin is not referenced in the API, I discovered that it could be accessed all the same, provided some camelCase changes. So far I've been able to generate the following json for the mailbox cryptokey generate command: curl -X POST -H "Authorization: X-Dovecot-API <base64-api-token>" -H "Content-Type: application/json" -d '[["mailboxCryptokeyGenerate",{"user":"<username>","userKeyOnly":true},"tag1"]]' http://localhost:8081/doveadm/v1 which is able to give me the same output as the related command: doveadm mailbox cryptokey generate -u <username> -U. This only works if a keypair has already been generated for the user, which is kind of counter-productive in my use case. I would like to know if there was a way to adapt the following command into a json API call : doveadm -o plugin/mail_crypt_private_password=<password> mailbox cryptokey generate -u <username> -U Especially the -o plugin/mail_crypt_private_password=<password> part, since it seems I've figured out the other part partly tinkering partly looking through the source code. Thanks everyone for your input. Thibault PASSERON PS : excerpts from my configuration : doveconf -n =========== # 2.3.9.3 (9f41b88fa): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.9 (db4e9a2f) # OS: Linux 5.6.7-300.fc32.x86_64 x86_64 Fedora release 32 (Thirty Two) # Hostname: <hostname> auth_mechanisms = plain login dict { sqldict = mysql:/etc/dovecot/dovecot-sql-dict.conf.ext } doveadm_api_key = # hidden, use -P to show it mail_attribute_dict = proxy:dict:sqldict mail_plugins = quota mail_crypt passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_crypt_curve = secp521r1 mail_crypt_require_encrypted_user_key = yes mail_crypt_save_version = 2 } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service doveadm { inet_listener http { port = 8081 } unix_listener doveadm-server { } } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota mail_crypt sieve } dovecot-sql.conf.ext ==================== driver = mysql connect = "host=/var/lib/mysql/mysql.sock user=<user> password=<pass> dbname=<db>" #SQL Query used to fetch the user from the DB user_query = SELECT email as user, \ CONCAT('*:bytes=',quota) AS quota_rule, \ '/var/spool/mail/virtual_mailboxes/%d/%n' as home, \ 5000 AS uid, \ 5000 AS gid, \ crypt AS mail_crypt_save_version \ FROM virtual_users WHERE email='%u'; #SQL Query used to fetch the user's password from the DB password_query = SELECT password, \ crypt AS userdb_mail_crypt_save_version, \ '%w' AS userdb_mail_crypt_private_password \ FROM virtual_users WHERE email='%u'; #SQL Query to iterate over all users iterate_query = SELECT email AS user FROM virtual_users; dovecot-sql-dict.conf.ext ========================= #driver = mysql connect = "host=/var/lib/mysql/mysql.sock user=<user> password=<pass> dbname=<db>" # User's private keys map { pattern = priv/$mailboxid/vendor/vendor.dovecot/pvt/crypt/privkeys/$digest table = virtual_users_cryptokeys_priv_dict username_field = email value_field = key_contents fields { mailbox_id = $mailboxid key_digest = $digest } } map { pattern = priv/$mailboxid/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/pvt/crypt/privkeys/$digest table = virtual_users_cryptokeys_priv_server_dict username_field = email value_field = key_contents fields { mailbox_id = $mailboxid key_digest = $digest } } #User's active private key map { pattern = priv/$mailboxid/vendor/vendor.dovecot/pvt/crypt/active table = virtual_users_cryptokeys_priv_active_dict username_field = email value_field = key_digest fields { mailbox_id = $mailboxid } } map { pattern = priv/$mailboxid/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/pvt/crypt/active table = virtual_users_cryptokeys_priv_active_server_dict username_field = email value_field = key_digest fields { mailbox_id = $mailboxid } } #Public keys map { pattern = shared/$mailboxid/vendor/vendor.dovecot/pvt/crypt/pubkeys/$digest table = virtual_users_cryptokeys_shared_dict value_field = key_contents fields { mailbox_id = $mailboxid key_digest = $digest } } map { pattern = shared/$mailboxid/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/pvt/crypt/pubkeys/$digest table = virtual_users_cryptokeys_shared_server_dict value_field = key_contents fields { mailbox_id = $mailboxid key_digest = $digest } } #Active public keys map { pattern = shared/$mailboxid/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/pvt/crypt/active table = virtual_users_cryptokeys_shared_active_server_dict value_field = key_digest fields { mailbox_id = $mailboxid } } map { pattern = shared/$mailboxid/vendor/vendor.dovecot/pvt/crypt/active table = virtual_users_cryptokeys_shared_active_dict value_field = key_digest fields { mailbox_id = $mailboxid } }

1 0

Support for MULTISEARCH
by Daniel Miller 14 May '20

14 May '20

Does Dovecot presently support the MULTISEARCH command, or are there plans to do so? --- Daniel

6 12

Re: doveadm sync backup from old to new server
by Aki Tuomi 14 May '20

14 May '20

> On 14/05/2020 09:02 Adi Pircalabu <adi(a)ddns.com.au> wrote: > > > On 14-05-2020 15:16, Aki Tuomi wrote: > >> On 14/05/2020 04:09 Gregory Sloop <gregs(a)sloop.net> wrote: > >> > >> > >> So I've done quite a lot of searching on the list and on the web - and > >> perhaps my google-fu is really bad - but I can't find any real recipes > >> on how to sync mail from the old server to the new. > >> > >> As an FYI - the old server is a CPanel/WHM setup on a VPS. > >> The new is mailcow - which uses docker. > >> > >> However, I don't think either of these platforms is what's causing > >> the issue - but I'm certainly not sure of that. > >> > >> --- > >> I've tried several things - but have lost track of all the things > >> I've tried. > >> This seemed like the best of all the things I've tried. > >> > >> This particular mailbox/user+domain is setup on both servers. > >> > >> doveadm backup -D -u mc-user(a)abc.net ssh root(a)abc.net -p2200 doveadm > >> dsync-server -u cp-user(a)abc.net > >> > >> mc-user(a)abc.net is the MC/NEW mailbox/domain > >> cp-user(a)abc.net is the CPanel/OLD user/domain account > >> The SSH server of the remote system is running on port 2200. > >> > >> However when I try this, I get: > >> WARNING: The WATCHDOG_NOTIFY_EMAIL variable is not set. Defaulting to > >> a blank string. > >> dsync-local(user(a)abc.net)<v44NFyRWvF5efgAAb6OASA>: Error: > >> read(remote) failed: EOF (version not received) > >> doveadm(user(a)abc.net): Fatal: execvp(ssh) failed: No such file or > >> directory > >> > >> The process appears to hang, and a Ctrl+C stops it. > >> > >> I'd love to get pointed at a reasonable recipe on how to make this > >> work. > >> > >> I don't really get/understand the docs much at all. > >> [And either everyone else understands it just fine, and never thinks > >> to write a document on how to do it - or, and I think this is a lot > >> more likely - they're using something like imapsync to do it. I found > >> numerous places where others were, essentially, "Dovecot's tool is way > >> too complicated and I can't get it to work right, so I used imapsync." > >> I suppose I should probably just do that too, but it does seem a shame > >> to do that when the dovecot tool is almost certainly the best tool for > >> the job, but I can't figure out how to use it.] > >> > >> If someone can help me grok what's going on, I'm glad to write it up > >> for the list and or a blog entry so it's more accessible. > >> > >> TIA > >> -Greg > >> > > > > Just thought I'd point out that if you want to use ssh, it should be > > installed on both ends: > > > > "doveadm(user(a)abc.net): Fatal: execvp(ssh) failed: No such file or > > directory" > > > > If you don't want to, or can't install ssh, you can also use doveadm > > server: > > > > service doveadm { > > inet_listener { > > port = 12534 > > } > > } > > > > doveadm_port = 12534 > > doveadm_password = secretpass > > > > Then you can use tcp:otherhost:12534 as target/source. > > Hi Aki, > Does this service provide encryption in transit? > > -- > Adi Pircalabu You can use tcps if you enable SSL for doveadm listener. Add ssl=yes after port. Please keep replies on list. Aki

1 0

last_login_dict: Failed to write value: dict-server returned failure: sql dict: commit failed
by Nicolas DEFFAYET 12 May '20

12 May '20

Hello, I get last_login_dict: Failed to write value: dict-server returned failure: sql dict: commit failed randomly in the logs: --- 1 mailserver dovecot: imap(test-email-bb(a)exemple.com) <NtiT9H2SFIVcuGID> [xxx.xxx.xxx.xxx]: Error: last_login_dict: Failed to write value: dict-server returned failure: sql dict: commit failed: INSERT, UPDATE command denied to user 'dovecot'@'sqlserver' for table 'dovecot_last_login' (reply took 0.003 secs (0.000 in dict wait, 0.003 in other ioloops, 0.000 in locks, async-id reply 0.002 secs ago, started on dict-server 0.003 secs ago, took 0.003 secs)) --- The goal is to keep the unique couple email and ip_address in the table of SQL database and update only timestamp if email and ip_address exist on same row. I have enabled auth_debug and mail_debug but it don't show last_login_dict SQL queries in the log (auth SQL queries are shown). So I have enabled SQL debug on SQL server. In the SQL server log: --- 190918 13:49:59 3 Connect dovecot@sqlserver as anonymous on mail 4 Connect dovecot@sqlserver as anonymous on mail 4 Query BEGIN 4 Query INSERT INTO dovecot_last_login (timestamp,email,ip_address) VALUES (1568814599,'test-email-cc@exemple. com','abcd:aabb:cc:ddd::e') ON DUPLICATE KEY UPDATE timestamp=1568814599 5 Connect dovecot@sqlserver as anonymous on mail 4 Query COMMIT --- In the Dovecot mail server log: --- 1 mailserver dovecot: imap(test-email-bb(a)exemple.com) <NtiT9H2SFIVcuGID> [xxx.xxx.xxx.xxx]: Error: last_login_dict: Failed to write value: dict-server returned failure: sql dict: commit failed: INSERT, UPDATE command denied to user 'dovecot'@'sqlserver' for table 'dovecot_last_login' (reply took 0.003 secs (0.000 in dict wait, 0.003 in other ioloops, 0.000 in locks, async-id reply 0.002 secs ago, started on dict-server 0.003 secs ago, took 0.003 secs)) --- In the SQL server log: --- 17 Query BEGIN 17 Query INSERT INTO dovecot_last_login (timestamp,email,ip_address) VALUES (1568816073,'test-email-aa@exemple. com','abcd:aabb:cc:ddd::e') ON DUPLICATE KEY UPDATE timestamp=1568816073 17 Query COMMIT 19 Query BEGIN 19 Query INSERT INTO dovecot_last_login (timestamp,email,ip_address) VALUES (1568816073,'test-email-cc@exemple. com','abcd:aabb:cc:ddd::e') ON DUPLICATE KEY UPDATE timestamp=1568816073 19 Query COMMIT 20 Query BEGIN 20 Query INSERT INTO dovecot_last_login (timestamp,email,ip_address) VALUES (1568816073,'test-email-bb@exemple. com','abcd:aabb:cc:ddd::e') ON DUPLICATE KEY UPDATE timestamp=1568816073 20 Query COMMIT --- Database contain: MariaDB [mail]> SELECT * FROM mail.dovecot_last_login WHERE ip_address='abcd:aabb:cc:ddd::e'; +----------------------------+---------------------+------------------- --+------------+ | email | ip_address | datetime | timestamp | +----------------------------+---------------------+------------------- --+------------+ | test-email-cc(a)exemple.com | abcd:aabb:cc:ddd::e | 2019-09-18 14:14:33 | 1568816073 | | test-email-aa(a)exemple.com | abcd:aabb:cc:ddd::e | 2019-09-18 14:14:33 | 1568816073 | | test-email-bb(a)exemple.com | abcd:aabb:cc:ddd::e | 2019-09-18 14:14:33 | 1568816073 | +----------------------------+---------------------+------------------- --+------------+ 3 rows in set (0.00 sec) MariaDB [mail]> The SQL request executed directly on SQL server works: MariaDB [mail]> INSERT INTO dovecot_last_login (timestamp,email,ip_address) VALUES (1568815883,'test-email-aa@exemple. com','abcd:aabb:cc:ddd::e') ON DUPLICATE KEY UPDATE timestamp=1568815883; MariaDB [mail]> INSERT INTO dovecot_last_login (timestamp,email,ip_address) VALUES (1568815883,'test-email-bb@exemple. com','abcd:aabb:cc:ddd::e') ON DUPLICATE KEY UPDATE timestamp=1568815883; Did you have any tips how fix this issue ? Many thanks Best Regards, -- Nicolas DEFFAYET

1 0