- dovecot - dovecot.org

User authentication / activity log
by Karl Denninger 07 Jul '22

07 Jul '22

I'm on 2.3.19.1 (9b53102964) running on FreeBSD, if it matters. I have a set of maintenance "things" that I want to have happen if someone does not authenticate against Dovecot (to check mail) after some period of time. I was running the Z-Push exchange server, which (as its in PHP) made sticking an "you were here" flag in the user's filesystem easy, which of course means checking it is easy since the modification time on the file is sufficient. I was looking for something similar that I could use with Dovecot and my first thought was the cache or index files, but as it turns out local delivery (I'm running Postfix) updates those, so they're not left alone if no client is connected. I also don't see anything appropriate in the syslog that dovecot dumps into there I can scan for on a sign-in. My auth mechanism is "straight" login, no LDAP or similar, and I use pam as the mechanism. I don't see anything in the auth.log file or dovecot's logs. My authentication section for dovecot is pretty-basic: auth_mechanisms = login disable_plaintext_auth = yes passdb { args = session=yes dovecot driver = pam } protocols = imap Does Dovecot maintain something that I can reasonably find in the filesystem for this? A perusal of the documentation doesn't appear to show anything directly pertinent -- but I may have missed it. It appears that the event export capacity might be able to do this but I'm confused on how to set it up; what would be very useful is if, for each user, the log point could be different (e.g. in their home directory) and if it allowed overwriting (thus becoming an activity flag, basically.) Thanks in advance! -- Karl Denninger karl(a)denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/

2 2

Case sensitivity and unicode normalisation on ZFS for Dovecot Maildir
by Jørn Åne de Jong 06 Jul '22

06 Jul '22

I'm wondering about some filesystem considerations when using Dovecot. I've read https://wiki.dovecot.org/FileSystems, but that basically talks about low-level details. My question is not about that. I use the following mail_location: maildir:~/maildir:LAYOUT=fs:INBOX=~/maildir/INBOX:UTF-8 In this setup, because I use LAYOUT=fs and UTF-8, the IMAP names are identical to the directory names. I noticed that the INBOX name is case-insensitive, but all other names are case-sensitive. I wonder if it's possible to have consistent behaviour here. Now since I use ZFS, I have the ability to make the filesystem case insensitive and to normalise unicode codepoints. Is that something that would be useful when running a Dovecot server, or would that be a bad idea?

2 1

Trivial Pigeonhole patch: allow X-Original-From header for address tests
by Rob Foehl 04 Jul '22

04 Jul '22

Motivated by more DMARC silliness, naturally. -Rob

2 2

Découvrez notre offre GitLab Hébergée et Infogérée par Bearstech
by news＠bearstech.com 28 Jun '22

28 Jun '22

Découvrez notre offre GitLab Hébergée et Infogérée par Bearstech GitLab <http://phplist.bearstech.com/lists/lt.php?tid=Tza50Ap4TD2gj9FrGpMNfI8Q2GhbL…> s'est imposé au fil des ans comme une des solutions de gestion de code la plus complète et performante, supporté par une communauté Open Source dynamique, et des dizaines de millions d'utilisateurs. Nous hébergeons et infogèrons des Gitlab <http://phplist.bearstech.com/lists/lt.php?tid=Tza50Ap4TD2gj9FrGpMNfI8Q2GhbL…> depuis 10 ans pour nos clients. Ayant développé une expertise autant en exploitation qu'en conseil pour mettre en place et améliorer des workflows de déploiement complexes, nous avons décidé de proposer une offre simple et capable d'évoluer en fonction du dimensionnement de vos projets. Cette offre GitLab <http://phplist.bearstech.com/lists/lt.php?tid=Tza50Ap4TD2gj9FrGpMNfI8Q2GhbL…> est hébergée sur notre propre infrastructure, localisée en France. Nous offrons un niveau de support et une qualité de service irréprochable, avec une disponibilité garantie de 99.9%. Nous assurons un service d'astreinte 24h/7j/365. Les serveurs étant infogérés par Bearstech, la sécurité et la fiabilité de votre forge répondent ainsi aux plus hauts standards du métier. Au lieu d'un coût par utilisateur, nous vous proposons un prix mensuel correspondant aux ressources matérielles et à vos usages, votre budget est donc maitrisé et prévisible, le coût par utilisateur étant rapidement moins cher que sur l'offre Gitlab.com. Votre garantie, un support personnalisé, avec des experts capables de vous apporter des retours d'expérience précieux et améliorer continuellement votre démarche DevOps. Découvrez notre offre Gitlab Hébergée et infogérée par Bearstech <http://phplist.bearstech.com/lists/lt.php?tid=Tza50Ap4TD2gj9FrGpMNfI8Q2GhbL…>

1 0

Doveadm http requests - payload size
by Tony Hartmann - WebBoty 22 Jun '22

22 Jun '22

Hello Team, We are running dovecot version (2.3.7.2 (3c910f64b)) on ubuntu 20.04. Using the doveadm tool via http api we can create emails and move them accordingly to the draft folder by sending http requests via cURL from another server. We can even attach files. However once we create a http API request bigger than 1MB in size we get the “PAYLOAD TO LARGE” response from dovecot. Going through the config I see no option to increase the allowed payload size for doveadm http api requests. However in the source code itself I see that there is a default limit/size of: #define HTTP_REQUEST_DEFAULT_MAX_PAYLOAD_SIZE (1 * 1024 * 1024) Further I found out that the default is only used if no limit is provided: === if (limits != NULL) { hdr_limits = limits->header; max_payload_size = limits->max_payload_size; } else { i_zero(&hdr_limits); max_payload_size = 0; } /* substitute default limits */ if (parser->max_target_length == 0) parser->max_target_length = HTTP_REQUEST_DEFAULT_MAX_TARGET_LENGTH; if (hdr_limits.max_size == 0) hdr_limits.max_size = HTTP_REQUEST_DEFAULT_MAX_HEADER_SIZE; if (hdr_limits.max_field_size == 0) hdr_limits.max_field_size = HTTP_REQUEST_DEFAULT_MAX_HEADER_FIELD_SIZE; if (hdr_limits.max_fields == 0) hdr_limits.max_fields = HTTP_REQUEST_DEFAULT_MAX_HEADER_FIELDS; if (max_payload_size == 0) max_payload_size = HTTP_REQUEST_DEFAULT_MAX_PAYLOAD_SIZE; if ((flags & HTTP_REQUEST_PARSE_FLAG_STRICT) != 0) msg_flags |= HTTP_MESSAGE_PARSE_FLAG_STRICT; http_message_parser_init(&parser->parser, input, &hdr_limits, max_payload_size, msg_flags); return parser; The question arises … how can we change / set the allowed payload size for the doveadm http api, so we can store bigger emails and attachments? Can we store the desired allowed payload size in an env file somewhere or are there any options to take control of the allowed payload size without changing the source code? Thanks in advance Tony

1 0

running alternate dovecot instances on the same server
by Chris Hoogendyk 21 Jun '22

21 Jun '22

I'm posting to the list, but not on the list. I presume that means a reply-all to get to me as well as the list? We have two servers (dovecot --version: 2.2.22 (fe789d2)) that handle email for two different departments. We are transitioning mail service to the University central IT. They need to move accounts in an automated fashion and therefore need a master password to our dovecot servers. However, we are running with LDAP authentication, and I understand that a master password is not possible in that configuration. Would it be possible to run an alternate dovecot process that would use local account authentication, have a master password, and use an alternate port for connecting? Ideally it would only read accounts without changing anything, and would not interfere with the operation of the other dovecot process. I'm hoping that I could copy the configuration files, make these changes, and then launch it manually without any startup scripts in /etc/inetd.conf. Oh, by the way, we are running Ubuntu 16.04 LTS and have contracts with Ubuntu Advantage for ongoing patch support. The dovecot version is from the distribution, installed with aptitude. -- --------------- Chris Hoogendyk - O__ ---- Systems Administrator, Retired c/ /'_ --- Biology & Geosciences Departments (*) \(*) -- 315 Morrill Science Center III ~~~~~~~~~~ - University of Massachusetts, Amherst <hoogendyk(a)bio.umass.edu> --------------- Erdös 4

3 7

dovecot and openssl3
by A. Schulze 21 Jun '22

21 Jun '22

Hello, I tried to build dovecot-2.3.19.1 with openssl-3.0.2 "make test" failed. Good, the test-suite found a problem! I found similar reports and patches: - https://sources.debian.org/src/dovecot/1%3A2.3.19%2Bdfsg1-1/debian/patches/… - https://bugzilla.redhat.com/show_bug.cgi?id=1962035 - https://bugs.launchpad.net/ubuntu/+source/dovecot/+bug/1945763 - https://launchpadlibrarian.net/569387479/dovecot.debdiff The patch looks easy and at least 'make test' pass again. Could the dovecot developer have a look at the patch and say something about the roadmap to support openssl3? Thanks Andreas

1 0

Malformed XLIST replies
by Bogdan Szczurek 21 Jun '22

21 Jun '22

Hi! Some (considerable) time ago, I, as one of the Mailspring (https://getmailspring.com/) users, had a problem with setting up IMAP email account hosted on home.pl. I was able to narrow down the problem to how the Mailspring handles server response regarding folder list. The problem is twofold: a) how the response is handled by Mailspring's IMAP libraries, b) how the server itself responds. As to the first part of the problem I submitted relevant bug reports (https://github.com/MailCore/mailcore2/issues/1908 and https://github.com/dinhvh/libetpan/issues/403) and but the second part appears to belong here, since home.pl uses Dovecot as their IMAP server. Now about the problem. When XLIST is used to get the list of the folders, I get, for example: 3 XLIST "" "*" * XLIST (\HasNoChildren \) "." "Archive" * XLIST (\HasNoChildren \) "." "Courses" * XLIST (\HasNoChildren \Draft) "." "DRAFTS" * XLIST (\HasNoChildren \Inbox) "." "INBOX" * XLIST (\HasChildren \) "." "PhD" * XLIST (\HasNoChildren \) "." "PhD.Advisor" * XLIST (\HasNoChildren \) "." "PhD.Archive" * XLIST (\HasNoChildren \) "." "PhD.Articles" * XLIST (\HasNoChildren \) "." "PhD.Conferences" * XLIST (\HasNoChildren \) "." "PhD.Journals" * XLIST (\HasNoChildren \) "." "PhD.Thesis" 3 OK Completed Compare this with the LIST output: 4 LIST "" "*" * LIST (\HasNoChildren) "." "Archive" * LIST (\HasNoChildren) "." "Courses" * LIST (\HasNoChildren \Drafts) "." "DRAFTS" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasChildren) "." "PhD" * LIST (\HasNoChildren) "." "PhD.Advisor" * LIST (\HasNoChildren) "." "PhD.Archive" * LIST (\HasNoChildren) "." "PhD.Articles" * LIST (\HasNoChildren) "." "PhD.Conferences" * LIST (\HasNoChildren) "." "PhD.Journals" * LIST (\HasNoChildren) "." "PhD.Thesis" 4 OK Completed Notice, how in the XLIST example, every item has an additional “empty” flag (“\”). This part causes libetpan to fail. While ignoring the problem as a library's problem would be perfectly understandable, I think it should be also considered if something shouldn't be done on Dovecot's end. Granted, XLIST has been long depreceated, however it still is implemented and it should be implemented properly. Perhaps I'm mistaken, but I failed to find any mention of a thing like “empty flag”. It might not be prohibited, but it strikes me as something bizarre. I am unable to get the information about the Dovecot version used by home.pl, but I suspect this problem may still be present up to the newest version. Also, if someone is willing to take a closer look at the problem, I can provide you with an email account for testing purposes. Best regards! Bogdan

2 1

v2.3.19.1 released
by Aki Tuomi 20 Jun '22

20 Jun '22

Hi everyone! Due to a severe bug in doveadm deduplicate, we are releasing patch release 2.3.19.1. Please find it at locations below: https://dovecot.org/releases/2.3/dovecot-2.3.19.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.19.1.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot Aki Tuomi Open-Xchange oy --- - doveadm deduplicate: Non-duplicate mails were deleted. v2.3.19 regression. - auth: Crash would occur when iterating multiple backends. Fixes: Panic: file userdb-blocking.c: line 125 (userdb_blocking_iter_next): assertion failed: (ctx->conn != NULL)

3 7

Move sent emails to sent folder?
by Austin Witmer 20 Jun '22

20 Jun '22

Hello all! I have a server running dovecot & postfix. I have a user on my server who is sending email via smtp on an HP printer and because of that, a copy of the email is not placed in the sent folder like usually happens with clients like outlook and thunderbird. Is there any way to have the sent emails copied to the sent folder for just this user on my server? Thx! Austin Witmer

6 19

Home directories with colons in it
by Jonas Pasche 16 Jun '22

16 Jun '22

Howdy folks, we're using Dovecot 2.3.19 in combination with vmailmgr as the virtual user management backend (please don't judge, there are plans to move away from it for various reasons, but as of today it's there), using the wrapper from https://wiki.dovecot.org/HowTo/VMailMgr - and we're facing an interesting problem with colons in home directories. I think this problem is not specific to vmailmgr but happens in any scenario that includes ":" in directory names. tl;dr: - The checkvpw-dovecot-wrapper from the Dovecot wiki converts ":" in directory names to "::" which works fine with general IMAP use, but at least the autoexpunge plugin and ManageSieve don't handle this escaping and thus break on those users. - When patching the ":"->"::" conversion out of the checkvpw-dovecot-wrapper, Dovecot itself bails on it, interpreting it as a sub-setting. - The latter is quite surprising because a HOME/mail_home directory is supposed to be exactly one directory (AFAIK), with no sub-settings like e.g. mail_location, so I did not expect it to be "interpreted" in any way. Short story long: When you set up a user with a name containing dots, vmailmgr converts them to colons, pretty much like qmail does (qmail maps the username "xy.z" to a file named ".qmail-xy:z"; vmailmgr creates the directory "./users/xy:z" for that username). The wrapper from the dovecot wiki escapes ":" into "::" before exporting the user's directory as the HOME environment variable: /* escape possible ':' characters before finally exporting */ escape_colon(buffer, MAXLEN); setenv("HOME", buffer, 1); The result looks like that: [root@stardust ~]# doveadm auth login xy.z(a)coltest.uber.space supersecret passdb: xy.z(a)coltest.uber.space auth succeeded extra fields: user=xy.z(a)coltest.uber.space userdb extra fields: xy.z(a)coltest.uber.space home=/home/coltest/./users/xy::z <---------- notice the double colon here uid=1009 gid=1010 auth_mech=PLAIN So far, so good: Working with IMAP generally works fine, but there's a catch: Not every module seems prepared for this "::" syntax. The first notable exception is the autoexpunge plugin which simply bails on it: Error: autoexpunge: Couldn't create dovecot.autoexpunge.lock lock: file_create_locked(/home/coltest/./users/xy::z/dovecot.autoexpunge.lock) failed: safe_mkstemp(/home/coltest/./users/xy::z/dovecot.autoexpunge.lock) failed: No such file or directory The second notable exception is ManageSieve which takes the escaped directory name "as is", leading to a situation where the Maildir is in "xy:z" while the Sieve stuff is being put in "xy::z" where it effectively is never picked up during delivery (as the stuff is in the wrong location and the .dovecot.sieve symlink is - silently - not created): [coltest@stardust ~]$ ls -la users/* users/xy:z: total 28 drwx------. 9 coltest coltest 4096 Jun 16 11:39 . drwxr-xr-x. 4 coltest coltest 31 Jun 16 11:40 .. drwxr-xr-x. 2 coltest coltest 6 Jun 16 11:39 cur -rw-------. 1 coltest coltest 376 Jun 16 11:40 dovecot.index.log -rw-------. 1 coltest coltest 2676 Jun 16 11:39 dovecot.list.index.log -rw-------. 1 coltest coltest 96 Jun 16 11:39 dovecot.mailbox.log -rw-------. 1 coltest coltest 51 Jun 16 11:39 dovecot-uidlist -rw-------. 1 coltest coltest 8 Jun 16 11:39 dovecot-uidvalidity -r--r--r--. 1 coltest coltest 0 Jun 16 11:39 dovecot-uidvalidity.62aafa70 drwx------. 5 coltest coltest 108 Jun 16 11:39 .Drafts drwxr-xr-x. 2 coltest coltest 6 Jun 16 11:39 new drwx------. 5 coltest coltest 108 Jun 16 11:39 .Sent drwx------. 5 coltest coltest 108 Jun 16 11:39 .Spam -rw-------. 1 coltest coltest 28 Jun 16 11:39 subscriptions drwxr-xr-x. 2 coltest coltest 6 Jun 16 11:39 tmp drwx------. 5 coltest coltest 108 Jun 16 11:39 .Trash users/xy::z: total 0 drwx------. 3 coltest coltest 19 Jun 16 11:40 . drwxr-xr-x. 4 coltest coltest 31 Jun 16 11:40 .. drwx------. 3 coltest coltest 33 Jun 16 11:40 sieve So my initial thought was: Why is the ":" even escaped to a "::" in the first place? It shouldn't be necessary according to this clean workaround that I found in a posting from 2009 with Timo advising for this type of handling: > Hmm. Although now that I looked at your code, you seem to be using only > HOME. And using ~/ in mail_location should work around any ":" issues. > So what exactly is the problem you're seeing? https://www.dovecot.org/list/dovecot/2009-June/040590.html (In the same thread, Timo _also_ introduced the "::" handling in Dovecot.) This is exactly what we're doing at delivery time: Setting mail_home to the real pathname including a _single_ colon (not an escaped double colon) and then pointing mail_location to "~/": /usr/libexec/dovecot/dovecot-lda -a '$RECIPIENT' -f '$SENDER' -o mail_home='$MAILDIR' -o mail_location='maildir:~/' This works well. So my assumption was: If the checkvpw-dovecot-wrapper returns the HOME directory of a virtual user; where's even the need to escape a single colon to a double colon? So I gave it a try and removed that one line of escaping and recompiled the wrapper. Result: [root@stardust ~]# doveadm auth login xy.z(a)coltest.uber.space supersecret passdb: xy.z(a)coltest.uber.space auth succeeded extra fields: user=xy.z(a)coltest.uber.space userdb extra fields: xy.z(a)coltest.uber.space home=/home/coltest/./users/xy:z <---------- single colon here now uid=1009 gid=1010 auth_mech=PLAIN Using a real IMAP login, though, this lead to the "interesting" situation that the login itself worked correctly, but _then_ immediately an "Internal error occurred": [root@stardust ~]# nc localhost 143 * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ STARTTLS AUTH=PLAIN] Dovecot ready. 0 LOGIN xy.z(a)coltest.uber.space supersecret 0 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY PREVIEW STATUS=SIZE SAVEDATE SPECIAL-USE LITERAL+ NOTIFY SPECIAL-USE] Logged in * BYE Internal error occurred. Refer to server log for more information. This is the according log: Jun 16 10:04:37 stardust.uberspace.de dovecot[15268]: Jun 16 10:04:37 imap-login: Info: Login: user=<xy.z(a)coltest.uber.space>, method=PLAIN, rip=::1, lip=::1, mpid=22889, secured Jun 16 10:04:37 stardust.uberspace.de dovecot[15268]: Jun 16 10:04:37 imap(xy.z(a)coltest.uber.space)<22889><utbow43hgJoAAAAAAAAAAAAAAAAAAAAB>: Error: Namespace '': Unknown setting: z Jun 16 10:04:37 stardust.uberspace.de dovecot[15268]: Jun 16 10:04:37 imap(xy.z(a)coltest.uber.space)<22889><utbow43hgJoAAAAAAAAAAAAAAAAAAAAB>: Info: Disconnected: Namespace '': Unknown setting: z in=0 out=428 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 So it looks like Dovecot tries to do some interpretation on the HOME value, splitting it at the ":" and interpret the "z" as some kind of sub-setting - which a HOME variable (in contrast to, e.g. mail_location) is not supposed to have. Here I'm a bit stuck. My idea is to work around this by eliminating the ":" from directory names altogether by passing an explicit directory name to vadduser: [coltest@stardust ~]$ echo supersecret | vadduser --directory=./users/ab.c ab.c vadduser: user 'ab.c' successfully added [coltest@stardust ~]$ ls -l users total 0 drwx------. 5 coltest coltest 39 Jun 16 10:26 ab.c drwx------. 5 coltest coltest 39 Jun 16 09:31 xy:z But still, it would be nicer if Dovecot cleanly supported the ":" in directory names, as it seems to _want_ to support it (by introducing the "::" escaping) but then only does it halfway. Could this be fixed in whatever direction, or is there any other advice how we should handle this? All the best, Jonas

1 0

Re: [EXT] Re: The meaning of "tarpit" as used in the auth policy docs?
by Hippo Man 15 Jun '22

15 Jun '22

I'm sorry. Gmail didn't include the list in the "To" header when I responded, and I didn't notice. I fixed it now. -- hippoman(a)gmail.com Take a hippopotamus to lunch today. On Tue, Jun 14, 2022 at 2:40 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > Hi! > > Can you please keep responses on the list? =) > > Aki > > > On 14/06/2022 03:57 Hippo Man <hippoman(a)gmail.com> wrote: > > > > > > Thank you very much for explaining what "tarpit" means. > > > > So, if I return a huge numeric status value from the "before" check, > could I > > make the client wait for hours or even days or weeks before continuing > > with the authentication? > > > > -- > > hippoman(a)gmail.com > > Take a hippopotamus to lunch today. > > > > > > > > On Wed, Jun 8, 2022 at 12:50 AM Aki Tuomi <aki.tuomi(a)open-xchange.com> > wrote: > > > > > > > On 08/06/2022 05:34 Hippo Man <hippoman(a)gmail.com> wrote: > > > > > > > > > > > > I'm trying to understand what is meant by "tarpit" in the > ffollowing quote of the Dovecot auth policy docs for the "before" check ... > > > > First query is done before password and user databases are > consulted. This means that any userdb/passdb attributes are left empty. > > > > The command used here is ‘allow’ and will appear on the URL as > command=allow. > > > > status result values: > > > > * -1: Reject > > > > * 0: Accept > > > > * (Any other positive value): Tarpit for this number of seconds. > > > > What actually happens if a positive status value is returned here? > > > > > > > > Does it mean that the client will not receive any response for the > given number of seconds, but that the given login attempt will still > continue after that delay? Or does it mean that the client will not receive > a response for the given number of seconds, and then the login will be > rejected after that delay? > > > > > > > > What if the client has connected via pop3 and is sending multple > "user" and "pass" combinations? If the "before" check returns, for example, > the integer "5" as the status, does this mean there will be a 5-second > delay between each login attempt that is being sent to this connection? > > > > > > > > Ideally, I'd like the following to occur, but I don't know if it is > possible: > > > > > > > > * Client connects via pop3 and intends to send a large batch of > "user"/"pass" commands via this connection. > > > > > > > > * The first "user"/"pass" command is made to wait for many seconds. > > > > > > > > * Then, the connection is dropped, so that the subsequent > "user"/"pass" commands do not even hit the dovecot server. > > > > > > > > I'm thinking that this is *not* what is meant by "tarpit" in the > auth policy docs, correct? > > > > > > > > Thank you for any clarification. > > > > > > > > -- > > > > hippoman(a)gmail.com > > > > Take a hippopotamus to lunch today. > > > > > > Hi! > > > > > > When client connects, and sends authentication request dovecot > performs a policy lookup before any actual authentication. If this policy > result has positive value, tarpit occurs. > > > > > > This means we simply add a timeout to auth process and leave it > hanging, while handling other requests, and then perform the actual > authentication. The authentication is not failed, however. > > > > > > Aki > > > >

1 0

Re: doveadm-deduplicate deletes non-duplicates
by gravitini 14 Jun '22

14 Jun '22

Replying to: https://dovecot.org/pipermail/dovecot/2022-May/124816.html Hi, Looking at the code (and tested via local build from source) it looks like doveadm deduplicate in 2.3.19 can cause significant data loss. A 2022-02-11 commit removed key duplication resulting in undefined behaviour which is often truncation of a mailbox to 67 entries. (HASH_TABLE_MIN_SIZE) https://github.com/dovecot/core/commit/320844f50cd669b602d30210e2e5216f65d2… diff --git a/src/doveadm/doveadm-mail-deduplicate.c b/src/doveadm/doveadm-mail-deduplicate.c index caec758112..2152482876 100644 --- a/src/doveadm/doveadm-mail-deduplicate.c +++ b/src/doveadm/doveadm-mail-deduplicate.c @@ -63,8 +63,10 @@ cmd_deduplicate_box(struct doveadm_mail_cmd_context *_ctx, if (key != NULL && *key != '\0') { if (hash_table_lookup(hash, key) != NULL) mail_expunge(mail); - else + else { + key = p_strdup(pool, key); hash_table_insert(hash, key, POINTER_CAST(1)); + } } }

4 8

Re: dovecot Digest, Vol 230, Issue 21
by Joseph Tam 10 Jun '22

10 Jun '22

On Thu, 9 Jun 2022, Richard wrote: > Rather than simply upping the limit I think a reasonable question to > ask is why/how they are managing to do that. That's a lot of open > folders. If this mail client behaves anything like Apple mail clients, these connection storms can come about when doing global searches. The mail clients will march through each mailbox (opening a connection for each mailbox) looking for a pattern. If you can narrow this scenario for one specific user (e.g. $user), you can deep dive what's going on by enabling IMAP session logs for this user protocol imap { ... rawlog_dir = /log/dir/%u } then (Make sure this user has write permissions into this directory) mkdir /log/dir/$user After you're done, you can disable logging, rm -rf /log/dir/$user Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Issue with one user only, exceeding connections
by Richard 09 Jun '22

09 Jun '22

> Date: Thursday, June 09, 2022 11:07:38 -0500 > From: Jeremy Schaeffer <kb9mfd(a)phonesplus.biz> > > On 6/9/2022 10:59, Richard wrote: >> >>> Date: Thursday, June 09, 2022 10:46:25 -0500 >>> From: Jeremy Schaeffer <kb9mfd(a)phonesplus.biz> >>> >>> That was the first thing I tried, I lowered the cache connections >>> in Thunderbird. Actually the max connections was 50, not 500, but >>> I could see why as I do have a lot of folders, but what is odd is >>> I have other mailboxes that have even more folders, but it's only >>> one mailbox that is trowing the error. >>> >>> "# ps -axww | grep imap" does not give me the same results - >>> >>> ..... >>> >>> 19897 ? S 0:00 dovecot/imap >>> 19900 ? S 0:02 dovecot/imap >>> 19901 ? S 0:00 dovecot/imap >>> 19902 ? S 0:00 dovecot/imap >>> ..... >>> >>> I wish it did give me the mailbox, is there a option to get it to >>> give me that information? >> >> Try "auxw" on your "ps". I.e., add in the "u" which will get you >> the user detail in the first column, otherwise you just get the >> process id. >> >> > Thank you! That worked, I piped the output to a file, grep the > username and sure enough there are 60 lines. So I guess going over > 50 was a possibility. > > Learn something new every day. I set the maximum to 100 so I should > not have any errors on that anymore. > Rather than simply upping the limit I think a reasonable question to ask is why/how they are managing to do that. That's a lot of open folders. By the way, the single command: ps auxw | grep imap | cut -d" " -f1 | sort | uniq -c will get you a nice list with the users and their connection counts.

4 4

Issue with one user only, exceeding connections
by Jeremy Schaeffer 09 Jun '22

09 Jun '22

I keep having this issue with one user, and I have to restart dovecot several times a day to clear it. What I have is a postfix / dovecot mail server (Centos 7) and about a dozen users. All mailboxes are imap ssl. I monitor about 4 mailboxes on my computer and tablet. I use Thunderbird on the computer (cache connections at 2) and K9 on the tablet, but one user of the four I keep getting "Maximum number of connections from user+IP exceeded" and I have the maximum at 50 "(mail_max_userip_connections=50)" so its hard for me to believe I am actually exceeding it unless dovecot/client is not dropping connections and keeps starting new ones until it reaches the maximum, but again, only for one user, even though I am monitoring 4 on the same devices. Any idea how to troubleshoot this? I don't know if I should be looking at dovecot or the clients, or what I need to look for. It's been going on since I put this server in use over a year ago. I also have issues with Outlook clients disconnecting, just outlook, is there any recommended settings to make Outlook work smoother? Thanks! - Jeremy Config - # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1160.11.1.el7.x86_64 x86_64 CentOS Linux release 7.9.2009 (Core) # Hostname: *** auth_mechanisms = plain login debug_log_path = /var/log/dovecot_debug.log first_valid_gid = 500 last_valid_gid = 600 last_valid_uid = 600 listen = * mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { driver = pam } pop3_uidl_format = %f protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = required ssl_cert = <*** ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 }

4 6

Replicator: Panic: data stack: Out of memory
by Ivan Jurišić 09 Jun '22

09 Jun '22

Reproduce of error (Replicator: Panic: data stack: Out of memory): ================================================================== When replay on any mail I will got OOM. I try add in service replicate vsz_limit = 0 but that not help (after proces dovecot/replicator eat all ram I got OOM) Log error: ========== Jun 03 09:38:59 Warning: imap(ivan(a)myserv.local)<2533034><h7EQN4bgaJ4FvZdE>: replication(ivan(a)myserv.local): Sync failure: Timeout in 2 secs Jun 03 09:39:03 Panic: replicator: data stack: Out of memory when allocating 4294967336 bytes Jun 03 09:39:03 Error: replicator: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7feef08f0582] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7feef08f069e] -> /usr/lib/dovecot/libdovecot.so.0(+0x1022fb) [0x7feef08fd2fb] -> /usr/lib/dovecot/libdovecot.so.0(+0x102391) [0x7feef08fd391] -> /usr/lib/dovecot/libdovecot.so.0(+0x55589) [0x7feef0850589] -> /usr/lib/dovecot/libdovecot.so.0(+0x54d52) [0x7feef084fd52] -> /usr/lib/dovecot/libdovecot.so.0(+0xfb808) [0x7feef08f6808] -> /usr/lib/dovecot/libdovecot.so.0(+0x122938) [0x7feef091d938] -> /usr/lib/dovecot/libdovecot.so.0(+0xf76bf) [0x7feef08f26bf] -> /usr/lib/dovecot/libdovecot.so.0(+0xf777e) [0x7feef08f277e] -> /usr/lib/dovecot/libdovecot.so.0(buffer_append+0x61) [0x7feef08f2a21] -> dovecot/replicator(replicator_queue_push+0x15a) [0x55953ece9b7a] -> dovecot/replicator(+0x62b6) [0x55953ece92b6] -> dovecot/replicator(+0x594e) [0x55953ece894e] -> dovecot/replicator(+0x5b2c) [0x55953ece8b2c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7feef0913529] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x132) [0x7feef0914c12] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) [0x7feef09135d0] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7feef0913790] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7feef0886353] -> dovecot/replicator(main+0x18d) [0x55953ece7cbd] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7feef0651d0a] -> dovecot/replicator(_start+0x2a) [0x55953ece7d7a] Jun 03 09:39:03 Fatal: replicator: master: service(replicator): child 2532886 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) My configuration: ========== # 2.3.19 (b3ad6004dc): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 5.10.0-13-amd64 x86_64 Debian 11.3 ext4 # Hostname: mail.myserv.local auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.debug default_client_limit = 5000 default_process_limit = 1000 default_vsz_limit = 2 G deliver_log_format = msgid=%m, subject=%s, from=%f, size=%p(%w), %$ dict { quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } doveadm_password = # hidden, use -P to show it hostname = myserv.local lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_path = /var/log/dovecot.log mail_home = /var/mail/vhosts/%d/mail/%n mail_location = maildir:/var/mail/vhosts/%d/mail/%n:INDEX=/var/mail/vhosts/%d/indexes/%n mail_plugins = " quota fts fts_solr notify replication" mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Sent autocreate2 = Drafts autocreate3 = Junk autocreate4 = Trash autosubscribe = Sent autosubscribe2 = Drafts autosubscribe3 = Junk autosubscribe4 = Trash expire = Trash expire2 = Trash/* expire3 = Spam fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mail_replica = tcp:imap.myserv2.local:12345 quota = dict:Mailbox::proxy::quota quota_rule = *:storage=1G quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u replication_sync_timeout = 2 sieve = file:/var/mail/vhosts/%d/sieve/%n;active=/var/mail/vhosts/%d/sieve/%n/.dovecot.sieve sieve_after = /etc/dovecot/sieve/after.d/ sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_scripts = 50 } postmaster_address = postmaster@%d protocols = " imap lmtp sieve pop3" service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { user = vmail } } service doveadm { inet_listener { port = 12345 ssl = no } } service imap-login { process_min_avail = 4 service_count = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-warning { executable = script /var/lib/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = root } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/letsencrypt/live/myserv.local/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.1 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota fts fts_solr notify replication sieve" } protocol !indexer-worker { mail_vsize_bg_after_count = 100 } protocol lda { mail_plugins = " quota fts fts_solr notify replication sieve" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " quota fts fts_solr notify replication imap_quota imap_sieve" } protocol sieve { mail_max_userip_connections = 20 managesieve_max_line_length = 64 k } protocol pop3 { mail_max_userip_connections = 20 mail_plugins = " quota fts fts_solr notify replication quota" }

4 14

Re: Issue with one user only, exceeding connections
by Richard 08 Jun '22

08 Jun '22

> Date: Wednesday, June 08, 2022 14:14:23 -0500 > From: Jeremy Schaeffer <kb9mfd(a)phonesplus.biz> > > I keep having this issue with one user, and I have to restart > dovecot several times a day to clear it. What I have is a postfix / > dovecot mail server (Centos 7) and about a dozen users. All > mailboxes are imap ssl. I monitor about 4 mailboxes on my computer > and tablet. I use Thunderbird on the computer (cache connections at > 2) and K9 on the tablet, but one user of the four I keep getting > "Maximum number of connections from user+IP exceeded" and I have > the maximum at 50 "(mail_max_userip_connections=50)" so its hard > for me to believe I am actually exceeding it unless dovecot/client > is not dropping connections and keeps starting new ones until it > reaches the maximum, but again, only for one user, even though I am > monitoring 4 on the same devices. Any idea how to troubleshoot > this? I don't know if I should be looking at dovecot or the > clients, or what I need to look for. It's been going on since I put > this server in use over a year ago. I also have issues with Outlook > clients disconnecting, just outlook, is there any recommended > settings to make Outlook work smoother? > > Thanks! - Jeremy > > Config - > ># 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf ># OS: Linux 3.10.0-1160.11.1.el7.x86_64 x86_64 CentOS Linux release ># 7.9.2009 (Core) Hostname: *** > } > protocol imap { > mail_max_userip_connections = 50 > } > On my centos-7 dovecot install (same versions you indicate you are using), that connection-limiting line is in: /etc/dovecot/conf.d/20-imap.conf while you appear to have it in the main dovecot.conf file. If you have that in both places I'm not certain which one takes precedence, but you might want to check. [In my setup almost all the configuration pieces are in include files, rather than the main .conf.] Starting with a "ps" (and grep &etc.) it's fairly easy to see how many connections any account has open. An open mailbox has one or two connections and then every folder (under a mailbox) that is open will have a connection associated with it too, which pushes up the count quickly if someone holds a lot of folders open.

1 0

Occasional service disruptions
by Nikolaos Milas 08 Jun '22

08 Jun '22

Hello, On a server with (Postfix and) Dovecot 2.3.18 (on a VM running CentOS 7 - 1 CPU, 5 GB RAM) with the config you will see below, we are facing occasional (infrequent) service disruptions: IMAP service seems unavailable to some users. Jun 6 12:01:25 vweb2 roundcube: <1eecb0d4> IMAP Error: Login failed for imaptester against vmail2.noa.gr from 195.251.202.xxx. Could not connect to ssl://vmail2.noa.gr:993: Connection rejected in /var/webs/webmail/rcube/program/lib/Roundcube/rcube_imap.php on line 211 (POST /?_task=login&_action=login) At that time there was no associated logged event in dovecot log. (Other users are logging in and out.) However, I see some warnings (I list the two of them closest to the above event): Jun 06 12:01:22 imap(user1)<29639><Vr0atcPg5M3BXBCl>: Warning: Inotify instance limit for user 500 (UID vmail) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances ... Jun 06 12:01:26 imap(user2)<29793><rZuSt8PgztoKyVSG>: Warning: Inotify instance limit for user 500 (UID vmail) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances (In above log excerpts I've only modified real usernames.) Restarting Dovecot returns things back to normal. I have tried to use "service_count = 100" in all configured services, to see how it goes. Most of the config is inherited from the past (older versions) and is not optimized. For example one can observe different "process_limit" values for different services, for no apparent reason I am aware of. Could anyone suggest changes and/or additions to the OS and/or Dovecot to resolve this issue? Any additional suggestions will also be welcome. Thanks in advance for your kind assistance. Here is the config (I've only changed postmaster address): ======================================================================= protocols = imap pop3 sieve lmtp login_greeting = Dovecot NOA ICXC-NIKA log_path = /var/log/dove.log mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = no auth_debug = no mail_debug = no disable_plaintext_auth = no mail_plugins = quota mail_log notify protocol imap { imap_client_workarounds = "delay-newmail" mail_plugins = quota imap_quota mail_log notify mail_max_userip_connections = 400 namespace inbox { mailbox Trash { autoexpunge = 15d } } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota notify pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv namespace inbox { mailbox Trash { autoexpunge = 15d } } } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = quota notify sieve postmaster_address = xxxxxxxxx(a)noa.gr sendmail_path = /usr/lib/sendmail } protocol lmtp { auth_socket_path = /var/run/dovecot/auth-master postmaster_address = xxxxxxxxx(a)noa.gr mail_plugins = quota notify sieve sendmail_path = /usr/lib/sendmail } protocol sieve { managesieve_max_line_length = 65536 mail_max_userip_connections = 10 managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 10 } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid size flags vsize from subject quota = maildir:User quota quota_rule = *:storage=15G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u sieve = file:~/sieve;active=~/.dovecot.sieve sieve_max_script_size = 0 sieve_max_actions = 0 sieve_max_redirects = 2 } service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 100 vsz_limit = 64 M process_limit = 500 } service pop3-login { service_count = 100 vsz_limit = 64 M } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 100 process_min_avail = 0 vsz_limit = 64M } service managesieve { process_limit = 1024 } service imap { executable = imap postlogin process_limit = 2048 } service pop3 { executable = pop3 postlogin } service postlogin { executable = script-login -d rawlog unix_listener postlogin { } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = yes ssl_cert = </etc/pki/tls/certs/star_noa_gr-cert-with_CA-rev-754868755.crt ssl_key = </etc/pki/tls/private/star_noa_gr-1243437.key namespace inbox { separator = . prefix = inbox = yes mailbox Drafts { special_use = \Drafts auto = subscribe } mailbox Junk { special_use = \Junk auto = subscribe } mailbox Trash { special_use = \Trash auto = subscribe } mailbox Sent { special_use = \Sent auto = subscribe } } ======================================================================= Nick

3 4

Distros based on OpenSSL 3 fail on lib-dcrypt/test-crypto
by Sloane Bernstein 08 Jun '22

08 Jun '22

Hello, I am getting our Dovecot packages preliminarily ready to support Linux distributions which rely on OpenSSL 3. I notice that even the main dev branch will build, but the test suite fails (among other places) at test_password_change in src/lib-dcrypt/test-crypto.c: -- [root@al9 lib-dcrypt]# ./test-crypto test_cipher_test_vectors ............................................. : ok test_cipher_aead_test_vectors ........................................ : ok test_hmac_test_vectors ............................................... : ok test_load_v1_keys .................................................... : ok test_load_v1_key ..................................................... : ok test_load_v1_public_key .............................................. : ok test_load_v2_key ..................................................... : ok test_load_v2_public_key .............................................. : ok test_get_info_v2_key ................................................. : ok test_gen_and_get_info_rsa_pem ........................................ : ok test_get_info_rsa_private_key ........................................ : ok test_get_info_invalid_keys ........................................... : ok test_get_info_key_encrypted .......................................... : ok test_get_info_pw_encrypted ........................................... : ok test-crypto.c:827: Assert failed: ret == TRUE Panic: file dcrypt-openssl.c: line 2636 (dcrypt_openssl_private_to_public_key): assertion failed: (priv_key != NULL && pub_key_r != NULL) Error: Raw backtrace: ./test-crypto(backtrace_append+0x42) [0x445332] -> ./test-crypto(backtrace_get+0x1e) [0x44544e] -> ./test-crypto() [0x42414b] -> ./test-crypto() [0x424181] -> ./test-crypto() [0x412b69] -> .libs/libdcrypt_openssl.so(+0x5f25) [0x7fb61954df25] -> ./test-crypto() [0x41cd9a] -> ./test-crypto() [0x4200af] -> ./test-crypto(test_run+0x4c) [0x420c5c] -> ./test-crypto(main+0x4b) [0x41717b] -> /lib64/libc.so.6(+0x44e50) [0x7fb6195a3e50] -> /lib64/libc.so.6(__libc_start_main+0x7c) [0x7fb6195a3efc] -> ./test-crypto(_start+0x25) [0x417295] Aborted (core dumped) -- Looking at how various distros handle this test failure when building packages, they all seem to apply the same patch developed by Red Hat to get this test to pass, attached to https://bugzilla.redhat.com/show_bug.cgi?id=1962035: -- diff -up dovecot-2.3.14/src/lib-dcrypt/dcrypt-openssl.c.opensslv3 dovecot-2.3.14/src/lib-dcrypt/dcrypt-openssl.c --- dovecot-2.3.14/src/lib-dcrypt/dcrypt-openssl.c.opensslv3 2021-06-03 18:56:52.573174433 +0200 +++ dovecot-2.3.14/src/lib-dcrypt/dcrypt-openssl.c 2021-06-03 18:56:52.585174274 +0200 @@ -73,10 +73,30 @@ 2<tab>key algo oid<tab>1<tab>symmetric algo name<tab>salt<tab>hash algo<tab>rounds<tab>E(RSA = i2d_PrivateKey, EC=Private Point)<tab>key id **/ +#if OPENSSL_VERSION_MAJOR == 3 +static EC_KEY *EVP_PKEY_get0_EC_KEYv3(EVP_PKEY *key) +{ + EC_KEY *eck = EVP_PKEY_get1_EC_KEY(key); + EVP_PKEY_set1_EC_KEY(key, eck); + EC_KEY_free(eck); + return eck; +} + +static EC_KEY *EVP_PKEY_get1_EC_KEYv3(EVP_PKEY *key) +{ + EC_KEY *eck = EVP_PKEY_get1_EC_KEY(key); + EVP_PKEY_set1_EC_KEY(key, eck); + return eck; +} + +#define EVP_PKEY_get0_EC_KEY EVP_PKEY_get0_EC_KEYv3 +#define EVP_PKEY_get1_EC_KEY EVP_PKEY_get1_EC_KEYv3 +#else #ifndef HAVE_EVP_PKEY_get0 #define EVP_PKEY_get0_EC_KEY(x) x->pkey.ec #define EVP_PKEY_get0_RSA(x) x->pkey.rsa #endif +#endif #ifndef HAVE_OBJ_LENGTH #define OBJ_length(o) ((o)->length) -- I presume that either this patch or an equivalent is planned for eventual inclusion into upstream? -- Sloane Bernstein Developer I cPanel, L.L.C.

2 1

The meaning of "tarpit" as used in the auth policy docs?
by Hippo Man 08 Jun '22

08 Jun '22

I'm trying to understand what is meant by "tarpit" in the ffollowing quote of the Dovecot auth policy docs for the "before" check ... First query is done *before* password and user databases are consulted. This means that any userdb/passdb attributes are left empty. The command used here is ‘allow’ and will appear on the URL as command=allow. status result values: - -1: Reject - 0: Accept - (Any other positive value): *Tarpit for this number of seconds.* What actually happens if a positive status value is returned here? Does it mean that the client will not receive any response for the given number of seconds, but that the given login attempt will still continue after that delay? Or does it mean that the client will not receive a response for the given number of seconds, and then the login will be rejected after that delay? What if the client has connected via pop3 and is sending multple "user" and "pass" combinations? If the "before" check returns, for example, the integer "5" as the status, does this mean there will be a 5-second delay between each login attempt that is being sent to this connection? Ideally, I'd like the following to occur, but I don't know if it is possible: * Client connects via pop3 and intends to send a large batch of "user"/"pass" commands via this connection. * The first "user"/"pass" command is made to wait for many seconds. * Then, the connection is dropped, so that the subsequent "user"/"pass" commands do not even hit the dovecot server. I'm thinking that this is *not* what is meant by "tarpit" in the auth policy docs, correct? Thank you for any clarification. -- hippoman(a)gmail.com Take a hippopotamus to lunch today.

2 1

Extremely long line
by Dmitriy Fitisov 07 Jun '22

07 Jun '22

Hello everyone, I’m using https://github.com/karastojko/mailio <https://github.com/karastojko/mailio> to get messages from dovecot-2.3.7.2 (3c910f64b) and 1 of the messages which is 2.5 mbytes in size and has an image attached, has a half megabyte of <80> (0x80) characters at the end. And that is with default encoding of 7 bit (meaning there is no part headers at the end), right after the message those characters. I got a feeling that max length was 998 characters. On other hand, looks like dovecot is replacing NULL chars with 0x80. Is that is correct behavior, should I expect that half meg of bytes in 1 line? Is it a known issue? Thank you. Dmitriy

2 1

Sieve configuration for roundcube
by Jeremy Hansen 07 Jun '22

07 Jun '22

Any pointers to get dovecot configured with sieve for Roundcube filters? Things I’ve found through search seem a bit all over the place. I’m using CentOS 8/Rocky Linux hosts. Thanks

4 6

Hiding imap account and still using it for outgoing email
by Hippo Man 07 Jun '22

07 Jun '22

I'm using dovecot 2.3.18 with a fairly recent version of postfix on my Debian-11 box. I have a question, and I'm not sure whether it pertains to dovecot, postfix, or both. I'm asking first here, but I'm glad to go to a postfix forum if it turns out that my question doesn't pertain to dovecot. On my server, account management in both dovecot and postfix is managed by the same mysql database, and postfix is configured to use dovecot's authentication mechanism. I have an email address which I do not want to be seen as one which can be accessed for imap nor pop3. However, I want to receive email to that address, and I, myself, still do want to be able to use imap or pop3 in order to access email that is sent to that address. I have something I want to try in order to accomplish this, but before I do, I want to make sure that no one can see any issues or "gotchas" with the following approach, or perhaps that there is an easier, more straightforward way to accomplish what I want to do: Assume the email address in question is "myemail(a)domain.com", and assume that I own and manage the "domain.com" domain. (1) Create another email address called "other(a)domain.com", and set it up with the same configuration as is currently set up for "myemail(a)domain.com" (2) In all my email clients, set the outgoing mail address and reply-to address for "other(a)domain.com" to be "myemail(a)domain.com". This way, all outgoing email from "other(a)domain.com" will look like it is being sent from "myemail(a)domain.com". (3) Change "myemail.com" (in the database used by dovecot and postfix) from being a bona-fide email address into becoming simply a forwarding email alias for "other(a)domain.com". (4) In all my email clients, change the inbox that I previously used for "myemail(a)domain.com" to now be associated with "other(a)domain.com". So ... if anyone sends email to "myemail(a)domain.com", it will automatically go to the "other(a)domain.com" inbox. And when I reply to those emails, the sender and reply-to addresses will still be "myemail(a)domain.com". And now, dovecot will no longer see "myemail(a)domain.com" as a mailbox from which email can be retrieved. And I will still be able to retrieve that email via imap or pop3 from the "other(a)domain.com" account. Do you folks think this will work? And again, is there perhaps a simpler way to accomplish this? Thank you in advance for any thoughts and suggestions. -- hippoman(a)gmail.com Take a hippopotamus to lunch today.

1 1

Random behavior with sieve extprograms
by Thomas Sommer 04 Jun '22

04 Jun '22

Hi I have a random behavior with dovecot and sieve extprograms. Here is my sieve file: require ["fileinto", "vnd.dovecot.pipe", "copy", "imap4flags"]; # rule:[DABS] if header :contains "X-Original-To" "dabs(a)mydomain.ch" { pipe "sieve-dabs-execute.sh"; setflag "\\Seen"; fileinto "acme.DABS"; stop; } Emails matching the condition are processed by a laravel (php) artisan command. See service sieve-pipe-script below. The exit code of this php command is 0. I randomly get the following in my postfix logs: Sieve thinks that the command failed, but the email was always processed correctly. In that case I get a copy in my Inbox. I'm wondering what could be the cause for this random behavior. My guess is that approximately 70% are processed correctly, 30% is as below. May 31 13:50:38 star dovecot[99425]: lda(user)<99425><kma+MC4dlmJhhAEAzJBnyA>: sieve: msgid=<62961d1c.5y4hr0Vqi97JFnyb%DABS.zsmsvp02(a)example.com>: fileinto action: stored mail into mailbox 'acme.DABS' May 31 13:50:39 star dovecot[99425]: lda(user)<99425><kma+MC4dlmJhhAEAzJBnyA>: sieve: msgid=<62961d1c.5y4hr0Vqi97JFnyb%DABS.zsmsvp02(a)example.com>: stored mail into mailbox 'INBOX' May 31 13:50:39 star dovecot[99425]: lda(user)<99425><kma+MC4dlmJhhAEAzJBnyA>: sieve: Execution of script /home/user/sieve/.dovecot.sieve failed, but implicit keep was successful (user logfile /home/user/sieve/.dovecot.sieve.log may reveal additional details) .dovecot.sieve.log: sieve: info: started log at May 31 13:50:39. error: failed to pipe message to program `sieve-dabs-execute.sh': refer to server log for more information. [2022-05-31 13:50:39]. It's weird. "failed to pipe message to program" is simply not true. The command was processed correctly. Any ideas where to look for clues or how to debug this? Regards Thomas config: # 2.3.14 (cee3cbc0d): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.14 (1b5c82b2) # OS: Linux 5.17.5-x86_64-linode154 x86_64 Ubuntu 20.04.4 LTS auth_mechanisms = plain login auth_username_format = %n auth_verbose = yes mail_location = maildir:~/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.pipe vnd.dovecot.execute namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { quota = fs:User quota quota_grace = 1%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = file:~/sieve;active=~/sieve/.dovecot.sieve sieve_execute_socket_dir = sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_exec_timeout = 30s sieve_pipe_socket_dir = sieve_plugins = sieve_extprograms sieve_redirect_envelope_from = recipient sieve_trace_debug = no sieve_trace_dir = ~/sieve/trace sieve_trace_level = matching } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service quota-status { client_limit = 1 executable = /usr/lib/dovecot/quota-status -p postfix inet_listener { address = 127.0.0.1 port = 8881 } } service sieve-pipe-script { executable = script /usr/bin/php /srv/www/mydomain/status/artisan dabs:processEmail unix_listener sieve-dabs-execute.sh { mode = 0660 user = user } user = www-data vsz_limit = 512 M } ssl = required ssl_cert = </etc/letsencrypt/live/star.mydomain.ch/fullchain.pem ssl_cipher_list = AES128+EECDH:AES128+EDH ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = passwd } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = " quota sieve" postmaster_address = postmaster(a)mydomain.ch quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { mail_max_userip_connections = 20 mail_plugins = " quota mail_log notify imap_quota" }

2 4

dovecot 2.3.19 source tarball build failed
by Dmitriy Fitisov 03 Jun '22

03 Jun '22

Hello all again, building from 2.3.19 src tarball on Darwin Kernel Version 21.5.0: Tue Apr 26 21:08:29 PDT 2022; root:xnu-8020.121.3~4/RELEASE_ARM64_T8101 arm64 got failure: ioloop-notify-kqueue.c:70:2: error: implicit declaration of function 'i_gettimeofday' is invalid in C99 [-Werror,-Wimplicit-function-declaration] i_gettimeofday(&ioloop_timeval); ^ ioloop-notify-kqueue.c:70:2: note: did you mean 'gettimeofday'? /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/time.h:197:9: note: 'gettimeofday' declared here int gettimeofday(struct timeval * __restrict, void * __restrict); ^ 1 error generated. Not sure what is a proper way to report patches. Seem source generated by bison? Anyway, just added one liner added to src/lib/ioloop-notify-kqueue.c: 13a14 > #include "time-util.h” Builds fine. Thank you. Dmitriy

2 2

Openmetrics label truncation
by Daniel Sabotta 03 Jun '22

03 Jun '22

Hello, I'm using dovecot 2.3.18 and want to collect metrics with prometheus via openmetrics. I need to label the metrics with the destination host name. The configuration works fine, but the label value is truncated after 32 chars (and a '...' is added). My config: service stats { inet_listener http { port = 9323 } } metric my_metric { filter = event=smtp_client_transaction_finished group_by = dest_host status_code } I wrote a simple patch, that fixes that for me: diff --git a/src/stats/stats-metrics.c b/src/stats/stats-metrics.c index 877c142546..30126563ff 100644 --- a/src/stats/stats-metrics.c +++ b/src/stats/stats-metrics.c @@ -357,7 +357,7 @@ stats_metric_sub_metric_alloc(struct metric *metric, const char *name, pool_t po array_append_zero(&fields); sub_metric = stats_metric_alloc(pool, metric->name, metric->set, array_idx(&fields, 0)); - sub_metric->sub_name = p_strdup(pool, str_sanitize_utf8(name, 32)); + sub_metric->sub_name = p_strdup(pool, str_sanitize_utf8(name, 63)); array_append(&metric->sub_metrics, &sub_metric, 1); return sub_metric; } Why are labels truncated after 32? Is there a reason I do not see? I found no reasons in the openmetrics specification [1]. Thanks in advance Daniel

2 2

Restrict IMAP login, but allow Postfix SASL
by lutz.niederer＠gmx.net 03 Jun '22

03 Jun '22

Hi, we have a very simple user-/passdb (like passwd) to authenticate virtual IMAP users. We also use this for Postfix authentication. Nothing special. But, we need to exclude some of the users from IMAP login. This means, some users should be allowed to send mail via Postfix (submission) and therefore authenticate via SASL against dovecot successfully, but they should not be allowed to login to their IMAP mail box. How could this be done? Thanks! -lutzn

9 9

Building dovecot-core
by Dmitriy Fitisov 03 Jun '22

03 Jun '22

Hi all, do we have any info on building dovecot-core? INSTALL.md suggests usual way: ./configure … Needless to say, there is no .configure in root dir. I think, instructions need to be updated to correct this. Thank you. Dmitriy

4 4

What is the state of SMTPUTF8 support?
by Sylvhem 02 Jun '22

02 Jun '22

Hi! It’s been some time since I last saw a mention of SMTPUTF8 here. Last time I heard about it, it was worked on. Does anybody have news about that? -- Sylvhem

5 8

doveadm-deduplicate deletes non-duplicates
by Ryan Kavanagh 31 May '22

31 May '22

Hi, I've been trying to use `doveadm deduplicate` to deduplicate mailboxes. According to doveadm-deduplicate(1), "deduplication will be done by message GUIDs". However, deduplication deletes messages with distinct message GUIDs, i.e., it deletes messages that are not duplicates. Is this a case of user error, do I have some form of corruption going on, or am I running into a bug? In case it helps, I'm including: 1) the list of GUIDs for messages in my INBOX before a deduplication run (as documented in doveadm-deduplicate(1)), 2) the output of `doveadm -D deduplicate -u rak mailbox INBOX`, 3) the list of GUIDs after deduplication, 4) a diff of (1) and (3), 5) the output of doveconf -n. Thanks, Ryan $ doveadm -f table fetch -u rak 'guid uid' mailbox INBOX | sort 0b3bee1414118f6282db0000226807b0 7100 0b4b681c18168f6220940000226807b0 7104 0b83ac1d79cf2962eb3a0100226807b0 6153 0b97791e83108f6282db0000226807b0 7095 1614451513.M180742P77875.hades.rak.ac,S=3516,W=3600 22 1614451513.M180779P77875.hades.rak.ac,S=5252,W=5370 52 1614452870.M315137P88362.hades.rak.ac,S=5516,W=5623 68 1614452870.M315152P88362.hades.rak.ac,S=5977,W=6085 69 23a5a0179e108f6282db0000226807b0 7097 33318e0686108f6282db0000226807b0 7096 3351581c9c0e8f624cd50000226807b0 7091 3359032360108f6282db0000226807b0 7093 3b3927352be48c62b65b0000226807b0 7072 3ba2252814118f62a2540100226807b0 7101 4154be0c2fc77761c2550000226807b0 4050 5b3a7327d73b866299cd0000226807b0 7013 638e073255235d62a5280100226807b0 6660 63b6422e14118f6282db0000226807b0 7102 8b9b942909118f6282db0000226807b0 7099 8bc95639a6168f62ad4e0000226807b0 7105 a316ee28980d8f627c460000226807b0 7090 ab802c1e37ac3d6214680100226807b0 6343 b3d12f21cd108f6282db0000226807b0 7098 bb89431b6e728d6230920000226807b0 7076 c386310f062adb61d1980000226807b0 5306 cb56992484478d62f3090100226807b0 7074 cb79bf3503128f6275220100226807b0 7103 eb2818367d108f62484b0100a558518d 7094 eb709020e70f8f62292e0000226807b0 7092 f19a8c06409a7d61271c0000226807b0 4128 f338ad1ff65e8562ff390100226807b0 7007 f9cd03363c457c613a0e0000226807b0 4107 guid uid $ doveadm -D deduplicate -u rak mailbox INBOX Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_flatcurve_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) May 31 12:50:35 Debug: Loading modules from directory: /usr/local/lib/dovecot May 31 12:50:35 Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so May 31 12:50:35 Debug: Module loaded: /usr/local/lib/dovecot/lib20_replication_plugin.so May 31 12:50:35 Debug: Module loaded: /usr/local/lib/dovecot/lib20_virtual_plugin.so May 31 12:50:35 Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm May 31 12:50:35 Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) May 31 12:50:35 Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) May 31 12:50:35 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) May 31 12:50:35 Debug: Skipping module doveadm_fts_flatcurve_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) May 31 12:50:35 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Cannot load specified object (this is usually intentional, so just ignore this message) May 31 12:50:35 doveadm(rak)<74469><>: Debug: auth-master: userdb lookup(rak): Started userdb lookup May 31 12:50:35 doveadm(rak)<74469><>: Debug: auth-master: conn unix:/var/dovecot/auth-userdb: Connecting May 31 12:50:35 doveadm(rak)<74469><>: Debug: auth-master: conn unix:/var/dovecot/auth-userdb (pid=6157,uid=0): Client connected (fd=9) May 31 12:50:35 doveadm(rak)<74469><>: Debug: auth-master: userdb lookup(rak): auth USER input: rak uid=1002 gid=1002 home=/home/vmail/rak /etc/mail/auth May 31 12:50:35 doveadm(rak)<74469><>: Debug: auth-master: userdb lookup(rak): Finished userdb lookup (username=rak uid=1002 gid=1002 home=/home/vmail/rak /etc/mail/auth) May 31 12:50:35 doveadm(rak)<74469><>: Debug: Unknown userdb setting: plugin//etc/mail/auth=yes May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: Effective uid=1002, gid=1002, home=/home/vmail/rak May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: open(/proc/self/stat) failed: No such file or directory May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: open(/proc/self/io) failed: No such file or directory May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail:LAYOUT=fs:INDEX=~/indexes May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: fs: root=/home/vmail/rak/mail, index=/home/vmail/rak/indexes, indexpvt=, control=, inbox=/home/vmail/rak/mail, alt= May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: Namespace virtual: type=private, prefix=Virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/etc/dovecot/virtual:LAYOUT=fs:INDEX=~/virtual May 31 12:50:35 doveadm(rak)<74469><PLteAltHlmLlIgEAImgHsA>: Debug: fs: root=/etc/dovecot/virtual, index=/home/vmail/rak/virtual, indexpvt=, control=, inbox=, alt= May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: Mailbox opened May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7007: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7013: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7090: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7091: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7094: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7096: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7099: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7101: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7103: Expunge requested May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7007: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7013: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7090: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7091: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7094: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7096: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7099: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7101: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: UID 7103: Mail expunged May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: Purging (new file_seq=1654009655): Too many deleted records (9/23) May 31 12:50:35 doveadm(rak): Debug: Mailbox INBOX: Purging finished, file_seq changed 1654009654 -> 1654009655, size=75108 -> 53936, max_uid=7105 May 31 12:50:35 doveadm(rak): Debug: User session is finished May 31 12:50:35 doveadm(74469): Debug: auth-master: conn unix:/var/dovecot/auth-userdb (pid=6157,uid=0): Disconnected: Connection closed (fd=9) $ doveadm -f table fetch -u rak 'guid uid' mailbox INBOX | sort 0b3bee1414118f6282db0000226807b0 7100 0b4b681c18168f6220940000226807b0 7104 0b83ac1d79cf2962eb3a0100226807b0 6153 0b97791e83108f6282db0000226807b0 7095 1614451513.M180742P77875.hades.rak.ac,S=3516,W=3600 22 1614451513.M180779P77875.hades.rak.ac,S=5252,W=5370 52 1614452870.M315137P88362.hades.rak.ac,S=5516,W=5623 68 1614452870.M315152P88362.hades.rak.ac,S=5977,W=6085 69 23a5a0179e108f6282db0000226807b0 7097 3359032360108f6282db0000226807b0 7093 3b3927352be48c62b65b0000226807b0 7072 4154be0c2fc77761c2550000226807b0 4050 638e073255235d62a5280100226807b0 6660 63b6422e14118f6282db0000226807b0 7102 8bc95639a6168f62ad4e0000226807b0 7105 ab802c1e37ac3d6214680100226807b0 6343 b3d12f21cd108f6282db0000226807b0 7098 bb89431b6e728d6230920000226807b0 7076 c386310f062adb61d1980000226807b0 5306 cb56992484478d62f3090100226807b0 7074 eb709020e70f8f62292e0000226807b0 7092 f19a8c06409a7d61271c0000226807b0 4128 f9cd03363c457c613a0e0000226807b0 4107 guid uid $ diff -u /tmp/guid-prededuplicate.txt /tmp/guid-postdeduplicate.txt --- /tmp/guid-prededuplicate.txt Tue May 31 12:50:24 2022 +++ /tmp/guid-postdeduplicate.txt Tue May 31 12:51:00 2022 @@ -7,27 +7,18 @@ 1614452870.M315137P88362.hades.rak.ac,S=5516,W=5623 68 1614452870.M315152P88362.hades.rak.ac,S=5977,W=6085 69 23a5a0179e108f6282db0000226807b0 7097 -33318e0686108f6282db0000226807b0 7096 -3351581c9c0e8f624cd50000226807b0 7091 3359032360108f6282db0000226807b0 7093 3b3927352be48c62b65b0000226807b0 7072 -3ba2252814118f62a2540100226807b0 7101 4154be0c2fc77761c2550000226807b0 4050 -5b3a7327d73b866299cd0000226807b0 7013 638e073255235d62a5280100226807b0 6660 63b6422e14118f6282db0000226807b0 7102 -8b9b942909118f6282db0000226807b0 7099 8bc95639a6168f62ad4e0000226807b0 7105 -a316ee28980d8f627c460000226807b0 7090 ab802c1e37ac3d6214680100226807b0 6343 b3d12f21cd108f6282db0000226807b0 7098 bb89431b6e728d6230920000226807b0 7076 c386310f062adb61d1980000226807b0 5306 cb56992484478d62f3090100226807b0 7074 -cb79bf3503128f6275220100226807b0 7103 -eb2818367d108f62484b0100a558518d 7094 eb709020e70f8f62292e0000226807b0 7092 f19a8c06409a7d61271c0000226807b0 4128 -f338ad1ff65e8562ff390100226807b0 7007 f9cd03363c457c613a0e0000226807b0 4107 guid uid $ doveconf -n # 2.3.19 (b3ad6004dc): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: OpenBSD 7.1 amd64 # Hostname: hades.rak.ac default_vsz_limit = 128 M doveadm_password = # hidden, use -P to show it first_valid_uid = 1000 mail_attribute_dict = file:%h/dovecot-attributes mail_location = maildir:~/mail:LAYOUT=fs:INDEX=~/indexes mail_plugins = " notify replication virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Bin { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } prefix = separator = / } namespace virtual { location = virtual:/etc/dovecot/virtual:LAYOUT=fs:INDEX=~/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } mailbox Flagged { auto = subscribe special_use = \Flagged } prefix = Virtual/ separator = / } passdb { args = /etc/mail/auth driver = passwd-file } plugin { fts = flatcurve fts_autoindex = yes fts_autoindex_exclude = \Trash \Junk fts_enforced = yes fts_languages = en fts_tokenizers = generic email-address imapsieve_mailbox1_before = file:/usr/local/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY,APPEND imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/usr/local/dovecot/sieve/report-ham.sieve imapsieve_mailbox3_causes = COPY,APPEND imapsieve_mailbox3_name = RAK imapsieve_url = sieve://localhost/ mail_replica = tcps:eos.rak.ac:12507 plugin = fts fts_flatcurve replication_dsync_parameters = -d -l 30 -U -n "" sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /usr/local/dovecot/sieve-before.d/ sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/local/dovecot/sieve-pipe sieve_pipe_socket_dir = sieve-pipe sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap lmtp sieve replication_dsync_parameters = -d -l 30 -U -n "" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = _dovecot } unix_listener replication-notify { user = _dovecot } } service auth { unix_listener auth-userdb { user = vmail } } service doveadm { inet_listener { port = 12507 ssl = yes } vsz_limit = 512 M } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service imap { vsz_limit = 512 M } service indexer-worker { vsz_limit = 512 M } service lmtp { drop_priv_before_exec = yes process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } service stats { unix_listener stats-reader { user = vmail } unix_listener stats-writer { user = vmail } } ssl_client_ca_file = /etc/ssl/cert.pem ssl_dh = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail home=/home/vmail/%u /etc/mail/auth driver = static } userdb { args = /etc/mail/auth driver = passwd-file } protocol lmtp { mail_plugins = " notify replication virtual sieve" } protocol lda { mail_plugins = " notify replication virtual sieve" } protocol imap { imap_metadata = yes mail_plugins = " notify replication virtual imap_sieve" } -- |)|/ Ryan Kavanagh | 4E46 9519 ED67 7734 268F |\|\ https://rak.ac | BD95 8F7B F8FC 4A11 C97A

1 0

iPhone does not show 'read marks'.
by Heinz Bruederlin 31 May '22

31 May '22

The iPhone mail app does not show the read marks.The OS/X mail sets and shows the read marks correctly.Is there a way to fix or at least debug this behaviour ?

1 0

Disconnected: Auth process broken (disconnected before auth was ready ... ???
by Hippo Man 30 May '22

30 May '22

I've been running dovecot 2.2.36.4 (baf9232c1) on my Debian-8 host for a long time with no problems. I am trying to move my email server to a Debian-11 host, and I have Dovecot configured exactly the same way that I have it configured under Debian-8. However, when I try to connect to that server via imap, I always get the following error: 2022.05.30-18:17:21 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session=<2+nKqj7g4t4AAAAAAAAAAAAAAAAAAAAB> The output of "dovecot -n" appears at the bottom of this message. I'm using mysql on the Debian-8 server for my authentication database, and I'm using mariadb on the Debian-11 server. The contents of the database on the new, Debian-11-based server are exactly the same as those on the Debian-8 server. These are the contents of /opt/local/etc/dovecot/dovecot-sql.ext with the comments removed. I can manually run the following queries against the database with a valid login ID, and these queries succeed ... driver = mysql connect = host=127.0.0.1 user=postfix password=XXXXXXXX dbname=postfix default_pass_scheme = CRYPT password_query = SELECT username AS user, domain, password FROM mailbox WHERE (username = '%u' OR find_in_set('%u', loginid) > 0) AND active = 1 user_query = SELECT concat('/var/vmail/', maildir) AS home, 1003 AS uid, 1003 AS gid FROM mailbox WHERE (username = '%u' OR find_in_set('%u', loginid) > 0) AND active = 1 Also ... % ls -Flas /var/run/dovecot/auth-userdb 0 srw-rw-rw- 1 dovecot root 0 May 30 18:30 /var/run/dovecot/auth-userdb= % ls -Flas /opt/local/etc/dovecot/dovecot-master-users-passwords 4 -rw-rw-r-- 1 root dovecot 36 Dec 16 2018 /opt/local/etc/dovecot/dovecot-master-users-passwords % ls -Flas /opt/local/etc/dovecot/ad-hoc-userdb 4 -rw-rw-r-- 1 root root 416 May 7 14:53 /opt/local/etc/dovecot/ad-hoc-userdb % ls -Flas /opt/local/etc/dovecot/dovecot-master-users-passwords 4 -rw-rw-r-- 1 root dovecot 36 Dec 16 2018 /opt/local/etc/dovecot/dovecot-master-users-passwords When I start up dovecot, the following line appears at the bottom of /var/log/mailclient.log ... 2022.05.30-18:31:37 master: Info: Dovecot v2.2.36.4 (baf9232c1) starting up for imap, pop3, lmtp, imap, pop3 (core dumps disabled) However, if I then run "telnet localhost 143", the following lines appear at the end of /var/log/mailclient.log ... 2022.05.30-18:32:44 master: Error: service(auth): command startup failed, throttling for 2 secs 2022.05.30-18:32:44 auth: Fatal: master: service(auth): child 235327 killed with signal 11 (core dumps disabled) 2022.05.30-18:32:44 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session=<8ezN4T7gJOAAAAAAAAAAAAAAAAAAAAAB> The exact, same actions on my Debian-8 host do not fail. And here is the output from "dovecot -n". As you can see, all "verbose" and debug-related options are set to "yes". Thank you for any suggestions you might be able to offer: # 2.2.36.4 (baf9232c1): /opt/local/etc/dovecot/dovecot.conf # OS: Linux 5.10.0-14-amd64 x86_64 Debian 11.3 ext4 # Hostname: my.hostname.com auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = : auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no log_path = /var/log/mailclient.log log_timestamp = "%Y.%m.%d-%H:%M:%S " mail_debug = yes mail_location = maildir:/var/vmail/%d/%n/ namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /opt/local/etc/dovecot/dovecot-master-users-passwords driver = passwd-file master = yes pass = yes } passdb { args = /opt/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = scheme=plain username_format=%u /opt/local/etc/dovecot/ad-hoc-userdb driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)my.hostname.com protocols = imap pop3 lmtp imap pop3 service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap { executable = imap postlogin } service pop3 { executable = pop3 postlogin } service postlogin { executable = script-login -d rawlog } ssl_cert = </etc/letsencrypt/live/my.hostname.com/fullchain.pem ssl_cipher_list = HIGH:!SSLv2:!aNULL@STRENGTH ssl_client_ca_dir = /etc/ssl/certs ssl_client_ca_file = ca-certificates.crt ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /opt/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = scheme=plain username_format=%u /opt/local/etc/dovecot/ad-hoc-userdb driver = passwd-file } protocol imap { mail_max_userip_connections = 128 } -- hippoman(a)gmail.com Take a hippopotamus to lunch today.

1 1

Force TCP socket disconnect on imap login failure?
by Lloyd Zusman 27 May '22

27 May '22

I'm running dovecot 2.2.13 under Debian 8. I'd like to force an immediate TCP socket disconnect after any imap login attempt that fails. Right now, if invalid credentials are supplied during an imap login, the client can keep retrying logins with different credentials. However, I want to prevent that from occurring by causing the socket connection to be closed as soon as there is any failed login attempt. I haven't been able to find any dovecot configuration setting which could control this behavior, but I'm hoping that I just missed something. Thank you very much for any suggestions. -- hippoman(a)gmail.com Take a hippopotamus to lunch today.

16 28

solr-jetty package in Debian 11 bullseye
by John Gateley 25 May '22

25 May '22

Hello, I am in the process of upgrading the OS on my mailserver, currently Debian 9, to Debian 11. The solr-jetty package does not appear to exist in Debian 11. Does anyone know where it is? Thanks John

2 1

Re: Duplicate messages if message is moved when using dsync
by Thom Pol 25 May '22

25 May '22

Hi, Thanks for your reply! The dsync is triggered on IMAP/POP3/LDA/LMTP activity. See my config dump from the first email. I'm wondering if my config is not OK so it causes dsync to sync twice? > you need / preferably use a database for your user auth I already do this. > run the command doveadm user '*' - it needs to return a list of users > that will trigger replication (after doing config above) This part works fine. Thanks, Thom Pol On 18/05/2022 16:51, Paul Kudla (SCOM.CA Internet Services Inc.) wrote: > ok - question > > when you say dsync are you running that manually or as a cronjob ?? > > or using replication via dsync > > there is a difference > > replication is designed to handle mailbox changes by quing the changes > on the fly and then update in the background. > > replication tracks all changes in a mailbox and then sends them one at a > time to the target server. > > i run replication with tcp (not tcps or dsync) > > I find (other then the 300+folder issues) that it runs pretty good in > real time. > > if you are running dsync manually then yes timing on its own will be a > hit and miss and it will never sync properly if something appears during > the dsync process. > > if you have the sive running as discussed that is the first step > > you should setup replication so things are handled in real time. > > pls advise if you have already done replication or just manually dsyncing. > > Below is basic replication setup but you need to make sure various > pre-requirements are in place a head of time. > > 1. you need / preferably use a database for your user auth > > you need to setup an iterate sql statement that returns the user > list of users to be replicated > > Example (i use pgsql) : > > # cat dovecot-pgsql.conf > driver = pgsql > connect = host=localhost port=5433 dbname=scom_billing user=pgsql password= > default_pass_scheme = PLAIN > > password_query = SELECT username as user, password FROM email_users > WHERE username = '%u' and password <> 'alias' and status = True and > destination = '%u' > > user_query = SELECT home, uid, gid FROM email_users WHERE username = > '%u' and password <> 'alias' and status = True and destination = '%u' > > iterate_query = SELECT "username" as user, domain FROM email_users WHERE > status = True and alias_flag = False > > #iterate_query above is what returns the user lists > > 2. run the command doveadm user '*' - it needs to return a list of users > that will trigger replication (after doing config above) > > 3. in general here is my relative parts for tcp replication > > In dovecot.conf > > --------------------------------------------------------------------------- > > mail_plugins = " virtual notify replication fts fts_lucene " > > replication_dsync_parameters = -d -N -l 300 -U > > dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u > > plugin { > > ..... > mail_replica = tcp:10.221.0.19:12345 > > #(note this is the ip address of the other server) > #it is the only config change ie server one above > #server2 would be the other server for communicating. > > > > ..... > > } > > protocol imap { > mail_max_userip_connections = 50 > mail_plugins = $mail_plugins notify replication > } > > protocol pop3 { > mail_max_userip_connections = 50 > mail_plugins = $mail_plugins notify replication > } > > protocol imaps { > mail_max_userip_connections = 25 > mail_plugins = $mail_plugins notify replication > } > > protocol pop3s { > mail_max_userip_connections = 25 > mail_plugins = $mail_plugins notify replication > } > > replication_max_conns = 100 (optional) > > replication_full_sync_interval = 1d > > service replicator { > client_limit = 0 > drop_priv_before_exec = no > idle_kill = 4294967295s > process_limit = 1 > process_min_avail = 0 > service_count = 0 > vsz_limit = 8g > unix_listener replicator-doveadm { > mode = 0600 > user = vmail > } > vsz_limit = 8192M > } > > service aggregator { > process_limit = 1000 > #vsz_limit = 1g > fifo_listener replication-notify-fifo { > user = vmail > group = vmail > mode = 0666 > } > > } > > > > ---------------------------------------------------------------------------- > > that should do it? > > > > > > > > > > > > > Happy Wednesday !!! > Thanks - paul > > Paul Kudla > > > Scom.ca Internet Services<http://www.scom.ca> > 004-1009 Byron Street South > Whitby, Ontario - Canada > L1N 4S3 > > Toronto 416.642.7266 > Main?1.866.411.7266 > Fax?1.888.892.7266

1 0

Panic: file userdb-blocking with Dovecot 2.3.19
by Niklas Meyer 25 May '22

25 May '22

Hello all, since we´ve tested around with the new dovecot release in the mailcow project we´ve came across a curious and new error with Dovecot: /auth: Panic: file userdb-blocking.c: line 124 (userdb_blocking_iter_next): assertion failed: (ctx->conn != NULL)/ *System Information:* *Dovecot Version: 2.3.19 (b3ad6004dc)** * *OS: Debian 11 (dovecot is running in a docker container)* *CPU: x86* *Filesystem: ext4* The error occurs only with the newest Dovecot release (2.3.19), the config hasn´t been changed. In the Attachment you can find all (hopefully) helpful informations. Maybe it is a simple fix. Kind regards and thanks for your help. -- The mailcow Team - Niklas --- The Infrastructure Company GmbH Parkstr. 42 47877 Willich Handelsregister: Amtsgericht Krefeld, HRB 15904 USt-IdNr.: DE308854956 Geschäftsführer: Martin Vogt /*Hinweis: *Der Inhalt dieser E-Mail ist vertraulich und nur für den in der Nachricht angegebenen Empfänger bestimmt. Es ist strengstens untersagt, irgendeinen Teil dieser Nachricht ohne schriftliche Zustimmung des Absenders an Dritte weiterzugeben. Wenn Sie diese Nachricht irrtümlich erhalten haben, antworten Sie bitte auf diese Nachricht und folgen Sie mit ihrer Löschung, so dass wir sicherstellen können, dass ein solcher Fehler in Zukunft nicht mehr vorkommt./

3 2

Message attachments, relocated with Tbird in Dovecot maildir store, not openable; reversible by moving BACK to inbox?
by PGNet Dev 25 May '22

25 May '22

I run dovecot --version 2.3.17.1 (476cd46418) on lsb_release -rd Description: Fedora release 35 (Thirty Five) Release: 35 mail store is maildir mail_location = maildir:/data/vmail/%d/%n/Maildir:CONTROL=/data/vmail/%d/%n/_control:INDEX=/var/vmail-index/%d/%n:LAYOUT=fs:UTF-8 front-end client is thunderbird --version Thunderbird 91.7.0 also on lsb_release -rd Description: Fedora release 35 (Thirty Five) Release: 35 mail is delivered to the store via lmtp transport from a Postfix agent mail, with attachments (e.g., .PDF) is received OK it's readable, attachments can be opened and/or saved to disk\ if, in TBird client, i move the message to any other folder in the IMAP hierarchy, the message relocates, as expected. the message itself is still readable, and _appears_ to have the attachment. but, attempting to OPEN the *attachment*, with e.g. Okular, from within the relocated message pops up a dialog, "Could not open file:///tmp/pid-28435/manual_13542AE.pdf" and saving it to Desktop, ls -al manual_13542AE.pdf -rw-r--r-- 1 pgnd pgnd 27 Apr 1 06:01 manual_13542AE.pdf file manual_13542AE.pdf manual_13542AE.pdf: data then opening it similarly returns "Could not open file:///home/pgnd/Desktop/manual_13542AE.pdf." Moving the message, via TBird, **BACK** to the Inbox, cures the problem -- -- I can immediately, again, open & save the attachments. This 'feels' like cache management misconfiguration to me. Not sure whether in Tbird &/or Dovecot, or what to look for specificially. Hints as to cause/fix of this attachment issue? Or event what/where, specifically, to log?

4 12

doveadm mailbox status -u paul@scom.ca -t all (syntax)
by Paul Kudla (SCOM.CA Internet Services Inc.) 24 May '22

24 May '22

Ok I know this is a general question and at my level I should be able to figure this out all i want is the complete status of an inbox ? # doveadm mailbox status -u paul(a)scom.ca -t all keeps returning .... doveadm mailbox status [-u <user>|-A] [-S <socket_path>] <fields> <mailbox> [...] ie no specific error. and no status answer just looking for default info ? -- Happy Monday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266 Email paul(a)scom.ca

3 5

enable/control fts-tika debug logging in Dovecot 2.3.18 + Tika Server 2.4.0?
by PGNet Dev 24 May '22

24 May '22

i run dovecot-2.3.18-1.fc36.x86_64 i've installed Apache Tika, v 2.4.0 ls -al tika-server-standard-2.4.0.jar -rw-r--r-- 1 root root 59M May 2 09:53 tika-server-standard-2.4.0.jar tika's listening telnet 127.0.0.1 9998 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. telnet> and responds to a test curl \ -T /tmp/test.pdf \ http://127.0.0.1:9998/meta pdf:unmappedUnicodeCharsPerPage,0,0,0,0,0,0,0,0,0,0,0,0,0,0 pdf:PDFVersion,1.4 xmp:CreatorTool,Adobe InDesign 15.1 (Macintosh) pdf:hasXFA,false access_permission:modify_annotations,true access_permission:can_print_degraded,true X-TIKA:Parsed-By-Full-Set,org.apache.tika.parser.DefaultParser,org.apache.tika.parser.pdf.PDFParser dcterms:created,2020-08-13T14:55:46Z language,en dcterms:modified,2020-09-24T23:38:28Z dc:format,application/pdf; version=1.4 xmpMM:DocumentID,xmp.id:8a612346-9d03-4caf-8ebf-da6f3716ed0a pdf:docinfo:creator_tool,Adobe InDesign 15.1 (Macintosh) access_permission:fill_in_form,true pdf:docinfo:modified,2020-09-24T23:38:28Z pdf:hasCollection,false pdf:encrypted,false pdf:hasMarkedContent,true Content-Type,application/pdf dc:language,en-US pdf:producer,Adobe PDF Library 15.0 access_permission:extract_for_accessibility,true access_permission:assemble_document,true xmpTPg:NPages,14 pdf:hasXMP,true pdf:charsPerPage,84,676,1653,1914,814,1022,645,1221,1087,732,887,1295,1263,149 access_permission:extract_content,true xmpMM:DerivedFrom:DocumentID,xmp.did:b98726d4-04c4-48f5-88be-0a48a0074356 access_permission:can_print,true pdf:docinfo:trapped,false X-TIKA:Parsed-By,org.apache.tika.parser.DefaultParser,org.apache.tika.parser.pdf.PDFParser xmpMM:DerivedFrom:InstanceID,xmp.iid:3dd6a91f-a114-4d63-804e-e2b749c15075 pdf:annotationTypes,null access_permission:can_modify,true pdf:docinfo:producer,Adobe PDF Library 15.0 pdf:docinfo:created,2020-08-13T14:55:46Z pdf:annotationSubtypes,Link in dovecot config, i've added plugin { fts_tika = http://127.0.0.1:9998/tika/ } and log_debug = (category=fts-flatcurve OR category=fts-tika) on message receipt, I see verbose logs for fts-flatcurve, as expected, but not a trace of output from fts-tika, in dovecot logs how to correctly turn on debug/verbose logging for fts-tika use in/by dovecot?

2 2

Many Thanks to the Programmers
by Paul Kudla (SCOM.CA Internet Services Inc.) 23 May '22

23 May '22

I am still in testing mode with 2.3.19 but the replication with the folders over 300+ seems to be fixed everything synced ok on its own within 30 minutes Again MUSH APPRECIATED ! Moving to 2.3.19 was woth it! -- Happy Monday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266 Email paul(a)scom.ca

1 0

mail_replica in userdb?
by Coy Hile 23 May '22

23 May '22

I seem to have got replication working from an older instance to a newer one (insofar as the data are present on the new box) that I’m looking to stand up to replace a newer box. In this case, nothing is configured to talk to the new machine yet, so the replication is unidirectional (old -> new). However, I’m seeing an error like like this repeatedly in syslog: 2022-05-21T23:23:15.295252+00:00 basement-imap01 dovecot: doveadm(hile(a)coyhile.com): Error: sync: User has no mail_replica in userdb What setting did I miss? kdoveconf -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.0-110-generic x86_64 Ubuntu 20.04.4 LTS # Hostname: basement-imap01.coyhile.com doveadm_password = # hidden, use -P to show it mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap lmtp" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service doveadm { inet_listener { port = 12345 } user = vmail } service replicator { unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap override_fields = uid=vmail gid=vmail home=/data/mail/vmail/%d/%n } Is that error something that I can (for the moment) ignore since I’m explicitly NOT trying to have this host replicate data anywhere, or do I need to tweak something? -- Coy Hile coy.hile(a)coyhile.com

3 7

SQL user_query quota_rule for *:messages=
by James 23 May '22

23 May '22

Hello, dovecot.conf sets the system default quota for storage and message count: plugin { ... quota_rule = *:storage=1G quota_rule2 = *:messages=10000 ... } This quota_rule for the storage is overridden by an SQL user_query in dovecot-sql.conf: user_query = "SELECT ... '*:storage=' || maxstorage || 'M' AS userdb_quota_rule, ...;" Is it possible to override the message count limit with an SQL user_query (and password_query)? I tried returning userdb_quota_rule2 in the SQL but it did not work. "SELECT ... '*:messages=' || maxcount AS userdb_quota_rule2 ...;" Ref: https://doc.dovecot.org/configuration_manual/authentication/user_database_e…

2 2

Dovecot 2.3.18 and OpenMetrics-Prometheus problem
by Christian Rößner 23 May '22

23 May '22

Hi, I have defined several metrics in Dovecot and activated the metrics service. After the I tried to include this in Prometheues, but I get strange errors. I gave up now after several hours in the hope that this might be a bug. So I ask for help here: Distribution: Rocky 8 Official Dovecot Repo Version: 2.3.18 Config for metrics, service and events: ----------------------------------------------------------------- metric auth_success { exporter = log filter = event=auth_request_finished AND success=yes } metric auth_failures { exporter = log filter = event=auth_request_finished AND NOT success=yes } metric auth_client_userdb { filter = event=auth_client_userdb_lookup_finished } metric auth_master { exporter = log filter = event=auth_master_client_login_finished } metric client_connected { filter = event=client_connection_connected } metric client_disconnected { filter = event=client_connection_disconnected group_by = reason } metric imap_command { filter = event=imap_command_finished group_by = cmd_name tagged_reply_state } metric lmtp_command { filter = event=smtp_server_command_finished AND protocol=lmtp group_by = cmd_name status_code duration:exponential:1:5:10 } metric imap_hibernate { filter = event=imap_client_hibernated group_by = error } metric imap_unhibernate { filter = event=imap_client_hibernated group_by = reason error } metric mail_delivery { filter = event=mail_delivery_finished group_by = duration:exponential:1:5:10 } metric sql_query { filter = event=sql_query_finished group_by = error_code } metric sieve_actions { filter = event=sieve_action_finished group_by = action_name error } metric managesieve { filter = event=managesieve_command_finished group_by = script_name } metric dict_lookups { filter = event=dict_lookup_finished group_by = driver error } service stats { inet_listener http { port = 9900 } } event_exporter log { format = json format_args = time-rfc3339 transport = log } ----------------------------------------------------------------- Shortened curl output: ----------------------------------------------------------------- # HELP process_start_time_seconds Timestamp of service start # TYPE process_start_time_seconds gauge process_start_time_seconds 1645743604 # HELP dovecot_build Dovecot build information # TYPE dovecot_build info dovecot_build_info{version="2.3.18",revision="9dd8408c18"} 1 # HELP dovecot_auth_success Total number of all events of this kind # TYPE dovecot_auth_success counter dovecot_auth_success_total 1669 # HELP dovecot_auth_success_duration_seconds Total duration of all events of this kind # TYPE dovecot_auth_success_duration_seconds counter dovecot_auth_success_duration_seconds_total 1.317570 # HELP dovecot_auth_failures Total number of all events of this kind # TYPE dovecot_auth_failures counter dovecot_auth_failures_total 1 # HELP dovecot_auth_failures_duration_seconds Total duration of all events of this kind # TYPE dovecot_auth_failures_duration_seconds counter ... # EOF ----------------------------------------------------------------- Prometheus yml config snippet: ----------------------------------------------------------------- global: scrape_interval: 15s evaluation_interval: 15s scrape_configs: - job_name: dovecot_exporter static_configs: - targets: - 172.30.10.1:9900 ----------------------------------------------------------------- Prometheus (Docker stable latest) with debug level show these lines: ----------------------------------------------------------------- prometheus_1 | ts=2022-02-25T10:22:00.840Z caller=scrape.go:1307 level=debug component="scrape manager" scrape_pool=dovecot_exporter target=http://172.30.10.1:9900/metrics msg="Append failed" err="expected label name or left brace, got \"INVALID\"" ----------------------------------------------------------------- Therefor the service is considered as being down. I really have no ide, what I can do here. Thanks for any help in advance Christian Rößner -- Rößner-Network-Solutions Zertifizierter ITSiBe / CISO Karl-Bröger-Str. 10, 36304 Alsfeld Fax: +49 6631 78823409, Mobil: +49 171 9905345 USt-IdNr.: DE225643613, https://roessner.website PGP fingerprint: 658D 1342 B762 F484 2DDF 1E88 38A5 4346 D727 94E5

4 9

Fix lmtp_save_to_detail_mailbox to be case insensitive?
by dovecot＠ptld.com 22 May '22

22 May '22

To bring this up again because i have not found a work around solution. Can dovecot make lmtp_save_to_detail_mailbox case-insensitive? If you create a folder "foobar" then an email with recipient user+foobar(a)example.com will be placed in the folder. However with the folder as "foobar" an email with recipient user+FOOBAR(a)example.com will report folder "FOOBAR" not found and the email will be placed in the inbox folder.

4 10

LDAP virtual user username being rewritten:
by Coy Hile 21 May '22

21 May '22

Hi all, I’m working on migrating a dovecot instance that formerly had its only user (me) stored in a SQL database to a new instance that uses LDAP so I don’t have to maintain a handful of different passwords. However, I’m ending up getting sent to an incorrect mailbox because the %d part of the username I enter is getting stripped somewhere along the lines. Dovecot debug logs show this happening here: May 21 18:36:53 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=itEO5InfPJusEgKD lip=172.18.2.131 rip=172.18.2.131 lport=143 rport=39740 resp=<hidden> May 21 18:36:53 auth: Debug: ldap(hile(a)coyhile.com,172.18.2.131,<itEO5InfPJusEgKD>): Performing passdb lookup May 21 18:36:53 auth: Debug: ldap(hile(a)coyhile.com,172.18.2.131,<itEO5InfPJusEgKD>): pass search: base=ou=People,dc=coyhile,dc=com scope=subtree filter=(&(objectClass=posixAccount)(uid=hile)) fields=uid,userPassword May 21 18:36:53 auth: Debug: ldap(hile(a)coyhile.com,172.18.2.131,<itEO5InfPJusEgKD>): result: uid=hile userPassword=<hidden>; uid,userPassword unused May 21 18:36:53 auth: Debug: ldap(hile(a)coyhile.com,172.18.2.131,<itEO5InfPJusEgKD>): username changed hile(a)coyhile.com -> hile May 21 18:36:53 auth: Debug: ldap(hile,172.18.2.131,<itEO5InfPJusEgKD>): Finished passdb lookup May 21 18:36:53 auth: Debug: auth(hile,172.18.2.131,<itEO5InfPJusEgKD>): Auth request finished May 21 18:36:53 auth: Debug: client passdb out: OK 1 user=hile original_user=hile(a)coyhile.com May 21 18:36:53 auth: Debug: master in: REQUEST 473956353 9409 1 2c1f94ded4de2c343425c90eeee8d094 session_pid=9412 request_auth_token May 21 18:36:53 auth: Debug: ldap(hile,172.18.2.131,<itEO5InfPJusEgKD>): Performing userdb lookup May 21 18:36:53 auth: Debug: ldap(hile,172.18.2.131,<itEO5InfPJusEgKD>): user search: base=ou=People,dc=coyhile,dc=com scope=subtree filter=(&(objectClass=posixAccount)(uid=hile)) fields=homeDirectory,uidNumber,gidNumber May 21 18:36:53 auth: Debug: ldap(hile,172.18.2.131,<itEO5InfPJusEgKD>): result: homeDirectory=/home/hile uidNumber=10000 gidNumber=10000; homeDirectory,uidNumber,gidNumber unused May 21 18:36:53 auth: Debug: ldap(hile,172.18.2.131,<itEO5InfPJusEgKD>): Finished userdb lookup May 21 18:36:53 auth: Debug: master userdb out: USER 473956353 hile home=/data/mail/vmail//hile uid=998 gid=998 auth_token=3a262da408d33ce2c51ecb1ddd943203fdbb17a3 auth_user=hile(a)coyhile.com Note the “username changed” line above. Clearly I’ve misconfigured something, butI am unsure what. My configuration is as follows: root@basement-imap01:/var/log# doveconf -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.0-110-generic x86_64 Ubuntu 20.04.4 LTS # Hostname: basement-imap01.coyhile.com auth_debug = yes debug_log_path = /var/log/dovecot-debug.log doveadm_password = # hidden, use -P to show it mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap lmtp" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service doveadm { inet_listener { port = 12345 } user = vmail } service replicator { unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap override_fields = uid=vmail gid=vmail home=/data/mail/vmail/%d/%n } root@basement-imap01:/var/log# with the dovecot-ldap.conf.ext as follows: root@basement-imap01:/etc/dovecot# cat dovecot-ldap.conf.ext # This file is commonly accessed via passdb {} or userdb {} section in # conf.d/auth-ldap.conf.ext # This file is opened as root, so it should be owned by root and mode 0600. # # http://wiki2.dovecot.org/AuthDatabase/LDAP # # NOTE: If you're not using authentication binds, you'll need to give # dovecot-auth read access to userPassword field in the LDAP server. # With OpenLDAP this is done by modifying /etc/ldap/slapd.conf. There should # already be something like this: # access to attribute=userPassword # by dn="<dovecot's dn>" read # add this # by anonymous auth # by self write # by * none # Space separated list of LDAP hosts to use. host:port is allowed too. #hosts = hosts = ldap.coyhile.com # LDAP URIs to use. You can use this instead of hosts list. Note that this # setting isn't supported by all LDAP libraries. #uris = # Distinguished Name - the username used to login to the LDAP server. # Leave it commented out to bind anonymously (useful with auth_bind=yes). #dn = dn = uid=dovecotquery,ou=people,dc=coyhile,dc=com # Password for LDAP server, if dn is specified. #dnpass = dnpass = [REDACTED] # Use SASL binding instead of the simple binding. Note that this changes # ldap_version automatically to be 3 if it's lower. #sasl_bind = no # SASL mechanism name to use. #sasl_mech = # SASL realm to use. #sasl_realm = # SASL authorization ID, ie. the dnpass is for this "master user", but the # dn is still the logged in user. Normally you want to keep this empty. #sasl_authz_id = # Use TLS to connect to the LDAP server. #tls = no # TLS options, currently supported only with OpenLDAP: #tls_ca_cert_file = #tls_ca_cert_dir = #tls_cipher_suite = # TLS cert/key is used only if LDAP server requires a client certificate. #tls_cert_file = #tls_key_file = # Valid values: never, hard, demand, allow, try #tls_require_cert = # Use the given ldaprc path. #ldaprc_path = # LDAP library debug level as specified by LDAP_DEBUG_* in ldap_log.h. # -1 = everything. You may need to recompile OpenLDAP with debugging enabled # to get enough output. #debug_level = 0 # Use authentication binding for verifying password's validity. This works by # logging into LDAP server using the username and password given by client. # The pass_filter is used to find the DN for the user. Note that the pass_attrs # is still used, only the password field is ignored in it. Before doing any # search, the binding is switched back to the default DN. #auth_bind = no # If authentication binding is used, you can save one LDAP request per login # if users' DN can be specified with a common template. The template can use # the standard %variables (see user_filter). Note that you can't # use any pass_attrs if you use this setting. # # If you use this setting, it's a good idea to use a different # dovecot-ldap.conf.ext for userdb (it can even be a symlink, just as long as # the filename is different in userdb's args). That way one connection is used # only for LDAP binds and another connection is used for user lookups. # Otherwise the binding is changed to the default DN before each user lookup. # # For example: # auth_bind_userdn = cn=%u,ou=people,o=org # #auth_bind_userdn = # LDAP protocol version to use. Likely 2 or 3. #ldap_version = 3 # LDAP base. %variables can be used here. # For example: dc=mail, dc=example, dc=org base = ou=People,dc=coyhile,dc=com # Dereference: never, searching, finding, always #deref = never # Search scope: base, onelevel, subtree #scope = subtree scope = subtree # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki2.dovecot.org/UserDatabase/ExtraFields #user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid # Filter for user lookup. Some variables can be used (see # http://wiki2.dovecot.org/Variables for full list): # %u - username # %n - user part in user@domain, same as %u if there's no domain # %d - domain part in user@domain, empty if user there's no domain #user_filter = (&(objectClass=posixAccount)(uid=%u)) user_filter = (&(objectClass=posixAccount)(uid=%u)) # Password checking attributes: # user: Virtual user name (user@domain), if you wish to change the # user-given username to something else # password: Password, may optionally start with {type}, eg. {crypt} # There are also other special fields which can be returned, see # http://wiki2.dovecot.org/PasswordDatabase/ExtraFields #pass_attrs = uid=user,userPassword=password # If you wish to avoid two LDAP lookups (passdb + userdb), you can use # userdb prefetch instead of userdb ldap in dovecot.conf. In that case you'll # also have to include user_attrs in pass_attrs field prefixed with "userdb_" # string. For example: #pass_attrs = uid=user,userPassword=password,\ # homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid # Filter for password lookups #pass_filter = (&(objectClass=posixAccount)(uid=%u)) pass_filter = (&(objectClass=posixAccount)(uid=%n)) # Attributes and filter to get a list of all users #iterate_attrs = uid=user iterate_attrs = maildrop=user iterate_filter = (objectClass=posixAccount) # Default password scheme. "{scheme}" before password overrides this. # List of supported schemes is in: http://wiki2.dovecot.org/Authentication #default_pass_scheme = CRYPT # By default all LDAP lookups are performed by the auth master process. # If blocking=yes, auth worker processes are used to perform the lookups. # Each auth worker process creates its own LDAP connection so this can # increase parallelism. With blocking=no the auth master process can # keep 8 requests pipelined for the LDAP connection, while with blocking=yes # each connection has a maximum of 1 request running. For small systems the # blocking=no is sufficient and uses less resources. #blocking = no root@basement-imap01:/etc/dovecot# -- Coy Hile coy.hile(a)coyhile.com

1 1

Possible to increase connection limit for one user only?
by Kurt Fitzner 20 May '22

20 May '22

I run a medium-sized virtual domain email server for about 15 domains. I also use it myself and have 3 or 4 devices using imap. I am often using a VPN to connect to my home network, which makes all my connections appear to come from one IP. I want to increase mail_max_userip_connections just for myself only so I'm not opening up my server to abuse. Is this possible?

3 3

doveadm search error
by Christoph Fürstaller 20 May '22

20 May '22

Hello, I've upgraded dovecote to 2.3.19 (b3ad6004dc) a week ago. Since then I get an error when searching for messages from all users in a particular folder: doveadm search -A mailbox 'INBOX.learn' Error: auth-master: userdb list: Disconnected unexpectedly doveadm: Error: Failed to iterate through some users This is in the logs: dovecot: auth: Panic: file userdb-blocking.c: line 124 (userdb_blocking_iter_next): assertion failed: (ctx->conn != NULL) dovecot: auth: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x41) [0x7f1c12675c91] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7f1c12675db2] -> /usr/lib/dovecot/libdovecot.so.0(+0x10b0bb) [0x7f1c126830bb] -> /usr/lib/dovecot/libdovecot.so.0(+0x10b157) [0x7f1c12683157] -> /usr/lib/dovecot/libdovecot.so.0(+0x5d375) [0x7f1c125d5375] -> dovecot/auth [0 wait, 0 passdb, 0 userdb](+0x157a7) [0x55e0278287a7] -> dovecot/auth [0 wait, 0 passdb, 0 userdb](+0x1954b) [0x55e02782c54b] -> dovecot/auth [0 wait, 0 passdb, 0 userdb](+0x36ca7) [0x55e027849ca7] -> dovecot/auth [0 wait, 0 passdb, 0 userdb](+0x2ab86) [0x55e02783db86] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0x15f) [0x7f1c1269976f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xcf) [0x7f1c1269b02f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x54) [0x7f1c12699a54] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f1c12699bc0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x17) [0x7f1c1260b207] -> dovecot/auth [0 wait, 0 passdb, 0 userdb](main+0x3c8) [0x55e027829588] -> /lib/x86_64-linux-gnu/libc.so.6(+0x29fd0) [0x7f1c122cbfd0] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x7d) [0x7f1c122cc07d] -> dovecot/auth [0 wait, 0 passdb, 0 userdb](_start+0x2e) [0x55e02782976e] dovecot: auth: Fatal: master: service(auth): child 19452 killed with signal 6 (core dumped) I've system users from passwd and users from a passwd-file: userdb { driver = passwd } userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } If I disable the passwd-file, a search works fine, but not with both user backends. This worked fine with version 2.3.18. Someone discovered this behavior too? This is my config: # 2.3.19 (b3ad6004dc): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 5.13.0-41-generic x86_64 Ubuntu 21.10 auth_mechanisms = plain login auth_username_format = %n default_vsz_limit = 2 G mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { driver = pam } passdb { args = scheme=ARGON2I username_format=%u /etc/dovecot/users driver = passwd-file } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/mail/moveSpam.sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = required ssl_cert = </etc/letsencrypt/live/mailserver/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = passwd } userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 30 } Best regards, Christoph

2 1

%{listener} not working
by cesco 19 May '22

19 May '22

Hi I'm trying to use the variable %{listener} in the following password mysql query: password_query = SELECT accounts.mcf AS password FROM accounts, domains WHERE user = '%n' AND accounts.domain = '%d' AND accounts.domain = domains.domain AND domains.host = '%{hostname}' AND accounts.service IN ('master', '%{listener}') but it doesn't expand, giving: Failed to expand password_query=SELECT accounts.mcf AS password FROM accounts, domains WHERE user = '%n' AND accounts.domain = '%d' AND accounts.domain = domains.domain AND domains.host = '%{hostname}' AND accounts.service IN ('master', '%{listener} ') : Unknown variable '%listener' %{hostname} works correctly, as well as other variables I tried. many thanks Franz ------------------- below my doveconf -n: # 2.3.19 (b3ad6004dc): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 5.10.0-13-amd64 x86_64 Debian 11.3 # Hostname: example.org auth_debug = yes auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 hostname = example.org login_log_format_elements = method=%m lip=%l %c %k mail_fsync = never mail_location = maildir:/var/vmail/%d/%n@%d/:INDEX=/var/vmail_indexes/%d/%n@%d/ mail_max_userip_connections = 200 mail_plugins = " notify replication fts fts_lucene" maildir_stat_dirs = yes maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/sql.conf.ext driver = sql } plugin { fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it sieve_extensions = +vnd.dovecot.filter sieve_global_extensions = +vnd.dovecot.filter sieve_plugins = sieve_extprograms } protocols = imap pop3 lmtp sieve submission service aggregator { fifo_listener replication-notify-fifo { user = dovemail } unix_listener replication-notify { user = dovemail } } service dict { unix_listener dict { group = dovemail mode = 0660 user = root } } service doveadm { inet_listener { port = 12345 } } service imap-login { service_count = 1 } service imap { executable = imap } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 1 } service pop3 { executable = pop3 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = dovemail mode = 0600 user = dovemail } } service submission-login { inet_listener submissions { port = 465 ssl = yes } } ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4::!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_max_mail_size = 100000000 B submission_max_recipients = 100 submission_relay_host = 127.0.0.1 submission_relay_port = 10025 userdb { args = uid=1000 gid=1000 home=/var/vmail/%d/%n@%d/ plain_pass=#hidden_use-P_to_show# user_part=%n domain_part=%d driver = static } userdb { driver = prefetch } userdb { args = /etc/dovecot/sql.conf.ext driver = sql } valid_chroot_dirs = /var/vmail:/var/vmail_indexes protocol imap { mail_plugins = " notify replication fts fts_lucene imap_zlib last_login" } protocol pop3 { mail_plugins = " notify replication fts fts_lucene last_login" } protocol lmtp { mail_fsync = optimized mail_plugins = " notify replication fts fts_lucene sieve" }

2 3

[Rocky Linux 8.6] expire plugin file disappeared
by Masakazu Hirose 19 May '22

19 May '22

Hi, Rocky Linux Dovecot no longer reads the expired plugin from the library directory. I use Rocky Linux packages. Rocky or Redhat may fail to package. "/usr/lib64/dovecot/lib20_expire_plugin.so" seems to have disappeared in the new package. This may not be relevant to the Dovecot project. # /var/log/messages May 18 08:21:22 xxxxxxx dovecot[3508407]: imap(yyyyyyy): Error: Plugin 'expire' not found from directory /usr/lib64/dovecot # cat /etc/redhat-release Rocky Linux release 8.6 (Green Obsidian) # rpm -qa | grep dovecot dovecot-2.3.16-2.el8.x86_64 dovecot-mysql-2.3.16-2.el8.x86_64 Thank you, Masakazu

2 2

Re: Duplicate messages if message is moved when using dsync
by Thom Pol 18 May '22

18 May '22

Never mind. It did not work, issue still exists. I guess my network was a little slower when I thought it worked, so the emails were moved by my local client only after the sync had already happened between the servers. So, back to the original message. Anyone any idea how this moving on local client while the remote servers are still running the dsync can work correctly without getting a duplicate? Kind regards, Thom Pol On 18/05/2022 16:24, Paul Kudla (SCOM.CA Internet Services Inc.) wrote: > Your Welcome > > > > Happy Wednesday !!! > Thanks - paul > > Paul Kudla > > > Scom.ca Internet Services<http://www.scom.ca> > 004-1009 Byron Street South > Whitby, Ontario - Canada > L1N 4S3 > > Toronto 416.642.7266 > Main?1.866.411.7266 > Fax?1.888.892.7266

2 1

FTS Solr -- no commit on message delete
by Shawn Heisey 18 May '22

18 May '22

I've been chasing down oddities in behavior related to FTS Solr for a while now. First the part that isn't a problem with dovecot: In cases where message deletes bypass the Trash folder (such as shift-delete and normal workflow with the Drafts and Sent folders), Thunderbird does not inform Dovecot about the change in a way that causes Dovecot to delete the entries from Solr. When you completely exit Thunderbird, it then sends something to dovecot that results in the messages being deleted from Solr. Today I discovered a related problem that I think IS in Dovecot. I did a shift-delete on some messages, and then exited Thunderbird. Dovecot did delete the messages from Solr, but it did not send a commit to make those changes affect subsequent searches. Is this something worth opening a bug? Where would I do that? Thanks, Shawn

1 1

Upgrading from 2.3.18 --> 2.3.19
by Paul Kudla (SCOM.CA Internet Services Inc.) 18 May '22

18 May '22

Ok currently running 2.3.18 Would like to upgrade to 2.3.19 (to keep current) Since these are production servers can i down grade back to 2.3.18 if nessesary? Issues at hand is there seems to be conflicting messages about the replication being fixed or not ? so would like to basically try 2.3.19 to see if it fixes some of my issues (large folder counts etc failing to replicate properly) If it does or stays the same then i am ok with that for now. if 2.3.19 causes issues can i go back to 2.3.18 as i already have scripts etc sorting out the sync issues? pls advise -- Happy Wednesday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

1 0

Re: Can sync/migrate all mail from remote imap account except the main "INBOX"
by Darren Mobley 18 May '22

18 May '22

Your example pointed me to a solution, excellent ! In my case I only needed one pass, I had to supply both imapc_list_prefix AND imapc_prefix AND the "namespace/inbox/prefix=" options. In case anyone runs into this in the future, here's a decent place to start for debugging: /usr/bin/doveadm -Dv -o imapc_list_prefix=INBOX -o imapc_prefix=INBOX. -o "namespace/inbox/prefix=" -o mail_fsync=never -o dsync_commit_msgs_interval=100 -o imapc_features=rfc822.size,fetch-headers -o dsync_features=empty-header-workaround -o imapc_port=143 -o imapc_host=127.0.0.1 -o imapc_password=yayforpasswords -o imapc_user=mailto:wah@hellodemo.ppl -o imapc_rawlog_dir=/tmp/raww -o mail_prefetch_count=20 sync -1Ru mailto:saywhatnow@letest.tld imapc: Thanks again for digging through the old emails where the magic incantations were, I really appreciate it! Darren ---- On Wed, 18 May 2022 05:19:53 -0500 Sami Ketola <sami(a)ketola.io> wrote ---- So adding "-o imapc_list_prefix=INBOX" to the doveadm command line should fix that, I would think ? So is the remote INBOX really 'INBOX' or 'INBOX.INBOX'? Command line arguments depend on which one it is. I managed to find some old archived emails with some tips on how it was solved back then. It was done with something like this: normal doveadm command: 'LOG_STDERR_TIMESTAMP="%b %d %H:%M:%S.%{usecs} " ' + '/usr/bin/doveadm' + dsync_debug + \ " -o mail_prefetch_count=10 " + \ " -o imapc_features=fetch-headers " + \ " -o imapc_host=" + legacy_host + \ " -o imapc_port=" + legacy_port + \ " -o imapc_list_prefix=" + imapc_prefix + \ " -o imapc_prefix=" + imapc_prefix + \ " -o imapc_user=" + self.legacy_user + \ " -o imapc_master_user=" + self.legacy_user + \ " -o imapc_password=" + imapc_master_password + \ " -o mail_fsync=never " + \ " backup -u " + self.uid + \ " -R imapc: >> " + dsync_err_log_location + self.uid + ".dsync_err.log 2>&1" If I remember correctly imapc_prefix was 'INBOX/' since this customer had INBOX/INBOX setup with / as separator. and if user had INBOX/INBOX detected this command was run on top of that to migrate INBOX: 'LOG_STDERR_TIMESTAMP="%b %d %H:%M:%S.%{usecs} " ' + '/usr/bin/doveadm' + dsync_debug + \ " -o namespace/inbox/prefix= " + \ " -o mail_prefetch_count=10 " + \ " -o imapc_features=fetch-headers " + \ " -o imapc_host=" + legacy_host + \ " -o imapc_port=" + legacy_port + \ " -o imapc_user=" + self.legacy_user + \ " -o imapc_master_user=" + self.legacy_user + \ " -o imapc_password=" + imapc_master_password + \ " -o mail_fsync=never " + \ " backup -u " + self.uid + \ " -m INBOX/INBOX " + \ " -R imapc: >> " + dsync_err_log_location + self.uid + ".dsync_err.log 2>&1" HTH, Sami

1 0

Re: dovecot Digest, Vol 229, Issue 23
by Thom Pol 18 May '22

18 May '22

I must say I was a bit sceptical if this sieve script would resolve it, but it seems like it totally did! Thanks a lot for your reply, hope this helps someone else in the future as well. Kind regards, Thom Pol On 16/05/2022 08:12, Paul Kudla (SCOM.CA Internet Services Inc.) wrote: > ok duplicsate emails (even across dsync, replication etc) is typically > handled via a global sieve script > > > I use : > > # cat duplicates.sieve > require "duplicate"; # for dovecot >= 2.2.18 > > if duplicate { > discard; > stop; > } > > for the scripts > > and setup sieve to work via my dovecot.conf file > > relative parts below : > > -------------------------------------------------------------------- > > protocols = imap pop3 lmtp sieve > > protocol lmtp { > mail_plugins = $mail_plugins sieve > postmaster_address =monitor(a)scom.ca > } > > > protocol lda { > mail_plugins = $mail_plugins sieve > } > > > plugin { > ..... > > sieve =file:~/sieve;active=~/sieve/.dovecot.sieve > > sieve_duplicate_default_period = 1h > sieve_duplicate_max_period = 1d > sieve_extensions = +duplicate +notify +imapflags +vacation-seconds > sieve_global_dir = /usr/local/etc/dovecot/sieve > sieve_before = /usr/local/etc/dovecot/sieve/duplicates.sieve > > ..... > } > > service managesieve-login { > process_limit = 1000 > vsz_limit = 1g > inet_listener sieve { > port = 4190 > } > } > > protocol sieve { > managesieve_implementation_string = Dovecot Pigeonhole > managesieve_max_line_length = 65536 > } > > > > ------------------------------------------------------------------ > > > note the sieve_before which handles duplictes during delivery etc. > > > Happy Monday !!! > Thanks - paul > > Paul Kudla > > > Scom.ca Internet Services<http://www.scom.ca> > 004-1009 Byron Street South > Whitby, Ontario - Canada > L1N 4S3 > > Toronto 416.642.7266 > Main?1.866.411.7266 > Fax?1.888.892.7266

2 1

dovecot virtual users with sendmail, my solution
by Christopher McCrory 18 May '22

18 May '22

Hello... I wanted to use dovecot virtual users with sendmail. As you probably know, this doesn't work by default. The more scalable solution is probably to use LDAP, but I really don't like it. This is how I did it https://github.com/chrismcc-gmail/dovecot-virtual-sendmail Basically I abused glibc's db feature in /etc/nsswitch in /var/db/Makefile something like this: $(VAR_DB)/passwd.db: /etc/dovecot/usersfile @printf %s "$(patsubst %.db,%,$(@F))... " @$(AWK) 'BEGIN { FS=":"; OFS=":" } \ /^[ \t]*$$/ { next } \ /^[ \t]*#/ { next } \ /^root/ { next } \ /^[^#]/ { printf ".%s ", $$1; \ printf "%s:x:65534:65534:%s:/home/vmail/%s:/sbin/nologin\n", $$1, $$1, $$1; \ }' $^ | \ $(MAKEDB) -o $@ - @echo "done." make -C /var/db getent passwd ; shows ... virtualuser:x:65534:65534:virtualuser:/home/vmail/virtualuser:/sbin/nologin othervuser:x:65534:65534:othervuser:/home/vmail/othervuser:/sbin/nologin A longer explanation and more info is in the github repository It takes about 10 minutes to go from new clean server to working email server with this I've been running this in production for about a week now without any problems. Question: Has anyone else done this? I don't see any downsides, but I might be missing something. -- Christopher McCrory To the optimist, the glass is half full. To the pessimist, the glass is half empty. To the engineer, the glass is twice as big as it needs to be.

2 1

Preventing deletion of mails in some directories?
by Philip Rhoades 18 May '22

18 May '22

People, I can't get the system "chattr" to do what I want so I am wondering if there is some way to prevent deletion of mails in the INBOX and the Sent folders? Renaming and moving files needs to be possible for Maildir functions and also for me - so I only need deletion prevention . . Is this possible from Dovecot? Thanks, Phil. -- Philip Rhoades PO Box 896 Cowra NSW 2794 Australia E-mail: phil(a)pricom.com.au

3 2

Can sync/migrate all mail from remote imap account except the main "INBOX"
by Darren Mobley 17 May '22

17 May '22

Greetings! I've been trying to sync my email to a server, however it only syncs the mail in folders other than INBOX. For testing purposes, I've created a fake domain, "letest.tld" and a new empty user account "mailto:saywhatnow@letest.tld" to receive the copy of the mail being migrated. What I've been trying are iterations of: /usr/bin/doveadm -D -o mail_fsync=never -o dsync_features=empty-header-workaround -o imapc_ssl=imaps -o imapc_features=rfc822.size,fetch-headers -o dsync_commit_msgs_interval=100 -o imapc_port=993 -o imapc_host=imap.zoho.com -o imapc_password=NoNoTRe4LLyMyP4$$ -o imapc_user=mailto:decker@n3t.net -o mail_prefetch_count=20 sync -1Ru mailto:saywhatnow@letest.tld imapc: Regardless of running sync -1 or backup (I want to keep original mailbox as-is for now) I get errors related to INBOX. With sync -1 ; May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: Ignore nonexistent mailbox GUID c92f64f79f0d1ed01e6d5b314f04886c with -1 sync May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: We don't have mailbox c92f64f79f0d1ed01e6d5b314f04886c May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: brain M: Ignoring missing remote box GUID c92f64f79f0d1ed01e6d5b314f04886c May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX.Archive: Mailbox opened May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX.Archive: Mailbox opened May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: Skipping unchanged mailbox 51a58e1d1d5c491aac71488647b20224 May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX.Commercial Spam: Mailbox opened May 10 16:53:29 dsync(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX.Commercial Spam: Mailbox opened With backup : May 10 16:54:55 doveadm(mailto:saywhatnow@letest.tld): Debug: brain M: Namespace INBOX. has location maildir:/home/letest/mail/letest.tld/saywhatnow:UTF-8 May 10 16:54:55 doveadm(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX: Mailbox opened May 10 16:54:55 doveadm(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX: Mailbox opened May 10 16:54:55 doveadm(mailto:saywhatnow@letest.tld): Debug: Namespace INBOX.: Using permissions from /home/letest/mail/letest.tld/saywhatnow: mode=0700 gid=default ... May 10 16:54:55 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: Namespace INBOX. has location imapc: May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain M: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1 uid_next=1 subs=yes last_change=0 last_subs=1652217475 May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1 uid_next=8230 subs=yes last_change=0 last_subs=0 ... May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain M: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1 uid_next=8230 subs=yes last_change=0 last_subs=0 ... May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain M: Mailbox INBOX: local=c92f64f79f0d1ed01e6d5b314f04886c/0/1, remote=c92f64f79f0d1ed01e6d5b314f04886c/0/1: Mailboxes are equal ... May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX: Mailbox opened May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: Mailbox INBOX: local=c92f64f79f0d1ed01e6d5b314f04886c/0/1, remote=c92f64f79f0d1ed01e6d5b314f04886c/0/1: Mailboxes are equal ... May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: Mailbox INBOX: Mailbox opened May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: Change during sync: Mailbox GUID c92f64f79f0d1ed01e6d5b314f04886c was lost May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain S: We don't have mailbox c92f64f79f0d1ed01e6d5b314f04886c May 10 16:54:57 dsync(mailto:saywhatnow@letest.tld): Debug: brain M: Change during sync: Remote lost mailbox GUID c92f64f79f0d1ed01e6d5b314f04886c (maybe it was just deleted?) ... May 10 16:55:33 dsync(mailto:saywhatnow@letest.tld): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID c92f64f79f0d1ed01e6d5b314f04886c (maybe it was just deleted?) This is odd, since that very GUID is in the uidlist file for the base folder: # grep -R Gc92f64f79f0d1ed01e6d5b314f04886c /home/letest/mail/letest.tld/saywhatnow /home/letest/mail/letest.tld/saywhatnow/dovecot-uidlist:3 V1 N1 Gc92f64f79f0d1ed01e6d5b314f04886c I've tried all sorts of things to get this to work, including removing the entire /home/letest/mail/letest.tld/saywhatnow/ directory so there could be no conflicts with existing mailbox, set mailbox_list_index=no , set lda_mailbox_autocreate=no , etc. The errors appear to originate from src/doveadm/dsync/dsync-brain-mailbox.c but it's not really telling me a lot. I'm using dovecot version 2.3.18 (9dd8408c18) on a cPanel server. `dovecot -n` output attached. Any help would be greatly appreciated! Thanks, Darren

3 5

Dovecot and RFC6856
by Tan Mientras 17 May '22

17 May '22

Hi. Just after upgrading *courier* from an old version, we are receiving warning messages instead of mails stating: "This E-mail message was determined to be Unicode-formatted but your E-mail reader does not support Unicode E-mail." warnings. It looks much like: *https://bugzilla.mozilla.org/show_bug.cgi?id=1571672 <https://bugzilla.mozilla.org/show_bug.cgi?id=1571672>* https://talk.plesk.com/threads/messages-with-unicode-unable-to-pick-up-via-… it seems, malformed mails (they showed errors before migration, but they were shown at least!) are handled incorrectly by thunderbird and the only option is to *revert backwards or migrate to dovecot*. *Does dovecot also implement RFC8656*? Will the same happen if we migrate to dovecot? Any plans for future adoption of that RFC?

2 1

Shared mailboxes, users with dots and a bug in subscriptions
by Tobias Stein 17 May '22

17 May '22

Hi, i'm running Dovecot 2.3.14.alpha0 with shared namespaces and stumbled across some errors messages logged, when the list of subscribed mailboxes is queried by a client. For every distinct account of in the list of subscriptions two corresponding lines are logged: Jan 28 11:42:34 mx1 dovecot: auth: missing passwd file: /etc/dovecot/private/example/users Jan 28 11:42:34 mx1 dovecot: auth: missing passwd file: /etc/dovecot/private/example/users Jan 28 11:42:34 mx1 dovecot: auth: missing passwd file: /etc/dovecot/private/example/users Jan 28 11:42:36 mx1 dovecot: imap(example_user(a)example.com)<3638><xl6li/O5VsVfWxyn>: Error: mkdir(/var/run/dovecot/user-not-found/noc@example) failed: Permission denied (euid=109(vmail) egid=118(vmail) missing +w perm: /var/run/dovecot, dir owned by 0:0 mode=0755) Jan 28 11:42:36 mx1 dovecot: imap(example_user(a)example.com)<3638><xl6li/O5VsVfWxyn>: Error: mkdir(/var/run/dovecot/user-not-found/info@example) failed: Permission denied (euid=109(vmail) egid=118(vmail) missing +w perm: /var/run/dovecot, dir owned by 0:0 mode=0755) Jan 28 11:42:36 mx1 dovecot: imap(example_user(a)example.com)<3638><xl6li/O5VsVfWxyn>: Error: mkdir(/var/run/dovecot/user-not-found/root@example) failed: Permission denied (euid=109(vmail) egid=118(vmail) missing +w perm: /var/run/dovecot, dir owned by 0:0 mode=0755) Similar messages are logged, when invalid entries are listed in '/var/lib/dovecot/db/shared-mailboxes', which i already pruned and haven't received them anymore since. I think these errors are caused by an unintended behaviour when writing "~/Maildir/subscriptions", which looks (shortened) like this. V 2 INBOX/INBOX shared/noc@example com/INBOX shared/info@example com/INBOX shared/root@example com/test shared/root@example com/test test_sub The subscription-file.c explodes the name on every hierarchy separator ('.','\0') and inserts a TAB character. Unfortunately it also explodes on the DNS label delimiter „.‟. This should probably be fixed by passing a structure containing the required information to the formatter to distinguish mailboxes from domain-names. Subscription in combination with multiple domains and shared mailboxes seems broken to me. Actually i can't even explain to me, why it is working in face of the errors. :-) Unfortunately in Maildir++ the separator dot is hard-coded. There is a very old thread on this mailing list, that suggests using „auth_username_translation‟ to replace dots with a different character, but this idea is getting worse the longer i think about it. I absolutely dislike the idea to set LAYOUT=fs, namespace/separator = § to change the separators to split on, because this would mean to restructure the physical layout of all mailboxes (hierarchically) and mess around with lots of files. I attached a dovecot-sysreport to reproduce the behaviour. /etc/dovecot/private/example.com/users looks like this: ### user:password:uid:gid:(gecos):home:(shell):extra_fields noc:{SSHA512}_hash_:::::: info:{SSHA512}_hash_:::::: root:{SSHA512}_hash_:::::: Please correct me if i'm wrong or point me to a workaround, but i think the layout code needs some love. :-) Best regards Tobias

2 4

Re: Permissions and ownership on /dev/shm/dovecot
by doug 16 May '22

16 May '22

1 0

Fatal Error after upgrade to 2:2.3.19-2+debian11
by Sebastian Kroczek 16 May '22

16 May '22

Hello all, I updated the server tonight and with it Dovecot from 2.2.27 to 2:2.3.19-2+debian11. However, there seems to be a problem with the ACLs, because since then fatal errors are logged (see core dump). I suspect that some outdated configuration is causing this behavior, but so far I couldn't figure out which one it could be. I also have no clue right now how to debug this further. Thank you very much for your help. If more information are needed, I will of course be happy to provide them. VG Sebastian ======== Error logs ========= May 16 13:33:43 Fatal: imap(user1(a)domain.com)<0r5YZR/fM4AfrHBI>: master: service(imap): child 238359 killed with signal 11 (core dumped) May 16 13:33:46 Fatal: imap(user2(a)domain.com)<Ul+kZR/fA4AfrHBI>: master: service(imap): child 238386 killed with signal 11 (core dumped) May 16 13:33:46 Fatal: imap(user3(a)domain.com)<VGOkZR/fG4AfrHBI>: master: service(imap): child 238387 killed with signal 11 (core dumped) May 16 13:34:54 Fatal: imap(user4(a)domain.com)<1WS6aR/fHoAfrHBI>: master: service(imap): child 238509 killed with signal 11 (core dumped) May 16 13:34:54 Fatal: imap(user2(a)domain.com)<mQu6aR/fBIAfrHBI>: master: service(imap): child 238508 killed with signal 11 (core dumped) May 16 13:35:27 Fatal: imap(user3(a)domain.com)<pWGYax/fE4AfrHBI>: master: service(imap): child 238589 killed with signal 11 (core dumped) May 16 13:35:27 Fatal: imap(user1(a)domain.com)<s/mgax/fG4AfrHBI>: master: service(imap): child 238590 killed with signal 11 (core dumped) ======== END Error logs ========= ======== dovecot.conf ========== # 2.3.19 (b3ad6004dc): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 5.10.0-14-amd64 x86_64 Debian 11.3 # Hostname: wv-imap1.wavecloud.de auth_mechanisms = plain login default_vsz_limit = 4 G dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf } first_valid_gid = 5000 first_valid_uid = 5000 imap_capability = +XDOVECOT last_valid_gid = 5000 last_valid_uid = 5000 listen = 10.10.115.XX login_trusted_networks = 10.10.115.XX 10.10.115.XX mail_location = maildir:~/ mail_log_prefix = "%s(%u)<%{session}>: " mail_plugins = acl notify quota fts fts_solr virtual maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } namespace Virtual { hidden = yes list = no location = virtual:/etc/dovecot/virtual:INDEX=/srv/vmail/_virtual/%u prefix = Virtual/ separator = / subscriptions = no } namespace shared { list = yes location = maildir:%%h:INDEX=~/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql-password.conf driver = sql } passdb { args = /etc/dovecot/admin-sql.conf driver = sql master = yes pass = yes } plugin { acl = vfile acl_shared_dict = proxy::acl fts = solr fts_autoindex = yes fts_solr = url=http://wv-solr1.wavecloud.de:8983/solr/dovecot/ quota = maildir:User quota quota_rule = *:storage=20G quota_rule2 = Trash:storage=+100M quota_rule3 = SPAM:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = ~/.dovecot.sieve sieve_before = /var/vmail/globalsieverc sieve_max_script_size = 1M sieve_quota_max_scripts = 42 sieve_quota_max_storage = 10 } protocols = imap pop3 sieve lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0666 user = vmail } unix_listener auth-master { mode = 0666 } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_min_avail = 1 service_count = 0 vsz_limit = 500 M } service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 24 } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { address = 10.10.115.10 port = 4190 } process_min_avail = 1 service_count = 1 } service managesieve { executable = /usr/local/sbin/dovecot-managesieve.sh } service pop3-login { process_min_avail = 1 service_count = 1 } service quota-warning { executable = script /usr/local/sbin/quota-warning.sh user = vmail } service stats { unix_listener stats-reader { group = vmail mode = 0660 user = vmail } unix_listener stats-writer { group = vmail mode = 0660 user = vmail } } shutdown_clients = no ssl_cert = </etc/ssl/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 2048 mail_plugins = acl notify quota fts fts_solr virtual imap_quota imap_acl } protocol pop3 { mail_plugins = acl notify quota fts fts_solr virtual pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { hostname = wv-imap1.wavecloud.de mail_fsync = optimized mail_plugins = acl notify quota fts fts_solr virtual sieve postmaster_address = postmaster(a)example.com quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } protocol lmtp { mail_fsync = optimized mail_plugins = acl notify quota fts fts_solr virtual sieve } ======== END dovecot.conf ========== ======== Core-Dump ================= PID: 240475 (imap) UID: 5000 (vmail) GID: 5000 (vmail) Signal: 11 (SEGV) Timestamp: Mon 2022-05-16 13:49:56 CEST (1min 17s ago) Command Line: dovecot/imap [user1(a)domain.com XX.XX.XX.XX MYRIGHTS] Executable: /usr/lib/dovecot/imap Control Group: /system.slice/dovecot.service Unit: dovecot.service Slice: system.slice Boot ID: acb78ce2252049778ff969755d277453 Machine ID: 1367ff1e75be457cacbf5e204a28711b Hostname: wv-imap1 Storage: /var/lib/systemd/coredump/core.imap.5000.acb78ce2252049778ff969755d277453.240475.1652701796000000.zst Message: Process 240475 (imap) of user 5000 dumped core. Stack trace of thread 240475: #0 0x00007f5db938c17c acl_mailbox_get_aclobj (lib01_acl_plugin.so + 0xf17c) #1 0x00007f5db93776ed n/a (lib02_imap_acl_plugin.so + 0x36ed) #2 0x000055f5568444d4 command_exec (imap + 0x224d4) #3 0x000055f55684244f n/a (imap + 0x2044f) #4 0x000055f5568424fa n/a (imap + 0x204fa) #5 0x000055f5568429d5 client_handle_input (imap + 0x209d5) #6 0x000055f556842f40 client_input (imap + 0x20f40) #7 0x00007f5db9682529 io_loop_call_io (libdovecot.so.0 + 0x118529) #8 0x00007f5db9683c12 io_loop_handler_run_internal (libdovecot.so.0 + 0x119c12) #9 0x00007f5db96825d0 io_loop_handler_run (libdovecot.so.0 + 0x1185d0) #10 0x00007f5db9682790 io_loop_run (libdovecot.so.0 + 0x118790) #11 0x00007f5db95f5353 master_service_run (libdovecot.so.0 + 0x8b353) #12 0x000055f556833f0a main (imap + 0x11f0a) #13 0x00007f5db93c5d0a __libc_start_main (libc.so.6 + 0x26d0a) #14 0x000055f556833fca _start (imap + 0x11fca) =========== END Core-Dump ============= -- Wavecon GmbH Anschrift: Gustavstraße 18, 90762 Fürth Website: www.wavecon.de Support: support(a)wavecon.de Telefon: +49 (0)911-1206581 (werktags von 9 - 17 Uhr) Hotline 24/7: 0800-WAVECON Fax: +49 (0)911-2129233 Registernummer: HRB Fürth 18164 GF: Cemil Degirmenci UstID: DE251398082 Pflichtinformationen nach Art. 13 DSGVO siehe wavecon.de/de/datenschutz

3 5

TLS renegotiation issue (CVE-2011-1473) in Dovecot
by Greg Earle 16 May '22

16 May '22

Hello, At work I'm running a Dovecot 2.3.15 server on a RHEL 7.9 system with OpenSSL 1.0.2k. Our IT Security people are threatening to shut it down because of this: > We were notified of a possible TLS renegotiation vulnerability on > [FQHN]. > > [Parent organization] ticket NNNNNNN is open to track efforts. > > We conducted a manual test on the site for TLS Renegotiation on IMAP > port 993. > > We found that this was set to enabled. > > In order to remediate we will need to either: > > 1. Disable Renegotiation (preferred) > 2. Set a max aggregated renegotiation > > Please remediate as soon as possible. > > References: > > https://support.f5.com/csp/article/K15278 > > https://nvd.nist.gov/vuln/detail/cve-2011-1473 > > https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2011-1473 I did some Googling and among the results, I found a few old posts from this mailing list among them, which to summarize basically seemed to say "Yeah, we could write some code ... " but that was about it. The IT Security rep sent me a reference to an ancient Red Hat article https://access.redhat.com/articles/23543 which is hysterical - ancient history, references NSS and Tomcat, suggests changes to an add-on product (Red Hat Certificate Server) that is EOL, etc. Is there any way to mitigate this issue? (The only thing I can think of is to upgrade the Dovecot server to RHEL 8 and restrict connections to only TLSv1.3, but that ain't gonna happen overnight.) Thanks, - Greg

3 2

Duplicate messages if message is moved when using dsync
by Thom Pol 16 May '22

16 May '22

Hi, Hope you are well. We have a cluster of 2 Dovecot servers, both on v2.3.13 (89f716dc2), using dsync to sync the messages between them. Previously, we used TCPS to sync the messages, but after some testing, we concluded that syncing over SSH resulted in a lot less failed syncs, so we started using SSH. The change has been a success, but I now notice a issue when a email client immediately moves a messages to a separate folder while Dovecot is syncing, where the message is seen twice in the folder (with the exact same headers/content). For example, I have set a filter in my email client, Thunderbird, to immediately move all emails coming from this list to a separate folder. When opening that folder, I do not see one, but two unread messages, both identical to each other. When checking the directories on the server, I see this: mx1: /var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615808.M190190P990486.mx2,S=19089,W=19384:2,S /var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615811.M180050P1376677.mx1,S=19089,W=19384:2,S mx2: /var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615811.M981426P990530.mx2,S=19089,W=19384:2,S /var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615808.M190190P990486.mx2,S=19089,W=19384:2,S Note the difference: on mx1, one indicates mx1, and one mx2, while on the other server, both indicate mx2/ Any idea (other then telling end-users not to use such filters) how we could prevent these duplicate messages? This is our config: # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 5.10.0-13-cloud-amd64 x86_64 Debian 11.3 # Hostname: mx1.example.com auth_mechanisms = plain login disable_plaintext_auth = no dsync_remote_cmd = ssh -p 222 -l%{login} %{host} doveadm dsync-server -u%u imap_capability = +SPECIAL-USE XLIST listen = *,[::] lmtp_rcpt_check_quota = yes log_timestamp = "%Y-%m-%d %H:%M:%S " mail_max_userip_connections = 100 mail_plugins = quota mail_privileged_group = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:root@mx2.example.com quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = /var/vmail/%d/%n/.sieve sieve_after = /var/vmail/%d/%n/.ispconfig.sieve sieve_before = /var/vmail/%d/%n/.ispconfig-before.sieve sieve_max_actions = 100 sieve_max_redirects = 25 sieve_max_script_size = 2M } protocols = imap pop3 lmtp replication_max_conns = 50 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service imap-login { client_limit = 1000 process_limit = 512 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0660 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 user = vmail } } service stats { unix_listener stats-reader { group = vmail mode = 0660 user = vmail } unix_listener stats-writer { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/postfix/smtpd.cert ssl_cipher_list = kEECDH:+kEECDH+SHA:kEDH:+kEDH+SHA:+kEDH+CAMELLIA:kECDH:+kECDH+SHA:kRSA:+kRSA+SHA:+kRSA+CAMELLIA:!aNULL:!eNULL:!SSLv2:!RC4:!MD5:!DES:!EXP:!SEED:!IDEA:!3DES ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { auth_verbose = yes mail_plugins = quota quota imap_quota quota notify replication } protocol pop3 { auth_verbose = yes mail_plugins = quota quota quota notify replication pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = quota sieve quota sieve quota notify replication postmaster_address = postmaster(a)mx1.example.com } protocol lmtp { mail_plugins = quota quota sieve sieve quota notify replication postmaster_address = postmaster(a)mx1.example.com } Thanks in advance for your thoughts. Kind regards, Thom Pol

2 1

Use different log files
by Cristiano Deana 16 May '22

16 May '22

Hi, I have a mailserver with dovecot logging to syslog (by default, to /var/log/maillog) and my MTA (postfix) is doing the same. I use dovecot's services imap/pop3, auth and lmtp and now logs files are hard to read because I havve all together MTA and these services. Is it possibile to have different log with different services? Example: auth logging: /var/log/mail.auth delivery: /var/log/mail.delivery and so on Thank you -- ############################### # Cristiano Deana # # # # Senior Network Engineer # # Digital Response Team # # CittaStudi S.p.a. # # off. +39 015 855 1172 # # cell +39 328 310 6392 # ###############################

3 2

Re: TLS renegotiation issue (CVE-2011-1473) in Dovecot
by Greg Earle 16 May '22

16 May '22

On 13 May 2022, at 19:38, Elisamuel Resto <sam(a)samresto.dev> wrote: > I believe this to be a configuration error, not a dovecot problem. > The > output of dovecot -n (as an attachment; look it over for any data you > do > not want publicized) would help to suggest changes to bring you back > into compliance. Elisamuel, I'm not really sure why you think it's a configuration error, but I'll attach the "dovecot -n" output. Thanks, - Greg

3 2

Dovecot v2.3.19 released
by Aki Tuomi 16 May '22

16 May '22

Hi all! We are pleased to release v2.3.19 of Dovecot. The docker images have been upgraded to use bullseye as base image. https://dovecot.org/releases/2.3/dovecot-2.3.19.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.19.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot Regards, Aki Tuomi Open-Xchange oy -- + Added mail_user_session_finished event, which is emitted when the mail user session is finished (e.g. imap, pop3, lmtp). It also includes fields with some process statistics information. See https://doc.dovecot.org/admin_manual/list_of_events/ for more information. + Added process_shutdown_filter setting. When an event matches the filter, the process will be shutdown after the current connection(s) have finished. This is intended to reduce memory usage of long-running imap processes that keep a lot of memory allocated instead of freeing it to the OS. + auth: Add cache hit indicator to auth passdb/userdb finished events. See https://doc.dovecot.org/admin_manual/list_of_events/ for more information. + doveadm deduplicate: Performance is improved significantly. + imapc: COPY commands were sent one mail at a time to the remote IMAP server. Now the copying is buffered, so multiple mails can be copied with a single COPY command. + lib-lua: Add a Lua interface to Dovecot's HTTP client library. See https://doc.dovecot.org/admin_manual/lua/ for more information. - auth: Cache lookup would use incorrect cache key after username change. - auth: Improve handling unexpected LDAP connection errors/hangs. Try to fix up these cases by reconnecting to the LDAP server and aborting LDAP requests earlier. - auth: Process crashed if userdb iteration was attempted while auth-workers were already full handling auth requests. - auth: db-oauth2: Using %{oauth2:name} variables caused unnecessary introspection requests. - dict: Timeouts may have been leaked at deinit. - director: Ring may have become unstable if a backend's tag was changed. It could also have caused director process to crash. - doveadm kick: Numeric parameter was treated as IP address. - doveadm: Proxying can panic when flushing print output. Fixes Panic: file ioloop.c: line 865 (io_loop_destroy): assertion failed: (ioloop == current_ioloop). - doveadm sync: BROKENCHAR was wrongly changed to '_' character when migrating mailboxes. This was set by default to %, so any mailbox names containing % characters were modified to "_25". - imapc: Copying or moving mails with doveadm to an imapc mailbox could have produced "Error: Syncing mailbox '[...]' failed" Errors. The operation itself succeeded but attempting to sync the destination mailbox failed. - imapc: Prevent index log synchronization errors when two or more imapc sessions are adding messages to the same mailbox index files, i.e. INDEX=MEMORY is not used. - indexer: Process was slowly leaking memory for each indexing request. - lib-fts: fts header filters caused binary content to be sent to the indexer with non-default configuration. - doveadm-server: Process could hang in some situations when printing output to TCP client, e.g. when printing doveadm sync state. - lib-index: dovecot.index.log files were often read and parsed entirely, rather than only the parts that were actually necessary. This mainly increased CPU usage. - lmtp-proxy: Session ID forwarding would cause same session IDs being used when delivering same mail to multiple backends. - log: Log prefix update may have been lost if log process was busy. This could have caused log prefixes to be empty or in some cases reused between sessions, i.e. log lines could have been logged for the wrong user/session. - mail_crypt: Plugin crashes if it's loaded only for some users. Fixes Panic: Module context mail_crypt_user_module missing. - mail_crypt: When LMTP was delivering mails to both recipients with mail encryption enabled and not enabled, the non-encrypted recipients may have gotten mails encrypted anyway. This happened when the first recipient was encrypted (mail_crypt_save_version=2) and the 2nd recipient was not encrypted (mail_crypt_save_version=0). - pop3: Session would crash if empty line was sent. - stats: HTTP server leaked memory. - submission-login: Long credentials, such as OAUTH2 tokens, were refused during SASL interactive due to submission server applying line length limits. - submission-login: When proxying to remote host, authentication was not using interactive SASL when logging in using long credentials such as OAUTH2 tokens. This caused authentication to fail due to line length constraints in SMTP protocol. - submission: Terminating the client connection with QUIT command after mail transaction is started with MAIL command and before it is finished with DATA/BDAT can cause a segfault crash. - virtual: doveadm search queries with mailbox-guid as the only parameter crashes: Panic: file virtual-search.c: line 77 (virtual_search_get_records): assertion failed: (result != 0)

12 20

Recovering deleted mailbox
by Sean McBride 14 May '22

14 May '22

Hi all, I have a user (coworker) that accidentally deleted a mailbox and all its sub-mailboxes. I use Maildir format storage. I have backups. Is it enough to put the mailbox folder back where it was? I'm talking about the folder that contains 'cur', 'new', 'tmp', 'dovecot-uidlist', etc. Or would this desynchronize or otherwise confuse dovecot? Or is it preferable to use some doveadm command? Or...? Thanks, Sean

6 13

how is the "Total number of known users" reported by doveadm replicator calculted?
by Arnaud Abélard 13 May '22

13 May '22

Hello, I have a question regarding the "Total number of known users" displayed by doveadm replicator status. How is it calculated? Shouldn't it match the number of users reported by doveadm user '*' ? I have 3 servers being replicated, the "total number of known users" a lot higher than the number of users reports by doveadm user '*' why is that? Arnaud -- Arnaud Abélard Responsable Service Infrastructures DSIN Université de Nantes -

2 1

FTS solr or xapian and Public Folders
by David Williams 13 May '22

13 May '22

Hi all I hope someone can help with this. I'm looking at setting up FTS on a Dovecot server which has some quite big pubic folders (100,000+ emails each) and would appreciate some info about how fts both Xapian and Solr works with public folders. As background of the folders can receive emails and I use a dummy user and an alias file to deliver them for example testfolder: dummy+Public/MYTESTFOLDER(a)example.com delivers email addressed to testfolder(a)example.com to MYTESTFOLDER in the namespace Public. Has anyone successfully setup FTS with public folders using either Xapian or Solr and what happens when one user changes a folder, does that change show up for other users? E.G.: When an email is delivered by dummy and indexed will that email be indexed for other users as well? Similarly what happens that when an email is moved between, deleted from or copied to public folders by one user will that change then show up for the other users or not? I guess the basic question is: Are public folders indexed once and then the indexes are made available to each user with access or are they indexed for each user? Any info or experience that anyone has will be appreciated. Many thanks David

2 1

copy recursive mails from one account to another
by Alex 12 May '22

12 May '22

Hi. I tried to copy a mailbox on the same server from src-account1 to dest-account2 and tried to follow this page https://doc.dovecot.org/admin_manual/migrating_mailboxes/ I have tried to get this command running via IMAP but sadly I was not able to bring it up and running. doveadm -D backup -u src-account1 -R dest-account2 This was working but only for INBOX, is there a option to copy the src-account1 recursively? doveadm -D copy -u dest-account2 INBOX user src-account1 Please can anybody recommend a command to copy recursively mails from one mailbox to another on the same server. ``` doveadm config -n # 2.2.36.4 (baf9232c1): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24.2 (aaba65b7) # OS: Linux 3.10.0-1160.59.1.el7.x86_64 x86_64 CentOS Linux release 7.9.2009 (Core) # Hostname: mail.DOMAIN.com auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN deliver_log_format = from=%{from}, envelope_sender=%{from_envelope}, subject=%{subject}, msgid=%m, size=%{size}, %$ dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 last_valid_uid = 2000 listen = * [::] mail_attribute_dict = file:%Lh/dovecot-attributes mail_gid = 2000 mail_location = maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/ mail_plugins = quota mailbox_alias acl mail_log notify stats mail_prefetch_count = 20 mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox "Junk E-mail" { auto = no special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } namespace { list = children location = maildir:%%Lh/Maildir/:INDEXPVT=%%Lh/Maildir/Shared/%%Ld/%%Ln prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-master-users driver = passwd-file master = yes } plugin { acl = vfile acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/var/vmail/sieve/report_spam.sieve imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/var/vmail/sieve/report_ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * imapsieve_url = sieve://192.168.122.173:4190 mail_log_events = delete undelete expunge mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from subject mailbox_alias_new = Sent Messages mailbox_alias_new2 = Sent Items mailbox_alias_old = Sent mailbox_alias_old2 = Sent quota = dict:user::proxy::quotadict quota_grace = 10%% quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u sieve = ~/sieve/dovecot.sieve sieve_before = /var/vmail/sieve/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_max_redirects = 30 sieve_pipe_bin_dir = /etc/dovecot/sieve/pipe sieve_plugins = sieve_imapsieve sieve_extprograms sieve_vacation_send_from_recipient = yes stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap sieve lmtp recipient_delimiter = - service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 port = 24 } process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 1 } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } service stats { fifo_listener stats-mail { mode = 0644 user = vmail } inet_listener { address = 127.0.0.1 port = 24242 } } ssl = required ssl_cert = </etc/pki/tls/certs/iRedMail.crt ssl_cipher_list = EECDH+CHACHA20:ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+3DES:!aNULL:!MD5 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_plugins = quota mailbox_alias acl mail_log notify stats sieve recipient_delimiter = - } protocol lmtp { lmtp_save_to_detail_mailbox = yes mail_plugins = quota sieve recipient_delimiter = - } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 mail_plugins = quota mailbox_alias acl mail_log notify stats imap_quota imap_acl imap_stats imap_sieve } protocol pop3 { mail_max_userip_connections = 30 mail_plugins = quota mailbox_alias acl mail_log notify stats pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } ``` Regards Alex

2 1

no full syncs after upgrading to dovecot 2.3.18
by Arnaud Abélard 12 May '22

12 May '22

Hello, I am working on replicating a server (and adding compression on the other side) and since I had "Error: dsync I/O has stalled, no activity for 600 seconds (version not received)" errors I upgraded both source and destination server with the latest 2.3 version (2.3.18). While before the upgrade all the 15 replication connections were busy after upgrading dovecot replicator dsync-status shows that most of the time nothing is being replicated at all. I can see some brief replications that last, but 99,9% of the time nothing is happening at all. I have a replication_full_sync_interval of 12 hours but I have thousands of users with their last full sync over 90 hours ago. "doveadm replicator status" also shows that i have over 35,000 queued full resync requests, but no sync, high or low queued requests so why aren't the full requests occuring? There are no errors in the logs. Thanks, Arnaud -- Arnaud Abélard Responsable pôle Système et Stockage Service Infrastructures DSIN Université de Nantes -

8 19

Pigeonhole v0.5.19 released
by Aki Tuomi 11 May '22

11 May '22

Hi all! We are pleased to release v0.5.19 of Pigeonhole. This release is done to maintain parity with dovecot 2.3.19 release, so it does not contain any news-worthy changes. https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.18.t… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.18.t… Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot Regards, Aki Tuomi Open-Xchange oy

1 1

dovecot + sieve: message recovery possible after rule pointed to invalid mailbox?
by Charles Gresham 09 May '22

09 May '22

Hi all, we face the following situation: 1, Customer created a mailbox (aka subfolder) "ABC" and setup a Pigeonhole Sieve script to file the messages into it. So fine, so good. All seemed to work out well. 2. Customer renamed the mailbox to, let's say, "CDE" and did not change the Sieve script accordingly. 3. We noticed this from a ~/.dovecot.sieve.log (after getting a complaint that messages were not arriving properly anymore :-o ): " sieve: info: started log at Apr 28 07:41:11. error: msgid=<433788c81ea044c4ae49cb39a6f673f3(a)ALB-DC-EXC08.CLPL.INTERN>: failed to store into mailbox 'ABC': Internal error occurred. Refer to server log for more information. [2022-04-28 07:41:10]. " Does anybody in this list know if all these messages went to /dev/null - or else? If the latter: where/can we restore the messages? Which "server log" is meant in this error message? I couldn't find the information needed by going through https://doc.dovecot.org/configuration_manual/sieve/ <https://doc.dovecot.org/configuration_manual/sieve/#> but I wonder if all the messages end in digital nirvana if a user sieve script points to non-existing mailboxes? Thanks for any hint. Greetings, C.

3 3

IMAP connection lost while sending mail
by Philipp Ewald 06 May '22

06 May '22

Hello, we have a strange problem. Costumer use Outlook to connect to our IMAP and SMTP Server. While sending Mails Outlooks reports connection lost. In Mail log there is no reason logged or something else. What i dont understand is that IMAP lose connetion while using SMTP. Outlloks reports problem by moving mails into Send dir. Is that a Outlook problem? i have enables debug logging and cant see any reason :( Network was already testet. any ideas? Kind regards Philipp -- Philipp Ewald Administrator DigiOnline GmbH, Probsteigasse 15 - 19, 50670 Köln Fax: +49 221 6500-690, E-Mail: philipp.ewald(a)digionline.de AG Köln HRB 27711, St.-Nr. 5215 5811 0640 Geschäftsführer: Werner Grafenhain Informationen zum Datenschutz: www.digionline.de/ds

3 4

disable attachments indexing
by Erik Colson 04 May '22

04 May '22

Hello, I am using fts-xapian with dovecot as fts indexer. It does work nicely but I would like to tell the indexer to *not* index the attachments. Can this be configured ? thanks -- erik colson

1 0

Authentication type for lan and haproxy (internet)
by Kees van Vloten 29 Apr '22

29 Apr '22

Hi Team, Would it be possible to setup a different authentication method depending on the connection source? I would like to use oauth2 (with mfa) for connections from internet via haproxy, whereas on the lan I run samba-dc and hence AD (krb5) is the method to use. The latter is already setup and works fine, now I want to add oauth2 for haproxy connections (or outside lan ip-range). Here's the relevant bit of "dovecot -n": auth_default_realm = EXAMPLE.COM auth_gssapi_hostname = mailserver.example.com auth_krb5_keytab = /etc/keytab/dovecot.keytab auth_master_user_separator = * auth_mechanisms = gssapi gss-spnego plain auth_realms = EXAMPLE.COM passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap pass = yes } passdb { driver = pam } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } - Kees.

1 0

director service tries to start without any configuration
by Eirik Rye 29 Apr '22

29 Apr '22

Hello, - Dovecot 2.3.18 (originally Dovecot 2.3.16, but upgraded in an attempt to fix issue) - Ubuntu 20.04 using Dovecot repo In my organization have run a cluster of dovecot proxy machines, with the director service enabled in a transition period as we have migrated all our users to do direct proxying to backend (e.g. `proxy=y, host=192.168.0.2`), bypassing the director service. Now that all users have been migrated, it is time to disable the director service. However, even after removing all director configuration ("doveconf -n | grep director" returns nothing) and restarting the entire dovecot service (not just "doveadm reload"), the error log still spits out these errors: 2022-04-29T11:27:25+0200 director: Error: Empty server list 2022-04-29T11:27:25+0200 director: Fatal: Invalid value for director_mail_servers setting 2022-04-29T11:27:25+0200 master: Error: service(director): command startup failed, throttling for 60.000 secs Why is this happening? It's not critical, and logins work fine without the director service running, but I'm trying to figure out why and stop the log noise. doveconf stuff: root@director03:~# doveconf -n | grep director # Hostname: director03 root@director03:~# doveconf -n # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.4.0-88-generic x86_64 Ubuntu 20.04.4 LTS # Hostname: director03 debug_log_path = /var/log/dovecot.log default_vsz_limit = 768 M disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 24245 event_exporter log { format = json format_args = time-rfc3339 transport = log } imap_id_retain = yes info_log_path = /var/log/dovecot.log lmtp_add_received_header = no lmtp_proxy = yes log_path = /var/log/dovecot.err log_timestamp = "%FT%T%z " login_greeting = %{hostname} ready. login_log_format_elements = user=<%u> orig=<%{orig_user}> method=%m proto=%s rip=%r lip=%l session=<%{session}> %c %k login_proxy_max_disconnect_delay = 10 secs login_trusted_networks = <redacted> mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext metric auth_passdb_request_finished { filter = event=auth_passdb_request_finished AND category=service:auth group_by = service passdb_name result } passdb { args = /etc/dovecot/dovecot-redis.conf.ext auth_verbose = yes driver = dict name = redis override_fields = proxy=y } protocols = imap pop3 lmtp sieve service doveadm { inet_listener http { port = 8080 } } service imap-login { client_limit = 2048 executable = imap-login inet_listener imap { address = port = 143 } inet_listener imaps { address = port = 993 ssl = yes } process_limit = 32 process_min_avail = 16 service_count = 0 vsz_limit = 1 G } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { client_limit = 1024 executable = managesieve-login inet_listener sieve { address = port = 4190 } process_limit = 2 process_min_avail = 1 service_count = 0 vsz_limit = 1 G } service pop3-login { client_limit = 2048 executable = pop3-login inet_listener pop3 { address = port = 110 } inet_listener pop3s { address = port = 995 ssl = yes } process_limit = 4 process_min_avail = 2 service_count = 0 vsz_limit = 1 G } service stats { client_limit = 65536 inet_listener http { port = 9900 } } ssl_cert = </etc/dovecot/wildcard.crt ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1 verbose_proctitle = yes protocol imap { mail_max_userip_connections = 25 } protocol pop { mail_max_userip_connections = 25 } local 127.0.0.0/8 { doveadm_password = # hidden, use -P to show it }

2 3

Informational messages written to ~/.dovecot.sieve.log
by Gedalya 29 Apr '22

29 Apr '22

Hi, After adding "vnd.dovecot.debug" to the require list at the top of a sieve script, informational messages started appearing in ~/.dovecot.sieve.log, even when debug_log was not used. The script looks like this: require ["fileinto","imap4flags","reject","duplicate","vnd.dovecot.debug"]; # rule:[Duplicate] if duplicate :header "X-dd-hash" :last { debug_log "Duplicate message, discarding"; discard; } [ .. more rules .. ] Log lines: sieve: info: started log at 2022-04-28 23:49:43 -0400. info: msgid=<xxxxxxxxx>: stored mail into mailbox 'INBOX'. (no rule matched) sieve: info: started log at 2022-04-29 00:51:40 -0400. info: msgid=<xxxxxxxxx>: fileinto action: stored mail into mailbox 'Alerts'. I would expect / prefer that the log would be used only when debug_log was used. With too many log messages, the interesting ones would get rotated out sooner than desired.

1 0

Can I set a different certificate per listen port?
by Kees van Vloten 28 Apr '22

28 Apr '22

Hi all, I am trying to setup dovecot to listen to imaps on the local network and through haproxy from the internet. service imap-login { inet_listener imaps { port = 993 ssl = yes } inet_listener imaps_haproxy { haproxy = yes port = 10993 ssl = yes } } Obviously the dns-name on the internet connection (10993) is different than on the lan (993). In the docs (https://doc.dovecot.org/configuration_manual/dovecot_ssl_configuration/) I found multiple options, but unfortunately none of those have the option to distinguish per listen port. Is there a way to setup two different certificates for the two listeners? - Kees

3 3

master user namespace error?
by Thomas Winterstein 26 Apr '22

26 Apr '22

Hello, I've set up a master user for migration purposes and doveadm auth tests succeed. If I test with telnet, the login as user also works and performs a user search on ldap but I get a namespace error: > Debug: ldap(testuser,1.2.3.4,<0o/OTasGHdfNCB>): Finished userdb lookup > Debug: master userdb out: USER#011911998977#011testuser#011uid=500#011gid=500#011nopassword=<hidden>#011proxy_maybe=yes#011master_user=admin#011auth_mech=PLAIN#011auth_token=b8c3dfdfcc9ac33cb1c2f1d755g8e04db58a7aa0#011auth_user=admin > imap-login: Login: user=<testuser>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=22569, TLS, session=<0o/OTasGHdfNCB> > Error: Namespace '': Mail storage autodetection failed with home=(not set) > Disconnected: Namespace '': Mail storage autodetection failed with home=(not set) in=0 out=417 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes Anything special to consider in a proxy setup? thank you Thomas

1 0

how to setup IMAPs with letsencrypt
by alice＠coakmail.com 26 Apr '22

26 Apr '22

hello I have setup website using letsencrypt for certification. how can I setup IMAP to use this certs as well? Thank you.

10 20

Heads-up: Exim 4.96 RC0 may break your Dovecot LDA delivery
by Kirill Miazine 25 Apr '22

25 Apr '22

Hi, all The just released RC0 for Exim 4.96 will break Dovecot LDA delivery as described on https://wiki.dovecot.org/LDA/Exim Here is the relevant ChangeLog entry: JH/25 Taint-check exec arguments for transport-initiated external processes. Previously, tainted values could be used. This affects "pipe", "lmtp" and "queryprogram" transport, transport-filter, and ETRN commands. The ${run} expansion is also affected: in "preexpand" mode no part of the command line may be tainted, in default mode the executable name may not be tainted. As of now I don't have a personal working solution to get untained data. I did try a small hack, but Exim was smart enough to see what I was doing. -- -- Kirill Miazine <km(a)krot.org>

2 3

doveadm pw usage
by ミユナ (alice) 25 Apr '22

25 Apr '22

Hello when i want to assign a password to a user, I need to write the plain passwd to a text file then do: # doveadm pw -p input.txt {CRAM-MD5}77180880... it's not that convenient to write to a file first. does it support the format below? doveadm pw "plain password" providing the plain password as CL argument to generate a encrypted one. thank you ミユナ alice

5 6

auth between postfix and dovecot?
by ミユナ (alice) 25 Apr '22

25 Apr '22

hello experts, I have installed postfix and dovecot in the same machine. Their configure looks as: service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { mode = 0600 user = postfix group = postfix } unix_listener /var/spool/postfix/private/auth { mode = 0666 user = postfix group = postfix } auth_mechanisms = plain login !include auth-passwdfile.conf.ext my question is: when postfix talks to dovecot, does it require user's username/password for authentication? or this communication just goes without authentication? I asked this, b/c my webmail send mail from localhost has been going without authentication to postifx. so i am not sure if postfix talks to dovecot without requiring auth too. Thanks alice

4 6

Weird status... " noselect"... why ?
by Stephane Magnier 23 Apr '22

23 Apr '22

a list "" * gives me this * LIST (\HasChildren \UnMarked) "/" INBOX/2022-PERSONNEL/FOO2 * LIST (\HasNoChildren \UnMarked) "/" INBOX/2022-PERSONNEL/FOO2/test * LIST (\Noselect \HasChildren) "/" INBOX/2022-PERSONNEL/FOO2/test * LIST(\Noselect \HasNoChildren) "/" INBOX/2022-PERSONNEL/FOO2/test/Location As you can see there is " noselect " and with Thunderbird this is in grey.. Due to a bad manipulation. I wanted to create a subfolder and I wrote "FOO2/test" when FOO2 didn't exist yet Now " test" is grey and I cannot place anything inside.. I didn't see this at first sight and I've placed important emails in it, that it didin't synch... and which which seems to be lost :-( a Repair didn't work out How can I " revalidate " this folder ? without removing it ? ( hoping to get something in it ) Thanks

2 1

replication fails with "Error: sync: Unknown user in remote" but user shows up in doveadm user "*"
by Arnaud Abélard 22 Apr '22

22 Apr '22

Hello, I've been trying to replicate a production server (debian buster, dovecot 2.3.4.1). But I nothing is actually being replicated and for each attempted user the message "Error: sync: Unknown user in remote" is being logged. The ldap settings are actually the same on both server (source and destnation) and the "unknown user" is actually showing up in doveadm user "*" on the destination server. I had already replicated 2 servers and used the same settings. Am I missing something obvious here? Thanks, Arnaud -- Arnaud Abélard Responsable pôle Système et Stockage Service Infrastructures DSIN Université de Nantes -

2 2

disabling namespace in special-userdb on dovecot 2.2
by Marc 21 Apr '22

21 Apr '22

Currently I have such special-userdb file test:x:11111:22222:testaccount_descr:/home/users/testaccount:/bin/false:userdb_mail=mbox:~/mbox:INBOX=/home/users/testaccount/inbox:INDEX=/home/users/testaccount/index However I am still getting errors of a default configured namespace that still seems to be active. Is there a way to disable this namespace or reconfigure this in the userdb file? (When I was testing this on a dovecot 2.3 I did not run into this)

2 2

Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox
by Turritopsis Dohrnii Teo En Ming 20 Apr '22

20 Apr '22

Subject: Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200,000 emails in my Inbox Good day from Singapore, I am using Virtualmin/Webmin web hosting control panel in my Virtual Private Servers (VPS) in Germany. [1st issue] =========== Both Roundcube and Squirrelmail webmail cannot search for anything because there are more than 200,000 emails in my Inbox. Roundcube webmail doesn't show any error. Search results simply don't show up after a long time. However, I got the following error in Squirrelmail webmail (using Firefox web browser). ERROR: Connection dropped by IMAP server. Query: SEARCH CHARSET ISO-8859-1 ALL SUBJECT "keyword" [2nd issue] ============ Both Roundcube and Squirrelmail webmail cannot open many emails because there are more than 200,000 emails in my inbox. Roundcube webmail gives the following error: SERVER ERROR! Could not load message from server. Squirrelmail webmail gives the following error: ERROR: Connection dropped by IMAP server. Query: FETCH 1 BODY[HEADER] My IMAP server is Dovecot version 2.2.36. Virtualmin version is 6.17. Webmin version is 1.990. Usermin version is 1.834. Authentic theme version is 19.85.1. However, using Samsung Email app on my Samsung Galaxy A32 5G Android phone, I am able to open emails it seems. Only Roundcube and Squirrelmail webmail appears to have issues opening emails. Using Samsung Email app, I have deleted around 6,000 useless emails so far but still unable to search and open emails. Looks like I need to delete more and more useless emails. How do I solve the above problems? I am looking forward to your reply. Thank you very much. Mr. Turritopsis Dohrnii Teo En Ming, 44 years old as of 17 April 2022 Sunday, is a TARGETED INDIVIDUAL living in Singapore. He is an IT Consultant with a Systems Integrator (SI)/computer firm in Singapore. He is an IT enthusiast. -----BEGIN EMAIL SIGNATURE----- The Gospel for all Targeted Individuals (TIs): [The New York Times] Microwave Weapons Are Prime Suspect in Ills of U.S. Embassy Workers Link: https://www.nytimes.com/2018/09/01/science/sonic-attack-cuba-microwave.html ******************************************************************************************** Singaporean Targeted Individual Mr. Turritopsis Dohrnii Teo En Ming's Academic Qualifications as at 14 Feb 2019 and refugee seeking attempts at the United Nations Refugee Agency Bangkok (21 Mar 2017), in Taiwan (5 Aug 2019) and Australia (25 Dec 2019 to 9 Jan 2020): [1] https://tdtemcerts.wordpress.com/ [2] https://tdtemcerts.blogspot.sg/ [3] https://www.scribd.com/user/270125049/Teo-En-Ming -----END EMAIL SIGNATURE-----

8 33

RE: Bad Signature - Both Roundcube and Squirrelmail webmail cannot search fos r anything + cannot open many emails because there are more than 200, 000 emails in my Inbox
by Tuomi, Aki 20 Apr '22

20 Apr '22

xxzfzzxxxzZSent from my Galaxys fcccc -------- Original message --------From: Turritopsis Dohrnii Teo En Ming <ceo.teo.en.ming(a)gmail.com> Date: 20/04/2022 16.51 (GMT+02:00) To: Shawn Heisey <elyograg(a)elyograg.org> Cc: ceo(a)teo-en-ming-corp.com, Dovecot <dovecot(a)dovecot.org> Subject: Re: Bad Signature - Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox I believe Gmail is using IMAP. The instructions for configuring Gmailemail accounts in Outlook specifically mention IMAP server hostname:imap.gmail.comTCP Port 993, SSLRegards,Mr. Turritopsis Dohrnii Teo En MingTargeted Individual in Singapore20 Apr 2022 WednesdayOn Wed, 20 Apr 2022 at 09:26, Shawn Heisey <elyograg(a)elyograg.org> wrote:>> On 4/19/2022 5:12 PM, Turritopsis Dohrnii Teo En Ming wrote:> > It is not true that no email system was ever designed for 200,000 or> > more emails.> >> > If I did not remember wrongly, more than 10 years ago, I used to have> > a Gmail email account, with 4-5 MILLION email messages in the Inbox.> > There was no problem searching even though I had 4-5 MILLION email> > messages in the Inbox.>> If you were using either a Google app or the gmail.com website to access> that inbox, then it doesn't compare. I really doubt that either of> those uses the IMAP protocol. They would be using something proprietary> that is highly optimized for the way that Google stores data and> leverages the enormous amounts of computing power that they maintain.>> I would bet that if you accessed a gmail folder with 5 million messages> in it using IMAP, you would have similar problems with it to those that> have been described here in this thread. IMAP is a beautiful protocol,> but I don't think it was designed for handling that many messages.>> Thanks,> Shawn>

1 0

temporary block incoming messages to specific user
by Marc 20 Apr '22

20 Apr '22

Is it possible to block incoming messages from being delivered to a specific user in such a way that the MTA will try again later. I do not want these message to bounce. (eg while doing some manual maintenance on the user)?

3 2

JMAP Support Status
by David Klingenberg 15 Apr '22

15 Apr '22

Hello, has there been any development on JMAP support in Dovecot? Also, I have noticed you planned to do some generic optimizations which could possibly make it easier to implement JMAP. What is status on that? https://dovecot.org/pipermail/dovecot/2021-March/121620.html Best Regards, David Klingenberg

4 5

NFS Config vs Ceph / GlusterFS
by dovecot＠ptld.com 15 Apr '22

15 Apr '22

Do all of the configuration considerations pertaining to using NFS on https://doc.dovecot.org/configuration_manual/nfs/ equally apply to using something like Ceph / GlusterFS? And if people wouldn't mind chiming in with which (NFS, Ceph & GlusterFS) they feel is better for maildir mail storage on dedicated non-container servers? Which is better for robustness / stability? Which is better for speed / performance? Thank you.

4 4

how to change the name of the dovecot pam file being used?
by Marc 15 Apr '22

15 Apr '22

Is there a way to configure the name of the pam file?

2 1

ssl_min_protocol appears to be ignored?
by Myriam Luce 14 Apr '22

14 Apr '22

Hi, I'm trying to enable TLS1.0 support for an old client. Per dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.0-107-generic x86_64 Ubuntu 20.04.4 LTS ext4 # Hostname: In 10-ssl.conf, I have set ssl_min_protocol = TLSv1 (It doesn't show in dovecot -n, I suspect because it's equal to default value?) I restarted dovecot with systemctl. Then, from another machine, openssl s_client -connect zeserver.com:993 -tls1 fails with this output: CONNECTED(00000003) 140166917489984:error:141E70BF:SSL routines:tls_construct_client_hello:no protocols available:../ssl/statem/statem_clnt.c:1112: --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 7 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- The same command with -tls1_2 works as intended (certificate printing, imap prompt). Am I forgetting something somewhere, or is this an actual bug?

3 2

Re: Dovecot and OAuth2 and gmail
by Richard 14 Apr '22

14 Apr '22

> Date: Wednesday, April 13, 2022 17:10:36 -0400 > From: Steve Litt <slitt(a)troubleshooters.com> > > Hi all, > > I'm not sure Dovecot has anything to do with this, but I'd rather > ask and know for sure. > > I do the following: > > Gmail IMAP=>fetchmail=>procmail=>Dovecot IMAP > > Then, I view my Dovecot hosted email with Claws-Mail. > > I understand that on May 31, 2022, current methods to access Gmail > IMAP will turn into pumpkins because of insistence on OAuth2. Do I > need to do anything to Dovecot to get ready for this Mass > Extinction Event? > > Do you think I'll need to dump fetchmail for something else? > While it's a little obtuse, a reading of: <https://support.google.com/accounts/answer/6010255#zippy=%2Cif-less-secure-…> specifically the "fix problems" / "use an app password" section, would seem to indicate that app passwords will continue to work for gmail access after May 30. What google is turning off is "third-party apps or devices which ask you to sign in to your Google Account using only your username and password", i.e., using your google login password with "less secure" 3rd party apps. So, you need to set up, and configure your application to use, app passwords.

2 1

Dovecot and OAuth2 and gmail
by Steve Litt 13 Apr '22

13 Apr '22

Hi all, I'm not sure Dovecot has anything to do with this, but I'd rather ask and know for sure. I do the following: Gmail IMAP=>fetchmail=>procmail=>Dovecot IMAP Then, I view my Dovecot hosted email with Claws-Mail. I understand that on May 31, 2022, current methods to access Gmail IMAP will turn into pumpkins because of insistence on OAuth2. Do I need to do anything to Dovecot to get ready for this Mass Extinction Event? Do you think I'll need to dump fetchmail for something else? Thanks, SteveT Steve Litt March 2022 featured book: Making Mental Models: Advanced Edition http://www.troubleshooters.com/mmm

1 0

Permissions and ownership on /dev/shm/dovecot
by doug 12 Apr '22

12 Apr '22

Hi, Environment: Dovecot 2.3.18 running on CentOS 7, mdbox, LDAP users I'm in the process of moving my mailboxes to NFS and moving with lock and index files in temp storage following instructions from https://doc.dovecot.org/configuration_manual/nfs. I set mail_location as: mail_location = mdbox:/mailstore/%u/mail:VOLATILEDIR=/dev/shm/dovecot/%u:LISTINDEX=/dev/shm/dovecot/%u/dovecot.list.index What I discovered is /dev/shm/dovecot is created by the initial user who accesses their mail from a client, and with permissions 700. This prevents subsequent users from creating their own index and lock files. # ls -l /dev/shm/dovecot total 0 drwx------ 2 mary users 60 Mar 25 10:00 mary Sample error message from maillog during mail delivery and from a dsync script. Mar 25 10:37:15 mailsrv1 dovecot: imap(doug)<19284><WKcX5gvbRe7AqFhA>: Error: mkdir(/dev/shm/dovecot/doug) failed: Permission denied (euid=1002(doug) egid=100(users) missing +x perm: /dev/shm/dovecot, dir owned by 97:100 mode=0700) dsync(test): Error: mkdir(/dev/shm/dovecot/test) failed: Permission denied (euid=2003(test) egid=100(users) missing +x perm: /dev/shm/dovecot, dir owned by 97:100 mode=0700) I couldn't locate documentation or discussions on how to set the ownership or permissions for /dev/shm/dovecot in the Dovecot configuration files. As a hack, I added this to /usr/libexec/dovecot/prestartscript. ! [[ -d /dev/shm/dovecot ]] && mkdir /dev/shm/dovecot chown dovecot:users /dev/shm/dovecot chmod 770 /dev/shm/dovecot This solved the problem, but left me wondering if I missed something obvious or if I am setting myself up for a problem later on, like with a Dovecot version upgrade. I could run these commands at bootup out of rc.local or a systemd script rather than customizing a Dovecot provided script. Is there a appropriate way of doing this that I missed? TIA, Doug

3 6

Re: Permissions and ownership on /dev/shm/dovecot
by doug 11 Apr '22

11 Apr '22

1 0

Set up per user sieve rules
by Austin Witmer 11 Apr '22

11 Apr '22

Hello! I am struggling to wrap my mind around how to set up sieve rules for my individual users on my mail server. I set up a global sieve script file at "/var/lib/dovecot/sieve/default.sieve” and that works great. My users maildirs are located at /mnt/volume1/mailserver/maildir/user. Do I need to create a sieve script file inside of that folder for sieve scripts to work on an individual basis? If so, what permissions will that script file need? Thanks in advance for your help! Austin Witmer

4 9

Dovecot 2.3.13 virtual mailboxes subscription problem
by Slavko 10 Apr '22

10 Apr '22

Hi, by discussion on IRC channel is post details here. I am using virtual plugin in dovecot 2.3.13 and i have porblems with subsription to these virtual mailboxes. I can setup autosubscribe to them and it works as expected. I can SUBSCRIBE to them, dovecot returns OK and they are added in subscriptions file, but then they are not shown in LSUB output. I can UNSUBSCRIBE from subscribed virtual mailbox (dovecot returns OK), but it is not removed from subscriptions file and remains there... I bother with this for long time. I tried to setup mailboxes without UTF-8 chars, but that doesn't matter nad currently problematic mailbox has not any nonASCII char (Virtual.Dnes). I tried to define mailboxes in parent namespace too, doesn't help, nor defining only Virtual in parent namespace (with and without separator at end). Some evidence follows. The (my) subscriptions file (the Virtual.Dnes is at end): --------------------------------------------------------- V 2 <snip> Virtual Dnes --------------------------------------------------------- IMAP LIST (only Virtual namespace), as shown by dovecot's imap command: --------------------------------------------------------- * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY METADATA SPECIAL-USE QUOTA ACL RIGHTS=texk] Logged in as slavko(a)slavino.sk <snip> * LIST (\Noselect \HasChildren) "." Virtual * LIST (\HasNoChildren) "." Virtual.Dnes * LIST (\HasNoChildren) "." Virtual.D&APQ-le&AX4-it&AOk- * LIST (\HasNoChildren) "." Virtual.Pr&AO0-lohy * LIST (\Noselect \HasChildren) "." Verejn&AOk- * LIST (\HasNoChildren \UnMarked) "." Verejn&AOk-.Novinky . OK List completed (0.004 + 0.000 + 0.003 secs). --------------------------------------------------------- One can see that there are three virtual mailboxes, the Virtual.Dnes, the Virtual.Dôležité (encoded) and the Virtual.Prílohy (encoded too), including Virtual namespace. IMAP LSUB output (again only Virtual namespace): --------------------------------------------------------- * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY METADATA SPECIAL-USE QUOTA ACL RIGHTS=texk] Logged in as slavko(a)slavino.sk <snip> * LSUB () "." Virtual.D&APQ-le&AX4-it&AOk- * LSUB () "." Virtual.Pr&AO0-lohy a OK Lsub completed (0.001 + 0.000 secs). --------------------------------------------------------- As one can see, there are only auto-subscribed Virtual mailboxes, the Virtual.Dnes is missing, despite that it is in subscriptions file. The doveconf -n output (can be wrapped): --------------------------------------------------------- # 2.3.13 (89f716dc2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 4.19.0-20-amd64 x86_64 Debian 10.12 # Hostname: servac.skk auth_default_realm = slavino.sk auth_mechanisms = plain login auth_policy_check_after_auth = no auth_policy_hash_nonce = # hidden, use -P to show it auth_policy_server_timeout_msecs = 5500 auth_policy_server_url = http://127.0.0.1:9090/ auth_verbose = yes first_valid_uid = 130 imap_idle_notify_interval = 15 mins imap_logout_format = in=%i out=%o deleted=%{deleted} expunged=%{expunged} trashed=%{trashed} hdr_count=%{fetch_hdr_count} hdr_bytes=%{fetch_hdr_bytes} body_count=%{fetch_body_count} body_bytes=%{fetch_body_bytes} autoexp=%{autoexpunged} last_valid_uid = 130 lda_original_recipient_header = Envelope-to lmtp_add_received_header = no lmtp_hdr_delivery_address = none lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes login_trusted_networks = 127.0.0.1 ::1 mail_attachment_detection_options = add-flags no-flags-on-fetch exclude-inlined content-type=!application/*-signature content-type=!application/pgp-keys mail_attribute_dict = file:%h/dovecot-attributes mail_home = /srv/vmail/%Ln mail_location = maildir:~/Maildir mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone" mail_privileged_group = mail mail_server_admin = mailto:postmaster@slavino.sk mail_vsize_bg_after_count = 100 mailbox_list_index_very_dirty_syncs = yes maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.report imapsieve vnd.dovecot.imapsieve metric imap_cmd { fields = bytes_in bytes_out filter = event=imap_command_finished } metric imap_cmdbad { filter = event=imap_command_finished AND tagged_reply_state=BAD } metric imap_cmdno { filter = event=imap_command_finished AND tagged_reply_state=NO } metric imap_cmdok { filter = event=imap_command_finished AND tagged_reply_state=OK } metric mail_deliv { fields = message_size filter = event=mail_delivery_finished } metric push_notif { filter = event=push_notification_finished } metric sieve_actions { filter = event=sieve_action_finished } metric sieve_scrrun { filter = event=sieve_runtime_script_finished } namespace Virtual { list = yes location = virtual:/usr/local/etc/vmail/virtual:INDEX=~/virtual:UTF-8 mailbox Dôležité { auto = subscribe } mailbox Dnes { auto = no } mailbox Prílohy { auto = subscribe } prefix = Virtual. separator = . subscriptions = no } namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Verejné.Novinky { auto = subscribe } prefix = separator = . } namespace pub { ignore_on_failure = yes location = maildir:/srv/vmail-public:INDEXPVT=~/public:UTF-8 prefix = Verejné. separator = . subscriptions = no type = public } namespace share { list = children location = maildir:%%h/Maildir:INDEXPVT=~/shared/%%u prefix = Zdieľané.%%u. separator = . subscriptions = no type = shared } passdb { args = username_format=%Ln /usr/local/etc/vmail/passwd.%{if;%Ls;eq;smtp;%Ls;empty} auth_verbose = no driver = passwd-file } passdb { args = username_format=%Ln scheme=ssha256 /usr/local/etc/vmail/passwd driver = passwd-file } plugin { acl = vfile:/etc/dovecot/dovecot-acl acl_shared_dict = file:/usr/local/etc/vmail/shared/shared-mailboxes.db fts = xapian fts_autoindex = yes fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_autoindex_exclude3 = \Drafts fts_autoindex_exclude4 = Junk fts_autoindex_exclude5 = Trash fts_autoindex_exclude6 = Drafts fts_autoindex_exclude7 = Sent fts_autoindex_exclude8 = Verejné.* fts_autoindex_exclude9 = Virtual.* fts_autoindex_max_recent_msgs = 99 fts_decoder = decode2text fts_enforced = yes fts_index_timeout = 90s fts_xapian = partial=2 full=20 attachments=1 verbose=0 imapsieve_mailbox1_before = file:/usr/local/etc/vmail/sieve/imap/trash-seen.sieve imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_name = Trash imapsieve_mailbox2_before = file:/usr/local/etc/vmail/sieve/imap/report-spam.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_name = Junk imapsieve_mailbox3_before = file:/usr/local/etc/vmail/sieve/imap/report-ham.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_from = Junk imapsieve_mailbox3_name = * mail_log_cached_only = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = redis:host=127.0.0.1:port=6379:prefix=dovec/:expire_secs=2592000 quota_exceeded_message = Mailbox is full quota_grace = 50M quota_max_mail_size = 50M quota_rule = *:storage=3G quota_rule2 = Trash:storage=+50M quota_rule3 = Junk:storage=+100M quota_rule4 = Sent:storage=+100M quota_vsizes = true sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /usr/local/etc/vmail/sieve/before.d/spam-move.sieve sieve_global_extensions = +vnd.dovecot.filter +vnd.dovecot.execute sieve_implicit_extensions = +vnd.dovecot.report sieve_max_redirects = 0 sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve pop3" quota_full_tempfail = yes service anvil { unix_listener anvil { group = $default_internal_group mode = 0660 } } service auth { unix_listener auth-client { mode = 0666 } } service decode2text { executable = script /usr/lib/dovecot/decode2text.sh unix_listener decode2text { group = vmail mode = 0660 } user = vmail } service imap-login { inet_listener imap { address = 127.0.0.1 ::1 } process_min_avail = 2 service_count = 100 unix_listener imap { group = www-data mode = 0660 } } service indexer-worker { vsz_limit = 2 G } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } unix_listener lmtp { group = Debian-exim mode = 0660 } user = vmail } service managesieve-login { service_count = 100 vsz_limit = 64 M } service managesieve { process_limit = 256 } service pop3-login { inet_listener pop3 { port = 0 } service_count = 100 } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener quota-status { group = Debian-exim mode = 0660 } } service stats { unix_listener stats-reader { group = $default_internal_group mode = 0660 } } ssl_cert = </etc/letsencrypt/live/slavino.sk/fullchain.pem ssl_cipher_list = HIGH:!kRSA:!SRP:!PSK:!DH:!eNULL:!aNULL:!SHA1:!CAMELLIA:+AESGCM:+AES256:+SHA256:+SHA384:+AES128:+AES256 ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes submission_host = 127.0.0.1:25 userdb { args = username_format=%Ln /usr/local/etc/vmail/passwd default_fields = uid=vmail gid=vmail driver = passwd-file } verbose_proctitle = yes protocol lmtp { info_log_path = /var/log/dovecot/lmtp.log log_path = /var/log/dovecot/lmtp-errors.log mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone push_notification sieve" } protocol imap { imap_metadata = yes mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone imap_quota imap_sieve imap_acl" namespace inbox { location = mailbox Drafts { autoexpunge = 4 weeks } mailbox Junk { autoexpunge = 2 weeks } mailbox Sent { autoexpunge = 60 days } mailbox Trash { autoexpunge = 4 weeks autoexpunge_max_mails = 1000 } prefix = } } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } protocol pop3 { mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone" } local_name servac.slavino.org { ssl_cert = </etc/letsencrypt/live/slavino.org/fullchain.pem ssl_key = # hidden, use -P to show it } local_name servac.skk { ssl_cert = </etc/dovecot/private/servac.pem ssl_key = # hidden, use -P to show it } --------------------------------------------------------- If you need something more, be free to contact me... regards -- Slavko https://www.slavino.sk

2 1

What is the current state of High Availability Dovecot ?
by White, Daniel E. (GSFC-770.0)[NICS] 10 Apr '22

10 Apr '22

… without going to too much fuss ? Searching the Internet produces a lot of old results and many overly complicated results. My only complication is that I am using PostfixAdmin for mailbox management, and all the mailboxes are virtual. Thanks.

2 1

Postfix - Dovecot alias
by John Doe 09 Apr '22

09 Apr '22

Hello, I have the problem with aliases. The emails did not delivery to correct email. I send email to email: to_alias(a)domain.com that is valid alias and email should be sent to real email folder: to(a)domain.com. Dovecot creating to_alias folder and deliver the emails there. Here is the email log: / did not see to(a)domain.com below / Apr 5 18:54:40 www postfix/smtpd[30547]: connect from mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:40 www postfix/smtpd[30547]: Anonymous TLS connection established from mail-40137.protonmail.ch[185.70.40.137]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384 Apr 5 18:54:52 www postfix/smtpd[30547]: 85A412E19B6: client= mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:52 www postfix/cleanup[30556]: 85A412E19B6: message-id=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com> Apr 5 18:54:53 www dccifd[1856]: stat(log directory "log"): No such file or directory Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: from=< from(a)protonmail.com>, size=2767, nrcpt=1 (queue active) Apr 5 18:54:57 www postfix/smtpd[30547]: disconnect from mail-40137.protonmail.ch[185.70.40.137] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Apr 5 18:54:57 www dovecot: lmtp(30559): Connect from local Apr 5 18:54:57 www dovecot: lmtp(compiz(a)domain.com)<30559><U8KALFFmTGJfdwAA8oMCvw>: sieve: msgid=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com>: stored mail into mailbox 'INBOX' Apr 5 18:54:57 www postfix/lmtp[30558]: 85A412E19B6: to=< to_alias(a)domain.com>, relay=mail.domain.com[private/dovecot-lmtp], delay=17, delays=17/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 < to_alias(a)domain.com> U8KALFFmTGJfdwAA8oMCvw Saved) Apr 5 18:54:57 www dovecot: lmtp(30559): Disconnect from local: Logged out (state=READY) Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: removed I was playing with password_query but not sure did I'm on right direction. password_query = \ SELECT username AS user, password, \ '/var/spool/postmail/%d/%n' AS userdb_home, 1002 AS userdb_uid, 1001 AS userdb_gid \ FROM mailbox WHERE username = (SELECT goto FROM alias WHERE address = '%u') I'm using dovecot --version: 2.3.18 (9dd8408c18) and my configuration is: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.17.0 x86_64 Slackware 15.0+ ext4 # Hostname: www.ixip.net base_dir = /var/run/dovecot/ default_login_user = nobody dict { driver = sql quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:/var/spool/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/spool/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/spool/postmail/%d/%n/sieve/ sieve_global_dir = /var/lib/dovecot/sieve sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = 127.0.0.1 port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/postfix/ssl/mail.stzbg.com.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=1002 gid=1001 home=/var/spool/postmail/%d/%n allow_all_users=yes driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } # grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=postfix password=password default_pass_scheme = CRYPT password_query = SELECT username AS user, password FROM mailbox WHERE username = '%u'; Kind Regards, Chris

3 4

Auth by ip address
by Vlastimil Wagner 09 Apr '22

09 Apr '22

Hi is possible authentication by ip address in dovecot? What i need. Now auth is by PAM (Active directory), i want application password (its plugin to Roundcube, passwords in mysql) for example android email client. I know that Multiple Authentication Databases work but i want when user auth from public network use sql and when from internal network use both sql and then pam. thanks for help Bukowski

3 2

Unable to write *.sieve files while Dovecot is running
by Ralph Seichter 08 Apr '22

08 Apr '22

I noticed lately that I can no longer modify *.sieve files while Dovecot is running. Write operations appear not to be permitted anymore: $ echo >> example.sieve zsh: permission denied: example.sieve Text editors like vim cannot write either. Since I used to be able to modify Sieve source files on the fly, I am wondering if the behaviour I see nowadays is intentional? Doveconf reports the following versions: # 2.3.14.1 (9f0cfb6426): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.14 (1b5c82b2) # OS: Linux 5.17.1-gentoo-r1-x86_64 x86_64 Gentoo Base System release 2.7 -Ralph

5 5

Problem with initial sync on new mailbox in a replicated setup
by ppq＠tuta.io 07 Apr '22

07 Apr '22

Hello, I run a two-node replicated setup with director + dovecot and replication between the two nodes. The setup is a couple of years old and has been working properly until recently, so I suspect some type of regression. I'm having an issue with replication and merging of newly created mailboxes. Old mailboxes work properly. When creating a new mailbox, the two nodes will not replicate and sync the new mailbox. I have to manually "merge" the mailbox via a "doveadm sync -1f..." command, after which all works properly. This has not been the case in the past, so I'm trying to debug the issue. When syncing manually, I get the following error: ----------------------------- # doveadm -v sync -df -u 'testaccount(a)mydomain.ext' doveadm(testaccount(a)mydomain.ext)<38041><wl3tAQ5LTWKZlAAAxdOQ8Q>: Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 6bfcbb2f92484d624b890000c5d390f1 (maybe it was just deleted?) ---------------------------- I have to sync once with a one-way merge using sync -1f and after the sync works properly. My setup is running Dovecot CE 2:2.3.18-4+debian11 from the dovecot.org repository installed on debian bullseye. The replicaiton is dove via TCP plaintext connection. Below I'm attaching some debug logs, for both sync -1f and sync -f. Is this a normal behavior or is this a bug ? Kind regards, Dave ---- CUT ---- # doveadm -v sync -df -u 'testaccount(a)mydomain.ext' Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:12:17 Debug: Loading modules from directory: /usr/lib/dovecot/modules 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so 2022-04-06 10:12:17 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Started passdb lookup 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Client connected (fd=9) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): auth PASS input: user=testaccount(a)mydomain.ext 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Finished passdb lookup (user=testaccount(a)mydomain.ext ) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Started userdb lookup 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): auth USER input: testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Finished userdb lookup (username=testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve>) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: Added userdb setting: mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: Added userdb setting: plugin/quota_rule=*:storage=0B 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: Added userdb setting: plugin/sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Effective uid=5000, gid=5000, home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota root: name=user backend=dict args=:file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=* bytes=0 messages=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=EXPUNGED ignored 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota grace: root=user bytes=0 (10%) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: quota-dict: user=testaccount(a)mydomain.ext, uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, noenforcing=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): dict created (uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, base_dir=/var/run/dovecot) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: maildir++: root=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, index=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/idx>, indexpvt=, control=, inbox=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, alt= 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot.acl 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: acl username = testaccount(a)mydomain.ext 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: owner = 1 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot.acl 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: brain M: Namespace has location maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'INBOX' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/dovecot-acl <http://mydomain.ext/testaccount/Maildir/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox '' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Trash' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Sent' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Junk' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Drafts' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Namespace : Using permissions from /var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>: mode=0700 gid=default 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: INBOX guid=08b6a62792484d624b890000c5d390f1 uid_validity=1649232018 uid_next=2 subs=no last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Drafts guid=6bfcbb2f92484d624b890000c5d390f1 uid_validity=1649232022 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Junk guid=6afcbb2f92484d624b890000c5d390f1 uid_validity=1649232021 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Sent guid=69fcbb2f92484d624b890000c5d390f1 uid_validity=1649232020 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Trash guid=68fcbb2f92484d624b890000c5d390f1 uid_validity=1649232019 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: INBOX guid=4d70ba2389484d628fa91300660b22f9 uid_validity=1649232013 uid_next=1 subs=no last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Junk guid=4c70ba2389484d628fa91300660b22f9 uid_validity=1649232012 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Drafts guid=4b70ba2389484d628fa91300660b22f9 uid_validity=1649232011 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Sent guid=4a70ba2389484d628fa91300660b22f9 uid_validity=1649232010 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Trash guid=4970ba2389484d628fa91300660b22f9 uid_validity=1649232009 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Drafts: local=6bfcbb2f92484d624b890000c5d390f1/0/1, remote=4b70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox INBOX: local=08b6a62792484d624b890000c5d390f1/0/1, remote=4d70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Junk: local=6afcbb2f92484d624b890000c5d390f1/0/1, remote=4c70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Sent: local=69fcbb2f92484d624b890000c5d390f1/0/1, remote=4a70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Trash: local=68fcbb2f92484d624b890000c5d390f1/0/1, remote=4970ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Drafts/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Drafts/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.INBOX/dovecot.index.log <http://mydomain.ext/testaccount/idx/.INBOX/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Junk/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Junk/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Sent/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Sent/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Trash/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Trash/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4b70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4d70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4c70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4a70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4970ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 4b70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): dict destroyed 2022-04-06 10:12:17 doveadm(38324): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Disconnected: Connection closed (fd=9) ------------------------- CUT ------------------------------------- Here's the sync with merge: ------------------- CUT ---------------------------------- # doveadm -v sync -1df -u 'testaccount(a)mydomain.ext' Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:13:25 Debug: Loading modules from directory: /usr/lib/dovecot/modules 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so 2022-04-06 10:13:25 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Started passdb lookup 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Client connected (fd=9) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): auth PASS input: user=testaccount(a)mydomain.ext 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Finished passdb lookup (user=testaccount(a)mydomain.ext ) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Started userdb lookup 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): auth USER input: testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Finished userdb lookup (username=testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve>) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: Added userdb setting: mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: Added userdb setting: plugin/quota_rule=*:storage=0B 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: Added userdb setting: plugin/sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Effective uid=5000, gid=5000, home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota root: name=user backend=dict args=:file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=* bytes=0 messages=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=EXPUNGED ignored 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota grace: root=user bytes=0 (10%) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: quota-dict: user=testaccount(a)mydomain.ext, uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, noenforcing=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): dict created (uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, base_dir=/var/run/dovecot) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: maildir++: root=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, index=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/idx>, indexpvt=, control=, inbox=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, alt= 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot.acl 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: acl username = testaccount(a)mydomain.ext 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: owner = 1 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot.acl 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: brain M: Namespace has location maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'INBOX' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/dovecot-acl <http://mydomain.ext/testaccount/Maildir/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox '' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Trash' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Sent' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Junk' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Drafts' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Namespace : Using permissions from /var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>: mode=0700 gid=default 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: INBOX guid=4d70ba2389484d628fa91300660b22f9 uid_validity=1649232013 uid_next=2 subs=no last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Drafts guid=4b70ba2389484d628fa91300660b22f9 uid_validity=1649232011 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Junk guid=4c70ba2389484d628fa91300660b22f9 uid_validity=1649232012 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Sent guid=4a70ba2389484d628fa91300660b22f9 uid_validity=1649232010 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Trash guid=4970ba2389484d628fa91300660b22f9 uid_validity=1649232009 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: INBOX guid=08b6a62792484d624b890000c5d390f1 uid_validity=1649232018 uid_next=1 subs=no last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Junk guid=6afcbb2f92484d624b890000c5d390f1 uid_validity=1649232021 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Drafts guid=6bfcbb2f92484d624b890000c5d390f1 uid_validity=1649232022 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Sent guid=69fcbb2f92484d624b890000c5d390f1 uid_validity=1649232020 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Trash guid=68fcbb2f92484d624b890000c5d390f1 uid_validity=1649232019 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Drafts: local=4b70ba2389484d628fa91300660b22f9/0/1, remote=6bfcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox INBOX: local=4d70ba2389484d628fa91300660b22f9/0/1, remote=08b6a62792484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Junk: local=4c70ba2389484d628fa91300660b22f9/0/1, remote=6afcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Sent: local=4a70ba2389484d628fa91300660b22f9/0/1, remote=69fcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Trash: local=4970ba2389484d628fa91300660b22f9/0/1, remote=68fcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Drafts' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: doveadm-sieve: Iterating Sieve mailbox attributes 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: Pigeonhole version 0.5.18 (0bc28b32) initializing 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Performing auto-detection 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Use home (/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount>) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Using active Sieve script path: /var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Using script storage path: /var/vmail/mydomain.ext/testaccount/sieve <http://mydomain.ext/testaccount/sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Using permissions from /var/vmail/mydomain.ext/testaccount/sieve <http://mydomain.ext/testaccount/sieve>: mode=0700 gid=-1 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Created storage directory /var/vmail/mydomain.ext/testaccount/sieve/tmp <http://mydomain.ext/testaccount/sieve/tmp> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: sync: Synchronization active 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'INBOX' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/dovecot-acl <http://mydomain.ext/testaccount/Maildir/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: UID 1: Opened mail because: prefetch 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Adding field date.received to cache for the first time (uid=1) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Adding field date.save to cache for the first time (uid=1) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Purging (new file_seq=1649232805): creating cache 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Purging finished, file_seq changed 1649232018 -> 1649232805, size=676 -> 172, max_uid=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Junk' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Sent' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Trash' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): dict destroyed 2022-04-06 10:13:25 doveadm(38465): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Disconnected: Connection closed (fd=9) ------------------------ CUT --------------------------------------

2 1

resend whole inbox to user
by Marc 07 Apr '22

07 Apr '22

I was wondering if there is some way to force an imap client to 're-download' all the messages from the inbox. I can remember in the 'old days' that when the connection was dropped during a pop download, the whole inbox was re-downloaded, resulting in quite a lot of duplicates. I am looking for such action.

6 6

macOS ManageSieve client?
by Gerben Wierda 07 Apr '22

07 Apr '22

I have a dovecot & dovecot-sieve running under MacPorts on my macOS ’server’. I do a very low tech maintenance on sieve, by using the cli on the server and edit sieve by hand for myself. I’d like to open this up to other users. How do people use this from their macOS clients? For this, the ManageSieve protocol exists and this is implemented by dovecot-sieve, but other than installing roundcube and offering a web-based mail client that also supports ManageSieve, is there another way? A ManageSieve client that directly runs on the macOS client and interfaces with dovecot-sieve on the server? After all, routing mail to different mailboxes better happens server-side so that all clients profit. Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>) R&A IT Strategy <https://ea.rna.nl/> (main site) Book: Chess and the Art of Enterprise Architecture <https://ea.rna.nl/the-book/> Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>

6 5

remove duplicate emails
by Jean-Max Reymond 06 Apr '22

06 Apr '22

Hi, I have postfix running and sometimes and I have some duplicate emails with the same Message-ID. With dovecot sieve, I understand that duplicate option remove these emails but I don't understand the configuration to apply. Thanks for your tips, # doveconf -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.0-104-generic x86_64 Ubuntu 20.04.4 LTS # Hostname: B7B3274.online-server.cloud auth_mechanisms = plain login first_valid_uid = 8 log_path = /var/log/dovecot.log mail_location = maildir:~ managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/letsencrypt/live/mail.maxou.fr/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 50 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r }

3 3

Postfix - Dovecot alias
by John Doe 06 Apr '22

06 Apr '22

Hello, I have the problem with aliases. The emails did not delivery to correct email. I send email to email: to_alias(a)domain.com that is valid alias and email should be sent to real email folder: to(a)domain.com. Dovecot creating to_alias folder and deliver the emails there. Here is the email log: / did not see to(a)domain.com below / Apr 5 18:54:40 www postfix/smtpd[30547]: connect from mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:40 www postfix/smtpd[30547]: Anonymous TLS connection established from mail-40137.protonmail.ch[185.70.40.137]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384 Apr 5 18:54:52 www postfix/smtpd[30547]: 85A412E19B6: client= mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:52 www postfix/cleanup[30556]: 85A412E19B6: message-id=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com> Apr 5 18:54:53 www dccifd[1856]: stat(log directory "log"): No such file or directory Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: from=< from(a)protonmail.com>, size=2767, nrcpt=1 (queue active) Apr 5 18:54:57 www postfix/smtpd[30547]: disconnect from mail-40137.protonmail.ch[185.70.40.137] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Apr 5 18:54:57 www dovecot: lmtp(30559): Connect from local Apr 5 18:54:57 www dovecot: lmtp(compiz(a)domain.com)<30559><U8KALFFmTGJfdwAA8oMCvw>: sieve: msgid=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com>: stored mail into mailbox 'INBOX' Apr 5 18:54:57 www postfix/lmtp[30558]: 85A412E19B6: to=< to_alias(a)domain.com>, relay=mail.domain.com[private/dovecot-lmtp], delay=17, delays=17/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 < to_alias(a)domain.com> U8KALFFmTGJfdwAA8oMCvw Saved) Apr 5 18:54:57 www dovecot: lmtp(30559): Disconnect from local: Logged out (state=READY) Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: removed I was playing with password_query but not sure did I'm on right direction. password_query = \ SELECT username AS user, password, \ '/var/spool/postmail/%d/%n' AS userdb_home, 1002 AS userdb_uid, 1001 AS userdb_gid \ FROM mailbox WHERE username = (SELECT goto FROM alias WHERE address = '%u') I'm using dovecot --version: 2.3.18 (9dd8408c18) and my configuration is: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.17.0 x86_64 Slackware 15.0+ ext4 # Hostname: www.ixip.net base_dir = /var/run/dovecot/ default_login_user = nobody dict { driver = sql quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:/var/spool/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/spool/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/spool/postmail/%d/%n/sieve/ sieve_global_dir = /var/lib/dovecot/sieve sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = 127.0.0.1 port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/postfix/ssl/mail.stzbg.com.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=1002 gid=1001 home=/var/spool/postmail/%d/%n allow_all_users=yes driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } # grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=postfix password=password default_pass_scheme = CRYPT password_query = SELECT username AS user, password FROM mailbox WHERE username = '%u'; Kind Regards, Chris

1 0

Support of "extlists" in sieve filters
by Marcin Bajer 04 Apr '22

04 Apr '22

Hi all, Don’t really know if this is sth. to post on this forum, but I tried to make a sieve filter which tags mails from my contacts by the category of the contact. Seems this feature is available in Protonmail: https://protonmail.com/support/knowledge-base/sieve-advanced-custom-filters/ require [“fileinto”, “extlists”]; Checks that the sender is in your personal address book if header :list “from” “:addrbook:personal?label=Family” { fileinto “Known”; } Would it be possible to implement such feature also in dovecot? BR, Marcin

1 0

Replication issues with 2.3.18 - Replication fails after xxx folders reached.
by Paul Kudla (SCOM.CA Internet) 02 Apr '22

02 Apr '22

please appreciate that i am trying to help .... after much testing i can now reporduce the replication issues at hand I am running on freebsd 12 & 13 stable (both test and production servers) sdram drives etc ... Basically replication works fine until reaching a folder quantity of ~ 256 or more to reproduce using doveadm i created folders like INBOX/folder-0 INBOX/folder-1 INBOX/folder-2 INBOX/folder-3 and so forth ...... I created 200 folders and they replicated ok on both servers I created another 200 (400 total) and the replicator got stuck and would not update the mbox on the alternate server anymore and is still updating 4 days later ? basically replicator goes so far and either hangs or more likely bails on an error that is not reported to the debug reporting ? however dsync will sync the two servers but only when run manually (ie all the folders will sync) I have two test servers avaliable if you need any kind of access - again here to help. [07:28:42] mail18.scom.ca [root:0] ~ # sync.status Queued 'sync' requests 0 Queued 'high' requests 6 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 255 username type status paul(a)scom.ca normal Waiting for dsync to finish keith(a)elirpa.com incremental Waiting for dsync to finish ed.hanna(a)dssmgmt.com incremental Waiting for dsync to finish ed(a)scom.ca incremental Waiting for dsync to finish nick(a)elirpa.com incremental Waiting for dsync to finish paul(a)paulkudla.net incremental Waiting for dsync to finish i have been going through the c code and it seems the replication gets requested ok replicator.db does get updated ok with the replicated request for the mbox in question. however i am still looking for the actual replicator function in the lib's that do the actual replication requests the number of folders & subfolders is defanately the issue - not the mbox pyhsical size as thought origionally. if someone can point me in the right direction, it seems either the replicator is not picking up on the number of folders to replicat properly or it has a hard set limit like 256 / 512 / 65535 etc and stops the replication request thereafter. I am mainly a machine code programmer from the 80's and have concentrated on python as of late, 'c' i am starting to go through just to give you a background on my talents. It took 2 months to finger this out. this issue also seems to be indirectly causing the duplicate messages supression not to work as well. python programming to reproduce issue (loops are for last run started @ 200 - fyi) : # cat mbox.gen #!/usr/local/bin/python2 import os,sys from lib import * user = 'paul(a)paulkudla.net' """ for count in range (0,600) : box = 'INBOX/folder-%s' %count print count command = '/usr/local/bin/doveadm mailbox create -s -u %s %s' %(user,box) print command a = commands.getoutput(command) print a """ for count in range (0,600) : box = 'INBOX/folder-0/sub-%' %count print count command = '/usr/local/bin/doveadm mailbox create -s -u %s %s' %(user,box) print command a = commands.getoutput(command) print a #sys.exit()

1 0

falsely log "auth: unknown user" when multiple userdb
by Anthony Panko 01 Apr '22

01 Apr '22

Hello, When there is a multiple userdb to look for user, Dovecot log «auth: unknown user» when the first userdb search failed. Then Dovecot successfully search user in the second userdb and things works. But "auth: unknown user" event left in a logs. Logs look like this: Apr 1 12:38:48 mail dovecot[75384]: lmtp(75397): Connect from 127.0.5.1 Apr 1 12:38:48 mail dovecot[75384]: auth: ldap(order(a)XXX,127.0.5.1): unknown user Apr 1 12:38:48 mail dovecot[75384]: lmtp(order)<75397><D8m2HCjIRmKFJgEAABdyCg>: msgid=<157609214.20220331172309@YYY>: saved mail to INBOX Debug show failed search in the first userdb and successfull search in the second userdb. When user found in the first userdb «unknown user» event does not appear. Configuration is: userdb { args = /usr/local/etc/dovecot/udb-ldap-personal.conf driver = ldap override_fields = home=/mnt/mboxes/personal/%n } userdb { args = /usr/local/etc/dovecot/udb-ldap-general.conf driver = ldap override_fields = home=/mnt/mboxes/general/%n } Dovecot verision is 2.3.16 (7e2e900c1a). -- Best regards, Anthony Pankov

2 1

Dovecot Submission - rate limiting
by itanguy＠univ-brest.fr 31 Mar '22

31 Mar '22

Hello, is there any way to rate limit submission mail (counting per user) when using Dovecot/Submission (no Postfix)? Using a milter seems impossible. Using Dovecot Events seems "too" global (not per users discrimination). Maybe rate-limiting has to be external and then include in the pass_db query ? Thank your for any hints. Ismaël Tanguy

3 3

Simplifying Support of Virtual and System Users
by Mark Olbert 29 Mar '22

29 Mar '22

Apologies if this has already been raised here (which I suspect it has 😊). I tried to raise it as an issue over on github but issues are not enabled for the repository. The support for mixing virtual users, with fully-qualified email addresses, and system users could be simpler. Assuming it doesn’t mess up other stuff in the code base, of course 😊. The problem appears to be that the PAM passwd module requires just user names without a domain (which makes sense given that they’re system users) but does not, so far as I can see, support the username_format argument. In my setup, the default structure of 10-auth.conf demonstrates this: auth_username_format = %n That means all username arguments lack the domain part…which complicates using fully-qualified ones for virtual users. I realize I could assign arbitrary unique names to the virtual accounts in the lookup file. But that complicates administering the system, so I want to be able to include the domain for virtual users. After about five hair-pulling hours of wrestling with the configuration I stumbled across an answer utilizing conditionals<https://serverfault.com/questions/260488/dovecot-user-lookup-fails-when-usi…> on ServerFault. It works fine. But being able to pass a username_format parameter to the PAM module (which I tried, but it was rejected) would be a lot simpler, and a lot more intuitive. - Mark

5 4

IMAP sync issue in email clients
by ChandranManikandan 29 Mar '22

29 Mar '22

Hi Friends, Some few email accounts are sync issues come in outlook,thunderbird,roundcube and squirrelmail after power shutdown suddenly. The dovecot mail log is shown below for those email accounts. Can anyone help me to fix it? imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=mail stream) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Corrupted record in index cache file /home/vpopmail/domains/ xxx.com/email/Maildir/dovecot.index.cache: Broken physical size in mailbox INBOX: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570..mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Info: FETCH failed: Internal error occurred. Refer to server log for more information. [2022-03-29 13:40:48] in=323 out=589163 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 -- *Regards,Manikandan.C*

2 2

Doveadm backup...
by Stephane Magnier 28 Mar '22

28 Mar '22

Hi I've recently tried to use the Dovecadm backup to backup the emails.. with the following syntax doveadm -Dv backup -u userx maildir:/mnt/nfs-backup/userx Sounds to be OK with few emails... Some of them got a lot of emails and one f them got an error and stop ! dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=1725fa475d774ee19cb98dfb6737b4f1 UID=24891 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=916ed110b4b1522868be6194f1ae36ff UID=24892 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=eb8d75c530a7b02fc26b494d9006c91b UID=24893 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=aee9155875c34861fd6500f1f2f51a26 UID=24894 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Last common UID=24894. Delayed expunges= dsync(userx): Debug: brain S: Import Trash: Saved UIDs: dsync(userx): Debug: brain S: Import Trash: Finish update: min_next_uid=24895 min_first_recent_uid=24895 min_highest_modseq=35344 min_highest_pvt_modseq=0 dsync(userx): Debug: /mnt/nfs-backup/userx/.Trash/dovecot.index.cache: Compressed, file_seq changed 1645803588 -> 1645803589, size=32, max_uid=24894 dsync(userx): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 7e05c335174bf1608f0a02004eac7fb4 (maybe it was just deleted?) dsync(userx): Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Disconnected: Connection closed (fd=10) I empty the trash... exactly the same problem... Any idea why this ?? Thanks and regards,

5 10

Private \seen flags lost during message move for other users
by Cube . 28 Mar '22

28 Mar '22

Hello, I have a shared mailbox set up with a private index: maildir:/var/mail/public:INDEXPVT=~/Maildir/public Per user \Seen flags are working fine until one user moves a message into another folder/sub-mailbox. For that user doing the move the message remains \Seen however for other users who have already seen the message the flag is lost and it appears unread in the new location. If the message is moved back it still appears unread to the other user even if had been read in that folder/sub-mailbox in the past. Is there anyway to retain per user \Seen that follows the message when its moved? Thank you.

2 1

dovecot replication on dovecot v 2.3.8
by Stephane Magnier 27 Mar '22

27 Mar '22

Hi, I am trying using a replication. Here is my config : 10-mail.conf. Before going " on real life " I try to make a very basic example... but without any success :-( bad start I took the config example on dovecot wiki The idea is to replicate the user: "user1" on a different server IP 177.28.1.120 at the location /home/SERVER/test and to get at the end the folder "/home/SERVER/test/user1" On the top, I wish to replication with the user / group : vmail. For the transfer, I use the root login on the backup server to avoid other rights problems at the moment 2) how to synchronized specific users ? apparently it's trying to sync other things.. :-) # mbox_very_dirty_syncs = yes mail_plugins=$mail_plugins quota notify replication service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -l root 177.28.1.120 doveadm dsync-server -u user1 plugin { mail_replica =remote:root@177.28.1.120:/home/SERVER/test/ } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service replicator { unix_listener replicator-doveadm { mode = 0600 user = vmail } } replication_max_conns = 10 But apparently nothing is happening.... [root@xxx xenia]# doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 24 Waiting 'failed' requests 10 Total number of known users 34 and the folder test is empty Any idea what is wrong ? maybe I should ask a start a cmd line to start the process ? ( [root@mbox1 xenia]# doveadm replicator status '*' username priority fast sync full sync success sync failed rngd none - - - - *user1 none 00:00:04 00:40:05 - y ( failed )* saslauth none - - - - sa-milt none - - - -

1 1

disable authentication for a user in specialuserdb passwd-file
by Marc 27 Mar '22

27 Mar '22

Is it possible to disable the authentication for a specific user in userdb password-file?

1 0

log failed plaintext password for specific user only
by mj 25 Mar '22

25 Mar '22

Hi, We are logging failed authentication attempts, with the attempted password as auth_verbose_passwords=sha1 The question: is it possible to configure auth_verbose_passwords=plain for a specific user only? Turning it on globally would be too much sensitive information for the purpose. Reason: We are currently observing a high number of failed authentications for a specific user, coming from *many* diffirent IPs across the globe, with most IPs only trying once or twice, making this difficult to block. The number of failed authentications cause this account to regularly become blocked in AD. We would like to know if they are trying older actual passwords from the user, or if it's just dictionary attack. Thanks!

4 7

Setting imap-login process_limit when service_count>1
by Joseph Tam 25 Mar '22

25 Mar '22

More of my users are accessing mail remotely, which probably explained why I started seeing Mar 18 05:50:34 dovecot: master: Warning: service(imap-login): process_limit (2) reached, client connections are being dropped I played around with increasing limits, but made the mistake of setting service_count to a value other than 0 and 1. service imap-login { client_limit = 1024 service_count = 10240 process_min_avail = 2 process_limit = 8 } Doubling and redoubling process_limit and increasing service_count didn't prevent IMAP from eventually grinding to a halt because process_limit was reached. Mar 18 12:36:12 dovecot: master: Warning: service(imap-login): process_limit (4) reached, client connections are being dropped Mar 18 20:39:48 viol dovecot: master: Warning: service(imap-login): process_limit (8) reached, client connections are being dropped Observing the way imap-login processes spawn and retain file descriptors, I finally understood the subtlety of [1], which explains that imap-login will not exit despite reaching service_count if one SSL connection is still open. With many long-lived client connections, the asymptotic behaviour is that the total #clients plateaus, but get spread out over many imap-login processes, with many lingering on to hold a few SSL connections. For service_count>1, process_limit should be set to a large fraction of peak simultaneous clients (i.e. the same value used when service_count=1), otherwise there is a high likelihood of running into process_limit and game over. Given this behaviour, there doesn't seem much sense in setting service_count to anything but 0 (unlimited => performance mode) or 1 (security mode). Setting to other values supposedly limit memory leaks, but if a single persistent SSL client can hold up an imap-login process from exiting and releasing memory, it seems to negate this purpose. Anyways, maybe [1] can mention this so others don't fall into the same pit I did. References [1] https://doc.dovecot.org/admin_manual/login_processes/ Joseph Tam <jtam.home(a)gmail.com>

1 0

ok replication does not work
by Paul Kudla (SCOM.CA Internet) 24 Mar '22

24 Mar '22

would someone please send me the standard that you are working towards (rfc stuff) in the mean time a bad email or folder or both are simply causing replication not to work no there is no logging of any kind of an error i would appreciate the info as i will start ripping down the c code to fix this doveadm / replication (seems to be seperate ???) remote , tcp tcps nothing works your co operation on this matter would be appreciated i dumped the 5 accounts listed below started from scratch and it just simply DOES NOT WORK all account replicate except for # sync.status Queued 'sync' requests 0 Queued 'high' requests 5 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 255 username type status paul(a)scom.ca incremental Waiting for dsync to finish nick(a)elirpa.com incremental Waiting for dsync to finish keith(a)elirpa.com incremental Waiting for dsync to finish ed.hanna(a)dssmgmt.com incremental Waiting for dsync to finish ed(a)scom.ca incremental Waiting for dsync to finish always the same five accounts and always they choke without any info i am forced to do a sync every five minutes (ten minute intevals) to keep the servers in sync. someone please give me a standard to work with otherwise the hacks that i do will be exactly that a hack???

2 1

Pop3 Panic Error
by Aurel Mihai 24 Mar '22

24 Mar '22

Hello, after upgrade to version 2.3.18, we enconter a lot of errors, such as: Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Panic: file lib-event.c: line 585 (event_reason_code_prefix): assertion failed: (name[0] != '\0') Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f7ce322e012] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f7ce322e12e] -> /usr/lib/dovecot/libdovecot.so.0(+0x101d4b) [0x7f7ce323ad4b] -> /usr/lib/dovecot/libdovecot.so.0(+0x101de1) [0x7f7ce323ade1] -> /usr/lib/dovecot/libdovecot.so.0(+0x55519) [0x7f7ce318e519] -> /usr/lib/dovecot/libdovecot.so.0(+0x594e2) [0x7f7ce31924e2] -> dovecot/pop3(client_handle_input+0x1c9) [0x55d5b5efa539] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f7ce3250f79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x96) [0x7f7ce3251066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f7ce32511e0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7ce31c4003] -> dovecot/pop3(main+0x2e6) [0x55d5b5ef81f6] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7f7ce2f93d0a] -> dovecot/pop3(_start+0x2a) [0x55d5b5ef838a] Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Fatal: master: service(pop3): child 52269 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) # dovecot -n # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.10.0-12-amd64 x86_64 Debian 11.2 # Hostname: auth_cache_verify_password_with_worker = yes auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 256 default_client_limit = 10000 default_process_limit = 10000 default_vsz_limit = 1 G dict { lastlogin = mysql:/etc/dovecot/mysql/dovecot-dict-lastlogin.conf quotadict = mysql:/etc/dovecot/mysql/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 100 imap_hibernate_timeout = 5 secs imap_idle_notify_interval = 3 mins log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c login_trusted_networks = mail_fsync = always mail_gid = 8 mail_home = /home/virtual0/%d/%n mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify mail_privileged_group = mail mail_uid = 150 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave metric imap_command { filter = event=imap_command_finished AND tagged_reply_state=OK group_by = cmd_name } metric imap_select_no { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply_state=NO } metric imap_select_no_notfound { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply="NO*Mailbox doesn't exist:*" } metric storage_http_gets { filter = event=http_request_finished AND category=storage AND method=get } mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 60 days special_use = \Trash } mailbox virtual/All { special_use = \All } prefix = } passdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user::proxy::quotadict quota_rule2 = Trash:ignore quota_rule3 = Spam:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 The email account that you tried to reach is over quota quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve trash = /etc/dovecot/dovecot-trash.conf zlib_save = gz zlib_save_level = 6 } protocols = imap sieve pop3 lmtp service anvil { client_limit = 50000 unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 50000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } user = root vsz_limit = 1 G } service dict { unix_listener dict { mode = 0660 user = vmail } } service imap-hibernate { unix_listener imap-hibernate { group = $default_internal_group mode = 0660 } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_min_avail = 16 service_count = 1 } service imap { extra_groups = $default_internal_group process_min_avail = 16 unix_listener imap-master { user = $default_internal_user } vsz_limit = 2 G } service lmtp { process_min_avail = 16 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 16 service_count = 1 } service managesieve { vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 } process_min_avail = 16 service_count = 1 } service pop3 { process_min_avail = 16 vsz_limit = 1 G } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix process_min_avail = 16 unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0666 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0660 user = vmail } user = vmail } service stats { unix_listener stats-reader { mode = 0660 user = vmail } unix_listener stats-writer { mode = 0666 user = vmail } } ssl_cert = </etc/dovecot/ssl/domain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1 userdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } protocol imap { imap_max_line_length = 64 k mail_max_userip_connections = 16 mail_plugins = zlib quota mail_log notify trash imap_quota last_login } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib quota mail_log notify last_login pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %08Xu%08Xv } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = zlib quota mail_log notify sieve sendmail_path = /usr/lib/sendmail syslog_facility = mail } protocol lmtp { mail_plugins = zlib quota mail_log notify sieve syslog_facility = mail } Any help please? Aurel

2 2

imap_metadata plugin panic
by Elisamuel Resto 23 Mar '22

23 Mar '22

Hello, This may be covered somewhere but recently I enabled the metadata plugin to work with sieve as part of some updates I did a while back and I hadn't checked my logs for any issues with it and so far they're not completely taking my system down. Right now, upon trying to delete a folder I noticed the following in my logs... what am I missing? I see the broken SQL query, but I don't know enough about the dict system or the metadata plugin to know how to add the missing information or fix it otherwise. Regards, Elisamuel Resto Nov 15 12:19:19 wyvern dovecot[461]: dict(51438): Panic: lib-sql: Too many bind args (2) for statement: SELECT meta_key FROM metadata WHERE meta_key LIKE AND username = ? Nov 15 12:19:19 wyvern dovecot[461]: dict(51438): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x43) [0x7f449789d073] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x20) [0x7f449789d190] -> /usr/lib/dovecot/libdovecot.so.0(+0xfaf1f) [0x7f44978a9f1f] -> /usr/lib/dovecot/libdovecot.so.0(+0xfafb1) [0x7f44978a9fb1] -> /usr/lib/dovecot/libdovecot.so.0(+0x4cd20) [0x7f44977fbd20] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0x875a) [0x555e60d7775a] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](sql_statement_query+0x42) [0x555e60d7f262] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xd97f) [0x555e60d7c97f] -> /usr/lib/dovecot/libdovecot.so.0(dict_iterate_values+0x25) [0x7f4497868615] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xa929) [0x555e60d79929] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xb224) [0x555e60d7a224] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xb381) [0x555e60d7a381] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](dict_command_input+0xd9) [0x555e60d7a579] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0x95b8) [0x555e60d785b8] -> /usr/lib/dovecot/libdovecot.so.0(connection_input_default+0x15e) [0x7f44978a16ce] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6b) [0x7f44978bfebb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13b) [0x7f44978c15cb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x51) [0x7f44978bff61] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x41) [0x7f44978c0131] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0x7f4497831f74] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](main+0x189) [0x555e60d78139] -> /usr/lib/libc.so.6(__libc_start_main+0xd5) [0x7f44972cfb25] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](_start+0x2e) [0x555e60d7819e] Nov 15 12:19:19 wyvern dovecot[461]: imap(sam(a)samresto.dev)<51449><+BGq2NfQM/7Pisr9>: Error: Mailbox Trash/Processed: dict_iterate(priv/c841ad0291c27461ac670100a07d9965/) failed: Connection closed (reply took 0.204 secs (0.204 in dict wait, 0.000 in other ioloops, 0.000 in locks)) Nov 15 12:19:19 wyvern dovecot[461]: dict(51438): Fatal: master: service(dict): child 51438 killed with signal 6 (core dumped)

4 12

Dovecot 2.3.18 Panic-Error (name[0] != '\0')
by Aurel Mihai 22 Mar '22

22 Mar '22

Hello, after upgrade to version 2.3.18, we enconter a lot of errors, such as: Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Panic: file lib-event.c: line 585 (event_reason_code_prefix): assertion failed: (name[0] != '\0') Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f7ce322e012] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f7ce322e12e] -> /usr/lib/dovecot/libdovecot.so.0(+0x101d4b) [0x7f7ce323ad4b] -> /usr/lib/dovecot/libdovecot.so.0(+0x101de1) [0x7f7ce323ade1] -> /usr/lib/dovecot/libdovecot.so.0(+0x55519) [0x7f7ce318e519] -> /usr/lib/dovecot/libdovecot.so.0(+0x594e2) [0x7f7ce31924e2] -> dovecot/pop3(client_handle_input+0x1c9) [0x55d5b5efa539] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f7ce3250f79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x96) [0x7f7ce3251066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f7ce32511e0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7ce31c4003] -> dovecot/pop3(main+0x2e6) [0x55d5b5ef81f6] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7f7ce2f93d0a] -> dovecot/pop3(_start+0x2a) [0x55d5b5ef838a] Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Fatal: master: service(pop3): child 52269 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) # dovecot -n # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.10.0-12-amd64 x86_64 Debian 11.2 # Hostname: auth_cache_verify_password_with_worker = yes auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 256 default_client_limit = 10000 default_process_limit = 10000 default_vsz_limit = 1 G dict { lastlogin = mysql:/etc/dovecot/mysql/dovecot-dict-lastlogin.conf quotadict = mysql:/etc/dovecot/mysql/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 100 imap_hibernate_timeout = 5 secs imap_idle_notify_interval = 3 mins log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c login_trusted_networks = mail_fsync = always mail_gid = 8 mail_home = /home/virtual0/%d/%n mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify mail_privileged_group = mail mail_uid = 150 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave metric imap_command { filter = event=imap_command_finished AND tagged_reply_state=OK group_by = cmd_name } metric imap_select_no { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply_state=NO } metric imap_select_no_notfound { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply="NO*Mailbox doesn't exist:*" } metric storage_http_gets { filter = event=http_request_finished AND category=storage AND method=get } mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 60 days special_use = \Trash } mailbox virtual/All { special_use = \All } prefix = } passdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user::proxy::quotadict quota_rule2 = Trash:ignore quota_rule3 = Spam:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 The email account that you tried to reach is over quota quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve trash = /etc/dovecot/dovecot-trash.conf zlib_save = gz zlib_save_level = 6 } protocols = imap sieve pop3 lmtp service anvil { client_limit = 50000 unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 50000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } user = root vsz_limit = 1 G } service dict { unix_listener dict { mode = 0660 user = vmail } } service imap-hibernate { unix_listener imap-hibernate { group = $default_internal_group mode = 0660 } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_min_avail = 16 service_count = 1 } service imap { extra_groups = $default_internal_group process_min_avail = 16 unix_listener imap-master { user = $default_internal_user } vsz_limit = 2 G } service lmtp { process_min_avail = 16 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 16 service_count = 1 } service managesieve { vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 } process_min_avail = 16 service_count = 1 } service pop3 { process_min_avail = 16 vsz_limit = 1 G } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix process_min_avail = 16 unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0666 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0660 user = vmail } user = vmail } service stats { unix_listener stats-reader { mode = 0660 user = vmail } unix_listener stats-writer { mode = 0666 user = vmail } } ssl_cert = </etc/dovecot/ssl/domain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1 userdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } protocol imap { imap_max_line_length = 64 k mail_max_userip_connections = 16 mail_plugins = zlib quota mail_log notify trash imap_quota last_login } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib quota mail_log notify last_login pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %08Xu%08Xv } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = zlib quota mail_log notify sieve sendmail_path = /usr/lib/sendmail syslog_facility = mail } protocol lmtp { mail_plugins = zlib quota mail_log notify sieve syslog_facility = mail } Any help please? Aurel

1 0

Disconnected: Shutting down (disconnected while authenticating) :: after mysql restart :: bug?
by rudolf＠padaru.de 17 Mar '22

17 Mar '22

Good morning list, i looking for a while for a solution above problem. We use dovecot 2.3.7.2 (3c910f64b) (Ubuntu 20.04) and 2.3.13 (89f716dc2) (Ubuntu 18.04) . Often we have the problem, that the authentication (dovecot <-> mysql) dont work after an mysql restart. Unfortunately i cant reproduce this problem, if i restart the mysql-server the authentication work when the database is up again. If we have this problem it is enough to reload the dovecot. So that the auth-worker will reconnect and everything is fine again. I have tried to encircle the problem with verbose auth-logging a wile ago but i only see timeouts from the auth-worker while mysql is running But this is not the solution für the problem. Is there an option i can set to force the auth-worker to reconnect? Maybe an timeout or something else? Or is there an value set to high in my conf? Somethin like the idle_kill from anvil service? Or is it simply a bug? doveconf output: auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_cache_verify_password_with_worker = no auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_gssapi_hostname = auth_krb5_keytab = auth_master_user_separator = auth_mechanisms = plain login auth_policy_check_after_auth = yes auth_policy_check_before_auth = yes auth_policy_hash_mech = sha256 auth_policy_hash_nonce = auth_policy_hash_truncate = 12 auth_policy_log_only = no auth_policy_reject_on_fail = no auth_policy_report_after_auth = yes auth_policy_request_attributes = login=%{requested_username} pwhash=%{hashed_password} remote=%{rip} device_id=%{client_id} protocol=%s auth_policy_server_api_header = auth_policy_server_timeout_msecs = 2000 auth_policy_server_url = auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_stats = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@üÜöÖäÄ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 60 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 1 mins default_internal_group = dovecot default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_flush_socket = director_mail_servers = director_max_parallel_kicks = 100 director_max_parallel_moves = 100 director_output_buffer_size = 10 M director_ping_idle_timeout = 30 secs director_ping_max_timeout = 1 mins director_servers = director_user_expire = 15 mins director_user_kick_delay = 2 secs director_username_hash = %u disable_plaintext_auth = no dotlock_use_excl = yes doveadm_allowed_commands = doveadm_api_key = doveadm_http_rawlog_dir = doveadm_password = doveadm_port = 0 doveadm_socket_path = doveadm-server doveadm_username = doveadm doveadm_worker_count = 0 dsync_alt_char = _ dsync_commit_msgs_interval = 100 dsync_features = dsync_hashed_headers = Date Message-ID dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -U first_valid_gid = 1 first_valid_uid = 500 haproxy_timeout = 3 secs haproxy_trusted_networks = hostname = imap_capability = +XLIST imap_client_workarounds = imap_fetch_failure = disconnect-immediately imap_hibernate_timeout = 0 imap_id_log = imap_id_retain = no imap_id_send = name * imap_idle_notify_interval = 2 mins imap_literal_minus = no imap_logout_format = in=%i out=%o del=%{deleted} fetched_mails=%{fetch_hdr_count} imap_max_line_length = 64 k imap_metadata = no imap_urlauth_host = imap_urlauth_logout_format = in=%i out=%o imap_urlauth_port = 143 imapc_cmd_timeout = 5 mins imapc_connection_retry_count = 1 imapc_connection_retry_interval = 1 secs imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_max_line_length = 0 imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_sasl_mechanisms = imapc_ssl = no imapc_ssl_verify = yes imapc_user = import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID LISTEN_FDS info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = libexec_dir = /usr/lib/dovecot listen = *, :: lmtp_hdr_delivery_address = final lmtp_proxy = no lmtp_proxy_rawlog_dir = lmtp_rawlog_dir = lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lmtp_user_concurrency_limit = 0 lock_method = flock log_core_filter = log_debug = log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = <myServer.com> mailserver ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c login_plugin_dir = /usr/lib/dovecot/modules/login login_plugins = login_proxy_max_disconnect_delay = 0 login_proxy_notify_path = proxy-notify login_source_ips = login_trusted_networks = mail_access_groups = mail_always_cache_fields = hdr.* flags mime.parts binary.parts body.snippet mail_attachment_detection_options = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_attribute_dict = mail_cache_compress_continued_percentage = 200 mail_cache_compress_delete_percentage = 20 mail_cache_compress_header_continue_count = 4 mail_cache_compress_min_size = 32 k mail_cache_fields = flags mail_cache_min_mail_count = 30 mail_cache_record_max_size = 64 k mail_cache_unaccessed_field_drop = 30 days mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_index_log2_max_age = 2 days mail_index_log_rotate_max_size = 1 M mail_index_log_rotate_min_age = 5 mins mail_index_log_rotate_min_size = 32 k mail_index_rewrite_max_log_bytes = 128 k mail_index_rewrite_min_log_bytes = 8 k mail_location = auto: mail_log_prefix = "%s(%u)<%{pid}><%{session}>: " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 30 mail_never_cache_fields = mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = " zlib" mail_prefetch_count = 0 mail_privileged_group = mail mail_save_crlf = no mail_server_admin = mail_server_comment = mail_shared_explicit_inbox = no mail_sort_max_read_count = 0 mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = mail_vsize_bg_after_count = 0 mailbox_idle_check_interval = 30 secs mailbox_list_index = yes mailbox_list_index_include_inbox = no mailbox_list_index_very_dirty_syncs = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_empty_new = no maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot (Ubuntu) Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader imapflags notify vnd.dovecot.pipe vnd.dovecot.filter vnd.dovecot.execute master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = dotlock mbox_very_dirty_syncs = yes mbox_write_locks = fcntl dotlock mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 250 M mmap_disable = no namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Archiv { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox Drafts { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox Junk { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox Sent { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox "Sent Messages" { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = \Sent } mailbox Trash { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } order = 0 prefix = separator = subscriptions = yes type = private } old_stats_carbon_interval = 30 secs old_stats_carbon_name = old_stats_carbon_server = old_stats_command_min_time = 1 mins old_stats_domain_min_time = 12 hours old_stats_ip_min_time = 12 hours old_stats_memory_limit = 16 M old_stats_session_min_time = 15 mins old_stats_user_min_time = 1 hours passdb { args = /etc/dovecot/conf.d/zDovecot-sql.conf.ext auth_verbose = default default_fields = deny = no driver = sql master = no mechanisms = name = override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never username_filter = } plugin { sieve = ~/sieve/.dovecot.sieve sieve_after = ~/sieve_after/.dovecot_after.sieve sieve_before = ~/sieve_before/.dovecot_before.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /usr/local/bin/ sieve_execute_input_eol = lf sieve_extensions = +notify +imapflags +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute +editheader -reject sieve_filter_bin_dir = /usr/local/bin/ sieve_filter_input_eol = lf sieve_global_dir = /etc/dovecot/sieve/ sieve_max_redirects = 25 sieve_pipe_bin_dir = /usr/local/bin/ sieve_pipe_input_eol = lf sieve_plugins = sieve_extprograms sieve_redirect_envelope_from = recipient zlib_save = gz zlib_save_level = 6 } pop3_client_workarounds = pop3_delete_type = default pop3_deleted_flag = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_features = pop3c_host = pop3c_master_user = pop3c_password = pop3c_port = 110 pop3c_quick_received_date = no pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = postmaster@%{if;%d;ne;;%d;%{hostname}} protocols = imap pop3 sieve quota_full_tempfail = no rawlog_dir = recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_dsync_parameters = -d -N -l 30 -U replication_full_sync_interval = 1 days replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 1 mins privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 1 mins privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = $default_internal_user } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = root vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict-async { chroot = client_limit = 0 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict-async { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = haproxy = no port = 0 reuse_port = no ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-hibernate { chroot = client_limit = 0 drop_priv_before_exec = no executable = imap-hibernate extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 0 type = unix_listener imap-hibernate { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = /usr/lib/dovecot/imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = haproxy = no port = 143 reuse_port = no ssl = no } inet_listener imaps { address = haproxy = no port = 993 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 4 protocol = imap service_count = 0 type = login user = dovecot vsz_limit = 18446744073709551615 B } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-master { group = mode = 0600 user = } unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = $default_internal_user } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = haproxy = no port = 4190 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 0 type = login user = dovecot vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = dovecot vsz_limit = 18446744073709551615 B } service old-stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = old-stats extra_groups = fifo_listener old-stats-mail { group = mode = 0600 user = } fifo_listener old-stats-user { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener old-stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = /usr/lib/dovecot/pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = haproxy = no port = 110 reuse_port = no ssl = no } inet_listener pop3s { address = haproxy = no port = 995 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 4 protocol = pop3 service_count = 0 type = login user = dovecot vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = /usr/lib/dovecot/pop3 extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = mode = 00 user = $default_internal_user } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats-reader { group = dovecot mode = 0666 user = } unix_listener stats-writer { group = dovecot mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service submission-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = submission-login extra_groups = group = idle_kill = 0 inet_listener submission { address = haproxy = no port = 587 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = submission service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service submission { chroot = client_limit = 1 drop_priv_before_exec = no executable = submission extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = submission service_count = 1 type = unix_listener login/submission { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service tcpwrap { chroot = client_limit = 1 drop_priv_before_exec = no executable = tcpwrap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = no ssl = yes ssl_alt_cert = ssl_alt_key = ssl_ca = </etc/apache2/zertifikate/<myServer.com>.com.pem ssl_cert = </etc/apache2/zertifikate/<myServer.com>.com.pem ssl_cert_username_field = commonName ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:E ECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!aNULL:!eNU LL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 ssl_client_ca_dir = ssl_client_ca_file = ssl_client_cert = ssl_client_key = ssl_client_require_valid_cert = yes ssl_crypto_device = ssl_curve_list = ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_key_password = ssl_min_protocol = TLSv1.2 ssl_options = ssl_prefer_server_ciphers = yes ssl_require_crl = yes ssl_verify_client_cert = no state_dir = /var/lib/dovecot stats_writer_socket_path = stats-writer submission_client_workarounds = submission_host = submission_logout_format = in=%i out=%o submission_max_mail_size = 0 submission_max_recipients = 0 submission_relay_command_timeout = 5 mins submission_relay_connect_timeout = 30 secs submission_relay_host = submission_relay_master_user = submission_relay_max_idle_time = 29 mins submission_relay_password = submission_relay_port = 25 submission_relay_rawlog_dir = submission_relay_ssl = no submission_relay_ssl_verify = yes submission_relay_trusted = no submission_relay_user = submission_ssl = no submission_timeout = 30 secs syslog_facility = mail userdb { args = /etc/dovecot/conf.d/zDovecot-sql.conf.ext auth_verbose = default default_fields = driver = sql name = override_fields = result_failure = continue result_internalfail = continue result_success = return-ok skip = never } valid_chroot_dirs = verbose_proctitle = yes verbose_ssl = no version_ignore = no protocol lda { mail_plugins = " zlib sieve zlib" rejection_reason = Your message to <%t> was automatically discarded:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = " zlib mail_log notify zlib" ssl = yes } protocol pop3 { mail_plugins = zlib pop3_client_workarounds = oe-ns-eoh outlook-no-nuls pop3_no_flag_updates = no pop3_uidl_format = %08Xu%08Xv ssl = yes } Thank you for any advide or solution. Mit freundlichen Grüßen Yours sincerely Pascal Rudolf

1 0

Finding Users Over Quota
by dovecot＠ptld.com 17 Mar '22

17 Mar '22

Using doveadm quota will let you see if a specific user is over quota. Is there a way to have dovecot tell you which users are currently over quota? Is the quota_clone plugin a way to save user quota to dict like how last_login saves to dict? The documentation for quota_clone is MIA. (As of 3/16/22) https://wiki2.dovecot.org/Plugins v https://wiki2.dovecot.org/Plugins/QuotaClone v https://doc.dovecot.org/plugin-settings/quota-clone-plugin/ v 404 Not Found

2 1

SIS and tracing the origin of an attachment
by doug 16 Mar '22

16 Mar '22

Hi All, I'm trying to trace an attachment within an SIS subdirectory to the email message(s) that link to it. I say messages because I'm also using dovecot dedup. My understanding is the linked file name is the hash value of the attachments contents concatenated with the GUID of the email message. I have had marginal success with a message I created myself. Example: I generated an email with two attachments. Here are the links in my attachment directory. ./26/c5/26c5c540d41779d83d2f5388041d05c67d720d9a-73eca8051acd276272310000f2bc99a3 ./65/cd/65cd73112a489ef07f17ed5740aa60358e2dd3fb-74eca8051acd276272310000f2bc99a3 In my sent folder the actual GUID of the message is 75eca8051acd276272310000f2bc99a3. So the GUID of the attachment is based on the GUID of the message, but not exact. The second hex byte seems to be decremented as an offset of the attachment index from the GUID of the message. At least in my one example. # doveadm dump /mailstore/doug/mail/mailboxes/Sent/dbox-Mails/dovecot.index | grep guid | tail -1 - guid: 75eca8051acd276272310000f2bc99a3 With that actual GUID I can find the message with a search: # doveadm search -u doug mailbox Sent guid 75eca8051acd276272310000f2bc99a3 doug e5711f1cf2c9294f71090000059b96e4 53526 Now let's try to track down another email when only the HASH-GUID value is known. Here is one randomly picked. ./00/a2/00a2d5de3e41053d59bd10084826bbe094aa1c59-57857b09d1a327627e260000f2bc99a3 # doveadm search -A mailbox '*' guid 57857b09d1a327627e260000f2bc99a3 # doveadm search -A mailbox '*' guid 58857b09d1a327627e260000f2bc99a3 # doveadm search -A mailbox '*' guid 59857b09d1a327627e260000f2bc99a3 I repeated this incrementing and decrementing from 5085... through 5f85... and never located the message. This seems like it should be trivial but I've been struggling with it for days. The GUID isn't random, there must be a way to track the attachment back. What am I missing? And for those wondering why, our virus scanner flagged a number of attachments, some with several links, and I want ask the users to delete the offending messages so I can purge them from the server. If I can find the emails I can give them the mail folder, date/time, and subject of the message. -- Doug

3 5

AW: [EXT] AW: AW: AW: invalid lz4 chunk size??
by Joachim Lindenberg 16 Mar '22

16 Mar '22

What might go wrong? Or should I copy the directory myself from remote? What can go wrong with that? Thanks, Joachim -----Ursprüngliche Nachricht----- Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> Gesendet: Wednesday, 16 March 2022 11:31 An: Joachim Lindenberg <dovecot(a)lindenberg.one> Betreff: Re: [EXT] AW: AW: AW: invalid lz4 chunk size?? It might, I can't promise it =) Aki > On 16/03/2022 12:29 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > With remote I am referring to the second instance of mailcow including dovecot I am running, which has dovecot replication active. I am observing the issue on just one box. Thus I am hoping that when I remove the user mail directory on one host, replication will restore it from remote. > Thanks, Joachim > > -----Ursprüngliche Nachricht----- > Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> > Gesendet: Wednesday, 16 March 2022 11:17 > An: Joachim Lindenberg <dovecot(a)lindenberg.one>; dovecot(a)dovecot.org > Betreff: Re: AW: AW: invalid lz4 chunk size?? > > Not sure what "remote" you are talking about. You can remove the file, and dovecot will notice it's absence and update it's indexes if this is maildir++ format. > > If this is sdbox, you need to run `doveadm force-resync -u user FolderName`. > > Aki > > > On 16/03/2022 12:08 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > > > > Hi Aki, > > sure I can delete (or rename) the file(s) in the mail directory. > > Will sync then restore it from remote or should I do this manually? Should I stop dovecot during the process?` I am not very familiar with dovecot yet, as most of the complexity is hidden by mailcow. > > Thanks, Joachim > > > > -----Ursprüngliche Nachricht----- > > Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> > > Gesendet: Wednesday, 16 March 2022 08:38 > > An: Joachim Lindenberg <dovecot(a)lindenberg.one>; dovecot(a)dovecot.org > > Betreff: Re: AW: invalid lz4 chunk size?? > > > > Hi, > > > > looks a lot like your mail file is corrupted. Not much you can do about it other than maybe delete the file? You can try recover it with `doveadm fetch -u someone text uid 1553 mailbox Sent` and then using `doveadm save -u someone -m Sent` to store it back. > > > > Aki > > > > > On 16/03/2022 09:35 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > > > > > > > Nobody that can help? > > > Thanks, > > > Joachim > > > > > > ---------- > > > > > > I am still experiencing the issue. Any suggestion? > > > As I do have replication between two nodes and only one is showing the issue - can I rename the mailbox easily on one side and rely on replication to get the copy replaced? If that makes sense, which commands do you recommend? > > > Thanks, > > > Joachim > > > > > > -----Ursprüngliche Nachricht----- > > > Von: Joachim Lindenberg <dovecot(a)lindenberg.one> > > > Gesendet: Thursday, 3 March 2022 12:06 > > > An: 'Aki Tuomi' <aki.tuomi(a)open-xchange.com>; dovecot(a)dovecot.org > > > Betreff: AW: invalid lz4 chunk size?? > > > > > > dovecot --version reports 2.3.17.1 (476cd46418) Joachim > > > > > > -----Ursprüngliche Nachricht----- > > > Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> > > > Gesendet: Thursday, 3 March 2022 11:56 > > > An: Joachim Lindenberg <dovecot(a)lindenberg.one>; > > > dovecot(a)dovecot.org > > > Betreff: Re: invalid lz4 chunk size?? > > > > > > > > > > On 03/03/2022 12:24 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > > > > > > > > > > Hello, > > > > when accessing one mailbox via ActiveSync / SoGo / Dovecot I get the following error repeatedly in dovecot log: > > > > imap(somemailbox(a)example.org)<1579><***>: Error: Mailbox Sent: > > > > UID=1553: read(compress()) failed: read() failed: lz4.read(): invalid lz4 chunk size: 1601505441 at 16842752 (read reason=) I can still access the mailbox via IMAP though. > > > > What can I do to resolve the issue? > > > > Thanks, > > > > Joachim > > > > > > Which version of Dovecot? > > > > > > Aki

2 1

invalid lz4 chunk size??
by Joachim Lindenberg 16 Mar '22

16 Mar '22

Hello, when accessing one mailbox via ActiveSync / SoGo / Dovecot I get the following error repeatedly in dovecot log: imap(somemailbox(a)example.org)<1579><***>: Error: Mailbox Sent: UID=1553: read(compress()) failed: read() failed: lz4.read(): invalid lz4 chunk size: 1601505441 at 16842752 (read reason=) I can still access the mailbox via IMAP though. What can I do to resolve the issue? Thanks, Joachim

2 7

sieve-filter not respecting :create flag of fileinto
by David Arroyo 16 Mar '22

16 Mar '22

Hello, I recently significantly modified my sieve rules for filing mailing list posts in my Fastmail inbox. The rules contain a few rules that file mail like so: fileinto :create ml.${5}${4}{$3}{$2}{$1}; # reversed list-id The rules work as expected on delivery to fastmail. Because these rules only run on delivery, and the new folder layout is different from my existing one, I want to apply the rules to my existing mail. I thought dovecot's `sieve-filter` command, together with the `imapc` storage backend, would be a good way to do that, so I moved some existing mail into a folder, `sieve-test`, and ran the following: sieve-filter -x '+editheader +mailbox' -W -e rules.sieve sieve-test However, what I see is that sieve-filter fails when the new directory does not exist. Here is some example (redacted) output: Info: imapc(imap.fastmail.com:993): Connected to x.x.x.x:993 (local x.x.x.x) error: msgid=<xxx>: fileinto action: failed to store into mailbox 'ml.gnu.guix-devel': Mailbox does not exist. sieve-filter(me): Info: sieve: msgid=<xxx>: left message in mailbox 'sieve-test' error: sieve script execution failed for this message; message left in source mailbox. sieve-filter(me): Info: sieve: msgid=<yyy>: fileinto action: stored mail into mailbox 'ml.9fans.9fans' My config looks like this: protocols = none mail_location = imapc: namespace { inbox = yes separator = . } imapc_host = imap.fastmail.com imapc_port = 993 imapc_ssl = imaps imapc_user = $username If this is a bug in sieve-filter I'd be happy to try and fix it, but I'm reaching out here first to see if this is expected behavior or a misconfiguration on my part. Thanks for any help, David

2 4

mdbox_rotate_size recommendation / performance
by Lucas Rolff 15 Mar '22

15 Mar '22

Hi guys, When using mdbox under Dovecot, the mdbox_rotate_size setting defaults to 10 megabyte - from a performance point of view if using spinning drives does this matter whether one goes for e.g. 2MB versus 10MB, especially in the combination with compression. Does anyone have any performance data regarding it’s size, and what’s a decent trade-off between limiting IOPS required by the drive versus the sequential read/write speeds. Any pointers would be awesome! Thanks in advance

1 0

AntiVirus in Maildir
by Masakazu Hirose 15 Mar '22

15 Mar '22

Hi all, I run a mail server on Maildir. Does Dovecot work correctly if I delete the mail files stored in Maildir? Do I need to run the doveadm command? I want to run a virus scan on Maildir. When a virus is detected, the mail file is deleted without notifying Dovecot. I assumed this was incorrect behavior for Dovecot. Please help me when someone has time. Thanks, Masa

4 5

allow_nets equivalent for all users?
by Bryan K. Walton 14 Mar '22

14 Mar '22

Hi, It is my understanding that allow_nets is a field that gets used in a password database, and therefore is a per-user setting. Is there an equivalent method for defining allowed network(s) for ALL users? In other words, a single setting that applies to every user? Thanks, Bryan

2 4

Possible bug interaction between Dovecot and Thunderbird 98/99 email client
by Arthur Koziol 11 Mar '22

11 Mar '22

Hi Dovecot devs, My name is Arthur. I'm a volunteer with Mozilla and am working with a user who's having some odd issues with his Thunderbird email client. I'm reaching out to you folks because he's using an at-home IMAP setup with Dovecot. It's not 100% clear if his setup is polling his GMail accounts and then pulling everything to his Dovecot setup but if there's any interesting in jumping into the bug we're trying to help this user with, feel free to browse the bug at https://bugzilla.mozilla.org/show_bug.cgi?id=1726319 I asked the user if he's reached out to the Dovecot devs yet but he's not replied. We're not sure if this is a Dovecot / setup issue, a Thunderbird issue or something in between but we could use some other eyes and ideas of what to check for this user if you guys have a couple seconds to take a look. Thanks for reading. best, Arthur

1 0

Dovecot High Availability ?
by White, Daniel E. (GSFC-770.0)[NICS] 11 Mar '22

11 Mar '22

Are there any current, free high availability strategies for Dovecot ?

2 1

Can't create viable password hashes
by David Griffith 11 Mar '22

11 Mar '22

I recently discovered that I can no longer create viable password hashes for use in /etc/dovecot/dovecot.passwd. So far, I've been using the following command done by root: doveadm_cmd pw -s SHA512-CRYPT -u joe -p mypassword This creates something that looks legit, but dovecot won't accept it. I've been using my own solution for allowing users to change their dovecot passwords (https://gitlab.com/DavidGriffith/dovepasswd) and this is how it generates the hashes. Is there a better way of going about this? -- David Griffith dave(a)661.org A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing in e-mail?

1 0

XOAUTH2 submission - "500 5.5.2 Line too long"
by Rosario Esposito 08 Mar '22

08 Mar '22

Hello, I setup a dovecot submission server, using xoauth2 authentication. My roundcube webmail points to dovecot submission. In roundcube smtp logs, I see: [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 250-PIPELINING [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 250 XCLIENT ADDR PORT PROTO HELO LOGIN SESSION TTL TIMEOUT FORWARD [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Send: AUTH XOAUTH2 dXNlcj1yZXNwb3NpdAFhdXRoPWJlYXJlci<<<...*very long base64 string*....>>> [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 500 5.5.2 Line too long [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Send: ****** [4] [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 221 2.0.0 Bye And, in dovecot logs I found: Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: 250 reply: Sent: 250-###.<#####> 8BITMIME AUTH PLAIN OAUTHBEARER XOAUTH2 BURL imap CHUNKING ENHANCEDSTATUSCODES SIZE PIPELINING XCLIENT ADDR PORT PROTO HELO LOGIN SESSION TTL TIMEOUT FORWARD Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: Finished Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: Destroy Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: 250 reply: Destroy Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Trigger output Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: No more commands pending Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Sending replies Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: No more commands pending Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Client sent invalid command: Command line is too long Apparently, the problem came out after upgrading from dovecot 2.3.17 to 2.3.18 Any ideas ?

3 2

Replicator Issues on Large Mail Boxes
by Paul Kudla (Scom.ca Internet Services Inc.) 08 Mar '22

08 Mar '22

Ok running : freebsd-12.1 dovecot-2.3.18.current dovecot-2.3-pigeonhole-0.5.18.current simply put replication works fine on smaller email boxes without issues. dsync also works when run manually, longest sync is 60 secords or so when using dsync so need replicator bumped up ? i get the fact that the file locking issue relative since a larger mailbox will take longer to replicate when an email comes in ? mail18 03-05 18:05:51 {dovecot} [15799] (872623573) doveadm(keith(a)elirpa.com)<32249><GnS3M53sI2L5fQAAz1jc/w>: Error: Couldn't lock /data/dovecot/users/elirpa.com/keith(a)elirpa.com//tmp/.dovecot-sync.lock: fcntl(/data/dovecot/users/elirpa.com/keith@elirpa.com//tmp/.dovecot-sync.lo…, write-lock, F_SETLKW) locking failed: Timed out after 30 seconds (WRITE lock held by pid 31519) so what i need is where fcntl is setting a 30 second timeout for replication (i have adjust all the others in the src code) simply put replicator fails and retries and keeps failing which is understandable as it probably needs a little more time ? # sync.users carol(a)scom.ca none 00:02:51 08:16:34 - y nick(a)elirpa.com low 02:45:17 09:28:32 - y keith(a)elirpa.com none 02:30:13 09:28:32 - y paul(a)scom.ca high 02:45:17 09:28:32 - y ed(a)scom.ca none 02:34:34 09:28:32 - y ed.hanna(a)dssmgmt.com high 02:45:17 09:28:32 - y i found under /programs/src/mail/dovecot-2.3.18.current/src/lib file-lock.c struct flock fl; fl.l_type = lock_type; fl.l_whence = SEEK_SET; fl.l_start = 0; fl.l_len = 0; ret = fcntl(fd, timeout_secs != 0 ? F_SETLKW : F_SETLK, &fl); if (timeout_secs != 0) { alarm(0); file_lock_wait_end(path); } if (ret == 0) break; if (timeout_secs == 0 && (errno == EACCES || errno == EAGAIN)) { /* locked by another process */ *error_r = t_strdup_printf( "fcntl(%s, %s, F_SETLK) locking failed: %m " "(File is already locked)", path, lock_type_str); return 0; } if (err_is_lock_timeout(started, timeout_secs)) { errno = EAGAIN; *error_r = t_strdup_printf( "fcntl(%s, %s, F_SETLKW) locking failed: " "Timed out after %u seconds%s", path, lock_type_str, timeout_secs, file_lock_find(fd, set->lock_method, lock_type)); return 0; } *error_r = t_strdup_printf("fcntl(%s, %s, %s) locking failed: %m", path, lock_type_str, timeout_secs == 0 ? "F_SETLK" : "F_SETLKW"); if (errno == EDEADLK && !set->allow_deadlock) { i_panic("%s%s", *error_r, file_lock_find(fd, set->lock_method, lock_type)); } return -1; #endif -- Happy Saturday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

Is fts_autoindex_exclude options working fine?
by Alessio Cecchi 07 Mar '22

07 Mar '22

Hi, we have some trouble with Solr ad FTS engine. Solr have some spike of load and responding slow when an user expunge or append a message. fts_autoindex is set to "yes". So I add to 90-plugin.conf these options: fts_autoindex_exclude = Drafts fts_autoindex_exclude2 = Spam fts_autoindex_exclude3 = Trash fts_autoindex_exclude4 = Sent or fts_autoindex_exclude = \Drafts fts_autoindex_exclude2 = \Junk fts_autoindex_exclude3 = \Trash fts_autoindex_exclude4 = \Sent But the problem is still present. Here some example of logs when users have timeout in their email client, specially when saving in Drafts automatically: Mar 7 12:21:37 pop01 dovecot: imap(user1(a)company1.com) session=<flNVCZ/ZcO5dPnGT>: Warning: Maildir /home/vmail/domains/company1.com/user1/Maildir/.Drafts: Synchronization took 119 seconds (0 new msgs, 0 flag change attempts, 1 expunge attempts) Mar 7 12:21:37 pop01 dovecot: imap(user1(a)company1.com) session=<flNVCZ/ZcO5dPnGT>: Disconnected: Connection closed (UID EXPUNGE finished 118.715 secs ago) in=77617 out=679511 deleted=1 expunged=1 autoexpunged=0 trashed=0 appended=2 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Mar 7 12:21:52 pop02 dovecot: imap(user2(a)company2.net) session=<B9NNCZ/Z+uC5Ydlv>: Warning: Maildir /home/vmail/domains/company2.net/user2/Maildir/.Trash: Synchronization took 149 seconds (0 new msgs, 0 flag change attempts, 1 expunge attempts) Mar 7 12:21:52 pop02 dovecot: imap(user2(a)company2.net) session=<B9NNCZ/Z+uC5Ydlv>: Disconnected: Logged out in=2407 out=7025 deleted=0 expunged=0 autoexpunged=1 trashed=0 appended=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Is my fts_autoindex_exclude wrong or there are some limits with this option? Here the relevant part of 15-mailboxes.conf namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / } Thanks -- Alessio Cecchi Postmaster @http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 0

doveadm complains about virtual namespace
by Roberto Sanchez 07 Mar '22

07 Mar '22

Hi, I’ve setup my server __user__nd mail sending/receiving is all working without issue. However, a cron script that cleans up the Junk folder and runs: doveadm expunge -A mailbox Junk savedbefore 60d gives out the following error: doveadm(__user__(a)example.com): Error: Namespace 'Virtual.': Unknown mail storage driver virtual I don’t know if I have a configuration issue or if I have to load the virtual plugin at some other point in the config? I would appreciate any help. This is the output with debug enabled, and further below is my dovecot -n output (I’ve changed the user name to __user__ and the domain to example.com) Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Debug: auth-master: userdb list: Started listing users (user_mask=) Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=10) Debug: auth-master: userdb list: Returned username: __user__(a)example.com doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): Started userdb lookup doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=12) doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): auth USER input: __user__(a)example.com maildir=example.com/__user__/ home=/var/mail/vhosts/example.com/__user__ uid=5000 gid=5000 doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): Finished userdb lookup (username=__user__(a)example.com maildir=example.com/__user__/ home=/var/mail/vhosts/example.com/__user__ uid=5000 gid=5000) doveadm(__user__(a)example.com)<1068593><>: Debug: Added userdb setting: plugin/maildir=example.com/__user__/ doveadm(__user__(a)example.com): Debug: Effective uid=5000, gid=5000, home=/var/mail/vhosts/example.com/__user__ doveadm(__user__(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/vhosts/example.com/__user__/Maildir doveadm(__user__(a)example.com): Debug: maildir++: root=/var/mail/vhosts/example.com/__user__/Maildir, index=, indexpvt=, control=, inbox=/var/mail/vhosts/example.com/__user__/Maildir, alt= doveadm(__user__(a)example.com): Debug: Namespace virtual: type=private, prefix=Virtual., sep=., inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/var/mail/virtual:INDEX=/var/mail/vhosts/example.com/__use… doveadm(__user__(a)example.com): Error: Namespace 'Virtual.': Unknown mail storage driver virtual > dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.16.3-x86_64-linode152 x86_64 Ubuntu 20.04.4 LTS # Hostname: bender.example.com auth_mechanisms = plain login auth_username_format = %u mail_location = maildir:%h/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } namespace virtual { list = yes location = virtual:/var/mail/virtual:INDEX=/var/mail/vhosts/%d/%n/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } mailbox Flagged { auto = subscribe comment = All my flagged messages special_use = \Flagged } prefix = Virtual. separator = . subscriptions = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = file:%h/sieve;active=%h/dovecot.sieve sieve_before = /etc/dovecot/sieve/ } postmaster_address = postmaster at example.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { address = localhost port = 4190 } } service stats { unix_listener stats-reader { group = www-data mode = 0660 user = www-data } unix_listener stats-writer { group = www-data mode = 0660 user = www-data } } ssl = required ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve virtual" postmaster_address = postmaster(a)example.com } protocol lda { mail_plugins = " virtual" } protocol imap { mail_plugins = " virtual" } protocol sieve { mail_plugins = virtual }

3 2

Pigeonhole Sieve: Vacation Extension issue
by Zakaria 05 Mar '22

05 Mar '22

Hi there, I wondered if there is any one who can help me out on this issue. I tried to setup the vacation extension, and it works fine if the Return-Path header and Envelope-From field in Received wasn’t rewritten and contains the actual sender email address which the vacation extension will retrieve from and reply to. Given, I’ve rewritten both headers, to modify TLS connection mailed-by address and I had to revert back to get the vacation extension working, I wondered if there is anyone know how to modify the Sieve settings in Dovecot config for LMTP/LDA and Sieve, or Sieve script rules to retrieve sender email address from From header or any other specific header? If it's not possible, it would be so good if its implemented, it doesn’t seem to be a hard task, so please log this as a feature request. With thanks. Zakaria. Btw, all my prayers and solidarity I send out to Ukraine, Russia and the rest of Europe, and the world, and the sick from this and COVID and alike. We should value one another, Seriously, Putin must urgently stop giving to who want destruction and harm in Europe and manipulating behind the scene such devil affair and leading to this very sickening and unacceptable horror. Palestine deserve justice than preoccupying the world with creating more injustices.

1 0

doveadm quota get hangs for 60 seconds (some analysis done)
by jaroslav＠thinline.cz 05 Mar '22

05 Mar '22

Hello, I encountered somewhat strange behaviour when running doveadm quota get with wildcard username (all usernames are in user@domain format): doveadm -f pager quota get -u *(a)example.domain The command hangs for 60 seconds before returning its result. I tried to dig into the issue a bit using strace and found out that there seems to be some kind of communication mismatch between Dovecot processes. Here is what I found - sorry for the wall of text, strace outputs tend to be large, I tried to reduce them as much as possible. I also tried to draw some conclusions below. This is from strace in the doveadm process, it connects to auth-userdb and requests list of users 1646473083.263021 connect(10, {sa_family=AF_UNIX, sun_path="/run/dovecot/auth-userdb"}, 110) = 0 1646473083.263627 write(10, "VERSION\t1\t0\nLIST\t1\tuser=*(a)example.domain\n", 47) = 47 1646473083.263807 read(10, "VERSION\t1\t1\nSPID\t30012\n", 8192) = 23 1646473084.188212 read(10, "LIST\t1\tuser1@notthat.domain\nLIST\t1\tuser2@another.domain\nLIST\t1\tuser3@also.not\nLIST\t1\t.... This list goes on, the server has over 10000 user accounts. (As a side note, this behaviour struck me as strange - I would expect that the result would be filtered by the server side of the connection, only listing users that match the requested wildcard. I don't know anything about Dovecot internals though, so this might be perfectly normal.) At some point the returned data contain users doveadm is interested in (ie. users that match the wildcard) and requests their information from other Dovecot services, this is an excerpt for a dict service: 1646473084.224608 connect(13, {sa_family=AF_UNIX, sun_path="/run/dovecot/dict"}, 110) = 0 1646473084.225617 write(13, "H2\t2\t0\trelevantuser(a)example.domain\tsqldomainquota\n", 50) = 50 No data are read from FD 10 during this time. When all users are queried, reading from FD 10 resumes 1646473084.274405 read(10, "ifth.domain\nLIST\t1\tuser987(a)domain.six\nLIST\t1\t... At this point though, the process gets stuck: 1646473084.274514 epoll_wait(11, [], 1, 0) = 0 1646473084.274555 read(10, 0x5620076d79dd, 6035) = -1 EAGAIN (Resource temporarily unavailable) 1646473084.274601 epoll_wait(11, [{EPOLLIN, {u32=124338208, u64=94695563280416}}], 1, 155000) = 1 It resumes after 60 seconds, reads some more users and then receives string "DONE" 1646473144.287149 read(10, "LIST\t1\tuser456@domain.seven\nLIST\t1\tuser123@domain.e8\nLIST\t1\tuser7865@dom.nine\n", 6035) = 99 1646473144.287149 read(10, "LIST\t1\t ... ", 5936) = 82 ... 1646473144.294373 epoll_wait(11, [{EPOLLIN, {u32=124338208, u64=94695563280416}}], 1, 155000) = 1 1646473144.307846 read(10, "DONE\t1\t\n", 1611) = 8 Note that at this point the read syscall is no longer trucated. As opposed to reads above, which amounted to 8kB blocks, these are reading few addresses at a time. After the "DONE" string is received, there is no more communication with other Dovecot processes, doveadm prints out results to the console and terminates. Next I investigated the auth process. 1646473083.263121 accept(11, {sa_family=AF_UNIX}, [28->2]) = 23 1646473083.263181 getsockname(23, {sa_family=AF_UNIX, sun_path="/run/dovecot/auth-userdb"}, [28->27]) = 0 1646473083.263690 read(23, "VERSION\t1\t0\nLIST\t1\tuser=*(a)example.domain\n", 1024) = 47 1646473083.263939 connect(24, {sa_family=AF_UNIX, sun_path="auth-worker"}, 110) = 0 1646473083.264228 write(24, "VERSION\tauth-worker\t1\t0\nDBHASH\t1234567890abcdef1234567890abcdef\tfedcba0987654321fedcba0987654321\n", 97) = 97 1646473083.264271 writev(24, [{iov_base="1\t", iov_len=2}, {iov_base="LIST\t1\tuser=*(a)example.domain\tservice=\toriginal-username", iov_len=61}, {iov_base="\n", iov_len=1}], 3) = 64 1646473084.187567 read(24, "1\t*\tuser1(a)notthat.domain\n1\t*\t... 1646473084.187977 write(23, "LIST\t1\tuser1(a)notthat.domain\nLIST\t1\t Reads and writes alternate until these syscalls: 1646473084.238938 read(24, " ... \n1\tOK\n", 8167) = 5354 1646473084.239108 write(23, "LIST\t1\t ... , 51224) = -1 EAGAIN (Resource temporarily unavailable) 1646473084.239536 write(23, "LIST\t1\t ... , 51224) = -1 EAGAIN (Resource temporarily unavailable) From the timing this looks like a kernel buffer for the connection is filled because the other side is not reading the data. This matches strace from doveadm which is at this point reading information about quotas from dict service (timestamp 1646473084.225617.) Auth process seems to react to this by putting the FD on epoll list and then it goes to handle other connections. FD 24 is removed from the epoll list at the same time: 1646473084.239926 epoll_ctl(14, EPOLL_CTL_ADD, 23, {EPOLLOUT|EPOLLERR|EPOLLHUP, {u32=109861328, u64=94566699784656}}) = 0 1646473084.239980 epoll_ctl(14, EPOLL_CTL_DEL, 24, 0x7ffca3a9ae2c) = 0 FD 23 becomes writable relatively quickly, pending data is written to it and read from FD 24 is attempted with no data available: 1646473084.270224 epoll_ctl(14, EPOLL_CTL_DEL, 23, 0x7ffca3a9ae5c) = 0 1646473084.270271 write(23, "LIST\t1\t ... , 51224) = 51224 1646473084.270620 epoll_ctl(14, EPOLL_CTL_ADD, 24, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=109860944, u64=94566699784272}}) = 0 1646473084.270712 read(24, 0x5602069198e3, 2813) = -1 EAGAIN (Resource temporarily unavailable) Again, nothing else happens for 60 seconds until FD 24 signals what I presume is a connection close attempt. Note that there was no data read from FD 24 but when the "SHUTDOWN" string arrives from it, auth process starts writing items to FD 23, one by one. 1646473144.286936 read(24, "SHUTDOWN\n", 2813) = 9 1646473144.287003 write(23, "LIST\t1\tuser456(a)domain.seven\n", 29) = 29 1646473144.287059 write(23, "LIST\t1\tuser123(a)domain.e8\n", 31) = 31 1646473144.287103 write(23, "LIST\t1\tuser7865(a)dom.nine\n", 39) = 39 There are multiple user databases, I assume the following is a lookup from the others: 1646473144.294256 writev(24, [{iov_base="2\t", iov_len=2}, {iov_base="LIST\t2\tuser=*(a)example.domain\tservice=\toriginal-username", iov_len=61}, {iov_base="\n", iov_len=1}], 3) = 64 1646473144.294379 read(24, 0x5602069198ec, 2804) = -1 EAGAIN (Resource temporarily unavailable) 1646473144.300490 read(24, "2\tOK\n", 2804) = 5 1646473144.300556 writev(24, [{iov_base="3\t", iov_len=2}, {iov_base="LIST\t3\tuser=*(a)example.domain\tservice=\toriginal-username", iov_len=61}, {iov_base="\n", iov_len=1}], 3) = 64 1646473144.300653 read(24, 0x5602069198f1, 2799) = -1 EAGAIN (Resource temporarily unavailable) 1646473144.307687 read(24, "3\tOK\n", 2799) = 5 1646473144.307751 write(23, "DONE\t1\t\n", 8) = 8 1646473144.307944 close(24) = 0 1646473144.308092 read(23, "", 977) = 0 1646473144.308185 close(23) = 0 I also looked into the auth-userdb (auth -w) service, it seems to mirror what happens in the auth process: [pid 22387] 1646473083.407660 accept(7, <unfinished ...> [pid 22387] 1646473083.407767 <... accept resumed>{sa_family=AF_UNIX}, [28->2]) = 17 [pid 22387] 1646473084.187096 write(17, "1\t*\tuser1(a)notthat.domain\n1\t*\t [pid 22387] 1646473084.233120 write(17, "1\tOK\n", 5 <unfinished ...> [pid 22387] 1646473084.233577 epoll_ctl(9, EPOLL_CTL_ADD, 17, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=659542480, u64=94356796068304}} <unfinished ...> [pid 22387] 1646473084.234006 read(17, <unfinished ...> [pid 22387] 1646473084.234254 <... read resumed>0x55d12753b7d1, 8031) = -1 EAGAIN (Resource temporarily unavailable) And after 60 seconds: [pid 22387] 1646473144.286843 write(17, "SHUTDOWN\n", 9 <unfinished ...> At which point the other two requests come in and are replied to. As I said above, I don't know anything about Dovecot internals but from I can gather from these outputs, all data are exchanged correctly and nothing gets stuck reading them from a permanent storage or alike. This bug doesn't manifest every time but seems to be fairly deterministic in that it always triggers for some domains but not for others. From what I've noticed, this affected domain receives all its users in single 8k read in the doveadm process, which in turns triggers (relatively) lengthy lookups and forces the auth process to put more writes on hold (at timestamp 1646473084.239108) Is it possible that when this happens, the "OK" string received from auth-userdb process (timestamp 1646473084.238938) is overlooked and auth process is waiting for more data from auth-userdb while auth-userdb waits for another request? The server itself runs Dovecot 1:2.3.13+dfsg1-2 from Debian repository on amd64. Output from dovecot --version is 2.3.13 (89f716dc2). As far as I can see, nothing indicates this is a performance problem related to insufficient hardware - server runs at 25% CPU utilization average, Pressure Stall Information reports average of 0.5% for CPU, 1% for I/O. System memory used is 10 out of 64GB. As far as I can see, no Dovecot process becomes CPU-bound when doveadm is running. I tried some web search but found nothing related to this. For our purposes, this issue has a relatively simple workaround - using doveadm quota get on specific usernames instead of the wildcard one. Since this might be an issue with a relatively easy fix for someone who knows where to look, I decided to post this bug report anyway. If needed, I should be able to test patches that apply cleanly to Debian sources and compile with dpkg-buildpackage. Thanks

1 0

Dupliate-ish email search?
by ＠lbutlr 04 Mar '22

04 Mar '22

I'm mulling over writing some code to find emails in a maildir that are duplicates, ish. That is to say that sometimes the same message doesn't quite show up as an exact match. Like some ad company may send you three identical messages, except they aren't actually EXACTLY identical, the message-IDs are different, and may the to address quoted part is different, so normal duplicate finders fail to find them. Before I start, is this a solved problem? -- I thought that they were angels, but to my surprise, we climbed aboard their starship, we headed for the skies.

3 2

Issue in 2.3.18 with fts_header_excludes/includes
by Alessio Cecchi 03 Mar '22

03 Mar '22

Hi, I'm still doing some test with fts-flatcurve, after updating to 2.3.18 I enabled: fts_header_excludes = * fts_header_includes = From To Cc Bcc Subject Message-ID but when I try to re-index all messages with FTS flatcurve the fts-flatcurve/ folder inside the Maildir/ become huge. Taking for example a Maildir with cur folder of 1.1G the related fts-flatcurve folder passed from 140M to 2.2G. After remove fts_header_excludes/includes config options, and re-index all messages, the fts-flatcurve/ size return to normal size. Is an issue? Thanks -- Alessio Cecchi Postmaster @http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 1

Does disabling POP3 just mean removing it from the `protocols` list?
by Sean McBride 02 Mar '22

02 Mar '22

Hi all, Hopefully a simple question. If I want to disable POP3 support (because everyone is using IMAP anyway), it is just a matter of removing `pop3` from the `protocols` setting in dovecot.conf? Are there side effects or other considerations I should be aware of? Thanks, Sean

7 9

multiple doveadm ports?
by Joachim Lindenberg 02 Mar '22

02 Mar '22

Hello, I am trying to add another doveadm listener but am struggling with that. The primary reason is that I want to enable replication between two systems and want the replication to be encrypted using TLS. However there are also other doveadm clients locally that are not using TLS and I don´t want to touch all of them. I tried to define something like service doveadm { inet_listener { port = 2425 } inet_listener { port = 2426 ssl = true } } But didn´t get that to work. Is that not possible? I also tried service doveadm { inet_listener { port = 2425 } inet_listener http { port = 2426 ssl = yes } } but then I failed with plugin { mail_replica = https:dove2.example.com:2426 } Can someone please share what is supported and what not, or any pointer to documentation that does? Thanks a lot! Regards, Joachim

2 4

Apple Mail behaviour: can not create sub-folders
by Joseph Tam 02 Mar '22

02 Mar '22

One of my Apple Mail users recently complained his mail reader couldn't create sub-folders -- he could only create top-level folders. Playing around with this, I discovered that I could create folders ( as opposed to mialboxes) *if* I specified mailbox name with a trailing slash. Has anyone come across this? Is this related to https://doc.dovecot.org/configuration_manual/mail_location/mbox/mboxchildfo… ? Joseph Tam <jtam.home(a)gmail.com>

2 2

Re: dovecot Digest, Vol 212, Issue 56
by Korehicom 01 Mar '22

01 Mar '22

1 0

Custom Authentication Method
by Matthew R 01 Mar '22

01 Mar '22

Hi guys, we're using Dovecot/Postfix here for our mail system. I'd like to switch the `passdb` authentication on Dovecot from PAM over to a custom implementation. We'd prefer to have some sort of script check the password with an external IAM provider via HTTP. Is there any way we can accomplish this? The idea is to have Dovecot somehow call a script or send a username/password to some service, which checks the username/password against the identity provider and returns a "yes/no" back to Dovecot. `checkpassword` seems like it may work but I see no documentation on its API. Matthew R, AD, FSEN, FSO, FSCR Chief Director of Engineering & Chairman of the Board of Directors Library of Code sp-us matthew(a)staff.libraryofcode.org

3 2

General Locking & Replication Issues
by Paul Kudla (Scom.ca Internet Services Inc.) 01 Mar '22

01 Mar '22

Ok I am running two dovecot servers and feel pretty close to getting things resolved config wise there are however 2 or 3 issues that all seem to be related i have enclosed FULL config files for both mail18.scom.ca & mail19.scom.ca I have a private network that is used for the replication (10.221.0.0/24) - port 12345 is blocked by pf firewall from outside. I am running freebsd 12.1 and built one server and then raid copied it to the second (mail19) so all the ports / builds etc are identical I did start with dovecot-2.3.14 but pigeonhole would not build on freebsd (thanks for that advice / reply )until upgrade to dovecot-2.3.18 dovecot-2.3.18 was built and installed on both servers along with a good build (freebsd build error was fixed after upgrading) dovecot-2.3-pigeonhole-0.5.18 please note that the second mailserver (mail19) is on an nfs share dedicated to the server (i am awaiting sdram drives to replace this issue) but since i am getting errors on both servers i feel nfs share is not the issue (and yes i enabled dlock) mail18 is on normal sdram drives (more of an fyi as i dont think this is the issue) neither mail server is connected to the other in any kind of a shared way - other then replication postfix should be delivering via : pipe -n dovecot -t unix flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${recipient} Replication only works properly at startup (ie the mail boxes do sync), afterwhich nothing seems to trigger the differences between the servers to update (notify i believe) manually running : [05:04:46] mail18.scom.ca [root:0] /usr/local/etc/dovecot # doveadm sync -u paul(a)scom.ca remote:10.221.0.19 & [05:21:18] mail19.scom.ca [root:0] /usr/local/etc/dovecot # doveadm sync -u paul(a)scom.ca remote:10.221.0.18 does seem to work but with mixed results. I also included postfix main.cf & master.cf as well as some googling has indicated the file locking may be on the postfix side ?? Also more then happy to donate just can not figure out how ??? so that being said : General logging errors are as follows ? [04:46:43] peer1.scom.ca [paul:0] /home/paul ## log dovecot rror Filtering by : dovecot & rror mail18 02-28 04:46:58 {dovecot} [30374] (859753649) doveadm(ed(a)scom.ca)<30486><SUtDJMGZHGIWdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:47:00 {dovecot} [22194] (859753669) doveadm(paul(a)scom.ca)<22219><KQzDNbyZHGLLVgAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:47:05 {dovecot} [30374] (859753724) doveadm(ed.hanna(a)dssmgmt.com)<30484><0dYbI8G ZHGIUdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:47:14 {dovecot} [30374] (859753799) doveadm(paul(a)scom.ca)<30485><W/KsI8GZHGIVdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:47:57 {dovecot} [30374] (859754250) doveadm(paul(a)paulkudla.net)<30676></v6tIASaH GLUdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:49:05 {dovecot} [30374] (859754939) doveadm(keith(a)elirpa.com)<30675><aasfIASaHGL TdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:54:45 {dovecot} [22194] (859759457) doveadm(paul(a)paulkudla.net)<22533><m1NpN4GbH GIFWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:55:07 {dovecot} [22194] (859759868) doveadm(ed(a)scom.ca)<22535><UrLTOYGbHGIHWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:55:28 {dovecot} [22194] (859760130) doveadm(ed.hanna(a)dssmgmt.com)<22534><kc2dOIG bHGIGWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:58:52 {dovecot} [22194] (859762842) replicator: Error: Raw backtrace: #0 fatal_handler_real[0x11370e50] -> #1 i_internal_fatal_handler[0x11370f80] -> #2 i_panic[0x112c4456] -> #3 mem_block_alloc.cold[0x112c3d0d] -> #4 t_malloc_real[0x1136a420] -> #5 pool_data_stack_realloc[0x113905f0] -> #6 buffer_alloc[0x11366060] -> #7 buffer_append[0x11366390] -> #8 replicator_queue_push[0x01026fb0] -> #9 dsync_callback[0x01026730] -> #10 dsync_callback[0x01025e60] -> #11 dsync_input[0x010 mail19 02-28 04:58:52 {dovecot} [22194] (859762844) replicator: Error: 0x11388360] -> #14 io_loop_handler_run[0x11386fb0] -> #15 io_loop_run[0x11387130] -> #16 master_service_run[0x112f9c00] -> #17 main[0x01024de0] -> #18 _start[0x01024ff0] -> #19 [unw_get_proc_name() failed: -1] mail19 02-28 04:58:55 {dovecot} [22194] (859762875) doveadm(keith(a)elirpa.com)<22532><zxU4NoGbHGI EWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds Dovecot config for mail18.scom.ca (server - 1) [05:03:57] mail18.scom.ca [root:0] /usr/local/etc/dovecot # cat dovecot.conf # 2.3.14 (cee3cbc0d): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 12.1-RELEASE amd64 # Hostname: mail18.scom.ca auth_debug = no auth_debug_passwords = no mail_debug = no #lock_method = dotlock #mail_max_lock_timeout = 300s #mbox_read_locks = dotlock #mbox_write_locks = dotlock mmap_disable = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /data/dovecot/run/ debug_log_path = syslog disable_plaintext_auth = no dsync_features = empty-header-workaround #imapc_features = rfc822.size fetch-headers #imapc_host = mail.scom.ca #imapc_password = Pk554669 #imapc_user = paul(a)scom.ca info_log_path = syslog login_greeting = SCOM.CA Internet Services Inc. - Dovecot ready login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_location = maildir:~/ mail_plugins = " virtual" mail_prefetch_count = 20 protocols = imap pop3 sieve mail_plugins = $mail_plugins notify replication protocol lmtp { mail_plugins = $mail_plugins notify replication sieve } protocol lda { mail_plugins = $mail_plugins notify replication sieve } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } doveadm_port = 12345 doveadm_password = secretxxxx service doveadm { inet_listener { port = 12345 } } #dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u #dsync_remote_cmd = doveadm sync -d -u%u replication_dsync_parameters = -d -N -l 30 -U plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid, box, msgid, from, subject, size, vsize, flags sieve = file:~/sieve/sieve;active=~/sieve/.dovecot.sieve sieve_duplicate_default_period = 1h sieve_duplicate_max_period = 1d mail_replica = tcp:10.221.0.19 #mail_replica = remote:10.221.0.19 replication_sync_timeout = 2 } service anvil { unix_listener anvil { group = vmail mode = 0666 } } service auth { unix_listener /usr/home/postfix/private/auth { mode = 0660 user = postfix group = postfix } } service stats { unix_listener stats-reader { group = vmail mode = 0660 } unix_listener stats-writer { group = vmail mode = 0660 } } userdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } protocol imap { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } protocol pop3 { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } service managesieve-login { inet_listener sieve { port = 4190 } } verbose_proctitle = yes replication_max_conns = 10 replication_full_sync_interval = 30m service replicator { unix_listener replicator-doveadm { mode = 0666 user = vmail } } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } #Addition ssl config !include sni.conf And dovecot-pgsql.conf file (same on both servers) : driver = pgsql connect = host=localhost port=5433 dbname=scom_billing user=pgsql password=Scom411400 default_pass_scheme = PLAIN password_query = SELECT username as user, password FROM email_users WHERE username = '%u' and password <> 'alias' and status = True and destination = '%u' user_query = SELECT home, uid, gid FROM email_users WHERE username = '%u' and password <> 'alias' and status = True and destination = '%u' iterate_query = SELECT user, password FROM email_users WHERE username = '%u' and password <> 'alias' and status = True and destination = '%u' Mail 19 dovecot config file : [05:05:40] mail19.scom.ca [root:0] /usr/local/etc/dovecot # cat dovecot.conf # 2.3.14 (cee3cbc0d): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 12.1-RELEASE amd64 # Hostname: mail19.scom.ca auth_debug = no auth_debug_passwords = no mail_debug = no #lock_method = dotlock #mail_max_lock_timeout = 5s #mbox_read_locks = dotlock #mbox_write_locks = dotlock mmap_disable = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /data/dovecot/run/ debug_log_path = syslog disable_plaintext_auth = no dsync_features = empty-header-workaround #imapc_features = rfc822.size fetch-headers #imapc_host = mail.scom.ca #imapc_password = Pk554669 #imapc_user = paul(a)scom.ca info_log_path = syslog login_greeting = SCOM.CA Internet Services Inc. - Dovecot ready login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_location = maildir:~/ mail_plugins = " virtual" mail_prefetch_count = 20 mail_plugins = $mail_plugins notify replication protocols = imap pop3 sieve protocol lmtp { mail_plugins = $mail_plugins notify replication sieve } protocol lda { mail_plugins = $mail_plugins notify replication sieve } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } doveadm_port = 12345 doveadm_password = secretxxxx service doveadm { inet_listener { port = 12345 } } #dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u #dsync_remote_cmd = doveadm sync -d -u%u replication_dsync_parameters = -d -N -l 30 -U plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid, box, msgid, from, subject, size, vsize, flags sieve = file:~/sieve/sieve;active=~/sieve/.dovecot.sieve sieve_duplicate_default_period = 1h sieve_duplicate_max_period = 1d mail_replica = tcp:10.221.0.18 #mail_replica = remote:vmail@10.221.0.18 replication_sync_timeout = 2 } service anvil { unix_listener anvil { group = vmail mode = 0666 } } service auth { unix_listener /usr/home/postfix/private/auth { mode = 0660 user = postfix group = postfix } } service stats { unix_listener stats-reader { group = vmail mode = 0660 } unix_listener stats-writer { group = vmail mode = 0660 } } userdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } protocol imap { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } protocol pop3 { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } service managesieve-login { inet_listener sieve { port = 4190 } } verbose_proctitle = yes replication_max_conns = 10 replication_full_sync_interval = 30m service replicator { unix_listener replicator-doveadm { mode = 0666 user = vmail } } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service replicator { unix_listener replicator-doveadm { mode = 0600 user = vmail } } replication_dsync_parameters = -d -N -l 30 -U #Addition ssl config !include sni.conf sni.conf file (same on both servers) : #sni.conf ssl = yes verbose_ssl = yes ssl_dh =</usr/local/etc/dovecot/dh-4096.pem ssl_prefer_server_ciphers = yes #ssl_min_protocol = TLSv1.2 #Default *.scom.ca ssl_key =</usr/local/etc/dovecot/scom.pem ssl_cert =</usr/local/etc/dovecot/scom.pem ssl_ca =</usr/local/etc/dovecot/scom.pem local_name .scom.ca { ssl_key = /programs/common/getssl.cert -c *.scom.ca -q yes ssl_cert = /programs/common/getssl.cert -c *.scom.ca -q yes ssl_ca = /programs/common/getssl.cert -c *.scom.ca -q yes } local_name mail.clancyca.com { ssl_key = /programs/common/getssl.cert -c mail.clancyca.com -q yes ssl_cert = /programs/common/getssl.cert -c mail.clancyca.com -q yes ssl_ca = /programs/common/getssl.cert -c mail.clancyca.com -q yes } local_name secure.clancyca.com { ssl_key = /programs/common/getssl.cert -c secure.clancyca.com -q yes ssl_cert = /programs/common/getssl.cert -c secure.clancyca.com -q yes ssl_ca = /programs/common/getssl.cert -c secure.clancyca.com -q yes } local_name mail.paulkudla.net { ssl_key = /programs/common/getssl.cert -c mail.paulkudla.net -q yes ssl_cert = /programs/common/getssl.cert -c mail.paulkudla.net -q yes ssl_ca = /programs/common/getssl.cert -c mail.paulkudla.net -q yes } local_name mail.ekst.ca { ssl_key = /programs/common/getssl.cert -c mail.ekst.ca -q yes ssl_cert = /programs/common/getssl.cert -c mail.ekst.ca -q yes ssl_ca = /programs/common/getssl.cert -c mail.ekst.ca -q yes } local_name mail.hamletdevelopments.ca { ssl_key = /programs/common/getssl.cert -c mail.hamletdevelopments.ca -q yes ssl_cert = /programs/common/getssl.cert -c mail.hamletdevelopments.ca -q yes ssl_ca = /programs/common/getssl.cert -c mail.hamletdevelopments.ca -q yes } Postfix main.cf (same on both servers) [05:15:03] mail19.scom.ca [root:0] /usr/home/postfix.local/config # cat main.cf # Global Postfix configuration file. This file lists only a subset # of all parameters. For the syntax, and for a complete parameter # list, see the postconf(5) manual page (command: "man 5 postconf"). # # For common configuration examples, see BASIC_CONFIGURATION_README # and STANDARD_CONFIGURATION_README. To find these documents, use # the command "postconf html_directory readme_directory", or go to # http://www.postfix.org/. # # For best results, change no more than 2-3 parameters at a time, # and test if Postfix still works after every change. alternate_config_directories = /usr/home/postfix/config data_directory = /var/lib/postfix.local maillog_file = /var/log/postfix.local compatibility_level=2 #compatibility_level=3.6 # SOFT BOUNCE # # The soft_bounce parameter provides a limited safety net for # testing. When soft_bounce is enabled, mail will remain queued that # would otherwise bounce. This parameter disables locally-generated # bounces, and prevents the SMTP server from rejecting mail permanently # (by changing 5xx replies into 4xx replies). However, soft_bounce # is no cure for address rewriting mistakes or mail routing mistakes. # soft_bounce = no #relayhost = 216.106.96.23 # LOCAL PATHNAME INFORMATION # # The queue_directory specifies the location of the Postfix queue. # This is also the root directory of Postfix daemons that run chrooted. # See the files in examples/chroot-setup for setting up Postfix chroot # environments on different UNIX systems. # queue_directory = /usr/home/postfix.local # The command_directory parameter specifies the location of all # postXXX commands. # command_directory = /usr/local/sbin # The daemon_directory parameter specifies the location of all Postfix # daemon programs (i.e. programs listed in the master.cf file). This # directory must be owned by root. # daemon_directory = /usr/local/libexec/postfix # QUEUE AND PROCESS OWNERSHIP # # The mail_owner parameter specifies the owner of the Postfix queue # and of most Postfix daemon processes. Specify the name of a user # account THAT DOES NOT SHARE ITS USER OR GROUP ID WITH OTHER ACCOUNTS # AND THAT OWNS NO OTHER FILES OR PROCESSES ON THE SYSTEM. In # particular, don't specify nobody or daemon. PLEASE USE A DEDICATED # USER. # mail_owner = postfix # The default_privs parameter specifies the default rights used by # the local delivery agent for delivery to external file or command. # These rights are used in the absence of a recipient user context. # DO NOT SPECIFY A PRIVILEGED USER OR THE POSTFIX OWNER. # #default_privs = nobody # INTERNET HOST AND DOMAIN NAMES # # The myhostname parameter specifies the internet hostname of this # mail system. The default is to use the fully-qualified domain name # from gethostname(). $myhostname is used as a default value for many # other configuration parameters. # #myhostname = localhost myhostname = mail19.scom.ca # The mydomain parameter specifies the local internet domain name. # The default is to use $myhostname minus the first component. # $mydomain is used as a default value for many other configuration # parameters. # #mydomain = localhost mydomain = mail19.scom.ca # SENDING MAIL # # The myorigin parameter specifies the domain that locally-posted # mail appears to come from. The default is to append $myhostname, # which is fine for small sites. If you run a domain with multiple # machines, you should (1) change this to $mydomain and (2) set up # a domain-wide alias database that aliases each user to # user(a)that.users.mailhost. # # For the sake of consistency between sender and recipient addresses, # myorigin also specifies the default domain name that is appended # to recipient addresses that have no @domain part. # myorigin = $myhostname #myorigin = $mydomain # RECEIVING MAIL # The inet_interfaces parameter specifies the network interface # addresses that this mail system receives mail on. By default, # the software claims all active interfaces on the machine. The # parameter also controls delivery of mail to user(a)[ip.address]. # # See also the proxy_interfaces parameter, for network addresses that # are forwarded to us via a proxy or network address translator. # # Note: you need to stop/start Postfix when this parameter changes. # inet_interfaces = 127.0.0.1 #inet_interfaces = $myhostname #inet_interfaces = $myhostname, localhost, 76.74.132.2 #inet_interfaces = mail.dsl.scom.ca, dsl.scom.ca # The proxy_interfaces parameter specifies the network interface # addresses that this mail system receives mail on by way of a # proxy or network address translation unit. This setting extends # the address list specified with the inet_interfaces parameter. # # You must specify your proxy/NAT addresses when your system is a # backup MX host for other domains, otherwise mail delivery loops # will happen when the primary MX host is down. # #proxy_interfaces = #proxy_interfaces = 1.2.3.4 # The mydestination parameter specifies the list of domains that this # machine considers itself the final destination for. # # These domains are routed to the delivery agent specified with the # local_transport parameter setting. By default, that is the UNIX # compatible delivery agent that lookups all recipients in /etc/passwd # and /etc/aliases or their equivalent. # # The default is $myhostname + localhost.$mydomain. On a mail domain # gateway, you should also include $mydomain. # # Do not specify the names of virtual domains - those domains are # specified elsewhere (see VIRTUAL_README). # # Do not specify the names of domains that this machine is backup MX # host for. Specify those names via the relay_domains settings for # the SMTP server, or use permit_mx_backup if you are lazy (see # STANDARD_CONFIGURATION_README). # # The local machine is always the final destination for mail addressed # to user(a)[the.net.work.address] of an interface that the mail system # receives mail on (see the inet_interfaces parameter). # # Specify a list of host or domain names, /file/name or type:table # patterns, separated by commas and/or whitespace. A /file/name # pattern is replaced by its contents; a type:table is matched when # a name matches a lookup key (the right-hand side is ignored). # Continue long lines by starting the next line with whitespace. # # See also below, section "REJECTING MAIL FOR UNKNOWN LOCAL USERS". # #mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain #mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain, # mail.$mydomain, www.$mydomain, ftp.$mydomain # REJECTING MAIL FOR UNKNOWN LOCAL USERS # # The local_recipient_maps parameter specifies optional lookup tables # with all names or addresses of users that are local with respect # to $mydestination, $inet_interfaces or $proxy_interfaces. # # If this parameter is defined, then the SMTP server will reject # mail for unknown local users. This parameter is defined by default. # # To turn off local recipient checking in the SMTP server, specify # local_recipient_maps = (i.e. empty). # # The default setting assumes that you use the default Postfix local # delivery agent for local delivery. You need to update the # local_recipient_maps setting if: # # - You define $mydestination domain recipients in files other than # /etc/passwd, /etc/aliases, or the $virtual_alias_maps files. # For example, you define $mydestination domain recipients in # the $virtual_mailbox_maps files. # # - You redefine the local delivery agent in master.cf. # # - You redefine the "local_transport" setting in main.cf. # # - You use the "luser_relay", "mailbox_transport", or "fallback_transport" # feature of the Postfix local delivery agent (see local(8)). # # Details are described in the LOCAL_RECIPIENT_README file. # # Beware: if the Postfix SMTP server runs chrooted, you probably have # to access the passwd file via the proxymap service, in order to # overcome chroot restrictions. The alternative, having a copy of # the system passwd file in the chroot jail is just not practical. # # The right-hand side of the lookup tables is conveniently ignored. # In the left-hand side, specify a bare username, an @domain.tld # wild-card, or specify a user(a)domain.tld address. # local_recipient_maps = unix:passwd.byname $alias_maps #local_recipient_maps = proxy:unix:passwd.byname $alias_maps #local_recipient_maps = # The unknown_local_recipient_reject_code specifies the SMTP server # response code when a recipient domain matches $mydestination or # ${proxy,inet}_interfaces, while $local_recipient_maps is non-empty # and the recipient address or address local-part is not found. # # The default setting is 550 (reject mail) but it is safer to start # with 450 (try again later) until you are certain that your # local_recipient_maps settings are OK. # #unknown_local_recipient_reject_code = 450 #Set by Mailscanner # TRUST AND RELAY CONTROL # The mynetworks parameter specifies the list of "trusted" SMTP # clients that have more privileges than "strangers". # # In particular, "trusted" SMTP clients are allowed to relay mail # through Postfix. See the smtpd_recipient_restrictions parameter # in postconf(5). # # You can specify the list of "trusted" network addresses by hand # or you can let Postfix do it for you (which is the default). # # By default (mynetworks_style = subnet), Postfix "trusts" SMTP # clients in the same IP subnetworks as the local machine. # On Linux, this does works correctly only with interfaces specified # with the "ifconfig" command. # # Specify "mynetworks_style = class" when Postfix should "trust" SMTP # clients in the same IP class A/B/C networks as the local machine. # Don't do this with a dialup site - it would cause Postfix to "trust" # your entire provider's network. Instead, specify an explicit # mynetworks list by hand, as described below. # # Specify "mynetworks_style = host" when Postfix should "trust" # only the local machine. # #mynetworks_style = class #mynetworks_style = subnet #mynetworks_style = host # Alternatively, you can specify the mynetworks list by hand, in # which case Postfix ignores the mynetworks_style setting. # # Specify an explicit list of network/netmask patterns, where the # mask specifies the number of bits in the network part of a host # address. # # You can also specify the absolute pathname of a pattern file instead # of listing the patterns here. Specify type:table for table-based lookups # (the value on the table right-hand side is not used). # mynetworks = 127.0.0.0/8 65.39.148.0/26 10.220.0.0/16 10.221.0.0/16 #mynetworks = $config_directory/mynetworks #mynetworks = hash:/usr/local/etc/postfix/network_table # The relay_domains parameter restricts what destinations this system will # relay mail to. See the smtpd_recipient_restrictions description in # postconf(5) for detailed information. # # By default, Postfix relays mail # - from "trusted" clients (IP address matches $mynetworks) to any destination, # - from "untrusted" clients to destinations that match $relay_domains or # subdomains thereof, except addresses with sender-specified routing. # The default relay_domains value is $mydestination. # # In addition to the above, the Postfix SMTP server by default accepts mail # that Postfix is final destination for: # - destinations that match $inet_interfaces or $proxy_interfaces, # - destinations that match $mydestination # - destinations that match $virtual_alias_domains, # - destinations that match $virtual_mailbox_domains. # These destinations do not need to be listed in $relay_domains. # # Specify a list of hosts or domains, /file/name patterns or type:name # lookup tables, separated by commas and/or whitespace. Continue # long lines by starting the next line with whitespace. A file name # is replaced by its contents; a type:name table is matched when a # (parent) domain appears as lookup key. # # NOTE: Postfix will not automatically forward mail for domains that # list this system as their primary or backup MX host. See the # permit_mx_backup restriction description in postconf(5). # relay_domains = $mydestination # INTERNET OR INTRANET # The relayhost parameter specifies the default host to send mail to # when no entry is matched in the optional transport(5) table. When # no relayhost is given, mail is routed directly to the destination. # # On an intranet, specify the organizational domain name. If your # internal DNS uses no MX records, specify the name of the intranet # gateway host instead. # # In the case of SMTP, specify a domain, host, host:port, [host]:port, # [address] or [address]:port; the form [host] turns off MX lookups. # # If you're connected via UUCP, see also the default_transport parameter. # #relayhost = [gateway.my.domain] #relayhost = [mailserver.isp.tld] #relayhost = uucphost #relayhost = [an.ip.add.ress] # REJECTING UNKNOWN RELAY USERS # # The relay_recipient_maps parameter specifies optional lookup tables # with all addresses in the domains that match $relay_domains. # # If this parameter is defined, then the SMTP server will reject # mail for unknown relay users. This feature is off by default. # # The right-hand side of the lookup tables is conveniently ignored. # In the left-hand side, specify an @domain.tld wild-card, or specify # a user(a)domain.tld address. # #relay_recipient_maps = hash:/usr/local/etc/postfix/relay_recipients # INPUT RATE CONTROL # # The in_flow_delay configuration parameter implements mail input # flow control. This feature is turned on by default, although it # still needs further development (it's disabled on SCO UNIX due # to an SCO bug). # # A Postfix process will pause for $in_flow_delay seconds before # accepting a new message, when the message arrival rate exceeds the # message delivery rate. With the default 100 SMTP server process # limit, this limits the mail inflow to 100 messages a second more # than the number of messages delivered per second. # # Specify 0 to disable the feature. Valid delays are 0..10. # #in_flow_delay = 1s # ADDRESS REWRITING # # The ADDRESS_REWRITING_README document gives information about # address masquerading or other forms of address rewriting including # username->Firstname.Lastname mapping. # ADDRESS REDIRECTION (VIRTUAL DOMAIN) # # The VIRTUAL_README document gives information about the many forms # of domain hosting that Postfix supports. # "USER HAS MOVED" BOUNCE MESSAGES # # See the discussion in the ADDRESS_REWRITING_README document. # TRANSPORT MAP # # See the discussion in the ADDRESS_REWRITING_README document. # ALIAS DATABASE # # The alias_maps parameter specifies the list of alias databases used # by the local delivery agent. The default list is system dependent. # # On systems with NIS, the default is to search the local alias # database, then the NIS alias database. See aliases(5) for syntax # details. # # If you change the alias database, run "postalias /etc/aliases" (or # wherever your system stores the mail alias file), or simply run # "newaliases" to build the necessary DBM or DB file. # # It will take a minute or so before changes become visible. Use # "postfix reload" to eliminate the delay. # #alias_maps = dbm:/etc/aliases alias_maps = hash:/usr/home/postfix/config/aliases #alias_maps = hash:/etc/aliases, nis:mail.aliases #alias_maps = netinfo:/aliases # The alias_database parameter specifies the alias database(s) that # are built with "newaliases" or "sendmail -bi". This is a separate # configuration parameter, because alias_maps (see above) may specify # tables that are not necessarily all under control by Postfix. # #alias_database = dbm:/etc/aliases #alias_database = dbm:/etc/mail/aliases alias_database = hash:/etc/postfix/aliases #alias_database = hash:/etc/aliases, hash:/opt/majordomo/aliases # ADDRESS EXTENSIONS (e.g., user+foo) # # The recipient_delimiter parameter specifies the separator between # user names and address extensions (user+foo). See canonical(5), # local(8), relocated(5) and virtual(5) for the effects this has on # aliases, canonical, virtual, relocated and .forward file lookups. # Basically, the software tries user+foo and .forward+foo before # trying user and .forward. # recipient_delimiter = + # DELIVERY TO MAILBOX # # The home_mailbox parameter specifies the optional pathname of a # mailbox file relative to a user's home directory. The default # mailbox file is /var/spool/mail/user or /var/mail/user. Specify # "Maildir/" for qmail-style delivery (the / is required). # #home_mailbox = Mailbox #home_mailbox = Maildir/ # The mail_spool_directory parameter specifies the directory where # UNIX-style mailboxes are kept. The default setting depends on the # system type. # #mail_spool_directory = /var/mail # The mailbox_command parameter specifies the optional external # command to use instead of mailbox delivery. The command is run as # the recipient with proper HOME, SHELL and LOGNAME environment settings. # Exception: delivery for root is done as $default_user. # # Other environment variables of interest: USER (recipient username), # EXTENSION (address extension), DOMAIN (domain part of address), # and LOCAL (the address localpart). # # Unlike other Postfix configuration parameters, the mailbox_command # parameter is not subjected to $parameter substitutions. This is to # make it easier to specify shell syntax (see example below). # # Avoid shell meta characters because they will force Postfix to run # an expensive shell process. Procmail alone is expensive enough. # # IF YOU USE THIS TO DELIVER MAIL SYSTEM-WIDE, YOU MUST SET UP AN # ALIAS THAT FORWARDS MAIL FOR ROOT TO A REAL USER. # #mailbox_command = /some/where/procmail #mailbox_command = /some/where/procmail -a "$EXTENSION" # The mailbox_transport specifies the optional transport in master.cf # to use after processing aliases and .forward files. This parameter # has precedence over the mailbox_command, fallback_transport and # luser_relay parameters. # # Specify a string of the form transport:nexthop, where transport is # the name of a mail delivery transport defined in master.cf. The # :nexthop part is optional. For more details see the sample transport # configuration file. # # NOTE: if you use this feature for accounts not in the UNIX password # file, then you must update the "local_recipient_maps" setting in # the main.cf file, otherwise the SMTP server will reject mail for # non-UNIX accounts with "User unknown in local recipient table". # mailbox_transport = dovecot # The fallback_transport specifies the optional transport in master.cf # to use for recipients that are not found in the UNIX passwd database. # This parameter has precedence over the luser_relay parameter. # # Specify a string of the form transport:nexthop, where transport is # the name of a mail delivery transport defined in master.cf. The # :nexthop part is optional. For more details see the sample transport # configuration file. # # NOTE: if you use this feature for accounts not in the UNIX password # file, then you must update the "local_recipient_maps" setting in # the main.cf file, otherwise the SMTP server will reject mail for # non-UNIX accounts with "User unknown in local recipient table". # #fallback_transport = lmtp:unix:/file/name #fallback_transport = cyrus #fallback_transport = # The luser_relay parameter specifies an optional destination address # for unknown recipients. By default, mail for unknown@$mydestination, # unknown@[$inet_interfaces] or unknown@[$proxy_interfaces] is returned # as undeliverable. # # The following expansions are done on luser_relay: $user (recipient # username), $shell (recipient shell), $home (recipient home directory), # $recipient (full recipient address), $extension (recipient address # extension), $domain (recipient domain), $local (entire recipient # localpart), $recipient_delimiter. Specify ${name?value} or # ${name:value} to expand value only when $name does (does not) exist. # # luser_relay works only for the default Postfix local delivery agent. # # NOTE: if you use this feature for accounts not in the UNIX password # file, then you must specify "local_recipient_maps =" (i.e. empty) in # the main.cf file, otherwise the SMTP server will reject mail for # non-UNIX accounts with "User unknown in local recipient table". # #luser_relay = $user(a)other.host #luser_relay = $local(a)other.host #luser_relay = admin+$local # JUNK MAIL CONTROLS # # The controls listed here are only a very small subset. The file # SMTPD_ACCESS_README provides an overview. # The header_checks parameter specifies an optional table with patterns # that each logical message header is matched against, including # headers that span multiple physical lines. # # By default, these patterns also apply to MIME headers and to the # headers of attached messages. With older Postfix versions, MIME and # attached message headers were treated as body text. # # For details, see "man header_checks". # #header_checks = regexp:/usr/local/etc/postfix/header_checks #Divert to Hold Queue #header_checks = regexp:/etc/postfix/header_checks # FAST ETRN SERVICE # # Postfix maintains per-destination logfiles with information about # deferred mail, so that mail can be flushed quickly with the SMTP # "ETRN domain.tld" command, or by executing "sendmail -qRdomain.tld". # See the ETRN_README document for a detailed description. # # The fast_flush_domains parameter controls what destinations are # eligible for this service. By default, they are all domains that # this server is willing to relay mail to. # #fast_flush_domains = $relay_domains # SHOW SOFTWARE VERSION OR NOT # # The smtpd_banner parameter specifies the text that follows the 220 # code in the SMTP server's greeting banner. Some people like to see # the mail version advertised. By default, Postfix shows no version. # # You MUST specify $myhostname at the start of the text. That is an # RFC requirement. Postfix itself does not care. # #smtpd_banner = $myhostname ESMTP $mail_name #smtpd_banner = $myhostname ESMTP $mail_name ($mail_version) # PARALLEL DELIVERY TO THE SAME DESTINATION # # How many parallel deliveries to the same user or domain? With local # delivery, it does not make sense to do massively parallel delivery # to the same user, because mailbox updates must happen sequentially, # and expensive pipelines in .forward files can cause disasters when # too many are run at the same time. With SMTP deliveries, 10 # simultaneous connections to the same domain could be sufficient to # raise eyebrows. # # Each message delivery transport has its XXX_destination_concurrency_limit # parameter. The default is $default_destination_concurrency_limit for # most delivery transports. For the local delivery agent the default is 2. #local_destination_concurrency_limit = 1 #2 #default_destination_concurrency_limit = 100 #20 # DEBUGGING CONTROL # # The debug_peer_level parameter specifies the increment in verbose # logging level when an SMTP client or server host name or address # matches a pattern in the debug_peer_list parameter. # debug_peer_level = 9 # The debug_peer_list parameter specifies an optional list of domain # or network patterns, /file/name patterns or type:name tables. When # an SMTP client or server host name or address matches a pattern, # increase the verbose logging level by the amount specified in the # debug_peer_level parameter. # #debug_peer_list = 127.0.0.1 #debug_peer_list = some.domain # The debugger_command specifies the external command that is executed # when a Postfix daemon program is run with the -D option. # # Use "command .. & sleep 5" so that the debugger can attach before # the process marches on. If you use an X-based debugger, be sure to # set up your XAUTHORITY environment variable before starting Postfix. # debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin xxgdb $daemon_directory/$process_name $process_id & sleep 5 # If you can't use X, use this to capture the call stack when a # daemon crashes. The result is in a file in the configuration # directory, and is named after the process name and the process ID. # # debugger_command = # PATH=/bin:/usr/bin:/usr/local/bin; export PATH; (echo cont; # echo where) | gdb $daemon_directory/$process_name $process_id 2>&1 # >$config_directory/$process_name.$process_id.log & sleep 5 # # Another possibility is to run gdb under a detached screen session. # To attach to the screen sesssion, su root and run "screen -r # <id_string>" where <id_string> uniquely matches one of the detached # sessions (from "screen -list"). # # debugger_command = # PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH; screen # -dmS $process_name gdb $daemon_directory/$process_name # $process_id & sleep 1 # INSTALL-TIME CONFIGURATION INFORMATION # # The following parameters are used when installing a new Postfix version. # # sendmail_path: The full pathname of the Postfix sendmail command. # This is the Sendmail-compatible mail posting interface. # sendmail_path = /usr/local/sbin/sendmail # newaliases_path: The full pathname of the Postfix newaliases command. # This is the Sendmail-compatible command to build alias databases. # newaliases_path = /usr/local/bin/newaliases # mailq_path: The full pathname of the Postfix mailq command. This # is the Sendmail-compatible mail queue listing command. # mailq_path = /usr/local/bin/mailq # setgid_group: The group for mail submission and queue management # commands. This must be a group name with a numerical group ID that # is not shared with other accounts, not even with the Postfix account. # setgid_group = maildrop # html_directory: The location of the Postfix HTML documentation. # html_directory = no # manpage_directory: The location of the Postfix on-line manual pages. # manpage_directory = /usr/local/man # sample_directory: The location of the Postfix sample configuration files. # This parameter is obsolete as of Postfix 2.1. # #sample_directory = /usr/local/etc/postfix # readme_directory: The location of the Postfix README files. # #readme_directory = no #Auth Stuff smtpd_sasl_auth_enable = yes broken_sasl_auth_clients = yes smtpd_sasl_security_options = noanonymous smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = smtpd smtpd_recipient_restrictions = permit_sasl_authenticated, permit_mynetworks reject_unauth_destination, #check_policy_service unix:private/policyd-spf #TLS Stuff #TLS Stuff #smtpd_tls_mandatory_protocols = !SSLv2,!SSLv3,!TLSv1 #smtp_tls_mandatory_protocols = !SSLv2,!SSLv3,!TLSv1 #smtpd_tls_protocols = !SSLv2,!SSLv3,!TLSv1 #smtp_tls_protocols = !SSLv2,!SSLv3,!TLSv1 smtpd_tls_exclude_ciphers = RC4, aNULL smtpd_tls_ask_ccert = yes smtpd_tls_security_level = may smtp_tls_security_level = may smtpd_tls_req_ccert = no smtpd_tls_auth_only = no smtpd_tls_loglevel = 2 smtp_tls_loglevel = 2 smtpd_use_tls = yes smtp_tls_chain_files = /etc/ssl/.scom.ca smtp_use_tls = yes smtp_tls_chain_files = /etc/ssl/.scom.ca smtpd_tls_session_cache_database = btree:${queue_directory}/smtpd_scache smtp_tls_session_cache_database = btree:${queue_directory}/smtp_scache smtp_tls_CApath = /etc/ssl/certs smtpd_tls_CApath = /etc/ssl/certs #Sort out hard bounce to softbounce smtp_reply_filter = pcre:/usr/home/postfix.local/config/smtp_5xx_to_4xx #General Options delay_warning_time = 1h mailbox_size_limit = 0 message_size_limit = 1000000000 #Mailscanner Options #header_checks = regexp:/usr/local/etc/postfix/header_checks unknown_local_recipient_reject_code = 550 #Dovecot stuff #Postgres Stuff #Temp off till i am a mail server mydestination = pgsql:/usr/home/postfix/config/pgsql-mydestination.cf virtual_maps=pgsql:/usr/home/postfix/config/pgsql-virtual.cf #Dovecot Stuff? dovecot_destination_recipient_limit = 1 virtual_transport = dovecot #Spf filter #policy_time_limit = 3600 #Other restrictions strict_rfc821_envelopes = yes smtpd_client_connection_count_limit = 1000 default_process_limit = 100 #minimal_backoff_time = 300s #maximal_backoff_time = 600s #queue_run_delay = 300s #Duplicate suppresion #enable_original_recipient = no #smtpd_discard_ehlo_keywords = silent-discard, dsn milter_default_action = accept milter_protocol = 6 smtpd_milters = inet:localhost:8891 non_smtpd_milters = inet:localhost:8891 #virtual_mailbox_lock = dotlock Postfix Master.cf : [05:16:09] mail19.scom.ca [root:0] /usr/home/postfix.local/config # cat master.cf # # Postfix master process configuration file. For details on the format # of the file, see the master(5) manual page (command: "man 5 master"). # # Do not forget to execute "postfix reload" after editing this file. # # ========================================================================== # service type private unpriv chroot wakeup maxproc command + args # (yes) (yes) (yes) (never) (100) # ========================================================================== #smtp inet n - n - - smtpd #submission inet n - n - - smtpd #465 inet n - n - - smtpd #995 inet n - n - - smtpd 61220 inet n - n - - smtpd # -o smtpd_tls_security_level=encrypt # -o smtpd_sasl_auth_enable=yes # -o smtpd_client_restrictions=permit_sasl_authenticated,reject # -o milter_macro_daemon_name=ORIGINATING #smtps inet n - n - - smtpd # -o smtpd_tls_wrappermode=yes # -o smtpd_sasl_auth_enable=yes # -o smtpd_client_restrictions=permit_sasl_authenticated,reject # -o milter_macro_daemon_name=ORIGINATING #628 inet n - n - - qmqpd pickup fifo n - n 60 1 pickup cleanup unix n - n - 0 cleanup qmgr fifo n - n 300 1 qmgr #qmgr fifo n - n 300 1 oqmgr tlsmgr unix - - n 1000? 1 tlsmgr rewrite unix - - n - - trivial-rewrite bounce unix - - n - 0 bounce defer unix - - n - 0 bounce trace unix - - n - 0 bounce verify unix - - n - 1 verify flush unix n - n 1000? 0 flush proxymap unix - - n - - proxymap proxywrite unix - - n - 1 proxymap smtp unix - - n - - smtp # When relaying mail as backup MX, disable fallback_relay to avoid MX loops relay unix - - n - - smtp -o smtp_fallback_relay= # -o smtp_helo_timeout=5 -o smtp_connect_timeout=5 showq unix n - n - - showq error unix - - n - - error retry unix - - n - - error discard unix - - n - - discard local unix - n n - - local virtual unix - n n - - virtual lmtp unix - - n - - lmtp anvil unix - - n - 1 anvil scache unix - - n - 1 scache # # ==================================================================== # Interfaces to non-Postfix software. Be sure to examine the manual # pages of the non-Postfix software to find out what options it wants. # # Many of the following services use the Postfix pipe(8) delivery # agent. See the pipe(8) man page for information about ${recipient} # and other message envelope options. # ==================================================================== # # maildrop. See the Postfix MAILDROP_README file for details. # Also specify in main.cf: maildrop_destination_recipient_limit=1 # #maildrop unix - n n - - pipe # flags=DRhu user=vmail argv=/usr/local/bin/maildrop -d ${recipient} # # ==================================================================== # # The Cyrus deliver program has changed incompatibly, multiple times. # #old-cyrus unix - n n - - pipe # flags=R user=cyrus argv=/usr/local/cyrus/bin/deliver -e -m ${extension} ${user} # # ==================================================================== # # Cyrus 2.1.5 (Amos Gouaux) # Also specify in main.cf: cyrus_destination_recipient_limit=1 # #cyrus unix - n n - - pipe # user=cyrus argv=/usr/local/cyrus/bin/deliver -e -r ${sender} -m ${extension} ${recipient} # # ==================================================================== # # See the Postfix UUCP_README file for configuration details. # #uucp unix - n n - - pipe # flags=Fqhu user=uucp argv=uux -r -n -z -a$sender - $nexthop!rmail ($recipient) # # ==================================================================== # # Other external delivery methods. # #ifmail unix - n n - - pipe # flags=F user=ftn argv=/usr/lib/ifmail/ifmail -r $nexthop ($recipient) # #bsmtp unix - n n - - pipe # flags=Fq. user=bsmtp argv=/usr/local/sbin/bsmtp -f $sender $nexthop $recipient # #scalemail-backend unix - n n - 2 pipe # flags=R user=scalemail argv=/usr/lib/scalemail/bin/scalemail-store # ${nexthop} ${user} ${extension} # #mailman unix - n n - - pipe # flags=FR user=list argv=/usr/lib/mailman/bin/postfix-to-mailman.py # ${nexthop} ${user} dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${recipient} policyd-spf unix - n n - - spawn user=nobody argv=/usr/local/bin/policyd-spf postlog unix-dgram n - n - 1 postlogd -- Happy Monday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

Build with MySQL -> libmysqlclient not found
by Dimitri 28 Feb '22

28 Feb '22

> John: > > ./configure --help > > might also be a good idea, I think it might have some options like: > > --mysql-libs=/path/to/lib > --mysql-includes=/path/to/include > > or something similiar to use. Unfortunately not, just the "--with-mysql" Option. > Oscar: > > You might need CPPFLAGS as well. (e.g. CPPFLAGS="-I/test/core/mariadb/include") > Check also "config.log" for errors. I had already done both, just forgot to mention it. But i should have looked further. Near the end of config.log is saw: ================================ > | /* Override any GCC internal prototype to avoid an error. > | Use char because int might match the return type of a GCC > | builtin and then its argument prototype would still apply. */ > | #ifdef __cplusplus > | extern "C" > | #endif > | char mysql_init (); > | int > | main () > | { > | return mysql_init (); > | ; > | return 0; > | } > configure:23386: result: noconfigure:23520: error: Can't build with MySQL support: libmysqlclient not found ================================ and thought that wouldn't help me. Now i looked again but further up an saw: ================================ > configure:23377: gcc -o conftest -std=gnu99 -g -O2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -mfunction-return=keep -mindirect-branch=keep -Wall -W -Wmissing-prototypes -Wmissing-declarations> ... > /usr/bin/ld: cannot find -lzcollect2: error: ld returned 1 exit status ================================ Zlib i have (of course ;) ) also compiled from source. After adding "/test/dep/zlib/include" to CPPFLAGS and "/test/dep/zlib/lib" to LDFLAGS the configuration runs without errors. However i don't understand why the configuration-script takes the non-standard path for openssl automatically and correctly from the PKG_CONFIG_PATH, but the paths to my zlib and mariadb installations, which i also set in PKG_CONFIG_PATH not...

3 3

Build with MySQL -> libmysqlclient not found
by Dimitri 27 Feb '22

27 Feb '22

Hi folks, just step into another problem and don't know why? If i try to configure dovecot with the following: > ./configure --prefix=/test/core/dovecot --with-ssldir=/test/core/dovecot/tls --with-mysql i get > ... > checking for auth_userokay... no > checking for mysql_config... NO > checking for mysql_init in -lmysqlclient... noconfigure: error: Can't build with MySQL support: libmysqlclient not found After that i've tried to configure with following: > LDFLAGS="-L/test/core/mariadb/lib" ./configure --prefix=/test/core/dovecot --with-ssldir=/test/core/dovecot/tls --with-mysql but with same result. The Content of "/test/core/mariadb/lib" is: libmariadbclient.a libmariadb.so -> libmariadb.so.3 libmariadb.so.3 libmysqlclient.a -> libmariadbclient.a libmysqlclient_r.a -> libmariadbclient.a libmysqlclient_r.so -> libmariadb.so.3 libmysqlclient.so -> libmariadb.so.3 libmysqlservices.a pkgconfigplugin Also the Path "/test/core/mariadb/lib/pkgconfig" is in the PKG_CONFIG_PATH variable and the Library-Path "/test/core/mariadb/lib" is known by the dynamic linker (/etc/ld.so.conf.d/mylibs.conf). So what am i doing wrong? My Dovecot version: 2.3.18 My Mariadb version: 10.6.5 My OS: Ubuntu 20.04

4 4

Build with MySQL -> libmysqlclient not found
by Dimitri 27 Feb '22

27 Feb '22

> Why aren't you just using the Ubuntu 20.04 packaged version instead? > > Also, did you install the headers for libmysqlclient properly as > > well? > > What does /test/core/mariadb/includes/ or > > /test/core/includes/... show? Hi John, i just want to manage all the software manually, use own directorie-structur and have all the programs in one place, deepen my understanding how these programs work and build these programs only with the components i need. The content of "/test/core/mariadb/include/mysql" is: > errmsg.h > ma_list.h > ma_pvio.h > mariadb/ > mariadb/ma_io.h > mariadb_com.h > mariadb_ctype.h > mariadb_dyncol.h > mariadb_rpl.h > mariadb_stmt.h > mariadb_version.h > ma_tls.h > my_config.h > my_global.h > mysql/ > mysql/client_plugin.h > mysql/plugin_auth_common.h > mysql/plugin_auth.h > mysql_com.h > mysqld_error.h > mysql.h > mysql_version.h > my_sys.h > server/...

1 0

email location - files or sql
by Robert Moskowitz 25 Feb '22

25 Feb '22

I have been running a Dovecot based mail server for over 10 years and it is time (really past) to upgrade. I really don't want to roll my own anymore. Too much time and too many skills needed. Time to retire. But still want it 'in-house'. What I am seeing is that many of the packages seem to roll the messages into some SQL database. My Dovecot setup uses the /home/vmail/doman/../{cur,new,etc} tree structure. Is there any pros vs cons on this that I can read? Is there some nice packed mailserver I can drop on a Centos-arm server that has Dovecot under the covers and I can easily rsync my current mail store to it? Mail-in-a-box looks interesting. But I have not figured out its internals and if I have to worry about anything compiled for arm that is not part of the distro. Thanks in advance for help.

5 7

Messages reappearing in mailboxes as duplicates
by Andrew Skipper 23 Feb '22

23 Feb '22

Hello, We have 3 nodes running, with a two way replication between 2 of them and a 1 way replication to a DR node running off one. We use mdbox, and directors to split traffic across nodes. There is no shared file system. Users are experiencing messages reappearing in their INBOX as unread with duplicate GUID and message headers. This occurs generally several days after a message was first received (and often actioned; read, moved, trashed, expunged, also often bulk moved/deleted). We have attempted to remove replication from the equation by cutting down to one single node with all replication disabled which did not have any impact. We have also started regular cache and mailbox purging. There are no logged events when mail items reappear, and we only observe it based on user report, mailbox inspection (doveadm looking for duplicate GUIDs/unique message headers) or seeing IMAP commands being done against the same message twice (e.g. monday they copy to trash, delete and expunge from inbox, delete and expunge from trash, then the next monday they will have to do the same for the reappearing message). OS: Centos 7 Dovecot: dovecot -version Scheduled jobs: */15 0 * * 0 doveadm sync -u "*" tcps:<dr node>:12345 > /var/log/dovecot/dr_sync.log 2>&1 1 3 * * * doveadm mailbox cache purge -A INBOX 21 3 * * * doveadm mailbox cache purge -A Trash 0 1 * * 0 /usr/bin/doveadm purge -A >/dev/null 2>&1 Conf: dovecot -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1160.53.1.el7.x86_64 x86_64 CentOS Linux release 7.9.2009 (Core) # Hostname: <primary node> auth_master_user_separator = * default_vsz_limit = 1 G disable_plaintext_auth = no dotlock_use_excl = no doveadm_password = # hidden, use -P to show it listen = * mail_fsync = always mail_location = mdbox:~/mail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify replication" mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { autoexpunge = 30 days special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/conf.d/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/dovecot/conf.d/passwd.masterusers driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename save flag_change mail_log_fields = uid box msgid size flags mail_log_group_events = mail_replica = tcps:<second node>:12345 } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { inet_listener imap { port = 144 } inet_listener imaps { port = 994 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot-internal.pem ssl_cipher_list = TLS_AES_256_GCM_SHA384:TLS_CHACHA20_POLY1305_SHA256:TLS_AES_128_GCM_SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA256:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_client_ca_file = /etc/ssl/certs/ca-bundle.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/conf.d/dovecot-dict-auth.conf.ext driver = dict } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 9999 mail_plugins = " notify replication mail_log notify" } Any thoughts would be greatly appreciated. Thanks in advance, Andrew

1 0

Pigeonhole page's RFC links broken (fix attached)
by Patrick Nagel 22 Feb '22

22 Feb '22

Hi there, I was just reading https://pigeonhole.dovecot.org/ and noticed that all the links to the RFCs are broken. I fixed them via regexp search & replace curl https://pigeonhole.dovecot.org/ | sed -e 's|https\?://tools.ietf.org/html/rfc$[0-9]\{4\}$/\?|https://www.ietf.org/r…' >Pigeonhole_fixed_rfc_links.html and attached the resulting page. Cheers, Patrick.

1 0

postfix, dovecot-lda, /run/dovecot/stats-writer socket permision and local user delivery, again
by Michael Tokarev 22 Feb '22

22 Feb '22

Hi! There are many questions on the 'net about the same theme: lda(mjt): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied dovecot-lda is run from postfix as mailbox_command for local users. There's even a suggestion on dovecot wiki to make dovecot-lda setgid (to mail) - for a different reason but people use this trick to shut this error message up. See eg the last message at https://forum.zentyal.org/index.php?topic=35236.0 which points to https://wiki2.dovecot.org/LDA/Postfix . But the thing is: mail delivery stops right after making dovecot-lda setgid, like this: Feb 22 00:06:46 tsrv dovecot: lda(mjt)<253650><s+nnHub+E2LS3gMA7tuOMA>: \ Fatal: setresgid(914(dovecot),914(dovecot),8(mail)) failed with euid=1000(mjt): \ Operation not permitted why the hell lda tries to setuid to dovecot user? It will definitely unable to write to the maildir since it is owned by user mjt, not by user dovecot! And I *only* made it setgid, not setuid. How to use dovecot-lda together with postfix, after all? Thanks, /mjt

2 2

RE: Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 22 Feb '22

22 Feb '22

No, the problem is the logging of the cache lookup with password mismatch. (release 2.3.17) We missing client IP and user in the cache lookup logging. auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) Arvid -----Original Message----- From: Aki Tuomi <aki.tuomi(a)open-xchange.com> Sent: tirsdag 22. februar 2022 09:15 To: Eikås Arvid <arvid.eikas(a)telenor.no>; dovecot(a)dovecot.org Subject: Re: Different auth logging with cache lookup. (OPEN) > On 22/02/2022 09:42 Eikås Arvid <arvid.eikas(a)telenor.no> wrote: > > > dovecot-2.3.5 and centos 7 > User and IP are logged in both scenarios. > auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch > auth-worker(13380): cache(user(a)online.no,1.1.1.1): Password mismatch > > > > > dovecot-2.3.17 and rhel 8 > Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker > (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): > Password mismatch (given password: xxxx) Feb 03 14:43:48 > auth-worker(1676266): Info: conn unix:auth-worker > (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given > password: xxxx) > > User and IP is not logged in cache lookup. > Is this a design change or a unplanned change? > > Any ide when it was changed? Looks more like 2.3.5 is incorrectly checking both cache and sql? Aki

1 0

Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 22 Feb '22

22 Feb '22

dovecot-2.3.5 and centos 7 User and IP are logged in both scenarios. auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch auth-worker(13380): cache(user(a)online.no,1.1.1.1<mailto:user@online.no,1.1.1.1>): Password mismatch dovecot-2.3.17 and rhel 8 Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): Password mismatch (given password: xxxx) Feb 03 14:43:48 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) User and IP is not logged in cache lookup. Is this a design change or a unplanned change? Any ide when it was changed?

2 1

/usr/libexec/dovecot/anvil crashes immediately
by Friedrich Kink 21 Feb '22

21 Feb '22

Dear list, I built a dovecot package for openindiana (which is a Solaris derivative) from latest version 2.3.18. Everything compiles and builds fine without any issue. Even subsequent installation and startup of main dovecot process works as expected. But execution of /usr/libexec/dovecot/anvil immediately crashes. To get some more meaningful backtrace I compiled with -g. Below some facts of my environment and a backtrace. Maybe some of you are more familiar with this kind of issue as I, and can give some hint or share ideas how to nail down the problem. Or can it be a configuration issue? BTW it is running in a so-called zone. And former versions, I don't know exactly but I believe up to 2.3.17, did not show this crash. gcc --version gcc (OpenIndiana 7.5.0-il-0) 7.5.0 Configure parameters: gcc_OPT = -g CONFIGURE_OPTIONS+= --sysconfdir=/etc \ --localstatedir=/var \ --with-gssapi=plugin \ --with-ldap=plugin \ --with-sql=plugin \ --with-lua=plugin \ --with-ssl=openssl \ --with-ioloop=poll \ --with-notify=none \ --with-sodium \ --with-mysql \ --with-pgsql \ --enable-static=no \ --without-systemd \ SSL_CFLAGS=-I/usr/openssl/1.1/include \ SSL_LIBS="-L/usr/openssl/1.1/lib/amd64 -lssl -lcrypto" \ LDFLAGS="-lldap_r" Backtrace: (gdb) bt full #0 0x00007fff5d2e6f2a in _lwp_kill () from /lib/64/libc.so.1 No symbol table info available. #1 0x00007fff5d2dd7f0 in thr_kill () from /lib/64/libc.so.1 No symbol table info available. #2 0x00007fff5d27ae7e in raise () from /lib/64/libc.so.1 No symbol table info available. #3 0x00007fff5d254ad8 in abort () from /lib/64/libc.so.1 No symbol table info available. #4 0x00007ffef05367c0 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:459 backtrace = 0x4178b8 "/usr/lib/amd64/dovecot/libdovecot.so.0.0.0'backtrace_append_libc+0x4c [0x7ffef0522042] -> /usr/lib/amd64/dovecot/libdovecot.so.0.0.0'backtrace_append+0x18 [0x7ffef05221c5] -> /usr/lib/amd64/dovecot/li"... recursed = 0 #5 0x00007ffef0536827 in fatal_handler_real (ctx=0x7fffbffff820, format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffbffff850) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:471 status = 0 #6 0x00007ffef0536871 in default_fatal_handler (ctx=0x7fffbffff820, format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffbffff850) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:479 No locals. #7 0x00007ffef0536aed in i_panic (format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)") at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:524 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0, log_prefix = 0x0, log_prefix_type_pos = 0} args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7fffbffff930, reg_save_area = 0x7fffbffff870}} #8 0x00007ffef056048b in io_loop_handle_add (io=0x42d7c0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop-poll.c:94 ctx = 0x423180 condition = IO_READ old_count = 3221223792 index = 0 old_events = 59 fd = 4 __func__ = "io_loop_handle_add" #9 0x00007ffef055c1ab in io_add_file (ioloop=0x423070, fd=4, condition=IO_READ, source_filename=0x7ffef05d9f48 "/usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c", source_linenum=192, callback=0x7ffef05698f4 <signal_read>, context=0x0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop.c:72 io = 0x42d7c0 __func__ = "io_add_file" #10 0x00007ffef055c27a in io_add_to (ioloop=0x423070, fd=4, condition=IO_READ, source_filename=0x7ffef05d9f48 "/usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c", source_linenum=192, callback=0x7ffef05698f4 <signal_read>, context=0x0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop.c:94 io = 0x7ffef0609aa0 <static_system_pool> __func__ = "io_add_to" #11 0x00007ffef0569289 in lib_signals_init_io (l=0x420a00) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:192 __func__ = "lib_signals_init_io" #12 0x00007ffef056933c in lib_signals_ioloop_ref (ioloop=0x423070) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:205 l = 0x420a00 #13 0x00007ffef0569507 in signal_handler_switch_ioloop (h=0x4209c0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:232 No locals. #14 0x00007ffef056a10a in lib_signals_set_handler (signo=2, flags=LIBSIG_FLAG_DELAYED, handler=0x7ffef0475e74 <sig_die>, context=0x422f20) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:520 h = 0x4209c0 __func__ = "lib_signals_set_handler" #15 0x00007ffef0477596 in master_service_init_finish (service=0x422f20) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib-master/master-service.c:668 sigint_flags = LIBSIG_FLAG_DELAYED st = {st_dev = 79, st_ino = 4209307, st_mode = 1, st_nlink = 79, st_uid = 4218704, st_gid = 0, st_rdev = 17179869185, st_size = 4337776, st_atim = {tv_sec = 140736414612384, tv_nsec = 1}, st_mtim = {tv_sec = 0, tv_nsec = 8388608}, st_ctim = {tv_sec = 0, tv_nsec = 0}, st_blksize = 4378928, st_blocks = 255, st_fstype = " /B\000\000\000\000\000 /B\000\000\000\000"} __func__ = "master_service_init_finish" #16 0x0000000000403cce in main (argc=1, argv=0x7fffbffffc38) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/anvil/main.c:80 service_flags = (MASTER_SERVICE_FLAG_UPDATE_PROCTITLE | MASTER_SERVICE_FLAG_DONT_SEND_STATS) error = 0x7fffbffffc10 " \374\377\277\377\177" Thanks a lot for any help, Fritz

2 1

Fwd: Memory problems with config service
by Víctor Rubiella Monfort 21 Feb '22

21 Feb '22

(Resend to list, sorry for personal reply) -------- Mensaje reenviado -------- Asunto: Re: Memory problems with config service Fecha: Wed, 16 Feb 2022 16:19:32 +0100 De: Víctor Rubiella Monfort <vrubiella(a)cdmon.com> Para: Aki Tuomi <aki.tuomi(a)open-xchange.com> # 2.2.27 (): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 () # OS: Linux 4.9.0-16-amd64 x86_64 Debian 9.9 auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@& auth_worker_max_count = 25 default_client_limit = 1200 disable_plaintext_auth = no first_valid_uid = 100 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log login_greeting = Server ready login_log_format_elements = user=<%u> method=%m port=%a rip=%r lip=%l mpid=%e %c mail_location = maildir:%h mail_max_userip_connections = 100 passdb { args = /etc/dovecot/mailaccounts.db driver = passwd-file } plugin { quota = maildir:User quota quota_rule3 = SPAM:storage=+50M } protocols = imap pop3 service config { vsz_limit = 9 G } service imap-login { process_limit = 500 } service pop3-login { process_limit = 500 } ssl_ca = </home/ssl/system/domain.cat/ca.pem ssl_cert = </home/ssl/system/domain.cat/crt.pem ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/mailaccounts.db driver = passwd-file } valid_chroot_dirs = /home/postfix/ protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify } protocol lda { mail_plugins = quota } local_name *.hidden.com { ssl_cert = </home/ssl/dovecot/live/hidden.com/fullchain.pem ssl_key = # hidden, use -P to show it } #3100+ local_name more with different domains. El 16/2/22 a las 10:02, Aki Tuomi escribió: >> On 16/02/2022 07:30 Víctor Rubiella Monfort <vrubiella(a)cdmon.com> wrote: >> >> >> Hi all, >> I'm having problems with memory in config service. I increased >> vsz_limit to 10GB but continue with this errors when try to reload or >> restart dovecot: >> >> config: Panic: data stack: Out of memory when allocating 2147483688 bytes >> master: Error: service(config): command startup failed, throttling >> for 2 secs >> config: Fatal: master: service(config): child 5512 killed with signal >> 6 (core dumps disabled) >> >> Dovecot has a lot of certificates TLS configured (SNI) (about 3k), >> but if I check the size of all of them is aprox 170MB on disk.Why >> does it need so much memory to boot? Is normal? >> >> >> >> service config { >> vsz_limit = {{ vszlimit }} >> } > Hi! > > Can you send your doveconf -n output? > > Aki >

2 2

Index Corruption Problem with new VM Host - But Only With Replication Enabled
by Reuben Farrelly 21 Feb '22

21 Feb '22

Hi, I've recently migrated my two VMs across from Linode (who use KVM) onto a local VPS service (which also uses KVM). Since doing so I have started to see some strange problems with Dovecot relating to indexes and replication. I have copied the configuration files across from old host to new host. The kernel is the same - as this is Gentoo everything was rebuilt and installed from fresh, but with the same options (use flags). Even the Linux kernel is the same version with the exact same options (as is Dovecot). The filesystem is the same EXT4 with the same options too. Here is what is logged: Feb 18 15:20:41 tornado.reub.net dovecot: imap(reuben)<20031><d0yxIEPY3ROfxG3u>: Error: Mailbox INBOX: /home/reuben/Maildir/dovecot.index reset, view is now inconsistent Feb 18 15:20:41 tornado.reub.net dovecot: imap(reuben)<20031><d0yxIEPY3ROfxG3u>: Disconnected: IMAP session state is inconsistent, please relogin. in=146 out=1398 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 The trigger is the move/delete of an email. Just reading seems to be OK. But as soon as you move/delete an email this event occurs and is logged. The move fails on the first attempt (error is logged, client refreshes) but then if attempted again it succeeds. This error causes the clients to be thrown off and the client view refreshed which seems to require a redownload of everything. It is extremely disruptive to client access. The odd thing is that as soon as I disable replication by commenting out the mail_replica line, *all* of the index corruption messages and symptoms go away completely and I don't see this problem occur. As soon as I re-add it they come back. So it appears that replication at least is triggering the problem. Replication is imap1 -> imap2 and on the other host imap2 - imap1 The odd thing is that this never was a problem while the system was on Linode. I have removed all files on the remote and let dovecot re-replicate everything but this didn't help. I can go back to the VPS host and talk to them about it as I have an open ticket but from their perspective it looks like an application level problem, so there's not a lot for them to go on especially given everything else is working OK. Could the underlying host be playing a role in this? It seems unlikely given turning replication or or off causes the problem to appear or disappear. All clients are connecting to only the master of the two replication partners. Many have multiple concurrent sessions (eg my phone, and Thunderbird at the same time) but all are connecting to only one instance at a time. The second instance is only there for a failover scenario (update a DNS entry to failover). There is no NFS or any sort of sharing set up on the VMs. They are dedicated virtual disks. Can anyone give me any ideas how to troubleshoot this further or things to try? Some system details: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.16.10-gentoo x86_64 Gentoo Base System release 2.8 # Hostname: tornado.reub.net auth_mechanisms = plain login auth_username_format = %Ln doveadm_password = # hidden, use -P to show it first_valid_uid = 1000 imap_client_workarounds = tb-lsub-flags tb-extra-mailbox-sep last_valid_uid = 1099 login_log_format_elements = user=<%u> auth-method=%m remote=%r local=%l %c %k mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_location = maildir:~/Maildir mail_plugins = notify replication managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = failure_show_msg=yes %s driver = pam } plugin { mail_replica = tcp:imap2.reub.net:4814 replication_full_sync_interval = 2 hours sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster(a)reub.net protocols = imap lmtp sieve submission sieve recipient_delimiter = - service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = root } unix_listener replication-notify { mode = 0666 user = root } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0777 } } service doveadm { inet_listener { address = 2404:9400:2264:7200::143 port = 4813 ssl = yes } inet_listener { address = 2404:9400:2264:7200::143 port = 4814 ssl = no } user = root } service imap-login { inet_listener imap { port = 143 } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } service submission-login { inet_listener submission { address = 103.4.234.81 2404:9400:2264:7200::587 port = 587 } } ssl_cert = </etc/ssl/dovecot/reub.net.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_client_workarounds = whitespace-before-path submission_relay_host = localhost submission_relay_port = 587 submission_relay_trusted = yes userdb { driver = passwd result_success = continue-ok } protocol lmtp { mail_plugins = notify replication sieve } protocol lda { mail_plugins = notify replication sieve } protocol imap { imap_metadata = yes mail_max_userip_connections = 25 } Thanks, Reuben

2 2

dovecot-2.3-pigeonhole-0.5.18 : Freebsd Will not build
by Paul Kudla (Scom.ca Internet Services Inc.) 21 Feb '22

21 Feb '22

dovecot version : dovecot-2.3.14 freebsd 12.1 dovecot-2.3.14 built manually (no port build) : ./configure --with-pgsql currentconfig (dovecot-2.3-pigeonhole-0.5.18) : ./configure --with-dovecot=/usr/local/lib/dovecot Error when building : Screen Shot (color may help) Actual : libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I/usr/local/include/dovecot -I../../../.. -I../../../../src/lib-sieve -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -mfunction-return=keep -mindirect-branch=keep -I../../../.. -MT sieve-dict-script.lo -MD -MP -MF .deps/sieve-dict-script.Tpo -c sieve-dict-script.c -fPIC -DPIC -o .libs/sieve-dict-script.o sieve-dict-script.c: In function 'sieve_dict_script_open': sieve-dict-script.c:84:9: error: variable 'set' has initializer but incomplete type 84 | struct dict_op_settings set = { | ^~~~~~~~~~~~~~~~ sieve-dict-script.c:85:4: error: 'struct dict_op_settings' has no member named 'username' 85 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:85:15: warning: excess elements in struct initializer 85 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:85:15: note: (near initialization for 'set') sieve-dict-script.c:84:26: error: storage size of 'set' isn't known 84 | struct dict_op_settings set = { | ^~~ sieve-dict-script.c:88:31: warning: passing argument 3 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 88 | (dscript->dict, &set, script->pool, path, &data_id, &error); | ~~~~~~^~~~~~ | | | pool_t {aka struct pool *} In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:15: note: expected 'const char *' but argument is of type 'pool_t' {aka 'struct pool *'} 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~^~~ sieve-dict-script.c:88:39: warning: passing argument 4 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 88 | (dscript->dict, &set, script->pool, path, &data_id, &error); | ^~~~ | | | const char * In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:33: note: expected 'const char **' but argument is of type 'const char *' 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~~^~~~~~~ sieve-dict-script.c:87:8: error: too many arguments to function 'dict_lookup' 87 | ret = dict_lookup | ^~~~~~~~~~~ In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:101:5: note: declared here 101 | int dict_lookup(struct dict *dict, pool_t pool, | ^~~~~~~~~~~ sieve-dict-script.c:84:26: warning: unused variable 'set' [-Wunused-variable] 84 | struct dict_op_settings set = { | ^~~ sieve-dict-script.c: In function 'sieve_dict_script_get_stream': sieve-dict-script.c:126:9: error: variable 'set' has initializer but incomplete type 126 | struct dict_op_settings set = { | ^~~~~~~~~~~~~~~~ sieve-dict-script.c:127:4: error: 'struct dict_op_settings' has no member named 'username' 127 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:127:15: warning: excess elements in struct initializer 127 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:127:15: note: (near initialization for 'set') sieve-dict-script.c:126:26: error: storage size of 'set' isn't known 126 | struct dict_op_settings set = { | ^~~ sieve-dict-script.c:130:32: warning: passing argument 3 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 130 | (dscript->dict, &set, dscript->data_pool, path, &data, &error); | ~~~~~~~^~~~~~~~~~~ | | | pool_t {aka struct pool *} In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:15: note: expected 'const char *' but argument is of type 'pool_t' {aka 'struct pool *'} 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~^~~ sieve-dict-script.c:130:45: warning: passing argument 4 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 130 | (dscript->dict, &set, dscript->data_pool, path, &data, &error); | ^~~~ | | | const char * In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:33: note: expected 'const char **' but argument is of type 'const char *' 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~~^~~~~~~ sieve-dict-script.c:129:8: error: too many arguments to function 'dict_lookup' 129 | ret = dict_lookup | ^~~~~~~~~~~ In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:101:5: note: declared here 101 | int dict_lookup(struct dict *dict, pool_t pool, | ^~~~~~~~~~~ sieve-dict-script.c:126:26: warning: unused variable 'set' [-Wunused-variable] 126 | struct dict_op_settings set = { | ^~~ gmake[5]: *** [Makefile:461: sieve-dict-script.lo] Error 1 gmake[5]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src/lib-sieve/storage/dict' gmake[4]: *** [Makefile:426: all-recursive] Error 1 gmake[4]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src/lib-sieve/storage' gmake[3]: *** [Makefile:909: all-recursive] Error 1 gmake[3]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src/lib-sieve' gmake[2]: *** [Makefile:438: all-recursive] Error 1 gmake[2]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src' gmake[1]: *** [Makefile:763: all-recursive] Error 1 gmake[1]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18' gmake: *** [Makefile:622: all] Error 2 -- Happy Sunday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

initial replication or clone?
by Joachim Lindenberg 19 Feb '22

19 Feb '22

Hello, I want to improve availability of my dovecot installation by implementing replication as outlined in https://wiki.dovecot.org/Replication. I am wondering whether I have to install an empty copy or whether it is also an option to clone the entire existing system and then configure replication, just to avoid the initial overhead. Any input? Thanks, Joachim

1 0

Unable to connect from macOS mail client
by necktwi 19 Feb '22

19 Feb '22

When trying to add mail account to the macOS mail client, I get following error Feb 13 13:05:15 imap-login: Info: Disconnected: Connection closed: SSL_accept() failed: error:14094416:SSL routines:ssl3_read_bytes:sslv3 alert certificate unknown: SSL alert number 46 (no auth attempts in 0 secs): user=<>, rip=157.48.200.20, lip=192.168.1.101, TLS handshaking: SSL_accept() failed: error:14094416:SSL routines:ssl3_read_bytes:sslv3 alert certificate unknown: SSL alert number 46, session=<5mZDV+HXxK+dMMgU> How to fix it? — Necktwi

4 4

--with-textcat: configure error?
by Felipe Gasper 18 Feb '22

18 Feb '22

Hello, With Dovecot 2.3.18 on AlmaLinux 8 I’m trying this: LIBEXTTEXTCAT_LIBS="-L/usr/lib64 -lexttextcat" ./configure --with-textcat … which gives me: checking for special_textcat_Init in -lexttextcat... no checking for special_textcat_Init in -ltextcat... no configure: error: Can't build with textcat support: libtextcat or libexttextcat not found I do have: > ls -la /usr/lib64 | grep textcat lrwxrwxrwx 1 root root 26 Oct 12 2019 libexttextcat-2.0.so.0 -> libexttextcat-2.0.so.0.0.0 -rwxr-xr-x 1 root root 22128 Oct 12 2019 libexttextcat-2.0.so.0.0.0 Is there some way of knowing what command it’s actually running that makes it say “libtextcat or libexttextcat not found”? Thank you! cheers, -Felipe Gasper

1 0

Debug shared namespace issues
by Kees van Vloten 18 Feb '22

18 Feb '22

Hi Team, I am still having troubles with the shared namespace. mail_shared_explicit_inbox = yes namespace { type = shared separator = "~" prefix = shared~%%u~ location = maildir:/srv/mail/vmail/example.com/%%n/store:LAYOUT=fs:FULLDIRNAME=0_Folde… hidden = no list = children subscriptions = no } To rule out ACL issues (for now), I have added: plugin { acl = vfile acl_shared_dict = file:/srv/mail/dovecot/lib/shared-mailboxes.db #acl_defaults_from_inbox = yes acl_user = %n acl_ignore_namespace = shared~ } The client imap communication looks like this: C[0x55ae80480750]: 1 login "test2" "" S[0x55ae8044a600]: 1 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE ACL RIGHTS=texk] Logged in C[0x55ae80480750]: 2 capability S[0x55ae8044a600]: * CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE ACL RIGHTS=texk S[0x55ae8044a600]: 2 OK Capability completed (0.001 + 0.000 secs). C[0x55ae80480750]: 3 ID ("x-originating-ip" "192.168.10.106") S[0x55ae8044a600]: * ID ("name" "Dovecot") S[0x55ae8044a600]: 3 OK ID completed (0.001 + 0.000 secs). C[0x55ae80480750]: 4 namespace S[0x55ae8044a600]: * NAMESPACE (("" "~")) (("shared~" "~")) NIL S[0x55ae8044a600]: 4 OK Namespace completed (0.001 + 0.001 secs). C[0x55ae80480750]: 5 LIST "" "" S[0x55ae8044a600]: * LIST (\Noselect) "~" "" S[0x55ae8044a600]: 5 OK List completed (0.001 + 0.001 secs). C[0x55ae80480750]: 6 getacl "shared~test1~Drafts" S[0x55ae8044a600]: 6 NO [NONEXISTENT] Mailbox doesn't exist: shared~test1~Drafts (0.001 + 0.000 secs). C[0x55ae80480750]: 7 create "shared~test1~Drafts" S[0x55ae8044a600]: 7 NO [CANNOT] Invalid mailbox name 'shared~test1~Drafts': Missing namespace prefix 'shared~test1/Drafts~' (0.001 + 0.000 secs). C[0x55ae80480750]: 8 getacl "shared~test1~Drafts" S[0x55ae8044a600]: 8 NO [NONEXISTENT] Mailbox doesn't exist: shared~test1~Drafts (0.001 + 0.000 secs). C[0x55ae80480750]: 9 select "shared~test1~Drafts" S[0x55ae8044a600]: 9 NO [CANNOT] Invalid mailbox name 'shared~test1~Drafts': Missing namespace prefix 'shared~test1/Drafts~' (0.001 + 0.001 secs). C[0x55ae80480750]: 10 unsubscribe "shared~test1~Drafts" S[0x55ae8044a600]: 10 NO [CANNOT] Invalid mailbox name 'shared~test1~Drafts': Missing namespace prefix 'shared~test1/Drafts~' (0.001 + 0.000 secs). C[0x55ae80480750]: 11 logout S[0x55ae8044a600]: * BYE Logging out The client shows the shared user, but no content. I am using Sogo to test and sometimes Thunderbird to verify it is not a Sogo specific issue. I have currently set these debug options in Dovecot: auth_verbose = yes auth_debug = yes mail_debug = yes Unfortunately this is not enough to get a clue. What more can I do (other debug options?) to figure out what is going on? - Kees

2 5

Using dovecot-shared for an shared index not working
by Achim Gottinger 18 Feb '22

18 Feb '22

Hello I'm in the process to migrate our mail server from version 2.2.13 with maildirs to 2.3.13 with sdbox. On the old server if we wanted an common index for the seen flag on shared folders we created an file called dovecot-shared in the mail_location folder and the mailbox folders. This does not work on the new server for all shared mailboxes the seen flag is stored per user. The log file shows this if the seen flag is changed Feb 18 13:24:15 SERVER dovecot[18887]: imap(USER)<18978><51HhlUnYeOfAwAx3>: Debug: imapsieve: mailbox shared/info: FLAG event (changed flags: \Seen) The dovecot-acl file for the shared/info/INBOX folder has the s flag set. I hope i can get a few pointers here how to get the seen flag working for all users again. On the old server the location variable for the shared folders had the variable INDEX defined which can not be used with sdbox. location = maildir:/home/vmail/%%u/mail:INDEX=/home/vmail/%u/mail/shared/%%u:INBOX=/home/vmail/%%u/mail/.INBOX Does that imply that sharing the seen flag can not be used with sdbox? Thanks in advance, Achim Here is the dovecot -n output: ---------------------------------------------------------------------------------------------------------------------- # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 4.19.0+1 x86_64 Debian 11.2 zfs # Hostname: SERVER auth_cache_size = 5 M auth_gssapi_hostname = SERVER auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = % auth_mechanisms = plain login gssapi auth_username_format = %Ln debug_log_path = syslog first_valid_gid = 998 first_valid_uid = 998 imap_max_line_length = 2 M info_log_path = syslog mail_attachment_dir = /var/lib/vmail/attachements mail_debug = yes mail_gid = 998 mail_home = /var/lib/vmail/%u mail_location = sdbox:/var/lib/vmail/%u/sdbox:INDEX=/var/lib/vmail/%u/sdbox mail_plugins = acl fts fts_solr mail_uid = 998 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { list = children location = sdbox:/var/lib/vmail/%%u/sdbox:INDEXPVT=/var/lib/vmail/%u/sdbox/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { acl = vfile acl_anyone = allow acl_defaults_from_inbox = yes acl_shared_dict = file:/var/lib/vmail/.shared-mailboxes fts = solr fts_autoindex = yes fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_solr = url=http://localhost:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid from subject size sieve = ~/.dovecot.sieve sieve_after = /etc/dovecot/sieve/after.d/ sieve_dir = ~/sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0777 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap-postlogin { executable = script-login /etc/dovecot/acl-groups.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/certs/SERVER.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap-user.conf.ext driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-group.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl fts fts_solr sieve } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = acl fts fts_solr imap_sieve imap_acl fts fts_solr } local_name EXTERN { ssl_cert = </etc/letsencrypt/live/EXTERN/fullchain.pem ssl_key = # hidden, use -P to show it }

1 1

Dovecot with Microsoft Azure OAUTH2 ?
by Max Kostikov 18 Feb '22

18 Feb '22

Does anyone have experience successfully setting up Dovecot OAUTH2 for authentication with Microsoft Azure? I'm not sure what to use as tokeninfo_url and introspection_url in the Dovecot configuration. I would appreciate any help and advice. -- Best regards, Max Kostikov

2 1

Too many wait in auth process
by ismael.tanguy＠univ-brest.fr 18 Feb '22

18 Feb '22

Hello, I'm currently benchmarking new hardware aimed to serve around 70k users For now, our IMAP server have 13k users. To run imaptest, I've spwan some bench clients. Each bench client can run imaptest with 1000 clients. More than 1000 clients will load CPU of this bench client imaptest command (command are chosen from usage stat on our other IMAP servers): imaptest host=xxxxx port=xxx userfile=userfile mbox=/root/dovecot-crlf pass=sxxxx seed=123 clients=1000 select=194 uidfetch=94 noop=70 status=82 append=49 fetch=276 list=12 store=19 expunge=22 msubs=4 search=4 logout=1 delete=81 no_pipelining With one bench client, everything runs smoothly. # ps aux | grep dovecot | awk '{print $11,$12,$13,$14,$15,$16,$17,$18}' | sort | uniq -c 1 anvil: [221 connections] (anvil) 1 auth: [13 wait, 0 passdb, 0 userdb] (auth) 1 dovecot/config 1 dovecot/imap 84 dovecot/imap-login 1 dovecot/log 20 dovecot/pop3-login 1 grep dovecot 1 stats: [1307 connections] (stats) When a second instance bench instance start imaptest, clients of first and second instance begin to stall : 1400 stalled for 20 secs in command: 1 LOGIN"fakeuser644@mailbench...." "password" And : # ps aux | grep dovecot | awk '{print $11,$12,$13,$14,$15,$16,$17,$18}' | sort | uniq -c 1 anvil: [221 connections] (anvil) 1 auth: [1227 wait, 0 passdb, 0 userdb] (auth) 1 dovecot/config 1 dovecot/imap 37 dovecot/imap-login 1 dovecot/log 20 dovecot/pop3-login 1 grep dovecot 1 stats: [680 connections] (stats) Every auth go in wait, number of connection decreases. Using mysql or a password file give same results. I have used different values for service_count with also no success. I think my use of imaptest could be false. My understanding of service auth is limited for now because I'm quite new to Dovecot (I have previously worked with Cyrus). Thank you for every hints. Ismaël Tanguy

12 13

Shared mailbox visible but not readable
by Kees van Vloten 17 Feb '22

17 Feb '22

After the previous thread, I am now able to see / list the structure of a shared mailbox but cannot see the messages. doveadm acl get -u test2 INBOX ID Global Rights user=test1 admin create delete expunge insert lookup post read write write-deleted write-seen dovecot -n # 2.3.13 (89f716dc2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 5.10.0-10-amd64 x86_64 Debian 11.2 ext4 # Hostname: server.example.com auth_debug = yes auth_default_realm = EXAMPLE.COM auth_gssapi_hostname = server.example.com auth_krb5_keytab = /etc/keytab/dovecot.keytab auth_master_user_separator = * auth_mechanisms = gssapi gss-spnego plain auth_realms = EXAMPLE.COM auth_verbose = yes first_valid_gid = 986 first_valid_uid = 990 hostname = server.example.com imap_client_workarounds = tb-extra-mailbox-sep imap_max_line_length = 2 M login_greeting = Dovecot ready. mail_debug = yes mail_gid = 986 mail_location = maildir:/srv/mail/vmail/example.com/%n/store:LAYOUT=fs:FULLDIRNAME=0_Folder… mail_plugins = zlib notify push_notification listescape acl mail_shared_explicit_inbox = yes mail_uid = 990 namespace { hidden = no list = children location = maildir:/srv/mail/vmail/example.com/%%n/store:LAYOUT=fs:FULLDIRNAME=0_Folde… prefix = shared~%%n~ separator = ~ subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Inbox { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = ~ subscriptions = yes type = private } passdb { args = username_format=%u /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/ldap_user_to_principal.conf.ext driver = ldap pass = yes } passdb { args = nopassword=y allow_nets=127.0.0.1/32 driver = static } passdb { driver = pam } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/srv/mail/dovecot/lib/shared-mailboxes.db acl_user = %n autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = Sent } protocols = " imap lmtp submission" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imap_local { address = 127.0.0.1 port = 144 ssl = no } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 } service indexer-worker { vsz_limit = 2 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service submission-login { inet_listener submission { port = 465 ssl = yes } } ssl = required ssl_cert = </etc/dovecot/private/dovecot.pem ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM ssl_client_ca_dir = /etc/ssl/certs ssl_curve_list = X25519:secp521r1:secp384r1:prime256v1 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 submission_client_workarounds = whitespace-before-path submission_relay_host = localhost userdb { args = /etc/dovecot/ldap_user_domain.conf.ext driver = ldap result_success = continue } userdb { args = uid=vmail gid=vmail home=/srv/mail/vmail allow_all_users=yes driver = static } protocol lmtp { mail_plugins = zlib notify push_notification listescape acl } protocol lda { mail_plugins = zlib notify push_notification listescape acl } protocol imap { mail_max_userip_connections = 50 mail_plugins = zlib notify push_notification listescape acl imap_acl } Server-side logging: Feb 17 18:19:46 server dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=wnsM+TnYeNt/AAAB#011lip=127.0.0.1#011rip=127.0.0.1#011lport=144#011rport=56184#011resp=<hidden> Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1(a)example.com,127.0.0.1,<wnsM+TnYeNt/AAAB>): Performing passdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1(a)example.com,127.0.0.1,<wnsM+TnYeNt/AAAB>): pass search: base=OU=User Accounts,OU=Interactive Users,OU=Groupware,DC=example,DC=com scope=subtree filter=(&(objectClass=user)(sAMAccountName=test1)(memberOf:1.2.840.113556.1.4.1941:=CN=mail_user-example.com,OU=Mail Domains,OU=Groups,DC=example,DC=com)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) fields=userPrincipalName Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1(a)example.com,127.0.0.1,<wnsM+TnYeNt/AAAB>): result: userPrincipalName=test1(a)example.com; userPrincipalName unused Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1(a)example.com,127.0.0.1,<wnsM+TnYeNt/AAAB>): username changed test1(a)example.com -> test1 Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Finished passdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: static(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Performing passdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: static(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): lookup Feb 17 18:19:46 server dovecot: auth: Debug: static(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): allow_nets: Matching for network 127.0.0.1/32 Feb 17 18:19:46 server dovecot: auth: Debug: static(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Finished passdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: auth(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Auth request finished Feb 17 18:19:46 server dovecot: auth: Debug: client passdb out: OK#0111#011user=test1#011k5principals=test1(a)example.com Feb 17 18:19:46 server dovecot: auth: Debug: master in: REQUEST#011674496513#011982757#0111#011bdc4ed95a66c86ed9e287682de2cc297#011session_pid=982760#011request_auth_token Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Performing userdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): user search: base=OU=User Accounts,OU=Interactive Users,OU=Groupware,DC=example,DC=com scope=subtree filter=(&(objectClass=user)(sAMAccountName=test1)(memberOf:1.2.840.113556.1.4.1941:=CN=mail_user-,OU=Mail Domains,OU=Groups,DC=example,DC=com)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) fields= Feb 17 18:19:46 server dovecot: auth: Debug: auth client connected (pid=982759) Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): no fields returned by the server Feb 17 18:19:46 server dovecot: auth: ldap(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): unknown user Feb 17 18:19:46 server dovecot: auth: Debug: ldap(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Finished userdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: static(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Performing userdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: static(test1,127.0.0.1,<wnsM+TnYeNt/AAAB>): Finished userdb lookup Feb 17 18:19:46 server dovecot: auth: Debug: master userdb out: USER#011674496513#011test1#011uid=990#011gid=986#011home=/srv/mail/vmail#011auth_mech=PLAIN#011auth_token=7f5013248866ebfbfb636b8de817aad6ac5af767 Feb 17 18:19:46 server dovecot: imap-login: Login: user=<test1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=982760, secured, session=<wnsM+TnYeNt/AAAB> Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: Effective uid=990, gid=986, home=/srv/mail/vmail Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: Namespace inbox: type=private, prefix=, sep=~, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/mail/vmail/example.com/test1/store:LAYOUT=fs:FULLDIRN… Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test1/store, index=/srv/mail/vmail/example.com/test1/index, indexpvt=, control=/srv/mail/vmail/example.com/test1/control, inbox=, alt= Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: initializing backend with data: vfile Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: acl username = test1 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: owner = 1 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl vfile: Global ACLs disabled Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: Namespace : type=shared, prefix=shared~%n~, sep=~, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/srv/mail/vmail/example.com/%n/store:LAYOUT=fs:FULLDIRNAME… Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: fts: Indexes disabled for namespace 'shared~%n~' Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: initializing backend with data: vfile Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: acl username = test1 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: owner = 0 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl vfile: Global ACLs disabled Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test2/INBOX/store, index=, indexpvt=/srv/mail/vmail/example.com/test1/index_shared/test2/INBOX, control=/srv/mail/vmail/example.com/test2/INBOX/control, inbox=, alt= Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: initializing backend with data: vfile Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: acl username = test2/INBOX Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: owner = 1 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl vfile: Global ACLs disabled Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test2/INBOX/store, index=, indexpvt=/srv/mail/vmail/example.com/test1/index_shared/test2/INBOX, control=/srv/mail/vmail/example.com/test2/INBOX/control, inbox=, alt= Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: initializing backend with data: vfile Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: acl username = test1 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl: owner = 0 Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: acl vfile: Global ACLs disabled Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: Mailbox shared~test2~INBOX: Mailbox opened because: SELECT Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Logged out in=245 out=1711 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Client-side logging: S[0x55ae80a7bb00]: * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS AUTH=GSSAPI AUTH=GSS-SPNEGO AUTH=PLAIN] Dovecot ready. C[0x55ae808c12d0]: 1 login "test1" "" S[0x55ae80a7bb00]: 1 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE ACL RIGHTS=texk] Logged in C[0x55ae808c12d0]: 2 capability S[0x55ae80a7bb00]: * CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE ACL RIGHTS=texk S[0x55ae80a7bb00]: 2 OK Capability completed (0.001 + 0.000 secs). C[0x55ae808c12d0]: 3 ID ("x-originating-ip" "192.168.10.106") S[0x55ae80a7bb00]: * ID ("name" "Dovecot") S[0x55ae80a7bb00]: 3 OK ID completed (0.001 + 0.001 secs). C[0x55ae808c12d0]: 4 namespace S[0x55ae80a7bb00]: * NAMESPACE (("" "~")) (("shared~" "~")) NIL S[0x55ae80a7bb00]: 4 OK Namespace completed (0.001 + 0.000 secs). C[0x55ae808c12d0]: 5 LIST "" "" S[0x55ae80a7bb00]: * LIST (\Noselect) "~" "" S[0x55ae80a7bb00]: 5 OK List completed (0.001 + 0.001 secs). C[0x55ae808c12d0]: 6 select "INBOX" S[0x55ae80a7bb00]: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) S[0x55ae80a7bb00]: * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. S[0x55ae80a7bb00]: * 1 EXISTS S[0x55ae80a7bb00]: * 0 RECENT S[0x55ae80a7bb00]: * OK [UIDVALIDITY 1637177527] UIDs valid S[0x55ae80a7bb00]: * OK [UIDNEXT 2] Predicted next UID S[0x55ae80a7bb00]: * OK [HIGHESTMODSEQ 10] Highest S[0x55ae80a7bb00]: 6 OK [READ-WRITE] Select completed (0.001 + 0.000 secs). C[0x55ae808c12d0]: 7 UID SEARCH (UNSEEN NOT DELETED) S[0x55ae80a7bb00]: * SEARCH S[0x55ae80a7bb00]: 7 OK Search completed (0.001 + 0.001 secs). C[0x55ae808c12d0]: 8 select "shared~test2~INBOX" S[0x55ae80a7bb00]: * OK [CLOSED] Previous mailbox closed. S[0x55ae80a7bb00]: 8 NO [CANNOT] Invalid mailbox name 'shared~test2~INBOX': Missing namespace prefix 'shared~test2/INBOX~' (0.001 + 0.001 secs). C[0x55ae808c12d0]: 9 logout S[0x55ae80a7bb00]: * BYE Logging out This issue I am facing is this: 8 NO [CANNOT] Invalid mailbox name 'shared~test2~INBOX': Missing namespace prefix 'shared~test2/INBOX~' The server-side seems to think everything is fine: Feb 17 18:19:46 server dovecot: imap(test1)<982760><wnsM+TnYeNt/AAAB>: Debug: Mailbox shared~test2~INBOX: Mailbox opened because: SELECT But I do not get to see any messages in test2's shared mailbox. How to debug this? Or better: how to fix it :-) ?? - Kees

2 2

mail-crypt and mbox format
by cincodemayo_67＠yahoo.com 17 Feb '22

17 Feb '22

Hi, My Dovecot server of many years has been set up to use mbox email folders. I want to implement mail-crypt and after banging my head against a wall for a few days trying to get mail-crypt to work I decided to try it against a test instance of my server that I reset to use Maildir format and mail-crypt worked instantly. Does mail-crypt work with mbox format mail folders, or am I wasting my time unless I switch over to Maildir? The documentation at https://doc.dovecot.org/configuration_manual/mail_crypt_plugin/ doesn't explicitly say Maildir is required. Thanks in advance, Doug

5 9

Mailbox sharing not working
by Kees van Vloten 17 Feb '22

17 Feb '22

Hi Team, I am trying to setup mailbox sharing. But although user test2 shares INBOX with test1, it is not visible for user1. doveadm acl get -u test2 INBOX ID Global Rights user=test1 admin create delete expunge insert lookup post read write write-deleted write-seen cat /srv/mail/dovecot/lib/shared-mailboxes.db shared/shared-boxes/user/test1/test2(a)example.com 1 Log output: Feb 16 20:12:42 server dovecot: imap-login: Login: user=<test1(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=900367, secured, session=<mDkSbyfYotF/AAAB> Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Loading modules from directory: /usr/lib/dovecot/modules Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_push_notification_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_xapian_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Effective uid=990, gid=986, home=/srv/mail/vmail Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Namespace inbox: type=private, prefix=, sep=~, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/mail/vmail/example.com/test1/store:LAYOUT=fs:FULLDIRN… Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test1/store, index=/srv/mail/vmail/example.com/test1/index, indexpvt=, control=/srv/mail/vmail/example.com/test1/control, inbox=, alt= Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: acl: initializing backend with data: vfile Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: Mailbox INBOX~example.com: Mailbox opened because: SELECT Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/INBOX/example.com/0_FolderContent/dovecot-acl not found Feb 16 20:12:42 server dovecot: imap(test1(a)example.com)<900367><mDkSbyfYotF/AAAB>: Logged out in=136 out=1584 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Feb 16 20:12:43 server dovecot: imap-login: Login: user=<test1(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=900369, secured, session=<82gfbyfYuNF/AAAB> <removed lines> Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: Namespace inbox: type=private, prefix=, sep=~, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/mail/vmail/example.com/test1/store:LAYOUT=fs:FULLDIRN… Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: fs: root=/srv/mail/vmail/example.com/test1/store, index=/srv/mail/vmail/example.com/test1/index, indexpvt=, control=/srv/mail/vmail/example.com/test1/control, inbox=, alt= Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: initializing backend with data: vfile Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: acl username = test1(a)example.com Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: owner = 1 Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: Global ACLs disabled Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: Namespace : type=shared, prefix=shared~%u~, sep=~, inbox=no, hidden=no, list=no, subscriptions=no location=maildir:/srv/mail/vmail/example.com/%n/store:LAYOUT=fs:FULLDIRNAME… Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: fts: Indexes disabled for namespace 'shared~%u~' Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: initializing backend with data: vfile Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl: acl username = test1(a)example.com Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: reading file /srv/mail/vmail/example.com/test1/store/INBOX/0_FolderContent/dovecot-acl Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Drafts/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Junk/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Trash/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/Sent/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: acl vfile: file /srv/mail/vmail/example.com/test1/store/INBOX/example.com/0_FolderContent/dovecot-acl not found Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Debug: Namespace shared~: Using permissions from : mode=0700 gid=default Feb 16 20:12:43 server dovecot: imap(test1(a)example.com)<900369><82gfbyfYuNF/AAAB>: Logged out in=130 out=1518 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Dovecot -n: # 2.3.13 (89f716dc2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 5.10.0-10-amd64 x86_64 Debian 11.2 ext4 # Hostname: server.example.com auth_default_realm = EXAMPLE.COM auth_gssapi_hostname = server.example.com auth_krb5_keytab = /etc/keytab/dovecot.keytab auth_master_user_separator = * auth_mechanisms = gssapi gss-spnego plain auth_realms = EXAMPLE.COM first_valid_gid = 601 first_valid_uid = 601 hostname = server.example.com imap_client_workarounds = tb-extra-mailbox-sep imap_max_line_length = 2 M login_greeting = Dovecot ready. mail_debug = yes mail_gid = 986 mail_location = maildir:/srv/mail/vmail/example.com/%n/store:LAYOUT=fs:FULLDIRNAME=0_Folder… mail_plugins = zlib notify push_notification listescape acl mail_shared_explicit_inbox = yes mail_uid = 990 namespace { hidden = no list = no location = maildir:/srv/mail/vmail/example.com/%%n/store:LAYOUT=fs:FULLDIRNAME=0_Folde… prefix = shared~%%u~ separator = ~ subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Inbox { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = ~ subscriptions = yes type = private } passdb { args = username_format=%u /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/ldap_user_to_principal.conf.ext driver = ldap pass = yes } passdb { args = nopassword=y allow_nets=127.0.0.1/32 driver = static } passdb { driver = pam } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/srv/mail/dovecot/lib/shared-mailboxes.db acl_user = %u autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = Sent listescape_char = \ } postmaster_address = admin(a)example.com protocols = " imap lmtp submission" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imap_local { address = 127.0.0.1 port = 144 ssl = no } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 } service indexer-worker { vsz_limit = 2 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service submission-login { inet_listener submission { port = 465 ssl = yes } } ssl = required ssl_cert = </etc/dovecot/private/dovecot.pem ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM ssl_client_ca_dir = /etc/ssl/certs ssl_curve_list = X25519:secp521r1:secp384r1:prime256v1 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 submission_client_workarounds = whitespace-before-path submission_relay_host = localhost userdb { args = /etc/dovecot/ldap_list_users.conf.ext driver = ldap result_success = continue } userdb { args = /etc/dovecot/ldap_user_domain.conf.ext driver = ldap result_success = continue } userdb { args = uid=vmail gid=vmail home=/srv/mail/vmail allow_all_users=yes driver = static } protocol lmtp { mail_plugins = zlib notify push_notification listescape acl } protocol lda { mail_plugins = zlib notify push_notification listescape acl } protocol imap { mail_max_userip_connections = 50 mail_plugins = zlib notify push_notification listescape acl imap_acl } Is there anything obviously wrong in the config? I suspect a mismatch between %u and %n somewhere but don't know how to figure out the culprit. How can I get more relevant debug log output about namespaces / mailbox sharing? Or can I run commands to check validity? - Kees

2 10

Replications ERROR
by Günther J. Niederwimmer 16 Feb '22

16 Feb '22

Hello, Can any Help me to find out the Problem with "sync failed" I have all disabled only one user is in the moment running? doveadm replicator status '*' username priority fast sync full sync success sync failed gjn(a)example.com none 00:01:47 23:37:43 - y gjn none 00:01:47 23:42:43 - y Could it be a Problem with this doveadm user '*' gjn(a)example.com What is the way to become logs what is going wrong ? Could it be, I have Problems with the Dovecot Variables in the LDAP Config ? Thanks very match for a answer, -- mit freundlichen Grüßen / best regards Günther J. Niederwimmer

2 3

Memory problems with config service
by Víctor Rubiella Monfort 16 Feb '22

16 Feb '22

Hi all, I'm having problems with memory in config service. I increased vsz_limit to 10GB but continue with this errors when try to reload or restart dovecot: config: Panic: data stack: Out of memory when allocating 2147483688 bytes master: Error: service(config): command startup failed, throttling for 2 secs config: Fatal: master: service(config): child 5512 killed with signal 6 (core dumps disabled) Dovecot has a lot of certificates TLS configured (SNI) (about 3k), but if I check the size of all of them is aprox 170MB on disk.Why does it need so much memory to boot? Is normal? service config { vsz_limit = {{ vszlimit }} }

2 1

mail.error listen_fd(7): Error: 22 46530 BYE
by Juerg Reimann 14 Feb '22

14 Feb '22

Hi there, What do the following logs mean and how do I resolve the problem? 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46519 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46529 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46531 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46530 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46532 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46537 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46535 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 22 46536 BYE 2022-02-14T12:44:24+01:00 localhost dovecot: [ID 702911 mail.error] listen_fd(7): Error: 26 46534 BYE Thanks for your help, Juerg

1 0

JWT tokens, timestamps and doubles (microseconds)
by Aleš Krajník 14 Feb '22

14 Feb '22

Hi all, I am having troubles with OAuth2 setup with local introspection of JWT tokens. This happens, when the JWT tokens contain timestamps as doubles, with microseconds, for example with the following payload: { "aud": "caf65d650022e3eb7cce518e7526a39f", "jti": "8291efed41d2ce65ec5c59a4cbcaa285f2ca37d5b2785da56de66adbd1b8eef65495bc 599be5ac56", "iat": 1644833538.793359, "nbf": 1644833538.79336, "exp": 1644833838.773605, "sub": "ales(a)example.com", "scope": "email" } Such a JWT token produces the following error: dovecot_1 | Feb 14 10:10:46 auth: Info: oauth2(ales(a)example.com,192.168.224.2,<xWZFoffXYujAqOAC>): oauth2 failed: Local validation failed: Malformed 'exp' field According to the RFC, the timestamps seem to be allowed to contain non- integer values: NumericDate A JSON numeric value representing the number of seconds from 1970- 01-01T00:00:00Z UTC until the specified UTC date/time, ignoring leap seconds. This is equivalent to the IEEE Std 1003.1, 2013 Edition [POSIX.1] definition "Seconds Since the Epoch", in which each day is accounted for by exactly 86400 seconds, other than that non-integer values can be represented. See RFC 3339 [RFC3339] for details regarding date/times in general and UTC in particular. (https://datatracker.ietf.org/doc/html/draft-ietf-oauth-json-web-token-32#se…) After removing the fractions, the token works well. This seems to be happening here: https://github.com/dovecot/core/blob/master/src/lib-oauth2/oauth2-jwt.c#L41 If you agree for this to be a bug, can I fill in a bug report somewhere? Thank you! Best, Aleš

2 1

wondering if I configured sieve vacation correctly
by Marc 14 Feb '22

14 Feb '22

I have a user who feels compelled to use the vacation as autoreply to confirm that a message has been received. The down side is of course, that if spam/abuse messages get through the spam filters, this can get 'messy'. Currently I am getting these ndr's as postmaster(?). But I was not actually expecting this. I would expect that the mailbox with the autoreply would get this report. The vacation is configured like this[1], my question is. What am I doing wrong that this ndr is not ending up in the users mailbox? Can it be the from is not correctly configured/set at the time the vacation message is being sent? [1] require ["vacation"]; # rule:[cccccccccc] if true { vacation :addresses "test(a)test.com" :from "test(a)test.com" text: dddddddddddddd } [2] Return-Path: <> Received: from aaaaa (localhost [127.0.0.1]) by aaaaa (8.14.7/8.14.7) with ESMTP id 21BDgaPj014029 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for <postyk(a)hm.edu>; Fri, 11 Feb 2022 14:42:36 +0100 Received: (from root@localhost) by aaaaa (8.14.7/8.14.7/Submit) id 21BDgamD014028 for postyk(a)hm.edu; Fri, 11 Feb 2022 14:42:36 +0100 X-Sieve: Pigeonhole Sieve 0.4.24 (124e06aa) Message-ID: <dovecot-sieve-1644586956-19320-0@bbbb> Date: Fri, 11 Feb 2022 14:42:36 +0100 From: test(a)test.com To: <postyk(a)hm.edu>

1 1

Backup procedures
by Jorge Bastos 13 Feb '22

13 Feb '22

Howdy, I have a particular situation where I have about 5 users using a large account in IMAP, and I have the need to backup the account daily or weekly or so. I was thinking about to copy the whole directory, each email is a file, it could probably work, but the dovecot index files would be damaged/wrong. Is there a tool that could perform a backup (ex: yesterday), and when I inserted that backup, it just insert the emails and folders that were deleted today? Thanks in advanced, Jorge

5 8

LMTP Crash with Dovecot 2.3.18
by Bryan Jacobs 13 Feb '22

13 Feb '22

Dear Dovecot Users, Upgrading from Dovecot 2.3.14 to 2.3.18 on Arch gives me the following dump immediately (100% of the time) on every LMTP handler invocation. Of course I'm using Squat for FTS (yes, I understand it's deprecated...). plugin { fts = squat fts_squat = partial=4 full=4 fts_autoindex = yes sieve = file:/mnt/mail/%Ln/sieve;active=/mnt/mail/%Ln/.dovecot.sieve master_user = %u } lmtp[592878]: segfault at 50 ip 00007f5355153eed sp 00007fff45b87ba0 error 4 in lib20_fts_plugin.so[7f5355153000+11000] Code: 00 4c 8d 05 f9 17 01 00 48 8d 0d ae 19 01 00 31 c0 ba 53 01 00 00 48 8d 35 f2 17 01 00 48 8d 3d 49 01 01 00 ff 15 53 7f 03 00 <48> 8b 04 25 50 00 00 00 0f 0b be 2a 01 00 00 8d 3d cf 17 01 00 > Feb 08 01:23:20 mail systemd-coredump[592880]: [🡕] Process 592878 (lmtp) of user 0 dumped core. > > Module linux-vdso.so.1 with build-id 0f9bd6468a3798a863048e6cd927830796809b46 > Module libffi.so.8 with build-id f90d8b734f6de9b25faedb8cbfab7054dafc0a42 > Module libp11-kit.so.0 with build-id cc372ea3c28c4d3dfc633b4d2e933c8584d2af16 > Module libcrypt.so.2 with build-id 5d45bdae438c16d52364b23d70bd5041ad070b0b > Module librt.so.1 with build-id 75484da2d6f1515189eefa076e0a40328834cd16 > Module libnss_systemd.so.2 with build-id 56da60140e2f0e47044a141378608146f6fd9bb8 > Module libnss_files.so.2 with build-id 1a36dfc01d3a1010b2ee79766a24a8090a3266d5 > Module libdovecot-sieve.so.0 with build-id a358da532b8ef09782b5a97a951df8ab5c8eb0db > Module lib90_sieve_plugin.so with build-id eb52835c5c3d1034617e745995b950484faed909 > Module lib21_fts_squat_plugin.so with build-id cc731fa9bf9cac2f890bbc1da598e958cb465d52 > Module libicudata.so.70 with build-id e1dcc2a88cfaafed882d09c90c668af0eed4efed > Module libgcc_s.so.1 with build-id 7f8508bb914546ada778809b64b99d234337d835 > Module libm.so.6 with build-id 2b8fd1f869ecab4e0b55e92f2f151897f6818acf > Module libstdc++.so.6 with build-id 9b5eeeb149bf3c4efe787fb398b44f00507aec87 > Module libicuuc.so.70 with build-id 2e245c2bf12f95fd8ab79b3a4be99524677cbd70 > Module libicui18n.so.70 with build-id 95af755fca990df26753a7d720b8e3ae24270e42 > Module lib20_fts_plugin.so with build-id 5b44deef3cd93f2cdac9a38ab3f5c4f1a2f48d40 > Module lib10_quota_plugin.so with build-id 5fa33175575dcf45f4aead56c701fe58a19f0df8 > Module libpthread.so.0 with build-id 07c8f95b4f3251d08550217ad8a1f31066229996 > Module libcrypto.so.1.1 with build-id 4c926b672d97886b123e03a008387aecf0786de4 > Module libssl.so.1.1 with build-id 1024424ab33a3767da03f4fdb1fc1b02479f160f > Module libssl_iostream_openssl.so with build-id ba2cf9015fbabf8459896bd584379f2f566aaa51 > Module ld-linux-x86-64.so.2 with build-id 040cc3dd10461562f177df39e3be2f3704258c3c > Module libdl.so.2 with build-id 5abc547e7b0949f89f3c0e21ab0c8331a7440a8a > Module libc.so.6 with build-id 4b406737057708c0e4c642345a703c47a61c73dc > Module libdovecot.so.0 with build-id 3f68ab1f1e0bffceea1c130e6b46f799eea45522 > Module libdovecot-storage.so.0 with build-id 3bf1e7c355c0c6184165e209f67b3a6627355401 > Module libdovecot-lda.so.0 with build-id 54cc9d9face18809a95ccd5ee643330eed997d8b > Module lmtp with build-id 7cc9238bb78e35771572aa3e31bdecf1cda5d754 > Stack trace of thread 592878: > #0 0x00007f5355153eed n/a (lib20_fts_plugin.so + 0x9eed) > #1 0x00007f535515db30 fts_mailbox_allocated (lib20_fts_plugin.so + 0x13b30) > #2 0x00007f535595eb6d hook_mailbox_allocated (libdovecot-storage.so.0 + 0x60b6d) > #3 0x00007f53559598ec mailbox_alloc (libdovecot-storage.so.0 + 0x5b8ec) > #4 0x00007f5355959b5e mailbox_alloc_for_user (libdovecot-storage.so.0 + 0x5bb5e) > #5 0x00007f5355a6d790 mail_deliver_save_open (libdovecot-lda.so.0 + 0x4790) > #6 0x00007f5355a6dbdc mail_deliver_save (libdovecot-lda.so.0 + 0x4bdc) > #7 0x00007f5355a6e39a mail_deliver (libdovecot-lda.so.0 + 0x539a) > #8 0x0000563d3a90bc2d lmtp_local_default_deliver (lmtp + 0x8c2d) > #9 0x0000563d3a90c39f lmtp_local_data (lmtp + 0x939f) > #10 0x0000563d3a90acc1 client_default_cmd_data (lmtp + 0x7cc1) > #11 0x0000563d3a90aa31 cmd_data_continue (lmtp + 0x7a31) > #12 0x00007f535579c3bf n/a (libdovecot.so.0 + 0x6d3bf) > #13 0x00007f535579cc46 n/a (libdovecot.so.0 + 0x6dc46) > #14 0x00007f53557a023e smtp_server_command_call_hooks (libdovecot.so.0 + 0x7123e) > #15 0x00007f53557a07f1 smtp_server_command_next_to_reply (libdovecot.so.0 + 0x717f1) > #16 0x00007f53557a5b5b n/a (libdovecot.so.0 + 0x76b5b) > #17 0x00007f535584469f io_loop_call_io (libdovecot.so.0 + 0x11569f) > #18 0x00007f5355844787 io_loop_handler_run (libdovecot.so.0 + 0x115787) > #19 0x00007f5355844919 io_loop_run (libdovecot.so.0 + 0x115919) > #20 0x00007f53557b31d8 master_service_run (libdovecot.so.0 + 0x841d8) > #21 0x0000563d3a909606 main (lmtp + 0x6606) > #22 0x00007f535557bb25 __libc_start_main (libc.so.6 + 0x27b25) Thanks, Bryan Jacobs

2 1

Dovecot installation problem (libssl_iostream_openssl.so is not portable!)
by Dimitri 11 Feb '22

11 Feb '22

Hi there, i finally solved the problem. On my server i always used openssl compiled from source with the following configuration options: > ./config --prefix=/test/dep/openssl --openssldir=/test/dep/openssl no-deprecated no-ssl The error when i try to compile dovecot tell about undefined references: > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `OBJ_cleanup' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_CTX_need_tmp_RSA' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_load_error_strings' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `ENGINE_cleanup' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `ERR_free_strings' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `EVP_cleanup' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_library_init' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `CRYPTO_cleanup_all_ex_data' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `SSL_CTX_set_tmp_rsa_callback' > > /usr/bin/ld: ./.libs/libssl_iostream_openssl.so: undefined reference to `OpenSSL_add_all_algorithms' for example "OBJ_cleanup". So i check these functions on the openssl documentation an saw the notice about "deprecated function since OpenSSL 1.1.0" Therefore i recompiled openssl with the following configuration options: > ./config --prefix=/test/dep/openssl --openssldir=/test/dep/openssl --api=1.0.0 After that the compilation of dovecot was successful. It seems that dovecot still uses now deprecated functions from openssl befor version 1.1.0 Can anyone tell me when dovecot doesn't need this deprecated functions anymore? Thanks!

1 0

Hanging doveadm-server processes with dsync replication
by Sebastian Marske 10 Feb '22

10 Feb '22

Dear Dovecot mailing list, after updating Dovecot from 2.3.16 to 2.3.18 on a dsync-replicated server there are hanging doveadm-server processes piling up over time, eventually resulting in some of the affected users being shown as out of sync. Our setup is based on FreeBSD 13, ZFS and Dovecot (we use custom packages built with poudriere) with master/master replication using dsync. However, we use a shared ip (Carp), so that only one server is actually active. Please see the output of "doveconf -n" at the end for our config. Starting from an in-sync state, I updated Dovecot on the inactive server. Occasionally, Dovecot logs messages like: Feb 8 15:02:15 myhost dovecot[99800]: doveadm(someuser)<2090><ZLayIal3AmIqCAAADKIhQg>: Error: write(<local>) failed: Timed out after 60 seconds These occur for an increasing number of users (maybe 30 after two days), but not for every user (there are >4800 users on that server) and also only once for every affected user. Here's some more information about the process/user from the log entry: # doveadm replicator dsync-status username type status someuser incremental Waiting for dsync to finish (the type is "incremental for most users, but "normal" and "full" show up as well) # doveadm replicator status someuser username priority fast sync full sync success sync failed someuser low 00:01:51 21:56:06 69:56:10 y (again, not all are in failed state) # top -abp 2090 PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 2090 sysdov 1 20 0 26M 15M kqread 12 0:01 0.00% doveadm-server: [<local>] (doveadm-server) (didn't change for >1d) # top -m io -abp 2090 PID USERNAME VCSW IVCSW READ WRITE FAULT TOTAL PERCENT COMMAND 2090 sysdov 363 58 0 271 2 273 0.00% doveadm-server: [<local>] (doveadm-server) (didn't change for >1d) # gdb -p 2090 ... (gdb stuff; gdb complaining about missing debug symbols) (gdb) bt full #0 0x00000000416a94ca in _kevent () from /lib/libc.so.7 No symbol table info available. #1 0x00000000419b94f3 in ?? () from /lib/libthr.so.3 No symbol table info available. #2 0x000000004152a645 in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00000000415282fa in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x0000000041528138 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x000000004148ac58 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #6 0x0000000001086431 in main () No symbol table info available. (gdb) So I guess it's waiting for something that * doesn't happen on my system * or it didn't wait for in 2.3.16 >From what I've seen, mails from the active server (still on 2.3.16) are replicated to this server. For non-affected users, mails are also replicated from this server to the active one. I can't tell about "outgoing" replication for affected users, yet. After downgrading back to 2.3.16, things are fine again. Most affected users jump back to being successfully synced within a couple of minutes. If not, starting replication via doveadm get's them there. Testing 2.3.18 again, it seems that the same users are affected again. I also tested 2.3.17 when it came out and had the same issue, paired with the ioloop issue [1], which was fixed in 2.3.18 and which I don't see anymore. The hanging doveadm processes remain, though. Do you have any suggestions on how to resolve this? [1] https://dovecot.org/pipermail/dovecot/2022-January/123907.html Best regards Sebastian # doveconf -n # 2.3.18 (9dd8408c18): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: FreeBSD 13.0-RELEASE-p6 amd64 # Hostname: myhost... auth_cache_ttl = 0 auth_username_chars = abcdefghijklmnopqrstuvwxyz01234567890@.- auth_username_format = %n default_client_limit = 126000 default_process_limit = 50000 default_vsz_limit = 512 M doveadm_password = # hidden, use -P to show it first_valid_gid = 20 first_valid_uid = 20 imap_client_workarounds = tb-extra-mailbox-sep imap_logout_format = in=%i out=%o delflag=%{deleted} deleted=%{expunged} trashed=%{trashed} session=<%{session}> login_trusted_networks = # imap proxy ips... mail_gid = sysdov mail_location = maildir:~/maildir:INDEX=/addons/index/%u:CONTROL=~/control:LAYOUT=fs mail_plugins = acl notify replication mail_uid = sysdov managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader namespace fremdeordner { list = yes location = maildir:%%h/maildir:INDEX=/addons/index/%u/FremdeOrdner/%%u:LAYOUT=fs prefix = FremdeOrdner/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes list = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox AutoCleanSpam { auto = subscribe } mailbox "Deleted Items" { special_use = \Trash } mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Entwürfe { special_use = \Drafts } mailbox "Gelöschte Elemente" { special_use = \Trash } mailbox "Gesendete Elemente" { special_use = \Sent } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox name { special_use = \Drafts \Junk \Sent \Trash \Archive } prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = failure_show_msg=yes dovecot driver = pam } plugin { acl = vfile acl_shared_dict = file:/addons/acl/shared-folder mail_replica = tcp:myreplica...:12345 sieve = /addons/sieve/%u.sieve sieve_dir = sieve_extensions = +imap4flags +editheader sieve_vacation_dont_check_recipient = yes } protocols = imap lmtp replication_dsync_parameters = -d -n 'inbox' -l 30 -U replication_max_conns = 150 service aggregator { fifo_listener replication-notify-fifo { user = sysdov } unix_listener replication-notify { user = sysdov } } service anvil { client_limit = 60003 unix_listener anvil-auth-penalty { mode = 00 } unix_listener anvil { group = nagios mode = 0660 } } service auth { client_limit = 126000 unix_listener auth-userdb { mode = 0644 user = sysdov } } service config { unix_listener config { user = sysdov } } service doveadm { inet_listener { port = 12345 } user = sysdov vsz_limit = 1 G } service imap-login { client_limit = 20000 process_limit = 10000 process_min_avail = 138 service_count = 0 } service imap { process_limit = 80000 process_min_avail = 10 vsz_limit = 512 M } service lmtp { client_limit = 1 executable = lmtp -L process_min_avail = 20 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = sysdov } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = sysdov } } ssl_cert = </usr/local/etc/letsencrypt/live/myhost/fullchain.pem ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { default_fields = mail_replica=tcp:myreplica...:12345 driver = passwd override_fields = uid=29 gid=29 blocking=yes } verbose_proctitle = yes protocol imap { login_trusted_networks = # imap proxy ips... mail_max_userip_connections = 25 mail_plugins = acl notify replication acl imap_acl } protocol lmtp { mail_plugins = acl notify replication sieve postmaster_address = postmaster@... sendmail_path = /usr/local/sbin/sendmail }

1 0

Different handling of upper and lower case while indexing/searching with Solr
by Patrik Peng 10 Feb '22

10 Feb '22

Hello there We stumbled upon an user account with Solr FTS, which returned no search results for any given search query. Further investigation revealed an issue between indexing mails and querying the index. The user name contains upper and lower case characters (eg. Some.User(a)domain.net) When new mail is indexed for this user, the user name used for Solr's `user` and `id` fields are transformed into lowercase, as shown in the Solr log: webapp=/solr path=/update params={...}{add=[8543/426f3b0348d03451a3fb00008ba2b673/some.user(a)domain.net (1724281617442144256), ... (162 adds)]} 0 44298 And can be confirmed by manually querying Solr. The Solr schema in use performs no transformation for the affected fields. When a search request is performed via IMAP, Dovecot queries Solr with the original user name: GET /solr/dovecot_fts_popimap/select?wt=json&f...&fq=%2Bbox:1a30ec359dce3451b8e600008ba2b673+%2Buser:Some.User@domain.net HTTP/1.1" Which (correctly) returns zero results. To summarize, I suspect dovecot transforms any user name to lower case while indexing mails, but not when querying for results. Is this a bug, or caused by misconfiguration? Regards Patrik

3 9

Outlook 2019 and push notifications
by Laura Smith 10 Feb '22

10 Feb '22

Is there some secret config sauce I'm unaware of to get IMAP push notifications working with Outlook ? My present situation is that non-Outlook users (e.g. Apple iOS, Apple Mail etc.) work perfectly with the config below. New emails get pushed, deletes get reflected, all is happy in the world. But with Outlook nothing. You send a user an email, nothing happens in their inbox until you manually refresh by checking for new mails or waiting for the auto-check to kick in (sometimes switching between IMAP folders also does the trick). I know Outlook has a long history of being a mess when it comes to standards compliance, but surely it can't be this bad ? doveconf -n : # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.10.0-11-amd64 x86_64 Debian 11.2 xfs # Hostname: foobar.example.com auth_verbose = yes auth_verbose_passwords = sha1:7 doveadm_password = # hidden, use -P to show it imap_capability = +SPECIAL-USE imapc_features = rfc822.size fetch-headers fetch-bodystructure imapc_port = 993 imapc_ssl = imaps mail_location = maildir:/foo_data/mail/%d/%n/Maildir mail_plugins = notify replication push_notification managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/local_sql_users.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/imap_sieve/spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/imap_sieve/ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * sieve = file:~/sieve;active=~/.dovecot.sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /etc/dovecot/imap_sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } vsz_limit = 2 G } service doveadm { inet_listener { port = 11867 ssl = yes } } service imap-login { process_min_avail = 5 service_count = 1 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = foo_virtmail } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieves { address = port = 5190 ssl = yes } } ssl = required ssl_ca = </etc/foobar/ssl/certificates/_.example.com.issuer.crt ssl_cert = </etc/foobar/ssl/certificates/_.example.com.crt ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/local_sql_users.conf default_fields = uid=foo_virtmail gid=foo_virtmail home=/foo_data/mail/%d/%n driver = sql } protocol lmtp { mail_plugins = notify replication push_notification sieve postmaster_address = foo(a)foobar.com } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = notify replication push_notification sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { mail_max_userip_connections = 20 mail_plugins = notify replication push_notification imap_sieve }

2 1

Certificate and showing a sign-cert not there
by Wayne Spivak 09 Feb '22

09 Feb '22

Hi - I am running Postfix 3.6.4 with Dovecot 2.3.17.1 (476cd46418). I have a multi-signed cert from Entrust. The cert works fine on port 25. However, on Port 587 I get an error: c [root@mcq wbs]# openssl s_client -connect mcq.sbanetweb.com:993 -servername mcq.sbanetweb.com CONNECTED(00000003) depth=0 C = US, ST = New York, L = Bellmore, O = SBA Consulting LTD, CN = mcq.sbanetweb.com verify error:num=20:unable to get local issuer certificate verify return:1 depth=0 C = US, ST = New York, L = Bellmore, O = SBA Consulting LTD, CN = mcq.sbanetweb.com verify error:num=21:unable to verify the first certificate verify return:1 depth=0 C = US, ST = New York, L = Bellmore, O = SBA Consulting LTD, CN = mcq.sbanetweb.com verify return:1 --- Certificate chain 0 s:C = US, ST = New York, L = Bellmore, O = SBA Consulting LTD, CN = mcq.sbanetweb.com i:C = US, O = "Entrust, Inc.", OU = See www.entrust.net/legal-terms <http://www.entrust.net/legal-terms> , OU = "(c) 2012 Entrust, Inc. - for authorized use only", CN = Entrust Certification Authority - L1K [root@mcq wbs]# dovecot -n # 2.3.17.1 (476cd46418): /etc/dovecot/dovecot.conf # OS: Linux 5.16.5-200.fc35.x86_64 x86_64 Fedora release 35 (Thirty Five) # Hostname: mcq.sbanetweb.com auth_mechanisms = plain login disable_plaintext_auth = no mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service submission-login { inet_listener submission { port = 587 } } ssl = required ssl_cert = </etc/postfix/tls/ServerCertificate.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-G CM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AE S128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA25 6:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE- ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES1 28-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE -DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES12 8-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNUL L:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-D ES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_client_ca_dir = /etc/postfix/tls/ ssl_client_ca_file = ChainBundle.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = passwd } protocol imap { mail_max_userip_connections = 15 } Any ideas? Wayne Spivak SBANETWEB.com

5 9

Config for filtering (ignoring) specific mbox mail folders?
by John Hardin 08 Feb '22

08 Feb '22

Folks: I'm migrating to Dovecot to provide IMAP services for my personal network. I have more than a couple of decades of mail in multiple (1000+) mbox mail files, but I don't care to expose all of those to IMAP. Is there any way to filter out what mail folders Dovecot will LIST and provide access to using globs or regular expressions? I'd prefer to avoid rearranging the mbox files (e.g. to subdirectories) if possible. I looked through the Dovecot documentation and didn't see anything promising, and I couldn't find any discussion of the topic online. The feature that looked like it might be closest was Namespaces, but I couldn't see how to use that to ignore specific mbox files. Is there any facility within Dovecot (or a plugin) to filter out / ignore mail folders by name, RE or file glob? Thanks in advance! -- John Hardin KA7OHZ http://www.impsec.org/~jhardin/ jhardin(a)impsec.org pgpk -a jhardin(a)impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79

1 0

Re: On mailbox full, retry for 4 days or similar instead of reject
by Jorge Bastos 08 Feb '22

08 Feb '22

Hi Lucas, Oh, it's so damn simple! Thank you!! Thank you all others aswell, i've read all info sent, thanks!! Jorge On 2022-02-07 22:57, Lucas Rolff wrote: > An option is to use > https://doc.dovecot.org/settings/core/#core_setting-quota_full_tempfail > - you can configure it e.g. > > protocol lda { > quota_full_tempfail = yes > } > >> On 7 Feb 2022, at 23:41, Jorge Bastos <mysql.jorge(a)decimal.pt> wrote: >> >> Howdy, >> >> I don't know if this is dovecot specific and i guess it may not be at >> 100% so I ask for help. >> >> I want postfix not to discard the message imediatly when a mailbox is >> full, i mean when postfix tries to deliver it to dovecot lmtp. >> Is it possible to change the behavior to something like what postfix >> does when he tries to deliver a message to an external server and the >> server is unaccessible for 4 days (the default i guess), and if in >> that period discard it. >> >> Does this exists? At least i know gmail does something similar to >> this. >> >> I've tried to google a bit but didn't found info that could lead me to >> this configuration. >> >> Thanks in advanced, >> Jorge

1 1

sieve: destination folder lookup in database?
by Hadmut Danisch 08 Feb '22

08 Feb '22

Hi, is there a way to lookup the action for an incoming mail, especially which folder to move the mail in, in a database? Given Problem: I want to replace the mda mailfilter/maildrop with dovecot/sieve. The mailfilter script is rather short, but looksup the destination folder by querying a berkeley database file with the sender's address to find the target folder, using the sender's address as an index. This way, it can store the target folder for hunders or thousands of senders, without needing to compare every single one of them by if == elsif == else... Is there a similar method for dovecot / sieve? I found that dovecot's sieve has some database connections, e.g. LDAP or https://doc.dovecot.org/configuration_manual/sieve/dict/ but rather to receive the whole sieve script for a given recipient as the owner of the mailbox. Is there a way to determine the target folder where to drop a mail into quickly by the sender's address, even for thousands, without the need to compare every single one of them? regards Hadmut

2 2

sieve script to alter subject of incoming message after lookup
by Marc 08 Feb '22

08 Feb '22

Is it possible with sieve to : 1. get sender of an email 2. lookup if this sender is present in an mailbox 3. if the sender is known, change the subject of the email. if the sender is not known, do nothing. 4. put/leave message in inbox. or maybe use dictionary (not really familiar with this) 1. get sender of an email 2. lookup if this sender is present in an dictionary 3. if the sender is known, change the subject of the email. if the sender is not known, do nothing. 4. put/leave message in inbox. But then I need something like 1. if message is dragged into a specific mailbox/folder 2. add sender to dictionary 1. if message is removed from a specific mailbox/folder 2. remove sender from dictionary

1 0

Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 07 Feb '22

07 Feb '22

dovecot-2.3.5 and centos 7 User and IP are logged in both scenarios. auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch auth-worker(13380): cache(user(a)online.no,1.1.1.1): Password mismatch dovecot-2.3.17 and rhel 8 Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): Password mismatch (given password: xxxx) Feb 03 14:43:48 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) User and IP is not logged in cache lookup. Is this a design change or a unplanned change? Any ide when it was changed?

1 0

Lucene support for FTS - EOL date.
by Jacek Grabowski 07 Feb '22

07 Feb '22

Hello Actually on the https://doc.dovecot.org/configuration_manual/fts/lucene/ site we can read about lucene fts plugin: "This plugin is no longer maintained in Dovecot (as of 2.3+) and will be removed in the future." Does anyone know about approximate EOL date for lucene plugin support in Dovecot? -- Pozdrawiam. Jacek Grabowski.

6 8

Dovecot v2.3.17.1 Released
by Aki Tuomi 07 Feb '22

07 Feb '22

We are happy to announce 2.3.17.1 patch release of Dovecot. This contains some fixes for issues found after 2.3.17 release. https://dovecot.org/releases/2.3/dovecot-2.3.17.1.tar.gz https://dovecot.org/releases/2.3/dovecot-2.3.17.1.tar.gz.sig Binary packages in https://repo.dovecot.org/ Docker images in https://hub.docker.com/r/dovecot/dovecot Aki Tuomi Open-Xchange oy -- - dsync: Add back accidentically removed parameters. - lib-ssl-iostream: Fix assert-crash when OpenSSL returned syscall error without errno. - master: Dovecot failed to start if ssl_ca was too large.

7 8

test-file-cache.c needs #ifdef HAVE_RLIMIT_AS
by Rupert Gallagher 07 Feb '22

07 Feb '22

test-file-cache.c:259:24: error: use of undeclared identifier 'RLIMIT_AS' test_assert(getrlimit(RLIMIT_AS, &rl_cur) == 0); ^ test-file-cache.c:267:24: error: use of undeclared identifier 'RLIMIT_AS' test_assert(setrlimit(RLIMIT_AS, &rl_new) == 0); ^ test-file-cache.c:270:24: error: use of undeclared identifier 'RLIMIT_AS' test_assert(setrlimit(RLIMIT_AS, &rl_cur) == 0); ^ test-file-cache.c:276:24: error: use of undeclared identifier 'RLIMIT_AS' test_assert(setrlimit(RLIMIT_AS, &rl_new) == 0); ^ test-file-cache.c:279:24: error: use of undeclared identifier 'RLIMIT_AS' test_assert(setrlimit(RLIMIT_AS, &rl_cur) == 0); ^

3 9

v2.3.17 quota-dict related sql errors
by Pascal Volk 06 Feb '22

06 Feb '22

Hi there, I've updated Dovecot from v2.3.14 (cee3cbc0d) to v2.3.17 (e2aa53df5b). Right after the update, dovecot begun flooding the mail.log and PostgreSQL's log. My dict sql configuration: ,--[ .../dovecot/dovecot-dict-sql.conf.ext ]-- | map { | pattern = priv/quota/storage | table = userquota | username_field = uid | value_field = bytes | } | map { | pattern = priv/quota/messages | table = userquota | username_field = uid | value_field = messages | } `-- This worked for decades. Since the update dovecot is passing the user's email address, instead the user's UID to the query. And therefor I have lots of errors in the log files: see attached `mail.log' and `postgresql-14-main.log' excerpts. The `userquota' table looks like this: Table "public.userquota" Column | Type | Collation | Nullable | Default ----------+---------+-----------+----------+--------- uid | bigint | | not null | bytes | bigint | | not null | 0 messages | integer | | not null | 0 ... Foreign-key constraints: "fkey_userquota_uid_users" FOREIGN KEY (uid) REFERENCES users(uid) ON DELETE CASCADE (full database structure: https://bitbucket.org/pvo/vmm/src/vmm-0.7.0/pgsql/create_tables.pgsql) Regards, Pascal -- Ubuntu is an ancient African word meaning “I can’t install Debian.” -- unknown

3 4

Can't get it to work with conf.d files
by Ruben Safir 06 Feb '22

06 Feb '22

I am trying to set up dovecot to be a sasl auithenticator for postfix but it can't get it to function even on the most fundemental level /usr/bin/dovecot -a -F -c /etc/dovecot/dovecot.conf # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/15-mailboxes.conf line 48: Unknown setting: service { namespace { namespace and before this, when I tried to get 10-ssl to work it said the same thing - unknonw setting Somewhere it is messed up in the syntax of the config files and I don't know where or how to run it down in a debugger. Here is the config file mail2:[root]:/etc/dovecot# grep "^#" -v /etc/dovecot/dovecot.conf|grep -v "^$" protocols = pop3 submission base_dir = /var/run/dovecot/ dict { #quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } !include conf.d/*.conf !include_try local.conf mail2:[root]:/etc/dovecot# -- So many immigrant groups have swept through our town that Brooklyn, like Atlantis, reaches mythological proportions in the mind of the world - RI Safir 1998 http://www.mrbrklyn.com DRM is THEFT - We are the STAKEHOLDERS - RI Safir 2002 http://www.nylxs.com - Leadership Development in Free Software http://www.brooklyn-living.com Being so tracked is for FARM ANIMALS and extermination camps, but incompatible with living as a free human being. -RI Safir 2013

1 0

Can't get it to work with conf.d files
by Ruben Safir 06 Feb '22

06 Feb '22

I am trying to set up dovecot to be a sasl auithenticator for postfix but it can't get it to function even on the most fundemental level /usr/bin/dovecot -a -F -c /etc/dovecot/dovecot.conf # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/15-mailboxes.conf line 48: Unknown setting: service { namespace { namespace and before this, when I tried to get 10-ssl to work it said the same thing - unknonw setting Somewhere it is messed up in the syntax of the config files and I don't know where or how to run it down in a debugger. -- So many immigrant groups have swept through our town that Brooklyn, like Atlantis, reaches mythological proportions in the mind of the world - RI Safir 1998 http://www.mrbrklyn.com DRM is THEFT - We are the STAKEHOLDERS - RI Safir 2002 http://www.nylxs.com - Leadership Development in Free Software http://www.brooklyn-living.com Being so tracked is for FARM ANIMALS and extermination camps, but incompatible with living as a free human being. -RI Safir 2013

1 0

Received invalid SSL certificate: unable to get certificate CRL
by Laura Smith 06 Feb '22

06 Feb '22

I'm having a frustrating problem trying to use "doveadm sync" to pull mails off a server for migration purposes. # 2.3.17.1 (476cd46418): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.17.1 (a1a0b892) # OS: Linux 5.10.0-11-amd64 x86_64 Debian 11.2 I have tried both explicit "ssl_client_ca_dir = /etc/ssl/certs" and commenting it out (i.e. relying on OpenSSL default per the docs) I always get the same: Info: Received invalid SSL certificate: unable to get issuer certificate: /C=US/O=Internet Security Research Group/CN=ISRG Root X1 (check ssl_client_ca_* se ttings?) Received invalid SSL certificate: unable to get issuer certificate: /C=US/O=Internet Sec urity Research Group/CN=ISRG Root X1 (check ssl_client_ca_* settings?) - disconnecting openssl s_client -starttls imap -servername $name -connect $name:143 is happy though: --- Certificate chain 0 s:CN = <REDACTED> i:C = US, O = Let's Encrypt, CN = R3 1 s:C = US, O = Let's Encrypt, CN = R3 i:C = US, O = Internet Security Research Group, CN = ISRG Root X1 2 s:C = US, O = Internet Security Research Group, CN = ISRG Root X1 i:O = Digital Signature Trust Co., CN = DST Root CA X3 --- --- No client certificate CA names sent Peer signing digest: SHA256 Peer signature type: RSA-PSS Server Temp Key: X25519, 253 bits --- SSL handshake has read 4954 bytes and written 412 bytes Verification: OK --- New, TLSv1.3, Cipher is TLS_AES_256_GCM_SHA384 Server public key is 2048 bit Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) ---

4 10

How to "activate" a mail directory?
by Peter Nabbefeld 06 Feb '22

06 Feb '22

Hello, as I need a mailbox locally only just for filtering, I've tried to manually create it (using Maildir as backend): 1. Created a folder in the appropriate location under /home/vmail with subfolders cur, new, tmp. 2. Set the same user:group as for the other folders (i.e. vmail:vmail). 3. Restarted Dovecot and Email-Client (Thunderbird). However, I cannot subscribe to the new folder. What am I missing here? Kind regards, Peter

2 2