- dovecot - dovecot.org

Re: creation of ssl-parameters fails
by Kai Schaetzl 20 Aug '18

20 Aug '18

Aki Tuomi wrote on Sun, 19 Aug 2018 18:21:31 +0300: > Just generate new parameters on some machine with good entropy source. So, if it fails to transform (although bigger) the machine hasn't enough entropy (because it's quite new?)? I'm generating now on the original machine from last year which is still going on while a second run on one of the machines where it failed to transform is already finished. So, that would indicate it has less entropy? Can I re-use the ssl-parameters.dat for several machines or should I create a new one for each? For the time being I just copied the dh.pem over, to get going, but I guess this should only be a temporary workaround? Thanks! Kai

3 6

imapsieve: Change message flags on COPY
by Leandro Lucarella 20 Aug '18

20 Aug '18

Hello, I'm trying to do a simple thing using imapsieve, I want messages to be marked as read when moved to certain folders (Trash, Archive, Spam). All the set up to run the imapsieve script works perfectly, but I'm having trouble to make changes effective. As the RFC says, IMAP messages are immutable, but it's not clear to me reading the specs if this applies to IMAP flags too, as one can really change flags in IMAP without having to create a new (modified) message, I guess this is an exception? 3.8. The "setflag", "deleteflag", and "removeflag" Actions Implementations of IMAP events in Sieve MUST also support the imap4flags extension [RFC5232], and the actions associated with it are all applicable to any case that falls under IMAP events in Sieve. It is worth noting also that the "hasflag" test that is defined in the imap4flags extension might be particularly useful in scripts triggered by flag changes ("hasflag" will see the new, changed flags). The flag changes behave as though a client had made the change. As explained above, in order to avoid script loops, flag changes that are made as a result of a script that was itself invoked because of flag changes SHOULD NOT result in another script invocation. In any case, implementations MUST take steps to avoid such loops. https://tools.ietf.org/html/rfc6785 Should changing flags just work for imapsieve? I even tried to use fileinto to explicitly save a new message (as far as I understand if I use fileinto the implicit keep should be cancelled, so the original message should be flagged as \Deleted (this is another hint that changing flags in immutable messages should be fine), and a new message should be created with the changed flags. But this is not happening, after moving the message I see unseen message still not flagged with \Seen. This is my imapsieve script: ---------------------------- require ["variables", "imap4flags", "fileinto", "vnd.dovecot.imapsieve", "vnd.dovecot.environment", "vnd.dovecot.execute", "vnd.dovecot.debug"]; if header :matches "Subject" "*" { set "subject" "${1}"; } if header :matches "From" "*" { set "from" "${1}"; } if environment :matches "imap.mailbox" "*" { set "dst" "${1}"; } debug_log "IMAPSIEVE TEST ---------------------"; debug_log "subject:${subject}"; debug_log "from:${from}"; debug_log "dst:${dst}"; debug_log "END IMAPSIEVE TEST -----------------"; if string :is "${dst}" ["Archive", "Trash", "Spam", "Sent"] { debug_log "Moved to ${dst}, marking as read: '${subject}' <${from>"; setflag "\\Seen"; fileinto "${dst}"; } ---------------------------- This is the log: Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: Archive: Mailbox opened because: UID MOVE Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: Mailbox INBOX: Opened mail UID=13304 because: copying Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: imapsieve: mailbox Archive: MOVE event Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: imapsieve: Matched static mailbox rule [1] Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: file storage: Using Sieve script path: /home/luca/sieve/imapsieve.sieve Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: file script: Opened script `imapsieve' from `/home/luca/sieve/imapsieve.sieve' Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: Opening script 1 of 1 from `/home/luca/sieve/imapsieve.sieve' Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: Loading script /home/luca/sieve/imapsieve.sieve Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: Script binary /home/luca/sieve/imapsieve.svbin successfully loaded Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: binary save: not saving binary /home/luca/sieve/imapsieve.svbin, because it is already stored Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: sieve: Executing script from `/home/luca/sieve/imapsieve.svbin' Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: imapsieve: line 11: DEBUG: IMAPSIEVE TEST --------------------- Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: imapsieve: line 12: DEBUG: subject:Ihr DHL Paket wurde zugestellt. Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: imapsieve: line 13: DEBUG: from:DHL Paket <noreply(a)dhl.de> Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: imapsieve: line 16: DEBUG: dst:Archive Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: imapsieve: line 17: DEBUG: END IMAPSIEVE TEST ----------------- Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: imapsieve: line 23: DEBUG: Moved to Archive, marking as read: 'Ihr DHL Paket wurde zugestellt.' <DHL Paket <noreply(a)dhl.de>> Aug 16 10:31:51 alerce dovecot: imap(luca): Debug: Archive: Mailbox opened because: lib-lda delivery Aug 16 10:31:51 alerce dovecot: imap(luca): sieve: left message in mailbox 'Archive' The last line looks weird, it seems like the message is not being copied, right? I tried adding a stop; too, as suggested in this thread https://www.dovecot.org/list/dovecot/2017-April/107658.html, but the effect is the same, the message in Archive is still not flagged as \Seen. So the main question here is if changing IMAP flags in imapsieve scripts shouldn't just work, without even having to use fileinto, and if not, why isn't even using fileinto working? PS: Please Cc me, I'm not in the list. Thanks! -- Leandro Lucarella (Luca) https://llucax.com

2 4

creation of ssl-parameters fails
by Kai Schaetzl 19 Aug '18

19 Aug '18

I did that the last time one year ago, now on another machine with the same software (Ubuntu 16.04) it fails. openssl dhparam 4096 > /var/lib/dovecot/ssl-parameters.dat dd if=/var/lib/dovecot/ssl-parameters.dat bs=1 skip=88 | openssl dhparam -inform der > /etc/dovecot/dh.pem last command fails with 681+0 records in 681+0 records out 681 bytes copied, 0,00278343 s, 245 kB/s unable to load DH parameters 139858178938624:error:0D0680A8:asn1 encoding routines:asn1_check_tlen:wrong tag:../crypto/asn1/tasn_dec.c:1129: 139858178938624:error:0D07803A:asn1 encoding routines:asn1_item_embed_d2i:nested asn1 error:../crypto/asn1/tasn_dec.c:289:Type=DH ssl-parameters.dat is more than double the size as the one that worked. And that one I can still transform: 272+0 records in 272+0 records out 272 bytes copied, 0,00105017 s, 259 kB/s So, something with openssl dhparam 4096 > /var/lib/dovecot/ssl-parameters.dat must be wrong. But what? https://wiki.dovecot.org/SSL/DovecotConfiguration tells to use this command. Thanks! Kai

3 2

dovecot and postfix, help?
by Christy S 19 Aug '18

19 Aug '18

Hi all, First a disclaimer. I have played with linux off and on for years, but this is my first time trying to run a server completely on my own from start to finish, well it's on a vps, but still. I'm pretty techie, but a lot of this stuff is new to me, so I apologize for any *duh!* questions. That said, I've so far installed dovecot, postfix, wordpress, and related programs mostly successfully by following tutorials. I say mostly successfully, because I'm having a really hard time trying to get dovecot and postfix to behave together, and I'm about at the end of what I know how to find on google. If you're still with me and not groaning at yet another newbie asking wtf did I do wrong questions, thank you! My basic setup is running ubuntu 18 with up to date dovecot and postfix. Sasl is installed, and I'm using a custom domain with all records successfully pointing to the VPS. As I mentioned, I've been following tutorials. My goal is to have a mail server which can send and receive emails using this custom domain both from the shell and, much more often, from my primary computer using thunderbird. As there will likely only be two of us using this, I'm completely fine with the setup using mailboxes that actually have linux accounts. I'm also using maildir as the mailbox type. Furthermore, I want to make sure to use ssl on any mail connections.. Normal passwords but ssl being used. So, following one tutorial I set up postfix and dovecot, then went to test it. The result was that while on the shell, I could send email to my gmail account from the domain and receive it just fine. I could also send mail from my gmail account to the domain and receive it on the shel. I even managed to get imap to work, so I could receive domain emails in thunderbird, after playing around with tb's settings. However, if using tb I attempted to send an email using the custom domain, smtp failed to connect. I verified with my VPS provider that no, they do not block port 25, 465 or 587. I also verified that at&t, my home ISP, does not block outgoing smtp traffic, considering I am using google's for my gmail account. After hitting google again, I realized two things. One, for some reason port 25 never got opened on UFW, so I fixed that. Second, for some reason in all the stuff I did, postfix never got configured to use SSL. I found yet another tutorial, and ran through it to set up SSL with postfix. However, in doing this I had to change a path for sasl, only to find out later that doing that broke dovecot! Imap completely and utterly stopped behaving. Back to google again, and this time I found something a bit more up to date which explained how to interconnect postfix and dovecot. It goes through using mysql too, but I don't need that, so I skipped that part. Changed the sasl path back to what it should be, told dovecot and postfix to talk to each other and... Nope, still nothing. I saw a warning that I should not use different certificates for postfix and dovecot, so I told dovecot to look at the smtpd certificate that I made. Not sure if that's what's breaking this or something completely different, as I'm also brand new to the ssl certificate creation process. So, here's the current status of using thunderbird with my domain. mail sent from gmail to new domain, never comes back in thunderbird but doesn't bounce, either. Mail sent via thunderbird to gmail from domain, works, but shows up as from my gmail domain as well, which makes me think it's defaulting to the gmail account even though the domain's smtp info is set up. This could be because just before writing this message, I got the accept this certificate dialog over and over again for the domain and had to cancel out of it. One final point. I looked at /var/log/mail.log and, while at first I found an error in the path to one of the certificates, once I fixed that no error shows up. I restarted both postfix and dovecot, tried refreshing thunderbird and still no emails showed up. I see the connection in the log, but no errors. Anyone have ideas? Even maybe just point me in the right direction for what to check?

3 2

update to my first email
by Christy S 19 Aug '18

19 Aug '18

Alright so after checking logs, rebooting the vps because why not, and removing and re-adding the account in thunderbird... Now nothing is working other than sending mail from gmail to the domain. imap does not pick up the email and trying to send with the domain just plain fails, saying it can't connect to the server. Honestly, tempted to uninstall dovecot, sasl and postfix and start again, but I don't want to run into the same issues with conflicting tutorials. Does anyone know of a good source of how to do this that's fairly recent? I'll keep searching, but all of the outdated info is kind of frustrating. If anyone has replied to me I haven't gotten it yet, so I'm not ignoring anything you may have said. For now going to give this a break. I've been working on it literally all day! :) Christy

4 3

None
by Jarrad 18 Aug '18

18 Aug '18

1 0

Imap special-use with IOS 11
by Federico Bartolucci 17 Aug '18

17 Aug '18

Hello, has anyone experiened any issues with IMAP SPECIAL-USE extension with ios11? After the update to ios11 the Ios mail client seems to not recognize anymore the imap special-use, so that system folders (Sent, Trash etc..) are not authomatically recognized and set during the configuration. Regards Federico

2 1

"nologin" field set leads to internal failure
by postminion＠dicksinmyan.us 17 Aug '18

17 Aug '18

Hi, I've tried to use the "nologin" extra password-db field as specified here: https://wiki.dovecot.org/PasswordDatabase/ExtraFields/NoLogin Due to lack of exact documentation, I've tried to use `nologin`='y' for users that can't login, and setting `nologin`='n' for normal users. Apparently setting it to NULL for normal users would have been correct, as I've found out. Maybe write that on the above website. Anyway, login didn't work for a user with `nologin`='n' set. Trying to debug a normal user being unable to login, the log (mail.log) says: dovecot: imap-login: Disconnected (internal failure, 4 successful auths): user=<test(a)example.com>, method=PLAIN, rip=<ip6>, lip=<ip6>, TLS, session=<session> What I'm expecting it to say would be something like "user not allowed to login". I'm considering this a problem because of "Dovecot always logs a detailed error message if something goes wrong." as written here: https://wiki2.dovecot.org/Logging For the record, setting auth_debug=yes and mail_debug=yes gave the following line in the logs somewhere, from which I was able to figure out that NOLOGIN was the problem: dovecot: auth: Debug: client passdb out: OK#011<id>#011user=test(a)example.com#011nologin Thank you. dovecot -n output: --snip-- # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_default_realm = example.com base_dir = ... listen = *,[v6] login_greeting = ... mail_home = .../%d/%n/ mail_location = maildir:~/mail/:INDEX=MEMORY mail_plugins = trees mail_temp_dir = ... namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap lmtp recipient_delimiter = -+ service auth { unix_listener ... { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 } service_count = 1 } service lmtp { unix_listener ... { group = postfix mode = 0600 user = postfix } user = vmail } ssl = required ssl_cert = <... ssl_cipher_list = ... ssl_dh_parameters_length = 4096 ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } --snap--

1 0

imap-login: Error: BUG: Authentication server sent unknown id
by Tom Sommer 17 Aug '18

17 Aug '18

I randomly get these errors on my Director Aug 17 10:52:37 imap-login: Error: BUG: Authentication server sent unknown id 98448 Aug 17 10:52:37 imap-login: Warning: Auth connection closed with 2 pending requests (max 2 secs, pid=27036, Received broken input: FAIL 98448 user=user(a)example.com) Aug 17 10:52:37 auth: Warning: auth client 27036 disconnected with 1 pending requests: EOF 2.3.2.1 -- Tom

2 1

None
by Aki Tuomi 17 Aug '18

17 Aug '18

---Aki TuomiDovecot oy

1 0

sdbox filesystem backup potential excludes
by Daniel Miller 17 Aug '18

17 Aug '18

When doing a filesystem backup of an moderate sdbox mailstore (300GB) - are there any files that can be safely excluded from the backup? Like *.log or *.backup? Or are they all "vital" for recovery? I'm already excluding the sdbox/virtual folders as it looks like they get created and updated as needed. -- Daniel

2 4

imapsieve wrong matches on APPEND cause
by Alex Cherevko 17 Aug '18

17 Aug '18

Hello, I'm experiencing some strange problem with imapsieve mailbox rules matching. I have Ubuntu Server 18.04.1 LTS with Postfix 3.3.0, Dovecot 2.2.33.2 and Rspamd 1.7.9. The problem occurs with Microsoft Outlook 2016 mail client. When moving with Outlook, APPEND event is logged instead of MOVE. However, when moving with another client, MOVE event is logged. So without APPEND event in causes in plugin section of dovecot.conf no rule is matched at all. If I add APPEND event into causes in plugin section of dovecot.conf, then for some reason imapsieve matches both rules on move from Inbox to Spam and no rules on move from Spam to Inbox. Matching both rules attempts to run both learn_spam and learn_ham. First one works and second logs error (which is correct). On attempt to move message from Spam to Inbox imapsieve not matching any rule at all and thus learning is not working. Could you please let me know how to fix this? More details. Here is what I have in my plugin section of dovecot.conf: ---------------------------------------- %< ---------------------------------------- plugin { imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_from = Inbox imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = Inbox sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-scr ipt.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_global_dir = /var/vmail/sieve/global/ sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms } ---------------------------------------- %< ---------------------------------------- I also have Trash, Drafts, Sent and Spam mailboxes defined in dovecot.conf. So when I try to move actual spam message from Inbox to Spam folder, this is what I see in dovecot.log: ---------------------------------------- %< ---------------------------------------- Debug: imapsieve: mailbox Spam: APPEND event ---------------------------------------- %< ---------------------------------------- So before I added "APPEND" into above imapsieve_mailbox1_causes and imapsieve_mailbox2_causes imapsieve was not matching rules at all. But after I added APPEND, here is what happens. In case I move message from Inbox to Spam both rules are matched and dovecot attempts to run both rules: ---------------------------------------- %< ---------------------------------------- Debug: INBOX: Mailbox opened because: SELECT Debug: Spam: Mailbox opened because: SELECT Debug: imapsieve: mailbox Spam: APPEND event Debug: sieve: Pigeonhole version 0.4.21 (92477967) initializing Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(APPEND) => before=`file:/var/vmail/sieve/global/learn-spam.sieve' after=(none) Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(APPEND) => before=`file:/var/vmail/sieve/global/learn-ham.sieve' after=(none) Debug: imapsieve: Matched static mailbox rule [2] Debug: imapsieve: Matched static mailbox rule [1] Debug: sieve: file storage: Using Sieve script path: /var/vmail/sieve/global/learn-spam.sieve Debug: sieve: file script: Opened script `learn-spam' from `/var/vmail/sieve/global/learn-spam.sieve' Debug: sieve: file storage: Using Sieve script path: /var/vmail/sieve/global/learn-ham.sieve Debug: sieve: file script: Opened script `learn-ham' from `/var/vmail/sieve/global/learn-ham.sieve' Debug: sieve: Opening script 1 of 2 from `/var/vmail/sieve/global/learn-spam.sieve' Debug: sieve: Loading script /var/vmail/sieve/global/learn-spam.sieve Debug: sieve: Script binary /var/vmail/sieve/global/learn-spam.svbin successfully loaded Debug: sieve: binary save: not saving binary /var/vmail/sieve/global/learn-spam.svbin, because it is already stored Debug: sieve: Executing script from `/var/vmail/sieve/global/learn-spam.svbin' Debug: sieve: action pipe: running program: rspamc Debug: Mailbox Spam: Opened mail UID=12 because: mail stream Debug: waiting for program `/usr/bin/rspamc' to finish after 0 msecs Debug: sieve: Opening script 2 of 2 from `/var/vmail/sieve/global/learn-ham.sieve' Debug: sieve: Loading script /var/vmail/sieve/global/learn-ham.sieve Debug: sieve: Script binary /var/vmail/sieve/global/learn-ham.svbin successfully loaded Debug: sieve: binary save: not saving binary /var/vmail/sieve/global/learn-ham.svbin, because it is already stored Debug: sieve: Executing script from `/var/vmail/sieve/global/learn-ham.svbin' Debug: Spam: Mailbox opened because: lib-lda delivery Debug: Spam: Mailbox opened because: SELECT ---------------------------------------- %< ---------------------------------------- And of course I'm getting the following in the log file: ---------------------------------------- %< ---------------------------------------- Error: sieve: learn-ham: line 2: duplicate pipe "rspamc" action not allowed (previously triggered one was here: learn-spam: line 3) Error: sieve: Execution of script /var/vmail/sieve/global/learn-ham.sieve failed ---------------------------------------- %< ---------------------------------------- In case I move message from Spam to Inbox on rule is matched at all: ---------------------------------------- %< ---------------------------------------- Debug: INBOX: Mailbox opened because: SELECT Debug: imapsieve: mailbox INBOX: APPEND event Debug: sieve: Pigeonhole version 0.4.21 (92477967) initializing Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.4.21 (92477967) loaded Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(APPEND) => before=`file:/var/vmail/sieve/global/learn-spam.sieve' after=(none) Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(APPEND) => before=`file:/var/vmail/sieve/global/learn-ham.sieve' after=(none) Debug: INBOX: Mailbox opened because: SELECT ---------------------------------------- %< ---------------------------------------- With best regards, Alex

3 5

Re: Does domain quota work and how?
by Aki Tuomi 16 Aug '18

16 Aug '18

> On 16 August 2018 at 17:47 Kai Schaetzl <maillists(a)conactive.com> wrote: > > > Dovecot-owner(a)dovecot.org wrote on Thu, 16 Aug 2018 17:14:00 +0300: > > > Message rejected by filter rule match > > Hello, > > why was this message rejected by a filter rule ? > (Posting first time to the list, yes, I subscribed.) > > Thanks, > > Kai > > Hi! I'm sorry you got bit by this, it's the spam filter. The way to get by the spam filter is to subscribe and wait about an hour for the subscription list to be updated, then you can post to the list, as we give a high negative score for anyone subscribed. Aki Tuomi ps. Here is the symbols your mail got, if it's any use to you. DMARC_NA(0)[conactive.com] SUBJECT_ENDS_QUESTION Subject ends with a question (1) REPLYTO_EQ_TO_ADDR(5) FROM_HAS_DN(0) IP_SCORE(-0.007259)[country: DE(-0.04)] MV_CASE(0.5) MIME_GOOD(-0.1)[text/plain] R_SPF_ALLOW(-0.2)[+a] R_DKIM_NA(0) GREYLIST(0)[pass,body] RCVD_TLS_LAST(0) ARC_NA(0) ASN(0)[asn:198710, ipnet:185.82.84.0/22, country:DE] PREVIOUSLY_DELIVERED(0)[dovecot(a)dovecot.org] FROM_EQ_ENVFROM(0) TO_DN_NONE(0) RCPT_COUNT_ONE(0)[1] BAYES_HAM(-0.000001)[14.49%] TO_MATCH_ENVRCPT_ALL(0) HAS_REPLYTO(0)[dovecot(a)dovecot.org] RCVD_COUNT_TWO(0)[2]

2 1

Re: [trees-plugin] - Dovecot index gets corrupted,^M when using maildir and recievend and accessing mail at the same time
by Joseph Tam 15 Aug '18

15 Aug '18

On Sat, 11 Aug 2018, Aki Tuomi wrote: > While this is true, it can be useful to encrypt messages in-rest at 3rd > party storage. Sure, in this case, mail operator != storage operator. It's not apparent those who clamour for it know the difference. > For end user, only PGP or similar provides sufficient security against admin. For content. Metadata can also reveal a lot. If the goal is to ensure privacy using a third-party storage provider (and assuming mail handlers are implictly trusted), it seems more productive to invest effort into block/FS level encryption that comprehensively protects all data. Joseph Tam <jtam.home(a)gmail.com>

1 0

doveadm mailbox delete not working
by Ralf Becker 15 Aug '18

15 Aug '18

I have a user who has several folders in his mailbox, which we can not delete, neither via IMAP nor via doveadm: root@ka-nfs-mail:~# doveadm mailbox list -u <username> | grep hbereiche | cat -v INBOX/[Fachbereiche ^M INBOX/Fachbereiche ^M INBOX/hbereiche^M INBOX/hbereiche/LAGen]^M INBOX/hbereiche/LAG^M INBOX/[Fachbereiche^M INBOX/[Fachbereiche/LAGen]^M INBOX/[Fachbereiche]^M INBOX/[Fachbereiche]/LAGen]^M INBOX/[Fachbereiche]/LAGe^M root@ka-nfs-mail:~# doveadm mailbox delete -u <username> 'INBOX/Fachbereiche ' doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche root@ka-nfs-mail:~# doveadm mailbox list -u <username>| grep hbereiche | cat -v INBOX/[Fachbereiche ^M INBOX/Fachbereiche ^M INBOX/hbereiche^M INBOX/hbereiche/LAGen]^M INBOX/hbereiche/LAG^M INBOX/[Fachbereiche^M INBOX/[Fachbereiche/LAGen]^M INBOX/[Fachbereiche]^M INBOX/[Fachbereiche]/LAGen]^M INBOX/[Fachbereiche]/LAGe^M As far as I tried none of these folders can be deleted (I added single quotes for trailing space and tried to delete subfolders first). Mailbox is in mdbox format on a replication pair under Dovecot 2.2.36 and I tried both nodes of the replication with same result. Any ideas? Ralf -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

3 6

error while compiling dovecot
by Rajesh M 15 Aug '18

15 Aug '18

hello my server is centos 6 64 bit while installing dovecot i get this error Failed to run: ./test-compression what could be the reason. could someone guide me please Version dovecot-ce-2.3.0-1 0 / 7 tests failed ==21130== Conditional jump or move depends on uninitialised value(s) ==21130== at 0x349B00ACB2: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B00AEA9: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B003121: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B0061A0: ??? (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x349B005212: lzma_easy_encoder (in /usr/lib64/liblzma.so.0.0.0) ==21130== by 0x406ACF: o_stream_create_lzma (ostream-lzma.c:206) ==21130== by 0x403D89: test_compression_handler (test-compression.c:36) ==21130== by 0x4040BD: test_compression (test-compression.c:96) ==21130== by 0x408281: test_run_funcs (test-common.c:244) ==21130== by 0x4083E0: test_run (test-common.c:315) ==21130== by 0x40398B: main (test-compression.c:308) ==21130== Failed to run: ./test-compression make[3]: *** [check-local] Error 1 make[3]: Leaving directory `/root/rpmbuild/BUILD/dovecot-ce-2.3.0/src/lib-compression' make[2]: *** [check-am] Error 2 make[2]: Leaving directory `/root/rpmbuild/BUILD/dovecot-ce-2.3.0/src/lib-compression' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/root/rpmbuild/BUILD/dovecot-ce-2.3.0/src' make: *** [check-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.LCwYD9 (%check) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.LCwYD9 (%check) thanks, rajesh

2 1

Confusing search / caps - non caps different results
by Götz Reinicke 15 Aug '18

15 Aug '18

Hi, I have some troubles with searching and could not find an answer yet. The search term is „istop“ in the subject. The client was SOGo. We run the recent dovecot, with solr backend and milder with zlib compression. Searching for all small letters „istop“ shows up no hit. Searching with a capital „S“ „iStop“ shows all messages back 10 years ago. Sprachig for „istopmotion“ all messages show up, wether the subject contains caps or non caps at all. I did a telnet to our dovecot and searched by hand for all three terms: 8 search Subject istop * SEARCH 8 OK Search completed (0.025 + 0.000 + 0.022 secs). 9 search subject iStop * SEARCH 544 604 654 662 910 1394 1471 1474 5493 9 OK Search completed (0.028 + 0.000 + 0.023 secs). 10 search subject istopmotion * SEARCH 544 604 654 662 910 1471 1472 1474 5493 10 OK Search completed (0.027 + 0.000 + 0.023 secs). Any hints or suggestion is welcome as I m very confused and lost. Thanks and regards . Götz

1 0

Re: doveadm mailbox delete not working
by Ralf Becker 15 Aug '18

15 Aug '18

Hi Aki, thanks for looking into this :) Am 14.08.18 um 15:15 schrieb Aki Tuomi: > can you turn on mail_debug=yes and run doveadm -Dv mailbox delete and > provide output and logs from both servers? root@ka-nfs-mail:~# doveadm -Dv mailbox delete -u h 'INBOX/Fachbereiche ' Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<username>): Debug: auth PASS input: doveadm(<username> 32679): Debug: auth USER input: <username> userdb_quota_rule=*:bytes=15728640000 master_user=<username> userdb_acl_groups=koakram@<domain>,wahlkampfnetzwerk@<domain>,wahlkalender 2017@<domain>,lgs@<domain> home=/var/dovecot/imap/<domain>/<user> doveadm(<username> 32679): Debug: Added userdb setting: plugin/master_user=<username> doveadm(<username> 32679): Debug: Added userdb setting: plugin/userdb_acl_groups=koakram@<domain>,wahlkampfnetzwerk@<domain>,wahlkalender 2017@<domain>,lgs@<domain> doveadm(<username> 32679): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=15728640000 doveadm(<username>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<username>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<username>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<username>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<username>): Debug: dict quota: user=<username>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<username>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<username>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 0 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<username>): Debug: INBOX/Fachbereiche : Mailbox opened because: mailbox delete doveadm(<username>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/Fachbereiche /dbox-Mails/dovecot-acl not found doveadm(<username>): Debug: Namespace INBOX/: Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<username>): Debug: replication: Replication requested by 'mailbox delete', priority=1 doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche Output and logs are from the (less loaded) standby/backup node. I can get the logs from the active node tonight. I had to remove some folder-names for privacy reasons, but they all have the same output in the logs. Ralf > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Ralf Becker <rb(a)egroupware.org> > Date: 14/08/2018 16:13 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: doveadm mailbox delete not working > > I have a user who has several folders in his mailbox, which we can not > delete, neither via IMAP nor via doveadm: > > root@ka-nfs-mail:~# doveadm mailbox list -u <username> | grep hbereiche > | cat -v > INBOX/[Fachbereiche ^M > INBOX/Fachbereiche ^M > INBOX/hbereiche^M > INBOX/hbereiche/LAGen]^M > INBOX/hbereiche/LAG^M > INBOX/[Fachbereiche^M > INBOX/[Fachbereiche/LAGen]^M > INBOX/[Fachbereiche]^M > INBOX/[Fachbereiche]/LAGen]^M > INBOX/[Fachbereiche]/LAGe^M > root@ka-nfs-mail:~# doveadm mailbox delete -u <username> > 'INBOX/Fachbereiche ' > doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche > root@ka-nfs-mail:~# doveadm mailbox list -u <username>| grep hbereiche | > cat -v > INBOX/[Fachbereiche ^M > INBOX/Fachbereiche ^M > INBOX/hbereiche^M > INBOX/hbereiche/LAGen]^M > INBOX/hbereiche/LAG^M > INBOX/[Fachbereiche^M > INBOX/[Fachbereiche/LAGen]^M > INBOX/[Fachbereiche]^M > INBOX/[Fachbereiche]/LAGen]^M > INBOX/[Fachbereiche]/LAGe^M > > As far as I tried none of these folders can be deleted (I added single > quotes for trailing space and tried to delete subfolders first). > > Mailbox is in mdbox format on a replication pair under Dovecot 2.2.36 > and I tried both nodes of the replication with same result. > > Any ideas? > > Ralf > > -- > Ralf Becker > EGroupware GmbH [www.egroupware.org] > Handelsregister HRB Kaiserslautern 3587 > Geschäftsführer Birgit und Ralf Becker > Leibnizstr. 17, 67663 Kaiserslautern, Germany > Telefon +49 631 31657-0 > > -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

3 7

Re: doveadm mailbox delete not working
by Ralf Becker 15 Aug '18

15 Aug '18

Hi Aki, Am 15.08.18 um 11:31 schrieb Aki Tuomi: > Such fun folders. Can you try doveadm -Dv mailbox delete -u username > folder and post it to the list? root@ka-nfs-mail:~# doveadm -Dv mailbox delete -u <username> 'INBOX/Fachbereiche ' Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<username> 46922): Debug: Added userdb setting: plugin/master_user=<username> doveadm(<username> 46922): Debug: Added userdb setting: plugin/userdb_acl_groups=koakram@<domain>,wahlkampfnetzwerk@<domain>,wahlkalender 2017@<domain>,lgs@<domain> doveadm(<username> 46922): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=15728640000 doveadm(<username>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<username>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<username>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<username>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<username>): Debug: dict quota: user=<username>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<username>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<username>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 0 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<username>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<username>): Debug: acl: initializing backend with data: vfile doveadm(<username>): Debug: acl: acl username = <username> doveadm(<username>): Debug: acl: owner = 1 doveadm(<username>): Debug: acl vfile: Global ACLs disabled doveadm(<username>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<username>): Debug: INBOX/Fachbereiche : Mailbox opened because: mailbox delete doveadm(<username>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/Fachbereiche /dbox-Mails/dovecot-acl not found doveadm(<username>): Debug: Namespace INBOX/: Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<username>): Debug: replication: Replication requested by 'mailbox delete', priority=1 doveadm(<username>): Info: Mailbox deleted: INBOX/Fachbereiche Event doveadm reporting the folder is deleted, it is not: root@ka-nfs-mail:~# doveadm mailbox list -u <username> 'INBOX/Fachbereiche ' INBOX/Fachbereiche But it can not get a status of it: root@ka-nfs-mail:~# doveadm mailbox status -u <username> all 'INBOX/Fachbereiche ' doveadm(<username>): Error: Mailbox INBOX/Fachbereiche : Failed to lookup mailbox status: Mailbox doesn't exist: INBOX/Fachbereiche Really wired Ralf > Aki > > On 15.08.2018 11:03, Ralf Becker wrote: >> Hi Aki, >> >> I respond to you only on purpose, as the a dont want to show all folders >> public, please remove them when you reply to the list. >> >> This is the folder my previous examples where about: >> >> "mailbox": "INBOX/[Fachbereiche " <-- trailing space >> >> >> Am 15.08.18 um 08:33 schrieb Aki Tuomi: >>> Can you try >>> >>> doveadm -fjson mailbox list -u user INBOX/* -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

1 0

Recommendations for backup methods
by Daniel Miller 14 Aug '18

14 Aug '18

I've been re-thinking my backup strategy - I wanted to see what input others have. At this time - I'm using sdbox as the primary storage format and running on a single server. Previously, all my backups were simple filesystem backups. Either inotify-based or cron-based. The whole mail folder structure would then be copied to a remote storage site. I've changed services - I now use OpenDrive for the remote storage and can access the remote drive as a mounted folder via WebDAV. I also now use a cron-based series of restic jobs for the backup processing. Because I have some large folders - both personal & business letters going back quite some time as well as mailing list archives - some mail folders can be quite sizable. Now I'm wondering, between sdbox's support for alternate locations and the ability to use different storage formats via namespaces - perhaps I should setup archive folders that are stored differently to improve backup performance. Maybe maildir or even mbox for the archive folders - I create one per year? Any comments? Experiences? -- Daniel

2 1

Move messages with doveadm recursively.
by Хлебалов Степан 14 Aug '18

14 Aug '18

Hello. I can move messages with doveadm like this: doveadm move -A Archive mailbox INBOX/* before 2018-02-01 but if inbox has a subfolders then subfolders structure does not move to Archive only messages. Is there a way to move messages to the same folder in new destination? Thanks.

2 1

"For end user, only PGP or similar provides sufficient security against admin." (was: [trees-plugin] - Dovecot index gets corrupted,^M when using maildir and recievend and accessing mail at the same time)
by Steffen Kaiser 13 Aug '18

13 Aug '18

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, 11 Aug 2018, Aki Tuomi wrote: > While this is true, it can be useful to encrypt messages in-rest at 3rd party storage. > For end user, only PGP or similar provides sufficient security against admin. Nice, short, pinpointed words I will file away for upcoming discussions. And I will file M's response, too, for the management. Thanks both of you. > -------- Original message --------From: "M. Balridge" <dovecot(a)r.paypc.com> Date: 11/08/2018 13:56 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Re: [trees-plugin] - Dovecot index gets corrupted, > when using maildir and recievend and accessing mail at the same time > Quoting Joseph Tam <jtam.home(a)gmail.com>: > >> Another privacy plugin that assumes the server operator is unmotivated or >> respects your privacy anyways, and won't just skim your password right off >> the top to look at your mail. A vault with steel walls and a dirt floor. > > *SIGH* As usual, you're right on the money, Joseph. > > I used to let things like this "slide", but somewhat recently I've had some > clients badgering me to implement something like this. It takes longer than it > should to explain how pointless the exercise is. > > Given that: > > 1) Email transactions, from submission, to delivery, to final reception by a > MUA, are done with plaintext contents. Those who want security, will undergo > the additional steps and hassles with using PGP to encrypt the contents, > providing the only demonstrably secure (against "Evil SysAdmins") means of > cloaking your content. The submission, delivery, and final reception is still > performed as "plaintext", albeit with an attachment that is encrypted, a > process done (and undone) by the ultimate endpoint clients. > > 2) Even if the "Evil SysAdmin" doesn't scribble all of the users' passphrases > into a log, it's trivial for various tools, many of which were hastily cobbled > together during the fad of implementing Sarbanes-Oxley Act (SOX) compliance on > mail servers. Tools like "milter-bcc" and friends which automatically clone > all email submitted to or arriving through SMTP, etc. It doesn't matter if > your SMTP software implements 65,536 Jiggabyte Key Quantum-Computing-Resistant > crypto, when it has the decrypted contents in its spool. > > I imagine this is an exercise in buzzword collection, and to be seen to be > "doing something" to improve security and/or privacy. > > If privacy is desired, there are only end-to-end encryption/signature schemes > to ensure anything at all, and even there we're at the mercy of mathematical > gods greater than we. > > Looking to a "magical" oracle on your server to do it for you, whilst keeping > all of the leaky, plaintext, and promiscuous protocols (DSN, bounces, > intermediate MXer hosts that eruct contents to various envelope addresses, > etc) that will betray you behind your back without a moment's notice is a > Fool's Errand. > > Think it over. > > =M= > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBW3ErEMQnQQNheMxiAQJZ+Qf9ECwe0SZXwClaM+wHBVdsOPLPuL6rkSzV TAkPe7bV2jnqUL8J0I7F46MW4yV76ttbWMbZ3wP6Mom2roNOqGoQIxWsQLkgZvib Wdg29L0nsMkHY6A5zCRM/n4rvNi/xDHIUWIinZRUWvFr8J6WWkSaYneX2Xjvf6tF 24nj+tqcuYtFomsY802WySgovLZi5y0s8nSSkQ9nnPA44hpozfbQXXf/pO14D2BL vhsiqvLKnS/3wY83Y05RLCsojfQDG3Vbqgm6qV9qkpOtGN9sLV/ufXc8tui070UW FDmV5S/KnP8Z7ru9Hq83JEhxkaApPhcKqIQcpjUIeWyobIwvYr718A== =cbbG -----END PGP SIGNATURE-----

1 0

[trees-plugin] - Dovecot index gets corrupted, when using maildir and recievend and accessing mail at the same time
by neutron 11 Aug '18

11 Aug '18

Hello dovecot team, at first I want to thank you the awesome dovecot software. I'm currently researching and developing the trees plugin (https://0xacab.org/riseuplabs/trees) In the future I would love to package this software for debian. I run into a problem, which I can not fix by myself, that's why I'm reaching out to you. The plugin is producing a reproducible error, when using dovecots mailbox format maildir, and receiving and accessing mail at the same time. I'm searching for additional information to fix that. I know that it's may not the scope of the mailing list to support external plugins, but since you are the experts, I thought I should ask at least. Trees Plugin: =================== The plugin adds individually encrypted mail storage to the Dovecot IMAP server. It encrypts all (incoming and outgoing) mail on the mail server with a key, which can only be accessed with the users password. So the server operator is not able to see any mail content, if it's saved on the hard disk. Bug Description: =================== I'm using a postfix dovecot setup with the enabled trees plugin with the mailboxformat maildir. When I'm receiving and accessing mail at the same time, the dovecot index gets corrupted. For accessing those mail I use Thunderbird. Example corruption: > ug 4 09:55:15 trees dovecot: imap-login: Login: user=<treesenabled(a)trees.testing>, method=PLAIN, rip=192.168.22.1, lip=192.168.22.77, mpid=4643, TLS, session=<w0OCCplyhLLAqBYB> > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Debug: trees plugin initialized > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Connection closed in=506 out=495 > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Error: Maildir filename has wrong S value, renamed the file from /var/vmail/trees.testing/treesenabled/Maildir/cur/1533376515.M379290P4641.trees,S=1456,W=748:2, to /var/vmail/trees.testing/treesenabled/Maildir/cur/1533376515.M379290P4641.trees,S=783:2, > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Error: Corrupted index cache file /var/vmail/trees.testing/treesenabled/Maildir/dovecot.index.cache: Broken physical size for mail UID 1 in mailbox INBOX: read(/var/vmail/trees.testing/treesenabled/Maildir/cur/1533376515.M379290P4641.trees,S=1456,W=748:2,) failed: Cached message size larger than expected (1456 > 728, box=INBOX, UID=1, cached Message-Id=<4ae8ea2c-17ac-37d5-9b9e-b32c6edc777a(a)trees.testing>) > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Panic: file istream.c: line 175 (i_stream_read): assertion failed: (old_size <= _stream->pos - _stream->skip) > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x95e92) [0x7fa88e2afe92] -> /usr/lib/dovecot/libdovecot.so.0(+0x95f8d) [0x7fa88e2aff8d] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fa88e245a91] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x290) [0x7fa88e2baf20] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7fa88e2bb72d] -> /usr/lib/dovecot/libdovecot.so.0(message_get_body_size+0xfd) [0x7fa88e29ab6d] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x220) [0x7fa88e5eb3d0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x66fc0) [0x7fa88e5a2fc0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream_because+0x5d) [0x7fa88e572e1d] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x536) [0x7fa88e6264f6] -> dovecot-trees.testing/imap(+0x1ebbc) [0x559b794f1bbc] -> dovecot-trees.testing/imap(+0x1cfb6) [0x559b794effb6] -> dovecot-trees.testing/imap(imap_fetch_more+0x39) [0x559b794f10e9] -> dovecot-trees.testing/imap(cmd_fetch+0x33b) [0x559b794e2d9b] -> dovecot-trees.testing/imap(command_exec+0xa5) [0x559b794ee735] -> dovecot-trees.testing/imap(+0x199c2) [0x559b794ec9c2] -> dovecot-trees.testing/imap(+0x19a4c) [0x559b794eca4c] -> dovecot-trees.testing/imap(client_handle_input+0x1b5) [0x559b794ece55] -> dovecot-trees.testing/imap(client_input+0x86) [0x559b794ed3c6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7fa88e2c49f2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7fa88e2c6029] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0x7fa88e2c4a8c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fa88e2c4c38] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fa88e24bfd3] -> dovecot-trees.testing/imap(main+0x328) [0x559b794dfe68] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7fa88de9b2e1] -> dovecot-trees.testing/imap(_start+0x2a) [0x559b794dffea] > Aug 4 09:55:15 trees dovecot: imap(treesenabled(a)trees.testing): Fatal: master: service(imap): child 4633 killed with signal 6 (core dumps disabled) The behavior does not occur, when I'm using maildir and access my mail after receiving it. It also does not occur with other mailbox formats such as mbox, sdbox and mdbox I opened a bug report at the trees repository, which is more detailed ( https://0xacab.org/riseuplabs/trees/issues/24 ). There I described how it's possible to reproduce this error. In the trees repo there is also a vagrant box, with which it's possible to spin up the exact same setup. Questions: =================== 1.) Do you know what could possibly lead to the the larger cached message size, when accessing this mail via imap? 2.) Why does these sizes differ from each other? Mail size from the log is: 'S=1456,W=748:2' or 'renamed to ...S=783:2'. But I do not see where the size of '728' come from? 3.) Do you have a hint what could lead to this behavior and how could I solve this error? Unrelated but also interesting for trees usage: 4.) Is there a tool, with which you can export and import mail to the same inbox? Background: After activation for an existing mail user, only new outgoing and incoming mail is encrypted. So it would be necessary to "re-save" the existing mail again in this mailbox, to pipe all mails through the encryption process. I know that there is dsync, imapsync and several different tools, but I'm not sure what is the best tool for the job, or if I should use dsync to do a 3 way sync? > existing_mailbox(a)server.com > tmp_mailbox(a)server.com > existing_mailbox(a)server.com Thank you: =================== Thank you for time reading this mail :) Dovecot Config: =================== # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.4 ext4 auth_mechanisms = plain login instance_name = trees.testing login_greeting = trees.testing ready. mail_gid = 5000 mail_location = maildir:/var/vmail/%Ld/%Ln/Maildir mail_plugins = " quota trees" mail_uid = 5000 mailbox_list_index = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 4 } service imap { executable = imap } service pop3 { executable = pop3 } ssl = required ssl_cert = </etc/ssl/certs/ssl-cert-snakeoil.pem ssl_cipher_list = ALL:!LOW:!RC4:!EXP:!aNULL ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

5 5

dovecot stats-writer socket permissions
by Scott Ruckh 11 Aug '18

11 Aug '18

I have seen this thread about being able to run doveadm as a non-root user, but I don't understand the solution even though I have seen other pages give this link as the solution. http://bit.ly/2MC5oq9 What configuration is necessary so that I can set the permissions on /var/run/dovecot/stats-writer socket-file so when dovecot starts my virtual mail account has read/write access? I saw another page about adding service stats { } Although I set user, group, and permissions, it did not seem to have any effect on the permissions when I restarted dovecot. Thank You.

2 2

Re: dying on osx
by Mike Makuch 10 Aug '18

10 Aug '18

$ grep dove /etc/passwd /etc/group /etc/passwd:_dovecot:*:214:6:Dovecot Administrator:/var/empty:/usr/bin/false /etc/passwd:_dovenull:*:227:227:Dovecot Authentication:/var/empty:/usr/bin/false /etc/group:certusers:*:29:root,_jabber,_postfix,_cyrus,_calendar,_dovecot /etc/group:_dovenull:*:227: I'm trying to build on osx so I can try to do some debugging. The INSTALL.md says to do: $ more INSTALL.md Build Instructions ================== For most people, the usual: ``` ./configure make sudo make install ``` But there is no configure file. How would I generate the configure file? Is it generated? Been a long time since I've done open source C code.. Thanks Mike On 8/10/18 11:04, Aki Tuomi wrote: > Is the user member of mail group? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Mike Makuch <1mikemakuch(a)gmail.com> > Date: 10/08/2018 19:02 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi> > Cc: dovecot(a)dovecot.org > Subject: Re: dying on osx > > Maybe an old problem that has resurfaced??? > > https://bugzilla.samba.org/show_bug.cgi?id=8773 > > Mike > > > > On 8/10/18 10:54, Aki Tuomi wrote: >> I have to see if this is reproducible outside mac. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Mike Makuch <1mikemakuch(a)gmail.com> >> Date: 10/08/2018 18:46 (GMT+02:00) >> To: Aki Tuomi <aki.tuomi(a)dovecot.fi> >> Subject: Re: dying on osx >> >> I did find that page and tried a few things there. My config has all of >> the settings there except 3: >> >> mail_access_groups = mail >> mbox_read_locks = fcntl >> mbox_write_locks = fcntl >> >> I add them to my config, restart and get the same abort >> >> 20180810-103849 imap(mkm)<79213><MkA5ihZzmdh/AAAB>: Fatal: >> setgroups(mail,505) failed: Too many extra groups >> >> I've tried numerous other settings as well. >> >> Thanks for any further advice >> >> Mike >> >> >> On 8/10/18 08:45, Aki Tuomi wrote: >> > Can you try this config and report back? >> > >> > >> https://superuser.com/questions/957272/dotlock-permissions-problems-with-do… >> > >> > Aki >> > >> >> On 10 August 2018 at 16:39 Mike Makuch <1mikemakuch(a)gmail.com> wrote: >> >> >> >> >> >> OSX 10.13.6 High Sierra, dovecot 2.3.2.1 >> >> >> >> dovecot starts up and runs but dies as soon as my mail client makes a >> >> request with log and config below. >> >> >> >> And advice appreciated. >> >> >> >> Thanks >> >> >> >> Mike >> >> >> >> >> >> >> >> 20180810-083730 auth: Debug: auth client connected (pid=77432) >> >> >> >> 20180810-083730 auth: Debug: client in: AUTH 1 PLAIN >> >> service=imap secured session=xo1p2BRzZNd/AAAB lip=127.0.0.1 >> >> rip=127.0.0.1 lport=143 rport=55140 >> >> 20180810-083730 auth: Debug: client passdb out: CONT 1 >> >> 20180810-083730 auth: Debug: client in: CONT 1 AG1rbQBta20xMjM= >> >> (previous base64 data may contain sensitive data) >> >> 20180810-083730 auth: Debug: static(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): >> >> lookup >> >> 20180810-083730 auth: Debug: client passdb out: OK 1 user=mkm >> >> host=localhost nopasswd=y >> >> 20180810-083730 auth: Debug: master in: REQUEST 4201906177 77432 >> >> 1 b8126b4b71be2959fc7716888eccc566 session_pid=77433 >> >> request_auth_token >> >> 20180810-083730 auth-worker(77426): Debug: >> >> passwd(mkm,127.0.0.1,<xo1p2BRzZNd/AAAB>): lookup >> >> 20180810-083730 auth: Debug: master userdb out: USER 4201906177 >> >> mkm system_groups_user=mkm uid=503 gid=20 home=/Users/mkm >> >> auth_token=4d2bb44168df3d63e4e1bb352e59de632bc7da49 >> >> 20180810-083730 imap-login: Info: Login: user=<mkm>, method=PLAIN, >> >> rip=127.0.0.1, lip=127.0.0.1, mpid=77433, secured, >> >> session=<xo1p2BRzZNd/AAAB> >> >> 20180810-083730 imap(mkm)<77433><xo1p2BRzZNd/AAAB>: Fatal: >> >> setgroups(505) failed: Too many extra groups >> >> >> >> # doveconf -n >> >> # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf >> >> # OS: Darwin 17.7.0 x86_64 >> >> # Hostname: pine >> >> auth_debug = yes >> >> auth_debug_passwords = yes >> >> default_internal_user = _dovecot >> >> default_login_user = _dovenull >> >> disable_plaintext_auth = no >> >> listen = 127.0.0.1 >> >> log_path = /var/log/dovecot >> >> log_timestamp = "%Y%m%d-%H%M%S " >> >> mail_debug = yes >> >> mail_gid = staff >> >> mail_location = mbox:~/Mail:INBOX=/var/mail/%u >> >> mail_privileged_group = mail >> >> mail_uid = _dovecot >> >> passdb { >> >> args = password=*** host=localhost nopasswd=y >> >> driver = static >> >> } >> >> passdb { >> >> args = login >> >> driver = pam >> >> } >> >> protocols = imap >> >> service auth { >> >> user = root >> >> } >> >> service imap-login { >> >> inet_listener imap { >> >> address = * >> >> port = 143 >> >> } >> >> } >> >> ssl = no >> >> userdb { >> >> driver = passwd >> >> } >> >> >> >> >> >

1 2