- dovecot - dovecot.org

Thunderbird ignores some folders
by dovecot.pkoch＠dfgh.net 03 Oct '14

03 Oct '14

Dear readers we are using Dovecot 2.2.7 and all of our users are using Thunderbird as their mail client. Some of them additionally use their iPad/iPhone and a very few an Android Mail-Client. Now one user noticed that two of his mail folders disappeared. He first believed that he accidentally deleted those folders but then he realized that they are still visible from his iPad. I checked this users maildir and everything looks normal. Deleting the index-files made no difference: New index-files were created but those two folders are still invisable from Thunderbird. My main concern is to find the reason for this behaviour. Maybe folders of other users have disappeared and they have not yet noticed. A fresh installation of Thunderbird will most likely fix this single users problem, but I cannot do this for all of our users. So here's my question: How would I debug such a situation? Kind regards Peter Koch And here's our config file: # Dovecot configuration file default_process_limit = 2048 protocols = imap listen = * base_dir = /var/dovecot/ mail_location = maildir:/mail/%u:LAYOUT=fs ssl_cert = </etc/ssl/certs/naev+chain.crt ssl_key = </etc/ssl/private/naev.key ssl_ca = </etc/ssl/certs/naev-ca.crt ssl_verify_client_cert = yes ssl_cert_username_field = x500UniqueIdentifier auth_ssl_username_from_cert = yes service imap-login { inet_listener imap { port = 0 } } service auth { client_limit = 4096 } service anvil { client_limit = 5000 } passdb { driver = checkpassword args = /usr/dovecot/bin/checkpassword } userdb { driver = passwd override_fields = home=/mail/%u } protocol imap { mail_max_userip_connections = 1000 }

3 2

LDA randomly failing to write email to disk
by Andy Dills 03 Oct '14

03 Oct '14

We're using 2.2.13 with pigeonhole 0.4.3, in a clustered environment (maildir on netapp, dual dovecot instances where each server is both a proxy and a backend). Every now and then (once a month per user, maybe?), users will see a blank email in their inbox. Investigating further, and we will see that the only information recorded in the maildir file for the message is the Return-Path, the Delivered-To, and the first Received line (the one generated by the local LDA via LMTP). For example, here is what I found in one such email today: Return-Path: <xxx(a)xecu.net> Delivered-To: <yyy(a)xecu.net> Received: from mail5.xecu.net ([10.0.1.85]) by mail2.xecu.net (Dovecot) with LMTP idX86eBjgaI1RdyQAA3SxDBg for <yyy(a)xecu.net>; Wed, 24 Sep 2014 15:24:20 -0400 Everything past that is lost, as if the either the LDA on mail2 exited early or was never sent the information from the dovecot instance on mail5. Here is a little more detail from the header of the same email, different recipient (all other recipients received the email properly, only one failed to receive properly): Return-Path: <xxx(a)xecu.net> Delivered-To: <yyz(a)xecu.net> Received: from mail5.xecu.net ([10.0.1.85]) by mail1.xecu.net (Dovecot) with LMTP id KPh8ItMXI1StBAAA/c3zFg for <yyz(a)xecu.net>; Wed, 24 Sep 2014 15:24:20 -0400 Received: from mail5.xecu.net by mail5.xecu.net (Dovecot) with LMTP id QsUBFoQZI1RjhgAAXyr1JQ ; Wed, 24 Sep 2014 15:24:20 -0400 Received: from mail5.xecu.net (localhost [127.0.0.1]) by mail5.xecu.net (Postfix) with ESMTP id 30AAE323BB18; Wed, 24 Sep 2014 15:24:20 -0400 (EDT) ... This is what I see in the logs of mail2, which is where the failure happened: Sep 24 15:24:20 mail2 dovecot: lmtp(51549, yyy(a)xecu.net) X86eBjgaI1RdyQAA3SxDBg: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' When I look at the logs of mail1, which is where the successful delivery happened: Sep 24 15:24:20 mail1 dovecot: lmtp(1197, yyz(a)xecu.net) KPh8ItMXI1StBAAA/c3zFg: sieve: msgid=<20140924192412.1435.qmail(a)xxx.xecu.net>: stored mail into mailbox 'INBOX' Nothing of note seems to be logged on mail5 (only a message from postfix, nothing from the proxy side of the lmtp). I do notice, when I check for the PID of 51549 in the logs, all of its other transactions seem to register with proper msgids and were delivered fine. Also, I notice plenty of other messages that have the msgid=unspecified error, but which were delivered with no problems and not truncated, so I'm suspecting what may be happening is that somehow the backend instance is not receiving the actual data portion, and only getting the envelope from proxy instance. How do I approach debugging this? It's very infrequent, but yet quite annoying. Seems to have started since we upgraded to 2.2.13 (from an older 2.1 build) earlier this year. Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

3 3

GETMETADATA UTF8 encoding of folder names instead of UTF7
by Bartłomiej Nogaś 03 Oct '14

03 Oct '14

Hello, I have dovecot 2.2.13 instance and I found that (at least for polish language) folder names in GETMETADATA command response are encoded in UTF8. Shouldn't it be converted to UTF7? Both SETMETADATA and GETMETADATA arguments have to be encoded in UTF7, the problem(?) is related only to server response example: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . login user pass . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE METADATA QUOTA ACL RIGHTS=texk] Logged in . GETMETADATA "INBOX/&AVs-olaris" (/private/vendor/kolab/folder-type /shared/vendor/kolab/folder-type) * METADATA {14} INBOX/śolaris (/private/vendor/kolab/folder-type NIL /shared/vendor/kolab/folder-type {4} mail) . OK Getmetadata completed. "INBOX/śolaris" - UTF8 Best Regards,

2 1

home from SQL
by Ralf Hildebrandt 03 Oct '14

03 Oct '14

Currently I'm using user_query = SELECT 1000 AS uid, 1000 AS gid, '/srv/vmail/%2.256Hu/%Lu' AS home, ... so I'm hashing based on %u (basically). But in my SQL db I have a "unique_identifier" field, which never changes, even when the user is changing his/her email address (due to marriage or the like). What I'd really like to do is to use %u to find the value of the unique_identifier field, hash THAT value and use "AS home". But how? That way I can rename users without shuffling directories around the filesystem. -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

3 2

virtualfolders under mdbox storage backend
by Jesus Cea 03 Oct '14

03 Oct '14

Reading docs in http://wiki2.dovecot.org/Plugins/Virtual I wonder how is that used if I am using MDBOX as my storage backend. The only references there are about Maildir. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

2 1

Re: [Dovecot] quota using wrong limits in user shared mailboxes
by Bartłomiej Nogaś 03 Oct '14

03 Oct '14

Hi, I confirm this bug with LDAP userdb. The temporary workaround is to set quota ignore rule for Shared namespace or specific shared folder. This is obviously not secure workaround. Example: for a shared namespace: namespace ( .... prefix = Shared Folders/%%u/ ... } you have to set quota_rule4 = Shared Folders/*:ignore or quota_rule4 = Shared Folders/username/*:ignore - Bartlomiej Nogas

2 1

Trouble getting listescape plugin to work with "$" separator (as demonstrated in Wiki) in Dovecot 2.2.9
by Ben Johnson 03 Oct '14

03 Oct '14

Hello, I'm attempting to install the listescape plugin so that IMAP users are able to include periods (.) and forward slashes (/) in IMAP directory names. I'm following the instructions at http://wiki2.dovecot.org/Plugins/Listescape , which imply that this can be accomplished by enabling the listescape plugin and using the dollar sign ($) as the separator. With regard to my dovecot configuration, first, I changed protocol imap { mail_plugins = quota imap_quota antispam } to protocol imap { mail_plugins = quota imap_quota antispam listescape namespace private { separator = $ inbox = yes } } When I start dovecot, I receive the following error: doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:102: namespace private {} has been replaced by namespace { type=private } Pretty straightforward; I made the required change to yield protocol imap { mail_plugins = quota imap_quota antispam listescape namespace { type = private separator = $ inbox = yes } } But now, when I attempt to start dovecot, I receive the following error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ Is it possible that the instructions at the Wiki 2 URL cited above are out-of-date? If I try to escape the $ with any other character (I'm just shooting in the dark regarding possible escape characters, as I cannot find definitive documentation that pertains to escaping $ in the dovecot configuration), I receive yet another error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: Namespace '': Hierarchy separator must be only one character long doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: Namespace '': Hierarchy separator must be only one character long Ultimately, I have two questions: 1.) Is the nesting structure that I've employed correct? The Wiki 2 page is not clear with regard to the nesting; is it correct to put the "namespace" block inside the "protocol imap" block, as I demonstrated above? 2.) Is it possible to escape the dollar sign so that it can be used as the separator? Full "doveconf -n" output is included below. Thanks for any assistance, -Ben # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ doveconf: Error: managesieve-login: dump-capability process returned 89 # OS: Linux 3.13.0-34-generic x86_64 Ubuntu 14.04.1 LTS auth_mechanisms = plain login disable_plaintext_auth = no listen = *,[::] log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_privileged_group = vmail passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /bin/bash antispam_pipe_program_args = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = SPAM;JUNK antispam_trash_pattern_ignorecase = trash;Deleted * antispam_verbose_debug = 1 quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_rule4 = INBOX:storage=+100M quota_warning = storage=100%% quota-reached 100 %u %d quota_warning2 = storage=95%% quota-warning 95 %u %d quota_warning3 = storage=80%% quota-warning 80 %u %d quota_warning4 = -storage=100%% quota-below below %u %d sieve = /var/vmail/%d/%n/.sieve } postmaster_address = postmaster(a)localhost.com protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service config { unix_listener config { group = vmail mode = 0600 user = vmail } } service imap-login { client_limit = 1000 process_limit = 500 } service quota-below { executable = script /usr/local/bin/quota-below.sh unix_listener quota-below { group = vmail mode = 0666 user = vmail } user = vmail } service quota-reached { executable = script /usr/local/bin/quota-reached.sh unix_listener quota-reached { group = vmail mode = 0666 user = vmail } user = vmail } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/postfix/smtpd.cert ssl_key = </etc/postfix/smtpd.key userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = quota imap_quota antispam listescape namespace { inbox = yes location = prefix = separator = $ type = private } } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { info_log_path = log_path = mail_plugins = sieve quota }

2 3

auth with entire email addr instead of just username
by Cliff Hayes 03 Oct '14

03 Oct '14

I am trying to configure a new IMAP based mail server. I thought I had everything correct. I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like this... Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser(a)domain.com,1.2.3.4): lookup service=dovecot ... and of course pam is reporting that as an invalid user. Moments ago when all was mbox, authentication worked fine. I can see Thunderbird has the username correct (no domain). What is tacking on the domain and how do I fix? Thanks in advance.

2 4

two dovecot instances
by jjhoffart 02 Oct '14

02 Oct '14

Hello, I am currently trying to setup two invocations of dovecot to run on a debian based server. One for director and the other a stock debian instance. The issue I am having is when I go to start the director instance, I receive multiple errors telling me that the listening ports are already in use. I have change these ports in the 10-master.conf file but am still presented with the same errors when starting the second instance. Is this the only file in which the ports need to be changed (10-master.conf) or is there another file in which the ports need to be set?

2 1

Re: Simply mysql quota check
by Alfredo Saldanha 02 Oct '14

02 Oct '14

Steffen, My problem was exactly what you said, the quota field in my query. I fixed it and now is working very well. Thank you very much. Alfredo ----- Mensagem original ----- De: "Steffen Kaiser" <skdovecot(a)smail.inf.fh-brs.de> Para: "Alfredo Saldanha" <asaldanha(a)infolink.com.br> Cc: dovecot(a)dovecot.org Enviadas: Quinta-feira, 2 de outubro de 2014 3:33:13 Assunto: Re: Simply mysql quota check -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 1 Oct 2014, Alfredo Saldanha wrote: > #/etc/dovecot/dovecot-sql.conf.ext > password_query = \ > SELECT username AS user, value AS password \ > FROM mailboxes WHERE username = '%n@%d' > > user_query = \ > SELECT username, domain, \ > CONCAT('*:storage=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule \ > FROM mailboxes, domains WHERE mailboxes.username = '%n@%d' \ > AND domains.domain = '%d' > > My idea is when a message is delivered, the dovecot to check quota in the mysql according to the value received in the "user_query" but he does not. > It shows a value of 2GB that I don't know where it gets. > > I execute a manual query in mysql to know the quota my test user and checked that are 5GB, but when I see the dovecot, it shows 2G. > > SELECT username, domain, CONCAT('*:bytes=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule > FROM mailboxes, domains WHERE mailboxes.username = 'junix(a)domain.com' AND domains.domain = 'domain.com' 1) your manual query uses '*:bytes=', whereas your conf uses '*:storage='. 2) you return the value as userdb_quota_rule, but it must read quota_rule in the user_query. In the password_query fields are prefixed by userdb_ . See http://wiki2.dovecot.org/Quota/Configuration - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVCzxqnz1H7kL/d9rAQIneAgAukcibxJoQdtwdmrxHbXmKgQsCG22itH5 9VSFGigiPjXg/F1hkj7jHC/xB5uh2M8ayMos+hPxaJkKC4AKYEZu1QEwXAX2qrvN DXt7uPZHLJSMtlWCVb5s6h+v6K3JnbWRrjI4CIfYqB8i8MHKBWei0K02QZcOUOfy KeD7lAIPRuZPnIEiWYREpalRMGeQzZ69SHEmhxDx7VFO5FanlHDxdCwmO7qHoJen ZuNpUWMf5i5czxcDhHjLdtGODv005LFDCXhj48SqI17WzD3mPjJegOCjym6RfKmU RT+PtKieBkzygT1YzvjJbHISFxJSryVg8c48tCb0FgjkNKWXq/KsPg== =wzY8 -----END PGP SIGNATURE-----

1 0