- dovecot - dovecot.org

Problem with dovecot-managesieved and sieve scripts in mysql
by ing. Petr Bitzan 04 Oct '14

04 Oct '14

Hello, I would like to ask for advice on the following things: I have sieve scripts stored in mysql, work for LDA and imapd correctly. When I try to connect using the client managesieve (Roungcube plugin managesieve with Thunderbird addon sieve), i receive the following error: Oct 3 19:04:50 mail dovecot: managesieve(11044167): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Oct 3 19:04:50 mail dovecot: managesieve(11044167): Error: sieve-storage: Cannot open non-file script location for active script `dict:proxy::sieve;name=active;bindir=/var/vmail/sieve-scripts/11044167' Oct 3 19:04:50 mail dovecot: managesieve(11044167): Fatal: Failed to open Sieve storage. If i change settings sieve to: sieve = ~/.dovecot.sieve sieve_dir = ~/sieve it works fine. can someone please advise configuring dovecot-managesieved with saving scripts in the database. Thank you very much Petr Bitzan ------------- # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.6 ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes dict { acl = mysql:/etc/dovecot/dovecot-acl-shared-dict.conf.ext sieve = mysql:/etc/dovecot/dict-sieve-sql.conf.ext } first_valid_gid = 1002 first_valid_uid = 1002 last_valid_gid = 1002 last_valid_uid = 1002 mail_debug = yes mail_location = maildir:/var/vmail/%n/Maildir mail_plugins = " mail_log notify acl" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:%%h/Maildir:INDEX=~/shared/%%u/ prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox HAM { auto = subscribe } mailbox Junk { special_use = \Junk } mailbox SPAM { auto = subscribe } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u sieve = dict:proxy::sieve;name=active;bindir=/var/vmail/sieve-scripts/%u sieve_dir = dict:proxy::sieve;name=active;bindir=~/.sieve-bin } protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } user = vmail } service managesieve-login { inet_listener sieve { address = xxxxxxx port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/smtp.lf3.cuni.cz.pem ssl_key = </etc/ssl/private/serverkeynopass.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " mail_log notify acl quota sieve" } protocol lda { mail_plugins = " mail_log notify acl quota sieve acl" } protocol imap { mail_plugins = " mail_log notify acl quota imap_quota acl imap_acl" } protocol pop3 { mail_plugins = " mail_log notify acl quota" } dict-sieve-sql.conf.ext: connect = host=xxxxxxxxxxxxx dbname=xxxxxxxx user=xxxxxxxx password=xxxxxxxxxxxxxx map { pattern = priv/sieve/name/$script_name table = user_sieve_scripts username_field = username value_field = id fields { script_name = $script_name } } map { pattern = priv/sieve/data/$id table = user_sieve_scripts username_field = username value_field = script_data fields { id = $id } } CREATE TABLE IF NOT EXISTS `user_sieve_scripts` ( `id` int(11) NOT NULL DEFAULT '0', `username` varchar(40) DEFAULT NULL, `script_name` varchar(255) DEFAULT NULL, `script_data` varchar(10240) DEFAULT NULL, PRIMARY KEY (`id`), UNIQUE KEY `username` (`username`,`script_name`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8;

2 2

Configure antispam plugin with private namespaces
by Bruno Galindro da Costa 03 Oct '14

03 Oct '14

When I use antispam plugin <http://wiki2.dovecot.org/Plugins/Antispam> with a folder that is outside a namespace, the plugin works great. But, if I configure it to watch a folder that is inside a namespace, the mailtrain backend does nothing. Does antispam plugin have support to namespaces? *This is my config:* namespace spam { type = private list = yes location = maildir:/var/mail.spam/%d/%n subscriptions = yes prefix = "SPAM." mailbox Filtrados { auto = subscribe } } plugin { antispam_backend = mailtrain antispam_verbose_debug = 1 antispam_debug_target = syslog # the above NOT works antispam_spam = SPAM.Filtrados # the above works #antispam_spam = Filtrados antispam_signature = X-VERTICAL-IP-Quarantine-ID antispam_mail_sendmail = /usr/local/bin/mail_spam.sh antispam_mail_spam = --spam antispam_mail_notspam = --notspam acl = vfile mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid from subject size vsize quota = maildir:DefaultQuota quota_exceeded_message = O destinatario desta mensagem esta com a caixa postal cheia. A sua mensagem so pode ser entregue se o destinatario apagar algumas das mensagens. quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 %u quota_warning2 = storage=90%% /usr/local/bin/quota-warning.sh 90 %u sieve = /var/mail/sieve_scripts/%d/%n/.dovecot.sieve sieve_dir = /var/mail/sieve_scripts/%d/%n/sieve sieve_global_path = /etc/dovecot/sieve/default.sieve sieve_after = /etc/dovecot/sieve/default.sieve sieve_global_dir = /etc/dovecot/sieve trash = /etc/dovecot/dovecot-trash.conf expire = SPAM.Filtrados expire_dict = proxy::expiredict } protocol imap { mail_fsync = never mail_max_userip_connections = 2048 mail_plugins = quota imap_quota trash zlib mail_log notify imap_acl acl antispam ssl_ca = </etc/dovecot/ca.crt ssl_cert = </etc/dovecot/ufsc.br.crt ssl_key = </etc/dovecot/ufsc.br.key } -- Att. Bruno Galindro da Costa

1 0

Thunderbird ignores some folders
by dovecot.pkoch＠dfgh.net 03 Oct '14

03 Oct '14

Dear readers we are using Dovecot 2.2.7 and all of our users are using Thunderbird as their mail client. Some of them additionally use their iPad/iPhone and a very few an Android Mail-Client. Now one user noticed that two of his mail folders disappeared. He first believed that he accidentally deleted those folders but then he realized that they are still visible from his iPad. I checked this users maildir and everything looks normal. Deleting the index-files made no difference: New index-files were created but those two folders are still invisable from Thunderbird. My main concern is to find the reason for this behaviour. Maybe folders of other users have disappeared and they have not yet noticed. A fresh installation of Thunderbird will most likely fix this single users problem, but I cannot do this for all of our users. So here's my question: How would I debug such a situation? Kind regards Peter Koch And here's our config file: # Dovecot configuration file default_process_limit = 2048 protocols = imap listen = * base_dir = /var/dovecot/ mail_location = maildir:/mail/%u:LAYOUT=fs ssl_cert = </etc/ssl/certs/naev+chain.crt ssl_key = </etc/ssl/private/naev.key ssl_ca = </etc/ssl/certs/naev-ca.crt ssl_verify_client_cert = yes ssl_cert_username_field = x500UniqueIdentifier auth_ssl_username_from_cert = yes service imap-login { inet_listener imap { port = 0 } } service auth { client_limit = 4096 } service anvil { client_limit = 5000 } passdb { driver = checkpassword args = /usr/dovecot/bin/checkpassword } userdb { driver = passwd override_fields = home=/mail/%u } protocol imap { mail_max_userip_connections = 1000 }

3 2

LDA randomly failing to write email to disk
by Andy Dills 03 Oct '14

03 Oct '14

We're using 2.2.13 with pigeonhole 0.4.3, in a clustered environment (maildir on netapp, dual dovecot instances where each server is both a proxy and a backend). Every now and then (once a month per user, maybe?), users will see a blank email in their inbox. Investigating further, and we will see that the only information recorded in the maildir file for the message is the Return-Path, the Delivered-To, and the first Received line (the one generated by the local LDA via LMTP). For example, here is what I found in one such email today: Return-Path: <xxx(a)xecu.net> Delivered-To: <yyy(a)xecu.net> Received: from mail5.xecu.net ([10.0.1.85]) by mail2.xecu.net (Dovecot) with LMTP idX86eBjgaI1RdyQAA3SxDBg for <yyy(a)xecu.net>; Wed, 24 Sep 2014 15:24:20 -0400 Everything past that is lost, as if the either the LDA on mail2 exited early or was never sent the information from the dovecot instance on mail5. Here is a little more detail from the header of the same email, different recipient (all other recipients received the email properly, only one failed to receive properly): Return-Path: <xxx(a)xecu.net> Delivered-To: <yyz(a)xecu.net> Received: from mail5.xecu.net ([10.0.1.85]) by mail1.xecu.net (Dovecot) with LMTP id KPh8ItMXI1StBAAA/c3zFg for <yyz(a)xecu.net>; Wed, 24 Sep 2014 15:24:20 -0400 Received: from mail5.xecu.net by mail5.xecu.net (Dovecot) with LMTP id QsUBFoQZI1RjhgAAXyr1JQ ; Wed, 24 Sep 2014 15:24:20 -0400 Received: from mail5.xecu.net (localhost [127.0.0.1]) by mail5.xecu.net (Postfix) with ESMTP id 30AAE323BB18; Wed, 24 Sep 2014 15:24:20 -0400 (EDT) ... This is what I see in the logs of mail2, which is where the failure happened: Sep 24 15:24:20 mail2 dovecot: lmtp(51549, yyy(a)xecu.net) X86eBjgaI1RdyQAA3SxDBg: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' When I look at the logs of mail1, which is where the successful delivery happened: Sep 24 15:24:20 mail1 dovecot: lmtp(1197, yyz(a)xecu.net) KPh8ItMXI1StBAAA/c3zFg: sieve: msgid=<20140924192412.1435.qmail(a)xxx.xecu.net>: stored mail into mailbox 'INBOX' Nothing of note seems to be logged on mail5 (only a message from postfix, nothing from the proxy side of the lmtp). I do notice, when I check for the PID of 51549 in the logs, all of its other transactions seem to register with proper msgids and were delivered fine. Also, I notice plenty of other messages that have the msgid=unspecified error, but which were delivered with no problems and not truncated, so I'm suspecting what may be happening is that somehow the backend instance is not receiving the actual data portion, and only getting the envelope from proxy instance. How do I approach debugging this? It's very infrequent, but yet quite annoying. Seems to have started since we upgraded to 2.2.13 (from an older 2.1 build) earlier this year. Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

3 3

GETMETADATA UTF8 encoding of folder names instead of UTF7
by Bartłomiej Nogaś 03 Oct '14

03 Oct '14

Hello, I have dovecot 2.2.13 instance and I found that (at least for polish language) folder names in GETMETADATA command response are encoded in UTF8. Shouldn't it be converted to UTF7? Both SETMETADATA and GETMETADATA arguments have to be encoded in UTF7, the problem(?) is related only to server response example: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . login user pass . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE METADATA QUOTA ACL RIGHTS=texk] Logged in . GETMETADATA "INBOX/&AVs-olaris" (/private/vendor/kolab/folder-type /shared/vendor/kolab/folder-type) * METADATA {14} INBOX/śolaris (/private/vendor/kolab/folder-type NIL /shared/vendor/kolab/folder-type {4} mail) . OK Getmetadata completed. "INBOX/śolaris" - UTF8 Best Regards,

2 1

home from SQL
by Ralf Hildebrandt 03 Oct '14

03 Oct '14

Currently I'm using user_query = SELECT 1000 AS uid, 1000 AS gid, '/srv/vmail/%2.256Hu/%Lu' AS home, ... so I'm hashing based on %u (basically). But in my SQL db I have a "unique_identifier" field, which never changes, even when the user is changing his/her email address (due to marriage or the like). What I'd really like to do is to use %u to find the value of the unique_identifier field, hash THAT value and use "AS home". But how? That way I can rename users without shuffling directories around the filesystem. -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

3 2

virtualfolders under mdbox storage backend
by Jesus Cea 03 Oct '14

03 Oct '14

Reading docs in http://wiki2.dovecot.org/Plugins/Virtual I wonder how is that used if I am using MDBOX as my storage backend. The only references there are about Maildir. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

2 1

Re: [Dovecot] quota using wrong limits in user shared mailboxes
by Bartłomiej Nogaś 03 Oct '14

03 Oct '14

Hi, I confirm this bug with LDAP userdb. The temporary workaround is to set quota ignore rule for Shared namespace or specific shared folder. This is obviously not secure workaround. Example: for a shared namespace: namespace ( .... prefix = Shared Folders/%%u/ ... } you have to set quota_rule4 = Shared Folders/*:ignore or quota_rule4 = Shared Folders/username/*:ignore - Bartlomiej Nogas

2 1

Trouble getting listescape plugin to work with "$" separator (as demonstrated in Wiki) in Dovecot 2.2.9
by Ben Johnson 03 Oct '14

03 Oct '14

Hello, I'm attempting to install the listescape plugin so that IMAP users are able to include periods (.) and forward slashes (/) in IMAP directory names. I'm following the instructions at http://wiki2.dovecot.org/Plugins/Listescape , which imply that this can be accomplished by enabling the listescape plugin and using the dollar sign ($) as the separator. With regard to my dovecot configuration, first, I changed protocol imap { mail_plugins = quota imap_quota antispam } to protocol imap { mail_plugins = quota imap_quota antispam listescape namespace private { separator = $ inbox = yes } } When I start dovecot, I receive the following error: doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:102: namespace private {} has been replaced by namespace { type=private } Pretty straightforward; I made the required change to yield protocol imap { mail_plugins = quota imap_quota antispam listescape namespace { type = private separator = $ inbox = yes } } But now, when I attempt to start dovecot, I receive the following error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ Is it possible that the instructions at the Wiki 2 URL cited above are out-of-date? If I try to escape the $ with any other character (I'm just shooting in the dark regarding possible escape characters, as I cannot find definitive documentation that pertains to escaping $ in the dovecot configuration), I receive yet another error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: Namespace '': Hierarchy separator must be only one character long doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: Namespace '': Hierarchy separator must be only one character long Ultimately, I have two questions: 1.) Is the nesting structure that I've employed correct? The Wiki 2 page is not clear with regard to the nesting; is it correct to put the "namespace" block inside the "protocol imap" block, as I demonstrated above? 2.) Is it possible to escape the dollar sign so that it can be used as the separator? Full "doveconf -n" output is included below. Thanks for any assistance, -Ben # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ doveconf: Error: managesieve-login: dump-capability process returned 89 # OS: Linux 3.13.0-34-generic x86_64 Ubuntu 14.04.1 LTS auth_mechanisms = plain login disable_plaintext_auth = no listen = *,[::] log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_privileged_group = vmail passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /bin/bash antispam_pipe_program_args = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = SPAM;JUNK antispam_trash_pattern_ignorecase = trash;Deleted * antispam_verbose_debug = 1 quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_rule4 = INBOX:storage=+100M quota_warning = storage=100%% quota-reached 100 %u %d quota_warning2 = storage=95%% quota-warning 95 %u %d quota_warning3 = storage=80%% quota-warning 80 %u %d quota_warning4 = -storage=100%% quota-below below %u %d sieve = /var/vmail/%d/%n/.sieve } postmaster_address = postmaster(a)localhost.com protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service config { unix_listener config { group = vmail mode = 0600 user = vmail } } service imap-login { client_limit = 1000 process_limit = 500 } service quota-below { executable = script /usr/local/bin/quota-below.sh unix_listener quota-below { group = vmail mode = 0666 user = vmail } user = vmail } service quota-reached { executable = script /usr/local/bin/quota-reached.sh unix_listener quota-reached { group = vmail mode = 0666 user = vmail } user = vmail } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/postfix/smtpd.cert ssl_key = </etc/postfix/smtpd.key userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = quota imap_quota antispam listescape namespace { inbox = yes location = prefix = separator = $ type = private } } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { info_log_path = log_path = mail_plugins = sieve quota }

2 3

auth with entire email addr instead of just username
by Cliff Hayes 03 Oct '14

03 Oct '14

I am trying to configure a new IMAP based mail server. I thought I had everything correct. I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like this... Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser(a)domain.com,1.2.3.4): lookup service=dovecot ... and of course pam is reporting that as an invalid user. Moments ago when all was mbox, authentication worked fine. I can see Thunderbird has the username correct (no domain). What is tacking on the domain and how do I fix? Thanks in advance.

2 4