- dovecot - dovecot.org

[Dovecot] Using a Sieve script to handle delivery to public mailboxes
by Alessandro Menti 19 Mar '14

19 Mar '14

Hello everyone, I'm setting up a Postfix+Dovecot stack with virtual domains and public mailboxes. I set up a shared mailbox "office(a)mydomain.com" as described in the Dovecot Wiki [1], that is: - I created the directory "/var/mail/mydomain.com/public/" and inside it I created the ".office" mailbox; - I added an appropriate ACL to allow the account "president(a)mydomain.com" to read and edit that mailbox under a public namespace; - I added a Sieve script to handle delivery to the public mailbox (its location is /var/mail/mydomain.com/public/.office/.dovecot.sieve). Some other relevant details about my configuration: - The backend used by Postfix and Dovecot to handle virtual aliases/domains/maps is a MySQL database. Since the virtual user table is used by other applications as well, I decided to keep it "clean" and to make use of another "virtual mailboxes" table (see /etc/dovecot/dovecot-sql.conf.ext below). The password_query setting returns only results from the virtual user table (so that only real users can authenticate on the IMAP server), while the user_query setting returns results from both the virtual user and the virtual mailbox table (so that dovecot-lda can choose the correct mailbox). - The queries saved in password_query and user_query return the correct results when executed manually: the home directory for the "office(a)mydomain.com" virtual mailbox is set to /var/mail/mydomain.com /public/.office. - Delivery from and to the "president(a)mydomain.com" account is regular, and that account is able to access the "office(a)mydomain.com" virtual mailbox (I have tested this by speaking IMAP to the server and by performing a manual check using Thunderbird). I encountered a problem with this setup: when I send a message to the "office(a)mydomain.com" account, the Postfix logs say it is correctly delivered via Dovecot, but the Sieve script says it can not find the folder "Public/.office". As a consequence, Dovecot creates a new Maildir in /var/mail/mydomain.com/office and delivers the mail there instead of saving it in the correct directory (/var/mail/mydomain.com/public/.office). Is there something I set incorrectly in my configuration? What is causing Dovecot not to recognize the correct mailbox during delivery? Is there a way to list all mailboxes seen by dovecot-lda itself? Thanks, Alessandro Menti [1] http://wiki2.dovecot.org/SharedMailboxes/Public ----- Dovecot and OS version: 2.0.19, Ubuntu 12.04 LTS Output of "dovecot -n": > # 2.0.19: /etc/dovecot/dovecot.conf > # OS: Linux 3.5.0-46-generic i686 Ubuntu 12.04.4 LTS ext4 > auth_mechanisms = plain login > login_greeting = IMAP server ready. > mail_debug = yes > mail_gid = vmail > mail_location = maildir:/var/mail/%d/%n/Maildir > mail_plugins = acl > mail_uid = vmail > namespace { > inbox = yes > location = > prefix = > separator = / > type = private > } > namespace { > list = children > location = maildir:/var/mail/mydomain.com/public > prefix = Public/ > separator = / > subscriptions = no > type = public > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > acl = vfile > sieve = ~/.dovecot.sieve > sieve_before = /var/mail/sieve/ > sieve_dir = ~/sieve > } > postmaster_address = postmaster(a)mydomain.com > protocols = " imap" > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0660 > user = dovecot > } > } > ssl_cert = </etc/ssl/srvcerts/mailcert-withintcas.cer > ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:AES256-SHA256:AES256-SHA:RC4-SHA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS > ssl_key = </etc/ssl/private/mailcert.pvk > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol lda { > info_log_path = /var/log/dovecot-lda.log > log_path = /var/log/dovecot-lda-errors.log > mail_plugins = acl sieve > } > protocol imap { > mail_plugins = acl imap_acl > } /etc/dovecot/dovecot-sql.conf.ext: > driver = mysql > connect = host=127.0.0.1 dbname=dbname user=username password=password > default_pass_scheme = SHA512-CRYPT > password_query = SELECT email as user, password FROM virtual_users WHERE email='%u'; > user_query = SELECT home FROM virtual_users WHERE email = '%u' UNION SELECT home FROM virtual_shared_mailboxes WHERE email = '%u' Extract from /var/log/mail.log: > Mar 15 11:43:07 phoenix postfix/pickup[1404]: 3BA221FFD1: uid=0 from=<sysadmin> > Mar 15 11:43:07 phoenix postfix/cleanup[4871]: 3BA221FFD1: message-id=<20140315104307.3BA221FFD1(a)mail.mydomain.com> > Mar 15 11:43:07 phoenix postfix/qmgr[7691]: 3BA221FFD1: from=<sysadmin(a)mydomain.com>, size=316, nrcpt=1 (queue active) > Mar 15 11:43:07 phoenix dovecot: auth-worker: mysql(127.0.0.1): Connected to database mailserver > Mar 15 11:43:07 phoenix postfix/pipe[4875]: 3BA221FFD1: to=<office(a)mydomain.com>, relay=dovecot, delay=0.15, delays=0.05/0.03/0/0.07, dsn=2.0.0, status=sent (delivered via dovecot service) > Mar 15 11:43:07 phoenix postfix/qmgr[7691]: 3BA221FFD1: removed Extract from /var/log/dovecot-lda.log: > Mar 15 11:43:07 lda: Debug: Loading modules from directory: /usr/lib/dovecot/modules > Mar 15 11:43:07 lda: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so > Mar 15 11:43:07 lda: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_sieve_plugin.so > Mar 15 11:43:07 lda: Debug: auth input: office(a)mydomain.com home=/var/mail/mydomain.com/public/.office > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: Effective uid=1002, gid=999, home=/var/mail/mydomain.com/public/.office > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/mydomain.com/office/Maildir > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: maildir++: root=/var/mail/mydomain.com/office/Maildir, index=, control=, inbox=/var/mail/mydomain.com/office/Maildir, alt= > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: Namespace : /var/mail/mydomain.com/office/Maildir doesn't exist yet, using default permissions > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: Namespace : Using permissions from /var/mail/mydomain.com/office/Maildir: mode=0700 gid=-1 > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: initializing backend with data: vfile > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: acl username = office(a)mydomain.com > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: owner = 1 > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl vfile: Global ACL directory: (none) > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/var/mail/mydomain.com/public > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: maildir++: root=/var/mail/mydomain.com/public, index=, control=, inbox=, alt= > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: initializing backend with data: vfile > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: acl username = office(a)mydomain.com > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: owner = 0 > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl vfile: Global ACL directory: (none) > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: none: root=, index=, control=, inbox=, alt= > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: Destination address: office(a)mydomain.com (source: user@hostname) > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: sieve: using sieve path for user's script: /var/mail/mydomain.com/public/.office/.dovecot.sieve > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: sieve: opening script /var/mail/mydomain.com/public/.office/.dovecot.sieve > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: sieve: script binary /var/mail/mydomain.com/public/.office/.dovecot.svbin successfully loaded > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: sieve: binary save: not saving binary /var/mail/mydomain.com/public/.office/.dovecot.svbin, because it is already stored > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: sieve: executing script from /var/mail/mydomain.com/public/.office/.dovecot.svbin > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl vfile: reading file /var/mail/mydomain.com/public/.office/dovecot-acl > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl vfile: file /var/mail/mydomain.com/public/dovecot-acl not found > Mar 15 11:43:07 lda(office(a)mydomain.com): Debug: acl vfile: file /var/mail/mydomain.com/office/Maildir/dovecot-acl not found > Mar 15 11:43:07 lda(office(a)mydomain.com): Info: sieve: msgid=<20140315104307.3BA221FFD1(a)mail.mydomain.com>: stored mail into mailbox 'INBOX' Extract from /var/mail/mydomain.com/public/.office/.dovecot.sieve.log: > sieve: info: started log at Mar 15 11:43:07. > error: msgid=<20140315104307.3BA221FFD1(a)mail.mydomain.com>: failed to store into mailbox 'Public/office': Mailbox doesn't exist: office. Listing of /var/mail/mydomain.com/public/.office: > $ sudo ls /var/mail/mydomain.com/public/.office -lA > total 56 > drwxr-x--- 2 vmail vmail 4096 mar 14 17:14 cur > -rw-r--r-- 1 root root 98 mar 9 18:05 dovecot-acl > -rw-r----- 1 vmail vmail 18432 mar 15 10:36 dovecot.index.cache > -rw-r----- 1 vmail vmail 1088 mar 15 10:36 dovecot.index.log > -rw-r--r-- 1 vmail vmail 0 mar 14 21:50 dovecot-shared > -rw-r--r-- 1 root root 50 mar 15 11:42 .dovecot.sieve > -rw------- 1 vmail vmail 188 mar 15 11:43 .dovecot.sieve.log > -rw-r--r-- 1 vmail vmail 124 mar 15 11:42 .dovecot.svbin > -rw-r----- 1 vmail vmail 98 mar 14 17:13 dovecot-uidlist > drwxr-x--- 2 vmail vmail 4096 mar 14 16:25 new > drwxr-x--- 2 vmail vmail 4096 mar 15 08:48 tmp Contents of /var/mail/mydomain.com/public/.office/.dovecot.sieve: > require "fileinto"; > fileinto "Public/office"; ACL for the "office" shared mailbox: > $ sudo cat /var/mail/mydomain.com/public/.office/dovecot-acl > user=president(a)mydomain.com lrwstipe Transcript of an IMAP session listing all folders: > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] IMAP server ready. > a01 LOGIN president(a)mydomain.com password > a01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in > a02 LIST "" "*" > * LIST (\HasNoChildren) "/" "Infected Items" > * LIST (\HasNoChildren) "/" "Recycle Bin" > * LIST (\HasNoChildren) "/" "Spam" > * LIST (\HasNoChildren) "/" "Trash" > * LIST (\HasNoChildren) "/" "Drafts" > * LIST (\HasNoChildren) "/" "Sent Mail" > * LIST (\HasNoChildren) "/" "INBOX" > * LIST (\HasNoChildren) "/" "Public/office" > a02 OK List completed. > a03 LOGOUT > * BYE Logging out > a03 OK Logout completed.

3 4

[Dovecot] Sieve vacation attach original message
by azurIt 19 Mar '14

19 Mar '14

Hi, is it, somehow, possible to attach the original message to the vacation autoreply? Thank you. azur

2 4

Re: [Dovecot] Sieve vacation attach original message
by Joseph Tam 19 Mar '14

19 Mar '14

"azurIt" <azurit(a)pobox.sk> writes: > is it, somehow, possible to attach the original message to the vacation > autoreply? Hmm. Allowing a sender control over both the recipient (via spoofing), and the content seems like perfect recipe to turn your mail server into a spam relay cannon. If you do do this, you should hedge this by only allowing it from known trusted senders (e.g. local network). Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Dovecot crashes on large search result sets in virtual folders when using fts-solr
by Steffen Templin 19 Mar '14

19 Mar '14

Hi Devs, I experience reproducible crashes when searching in a virtual folder with fts-solr activated. The crashes occur only, if the folder contains a large number of mails and the result set of the search is also large. If the result set is small, no crash occurs. This happens on Debian Wheezy with versions 2.1.7 and 2.2.9. My goal was it to setup the possibility for cross-folder fulltext search. Therefore dovecot was setup with fts-solr, which seems to work fine in most cases. A virtual folder "test" in a namespace "virtual" was created and configured to return all mails from all mailboxes in the default namespace (with empty prefix). It was configured like this: /etc/dovecot/virtual/test/dovecot-virtual: * all It's also reproducible with: INBOX all The test user only has the standard mail folders (Sent, Drafts, Trash) beside the INBOX and of course the folder "virtual.test". INBOX contains about 10.000 mails, the other folders are empty. "virtual.test" correctly referrs to all mails of the INBOX. Searching within the INBOX returns the desired results without any problems. Performing the same search within "virtual.test" fails and dovecot crashes. However, if the result set is small, no crash occurs. My test mails are imported from the ubuntu mailing list. Therefore the term "ubuntu" produces a large result set. See attachments for further details, they all refer to the same crash, reproduced with version 2.2.9 (from the Debian Backports repository): - config.txt: dovecot -n - gdb_backtrace.txt: The gdb backtrace of the attached core dump - log.txt: A logfile extract from the crash - protocol_output.txt: The telnet session that caused the crash Don't hesitate to ask for further details. Thanks and best regards, Steffen

1 0

[Dovecot] Sieve escape user input
by azurIt 19 Mar '14

19 Mar '14

Hi, i'm having problems with escaping user input in sieve scripts. I'm using 'variables' extension and i can't find out how to escape character '$' - i tried '\$' and '$$' but nothing helps. Any ideas? Thanks. azur

2 1

[Dovecot] When does the replication run normally?
by Daniel Thielemann 18 Mar '14

18 Mar '14

Hi, I got my manual dsync finally working and can replicate mails by initiate it from comandline (doveadm sync -u mail(a)domain.dom -d), but it does not run by itself (per dovecot replication). When does dovecot invoke the replication normally? Thanks in advance Daniel

2 2

[Dovecot] dovecot for centos ?
by Spyros Tsiolis 18 Mar '14

18 Mar '14

Hello all, I was wondering which version is better for Centos v6.x. CentOS v6.5 comes with dovecot v2.0.9 as default. Should I go ahead with this or go for the latest ? (v2.2.10 / v2.211 / v2.2.12, btw what's the diferrence between the three ?) s.

1 0

[Dovecot] versioning of mailbox index files
by morrison 18 Mar '14

18 Mar '14

Hi, I am wondering if dovecot assigns version information in mailbox index files so that by which version of dovecot the index files are created can be determined. Our existing mail service used dovecot 2.2.4 with lots of active mail users. When upgraded to 2.2.10, imap processes aborted all the time due to the corrupted index files (the problem was fixed in dovecot 2.2.5). After investigation, I found that this annoying problem could be avoid by deleting index files before opening a mailbox. Now the problem is how I could know if the index files are created by a version newer than 2.2.4. Thanks, Morrison

2 1

[Dovecot] Any client out there taking advantage of Dovecot's virtual mailboxes?
by Aleve Sicofante 18 Mar '14

18 Mar '14

I wish to know if someone knows an IMAP client (desktop or webmail) using Dovecot's virtual mailboxes as server-side search folders. Thanks.

5 14

[Dovecot] dsync Error: Mailbox INBOX: Save commit failed: Mailbox was deleted under us
by Alan McGinlay - SICS 17 Mar '14

17 Mar '14

Hi, I am doing a mass migration of users from Cyrus imap on a solaris server to dovecot 1:2.2.9-1ubuntu1 and am getting this weird issue with dsync if I try to do a "full" sync. Debug output below: dsync(user(a)example.com): Error: Mailbox INBOX: Save commit failed: Mailbox was deleted under us dsync(user(a)example.com): Debug: brain M: out box 'INBOX' recv_state=recv_last_common send_state=done changed=1 dsync(user(a)example.com): Debug: brain M: out state=sync_mails changed=1 dsync(user(a)example.com): Debug: brain S: in state=sync_mails dsync(user(a)example.com): Debug: brain S: in box 'INBOX' recv_state=recv_last_common send_state=done dsync(user(a)example.com): Debug: brain S: out box 'INBOX' recv_state=recv_last_common send_state=done changed=0 dsync(user(a)example.com): Debug: brain S: out state=sync_mails changed=0 dsync(user(a)example.com): Debug: imapc(10.10.10.10:143): Disconnected [2]+ Killed /usr/bin/dsync -v -o mail_fsync=never backup -R -f -u user(a)example.com imapc: (I changed the domain / ip here of course) I notice that it does the IMAP sync for a while and then shows connecting info for pop3 (I have configuration for both imap and pop). The user in question has never connected with POP. imap migration config: imapc_host = 10.10.10.10 imapc_user = %u imapc_master_user = cyrusadmin imapc_password = blahblahblahpasswordhere imapc_features = rfc822.size imapc_features = $imapc_features #fetch-headers mail_prefetch_count = 20 pop configuration: pop3c_host = pop.example.com pop3c_user = %u pop3c_master_user = cyrusadmin pop3c_password = blahblahblahpasswordhere namespace { prefix = POP3-MIGRATION-NS/ location = pop3c: list = no hidden = yes } protocol doveadm { mail_plugins = $mail_plugins pop3_migration } plugin { pop3_migration_mailbox = POP3-MIGRATION-NS/INBOX } Thanks in advance for any pointers on this! /Alan

2 1