- dovecot - dovecot.org

dovecot, fts, solr5 patch, fuzzy search
by Sergey Urushkin 28 Sep '15

28 Sep '15

Hi! I have a patch and several thoughts about FTS in dovecot. I. SOLR v5.1 and above doesn't allow GET /select queries with Content-Type header set, so, I just removed it from the code: --- dovecot-2.2.18/src/plugins/fts-solr/solr-connection.c 2015-05-13 17:14:45.000000000 +0300 +++ dovecot-2.2.18.patch/src/plugins/fts-solr/solr-connection.c 2015-09-27 19:47:40.363843359 +0300 @@ -432,7 +432,6 @@ solr_connection_select_response, conn); http_client_request_set_port(http_req, conn->http_port); http_client_request_set_ssl(http_req, conn->http_ssl); - http_client_request_add_header(http_req, "Content-Type", "text/xml"); http_client_request_submit(http_req); conn->request_status = 0; After that it works just fine. And it seems it doesn't hurt compatibility with older versions. Tested with 3.1, 3.6.2, 4.10.4, 5.3.1 So, I think this patch should be included. II. Fuzzy search. As I understand dovecot searches the same way despite FUZZY word is given or not. In my case I'd like to have an ability to make lookups like "domain.com usernamepart" (usernamepart - part of localpart). So, I use '<str name="defType">edismax</str><int name="qs">15</int>' inside requestHandler /select in solrconfig.xml. It's very convenient for users. Besides other things, this makes searches "abc@def" and "def@abc" identical to dovecot. But the problem is that sometimes the exact match is necessary. E.g. when using "doveadm expunge". For now I found a workaround - remove fts plugins while using doveadm with -o "`dovecot -n | sed -n 's/"//; s/ *= */=/; /^mail_plugins/s/$"\| fts\(\|_[^ ]\+$\)//gp'`". But I think users should have an ability to decide which search type to use. Here is what I'm suggesting: 1. Implement fts_fuzzy_default option (default - true, current behavior). false should disable fuzzy search by default. 2. Make a way for fts backend to choose which search type to use. For solr it would be an ability to specify: a) "handler" (default=select) and "handler_fuzzy" (default=select or handler's value) (the same as handler by default). After this you have to create second select-like handler with fuzzy capabilities in solrconfig.xml. Example: fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ handler=select handler_fuzzy=select2 This method will use the same index for both search types. b) "url_fuzzy" URL (different solr core or even address/port), like this: fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ url_fuzzy=http://127.0.0.1:8983/solr/dovecot_fuzzy/ This method will allow to have two completely different indexes. And according to RFC 6203 search query generally may be mixed (FUZZY/EXACT). Both options will be useful in different setups. Hope, these thoughts will help. -- Best regards, Sergey Urushkin

1 1

v2.2.19 release candidate released
by Greg Wildman 28 Sep '15

28 Sep '15

Hello, I am trying out 2.2.19.rc1 on a lightly loaded server with no problems so far. The reason I wanted to try 2.2.19.rc1 was to get access to the %{listener} variable in the auth phase so I can modify the SQL password_query according to which unix_listener is being queried. According to the docs, "These variables work only in Dovecot-auth and login_log_format_elements setting". I can confirm that %{listener} works in login_log_format_elements but it does not work if I use it in my SQL auth query. My logic is as follows: I create multiple listeners for different SASL authentications in 10 -master.conf service auth { unix_listener auth-userdb { mode = 0660 user = dovecot group = vmail } unix_listener exim-client { mode = 0660 user = dovecot group = exim } unix_listener xmpp-client { mode = 0660 user = dovecot group = mail } user = $default_internal_user } Now I want to use %{listener} in my SQL password_query in a case statement to auth according to which listener is being used. E.g. CASE '%{listener} ' \ WHEN 'exim-client' THEN ma.SMTPAUTH_allowed = 'YES' \ WHEN 'xmpp-client' THEN ma.XMPP_allowed = 'YES' \ ELSE ma.IMAP_allowed = 'YES' \ END Should the %{listener} variable work in this case ? -- Greg

3 4

modify message with doveadm?
by Frank-Ulrich Sommer 27 Sep '15

27 Sep '15

Hello, I'm using dovecot with getmail and spamassassin. To re-learn false detected mails I created two folders and use an external script that checks the corresponding maildir directories for changes (with inotifywait). The mails found in these directories are passed to sa-learn (to re-learn the correct classification) and then moved back to the inbox or the spam folder. To access the mail I use "doveadm search" (to find all mails in the two folders), "doveadm fetch" (to get the text and pass it to sa-learn) and "doveadm move" (to move the mail to the correct location. This works as desired, except that a mail once marked as spam will forever be marked as such. Spamassassin has the -d option to remove the markup, but I need to replace the original mail with the cleaned version. The only idea I got was deleting that mail and importing the cleaned one, but as I want to implement several "special" folders for further functionality with different IMAP clients I would prefer a "cleaner" solution. What would be the correct/best way to modify the mail body/header/text from an external tool? Kind regards, Frank

2 1

Expunged message reappeared to mailbox
by Alex 26 Sep '15

26 Sep '15

Hi, I'm using dovecot-2.2.18 on fedora22 and receiving the following messages: Sep 26 11:07:52 orion dovecot: imap(dave): Error: Sync failed for mbox file /var/spool/mail/alex: Expunged message reappeared to mailbox (UID 267101 < 267175, seq=2, idx_msgs=0) How do I troubleshoot this? Any idea what could be causing it? I've included my doveconf below. # 2.2.18: /etc/dovecot/dovecot.conf # OS: Linux 4.0.7-300.fc22.x86_64 x86_64 Fedora release 22 (Twenty Two) mail_gid = mail mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mail_plugins = " listescape" mail_privileged_group = mail mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = pam } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 } process_min_avail = 20 service_count = 0 } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { address = 192.168.1.100 port = 995 } } ssl_ca = </etc/pki/dovecot/certs/ca-bundle.pem ssl_cert = </etc/pki/dovecot/certs/orion-2015.pem ssl_key = </etc/pki/dovecot/certs/orion-2015.key userdb { driver = passwd } userdb { driver = passwd } Thanks, Alex

1 0

[dovecot-2.2.18] dsync error: Error: Can't delete mailbox INBOX: INBOX can't be deleted. Problem with name of folders?
by Marcin Mirosław 26 Sep '15

26 Sep '15

Hi All! I'm also hitted by this problem. I'm trying to migrate emails from very old dbmail to dovecot (maildir). I read old threads with similar problem but I found only such solutions: - upgrade to 2.2.13 - workarround : use imapsync - no solution I'd like to not use imapsync, have you got an idea what should I do to do migration successfully? dsync throws: doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib20_listescape_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib20_mail_log_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_squat_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib90_stats_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: exp ire_set_init (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm(example.user(a)example.com): Debug: Added userdb setting: plugin/quota_rule=*:bytes=104857600 doveadm(example.user(a)example.com): Debug: Effective uid=999, gid=999, home=/data/poczta/skrzynki/example.com/example.user doveadm(example.user(a)example.com): Debug: Quota root: name=User quota backend=dict args=:proxy::quota doveadm(example.user(a)example.com): Debug: Quota rule: root=User quota mailbox=* bytes=104857600 messages=0 doveadm(example.user(a)example.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 doveadm(example.user(a)example.com): Debug: Quota warning: bytes=89128960 (85%) messages=0 reverse=no command=quota-warning 85 example.user(a)example.com doveadm(example.user(a)example.com): Debug: Quota grace: root=User quota bytes=10485760 (10%) doveadm(example.user(a)example.com): Debug: dict quota: user=example.user(a)example.com, uri=proxy::quota, noenforcing=0 doveadm(example.user(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: doveadm(example.user(a)example.com): Debug: imapc(source-imap-server:144): Looking up IP address doveadm(example.user(a)example.com): Debug: imapc(source-imap-server:144): Connecting to 192.168.1.202:144 doveadm(example.user(a)example.com): Debug: imapc(source-imap-server:144): Server capabilities: IMAP4 IMAP4rev1 AUTH=LOGIN ACL NAMESPACE SORT CHILDREN QUOTA doveadm(example.user(a)example.com): Debug: imapc(source-imap-server:144): Authenticating as example.user(a)example.com doveadm(example.user(a)example.com): Debug: imapc(source-imap-server:144): Authenticated successfully doveadm(example.user(a)example.com): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(example.user(a)example.com): Debug: fts: Indexes disabled for namespace '' doveadm(example.user(a)example.com): Debug: acl: initializing backend with data: vfile:/data/poczta/acl/global-acls:cache_secs=60 doveadm(example.user(a)example.com): Debug: acl: acl username = example.user(a)example.com doveadm(example.user(a)example.com): Debug: acl: owner = 1 doveadm(example.user(a)example.com): Debug: acl vfile: Global ACL legacy directory: /data/poczta/acl/global-acls doveadm(example.user(a)example.com): Debug: Namespace : type=shared, prefix=shared/%n/, sep=, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:%h/.mail dir:INDEX=/data/poczta/indeksy/shared/example.com/example.user doveadm(example.user(a)example.com): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(example.user(a)example.com): Debug: fts: Indexes disabled for namespace 'shared/%n/' doveadm(example.user(a)example.com): Debug: acl: initializing backend with data: vfile:/data/poczta/acl/global-acls:cache_secs=60 doveadm(example.user(a)example.com): Debug: acl: acl username = example.user(a)example.com doveadm(example.user(a)example.com): Debug: acl: owner = 0 doveadm(example.user(a)example.com): Debug: acl vfile: Global ACL legacy directory: /data/poczta/acl/global-acls doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found doveadm(example.user(a)example.com): Debug: Namespace : Using permissions from : mode=0700 gid=default doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Trash not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Sent not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Junk not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Drafts not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Total Wellbeing App not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Philipiak not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Nexto not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Inne not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/IMGW not found doveadm(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/E-pasaż wizytówki not found dsync(example.user(a)example.com): Debug: Effective uid=999, gid=999, home=/data/poczta/skrzynki/example.com/example.user dsync(example.user(a)example.com): Debug: Quota root: name=User quota backend=dict args=:proxy::quota dsync(example.user(a)example.com): Debug: Quota rule: root=User quota mailbox=* bytes=104857600 messages=0 dsync(example.user(a)example.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 dsync(example.user(a)example.com): Debug: Quota warning: bytes=89128960 (85%) messages=0 reverse=no command=quota-warning 85 example.user(a)example.com dsync(example.user(a)example.com): Debug: Quota grace: root=User quota bytes=10485760 (10%) dsync(example.user(a)example.com): Debug: dict quota: user=example.user(a)example.com, uri=proxy::quota, noenforcing=0 dsync(example.user(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/data/poczta/skrzynki/example.com/example.user/.maildir/:I… dsync(example.user(a)example.com): Debug: maildir++: root=/data/poczta/skrzynki/example.com/example.user/.maildir, index=/data/poczta/indeksy/example.com/example.user, indexpvt=, control=, inbox=/data/poczta/skrzynki/example.com/example.user/.maildir, alt= dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: Namespace : Using permissions from /data/poczta/skrzynki/example.com/example.user/.maildir: mode=0700 gid=default dsync(example.user(a)example.com): Debug: acl: initializing backend with data: vfile:/data/poczta/acl/global-acls:cache_secs=60 dsync(example.user(a)example.com): Debug: acl: acl username = example.user(a)example.com dsync(example.user(a)example.com): Debug: acl: owner = 1 dsync(example.user(a)example.com): Debug: acl vfile: Global ACL legacy directory: /data/poczta/acl/global-acls dsync(example.user(a)example.com): Debug: Namespace : type=shared, prefix=shared/%n/, sep=, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:%h/.maildir:INDEX=/data/poczta/indeksy/shared/example.com/… dsync(example.user(a)example.com): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= dsync(example.user(a)example.com): Debug: fts: Indexes disabled for namespace 'shared/%n/' dsync(example.user(a)example.com): Debug: acl: initializing backend with data: vfile:/data/poczta/acl/global-acls:cache_secs=60 dsync(example.user(a)example.com): Debug: acl: acl username = example.user(a)example.com dsync(example.user(a)example.com): Debug: acl: owner = 0 dsync(example.user(a)example.com): Debug: acl vfile: Global ACL legacy directory: /data/poczta/acl/global-acls dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/Junk not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.Junk/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/Trash not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.Trash/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/Archive not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.Archive/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/Sent not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.Sent/dovecot-acl not found dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=13783 uid_next=34894281 subs=no last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX/E-pasaż wizytówki guid=5d360d682d48c1090150341143cf6fad uid_validity=13841 uid_next=3489428 1 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX/IMGW guid=5849136be8a03ed13bf8f9d41910d7f8 uid_validity=13805 uid_next=34894281 subs=yes la st_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=13783 uid_next=34894281 subs=no last_ch ange=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX/E-pasaż wizytówki guid=5d360d682d48c1090150341143cf6fad uid_validity=13841 uid_next=348942 81 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX/IMGW guid=5849136be8a03ed13bf8f9d41910d7f8 uid_validity=13805 uid_next=34894281 subs=yes l ast_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX/Inne guid=5eb05c4811720cdf3d9f5352dc994fac uid_validity=13804 uid_next=34894281 subs=yes la st_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX/Inne guid=5eb05c4811720cdf3d9f5352dc994fac uid_validity=13804 uid_next=34894281 subs=yes l ast_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX/Nexto guid=d467b829b0cc91ac4eb975715889bd31 uid_validity=13806 uid_next=34894281 subs=yes l ast_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX/Nexto guid=d467b829b0cc91ac4eb975715889bd31 uid_validity=13806 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX/Philipiak guid=790024d6afa83b393825d00df73b516d uid_validity=13913 uid_next=34894281 subs=y es last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX/Philipiak guid=790024d6afa83b393825d00df73b516d uid_validity=13913 uid_next=34894281 subs= yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX/Total Wellbeing App guid=2baa2fed3be5624bc399327558327e3e uid_validity=13818 uid_next=34894 281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX/Total Wellbeing App guid=2baa2fed3be5624bc399327558327e3e uid_validity=13818 uid_next=3489 4281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX.Drafts guid=004ef77f6a9c3669bcb43012f3a43855 uid_validity=13784 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX.Drafts guid=004ef77f6a9c3669bcb43012f3a43855 uid_validity=13784 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX.Junk guid=4849549b42c9c7de02f5e49cfa8ae258 uid_validity=13786 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX.Junk guid=4849549b42c9c7de02f5e49cfa8ae258 uid_validity=13786 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX.Sent guid=7d3c7eaa71cdf47ee8a1192687cda8cd uid_validity=13785 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX.Sent guid=7d3c7eaa71cdf47ee8a1192687cda8cd uid_validity=13785 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain M: Local mailbox tree: INBOX.Trash guid=b36f688eae08506001091708006abe5a uid_validity=13787 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: brain S: Remote mailbox tree: INBOX.Trash guid=b36f688eae08506001091708006abe5a uid_validity=13787 uid_next=34894281 subs=yes last_change=0 last_subs=0 dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.E-pasa&AXw- wizyt&APM-wki doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/E-pasaż wizytówki not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.E-pasa&AXw- wizyt&APM-wki/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.IMGW doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/IMGW not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.IMGW/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Inne doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Inne not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Inne/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Nexto doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Nexto not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Nexto/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Philipiak doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Philipiak not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Philipiak/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Total Wellbeing App doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX/Total Wellbeing App not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX.Total Wellbeing App/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eDrafts doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: Namespace : Using permissions from /data/poczta/skrzynki/example.com/example.user/.maildir: mode=0700 gid=default dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Drafts not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eDrafts/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eJunk doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: Namespace : Using permissions from /data/poczta/skrzynki/example.com/example.user/.maildir: mode=0700 gid=default dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Junk not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eJunk/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eSent doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: Namespace : Using permissions from /data/poczta/skrzynki/example.com/example.user/.maildir: mode=0700 gid=default dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Sent not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eSent/dovecot-acl not found dsync(example.user(a)example.com): Debug: Namespace : /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eTrash doesn't exist yet, using default permissions dsync(example.user(a)example.com): Debug: Namespace : Using permissions from /data/poczta/skrzynki/example.com/example.user/.maildir: mode=0700 gid=default dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/ not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX.Trash not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/.INBOX\2eTrash/dovecot-acl not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=723d36276ba602567e720000b2e75159 type=mailbox timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=2621c6fd51a58e1d1d5c491aac714886 type=dir timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=703d36276ba602567e720000b2e75159 type=mailbox timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=86c7d94c87680557f26fcb26843f739f type=dir timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=733d36276ba602567e720000b2e75159 type=mailbox timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=35f49dcfbfb2e03fdce327671e82bf17 type=dir timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=713d36276ba602567e720000b2e75159 type=mailbox timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: brain M: Remote mailbox tree deletion: guid=e3bf62bb7f5af7ba291b2df1a11d573b type=dir timestamp=1443014289 name= local update=not found dsync(example.user(a)example.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes dsync(example.user(a)example.com): Debug: sieve: Pigeonhole version 0.4.5 (b7754774631d+) initializing dsync(example.user(a)example.com): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. dsync(example.user(a)example.com): Debug: sieve: file storage: Using script storage path: /data/poczta/skrzynki/example.com/example.user/sieve dsync(example.user(a)example.com): Debug: sieve: file storage: Using active Sieve script path: /data/poczta/skrzynki/example.com/example.user/.dovecot.sieve dsync(example.user(a)example.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ dsync(example.user(a)example.com): Debug: sieve: file storage: Using permissions from /data/poczta/skrzynki/example.com/example.user/sieve: mode=0700 gid=-1 dsync(example.user(a)example.com): Debug: sieve: file storage: sync: Synchronization active dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Warning: Deleting mailbox 'INBOX': UID=34841186 GUID= is missing locally dsync(example.user(a)example.com): Debug: brain S: Import INBOX: Import change GUID= UID=34841186 hdr_hash=ec96ee09dfd0dda2cdf5e3eabaf86dfd result=Reverting local change by deleting mailbox - No more local mails found dsync(example.user(a)example.com): Debug: brain S: Import INBOX: Saved UIDs: dsync(example.user(a)example.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes dsync(example.user(a)example.com): Debug: sieve: Pigeonhole version 0.4.5 (b7754774631d+) initializing dsync(example.user(a)example.com): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. dsync(example.user(a)example.com): Debug: sieve: file storage: Using script storage path: /data/poczta/skrzynki/example.com/example.user/sieve dsync(example.user(a)example.com): Debug: sieve: file storage: Using active Sieve script path: /data/poczta/skrzynki/example.com/example.user/.dovecot.sieve dsync(example.user(a)example.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ dsync(example.user(a)example.com): Debug: sieve: file storage: Using permissions from /data/poczta/skrzynki/example.com/example.user/sieve: mode=0700 gid=-1 dsync(example.user(a)example.com): Debug: sieve: file storage: sync: Synchronization active dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/acl/global-acls/INBOX not found dsync(example.user(a)example.com): Debug: acl vfile: file /data/poczta/skrzynki/example.com/example.user/.maildir/dovecot-acl not found dsync(example.user(a)example.com): Error: Couldn't delete mailbox INBOX: INBOX can't be deleted. dsync(example.user(a)example.com): Debug: imapc(source-imap-server:144): Disconnected doveadm conf -n: # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 3.18.12-gentoo x86_64 Gentoo Base System release 2.2 auth_cache_size = 64 k auth_cache_ttl = 10 mins auth_master_user_separator = * auth_mechanisms = plain login default_vsz_limit = 512 M deliver_log_format = msgid=%m: from=%f: phys=%p: virt=%w %$ dict { lastlogin = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 999 first_valid_uid = 999 last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_gid = 999 mail_location = maildir:~/.maildir:INDEX=/data/poczta/indeksy/%d/%n mail_log_prefix = "%s(%u) <%{session}>: " mail_plugins = acl fts fts_squat listescape quota notify mail_log stats zlib mail_prefetch_count = 50 mail_temp_dir = /data/poczta/tmp mail_uid = 999 mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace { location = maildir:%%h/.maildir:INDEX=/data/poczta/indeksy/shared/%d/%n prefix = shared/%%n/ type = shared } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Archives { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Wiadomości-śmieci { special_use = \Junk } mailbox Wiadomo&AVs-ci-&AVs-mieci { special_use = \Junk } prefix = separator = / } passdb { driver = pam master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/data/poczta/acl/global-acls:cache_secs=60 acl_shared_dict = file:/data/poczta/acl/shared-mailboxes.db antispam_backend = spool2dir antispam_debug_target = syslog antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = SPAM;Junk antispam_spool2dir_notspam = /data/poczta/tmp/spamspool/%u__%%020lu-%%05lu___ham antispam_spool2dir_spam = /data/poczta/tmp/spamspool/%u__%%020lu-%%05lu___spam antispam_trash_pattern_ignorecase = trash;Deleted * antispam_verbose_debug = 1 fts = squat fts_squat = partial=4 full=10 last_login_dict = proxy::lastlogin last_login_key = lastlogin/%u/%s/%r listescape_char = \ quota = dict:User quota::proxy::quota quota_rule2 = Trash:storage=+100M quota_warning = storage=85%% quota-warning 85 %u sieve = file:~/sieve;active=~/.dovecot.sieve sieve_default = /etc/dovecot/sieve/sieve_default_spam-to-junk.sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 1M stats_refresh = 30 s stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } postmaster_address = postmaster(a)example2.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth-worker { user = root } service auth { unix_listener auth-client { group = mail mode = 0660 } unix_listener auth-userdb { mode = 0777 } } service dict { unix_listener dict { group = poczta mode = 0660 } } service lmtp { inet_listener lmtp { address = 192.168.1.198 port = 24 } } service quota-warning { executable = script /data/poczta/bin/quota-warning.sh unix_listener quota-warning { group = poczta mode = 01224 } user = poczta } service stats { fifo_listener stats-mail { group = poczta mode = 0660 } } ssl_cert = </etc/ssl/private/example2.com.crt ssl_cipher_list = HIGH:!aNULL:!MD5!DES:!3DES ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/example2.com.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes version_ignore = yes protocol lmtp { mail_plugins = acl fts fts_squat listescape quota notify mail_log stats zlib sieve } protocol lda { mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = acl fts fts_squat listescape quota notify mail_log stats zlib antispam imap_acl imap_quota imap_stats imap_zlib last_login } protocol pop3 { mail_plugins = acl fts fts_squat listescape quota notify mail_log stats zlib last_login } Thanks for help, Marcin.

2 4

Sieve - multiple cores/CPUs
by Paweł Grzesik 25 Sep '15

25 Sep '15

Hi All, I have a quick question about the Sieve in Dovecot. I know that this is a plugin so probably it depends on the Dovecot itself but: is it able to use multiple cores/CPUs when doing the filtering? does the filtering for each mail user run on a separate core? Thanks, Pawel

2 1

Cyrus mailbox (plain files) to Dovecot
by Wolfgang Rosenauer 25 Sep '15

25 Sep '15

Hi, I'm migrating from a Cyrus to a Dovecot installation right now. As part of it I've got plain Cyrus mailboxes (w/o real metadata; so to say I've got the /var/spool/imap/user part but not the /var/lib/imap/user one)). Those former mailboxes I want to provide under a public namespace via ACLs. The question I cannot answer right now is: How can I convert these plain mailboxes on a FS level to maildir++ so I can provide them as public mailboxes on the new system? The tools I have found require a valid/complete cyrus mailbox. (I don't really care about message flags etc). Thanks, Wolfgang

2 1

v2.2.19 release candidate released
by Timo Sirainen 25 Sep '15

25 Sep '15

http://dovecot.org/releases/2.2/rc/dovecot-2.2.19.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.19.rc1.tar.gz.sig A lot of changes since v2.2.18, so here's a release candidate first. If no bugs are reported, I'm planning on making the final release sometimes this week. The most interesting new features here are the imap-hibernate process, quota count backend and director/proxy improvements. * "doveadm director flush" command has a changed meaning now: It safely moves users to their wanted backends, instead of simply forgetting the mapping entirely and leaving the existing connections untouched. Use -F parameter to get the original unsafe behavior. + Added support for imap-hiberanate processes. + Optimized tracking mailboxes' vsizes (= sum of all messages' size). If mailbox_list_index=yes, it's also stored in there. This makes it very efficient to look up vsizes for all mailboxes. + Added a quota "count" backend, which uses the mailbox vsizes to get the current quota usage. It requires using the new quota_vsizes=yes setting, which tracks the messages' "virtual sizes" rather than "physical sizes". Their distiction is minor and mostly irrelevant nowadays (if mail sizes should be counted with LF or CRLF newlines). + "doveadm director up/down" commands added. The monitoring script should be using these commands instead of changing the vhost count. This allows admin to manually disable a server by changing the vhost count to 0 without the monitoring script changing it back. + Added support for HAProxy protocol: http://wiki2.dovecot.org/HAProxy + Added push-notification plugin framework, which can be used to easily implement push notifications to various backends. Implemented "ox" backend for notifying Open-Xchange via HTTP/json. + imap_logout_format supports more variables now, e.g. number of deleted messages. + pop3: Added pop3_delete_type setting (related to pop3_deleted_flag). + plugin { fts_enforced=yes } setting now fails body searches unless it can be done via the full text search engine. + Added %{passdb:*} and %{userdb:*} variables to various places + auth: Added ":protected" suffix for passdb and userdb fields. If used, the field doesn't overwrite an existing field. + IMAP/POP3 proxy: If a backend server dies, avoid client reconnection spikes by slowly disconnecting clients over time. This is enabled by setting login_proxy_max_disconnect_delay=secs passdb extra field. + imap: Added new read-only METADATA entries: /private/specialuse, /shared/comment, /shared/admin + imap: If client disconnects in the middle of a command, log how long the command had been running. - mdbox: Rebuilding could have caused message's reference count to overflow the 16bit number in some situations, causing problems when trying to expunge the duplicates. - Various search fixes (fts, solr, tika, lib-charset, indexer) - Various virtual plugin fixes - Various fixes and optimizations to dsync, imapc and pop3-migration - imap: Various RFC compliancy and crash fixes to NOTIFY

5 13

dovecot --hostdomain issue
by dovecot＠outputservices.com 25 Sep '15

25 Sep '15

I am on a server I called "email. But dovecot says i am on sunfire.outputservices.com ------------------------------------ dovecot --hostdomain sunfire.outputservices.com ------------------------------------ I would like to at least get it to say email.outputservices.com. But what I really want it to say is posta.outputservices.com. First where does --hostdomain get it's information so I can clear that up? Then how can I get it to identify as posta.outputservices.com? Dave Ryan dovecot(a)outputservices.com Senior System Administrator Output Services, Inc. Thursday, September 24, 2015 1124 hrs MDT ----------------------------------------------------------- doveconf -n # 2.2.15: /usr/local/tools/dovecot/etc/dovecot/dovecot.conf # OS: SunOS 5.10 i86pc base_dir = /dovecot/var/run/dovecot log_path = /dovecot/log/log login_trusted_networks = 137.106.0.0/16 mail_location = mbox:~/posta:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /dovecot/etc/dovecot/conf.d/ldap.settings driver = ldap } protocols = imap service auth { unix_listener /postfix/mqueue/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } ssl_cert = </dovecot/certs/dovecot.pem ssl_key = </dovecot/certs/dovecot.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /dovecot/etc/dovecot/conf.d/ldap.settings driver = ldap } -----------------------------------------------------------

2 1

Released Pigeonhole v0.4.9.rc1 for Dovecot v2.2.19.rc1
by Stephan Bosch 25 Sep '15

25 Sep '15

Hello Dovecot users, Here's the Pigeonhole RC that goes with the Dovecot RC. Changelog v0.4.9.rc1: * Properly implemented checking of ABI version for Sieve interpreter plugins, much like Dovecot itself does for plugins. This will prevent plugin ABI mismatches. + Implemented a vnd.dovecot.environment extension. This builds upon the standard environment extension and adds a few more environment items, such as username and default mailbox. It also creates a variables namespace so that environment items can be accessed directly. I am still thinking about more environment items that can be added. + Sieve extprograms plugin: Made line endings of the input passed to the external programs configurable. This can be configured separately for each of the three extensions. + ManageSieve: Implemented proxy XCLIENT support. This allows the proxy to pass client information to the back-end. - ManageSieve: Fixed an assert failure occurring when a client disconnects during the GETSCRIPT command. - doveadm sieve plugin: Fixed incorrect initialization of mail user. This caused a few memory leaks. - sieve-filter command line tool: Fixed handling of failure-related implicit keep when there is an explicit default destination folder. This caused message duplication. - lib-sieve: Fixed bug in RFC5322 header folding. Words longer than the optimal line length caused empty lines in the output, which would break the resulting message header. This surfaced in References: headers with very long message IDs. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.9.rc1… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.9.rc1… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0