March 2016 - dovecot - dovecot.org

Dsync Header Hashing
by Richard Laager 13 Apr '16

13 Apr '16

Is there any way to disable the header hashing in dsync? I'm doing a one-time migration to Dovecot using imapc. The FETCHes for Date & Message-ID take a non-trivial amount of time and it's not clear to me if they have a function for a one-time migration. -- Richard

2 5

sis deduplication broken from 2.2.16 upwards
by Pavel Stano 12 Apr '16

12 Apr '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, sis attachment deduplication is broken in 2.2.16 upwards. It is caused by this commit. https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c… in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of inodes of hash files. Because fs_stat() after that commit use fstat() on open fd of temporary file instead of stat on filename. But that temporary file has differnt inode. It not cause any corruption but it will not save any space. Because every duplicate attachment will be in separate file. - -- [ Ohodnotte kvalitu mailu: https://www.nicereply.com/websupport/4afafd34 ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE *** -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJW3XkgAAoJEJDF0QA0DLajmJ0QAIZTFTkN0KMJDT3I/rft5Dpp QYM6kyTVdr/FNeR200LLPjXsHXHF8hhoxkQbpfq1D9ceQO0ERDVaL6knKK7/j5Zj EffO+ercXUkcJbE8iYRNcbdpXltUjgYYzgOha7ULiCk0VxROxcujThNTGCDHY8g/ zHXre2aW7hQ8o1yjjhITIOU5WsENSI8PbFktvvWF6OEMVwv8EnaEckJTRGwEl2fu FEPSV+eQg6jHTs/fgiMxAbd4DSzRa2tkeOrw4l4oprtIuthU5hAi9G42Dk+IFvXk k6imnsI6QMPhlrHCm+8Ym+8FwCv7S75JJ/iRp/sS2zHuEwvfwFcVi8pBSjeV50kZ Z0Xglm35tFrHNLAFFb1CVnEw6ftQpuMEE7o/IYrLMVVdPB0C/1IP0s9ucKK0ccQ0 Ld9RULBo6jLgxsVodEntgtMABkfvxybut/tF3O4mm/iN0rDzlOZHMeQ+lsgcdrZd J7h3ow/J0OYosR7CfRFLA875ue2g4GsF+FFP9/oKx/1TkHXJNXpKAhhjOCnSgxHe h44bDrpJyYKlrCaLcOjQM4iUO0upBPpepOnJu50Fde1hNmyr4NaiHLTo23OGX/v3 kEA6xEgmTsXyr3kjhg51/0tdradqKvih2yIptmhpw8P+RWp+ceMoDX2hF95EGB8q FGklrxdxCIoGPAZTOVyf =imfX -----END PGP SIGNATURE-----

5 7

[Dovecot] Replication and public namespaces
by Markus Weippert 11 Apr '16

11 Apr '16

Hi, I'm having some issues with replicating public namespaces. Everything seems to work fine for private namespaces, but while importing some huge mailboxes (many small mails) into a public namespace via imapsync, something goes wrong. The expected mail flow is: old-server (imapsync)> new-server1 (replication)> new-server2 But then, dovecot seems to run into race conditions when the replications process tries to sync the same public mailbox under two or more different users at the same time. As a result, messages get duplicated, new-server2 sends those back to new-server1 which then starts to produce duplicates too. If I don't kill the processes in time and delete the faulty mailbox, they start to produce thousands of mails. In fact, server2 should not export messages at all, since it's not productive yet and does not get any mail except from the replication. The only thing getting logged (only few compared to the huge amount of duplicates produced): "dsync-server(user(a)example.com): Warning: Maildir /...: Expunged message reappeared, giving a new UID" Is there any way to fix this? Regards, Markus doveadm_password = *********** doveadm_port = ***** mail_home = /var/vmail/private/%d/%n mail_location = maildir:~/mail mail_plugins = acl virtual listescape notify replication namespace inbox { inbox = yes location = prefix = separator = / type = private } namespace legacy { alias_for = # ... } namespace ns_public { list = children location = maildir:/var/vmail/public/%d prefix = Public/ separator = / subscriptions = no type = public } namespace virtual { # ... } plugin { mail_replica = tcps:************** } protocols = imap lmtp sieve replication_dsync_parameters = -d -l 60 -N -x virtual -x ns_public -U replication_full_sync_interval = 4 hours replication_max_conns = 20 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 8143 ssl = yes } process_min_avail = 5 user = vmail vsz_limit = 4 G } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } }

3 7

ETOOMANYREFS related errors
by Luis Ugalde 07 Apr '16

07 Apr '16

Hi, I'm starting to see, on a pretty standard Debian Jessie installation, some error messages that are apparently related to the ETOOMANYREFS errno. Firstly, the mail log shows this: dovecot: pop3-login: Error: fd_send(pop3, 18) failed: Too many references: cannot splice And then the login process fails: dovecot: pop3-login: Internal login failure (pid=34388 id=1) (internal failure, 1 successful auths): user=<username>, method=PLAIN, rip=rip, lip=lip, session=<session> Is this something that Dovecot should be able to handle, or is it strictly Debian/libc/MySillyMistake related? #uname -a Linux server 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 (2016-01-17) x86_64 GNU/Linux #dovecot --version 2.2.13 #dpkg -l | grep -E 'dovecot-core|libc6|linux-image' ii dovecot-core 1:2.2.13-12~deb8u1 amd64 ii libc6:amd64 2.19-18+deb8u3 amd64 ii libc6-i386 2.19-18+deb8u3 amd64 ii linux-image-3.16.0-4-amd64 3.16.7-ckt20-1+deb8u3 amd64 Best Regards, Luis

2 3

How to delete Dovecot users when using Single Instance Storage
by Jesus Cea 05 Apr '16

05 Apr '16

In case somebody find this useful: https://blog.jcea.es/posts/20160211-delete_users_dovecot.html -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

2 1

New feature: HTTP API
by aki.tuomi＠dovecot.fi 05 Apr '16

05 Apr '16

Hi all! We are bringing out HTTP API for doveadm-server in master HEAD. This feature is experimental, and can be expected to have bugs in it and might not always work. If you feel like trying it out though, you can enable it in your configuration file: doveadm_api_key = some-string service doveadm { inet_listener http { port = 8080 } } To use the API, you can go to http://host:8080/doveadm. GET request will print out possible commands, along with their parameters. If you have set API KEY, you need to include it in the request as X-API-Key header. This API has been designed to resemble JMAP API since we are planning to implement it in future version. The rule of thumb is that all the commands work as they would on cli, so the parameters are more or less the same. There are few exceptions, like 'field' parameter in some mail/mailbox commands. Commands are executed by POSTin JSON to /doveadm. The JSON format is [ ["command",{"parameter":"value"},"opaque identifier"], ["command",{"parameter":"value"},"opaque identifier"], ["command",{"parameter":"value"},"opaque identifier"], ... ] Be warned though that even if it supports multiple commands, some commands still use i_fatal to terminate the server if they are unhappy. This will mean you will lose the whole result set, and get no output, so at this point it is safest option to run only one command at a time. If you run into problems or discover issues, please report them in the usual manner to us. Kind regards, Aki Tuomi Dovecot Oy

2 3

default namespace
by Nerijus Baliunas 01 Apr '16

01 Apr '16

Hello, With no namespace settings and dovecot 2.0.9 I get the following listing: a LIST "" "*" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "INBOX" a OK List completed. Then I add the namespaces: namespace inbox { separator = . prefix = inbox = yes hidden = no list = yes subscriptions = yes } namespace compat { separator = . prefix = INBOX. inbox = no hidden = yes list = no alias_for = } Then list output changes: a LIST "" "*" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasChildren) "." "INBOX" a OK List completed. INBOX now has \HasChildren, while before it had \HasNoChildren. How can I make it \HasNoChildren? Regards, Nerijus

1 1

mail filter plugin script doesn't effective
by use experience 31 Mar '16

31 Mar '16

output of *dovecot --version*: Dovecot version : 2.2.9 ----- output of *doveconf -n:* auth_debug = yes > > auth_mechanisms = plain login > > auth_verbose = yes > > disable_plaintext_auth = no > > mail_debug = yes > > mail_location = > maildir:/var/mail/vhosts/%d/%n:LAYOUT=fs:DIRNAME=dovecot_maildir > > mail_plugins = " mail_log notify mail_filter" > > mail_privileged_group = mail > > namespace inbox { > > inbox = yes > > location = > > mailbox Drafts { > > auto = subscribe > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > auto = subscribe > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > auto = no > > special_use = \Sent > > } > > mailbox Spam { > > auto = create > > special_use = \Junk > > } > > mailbox Trash { > > auto = no > > special_use = \Trash > > } > > mailbox virtual/All { > > auto = no > > special_use = \All > > } > > prefix = > > } > > passdb { > > args = /etc/dovecot/dovecot-sql.conf.ext > > driver = sql > > } > > plugin { > > autocreate = Trash > > autocreate2 = Spam > > mail_filter = santhosh-filter %u > > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename flag_change save mailbox_create > > mail_log_fields = uid box msgid size flags vsize from subject > > } > > protocols = " imap lmtp pop3" > > service auth-worker { > > user = vmail > > } > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0777 > > user = postfix > > } > > unix_listener auth-userdb { > > mode = 0777 > > } > > user = dovecot > > } > > service imap-login { > > executable = imap-login -R rawlogs > > } > > service imap-postlogin { > > executable = script-login /usr/local/bin/postlogin.sh > /etc/dovecot/script/echo.sh > > user = vmail > > } > > service imap { > > executable = imap imap-postlogin > > } > > service lmtp { > > unix_listener /var/spool/postfix/private/dovecot-lmtp { > > group = postfix > > mode = 0600 > > user = postfix > > } > > } > > service santhosh-filter-out { > > executable = script /usr/local/bin/mail-filter-out.sh > > unix_listener santhosh-filter-out { > > mode = 0777 > > user = vmail > > } > > user = dovecot > > } > > service santhosh-filter { > > executable = script /usr/local/bin/mail-filter.sh > > unix_listener santhosh-filter { > > mode = 0777 > > user = vmail > > } > > } > > ssl_cert = </etc/dovecot/dovecot.pem > > ssl_key = </etc/dovecot/private/dovecot.pem > > userdb { > > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > > driver = static > > } > > protocol imap { > > mail_plugins = " autocreate" > > } > >

2 4

VS: Re: v2.2.23 released
by Aki Tuomi 31 Mar '16

31 Mar '16

It's fixed in head. Sorry. ---Aki TuomiDovecot oy -------- Alkuperäinen viesti --------Lähettäjä: Eric <ebroch(a)whitehorsetc.com> Päivämäärä: 31.3.2016 18.05 (GMT+02:00) Saaja: dovecot(a)dovecot.org Aihe: Re: v2.2.23 released Yes. I concur. On 3/31/2016 7:44 AM, Leon Kyneur wrote: > 2.2.23 seems to have broken doveadm backup, was previously working > fine on 2.2.22 > > [root@S613 lkyneur]# doveadm -v backup -u em.mck ... > doveadm(root): Error: User doesn't exist > > > [root@S613 lkyneur]# doveadm user em.mck > field value > uid vmail > gid vmail > home /srv/vmail/eftel/xxx.com/20032218/em.mck > mail > mdbox:/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox:ALT=/altstorage/srv/vm… > quota_rule *:bytes=500M > > > On 30/03/16 23:48, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >> >> This is a bugfix-only release with various important fixes on top of >> v2.2.22. >> >> - Various fixes to doveadm. Especially running commands via >> doveadm-server was broken. >> - director: Fixed user weakness getting stuck in some situations >> - director: Fixed a situation where directors keep re-sending >> different states to each others and never becoming synced. >> - director: Fixed assert-crash related to a slow "user killed" reply >> - Fixed assert-crash related to istream-concat, which could have >> been triggered at least by a Sieve script.

3 2

Reply to : http://dovecot.org/pipermail/dovecot/2016-March/103789.html
by use experience 31 Mar '16

31 Mar '16

I dint get reply as mail to my mailed, so pasting here the link http://dovecot.org/pipermail/dovecot/2016-March/103791.html

1 0