[Dovecot] On-delivery deduplication?

Xin LI delphij at delphij.net
Fri Jun 10 00:32:47 EEST 2011


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 06/09/11 05:36, Allan Cassaro wrote:
[...]


Well, for me it's not a matter of size (I use FreeBSD ZFS which can do
dedup by the way), but simply same message showing up on same inbox for
twice, for IMAP, this can be quite annoying.

Also I don't think filesystem level dedup would work well for mail
servers even using a filesystem that is capable for doing dedup (not to
mention it's sometimes slow), because we store the message header
together with the bodies, and they are likely to differ slightly
(someone@ vs someoneelse at domainname), causing an offset in the message
and thus make block-level dedup useless, so in order to efficiently use
dedup (for speed and space), one have to migrate to a new storage format.

I'll take a look at the code and see if I can do that myself when I have
some spare time, and thanks for everyone who replied.

Cheers,
- -- 
Xin LI <delphij at delphij.net>	http://www.delphij.net/
FreeBSD - The Power to Serve!	       Live free or die
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (FreeBSD)

iQEcBAEBCAAGBQJN8Tv/AAoJEATO+BI/yjfBz6AH/3FWAMNuqTWTvaT8lnSfDl99
7KclQamlczrKvJ3XKjfFCaAzf73PQffwfJbz/RtMfwCgKZhiZG86U5uo15qb8eKU
pUxDVpukxarrb9r/13x5vxrSJz33QVebwdzvdBckZk2sbzUodW1MoMIH/66jmuDG
gojKzn4gdTW1jH5OUlWN3NZSmib44xvTvSjRDX/6OV6DBvAmpHRFOm1f6iEk5BHE
sPnbKEzwNoqAvDlqzPynuhOc+acTuaVL0/+dyEmVcI5neZf6eYRljgoP+NlzF4yk
R9IpghAnRe5Us4ZIXvla1fT345ckAhPtvP0j5FxTjXq4IBChkV4k7PXkwlQSocE=
=PyS4
-----END PGP SIGNATURE-----


More information about the dovecot mailing list