[Dovecot] M-Box benchmark

[Jonathan Stewart]

Javier Henderson wrote:
> 
> On Mar 17, 2007, at 2:02 PM, Jonathan Stewart wrote:
> 
>> Maykel Moya wrote:
>>> A friend of mine passed me this[1] cause I'm recommending him Dovecot.
>> [snip]
>>> [1] http://www.isode.com/whitepapers/mbox-benchmark.html
>>
>> My first questions about this test are what version of dovecot was 
>> used, did they take into account the fact that dovecot has to build 
>> indexes? A 10s ramp-up time seems rather short for that.  What kind of 
>> auth backend was used for each product and did they even attempt any 
>> kind of performance tuning on anything other than their product?  This 
>> "whitepaper" comes across as extremely biased and very short on 
>> important information.
> 
> It seems to me that it was a vendor sponsored test, so one would think 
> they designed the testing criteria to favor their product.

I know and I'm sure they did.  I just had to rant a bit because this 
kind of thing is so common and many people don't even bother to ask 
questions about it and accept any "study" or "whitepaper" as gospel.

Jonathan