August 2007 - dovecot

[Dovecot] Benchmark: Appending 250k messages
by Timo Sirainen 06 Aug '07

06 Aug '07

I just changed Dovecot v1.1 code to work much more nicely when appending new messages to large mailboxes. Dovecot hg (cydir format, fsync_disable=yes): ./imaptest secs=1 ./imaptest - append=100,0 logout=0 msgs=10000000 clients=1 seed=1 secs=300 Logi Sele Appe 100% 100% 100% 1 1 2322 1/ 1 0 0 1998 1/ 1 0 0 2293 1/ 1 0 0 2009 1/ 1 0 0 1789 1/ 1 0 0 1245 1/ 1 0 0 43 1/ 1 0 0 32 1/ 1 0 0 881 1/ 1 0 0 2137 1/ 1 .. 0 0 704 1/ 1 0 0 771 1/ 1 0 0 388 1/ 1 0 0 831 1/ 1 0 0 572 1/ 1 0 0 766 1/ 1 Totals: 1 1 251397 Averaging 837/sec. The append speed jumps around quite a lot. Typically it's around 800-1000/sec, but it jumps between 0-500/sec also quite often. I'm not sure why that is. Cyrus v2.3.8 (fsync and fdatasync calls disabled from code): ./imaptest - append=100,0 logout=0 msgs=10000000 clients=1 seed=1 secs=300 Logi Sele Appe 100% 100% 100% 1 1 2587 1/ 1 0 0 1907 1/ 1 0 0 1597 1/ 1 0 0 1260 1/ 1 0 0 1220 1/ 1 0 0 1151 1/ 1 0 0 1068 1/ 1 .. 0 0 121 1/ 1 0 0 127 1/ 1 0 0 128 1/ 1 0 0 126 1/ 1 Totals: 1 1 79613 Averaging 265/sec. The speed slows down pretty consistently, there's no jumping like with Dovecot.

1 0

[Dovecot] Disable IMAP for certain users, but not Webmailer
by FORMER 03 | Baltasar Cevc 06 Aug '07

06 Aug '07

Hi everybody, I'm planning to set up our new mail system using the Dovecot mailbox server. It mostly works fine yet (it's quite straigt forward to set up, I'd say), but there's a thing I haven't been able to find out yet. We provide POP3 access for all users, but want to restrict IMAP access to some of them (because IMAP users tend to leave more messages on the server, thus increasing storage needs). I used to do it by providing two services. One provided the public imap and checked a database flag during authentication, the other just provided IMAP on localhost and did not check the "allowed to use IMAP" flag. What I've found for Dovecot is http://wiki.dovecot.org/Authentication/RestrictAccess While this allows me to provide full POP3 to everybody and in the same time restricting IMAP, I don't see a possibility Is there any possibility to achieve what I need without having two completely separated instances of Dovecot running? I'd appreciate any hints, pointers to documents etc. Thanx, Baltasar -- _____ FORMER 03 GmbH _____ infanteriestra§e 19 haus 6 eg _____ 80797 muenchen _____ baltasar.cevc(a)former03.de _____ www.former03.de _____ fon 089.322112.29 _____ fax 089.322112.11 _____ mobil 0178.691.2233 _____ geschftsfhrer _____ sebastian fiedler _____ gert zellentin _____ handelsregister _____ HRB Mnchen 148468 _____ steuer _____ ust.-id DE 2291076876

6 12

[Dovecot] dovecot.index.cache weirdness
by Tan Shao Yi 06 Aug '07

06 Aug '07

Hi Timo, Just a quick check, may I know if the following output of idxview is normal? (see bottom of e-mail) I am running dovecot-1.0.3 on a Solaris 10 SPARC box. Deleting dovecot.index.cache does not seem to help for this user; it keeps getting regenerated with these same lines. I seems that I have to set mmap_disable=yes on this box to have a "clean-looking" dovecot.index.cache. Is it mmap related? Or it just happens to be a coincidence? Cheers, Tan Shao Yi /usr/local/libexec/dovecot/idxview dovecot.index dovecot.index.cache (... normal looking stuff ...) RECORD: offset=408, seq=22, uid=126, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=420, seq=23, uid=127, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=432, seq=24, uid=128, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=444, seq=25, uid=129, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=456, seq=26, uid=130, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=468, seq=27, uid=131, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=480, seq=28, uid=132, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=492, seq=29, uid=133, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=504, seq=30, uid=134, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=516, seq=31, uid=135, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=528, seq=32, uid=136, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=540, seq=33, uid=137, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=552, seq=34, uid=138, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=564, seq=35, uid=139, flags=0 - ext cache(0): 0 (00000000)

2 1

[Dovecot] FETCH for mailbox XXX UID XXX got too little data.
by Tan Shao Yi 06 Aug '07

06 Aug '07

Hi Timo, I am receiving the above error in dovecot's logs, here's how it looks like: dovecot: Aug 05 19:52:19 Info: imap-login: Login: user=<XXXXXXXXXXXX>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: Aug 05 19:53:36 Error: IMAP(XXXXXXXXXXXX): FETCH for mailbox Bulk Mails UID 32 got too little data: 9199 vs 39532 dovecot: Aug 05 19:53:36 Info: IMAP(XXXXXXXXXXXX): Disconnected: Disconnected When I attempted a telnet to the IMAP port, a fetch body[text] of the message begins with a partial portion of the Received headers: dsl-146-173-81.clt.bellsouth.net (72.146.173.81) by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000 and I get abruptly disconnected: Connection to localhost closed by foreign host. May I know what could have gone wrong? To protect the user's privacy, I will be e-mailing you the actual bad e-mail in a separate e-mail. Thanking in advance. Cheers. Following this is a partial transcript of the IMAP transaction: a1 fetch 32 full * 32 FETCH (FLAGS (\Seen) INTERNALDATE "26-Jul-2007 00:35:20 +0800" RFC822.SIZE 40598 ENVELOPE ("Thu, 26 Jul 2007 00:22:09 +0800" "ADV: Empowering Your Presentation Skills" (("Personal Development Workshops" NIL "enews" "JuzEvents2.com")) (("Personal Development Workshops" NIL "enews" "JuzEvents2.com")) (("Personal Development Workshops" NIL "enews" "JuzEvents2.com")) ((NIL NIL "XXXXXXXXXXXX" "pacific.net.sg")) NIL NIL NIL "<004e4411357e78a1b6eec83d00114028(a)juzevents2.com>") BODY ("text" "html" ("charset" "gb2312") NIL NIL "base64" 39532 508)) a1 OK Fetch completed. a1 fetch 32 body[text] * 32 FETCH (BODY[TEXT] {39532} dsl-146-173-81.clt.bellsouth.net (72.146.173.81) by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000 Received: from NHGF ([10.161.42.56]) by adsl-146-173-81.clt.bellsouth.net (8.13.4/8.13.4) with SMTP id i154842195219s7Ho019018 for <XXXXXXXXXXXX(a)pacific.net.sg>; Tue, 31 Jul 2007 21:48:10 -0500 (CDT) (envelope-from espainolax_6666(a)yahoo.es) Message-ID: <005801c7d3de$046dbe90$51ad9248@NHGF> From: "espainolax_6666" <espainolax_6666(a)yahoo.es> To: <XXXXXXXXXXXX(a)pacific.net.sg> Subject: soggy fighter pilot Date: Wed, 01 Aug 2007 10:45:38 +0800 MIME-Version: 1.0 Content-Type: multipart/related; boundary="----=_NextPart_000_0055_01C7D3BC.7D1C7D80"; type="multipart/alternative" X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3138 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3138 *** blah *** Connection to localhost closed by foreign host.

2 2

[Dovecot] Some of my IMAP Folders vanished in some MUAs
by Dominik Schulz 05 Aug '07

05 Aug '07

Hi, I'm using dovecot for some time now. Previously I was using Courier and I've migrated this setup to dovecot which went pretty fine. Now I'm experiencing some strange behaviour when using some newer mail clients. Some of my Folders, like "spam", are vanished. The strange point is that it only happens in some clients, like Thunderbird 2.x+ or KMail 3.5.x. In others, like Thunderbird < 2, Mutt or my Webmailer (Horde) they still show up. These folders are still there, i.e. in the filesystem, and the permissions seem to match those of the other folders which can be seem in all MUAs. I don't know if this is even related to dovecot but I think this is where I should start looking for an solution. I'm using dovecot 1.0.rc15 from Debian (stable/etch). It'd be great if anyone was able to help me. Thanks in advance. Best Regrads Dominik Schulz

6 10

[Dovecot] Password Encryption
by Dave Morrow 05 Aug '07

05 Aug '07

Hi all. I hope this is not a RTFM-type question, but I've been unable to find a searchable archive of this mailing list....... I recently began investigating using Dovecot/Postfix/MySQL solution. I've been following the documentation http://wiki.dovecot.org/HowTo/DovecotLDAPostfixAdminMySQL?highlight=%28m ysql%29 While everything seems to have gone right, I have been unable to successfully login to the IMAP server using Outlook Express. It seems that the problem may relate to PostfixAdmin storing passwords in the mysql database md5 encrypted, and Dovecot is not able to read them, but I am not certain. The error when a client logs in is something like dovecot: auth-worker(default): plain_md5_verify(testuser1(a)mydomain.com): Invalid password encoding David Morrow Technical Systems Lead Autodata Solutions Company David.Morrow(a)Autodata.net <mailto:David.Morrow@Autodata.net> http://www.autodatasolutions.com <http://www.autodatasolutions.com/> Tel: (519) 963-3020 Fax: (519) 451-6615 Think slowly. Act quickly. This message has originated from Autodata Solutions. The attached material is the Confidential and Proprietary Information of Autodata Solutions. This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please delete this message and notify the Autodata system administrator at Administrator(a)autodata.net <mailto:Administrator@autodata.net <mailto:Administrator@autodata.net> >

3 3

[Dovecot] modify header in deliver
by Reinhard Hainz 05 Aug '07

05 Aug '07

hi, is it possible to modify the mail-header (subject) within the deliver process (maybe by a lda-plugin)? I have tried to write a simple plugin for this, but I cannot find a way to modify the mail befor writing it to the mailbox. Reinhard ------------------------------------------- Versendet durch aonWebmail (webmail.aon.at) Hier spielt die Musik! Über zwei Millionen Songs zum Downloaden. http://www.aon.at/musikdownload

2 1

[Dovecot] IMAP-Proxy and LDAP?
by Patrick Ben Koetter 05 Aug '07

05 Aug '07

I am doing some research on Dovecots IMAP-Proxy features mentioned in <http://wiki.dovecot.org/HowTo/ImapProxy> and <http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy>. The docs only mention SQL as backend to hold required data. Is it also possible to use LDAP? TIA, p@rick -- state of mind Agentur für Kommunikation, Design und Softwareentwicklung Patrick Koetter Tel: 089 45227227 Echinger Strasse 3 Fax: 089 45227226 85386 Eching Web: http://www.state-of-mind.de Amtsgericht München Partnerschaftsregister PR 563

2 2

[Dovecot] sendfile on Solaris 10 SPARC?
by Tan Shao Yi 04 Aug '07

04 Aug '07

Hi, I am using dovecot-1.0.2 and am observing occassions where the imap process for the user goes into an infinite loop. A truss of the process gives: pollsys(0x000B0308, 4, 0xFFBFF898, 0x00000000) = 1 fstat64(10, 0x000BC130) = 0 sendfilev64(1, 1, 0xFFBFF4B0, 1, 0xFFBFF4A4) Err#11 EAGAIN pollsys(0x000B0308, 4, 0xFFBFF898, 0x00000000) = 1 fstat64(10, 0x000BC130) = 0 sendfilev64(1, 1, 0xFFBFF4B0, 1, 0xFFBFF4A4) Err#11 EAGAIN pollsys(0x000B0308, 4, 0xFFBFF898, 0x00000000) = 1 fstat64(10, 0x000BC130) = 0 (... repeatedly ...) When I searched the maillog for the user, the last actions taken were: dovecot: Aug 04 10:50:42 Info: imap-login: Login: user=<XXX>, method=PLAI N, rip=203.120.90.32, lip=203.120.90.85 dovecot: Aug 04 10:50:42 Info: IMAP(XXX): copy -> Trash: uid=25, msgid=<d 05001c7d51a$0a18c550$958f3011@burgaldceo> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): copy -> Trash: uid=26, msgid=<4 14901c7d5bd$55a80b40$26227a4d@Mitchell> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): copy -> Trash: uid=27, msgid=<9 31601908.49031521463794(a)lanecompany.com> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): deleted: uid=25, msgid=<d05001c 7d51a$0a18c550$958f3011@burgaldceo> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): deleted: uid=26, msgid=<414901c 7d5bd$55a80b40$26227a4d@Mitchell> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): deleted: uid=27, msgid=<9316019 08.49031521463794(a)lanecompany.com> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): expunged: uid=25, msgid=<d05001 c7d51a$0a18c550$958f3011@burgaldceo> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): expunged: uid=26, msgid=<414901 c7d5bd$55a80b40$26227a4d@Mitchell> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): expunged: uid=27, msgid=<931601 908.49031521463794(a)lanecompany.com> dovecot: Aug 04 10:50:43 Info: IMAP(XXX): Disconnected: Logged out May I know what could have caused the problem or is there any other information I can provide? Thanking in advance. Cheers, Tan Shao Yi

1 0

Re: [Dovecot] Dovecot strong or not for a big Webmail architecture
by Bill Boebel 04 Aug '07

04 Aug '07

On Thu, August 2, 2007 3:06 pm, John fistack <john.fistack(a)yahoo.fr> said: > I know webmail.us use Dovecot, what is the most big dovecot architecture known ? > Do you think Dovecot can handle 1 million of active users in a good architecture ? Yep... and we have 500K very active users on it. We've scaled Dovecot horizontally without NFS, just lots of independent Dovecot server intances with smart proxy/mail-routing infrastructure around it. It can easily scale to millions of users this way. Just make sure you throw enough disks at it and you'll be fine, with or without NFS. > Do you think it's a good solution to use one synchronised local Openldap on each > server Dovecot ? No. I'd replicate your ldap database on a few servers that are dedicated to that purpose, and on each mail server use Dovecot's auth_cach feature to minimize how often it needs to query ldap. > Do you think It's possible to use Postgresql or MySQL instead of Openldap ? We use MySQL. MySQL handles frequent writes better than OpenLDAP from our experience. It is also simpler for us to do replication and troubleshooting because we employ several MysQL gurus already. > Are cyrus or courrier-imap better solutions ? Definitely not courier-imap, because of it's lack of indexes. Not sure about Cyrus. > Someone say "Zimbra is highly scalable and fast", I think Zimbra could be to heavy > in this architecture, is Dovecot scalable ? My opinion is Zimbra is too heavy beccause of the way mail is stored on the backend. Dovecot with maildir scales out well, and the promise of dbox mail storage format appears that it will make it even more scalable down the road. Bill

3 2