March 2007 - dovecot - dovecot.org

[Dovecot] locking question
by Stewart Dean 01 Apr '07

01 Apr '07

There are three applications that have their mitts on files on my mail server, which is running AIXV5.3 and UWIMAP and mbox format. The mail folders and INBOXES are native to that machine, but also are NFS exported to a login server and a mailing list server. All three machines are running the lockd daemon. Everybody wants to lock differently 1) procmail (delivering for sendmail), which seems to want to use dotlocking, fcntl and lockf locking; for whatever reasons, the compile time tests seem to disallow flock. 2) UWIMAP which according to wiki.dovecot.org/Migration/UW uses: mbox_read_locks = flock mbox_write_locks = dotlock flock 3) I want to run dovecot in the same environment as I switch over, for which the locking strategy is supposed to be (according to http://wiki.dovecot.org/MboxLocking) mbox_read_locks = fcntl mbox_write_locks = dotlock fcntl Since that same page in the wiki says. "*It's important that all software that's reading or writing to mboxes use the same locking settings.",* I had recompiled procmail so it only usedotlocking and fcntl (thus removing lockf in addition to the disallowed flock)...but now I bumped into the Migration/UW page and there looks to be a conflict. I want to be able to run dovecot (for testing) and UWIMAP (for all users/production) at the same time (but never at the same time with the same mailbox), but UWIMAP is doc'ed to use flock and Dovecot doesn't It's conceivable that the different locking strategies of UWIMAP and Dovecot don't matter because they would never be going after the same mail files (right?) but there is procmail, which has to interact with both. It appears to not use flock OK, even though the docs say it should since UWIMAP expects it, and I've disabled lockf as well. But will there be a conflict with procmail and dovecot's use of fcntl, which UWIMAP doesn't use? Help. * * ** -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] who owns dovecot files and dirs?
by Stewart Dean 01 Apr '07

01 Apr '07

...and what permissions should they have. I am thinking of /var/run/dovecot and the index directory. What ownership, group and permissions should they be? Are there any other files/dirs created for dovecot alone (not the mail folders and INBOXes); if so, how should they be owned and permed? I had thought they were to be owned by dovecot, but it turns out that they should not -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] convert plugin failing
by Adrian Bridgett 31 Mar '07

31 Mar '07

I'm struggling to get the convert plugin working using the Debian etch packages. When starting dovecot it was trying to create files in /.temp.hostname... convert-plugin.c looks like it has a couple of typos in it - it checks "mail" three times for NULL rather than mail, user, home. I changed this but it's getting called when these three items are set to: "maildir:/HOME_DIRECTORY_USED_BUT_NOT_GIVEN_BY_USERDB/Maildir" "dump-capability" "" I must be missing something - shouldn't the mailboxes only be converted when a user logs in? Should the conversion be skipped for the dump-capability user (whatever that is!) Thanks, Adrian -- Adrian Bridgett - adrian(a)smop.co.uk GPG key available on public key servers

2 1

[Dovecot] Version Numbering and releases
by Peter Lindgren 31 Mar '07

31 Mar '07

Hi all, Merging the two large recent threads, my recommendation is as follows: * The Release Candidates for 1.0 should be bug fixes only. * Each new Feature, or a Feature Set, goes in a separate branch. * That branch is tested by those who need/want that feature. * When testing is completed, the branch is merged into the main trunk. This way, we will have fairly well tested features/feature sets in the main trunk which people can fairly safe download and test and deploy, if their own tests succeeds. When the feature code is merged into the main trunk, the minor version is incremented by one (1.0.x --> 1.1.0). Bug fixes increment the revision (1.1.0 --> 1.1.1). Easy to follow, easy to package for package maintainers. Also, it's easy to write Readme's and other documentation on what's changed. (And for those who think that odd versions are for development (unstable), well, they will just wait until sufficient features have been added before they think it is stable... ) Timo's new features he sees for future versions, plan them for a 2.0 or a 1.1 or whatever version number, just don't call it 1.0.2rc1 :-) Another suggestion, is to create a Bugzilla (or similar) site for dovecot. That gives us all a chance to track changes and bug fixes. /Peter, building rc29 as I write this

1 0

[Dovecot] rc28 : can't set quotas with userdb + passwd file
by David Anderson 30 Mar '07

30 Mar '07

I'm using dovecot 1.0 rc28 - great software! I have a virtual hosting setup, with passdb and userdb both using a passwd file. I cannot get per-user quotas put in the relevant field of the userdb to work. They appear to be completely ignored; only the setting from /etc/dovecot.conf is applied. Can anyone confirm that this is working for them? If it is, can you post the relevant bits of your configuration, please? Many thanks. Kind regards, David

3 3

[Dovecot] Freebsd 4 error DSN stat=Service Unavailable after dovecot install
by Biffy Bob 30 Mar '07

30 Mar '07

Hello everyone, I am getting an error message on FreeBSD 4 after I install dovecot. To start off, I create two regular users, testuser and testuser1. I send each user emails then I install dovecot. After installing dovecot I set up the users in Maildir format then proceed to send them emails and here is what shows up in the maillogs: Email to testuser3 - Mar 29 22:34:52 myserver sendmail[4379]: l2TMYqwj004379: from=root, size=54, class=0, nrcpts=1, msgid=<200703292234.l2TMYqwj004379(a)myserver.vwh.net>, relay=r oot@localhost Mar 29 22:34:52 myserver sm-mta[4380]: l2TMYqMi004380: from=<root(a)myserver.vwh.net>, size=342, class=0, nrcpts=1, msgid=<200703292234.l2TMYqwj004379@myserver .vwh.net>, proto=ESMTP, daemon=MTA-v4, relay=localhost [127.0.0.1] Mar 29 22:34:52 myserver sendmail[4379]: l2TMYqwj004379: to=testuser3(a)myserver.vwh.net, ctladdr=root (0/0), delay=00:00:00, xdelay=00:00:00, mailer=relay, pr i=30054, relay=localhost.. [127.0.0.1], dsn=2.0.0, stat=Sent (l2TMYqMi004380 Message accepted for delivery) Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMi004380: to=<testuser3(a)myserver.vwh.net>, ctladdr=<root(a)myserver.vwh.net> (0/0), delay=00:00:00, xdelay=00:00:0 0, mailer=local, pri=30560, relay=local, dsn=5.0.0, stat=Service unavailable (something didn't work) Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMi004380: l2TMYqMi004381: DSN: Service unavailable (something didn't work) Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMi004381: to=myserver, delay=00:00:00, xdelay=00:00:00, mailer=local, pri=31584, relay=local, dsn=5.0.0, stat=Se rvice unavailable (something didn't work) Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMi004381: l2TMYqMj004381: return to sender: Service unavailable (something didn't work) Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMj004381: to=myserver, delay=00:00:00, xdelay=00:00:00, mailer=local, pri=32608, relay=local, dsn=5.0.0, stat=Se rvice unavailable (something didn't work) Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMi004381: Losing ./qfl2TMYqMi004381: savemail panic Mar 29 22:34:52 myserver sm-mta[4381]: l2TMYqMi004381: SYSERR(root): savemail: cannot save rejected email anywhere Here is what the user looks like in /etc/passwd: testuser3:*:2400:2400:My very own test user:/home/testuser3:/sbin/nologin For the other users that have shell access, they don't get this problem. It seems to be only the users with no shell. Does anybody know of a fix for this problem?

3 4

[Dovecot] make failed in doc/wiki
by Daniel 30 Mar '07

30 Mar '07

Hi! I have this problem with cvs (1.0 branch): [...] Making all in wiki make: don't know how to make \n. Stop in /home/leva/dovecot/dovecot/doc/wiki. *** Error code 1 Stop in /home/leva/dovecot/dovecot/doc (line 323 of Makefile). *** Error code 1 Stop in /home/leva/dovecot/dovecot (line 390 of Makefile). *** Error code 1 Stop in /home/leva/dovecot/dovecot (line 242 of Makefile). Using automake-1.9.6 and autoconf-2.59. What could be the problem? Daniel

2 4

[Dovecot] Security hole #3: zlib plugin allows opening any gziped mboxes
by Timo Sirainen 30 Mar '07

30 Mar '07

zlib plugin allows opening gzipped mboxes as read-only mailboxes. However when using it, the mailbox name checks are bypassed so it's possible to open for example "../otheruser/somefile.gz". Only valid gzipped mbox files can be opened, and only if their name ends with ".gz". You can fix this by upgrading to v1.0.rc29 (available soon) or with this patch: http://dovecot.org/list/dovecot-cvs/2007-March/008488.html I don't think this matters much though. zlib plugin is rarely used, and those who do use it are probably using Dovecot with systems users (per-user UIDs), so the imap process wouldn't have access to other users' mbox files anyway. I found this problem when I was cleaning up the code in CVS HEAD.

1 0

[Dovecot] dovecot-ldap for active directory 2003 r2
by Claudio Roberto Prateat 30 Mar '07

30 Mar '07

Hi, You have example of the dovecot-ldap.conf for authenticate in active directory 2003 r2 ? I have squid, apache authenticate in active directory, but dovecot return failed. Help, please... Best regards !

2 2

[Dovecot] uiddir mailbox format with benchmarks
by Timo Sirainen 30 Mar '07

30 Mar '07

I cleaned up the lib-storage code a bit so that it's easier to write support for new mailbox formats. It could still use a bit of cleaning up. Anyway, I thought I'd try how easy it would be to implement Cyrus-like mail store which would consist of only Dovecot's index files and "<uid>." message files. Flags and everything else is kept only in Dovecot's index files (so it might not be the best idea to use it in production just yet). Several hours later I ended up having it working. The code contains: ~/cvs/m/dovecot-head/src/lib-storage/index/uiddir% wc *[ch] 144 329 3552 uiddir-mail.c 240 565 6206 uiddir-save.c 532 1367 13628 uiddir-storage.c 55 126 1712 uiddir-storage.h 169 404 4057 uiddir-sync.c 21 48 573 uiddir-sync.h 103 258 2762 uiddir-transaction.c 1264 3097 32490 total uiddir-storage.c is still a bit too bloaty with lots of copy&pasted code. The same with maildir and mbox: maildir: 6022 18232 165605 total mbox: 7859 23283 213686 total Benchmarks show that with small mailboxes it's a lot faster than maildir, and with larger mailboxes it's a bit faster. I also tested it against Cyrus. I found out that fetching ENVELOPE vs. specific headers gives quite a huge performance difference. Cyrus is optimized for ENVELOPE while Dovecot is optimized for specific headers. With larger mailboxes + ENVELOPE Cyrus is faster than Dovecot, while with specific headers Dovecot is always faster. Maybe I'll some day make Dovecot optimize for ENVELOPE also if it sees that client only wants to use it. BTW. Does anyone have better naming ideas than "uiddir"? I'll commit it to CVS HEAD once I'm sure about the name. :) u: Dovecot CVS HEAD + uiddir m: Dovecot CVS HEAD + Maildir c: Cyrus IMAP 2.2.13 ./imaptest list=0 seed=1 secs=60 clients=10 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 23486 11822 23481 23476 33426 11659 8038 23472 11922 46952 m: 19367 9734 19367 19356 27453 9687 6287 19347 7983 38709 c: 5124 2553 5121 5105 7080 2559 1877 5104 3271 10228 ./imaptest list=0 dele=20 expu=20 seed=1 secs=60 msgs=10000 clients=10 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 5291 2704 5289 5278 7448 2706 1048 1061 5283 10563 m: 4162 2103 4162 4153 5977 2124 762 853 4153 8304 c: 4302 2157 4301 4289 6021 2072 806 879 4292 8584 ./imaptest list=0 dele=10 expu=10 seed=1 secs=60 msgs=100000 clients=10 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 3211 1637 3206 3195 4639 1537 287 302 3202 6402 m: 2957 1508 2955 2944 4173 1440 279 306 2948 5894 c: 3933 1929 3933 3920 5604 2020 380 379 3923 7846 ------ ./imaptest list=0 dele=10 expu=10 seed=1 secs=60 msgs=100000 clients=1 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 1529 745 1529 1528 2184 819 136 162 1528 3056 c: 1579 813 1579 1578 2257 811 171 148 1578 3156 ./imaptest list=0 dele=10 expu=10 seed=1 secs=60 msgs=100000 clients=50 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 3098 1552 3093 3085 4432 1520 293 334 3089 6173 c: 3664 1765 3659 3596 5106 1802 365 364 3614 7228 ====== FETCH BODY.PEEK[HEADER.FIELDS(from to cc subject)] instead of ENVELOPE: ./imaptest list=0 dele=20 expu=20 seed=1 secs=60 msgs=10000 clients=10 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 5777 2933 5777 5767 8215 2901 1133 1191 5767 11531 c: 3636 1794 3635 3623 5196 1843 682 722 3627 7254 ./imaptest list=0 dele=10 expu=10 seed=1 secs=60 msgs=100000 clients=10 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 3869 1959 3868 3861 5452 1943 364 394 3859 7717 c: 3191 1620 3189 3184 4501 1598 315 327 3181 6362 ./imaptest list=0 dele=10 expu=10 seed=1 secs=60 msgs=100000 clients=1 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 1912 966 1912 1910 2783 940 184 197 1911 3820 c: 1342 696 1342 1341 1888 682 109 126 1341 2682 ./imaptest list=0 dele=10 expu=10 seed=1 secs=60 msgs=100000 clients=50 Logi Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo u: 4618 2320 4610 4604 6558 2266 452 455 4605 9205 c: 2960 1472 2956 2941 4134 1425 281 312 2910 5820

3 5