- dovecot - dovecot.org

[Dovecot] 1.0.beta4 released
by Timo Sirainen 04 Apr '06

04 Apr '06

I haven't had yet time to read all the mails in this list which I skipped in the last few of weeks. I'll try to get to them eventually. This release contains several new features which haven't been fully tested yet, such as ACLs, master users and Maildir++ quota. If you intend to use them, test them properly first. This is the first Dovecot release where it's supposed to work well with NFS. Even with indexes being stored in NFS. I was able to test it only with Linux 2.4 kernels as clients though, and it didn't work well in a stress test. It looked like the problem was caused by the kernel caching the data a bit too much. Hopefully I can test soon with 2.6 kernels. Also note the other changes which might affect you. Especially if you're using Dovecot-LDA remember to upgrade it as well to make sure the default lock_method gets updated in it also. As for the future, it looks like I'm getting soon paid to develop several features to improve Dovecot's performance (by the company which already paid for ACLs, NFS fixes and many other changes in this release, thanks!). * Changed the default lock_method back to fcntl. Apparently flock gives problems with some systems. * mbox: mailboxes beginning with '.' are now also listed * Replaced mail_use_modules and mail_modules settings with mail_plugins and mail_plugin_dir. Now instead of loading all plugins from the directory, you'll have to give a list of plugins to load. If the plugin couldn't be loaded, the process exits instead of just ignoring the problem (this is important with ACL plugin). + Added support for "master users" who can log in as other people. The master username can be given either in authorization ID string with SASL PLAIN mechanism or by setting auth_master_user_separator and giving it within the normal username string. + Added ACL plugin with ACL file backend. This however doesn't mean that there yet exists a proper shared folder support. If master user logged in as someone else, the ACLs are checked as the master user. + Added some Dovecot extensions to checkpassword passdb, see ChangeLog + Updated passwd-file format to allow specifying any key=value fields + Maildir++ quota support and several quota fixes + passdb supporting extra fields: Added "allow_nets" option which takes a comma separated list of IPs/networks where to allow user to log in. + NFS: Handle ESTALE errors the best way we can + IMAP now writes to log when client disconnects + In shared mailboxes (if dovecot-shared file exists) \Seen flags are now kept only in index files, so as long as each user has a separate index file they have separate \Seen flags. - Fixes to DIGEST-MD5 realm handling so it works with more clients - BODYSTRUCTURE -> BODY conversion from cache file was broken with mails containing message/rfc822 parts. - Fixed several memory leaks - We could have sent client FETCH notifications about messages before telling about them with EXISTS - Compiling fixes for Solaris and some other OSes - Fixed problem with internal timeout handling code, which caused eg. outlook-idle workaround to break. - If /dev/urandom didn't exist, we didn't seed OpenSSL's random number generator properly. Patch by Vilmos Nebehaj. - Maildir: Recent flags weren't always immediately removed from mails when mailbox was opened. - Several changes to SSL proxying code, hopefully making it work better.

8 9

[Dovecot] Dovecot 1.0beta4 and Disconnected Problem
by Gerhard Wiesinger 04 Apr '06

04 Apr '06

Hello! Yesterday I upgraded from 1.0beta3 to 1.0beta4. I've major problems now with my inbox (quite large, 900MB) and another large folder. Thunderbird 1.5 connects and disconnects. I tried to delete the indexes of dovecot and thunderbird without any sucess. Finally I downgraded to 1.0beta3 and it works well again (Beta3 was running for a timeframe from when it came out and now without any problems). Config is the same as for 1.0beta3. Apr 3 07:30:27 bbs dovecot: imap-login: Login: user=<user1>,method=plain, rip=192.168.0.5, lip=192.168.0.2, TLS Apr 3 07:30:27 bbs dovecot: imap(gerhard): Disconnected Apr 3 07:30:27 bbs dovecot: imap-login: Login: user=<user1>, method=plain, rip=192.168.0.5, lip=192.168.0.2, TLS Apr 3 07:30:28 bbs dovecot: imap(gerhard): Disconnected Apr 3 07:30:28 bbs dovecot: imap-login: Login: user<user1>, method=plain, rip=192.168.0.5, lip=192.168.0.2, TLS Apr 3 07:30:28 bbs dovecot: imap(gerhard): Disconnected Any ideas how the problem can be found? Thank you for the answer. Ciao, Gerhard

4 4

[Dovecot] Busyloop in dovecot-auth
by Jorgen Lundman 04 Apr '06

04 Apr '06

SunOS pop01.unix 5.10 Generic_118844-26 i86pc i386 i86pc dovecot-1.0.beta3 Dovecot itself runs well, and was easy to confirgure with LDAP. However, I am seeing a cpu busy-loop in dovecot-auth. Is this a known issue, or do you know why it happens? If needed I can go deeper if so required. PID USERNAME LWP PRI NICE SIZE RES STATE TIME CPU COMMAND 26440 root 1 10 0 4232K 2096K cpu/0 40.9H 49.73% dovecot-auth # truss -fip 26440 26440: pollsys(0x08093E90, 10, 0x08047B90, 0x00000000) = 1 26440: pollsys(0x08047834, 5, 0x080477F8, 0x00000000) = 0 26440: pollsys(0x08093E90, 10, 0x08047B90, 0x00000000) = 1 26440: pollsys(0x08047834, 5, 0x080477F8, 0x00000000) = 0 26440: pollsys(0x08093E90, 10, 0x08047B90, 0x00000000) = 1 26440: pollsys(0x08047834, 5, 0x080477F8, 0x00000000) = 0 [snip] This is a test box, it has no load/users, except when I telnet to port 110 to test LDAP authentication. Lund -- Jorgen Lundman | <lundman(a)lundman.net> Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work) Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell) Japan | +81 (0)3 -3375-1767 (home)

1 1

[Dovecot] batch convert mbox to maildir
by Netlink Tech 03 Apr '06

03 Apr '06

Hello, I have used mb2md for an individual user like this: su ~username cd ~ ./mb2md -m This converted /var/spool/mail/username mbox to /home/users/username/Maildir just as I expected. To convert 100s of users the same way would be a chore (su as each user for permissions, etc.). Is there a way to batch process all /var/spool/mail/$USER to /home/users/$USER/Maildir with the correct permissions/file owners for each user?

3 3

[Dovecot] Re: Courier to Dovecot Maildir conversion
by Roger Weeks 03 Apr '06

03 Apr '06

We went through a courier to dovecot conversion. There are a couple of things that might be causing this problem. 1. Dovecot namespaces 2. Client configuration Your namespaces might not be taking into account the fact that courier prefixed all files and directories in the maildir with a dot (.). You can get around this a couple of ways. We had almost no IMAP clients under courier, so I renamed everything in our IMAP client directories away from .files and .directories, and used a default namespace without dots. Also some clients like Apple Mail needed an IMAP prefix like INBOX. to work with courier. I had to remove those with the dovecot namespace I set up. -- Roger J. Weeks Systems & Network Administrator Mendocino Community Network On Mar 31, 2006, at 12:29 PM, dovecot-request(a)dovecot.org wrote: > Message: 8 > Date: Fri, 31 Mar 2006 14:07:56 -0400 > From: "Jeff S." <go4broke(a)gmail.com> > Subject: [Dovecot] Courier to Dovecot Maildir converstion > To: dovecot(a)dovecot.org > Message-ID: > <f63de89e0603311007p2c367b5ev17bef83a7b98833(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Hello, > > I am running Dovecot 0.99 on OpenSuse 10.0. Previously, I was running > courier IMAP with vpopmail on Suse 9.3. In the process of the > change, I > decided to sing MySQL to authenticate the users, provide home dir, > uid and > gid. > > I tar'ed up the old mail directories, moved them to the new server, > added a > new user and group to own the files, set the files uid/gid to match > the > values in the db. Next, I followed the Migration directions on > http://wiki.dovecot.org/Migration. I can successfully authenticate > the new > users, have no errors in the log file but when I am logged in I > only see the > Inbox. There should be other folders as well as mail in the > inbox. No > errors in the log files. > > Any ideas?

1 0

[Dovecot] hard quota example, 1.0b3
by Jeff A. Earickson 03 Apr '06

03 Apr '06

Timo, Here's an example of the filesystem quota issue: A user was near his hard filesystem quota, so he moved some junk to his Trash folder to clear disk space. He got the following error on his IMAP client: "Internal error occurred. Refer to server log for more information. {2006-04033 11:08:44]". My setup: Solaris 9, beta3 (soon going to beta4), mbox format, IMAP only. Home directories (where IMAP folders and index files go) have filesystem quotas. Jeff Earickson Colby College

2 1

Re: [Dovecot] Dovecot road-map
by Jeff A. Earickson 03 Apr '06

03 Apr '06

> Date: Sun, 02 Apr 2006 19:11:33 +0300 > From: Timo Sirainen <tss(a)iki.fi> > To: Kupor Laszlo <willy(a)dunanet.hu> > Cc: dovecot(a)dovecot.org > Subject: Re: [Dovecot] Dovecot road-map > On Sun, 2006-04-02 at 09:54 +0200, Kupor Laszlo wrote: > > > > Hello, > > > > I track dovecot m-list, and i wan't migrate to dovecot, but now dovecot > > has no maildir++ quota in public release(beta etc). Without quota support > > dovcot not a solution for me. > > Please if dovecot have a release plan, post to me. > > I'll release beta4 today which will have Maildir++ quota support. It's > not well tested yet, but if there are bugs they should be easy to fix > now. :) I have to agree that dovecot's inability to react to filesystem quotas is a major deficiency. This feature should not rely on plug-ins, mailbox format, etc. It should be built into the base code, IMHO. Jeff Earickson Colby College

2 1

[Dovecot] MySQL auth issues?
by Matthias Saou 03 Apr '06

03 Apr '06

Hi, Since my last email about RHEL4 problems on x86_64, I've kept trying to figure out what the problem might be, and just ran into a reply to an old email I sent to the list, which I had missed. It suggests that the issue might be in the MySQL authentication that I'm using. Here is a more detailed log entry, with auto debugging on : Apr 3 13:13:02 s1 dovecot: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=::ffff:195.x.x.x rip=::ffff:195.x.x.x resp=AHBhcnRuZXJzQdNvbW1lcm3lZ2F0ZS5jb20Aa2F2YWthdmE= Apr 3 13:13:02 s1 dovecot: auth(default): client out: OK 1 user=x(a)domain.com Apr 3 13:13:02 s1 dovecot: auth(default): master in: REQUEST 70 22190 1 Apr 3 13:13:02 s1 dovecot: auth-worker(default): sql(x@domain.com,::ffff:195.x.x.x): SELECT maildir, 101 AS uid, 103 AS gid FROM mailbox WHERE username = 'x(a)domain.com' Apr 3 13:13:02 s1 dovecot: auth(default): master out: USER 70 x(a)domain.com maildir=domain.com/x/ uid=101 gid=103 Apr 3 13:13:02 s1 dovecot: pop3-login: Login: user=<x(a)domain.com>, method=PLAIN, rip=::ffff:195.x.x.x, lip=::ffff:195.x.x.x Apr 3 13:13:02 s1 dovecot: pop3(x(a)domain.com): ^GUnexpected eof found when reading file 'UNOPENED' (Errcode: 0) Apr 3 13:13:02 s1 last message repeated 2 times Apr 3 13:13:02 s1 dovecot: pop3(x(a)domain.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/2, size=17174 Those "Unexpected eof found when reading file 'fileName'" messages are apparently from MySQL, as one can see here for instance : http://www.mysqlfreaks.com/errors/49.php Here is my relevant configuration (all the rest is the default) : login_greeting = Ready. verbose_proctitle = yes first_valid_uid = 101 default_mail_env = maildir:/home/vmail/%d/%n:INDEX=MEMORY auth_cache_size = 512 auth_verbose = yes auth_debug = yes auth_debug_passwords = yes auth default { mechanisms = plain passdb sql { args = /etc/dovecot-mysql.conf } userdb sql { args = /etc/dovecot-mysql.conf } } The INDEX=MEMORY was added because of similar errors with the indexes : Apr 3 12:56:44 s1 dovecot: pop3-login: Login: user=<x(a)domain.com>, method=PLAIN, rip=::ffff:195.x.x.x, lip=::ffff:195.x.x.x, TLS Apr 3 12:56:44 s1 dovecot: pop3(x(a)domaine.com): Corrupted transaction log file /home/vmail/domain.com/x/dovecot.index.log: unexpected end of file while reading header Apr 3 12:56:44 s1 dovecot: pop3(x(a)domain.com): Corrupted transaction log file /home/vmail/domain.com/x/dovecot.index.log: unexpected end of file while reading header Apr 3 12:56:44 s1 dovecot: pop3(x(a)domain.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 (this was when the auth_debug wasn't enabled) Here is my /etc/dovecot-mysql.conf file : driver = mysql connect = host=/var/lib/mysql/mysql.sock dbname=postfix user=postfix password=xxx default_pass_scheme = PLAIN password_query = SELECT password FROM mailbox WHERE username = '%u' user_query = SELECT maildir, 101 AS uid, 103 AS gid FROM mailbox WHERE username = '%u' I'm using MySQL 4.1.12-3.RHEL4.1 (the original RHEL4 packages), with the server on the same machine (hence the socket access). I was seeing this also with 0.9, not just 1.0 betas. With x86_64 packages, any slight change to the main dovecot.conf file can prevent dovecot from starting (segfault with "Unexpected eof found when reading file 'UNOPENED' (Errcode: 0)" message), whereas i386 packages work somewhat better. This is on the same machine with an i386 compatibility layer. Is anyone using MySQL auth successfully? Any help or pointers would be more than welcome. Matthias -- Clean custom Red Hat Linux rpm packages : http://freshrpms.net/ Fedora Core release 5 (Bordeaux) - Linux kernel 2.6.16-1.2080_FC5 Load : 0.38 0.33 0.34

1 1

[Dovecot] mbox-sync-update.c error
by Carlos Vicente 03 Apr '06

03 Apr '06

Hi, I think the problem is in Dovecot. I'm using both Evolution and Thunderbird on a Gentoo box. One of my folders keeps locking up and the clients can't retrieve the messages. The situation appears to be triggered by trying to move a message into that folder. Deleting the index files (under /var/log/dovecot/xxx/) solves the problem (temporarily). I get these error messages in the logs: Mar 31 15:10:34 dovecot: imap(cvicente): mbox sync: UID inserted in the middle of mailbox /home/xxx/Mail/xxx (93 > 3, seq=93, idx_msgs=3455) Mar 31 15:10:34 dovecot: imap(cvicente): file mbox-sync-update.c: line 55 (mbox_sync_move_buffer): assertion failed: (ctx->mail.offset + ctx->mail.space <= ctx->hdr_offset + pos || ctx->mail.offset > ctx->hdr_offset + pos + have) Mar 31 15:10:35 dovecot: child 32373 (imap) killed with signal 6 M I'm running dovecot-1.0_beta3 Hope this gets some attention from the developers. cv >In the maillog I get > > Mar 29 09:17:25 bree dovecot: imap-login: Login: user=<hartr>, > method=plain, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured > Mar 29 09:17:25 bree dovecot: imap(hartr): mbox sync: UID inserted > in the middle of mailbox /var/mail/hartr (8 > 1, seq=2, idx_msgs=4) > Mar 29 09:17:25 bree dovecot: imap(hartr): file mbox-sync-update.c: > line 55 (mbox_sync_move_buffer): assertion failed: (ctx->mail.offset > + ctx->mail.space <= ctx->hdr_offset + pos || ctx->mail.offset > > ctx->hdr_offset + pos + have) > Mar 29 09:17:26 bree dove

3 4

[Dovecot] Dovecot-news mailing list created
by Timo Sirainen 02 Apr '06

02 Apr '06

New low-traffic list created for people who only wish to see new release announcements and possibly some other rare important announcements. Also from now on no-one can send mails to either of these lists with From-field containing "tss(a)iki.fi" or "Timo Sirainen", unless it also contains a valid PGP signature from me. If someone wants to see the script (and please check if there are any bugs in it, thanks :), it's here: http://iki.fi/tss/gpgcheck.pl

1 0