June 2008 - dovecot - dovecot.org

[Dovecot] fd limit 1024 is lower in dovecot-1.1.1
by Zhang Huangbin 16 Jul '08

16 Jul '08

Hi, all. I just upgrade from 1.0.15 to 1.1.1 in a test box(RHEL 5.2, x86_64). after upgrade, i got this warning msg: ----8< ---- # /etc/init.d/dovecot restart Stopping Dovecot Imap: [ OK ] Starting Dovecot Imap: Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 1280). Either grow the limit or change login_max_processes_count and max_mail_processes settings [ OK ] ----8< ---- but i changed either login_max_processes_count and max_mail_processes to 2048, it raised the same msg. How can i solove this issue? Thanks very much. My dovecot -n output: ----8<---- # dovecot -n # 1.1.1: /etc/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 1280). Either grow the limit or change login_max_processes_count and max_mail_processes settings log_path: /var/log/dovecot.log protocols: pop3 pop3s imap imaps listen: * ssl_cert_file: /etc/pki/dovecot/certs/dovecotCert.pem ssl_key_file: /etc/pki/dovecot/private/dovecotKey.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login max_mail_processes: 1024 mail_uid: 2000 mail_gid: 2000 mail_location: maildir:/%Lh/%Ld/%Ln/:INDEX=/%Lh/%Ld/%Ln/ mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login user: vmail passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail -- Best Regards. Zhang Huangbin - Mail Server Solution for Red Hat(R) Enterprise Linux & CentOS 5.x: http://rhms.googlecode.com/

4 5

[Dovecot] 1.1 and the zlib plugin
by Kyle Wheeler 12 Jul '08

12 Jul '08

Hello, I've been playing around with using namespaces to change the way messages are stored. My idea was to use mbox for archival stuff, like this: namespace private { separator = . hidden = no inbox = yes prefox = location = maildir:%h/Maildir } namespace private { separator = . hidden = no prefix = "INBOX.Archive." location = mbox:%h/Maildir/Archive } This works *GREAT*, and I'm really pleased with it. However, it occurred to me that for deeply frozen archives, it might be nice to gzip them. Conveniently, there's the zlib plugin. From what I could tell from the documentation, the compressed mbox names must end in ".gz", so I thought I could simply go into ~/Maildir/Archive and gzip everything. But when I did that, Dovecot started behaving strangely. First of all, the result of LIST shows the files like this: * LIST (\NoInferiors \Marked) "." "INBOX.Archive.Friends.gz" Which is obviously wrong. When I try to SELECT it, I get this: ? SELECT "INBOX.Archive.Friends.gz" ? NO Mailbox doesn't exist: Friends/gz Which seems to indicate that Dovecot is treating the dot in the extension as the separator (understandably), and failing. However, if I leave off the extension, I get this: ? SELECT "INBOX.Archive.Friends" ? NO Mailbox doesn't exist: Friends Which seems to indicate that Dovecot isn't translating "Friends" into "Friends.gz" for some reason. Then I remembered that in the ChangeLog, back in May, the zlib plugin was changed to look for the zlib header rather than the Z flag. I assume that was for using it with Maildirs, but I figured it was worth a shot. So I renamed the Friends.gz file to remove the extension. But that just gives me an error message: ? SELECT "INBOX.Archive.Friends" ? NO Mailbox isn't a valid mbox file It seems like loading the zlib plugin either doesn't have any effect, or I'm not doing it right. I have it in the config file along with other plugins that work just fine: mail_plugins = fts fts_squat zlib And when I check that with dovecot -p, it shows up: mail_plugins: fts fts_squat zlib There's no entry in the plugin {} section of the config file for the zlib plugin... but I assume that none is necessary. Am I doing something wrong? ~Kyle -- No people can be great who have ceased to be virtuous. -- Samuel Johnson, on the behavior of the British colonists in America

4 6

[Dovecot] Vacation?
by kbajwa 12 Jul '08

12 Jul '08

CentOS 5.1 Dovecot & Postfix (part of CentOS install & updated) I understand that there is a package which is part of Dovecot to handle "Auto Responses" known as Vacation. Where I can find more info on this package & especially how to install & configure it? Thanks Kirt

9 20

[Dovecot] Time moved backwards by 4398 seconds
by Anders 09 Jul '08

09 Jul '08

Dovecot (v1.1.rc8) died tonight, with an error about time moving backwards by 4398 seconds. I can see from logs that this has happend a few times before with the imap processes, without me noticing. I sure noticed the master process missing, though :-). I was puzzled that it was always 4398 seconds, in particular because this server runs an NTP daemon. A little searching for this problem shows that it is an issue with the Linux kernel gettimeofday(), see e.g. http://lkml.org/lkml/2007/8/23/96 Below is a patch (untested) to work around this issue. Do you see something wrong with this approach, apart from the uglyness? I just picked the 4395-4400 values by chance. Can you figure out how big the window should be? Thanks, Anders. --- ./src/lib/ioloop.c-orig 2008-06-20 10:45:54.000000000 +0200 +++ ./src/lib/ioloop.c 2008-06-20 10:47:36.000000000 +0200 @@ -230,8 +230,13 @@ struct timeval tv, tv_call; unsigned int t_id; - if (gettimeofday(&ioloop_timeval, &ioloop_timezone) < 0) - i_fatal("gettimeofday(): %m"); + /* The Linux gettimeofday() will sometimes jump forward + * by approximately 4398 seconds. Ignore that reading. */ + do { + if (gettimeofday(&ioloop_timeval, &ioloop_timezone) < 0) + i_fatal("gettimeofday(): %m"); + } while (4395 < (ioloop_timeval.tv_sec - ioloop_time) + && (ioloop_timeval.tv_sec - ioloop_time) < 4400); /* Don't bother comparing usecs. */ if (ioloop_time > ioloop_timeval.tv_sec) {

4 9

[Dovecot] can't download attachment from the wiki
by Andrew Schulman 05 Jul '08

05 Jul '08

Hi. At http://wiki.dovecot.org/ManageSieve#line-229 , I want to download the patch that's supposed to fix two problems in Avelsieve. Unfortunately, when I click on the link to the patch, I always get an error message: You are not allowed to do AttachFile on this page. Annoying. I've created an account and logged in, but still no joy. Can anyone suggest how or where else I can get that patch? Thanks, Andrew.

3 5

[Dovecot] newbie: problem with IMAPS + mutt + Thunderbird
by Toni Mueller 04 Jul '08

04 Jul '08

Hi, I'm a Dovecot newbie and have some problems with the configuration/the resulting interoperability. My setup looks like this: I receive my mail using qmail-ldap and sort it with a number of means into ~/Mailbox/ (= INBOX) and ~/Mail/folder/ for various values of 'folder' (generally one folder per mailing list). The sorting is done via .qmail-* files, LDAP entries, and procmail (this is a "legacy" setup that I'd rather not change too much). I usually access my mail using 'mutt' on the local machine (Debian 4.0), and everything is fine. I'd like to be able to access the same email using Thunderbird over IMAPS as well, to gain foreign character support (ie, Chinese), while continuing to use mutt as my main MUA. There are, so far, two problems with this setup: 1. I can't find the folders in ~/Mail/. As an interim solution, I symlinked them from my ~/Mailbox/ dir, but this is _dead_ugly_. 2. (MUCH more serious) As soon as I access the email using Thunderbird, Dovecot moves all new mail from somefolder/new to somefolder/cur, thereby making mutt flag all my new mail as 'O' ("old") which was flagged 'N' ("new") before. If I remember which the new mails were, I can flag them as 'N' in mutt, and they get moved to .../new again, but this isn't usually the case because my mailboxen are often large (> 10.000 messages), and it's undone as soon as I access the mailbox with Thunderbird (over IMAPS). I also have a wish list. Both Mutt and Dovecot (can) make use of index files to speed mail access. It would be great if this could be unified so that both programs use the same index files (in a consistent manner, of course). The software versions I currently use are these: Mutt: 1.5.17+2008011 Dovecot: 1.0.13-1~bpo40 Thunderbird: 1.5.0.13+1.5.0 Dovecot configuration: log_timestamp: %Y-%m-%dT%H:%M:%S protocols: imaps ssl_listen: 10.10.10.1:993 login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 2 login_max_processes_count: 20 max_mail_processes: 30 first_valid_uid: 2000 first_valid_gid: 2000 mail_location: maildir:~/Mail:INBOX=~/Mailbox/ mail_debug: yes auth default: verbose: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf Kind regards, --Toni++

1 1

[Dovecot] v1.1.1 released
by Timo Sirainen 03 Jul '08

03 Jul '08

http://dovecot.org/releases/1.1/dovecot-1.1.1.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.1.tar.gz.sig Hopefully this release lives a bit longer than v1.1.0. - Maildir: When migrating from v1.0 with old format dovecot-uidlist files, Dovecot may have appended lines to it using the new format and later broken with "UID larger than next_uid" error.

7 10

[Dovecot] 1.1 namespaces and message corruption
by Kyle Wheeler 02 Jul '08

02 Jul '08

Hello, I've been trying out the new dovecot's namespace support, and I'm having some issues moving messages between namespaces. Specifically, when I move some messages from a Maildir-based namespace to an mbox-based namespace, the message gets corrupted: its contents are removed, and an entirely empty message is added to the destination mailbox. This is 100% repeatable (some messages just *cannot* be copied intact). I have two namespaces, set up like so: namespace private { # Default separator = . hidden = no inbox = yes prefix = location = maildir:%h/Maildir } namespace private { separator = . hidden = no prefix = "INBOX.ArchiveTest." location = mbox:%h/Maildir/Archive } All I do is tell my client (mutt) to copy a message from a folder in the maildir namespace into a folder in the mbox namespace. Does anyone know what might be going wrong or how I can even debug this? No error messages of any kind are showing up in the dovecot log file, and the mail_debug setting doesn't seem to give me any useful information. Message corruption of this sort worries me... ~Kyle -- To sin by silence when they should protest makes cowards of men. -- Abraham Lincoln

2 2

[Dovecot] courier IMAP to dovecot migration: folders not showing up
by Jacob Yocom-Piatt 01 Jul '08

01 Jul '08

i have been running postfix + courier-imap + cyrus sasl for several years and have some prior experience with dovecot + postfix and had no problems. now that i'm trying to convert an existing courier-imap configuration to dovecot and all the various parts work together (e.g. mail delivery and dovecot sasl), i cannot get the folder subscription issue sorted. the machine is running netbsd 4.1 + postfix 2.5.1 + dovecot 1.0.13. searching for a bit yields the following useful links http://wiki.dovecot.org/Migration/Courier http://wiki.dovecot.org/Migration http://marc.info/?l=dovecot&m=120592911416484&w=2 i have downloaded and run the courier-dovecot-migrate.pl script and that does not do the trick, nor does following it up with the suggested changes in the private namespace. an example of one of the maildirs i have at hand is mail# ls -al total 1580 drwx------ 71 vmail users 2560 Jun 27 13:47 . drwx------ 24 vmail users 512 May 28 14:10 .. drwx------ 6 vmail users 512 Jun 27 12:10 .Drafts drwx------ 5 vmail users 512 Jun 27 13:17 .INBOX.Trash drwx------ 6 vmail users 512 Jun 27 12:45 .RT drwx------ 6 vmail users 512 Jun 27 12:50 .Sent drwx------ 6 vmail users 512 Jun 27 12:46 .Trash drwx------ 6 vmail users 512 Jun 27 12:45 .Trash.bro drwx------ 6 vmail users 512 Jun 27 12:45 .associates .... and the subscriptions file, after courier-dovecot-migrate.pl runs is Trash Sent Drafts associates .... based on the folder subscriptions, i have attempted to move the folders preceded by a '.' to the same name without a '.'. this does not fix the problem either. any clues on how to fix this issue would be welcome. cheers, jake

3 3

[Dovecot] Poor pop3 over nfs performance
by Mark Zealey 01 Jul '08

01 Jul '08

Hi, About a week ago I upgraded our reasonably heavily loaded mail servers from a pretty recent courier version to dovecot-1.1rc10. IMAP performance on dovecot is amazing, however POP3 performance is worse than courier :-( I have uploaded some munin graphs taken today to http://linweb.atlas.pipex.net/dovecot/; the dovecot server is handling about 2000 pop logins/sec and 300 imap sessions (but these are negligible in terms of nfs ops). The courier server is handling a similar number of pop logins/sec but no imap (slightly less traffic overall but a similar number of logins). As you can see, dovecot seems to issue an awful lot more read requests than courier. The big spike at 10am is where I tried setting the :INDEX=MEMORY flag on dovecot as I assumed that's what courier is doing. I've also attached graphs of the relative network usage - as you can see, dovecot is using up to 100mbps whereas courier is using less than 10mbps; I believe this is due to the read. I initially assumed this high read load was due to courier building up its index files, but this has now been happening for about a week with little variation. The servers are both centos 5.0 (perhaps 5.1 actually, but with the latest centosplus kernel which fixes the nfs lookup bug in the standard kernels); and are not running any other nfs programs. The NFS server is a high performance NAS unit - no issues there. We're only using Maildirs; relevant config options are: mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes Thanks, Mark

3 2