- dovecot - dovecot.org

[Dovecot] 1.1 and the zlib plugin
by Kyle Wheeler 12 Jul '08

12 Jul '08

Hello, I've been playing around with using namespaces to change the way messages are stored. My idea was to use mbox for archival stuff, like this: namespace private { separator = . hidden = no inbox = yes prefox = location = maildir:%h/Maildir } namespace private { separator = . hidden = no prefix = "INBOX.Archive." location = mbox:%h/Maildir/Archive } This works *GREAT*, and I'm really pleased with it. However, it occurred to me that for deeply frozen archives, it might be nice to gzip them. Conveniently, there's the zlib plugin. From what I could tell from the documentation, the compressed mbox names must end in ".gz", so I thought I could simply go into ~/Maildir/Archive and gzip everything. But when I did that, Dovecot started behaving strangely. First of all, the result of LIST shows the files like this: * LIST (\NoInferiors \Marked) "." "INBOX.Archive.Friends.gz" Which is obviously wrong. When I try to SELECT it, I get this: ? SELECT "INBOX.Archive.Friends.gz" ? NO Mailbox doesn't exist: Friends/gz Which seems to indicate that Dovecot is treating the dot in the extension as the separator (understandably), and failing. However, if I leave off the extension, I get this: ? SELECT "INBOX.Archive.Friends" ? NO Mailbox doesn't exist: Friends Which seems to indicate that Dovecot isn't translating "Friends" into "Friends.gz" for some reason. Then I remembered that in the ChangeLog, back in May, the zlib plugin was changed to look for the zlib header rather than the Z flag. I assume that was for using it with Maildirs, but I figured it was worth a shot. So I renamed the Friends.gz file to remove the extension. But that just gives me an error message: ? SELECT "INBOX.Archive.Friends" ? NO Mailbox isn't a valid mbox file It seems like loading the zlib plugin either doesn't have any effect, or I'm not doing it right. I have it in the config file along with other plugins that work just fine: mail_plugins = fts fts_squat zlib And when I check that with dovecot -p, it shows up: mail_plugins: fts fts_squat zlib There's no entry in the plugin {} section of the config file for the zlib plugin... but I assume that none is necessary. Am I doing something wrong? ~Kyle -- No people can be great who have ceased to be virtuous. -- Samuel Johnson, on the behavior of the British colonists in America

4 6

Re: [Dovecot] Poor pop3 over nfs performance
by Mark Zealey 12 Jul '08

12 Jul '08

> rc11 had this fix which may be relevant: > > - dovecot-uidlist is now recreated if it results in > file shrinking > over 25%. Not sure this fix is relevent; but I have upgraded to 1.1.1 > With v1.1 INDEX=MEMORY shouldn't matter that much anymore, since it > should cache the virtual message size to dovecot-uidlist. > > 1) Do you have ,W=<size> in maildir filenames? Apparently not? No; yesterday though I did switch exim to delivering through lda - surprisingly though there was not much effect on the graphs. > 2) Do you have W=<size> added to dovecot-uidlist? I have found something here which I believe is a bug; will detail below > 3) Are your POP3 users download + delete or do they leave mail on the > server? A mixture; I believe at least 80% will download+delete; probably closer to 95% but we do have some very large mail stores - most of these would be accessed by a combination of pop and imap. > You should be able to use dotlock_use_excl=yes. ... > dotlock is the slowest locking method. Did you try how well > fcntl would > have worked? Not tried fcntl; I don't really trust nfs locking. I have enabled the excl in the config; again not much change. Now what I discovered in testing a particularly problematic user with an 800mb cur directory (under v1.1.1; I have never used v1.0 on this mbox but it was converted with your courier convert script); initially they had the following: drwx------ 2 exim exim 2048 Apr 11 2007 courierimapkeywords -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist drwx------ 2 exim exim 499712 Jul 2 10:35 cur -rw------- 1 exim exim 20912 Jul 2 10:51 dovecot.index -rw------- 1 exim exim 33056 Jun 17 17:34 dovecot.index.cache -rw------- 1 exim exim 31336 Jul 2 10:37 dovecot.index.log -rw------- 1 exim exim 158465 Jul 2 10:13 dovecot-uidlist drwx------ 2 exim exim 4096 Jul 2 10:29 new -rw------- 1 exim exim 23 Jun 24 22:49 subscriptions drwx------ 2 exim exim 2048 Jul 2 10:42 tmp As you can see, the cache file is very old, and the uidlist file is behind the last time that the logged in (which was 10:35). When I log in over pop and do a stat/list, it re-reads everything in cur/new but didn't update the dovecot-uidlist file or the index.cache file (the log file is updated though). Dovecot-uidlist file does not have the extra W= tags in it. I removed the dovecot.index.cache file and performed the same login/stat/list operation and logged out, and suddenly the dovecot-uidlist file was updated to the new v1.1 format, and the directory listing looks like: total 1068 drwx------ 2 exim exim 2048 Apr 11 2007 courierimapkeywords -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist drwx------ 2 exim exim 499712 Jul 2 10:35 cur -rw------- 1 exim exim 20912 Jul 2 10:53 dovecot.index -rw------- 1 exim exim 31428 Jul 2 10:53 dovecot.index.log -rw------- 1 exim exim 175508 Jul 2 10:53 dovecot-uidlist drwx------ 2 exim exim 4096 Jul 2 10:29 new -rw------- 1 exim exim 23 Jun 24 22:49 subscriptions drwx------ 2 exim exim 2048 Jul 2 10:42 tmp This looks like a bug to me; I will have a look in the source and see if I can find anything, but I thought I'd send this email as you'll be able to find the bug faster than I can. Thanks, Mark

2 1

[Dovecot] POP3 Mails Not Deleted
by imacat 12 Jul '08

12 Jul '08

Dear all, Hi. This is imacat from Taiwan. We are running Dovecot 1.1.1. I received complaints from one of my colleagues. She checks her mails both from home and from office, so she left her mails in the server for 3 days. This morning she got lots of received mails again. I tracked the syslog, and found the following records: ============ Jul 2 18:39:59 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=0/0, del=0/577, size=55354063 Jul 3 11:59:17 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=99/4866408, del=287/676, size=60218727 Jul 3 12:05:19 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=288/35132998, del=2/677, size=60220846 Jul 3 12:09:58 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=2/9289, del=2/675, size=60190368 ============ It seems that the deleted 287 mails was not really deleted, though the second deletion works. This happens occationally, so I cannot easily reproduce it. Can anyone look into this issue? How can I debug further? Thank you very much in advance. -- imacat ^_*' imacat(a)mail.imacat.idv.tw PGP Key: http://www.imacat.idv.tw/me/pgpkey.asc Tavern IMACAT's http://www.imacat.idv.tw/ Woman's Voice http://www.wov.idv.tw/ TLUG List Manager http://www.linux.org.tw/mailman/listinfo/tlug

3 3

[Dovecot] Q: imaptest license
by seriv＠parkheights.dyndns.org 12 Jul '08

12 Jul '08

Hi Timo, I can't find licensing information in http://hg.dovecot.org/imaptest. Can you tell what is the license for this utility? I'd like to package it for ALTLinux Sisyphus repository. -- Sergey Ivanov

2 2

[Dovecot] imap-login: socketpair() failed: Too many open files
by Manoel Prazeres 12 Jul '08

12 Jul '08

Hi, I'am trying to use heartbeat to start dovecot... It starts but all the login connections are reject with this line on log file: Jul 7 12:47:28 markov dovecot: imap-login: socketpair() failed: Too many open files No username/password are asked (using Thunderbird as client). Outside heartbeat, dovecot runs fine. My environment: # dovecot --version 1.1.1 # uname -a Linux markov.impa.br 2.6.18-53.1.21.el5xen #1 SMP Tue May 20 10:03:27 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux # df -H /dovecot (the indexes - a drbd disk) Filesystem Size Used Avail Use% Mounted on /dev/drbd0 5.3G 146M 4.9G 3% /dovecot # df -H /data/mail (the mailboxes - a nfs disk) Filesystem Size Used Avail Use% Mounted on nfs.impa.br:/data/mail 158G 95G 56G 63% /data/mail # dovecot -n # 1.1.1: /etc/dovecot.conf syslog_facility: local5 protocols: imap imaps listen: 127.0.0.1:143 ssl_listen: 147.65.1.46:993 disable_plaintext_auth: yes login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_log_format_elements: user=<%u> method=%m pid=%p rip=%r lip=%l %c login_processes_count: 32 login_max_processes_count: 512 first_valid_uid: 8 first_valid_gid: 12 mail_location: mbox:%h/mail:INBOX=%h/mbox:INDEX=/dovecot/imapd.indexes/%u mbox_read_locks: dotlock fcntl mbox_write_locks: dotlock fcntl mail_log_prefix: %Us(%u): pid=%p, rip=%r, lip=%l, auth default: passdb: driver: passwd-file args: /etc/dovecot.deny deny: yes passdb: driver: pam userdb: driver: passwd Any suggestion? Thanks Manoel

2 1

[Dovecot] client cannot list subfolders
by Michael B Allen 12 Jul '08

12 Jul '08

Hi, I'm having a problem with the Sylpheed mail client and dovcot 1.0.rc15. Sylpheed does not like how dovecot is returning LIST output so it cannot see subfolders. Note: Sylpheed 2.4 actually works with the same server so apparently something in a newer version of Sylpheed has changed. This is some dialog with the Sylpheed mailing list: > > Apparently it sees them but they're not making it into the tree: > > > > [18:06:12] IMAP4> 11 LIST "" "*" > > getting list of "" ... > > IMAP4< * LIST (\HasNoChildren) "." "Lists.Heimdal" > > folder 'Lists/Heimdal' found. > > IMAP4< * LIST (\HasNoChildren) "." "Lists.JCIFS" > > folder 'Lists/JCIFS' found. > > IMAP4< * LIST (\HasNoChildren) "." "LearnAsSpam" > > folder 'LearnAsSpam' found. > > IMAP4< * LIST (\HasNoChildren) "." "Spam" > > folder 'Spam' found. > > IMAP4< * LIST (\HasNoChildren) "." "Trash" > > folder 'Trash' found. > > IMAP4< * LIST (\HasNoChildren) "." "Sent" > > folder 'Sent' found. > > IMAP4< * LIST (\HasNoChildren) "." "Drafts" > > folder 'Drafts' found. > > IMAP4< * LIST (\HasNoChildren) "." "Saved" > > folder 'Saved' found. > > IMAP4< * LIST (\HasNoChildren) "." "INBOX" > > folder 'INBOX' found. > > IMAP4< * LIST (\HasNoChildren) "." "TMP.STMP" > > folder 'TMP/STMP' found. > > [18:06:12] IMAP4< 11 OK List completed. > > imap_get_part_folder_list(): get root folders > > append 'LearnAsSpam' > > append 'Spam' > > append 'Trash' > > append 'Sent' > > append 'Drafts' > > append 'Saved' > > append 'INBOX' > > imap_get_part_folder_list(): get folders under 'LearnAsSpam' > > imap_get_part_folder_list(): get folders under 'Spam' > > imap_get_part_folder_list(): get folders under 'Trash' > > imap_get_part_folder_list(): get folders under 'Sent' > > imap_get_part_folder_list(): get folders under 'Drafts' > > imap_get_part_folder_list(): get folders under 'Saved' > > imap_get_part_folder_list(): get folders under 'INBOX' > > Setting folder info... > > empty folder > > > > Note that TMP.STMP was created through Sylpheed but after a rebuild > > it's gone .... > > This breaks in the implementation because both "Lists" and "TMP" are not > listed separately and are not recognised as root folders by Sylpheed. As I > read the code, only folders without a '/' are recognised as root folders > (considering the '.' namespace that is used here). It could be that > Sylpheed 2.4.0 parsed the LIST return values differently. > > For Thomas White it's the same problem. Folders "Academic" and > "Theatre" are not recognised as root folders. > > On the contrary, for example Google Mail returns all root folders > separately. > > Which behaviour exactly is IMAP4 compliant remains to be investigated. Basically Sylpheed does not like the dots (which represent slashes) and would prefer to see each folder "listed separately". Can anyone comment regarding proper LIST output and what clients should be expected to handle? Who's bug is this and what is the path of least resistance to fixing it? Mike

3 2

[Dovecot] Global Script to filter Spam
by Andrés Yacopino 12 Jul '08

12 Jul '08

Dovecot Version: 1.1.1 with sieve and managesieve configured. I want to filter spam with the subject *SPAM* to a spam folder for all users, and i also want users to have personal sieve scripts (like vacation). I have configured Squirrelmail, dovecot manage sieve and avelsieve plugin in squirrelmail to do that. The problem is that the user home 's scripts are replaced with the avelsieve plugin script did it in the web interface and the configuration of .dovecot.sieve calling the global script is lost. Is there any other way to call a global script for all users not depending in the user script? Thanks Andrés Fernando Yacopino

3 2

[Dovecot] dovecot-db.conf missing?
by Edgar Fuß 12 Jul '08

12 Jul '08

In dovecot-example.conf (dovecot version 1.1.1), a comment to dict_db_config mentions an example file doc/dovecot.db.conf the distribution tar doesn't seem to contain. Has this been lost from 1.1 to 1.1.1?

2 1

[Dovecot] Vacation?
by kbajwa 12 Jul '08

12 Jul '08

CentOS 5.1 Dovecot & Postfix (part of CentOS install & updated) I understand that there is a package which is part of Dovecot to handle "Auto Responses" known as Vacation. Where I can find more info on this package & especially how to install & configure it? Thanks Kirt

9 20

[Dovecot] Dovecot - Permission denied error!
by kbajwa 11 Jul '08

11 Jul '08

Hello: CentOS 5.2 Postfix 2.3.3 + updates (bundled with CentOS 5.2) Dovecot-1.0.7 (bundled with CentOS 5.2) Dovecot-1.1.1 (Updated from www.atrpms.com) Dovecot-sieve-1.1.5 (Updated from www.atrpms.com) During the last few days I have installed dovecot many times without errors. Today I installed dovecot-1.1.1 & sent a test message to 'test(a)tib.com'. I received the following message back: ------------------ This is the mail system at host mail.tib.com. I'm sorry to have to inform you that your message could not be delivered to one or more recipients. It's attached below. For further assistance, please send mail to <postmaster> If you do so, please include this problem report. You can delete your own text from the attached returned message. The mail system <test(a)tib.com>: local configuration error. Command output: Fatal: open(/etc/dovecot.conf) failed: Permission denied Here is dovecot.conf file: ========================== Jul 11 05:24:50 www dovecot: Dovecot v1.1.1 starting up Jul 11 05:24:52 www postfix/postfix-script: starting the Postfix mail system Jul 11 05:24:52 www postfix/master[4767]: daemon started -- version 2.3.3, configuration /etc/postfix Jul 11 05:25:12 www postfix/smtpd[5081]: connect from unknown[59.93.166.101] Jul 11 05:25:16 www postfix/smtpd[5081]: NOQUEUE: reject: RCPT from unknown[59.93.166.101]: 550 5.1.1 <kdkapp(a)tib.com>: Recipient address rejected: User unknown in local recipient table; from=<byung-ho(a)mailexcite.com> to=<kdkapp(a)tib.com> proto=ESMTP helo=<59.93.166.101> Jul 11 05:25:18 www postfix/smtpd[5081]: lost connection after DATA from unknown[59.93.166.101] Jul 11 05:25:18 www postfix/smtpd[5081]: disconnect from unknown[59.93.166.101] Jul 11 05:28:09 www postfix/smtpd[5452]: connect from mail.highcountryonline.net[12.179.81.11] Jul 11 05:28:09 www postfix/smtpd[5452]: B7EBD1E48069: client=mail.highcountryonline.net[12.179.81.11] Jul 11 05:28:10 www postfix/cleanup[5457]: B7EBD1E48069: message-id=<B2D87B9F772F48BE9FAFD1B29F15AEF0@Sunshine> Jul 11 05:28:10 www postfix/qmgr[4779]: B7EBD1E48069: from=<kbajwa(a)tibonline.net>, size=816, nrcpt=1 (queue active) Jul 11 05:28:10 www postfix/smtpd[5452]: disconnect from mail.highcountryonline.net[12.179.81.11] Jul 11 05:28:10 www postfix/local[5458]: B7EBD1E48069: to=<test(a)tib.com>, relay=local, delay=0.9, delays=0.69/0.06/0/0.16, dsn=5.3.5, status=bounced (local configuration error. Command output: Fatal: open(/etc/dovecot.conf) failed: Permission denied ) Jul 11 05:28:10 www postfix/cleanup[5457]: 6D7BF1E4806C: message-id=<20080711112810.6D7BF1E4806C(a)mail.tib.com> Jul 11 05:28:10 www postfix/qmgr[4779]: 6D7BF1E4806C: from=<>, size=2623, nrcpt=1 (queue active) Jul 11 05:28:10 www postfix/bounce[5461]: B7EBD1E48069: sender non-delivery notification: 6D7BF1E4806C Jul 11 05:28:10 www postfix/qmgr[4779]: B7EBD1E48069: removed Jul 11 05:28:11 www postfix/smtp[5462]: 6D7BF1E4806C: to=<kbajwa(a)tibonline.net>, relay=mail.tibonline.net[12.179.81.11]:25, delay=1.3, delays=0.01/0.06/0.62/0.63, dsn=2.0.0, status=sent (250 OK) Jul 11 05:28:11 www postfix/qmgr[4779]: 6D7BF1E4806C: removed ----------------------- I believe that dovecot-1.1.1 may be causing it. I did not have this problem when I was testing dovecot-1.0.7. Google show 'Permission denied' error problem going back to several years. One suggestion on Google was to 'disable' SElinux, which I did without success. Any ideas why this error is happening? Kirti

2 8