March 2008 - dovecot - dovecot.org

[Dovecot] Fix available for mmap on FreeBSD zfs
by Adam McDougall 29 Jul '08

29 Jul '08

Saw this just come through for 8-current, 7-stable ought to have it in a week or so. I have not encountered the problem so I would not be able to judge if this fixes it. Patch here: http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/contrib/opensolaris/uts/commo… pjd 2008-03-15 23:23:04 UTC FreeBSD src repository Modified files: sys/contrib/opensolaris/uts/common/fs/zfs zfs_vnops.c Log: Fix mmap(2) on ZFS after some changes in VM subsystem. Submitted by: alc Reported by: kris (originally) and many others Tested with: fsx MFC after: 1 week Revision Changes Path 1.28 +4 -0 src/sys/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c

2 3

[Dovecot] BUG: messages created with permissions not respecting umask
by Thomas Vander Stichele 20 Jul '08

20 Jul '08

Using dovecot 1.0rc15, together with postfix and dovecot-lda. umask is set to 0007. This should ensure directories and files get created with read/write permissions for both user and group. However, dovecot-lda writes files with 600 permissions, instead of 660. So dovecot does not seem to respect the umask configuration property for local mail delivery. In my particular case, I have vmail:vmail own the mail directories, and a backup user part of the vmail group. However the backup user cannot read the mails and thus back them up properly. Suggestions: - respect the umask for file delivery as well - alternatively, take the parent directory's permissions, strip executable bits, and apply to file Thanks Thomas

3 3

[Dovecot] EXPUNGE delay
by Eugene 09 Jun '08

09 Jun '08

Hi people! I just switched one of my servers from Courier to Dovecot. Planned to do it anyway but had to do it faster after the discovery that courier [the version I had installed, at least] returns malformed headers for a few messages, causing Outlook Express to completely ignore them. Curiously, they were visible in Squirrelmail and Nokia Series60 e-mail client. Overal I am quite happy but have one little problem. More often than not, I have to press 'Purge' button two or more times in order to actually remove the deleted messages. The fragment of Outlook's IMAP log is below. Interestingly, Dovecot 1.0.7 (on another server) does not have such problem. Best wishes Eugene IMAP: 00:46:56 [tx] 0yc9 UID STORE 172903 +FLAGS.SILENT (\Deleted \Seen) IMAP: 00:46:56 [rx] 0yc9 OK Store completed. IMAP: 00:46:58 [tx] 623w EXPUNGE IMAP: 00:46:58 [rx] * 102 FETCH (FLAGS (\Deleted \Seen)) IMAP: 00:46:58 [rx] 623w OK Expunge completed. IMAP: 00:46:58 [tx] 62lg IDLE IMAP: 00:46:58 [rx] + idling IMAP: 00:47:02 [tx] DONE IMAP: 00:47:02 [rx] 62lg OK Idle completed. IMAP: 00:47:02 [tx] a4si EXPUNGE IMAP: 00:47:02 [rx] * 102 EXPUNGE IMAP: 00:47:02 [rx] a4si OK Expunge completed. dovecot version: 1.0.10 OS: FreeBSD 5.3-RELEASE i386 dovecot -n # 1.0.10: /usr/contrib/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/certs/xxxx.pem ssl_key_file: /etc/ssl/private/xxxx.pem disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/contrib/libexec/dovecot/imap-login login_executable(imap): /usr/contrib/libexec/dovecot/imap-login login_executable(pop3): /usr/contrib/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_gid: 0 mail_extra_groups: mail mail_location: maildir:/home/%u/Maildir mail_executable(default): /usr/contrib/libexec/dovecot/imap mail_executable(imap): /usr/contrib/libexec/dovecot/imap mail_executable(pop3): /usr/contrib/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/contrib/lib/dovecot/imap mail_plugin_dir(imap): /usr/contrib/lib/dovecot/imap mail_plugin_dir(pop3): /usr/contrib/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam userdb: driver: passwd

3 6

[Dovecot] messages downloading repeatedly to mozilla/seamonkey pop3 client
by Ben Julian 20 May '08

20 May '08

Hello Dovecot List, I am a bit of a sysadmin novice and this is my first time emailing, so please let me know if I have left some critical information out. I am supporting a small office network supported primarily by linux servers. All of my users are using dovecot as a pop3 daemon on a centOS 5 box, no IMAP users. Seven users are running outlook 2003 on windows XP, two users are running thunderbird on ubuntu, two are running evolution on ubuntu, and one is running mozilla seamonkey on XP. Emails to the mozilla/seamonkey user are downloading multiple times, but not to any of the other users. A typical maillog report following this user's mail client pop3 login: Mar 3 10:37:00 servername dovecot: pop3-login: Login: user=<user>, method=PLAIN, rip=::ffff:192.168.99.13, lip=::ffff:192.168.99.4 Mar 3 10:37:00 servername dovecot: POP3(user): mbox sync: UID inserted in the middle of mailbox /var/mail/user (84873 > 84872, seq=2, idx_msgs=3) Mar 3 10:37:01 servername dovecot: POP3(user): mbox sync: UID inserted in the middle of mailbox /var/mail/user (84877 > 84872, seq=2, idx_msgs=4) Mar 3 10:37:01 servername dovecot: POP3(user): Disconnected: Logged out top=0/0, retr=1/3364, del=1/1, size=3347 Things I've tried: *adding the following lines to dovecot.conf: protocol pop3 { pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } *deleting the user's homedir mail directory (including all dovecot index files) *restarting dovecot *changing mail clients: tried outlook express, netscape 4.8, thunderbird on user's PC *restarting the server All changes resulted in only a brief (1-2hr) cessation of the problem. I've subscribed for a month or so now and searched the archives, but if I missed a solution to this in there, I apologize. Thanks, Ben Julian

4 7

[Dovecot] Webmail Recommendation
by Peter Sparkes 19 May '08

19 May '08

Hi, I want to install webmail. I am using Dovecot with Exim4. Recommendations requested please. Thanks Peter Sparkes

32 46

[Dovecot] Postfix & Dovecot LDA
by Jochen Schulz 18 May '08

18 May '08

Hi, before I start to write a lengthy email about something that isn't really possible anyway: can I make Postfix use Dovecot's LDA and start it with different user IDs? My scenario: Dovecot authenticates users for Postfix and itself using Postgresql. Mails for two domains should be stored under /srv/<domain>/<user> (which is the location returned by my user_sql query and mail_location). When my clients login (with usernames of the form 'user@domain'), Dovecot creates/opens the correct mailboxes for them, but I can't get LDA to deliver to these mailboxes. Whatever I try, I am always running into some kind of permission problems (either for the mailboxes, or for auth_socket). I want to use a unique UID for every virtual domain, so I guess LDA needs to have permissions for every corresponding mailbox *and* Dovecot's auth_socket_path. Is there a good solution for this which doesn't involve severe security implications? J. -- If all my friends had Playstations I would buy a Nintendo to prove my individuality. [Agree] [Disagree] <http://www.slowlydownward.com/NODATA/data_enter2.html>

6 7

[Dovecot] Development news
by Timo Sirainen 17 May '08

17 May '08

First a list of all the new features and their state: 1. http://hg.dovecot.org/dovecot-threadindexes/ THREAD=REFERENCES indexes. Missing NFS flushes, support for mmap_disable=yes, breaks when more than one session modifies at the same time. Not tested much if the replies are really correct at all. Also started THREAD=X-REFERENCES2 but it doesn't work as expected. 2. http://hg.dovecot.org/dovecot-virtualboxes/ Virtual mailboxes. Nothing changed since http://dovecot.org/list/dovecot/2008-March/029546.html 3. http://hg.dovecot.org/dovecot-condstore/ Implemented CONDSTORE, QRESYNC, ESEARCH, SEARCHRES and WITHIN extensions. The only known problem left is making CONDSTORE's STORE UNCHANGEDSINCE operation atomic, but it requires changing transaction log file format. Maybe I'll do it and just make v1.1 and v1.0 be able to read the format and just ignore the modseq in the record. Those code trees don't contain all the latest changes from v1.1 tree. So at some point I'll start merging all of them into one dovecot-1.2 code tree. v1.1 is coming along pretty nicely. I'll make a new RC release in a few days. After that probably one more and then v1.1.0. Tomorrow begins a 5 week lab course at school. Every day and about 8 hours a day. And then we'll also have to write these reports about what we have done and how/why, which takes quite a lot of time as well. After 5 weeks there's one free week and then probably another 2 week lab course if I get selected there. So I doubt I can get much Dovecot work done for the next two months. It's also likely that I won't be answering mails much in this list either.

2 3

[Dovecot] Allow_nets + MySQL failing when using range notation
by Javier García 15 May '08

15 May '08

Hello all, I am testing my dovecot installation in order to restrict access via POP3 for IPs outside my network. I have read and understood the instructions in the wiki and I have reached a configuration that works ONLY when single IPs are listed in allow_nets but not when ranges in the notation x.x.x.x/y are listed. Some examples should be more explanatory. I am using 1.0.rc15 patched as for last week as distributed in Debian etch. First of all, everything related to this is stored in a MySQL database, here is my password query: password_query = SELECT u.password as password, t.allow_nets as allow_nets FROM users u, access_type t WHERE u.ID_access_type = t.ID_access and ( t.%Ls = 1 ) and u.mail = '%u' This one should validate all mail addresses when the protocol used is marked as 1 in table access_type and when the allow_nets value in this same table contains the IP used for the access request. The, if access_type looks like: ID_access pop3 imap allow_nets 3 0 1 10.34.128.0/23, 10.34.133.0/24, 192.168.0.0/24 users with ID_access=3 fail to login by either pop3 (normal, value is 0) or imap. Here is the corresponding excerpt from dovecot.log: dovecot: 2008-03-31 11:29:04 Info: auth-worker(default): sql(user(a)domain.com,10.34.133.104): query: SELECT u.password as password, t.allow_nets as allow_nets FROM users u, access_type t WHERE u.ID_access_type = t.ID_access and ( t.imap = 1 ) and u.mail = 'user(a)domain.com' dovecot: 2008-03-31 11:26:39 Info: auth-worker(default): auth(user(a)domain.com,10.34.133.104): allow_nets: Matching for network 192.168.0.0/24 dovecot: 2008-03-31 11:26:39 Info: auth-worker(default): auth(user(a)domain.com,10.34.133.104): allow_nets: Matching for network 10.34.128.0/23 dovecot: 2008-03-31 11:26:39 Info: auth-worker(default): auth(user(a)domain.com,10.34.133.104): allow_nets: Matching for network 10.34.133.0/23 dovecot: 2008-03-31 11:26:39 Info: auth-worker(default): passdb(user(a)domain.com,10.34.133.104): allow_nets check failed: IP not in allowed networks but if it looks like ID_access pop3 imap allow_nets 3 0 1 10.34.133.105, 10.34.133.104 then access is allowed by IMAP dovecot: 2008-03-31 11:34:01 Info: auth-worker(default): sql(user(a)domain.com,10.34.133.104): query: SELECT u.password as password, t.allow_nets as allow_nets FROM users u, access_type t WHERE u.ID_access_type = t.ID_access and ( t.imap = 1 ) and u.mail = 'user(a)domain.com' dovecot: 2008-03-31 11:34:01 Info: auth-worker(default): auth(user(a)domain.com,10.34.133.104): allow_nets: Matching for network 10.34.133.105 dovecot: 2008-03-31 11:34:01 Info: auth-worker(default): auth(user(a)domain.com,10.34.133.104): allow_nets: Matching for network 10.34.133.104 dovecot: 2008-03-31 11:34:01 Info: auth(default): client out: OK 1 user=user(a)domain.com while POP3 still disallowed as expected: dovecot: 2008-03-31 11:34:25 Info: auth-worker(default): sql(user(a)domain.com,10.34.133.104): query: SELECT u.password as password, t.allow_nets as allow_nets FROM users u, access_type t WHERE u.ID_access_type = t.ID_access and ( t.pop3 = 1 ) and u.mail = 'user(a)domain.com' dovecot: 2008-03-31 11:34:25 Info: auth-worker(default): sql(user(a)domain.com,10.34.133.104): unknown user So, is there a bug related to the IP class notation or am I doing something wrong? I have tried to leave a single class (10.34.133.0/24), to explicitly erase any spaces after the commas, but nothing of these worked. Also, note that using 0.0.0.0/0 behaves as expected, this is, access for any IP is allowed. Thanks in advance, Javier

3 8

[Dovecot] imap memory footprint rather large
by martin f krafft 12 May '08

12 May '08

Dear list, I am experimenting with a new mail handling setup and it involves a single IMAP folder with just under 70'000 messages. When OfflineIMAP connects to the server, the imap process starts to eat up a lot of memory: PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 15607 madduck 35 19 283m 244m 239m D 16.9 49.3 0:09.96 imap On the contrary, when "online" client, such as Thunderbird connect, memory usage is around 10m, which is entirely acceptable. The way offlineimap reads may is by FETCHing metadata, then APPENDing new local mail, SEARCHing for the UIDs of each uploaded mail, and finally FETCHing new remote mail. Memory use seems to be O(n) in the size of the folder. On the folder with 70k messages, dovecot seems to allocate 280m of memory, which it then fills to about 70% during the metadata FETCH, and then keeps growing while APPEND/SEARCHing the new local messages. The 70k mailbox is just short of 600Mb in size on disk. Dovecot uses 280Mb to serve it. Is it possible that dovecot is reading too much into memory, or over-optimising? Can I somehow tweak this to lower the memory footprint? Cheers, -- martin; (greetings from the heart of the sun.) \____ echo mailto: !#^."<*>"|tr "<*> mailto:" net@madduck "the unexamined life is not worth living" -- platon spamtraps: madduck.bogus(a)madduck.net

2 9

[Dovecot] Another numptie question - making maildirs for shared mailboxes.
by Stroller 12 May '08

12 May '08

Hi there, Sorry to have so much trouble with my Dovecot setup & to ask so many questions, but I'm having some problems with shared folders. I've read the thread at <http://dovecot.org/pipermail/dovecot/2005-January/006079.html> and added the following lines to /etc/dovecot.conf: namespace private { separator = / prefix = inbox = yes } namespace public { separator = / prefix = General/ location = maildir:/tmp/dovecot-test/ inbox = no hidden = no } So I create a directory /tmp/dovecot-test/ and an empty file /tmp/dovecot-test/dovecot-shared with liberal (777 & 666 respectively) permissions and then try to subscribe to the "General" folder in Outlook - I get a "failed to subscribe to the folder. The server responded `the mailbox doesn't exist: General`" error message, but cur, new & tmp are created in /tmp/dovecot-test. These subfolders are owned by the user that attempted to subscribe & have 700 permissions; chmod'ing them 777 makes no difference. Since "default_mail_env = maildir:%h/.maildir" in dovecot.conf I make a directory /tmp/dovecot-test/.maildir also containing cur, new, tmp & dovecot-shared. When I select "IMAP folders" in Outlook I am still unable to subscribe to "General" but am now able to subscribe to "General/maildir". The subscribed folder is shown in Outlook underneath the users' Inbox as a sub-folder of general, screenshot at <http://linux.stroller.uk.eu.org/DovecotSharedFolders.png> - see how I can't subscribe to "General" alone, but it is "brought in" by subscribing to "General/maildir"? If I try to copy a test message into General then, after a delay of a minute or so, I get "Can't move the items - this IMAP command could not be sent to the server before the connect was terminated"; if I try to copy the test message into General/maildir then I immediately get "Can't copy the items. The server responded: `Internal error occurred. Refer to server log for more information [2005-12-20 12:05:40]". I've tried tinkering with other directory structures under /tmp/dovecot-test/ with no success - can anyone suggest what I'm doing wrong, please? It's quite important to me that the "General" folder is a fairly high-level one - only one additional folder icon should show up for the users' shared mail. At one point I managed to create a folder General/General, but that's undesirable - the users wouldn't understand the concept of having a folder showing in Outlook that they can't write to, or which is only used as a container for another folder. (In any case, I believe I was still unable to write to it). I was about to say, "I know I could resolve this with the use of a symlink-type shared folder, but that's undesirable because I'd have to manually add the symlink for each user that's added to the system", but writing this it occurs to me that I could resolve that by adding the symlink to the the etc/skel/. Nevertheless, I see the namespaces approach as more elegant, as it allows for different user groups having different shared folders. I'd appreciate any advice - I suspect I'm just getting the directory hierarchies wrong, or the syntax of dovecot.conf wrong AGAIN! If anyone with a working shared folders setup could provide a copy of the appropriate section of dovecot.conf & a listing of the appropriate directories then I'd be EXTREMELY grateful. Stroller.

7 12