- dovecot - dovecot.org

[Dovecot] LDAP and (py|cmu)sieve
by Thibault VINCENT 09 Aug '07

09 Aug '07

Hello, Before asking help, i would like thank Timo for this awesome server, it's lite, fast, and has good features. I've read the Wiki, tutorials, and tried various configurations to get the result I expect. My company is running a dovecot 1.0.0 server set up with an LDAP directory, mails are delivered to /var/spool/imap and users do not have a real unix home directory on this system. During my internship, I've installed a sieve server (pysieved) that is working with dovecot. But I encountered a problem with the LDAP setup. Pysieved is using dovecot's auth and client sockets to authenticate the user and get it's home directory where it will store sieve scripts, this home directory is also actually used by cmusieve. With our setup, users do not have /home directories on the mail server but the homeDirectory LDAP attribute is used by other services and cannot be modified for dovecot. I know we have the option to create a new attribute, set it to something like /var/spool/imap/<user> for every mail users, and use this new attribute name in dovecot-ldap.conf with the user_db statement. This is actually working on a test environnement, but we wish we could do it without any modification on the LDAP directory. The very precise question is : How can I tell dovecot to compute the « home » path from the login name when using LDAP userdb ? By example, if a user has login name "jdoe", dovecot will authenticate him against the LDAP directory but won't get the home path from it. Instead, it will use the same mail_location path (if possible) or something similar, like /var/spool/imap/%1u/%u . Can I do this without any modification of the source code of both dovecot and pysieved ? Thank you, -- Thibault VINCENT tibal(a)reloaded.fr thibault.vincent(a)reloaded.fr PGP Key : 0x4BA8A39B

2 1

[Dovecot] HP-UX troubles
by Matthias Luehr 09 Aug '07

09 Aug '07

Hi there, I got dovecot compiled and running on HP-UX 11.23. It's using LDAPUX and PAM for authentication. So far, it works. But after logging in the connection is closed immediately. It looks like this: telnet <ip> 143 Connected to ... Escape character is '^]'. * OK Dovecot ready. a01 login <user> <pass> Connection closed by foreign host. The dovecot log says: Error: imap-login: fd_send(7) failed: Bad file number Error: child 22629 (login) returned error 89 As far as I can see, the problem seems to reside in dovecot's fdpass.c... dovecot version: 1.0.3 gcc version: 2.9 Any ideas or solutions? Thanks in advance, Matthias

2 3

[Dovecot] UIDL match from 0.99.13 to 1.0-1.2
by Daniel Davidson 09 Aug '07

09 Aug '07

I am moving from and old FC2 system to a new RHEL5 system and am having trouble getting the UIDLs to move over right, mainly the UID. I copy over the mailbox, and see the x-uid in the message is what it was on the old server, but when I telnet in to check pop, it rewrites x-uid in the message to something new, causing old messages to get downloaded again, which is not what we want I have tried setting pop3_reuse_xuidl to yes, but that did not change anything, probably because that is the wrong header (I do not have x-uidl, but I do have x-uid). I do have pop3_uidl_format set to %v.%u for compatibility. On the old system the first five are: +OK Logged in. uidl +OK 1 1095087961.3092736 2 1095087961.3092737 3 1095087961.3092738 4 1095087961.3092739 5 1095087961.3092740 On the new system the first five are: +OK Logged in. uidl +OK 1 1095087961.3093018 2 1095087961.3093155 3 1095087961.3093156 4 1095087961.3093157 5 1095087961.3093158 Any help would be appreciated, I do not understand how it is generating the UID portion. Dan

2 6

[Dovecot] Userdb and home directories
by Mike Brudenell 09 Aug '07

09 Aug '07

Greetings - I've just discovered an oddity I didn't know I had... We have two NetApp filers: one serves people's home directories; the other their message store and control files filestores. At the moment the first of the two filers is not accessible to my Dovecot system and I assumed all would be well because, as far as I knew, I wasn't using it at all. However in practice Dovecot DOES appear to be using it: it is trying to chdir() to my home directory when I login, finds it can't at the moment (because of a problem giving "Permission denied"), and closes the connection. I've read the pages on home directories and the userdb on the Wiki and it advises that having a home directory is beneficial. I'm happy to create a subdirectory for this within a user's control files directory, but do NOT want it on our normal filestore: we can't have mail inaccessible because a user's home directory is inaccessible because the other filer is out of action. We use shadow for the passdb and passwd for the userdb (see dovecot - n output below). I'm trying to work out how to override the home directory returned from NIS. Ultimately I'd like to use this template: /mailstore/control/%1Ln/%Ln/home but for the time being while I'm trying to work out how to do it have my own area hard-coded in (as it's only me logging in to the test system): /mailstore/control/p/pmb1/home I'm specifying this with the "args" directive in the userdb section as follows: args = home=/mailstore/control/p/pmb1/home but it isn't being picked up. What am I doing wrong, please? (We want to continue using uids and gids etc from NIS so I don't think using the static userdb is the right thing to do?) Cheers, Mike B-) Output of dovecot -n -------------------- # 1.0.3: /usr/local/dovecot-1.0.3/etc/dovecot.conf log_path: /logfiles/mail/live/dovecot info_log_path: /logfiles/mail/live/dovecot-info disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/dovecot-1.0.3/libexec/dovecot/imap-login login_log_format_elements: user=<%Lu> method=%m rip=%r lip=%l %c login_process_per_connection: no login_greeting_capability: yes login_process_size: 64 login_processes_count: 10 max_mail_processes: 10000 mail_location: maildir:/mailstore/messages/%1Ln/%Ln/Maildir:INDEX=/ mailstore/index/%1Ln/%Ln:CONTROL=/mailstore/control/%1Ln/%Ln maildir_copy_with_hardlinks: yes mail_plugins: quota imap_quota mail_log_prefix: [%p]%Us(%Lu): imap_client_workarounds: delay-newmail outlook-idle namespace: type: private separator: / inbox: yes auth default: mechanisms: plain login cache_size: 1024 cache_ttl: 600 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890 username_format: %Ln passdb: driver: shadow userdb: driver: passwd args: home=/mailstore/control/p/pmb1/home plugin: quota: fs -- The Computing Service, University of York, Heslington, York Yo10 5DD, UK Tel:+44-1904-433811 FAX:+44-1904-433740 * Unsolicited commercial e-mail is NOT welcome at this e-mail address. *

3 4

[Dovecot] Mails causing imap process to hang.
by Tan Shao Yi 09 Aug '07

09 Aug '07

Hi Timo, We are getting e-mails from a certain domain that seem to cause the IMAP process to hang. Here's how it looks like if we issued a FETCH 40 FULL: * 40 FETCH (FLAGS (\Seen) INTERNALDATE "09-Aug-2007 11:50:44 +0800" RFC822.SIZE 803392 ENVELOPE ("Thu, 09 Aug 2007 11:09:09 +0800 (CST)" {64} 8¤ë¸¹Âø»x¤C¤Ñ¤W¬[79§é !! SmartÀ°±zÄY¿ï¥|¤j°Ï°ì20ÀÉ³Ì·í¼ö°òª÷±ÀÂË (("=?Big5?B?s9WryKjTpKSk5cL4u3ikS6TruLk=?=" NIL "mailsender" "books.com.tw")) (("=?Big5?B?s9WryKjTpKSk5cL4u3ikS6TruLk=?=" NIL "mailsender" "books.com.tw")) (("=?Big5?B?s9WryKjTuvS49K7RqbE=?=" NIL "mailsender" "books.com.tw")) NIL NIL NIL NIL "<20070809035039.JDYJ10720.mta2.pacific.net.sg(a)mx3.pacific.net.sg>") BODY ("text" "html" ("charset" "Big5") NIL NIL "base64" 801726 10279)) A truss of the process reveals: write(1, " * 4 0 F E T C H (".., 36) = 36 sendfilev64(1, 1, 0xFFBFF2C0, 1, 0xFFBFF2B4) = 65536 close(10) = 0 close(8) = 0 open64("/var/qmail/maildirs/09/44/XXXXXX/Maildir/maildirsize", O_RDWR|O_APPEND) = 8 read(8, " 1 0 4 8 5 7 6 0 S\n 6 4".., 5120) = 1188 read(8, 0xFFBFE3FC, 3932) = 0 write(1, " )\r\n 0 0 0 0 0 0 1 0 ".., 33) = 33 pollsys(0x000B0378, 3, 0xFFBFF888, 0x00000000) = 1 read(0, " 0 0 0 0 0 0 1 1 F E T".., 2769) = 42 close(8) = 0 open64("/var/qmail/maildirs/09/44/XXXXXX/Maildir/maildirsize", O_RDWR|O_APPEND) = 8 read(8, " 1 0 4 8 5 7 6 0 S\n 6 4".., 5120) = 1188 read(8, 0xFFBFE4FC, 3932) = 0 open64("/var/qmail/maildirs/09/44/XXXXXX/Maildir/cur/1186631443.M495843P21207V000000940000BF68I000000000030AFC0_0.recess4,S=803364:2,S", O_RDONLY) = 10 fstat64(10, 0xFFBFF2A0) = 0 pread64(10, " A g I C A 8 d G Q g Y 2".., 4096, 58982) = 4096 pread64(10, " R p b m c 9 I j A i P g".., 4096, 63078) = 4096 pread64(10, " O V 8 w M D F f M D M y".., 4096, 67174) = 4096 pread64(10, " Z W M v Y X M v M j A w".., 4096, 71270) = 4096 pread64(10, " 4 K I C A g I C A g I C".., 4096, 75366) = 4096 pread64(10, " A g I C A g I C A g I C".., 4096, 79462) = 4096 pread64(10, " I C A g I C A 8 L 3 R y".., 4096, 83558) = 4096 pread64(10, " c y 5 j b 2 0 u d H c v".., 4096, 87654) = 4096 pread64(10, " A g I C A g I C A g I C".., 4096, 91750) = 4096 pread64(10, " A 4 N j A i P j x p b W".., 4096, 95846) = 4096 pread64(10, " I C A 8 d G Q + I A o g".., 4096, 99942) = 4096 pread64(10, " U j A z L z k v U j A z".., 4096, 104038) = 4096 pread64(10, " A g P H R k I G N v b H".., 4096, 108134) = 4096 pread64(10, " R k P g o g I C A g\r\n".., 4096, 112230) = 4096 pread64(10, " I C A g I C A g I D x 0".., 4096, 116326) = 4096 pread64(10, " e m l u Z S 9 t\r\n Y W".., 4096, 120422) = 4096 pread64(10, " J 0 Z X h 0 I j 6 q s a".., 4096, 124518) = 4096 fstat64(10, 0x000D6610) = 0 write(1, " * 4 0 F E T C H (".., 38) = 38 sendfilev64(1, 1, 0xFFBFF2C0, 1, 0xFFBFF2B4) = 131072 close(10) = 0 close(8) = 0 open64("/var/qmail/maildirs/09/44/XXXXXX/Maildir/maildirsize", O_RDWR|O_APPEND) = 8 read(8, " 1 0 4 8 5 7 6 0 S\n 6 4".., 5120) = 1188 read(8, 0xFFBFE3FC, 3932) = 0 write(1, " )\r\n 0 0 0 0 0 0 1 1 ".., 33) Err#11 EAGAIN pollsys(0x000B0378, 4, 0xFFBFF888, 0x00000000) = 1 write(1, " )\r\n 0 0 0 0 0 0 1 1 ".., 33) = 33 pollsys(0x000B0378, 3, 0xFFBFF888, 0x00000000) = 1 read(0, " 0 0 0 0 0 0 1 2 F E T".., 2727) = 42 close(8) = 0 open64("/var/qmail/maildirs/09/44/XXXXXX/Maildir/maildirsize", O_RDWR|O_APPEND) = 8 read(8, " 1 0 4 8 5 7 6 0 S\n 6 4".., 5120) = 1188 read(8, 0xFFBFE4FC, 3932) = 0 open64("/var/qmail/maildirs/09/44/XXXXXX/Maildir/cur/1186631443.M495843P21207V000000940000BF68I000000000030AFC0_0.recess4,S=803364:2,S", O_RDONLY) = 10 fstat64(10, 0xFFBFF2A0) = 0 pread64(10, " J 0 Z X h 0 I j 6 q s a".., 4096, 124518) = 4096 pread64(10, " c v Z X h l\r\n Y y 9 h".., 4096, 128614) = 4096 pread64(10, " I C A g I C A g I C A g".., 4096, 132710) = 4096 pread64(10, " I C A g\r\n I C A g C i".., 4096, 136806) = 4096 pread64(10, " A g I C A g I C A g I C".., 4096, 140902) = 4096 pread64(10, " w v\r\n d H I + C i A g".., 4096, 144998) = 4096 pread64(10, " Z H R o P S I 4 M S I g".., 4096, 149094) = 4096 pread64(10, "\r\n b 2 x z c G F u P S".., 4096, 153190) = 4096 pread64(10, " T r u L k v M j A w N y".., 4096, 157286) = 4096 pread64(10, " c j 4 K I C A g I C A g".., 4096, 161382) = 4096 pread64(10, " I C A g P H R k I G N v".., 4096, 165478) = 4096 pread64(10, " E g a H J l Z j 0 i a H".., 4096, 169574) = 4096 pread64(10, " A g I C A g I C A 8 d H".., 4096, 173670) = 4096 pread64(10, " I i B o Z W l n a H Q 9".., 4096, 177766) = 4096 pread64(10, " I D x 0 Z C B j b 2 x z".., 4096, 181862) = 4096 pread64(10, " M u Z 2 l m I i B 3 a W".., 4096, 185958) = 4096 pread64(10, " l 3 u / m h R z x z P j".., 4096, 190054) = 4096 pread64(10, " I C A g I C A 8 L 3 R y".., 4096, 194150) = 4096 pread64(10, " Y 2 9 t L n R 3 L 0 c v".., 4096, 198246) = 4096 pread64(10, " R k P g o g I C A g I C".., 4096, 202342) = 4096 pread64(10, " A g P H R y P i A K I C".., 4096, 206438) = 4096 pread64(10, " I C A g I C A g I C A g".., 4096, 210534) = 4096 pread64(10, " Z W 0 9 U j A z M D A w".., 4096, 214630) = 4096 pread64(10, " M v Y X M v M j A w N z".., 4096, 218726) = 4096 pread64(10, " A g I C A g I C A g P H".., 4096, 222822) = 4096 pread64(10, " P H R k I G N v b H N w".., 4096, 226918) = 4096 pread64(10, " I C A g I C A g I C A g".., 4096, 231014) = 4096 pread64(10, " I + C i A g I C A g I C".., 4096, 235110) = 4096 pread64(10, " A g I C A g I C A g I C".., 4096, 239206) = 4096 pread64(10, " I D x 0 Z D 4 8 L 3 R k".., 4096, 243302) = 4096 pread64(10, " I C A g I C A g I D x 0".., 4096, 247398) = 4096 pread64(10, " A g I C A g I C A g I C".., 4096, 251494) = 4096 pread64(10, " R 0 c D o v L 2 F k Z G".., 4096, 255590) = 4096 fstat64(10, 0x000CB208) = 0 write(1, " * 4 0 F E T C H (".., 38) = 38 sendfilev64(1, 1, 0xFFBFF2C0, 1, 0xFFBFF2B4) Err#11 EAGAIN fstat64(10, 0x000CB208) = 0 sendfilev64(1, 1, 0xFFBFF4A0, 1, 0xFFBFF494) Err#11 EAGAIN pollsys(0x000B0378, 4, 0xFFBFF888, 0x00000000) = 1 fstat64(10, 0x000CB208) = 0 sendfilev64(1, 1, 0xFFBFF4A0, 1, 0xFFBFF494) Err#11 EAGAIN pollsys(0x000B0378, 4, 0xFFBFF888, 0x00000000) = 1 fstat64(10, 0x000CB208) = 0 sendfilev64(1, 1, 0xFFBFF4A0, 1, 0xFFBFF494) Err#11 EAGAIN pollsys(0x000B0378, 4, 0xFFBFF888, 0x00000000) = 1 fstat64(10, 0x000CB208) = 0 sendfilev64(1, 1, 0xFFBFF4A0, 1, 0xFFBFF494) Err#11 EAGAIN pollsys(0x000B0378, 4, 0xFFBFF888, 0x00000000) = 1 fstat64(10, 0x000CB208) = 0 sendfilev64(1, 1, 0xFFBFF4A0, 1, 0xFFBFF494) Err#11 EAGAIN This goes on and on... consuming all bandwidth on the system. Is there something wrong with this particular e-mail? I will be attaching it in a separate e-mail to you to protect the user's privacy. Thanking in advance. Cheers, Tan Shao Yi

2 3

[Dovecot] courier-dovecot-migrate.pl destroyed my indices... still recovering...
by Ralf Hildebrandt 09 Aug '07

09 Aug '07

I tried to disable courier-pop3 today in favour of dovecot pop3. Prior to that I ran: find /home -maxdepth 1 -type d | xargs --replace /usr/local/scripts/courier-dovecot-migrate.pl --overwrite --recursive --convert {} ( /home is hashed two levels deep: /home/a/a/aanton/Maildir/ ) After that, I got lots of errors like: Aug 9 13:02:40 postamt dovecot: IMAP(azenclu): Maildir /home/a/z/azenclu/Maildir sync: UIDVALIDITY changed (1167827929 -> 1058881980) Aug 9 13:03:46 postamt dovecot: POP3(bbuhse): Couldn't init INBOX: BUG: Unknown internal error Aug 9 13:03:46 postamt dovecot: POP3(bbuhse): Mailbox init failed top=0/0, retr=0/0, del=0/0, size=0 Aug 9 13:04:14 postamt dovecot: IMAP(bkusma): Maildir /home/b/k/bkusma/Maildir sync: UIDVALIDITY changed (1179153053 -> 1174292827) Aug 9 13:04:19 postamt dovecot: IMAP(am02): Corrupted index cache file /home/a/m/am02/Maildir/dovecot.index.cache: indexid changed Aug 9 13:04:28 postamt deliver(avolz): Corrupted index cache file /home/a/v/avolz/Maildir/dovecot.index.cache: indexid changed Aug 9 13:04:51 postamt dovecot: IMAP(ck05): Maildir /home/c/k/ck05/Maildir sync: UIDVALIDITY changed (1167893115 -> 1094733247) Aug 9 13:05:11 postamt deliver(agundlfi): Corrupted index cache file /home/a/g/agundlfi/Maildir/dovecot.index.cache: indexid changed Aug 9 13:05:50 postamt dovecot: IMAP(asorigue): Corrupted index cache file /home/a/s/asorigue/Maildir/dovecot.index.cache: indexid changed Aug 9 13:06:04 postamt dovecot: IMAP(azenclu): Corrupted index cache file /home/a/z/azenclu/Maildir/dovecot.index.cache: indexid changed Aug 9 13:06:08 postamt dovecot: IMAP(coneck): Maildir /home/c/o/coneck/Maildir sync: UIDVALIDITY changed (1164189070 -> 1058892719) Dovecot would recover from that (deliver would deliver the mail on the next queue run) -- but why is that? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de This message represents the official view of the voices in my head

2 4

[Dovecot] dovecot-sieve vacation changes
by pod 09 Aug '07

09 Aug '07

I'd like to put forward the following patch for dovecot-sieve. Essentially this just merges in some changes made in CMU sieve 2.3.8 and as such brings the behaviour more in line with RFC 3834 "Recommendations for Automatic Responses to Electronic Mail": - fixes erroneous sender "-request" substring match - checks for existence of a selection of list-* headers - expands "named-as-recipient" header checks to "Resent-To", "Resent-CC" and "Resent-BCC" fields. Note that the appended patch also includes a fix for some missing parentheses in the "resent-to" test which resulted in some extra work being done but was otherwise harmless. The fix has been sent to <cyrus-bugs+(a)andrew.cmu.edu> - prefixes subject in response with "Auto: " rather than (non-expanding) "Re: " I also, mostly for kicks, attach two sieve-like scripts that attempt to encapsulate the when-not-to-respond logic as implemented (if the patch were to be applied) and as advised by RFC 3834 respectively. I wrote these as an exercise to help me gain a better understanding of sieve and the CMU implementation. I'm not sure they are otherwise useful.

3 3

[Dovecot] NFS rquota support
by Timo Sirainen 09 Aug '07

09 Aug '07

For v1.1, probably applies to v1.0 code pretty easily too: http://hg.dovecot.org/dovecot/rev/078d9dde99c8 The other rquota patches had authunix_create_default() call. Is this needed/useful? The client is now always created+destroyed for each quota lookup. I'd think it would be faster if it was created only once, but does it then break something? If the above isn't done, clnt_create() could be replaced with clntudp_create() and have the struct sockaddr_in cached. Patches welcome. :)

7 25

[Dovecot] Shared folder hierarchies, multiple groups
by Benjamin R. Haskell 09 Aug '07

09 Aug '07

Hi, I'm trying to set up two shared folder hierarchies on my Dovecot installation for two groups of employees, all of whom should only have access to their own hierarchy. Any employee should be able to create sub-folders and generally have full access to the hierarchy. My initial setup was to create two public namespaces, Shared-One and Shared-Two. Each is a Maildir under /var/mail. The actual shared folders seem to be working fine in terms of adding and accessing folders and messages, and there are no problems at all for the 'admin' user, who belongs to both the shared1 and shared2 Unix groups. The problem is for other users, where trying to (IMAP-) LIST folders fails. (sanitized) IMAP session log: ('user2' is in group shared2) * OK Dovecot ready. A LOGIN user2 pass A OK Logged in. B LIST "" "%" * LIST (\Noselect \HasChildren) "/" "Shared-One" B NO Internal error occurred. Refer to server log for more information. [2007-08-02 09:01:23] In the mail logs I find: dovecot: IMAP(user2): stat(/var/mail/Shared-One/cur) failed: Permission denied Relevant permissions: 2770/drwxrws--- shared1 shared1 /var/mail/Shared-One 2770/drwxrws--- shared1 shared1 /var/mail/Shared-One/cur 0660/-rw-rw---- shared1 shared1 /var/mail/Shared-One/dovecot-shared And similarly for Shared-Two. (replace shared1 with shared2 everywhere) Among other things, I've read: http://wiki.dovecot.org/SharedMailboxes http://wiki.dovecot.org/ACL http://wiki.dovecot.org/MainConfig http://wiki.dovecot.org/Namespaces I don't want to use vfile ACL's (I think) because I want users to be able to create subfolders at will, and I don't want to have to add a dovecot-acl file per-folder. (Is there a way to set global defaults on a global basis? [not per-folder]) I also think there would be a problem with the hierarchies being similar. (e.g. both have a 'Projects' sub-folder, but there's a pretty clear WARNING on the wiki about mailbox name conflicts.) I can't use symlinked Maildirs, because new subfolders get created under ~user/Maildir/. (Want them under /var/mail/Shared-X/) I can't use hidden namespaces, because employees use Outlook (uggh), and I couldn't figure out how to "find" the namespace when it was hidden. (That seemed like the closest thing to a solution - it solved the LIST problem.) Ideally, Shared-Two wouldn't even be visible to members of Shared-One, and vice versa. But, that's at least an acceptable "problem" I could live with. Any suggestions? Thanks, Ben

2 1

[Dovecot] Bug in Exim->Dovecot auth
by Chris Laif 09 Aug '07

09 Aug '07

Hi. I'm using SMTP auth with Exim authenticating against Dovecot's auth socket. My (excellent) SMTP test tool "swaks" (http://jetmore.org/john/code/#swaks) tries multiple auth mechanismus consecutively which leads to the following message in Dovecot's log file: Error: auth(default): BUG: Authentication client gave a PID 6738 of existing connection I'm not sure where to report this bug, exim's or dovecot's mailing list, so I'll try here first :) Chris <- 250-AUTH PLAIN LOGIN <- 250 HELP -> AUTH PLAIN AHh5egBra2s= <** 535 Incorrect authentication data -> AUTH LOGIN <** 435 Unable to authenticate at present *** No authentication type succeeded -> QUIT

2 2