June 2006 - dovecot - dovecot.org

[Dovecot] writing a plugin for LDA to chain Unix pipes
by martin f krafft 02 Jul '06

02 Jul '06

Hi, I've spent some part of the last week on trying to figure out whether dovecot LDA meets our requirements for a new mail server infrastructure (the IMAP and POP servers, as well as the SASL backend certainly do; thanks a lot!). The one thing that's holding me back is that we need per-user integration of SpamAssassin and some other, custom content filters, all of which are implemented as Unix pipe filters. My conclusion is that since dovecot LDA cannot yet integrate such filters in the delivery chain, but it supports plugins, that such a plugin must be written. Conceptually, it's very simple: a configuration file option specifying the Unix pipe, and a plugin that does the proper popen() (or whatever is to be used these days) call, checking for errors and doing the right thing. Unfortunately, I do not have much time at my hands -- basically it all boils down to Sunday evening and a little bit of Monday, and then it's got to be done. My C is rusty, but I do have a lot of experience with it, so I am confident... ... but what would really help is if someone who knows the internals of Dovecot would give me a starting point, or even some more information. How do I conceive to write such a plugin? I could not find the information online, and I'd rather not reverse engineer existing plugins, for that approach usually leads to ugly and hence unstable/insecure/unusable code. Any feedback is thus warmly appreciated! Also, if someone is online on IRC on Sunday and Monday and wouldn't mind if I asked a question now and then, please let me know. It goes without saying that I will happily submit my plugin (once its tested) to Dovecot upstream under the Artistic Licence, or if that doesn't work, another licence of your choosing. Thanks, -- martin; (greetings from the heart of the sun.) \____ echo mailto: !#^."<*>"|tr "<*> mailto:" net@madduck spamtraps: madduck.bogus(a)madduck.net "common sense is the collection of prejudices acquired by age eighteen." -- albert einstein

4 8

[Dovecot] 1.0.rc1 released
by Timo Sirainen 02 Jul '06

02 Jul '06

I think the code is now stable enough to be called the first release candidate. Please report any bugs, new and old. The filesystem quota numbers should be correct now? http://dovecot.org/releases/dovecot-1.0.rc1.tar.gz http://dovecot.org/releases/dovecot-1.0.rc1.tar.gz.sig * PAM: If user's password is expired, give "Password expired" error message to the user. Now actually working thanks to Vaidas Pilkauskas * Relicensed dovecot-auth, lib-sql and lib-ntlm to MIT license. See COPYING file for more information. * Abuse prevention: When creating a mailbox, limit the number of hierarchies (up to 20) and the length of the mailbox name within a hierarchy (up to 200 characters). * mbox: If saved mail doesn't end with LF, add it ourself so that the mails always have one empty line before the next From-line. + Added --with-statedir configure option which defaults to $localstatedir/lib/dovecot. ssl-parameters.dat is permanently stored in that directory and is copied to login_dirs from there. + IMAP: Support SASL-IR extension (SASL initial response) + Support initial SASL response with LOGIN mechanism. Patch by Anders Karlsson + Added PLAIN-MD4 password scheme. Patch by Andrey Panin. + Added support for XFS disk quotas. Patch by Pawel Jarosz + If another process deletes the opened mailbox, try to handle it without writing errors to log file. Handles the most common cases. + Added TLS support for LDAP if the library supports it. - SEARCH command was more or less broken with OR and NOT conditions - Dovecot corrupted mbox files which had CR+LF linefeeds in headers - MySQL code could have crashed while escaping strings - MD4 code with NTLM authentication was broken with 64bit systems. Patch by Andrey Panin - Plugin loading was broken in some OSes (eg. FreeBSD) - Several fixes to handling empty values in configuration file - Several fixes to dictionary quota backend and dict server. Also changed how they're configured. - deliver: Fixed plugin handling settings - mbox_min_index_size handling was somewhat broken - passdb passwd-file: extra_args field wasn't read unless the file was also used as userdb.

5 7

[Dovecot] Secure connection from "localhost" in jails
by Dirk Engling 02 Jul '06

02 Jul '06

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Dear dovecot developers, first: thanks for this really cool imapd, on my server it serves some hundred domains, all in all some thousand users, some having hundred thousand mails in their Maildirs (their spam boxes mostly). Since I put this installation in an FreeBSD geli encrypted disc image I had no choice but to choose an imapd with clever indexes - dovecot was perfect. However, since I reconfigured the disc image to work as a FreeBSD jail, I had some trouble with my web mail solution. Squirrelmail does not work with imaps (or at least not smoothly, out of the box, or whatever) and I didn't like to hack php to support SSL. Plus: there is no point in using ssl for a local connection. In a FreeBSD jail a sockets source address is always rewritten to the jails address, so squirrelmail opening a connection to dovecot will not come from 127.0.0.1 but from the same (jails) address, dovecot listens to. Still, dovecot only considers 'localhost' addresses as secure and allows LOGIN or PLAIN auth. With the little patch below dovecot allows clients from the jail to authenticate via LOGIN, when they connect from the IP it accepts connections at. Something similar is lurking around in pop3 auth code, I am sure, you get the point. Regards erdgeist ======== 8< ======== 8< ======== 8< ======== 8< ======== 8< ======== 8< dovecot-1.0.rc1/src/imap-login 18:59:44 #> diff -u client.c* - --- client.c Thu Jun 29 18:59:39 2006 +++ client.c_new Thu Jun 29 18:59:19 2006 @@ -411,7 +411,7 @@ const struct ip_addr *ip) { struct imap_client *client; - - const char *addr; + const char *addr, *local_addr; if (max_logging_users > CLIENT_DESTROY_OLDEST_COUNT && hash_size(clients) >= max_logging_users) { @@ -429,8 +429,10 @@ client->common.tls = ssl; addr = net_ip2addr(ip); + local_addr = net_ip2addr(local_ip); client->common.secured = ssl || (IPADDR_IS_V4(ip) && strncmp(addr, "127.", 4) == 0) || + (IPADDR_IS_V4(ip) && strncmp(addr, local_addr, strlen(local_addr)) == 0) || (IPADDR_IS_V6(ip) && (strcmp(addr, "::1") == 0 || strncmp(addr, "::ffff:127.", 11) == 0)); -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (Darwin) iD8DBQFEpAu4ImmQdUyYEgkRAnC8AJ9W3L5XwjdTuLvGfUwmIjEfyq8sAQCdErPc v6JW46e9dfYBsKzAWprg2zw= =/IWt -----END PGP SIGNATURE-----

3 4

[Dovecot] Re: 1.0 RC1 status
by Ramunas 01 Jul '06

01 Jul '06

>If you think there's still something I should have replied to, please >re-send it because I've either missed it or just skipped it for some >reason.(Except there are still a couple of mails from this week I've >yet to reply to.) Timo look at this message - http://www.dovecot.org/list/dovecot/2006-June/013958.html. I compiled dovecot-latest (dovecot-20060618.tar.gz , configured --with-ioloop=poll), but same problem: Jun 19 07:43:25 srv1 dovecot: Dovecot v1.0.beta9 starting up Jun 19 07:43:26 srv1 dovecot: auth(default): pgsql: Connected to hosting Jun 19 07:44:09 srv1 dovecot: pop3-login: Login: user=<ramas>, method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 07:44:09 srv1 dovecot: POP3(ramas): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Jun 19 19:18:21 srv1 dovecot: auth(default): sql(ramas,192.168.0.3): Password query failed: Jun 19 19:18:21 srv1 dovecot: auth(default): invalid I/O fd 8, callback 0x8065170 Jun 19 19:19:21 srv1 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS gdb /usr/libexec/dovecot/dovecot-auth 30056 GNU gdb Red Hat Linux (6.3.0.0-1.122rh) 0xffffe410 in __kernel_vsyscall () (gdb) x 0x8065170 0x8065170 <get_result>: 0x83e58955 (gdb) bt #0 0xffffe410 in __kernel_vsyscall () #1 0xb7debe3e in __lll_mutex_lock_wait () from /lib/libc.so.6 #2 0xb7d6b94c in _L_lock_100 () from /lib/libc.so.6 #3 0xb7d6b8ea in fflush () from /lib/libc.so.6 #4 0xb7e5a973 in pqFlush () from /usr/lib/libpq.so.3 #5 0xb7e57cb0 in PQconsumeInput () from /usr/lib/libpq.so.3 #6 0x0806518c in get_result () #7 0x0806abe8 in io_loop_handler_run () #8 0x0806a28c in io_loop_run () #9 0x08058da5 in main () Also tryed compile with epoll, got this error: Jun 19 06:55:23 srv1 dovecot: auth(default): sql(ramas,192.168.0.3): Password query failed: Jun 19 06:55:23 srv1 dovecot: pop3-login: Disconnected: user=<ramas>, method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 06:55:26 srv1 dovecot: auth(default): io_loop_handle_add: epoll_ctl(3, 9): No such file or directory Jun 19 06:55:26 srv1 dovecot: pop3-login: Disconnected: method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 06:55:26 srv1 dovecot: child 11758 (auth) returned error 89 Jun 19 06:55:27 srv1 dovecot: auth(default): pgsql: Connected to hosting Jun 19 06:55:27 srv1 dovecot: pop3-login: Login: user=<ramas>, method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 06:55:27 srv1 dovecot: POP3(ramas): Disconnected: Logged out top=0/0, retr=2/3429, del=2/2, size=3395 Users passwords stored on PostgreSQL (7.4.11) another server. Machine - Linux, kernel 2.6.16.20 Thank you. Ramunas

2 2

[Dovecot] Just one user experiencing server timeouts
by Fran Fabrizio 01 Jul '06

01 Jul '06

[dovecot-1.0-0.beta2.7 on Fedora Core 5, maildir formatted mail directories, various clients: thunderbird 1.5.0.4 from FC4 and WinXP, SquirrelMail 1.4.6-5.fc5 RPM, various recent versions of Pine from various Fedoras and Redhat 9] I have just one mail user who experiences server timeouts when trying to delete a message (move it to Trash) or other common operations. This user has 4.1GB of mail spread over 200+ Maildir-formatted folders, so I immediately expected sheer volume as the problem - this user has by far the most mail. This user experiences the problem from multiple Thunderbird installs, from SquirrelMail, and from Pine. However, I created a new user account using our standard account creation processes, and did a direct copy of olduser's Maildir to newuser's homedir. Then I did a chown -R newuser ~newuser/Maildir, set up an account in Thunderbird for newuser's account, and tried for an hour to get a server timeout doing all the same operations that cause the timeout on olduser's account, with no timeouts. I absolutely cannot duplicate the behavior, but when I watch olduser do this from any of the above named clients, I see the timeouts on about 10% of the operations. I've been looking into this off and on for weeks, but I am baffled. I can't think of what is so specific about this one user's account that is causing the trip up. Both home directories are stored on the same filesystem and as I mentioned I made an exact duplicate of Maildir. I'm completely out of ideas, does anyone have any thoughts? Does Dovecot do any data tracking on a per user basis that could be confusing it, some cache I can clear? Dovecot has been restarted numerous times since the trouble started. -- Fran Fabrizio Senior Systems Analyst Department of Computer and Information Sciences University of Alabama at Birmingham http://www.cis.uab.edu/ 205.934.0653

2 1

[Dovecot] Problems with Sent folder
by james edwards 01 Jul '06

01 Jul '06

We are using dovecot-0.99.13-3.FC3; the users use IMAP. I have had several of these today where the user cannot write to their Sent folder on the server. The users do own everything in their home dir: [root@jidmail lcrdjav]# file Sent Sent: ISO-8859 HTML document text What is up with the HTML, I am not used to seeing this in any of the IMAP folders ? -- James H. Edwards Network Systems Administrator Judicial Information Division jedwards(a)nmcourts.com

2 1

[Dovecot] patch to make sieved compile & work
by Steffen Kaiser 01 Jul '06

01 Jul '06

Hello, attached you'll find a patch to make the Sieve decompiler located in dovecot-sieve/src/libsieve compile & work. To compile sieved I've extracted the two commands from the make process for sievec, see the attached sieved.compile.sh. Bye, -- Steffen Kaiser

2 1

[Dovecot] rc1 & password debug
by Thomas Hummel 01 Jul '06

01 Jul '06

Hello Timo, I just launched rc1 with auth_verbose = yes auth_debug = yes #auth_debug_passwords = no and on a wrong password, I see my crypted passwd in the log : userPassword(password)={Crypt}xxxxxxxx Is that normal, since I assume that auth_debug_passwords defaults to no ? -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 1

[Dovecot] Improving interaction/performance with Mail.app?
by Alan Schmitt 01 Jul '06

01 Jul '06

Hello, I'm using dovecot as my IMAP server just for me, and I access it from three machines, all using Apple Mail.app. Unfortunately the performance is really bad, especially when deleting or copying a lot of messages. I know this is the fault of Mail.app, whose IMAP support leaves a lot to desire, but I was wondering if there could be some dovecot configuration tricks that make the interaction smoother. Thanks a lot, Alan -- Alan Schmitt <http://alan.petitepomme.net/> The hacker: someone who figured things out and made something cool happen. .O. ..O OOO

4 8

[Dovecot] file_wait_lock with dovecot 0.99.14-1sarge
by Jorge Salamero Sanz 01 Jul '06

01 Jul '06

hi all, i've just installed dovecot from debian sarge and i get this error: Jun 28 16:31:50 server pop3(user): file_wait_lock() failed with custom flags file /mnt/nfs/users/user//mail/.customflags: No locks available (maildir in nfs) how seriously i should take it ? is it fixed in newer versions ? thanks !

2 1