- dovecot - dovecot.org

[Dovecot] writing a plugin for LDA to chain Unix pipes
by martin f krafft 02 Jul '06

02 Jul '06

Hi, I've spent some part of the last week on trying to figure out whether dovecot LDA meets our requirements for a new mail server infrastructure (the IMAP and POP servers, as well as the SASL backend certainly do; thanks a lot!). The one thing that's holding me back is that we need per-user integration of SpamAssassin and some other, custom content filters, all of which are implemented as Unix pipe filters. My conclusion is that since dovecot LDA cannot yet integrate such filters in the delivery chain, but it supports plugins, that such a plugin must be written. Conceptually, it's very simple: a configuration file option specifying the Unix pipe, and a plugin that does the proper popen() (or whatever is to be used these days) call, checking for errors and doing the right thing. Unfortunately, I do not have much time at my hands -- basically it all boils down to Sunday evening and a little bit of Monday, and then it's got to be done. My C is rusty, but I do have a lot of experience with it, so I am confident... ... but what would really help is if someone who knows the internals of Dovecot would give me a starting point, or even some more information. How do I conceive to write such a plugin? I could not find the information online, and I'd rather not reverse engineer existing plugins, for that approach usually leads to ugly and hence unstable/insecure/unusable code. Any feedback is thus warmly appreciated! Also, if someone is online on IRC on Sunday and Monday and wouldn't mind if I asked a question now and then, please let me know. It goes without saying that I will happily submit my plugin (once its tested) to Dovecot upstream under the Artistic Licence, or if that doesn't work, another licence of your choosing. Thanks, -- martin; (greetings from the heart of the sun.) \____ echo mailto: !#^."<*>"|tr "<*> mailto:" net@madduck spamtraps: madduck.bogus(a)madduck.net "common sense is the collection of prejudices acquired by age eighteen." -- albert einstein

4 8

[Dovecot] Error compiling on Solaris 10
by Dirk Essl 02 Jul '06

02 Jul '06

Hi, I'm trying to compile dovecot 1.0rc1 on a V250, Solaris 10 installed. -- configure: CPPFLAGS=-I/usr/local/ssl/include LDFLAGS='-L/usr/local/ssl/lib -R/usr/local/ssl/lib' ./configure --with-ssl=openssl --with-file-offset-size=32 -- gcc Version 3.3.2 from Sunfreeware Error Message: # make make all-recursive Making all in src Making all in lib if gcc -DHAVE_CONFIG_H -I. -I. -I../.. -I/usr/local/ssl/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT file-dotlock.o -MD -MP -MF ".deps/file-dotlock.Tpo" -c -o file-dotlock.o file-dotlock.c; \ then mv -f ".deps/file-dotlock.Tpo" ".deps/file-dotlock.Po"; else rm -f ".deps/file-dotlock.Tpo"; exit 1; fi In file included from /usr/include/sys/signal.h:34, from /usr/include/signal.h:26, from file-dotlock.c:13: /usr/include/sys/siginfo.h:259: error: parse error before "ctid_t" /usr/include/sys/siginfo.h:292: error: parse error before '}' token /usr/include/sys/siginfo.h:294: error: parse error before '}' token /usr/include/sys/siginfo.h:390: error: parse error before "ctid_t" /usr/include/sys/siginfo.h:392: error: conflicting types for `__proc' /usr/include/sys/siginfo.h:261: error: previous declaration of `__proc' /usr/include/sys/siginfo.h:398: error: conflicting types for `__fault' /usr/include/sys/siginfo.h:267: error: previous declaration of `__fault' /usr/include/sys/siginfo.h:404: error: conflicting types for `__file' /usr/include/sys/siginfo.h:273: error: previous declaration of `__file' /usr/include/sys/siginfo.h:420: error: conflicting types for `__prof' /usr/include/sys/siginfo.h:287: error: previous declaration of `__prof' /usr/include/sys/siginfo.h:424: error: conflicting types for `__rctl' /usr/include/sys/siginfo.h:291: error: previous declaration of `__rctl' /usr/include/sys/siginfo.h:426: error: parse error before '}' token /usr/include/sys/siginfo.h:428: error: parse error before '}' token /usr/include/sys/siginfo.h:432: error: parse error before "k_siginfo_t" /usr/include/sys/siginfo.h:437: error: parse error before '}' token In file included from /usr/include/signal.h:26, from file-dotlock.c:13: /usr/include/sys/signal.h:85: error: parse error before "siginfo_t" In file included from file-dotlock.c:13: /usr/include/signal.h:111: error: parse error before "siginfo_t" /usr/include/signal.h:113: error: parse error before "siginfo_t" *** Error code 1 make: Fatal error: Command failed for target `file-dotlock.o' Current working directory /tmp/dovecot-1.0.beta8/src/lib *** Error code 1 The following command caused the error: set fnord $MAKEFLAGS; amf=$2; \ dot_seen=no; \ target=`echo all-recursive | sed s/-recursive//`; \ list='lib lib-dict lib-sql lib-ntlm lib-settings lib-charset lib-mail lib-imap lib-index lib-storage lib-auth auth dict master login-common imap-login imap pop3-login pop3 util plugins'; for subdir in $list; do \ echo "Making $target in $subdir"; \ if test "$subdir" = "."; then \ dot_seen=yes; \ local_target="$target-am"; \ else \ local_target="$target"; \ fi; \ (cd $subdir && make $local_target) \ || case "$amf" in *=*) exit 1;; *k*) fail=yes;; *) exit 1;; esac; \ done; \ if test "$dot_seen" = "no"; then \ make "$target-am" || exit 1; \ fi; test -z "$fail" make: Fatal error: Command failed for target `all-recursive' Current working directory /tmp/dovecot-1.0.beta8/src *** Error code 1 The following command caused the error: set fnord $MAKEFLAGS; amf=$2; \ dot_seen=no; \ target=`echo all-recursive | sed s/-recursive//`; \ list='src doc'; for subdir in $list; do \ echo "Making $target in $subdir"; \ if test "$subdir" = "."; then \ dot_seen=yes; \ local_target="$target-am"; \ else \ local_target="$target"; \ fi; \ (cd $subdir && make $local_target) \ || case "$amf" in *=*) exit 1;; *k*) fail=yes;; *) exit 1;; esac; \ done; \ if test "$dot_seen" = "no"; then \ make "$target-am" || exit 1; \ fi; test -z "$fail" make: Fatal error: Command failed for target `all-recursive' Current working directory /tmp/dovecot-1.0.beta8 *** Error code 1 make: Fatal error: Command failed for target `all' -- Can anybody halp, please? TIA dirk

3 3

[Dovecot] 1.0.rc1 released
by Timo Sirainen 02 Jul '06

02 Jul '06

I think the code is now stable enough to be called the first release candidate. Please report any bugs, new and old. The filesystem quota numbers should be correct now? http://dovecot.org/releases/dovecot-1.0.rc1.tar.gz http://dovecot.org/releases/dovecot-1.0.rc1.tar.gz.sig * PAM: If user's password is expired, give "Password expired" error message to the user. Now actually working thanks to Vaidas Pilkauskas * Relicensed dovecot-auth, lib-sql and lib-ntlm to MIT license. See COPYING file for more information. * Abuse prevention: When creating a mailbox, limit the number of hierarchies (up to 20) and the length of the mailbox name within a hierarchy (up to 200 characters). * mbox: If saved mail doesn't end with LF, add it ourself so that the mails always have one empty line before the next From-line. + Added --with-statedir configure option which defaults to $localstatedir/lib/dovecot. ssl-parameters.dat is permanently stored in that directory and is copied to login_dirs from there. + IMAP: Support SASL-IR extension (SASL initial response) + Support initial SASL response with LOGIN mechanism. Patch by Anders Karlsson + Added PLAIN-MD4 password scheme. Patch by Andrey Panin. + Added support for XFS disk quotas. Patch by Pawel Jarosz + If another process deletes the opened mailbox, try to handle it without writing errors to log file. Handles the most common cases. + Added TLS support for LDAP if the library supports it. - SEARCH command was more or less broken with OR and NOT conditions - Dovecot corrupted mbox files which had CR+LF linefeeds in headers - MySQL code could have crashed while escaping strings - MD4 code with NTLM authentication was broken with 64bit systems. Patch by Andrey Panin - Plugin loading was broken in some OSes (eg. FreeBSD) - Several fixes to handling empty values in configuration file - Several fixes to dictionary quota backend and dict server. Also changed how they're configured. - deliver: Fixed plugin handling settings - mbox_min_index_size handling was somewhat broken - passdb passwd-file: extra_args field wasn't read unless the file was also used as userdb.

5 7

[Dovecot] SSL proxy rewrite
by Timo Sirainen 02 Jul '06

02 Jul '06

Last time I committed my SSL proxy rewrite people complained that it got broken. Now that I'm finally trying to fix it, it seems to work perfectly with me. Both downloading lots of messages and saving lots of messages works fine. I added SSL alerts and something else to be logged now with verbose_ssl=yes. With that enabled, could you people try if the rewritten code works with you, and if not, what do the logs say? To test it you'll need the latest CVS code or the latest nightly snapshot and this patch: http://dovecot.org/patches/ssl-rewrite.diff

1 2

[Dovecot] Secure connection from "localhost" in jails
by Dirk Engling 02 Jul '06

02 Jul '06

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Dear dovecot developers, first: thanks for this really cool imapd, on my server it serves some hundred domains, all in all some thousand users, some having hundred thousand mails in their Maildirs (their spam boxes mostly). Since I put this installation in an FreeBSD geli encrypted disc image I had no choice but to choose an imapd with clever indexes - dovecot was perfect. However, since I reconfigured the disc image to work as a FreeBSD jail, I had some trouble with my web mail solution. Squirrelmail does not work with imaps (or at least not smoothly, out of the box, or whatever) and I didn't like to hack php to support SSL. Plus: there is no point in using ssl for a local connection. In a FreeBSD jail a sockets source address is always rewritten to the jails address, so squirrelmail opening a connection to dovecot will not come from 127.0.0.1 but from the same (jails) address, dovecot listens to. Still, dovecot only considers 'localhost' addresses as secure and allows LOGIN or PLAIN auth. With the little patch below dovecot allows clients from the jail to authenticate via LOGIN, when they connect from the IP it accepts connections at. Something similar is lurking around in pop3 auth code, I am sure, you get the point. Regards erdgeist ======== 8< ======== 8< ======== 8< ======== 8< ======== 8< ======== 8< dovecot-1.0.rc1/src/imap-login 18:59:44 #> diff -u client.c* - --- client.c Thu Jun 29 18:59:39 2006 +++ client.c_new Thu Jun 29 18:59:19 2006 @@ -411,7 +411,7 @@ const struct ip_addr *ip) { struct imap_client *client; - - const char *addr; + const char *addr, *local_addr; if (max_logging_users > CLIENT_DESTROY_OLDEST_COUNT && hash_size(clients) >= max_logging_users) { @@ -429,8 +429,10 @@ client->common.tls = ssl; addr = net_ip2addr(ip); + local_addr = net_ip2addr(local_ip); client->common.secured = ssl || (IPADDR_IS_V4(ip) && strncmp(addr, "127.", 4) == 0) || + (IPADDR_IS_V4(ip) && strncmp(addr, local_addr, strlen(local_addr)) == 0) || (IPADDR_IS_V6(ip) && (strcmp(addr, "::1") == 0 || strncmp(addr, "::ffff:127.", 11) == 0)); -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (Darwin) iD8DBQFEpAu4ImmQdUyYEgkRAnC8AJ9W3L5XwjdTuLvGfUwmIjEfyq8sAQCdErPc v6JW46e9dfYBsKzAWprg2zw= =/IWt -----END PGP SIGNATURE-----

3 4

[Dovecot] Re: 1.0 RC1 status
by Ramunas 01 Jul '06

01 Jul '06

>If you think there's still something I should have replied to, please >re-send it because I've either missed it or just skipped it for some >reason.(Except there are still a couple of mails from this week I've >yet to reply to.) Timo look at this message - http://www.dovecot.org/list/dovecot/2006-June/013958.html. I compiled dovecot-latest (dovecot-20060618.tar.gz , configured --with-ioloop=poll), but same problem: Jun 19 07:43:25 srv1 dovecot: Dovecot v1.0.beta9 starting up Jun 19 07:43:26 srv1 dovecot: auth(default): pgsql: Connected to hosting Jun 19 07:44:09 srv1 dovecot: pop3-login: Login: user=<ramas>, method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 07:44:09 srv1 dovecot: POP3(ramas): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Jun 19 19:18:21 srv1 dovecot: auth(default): sql(ramas,192.168.0.3): Password query failed: Jun 19 19:18:21 srv1 dovecot: auth(default): invalid I/O fd 8, callback 0x8065170 Jun 19 19:19:21 srv1 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS gdb /usr/libexec/dovecot/dovecot-auth 30056 GNU gdb Red Hat Linux (6.3.0.0-1.122rh) 0xffffe410 in __kernel_vsyscall () (gdb) x 0x8065170 0x8065170 <get_result>: 0x83e58955 (gdb) bt #0 0xffffe410 in __kernel_vsyscall () #1 0xb7debe3e in __lll_mutex_lock_wait () from /lib/libc.so.6 #2 0xb7d6b94c in _L_lock_100 () from /lib/libc.so.6 #3 0xb7d6b8ea in fflush () from /lib/libc.so.6 #4 0xb7e5a973 in pqFlush () from /usr/lib/libpq.so.3 #5 0xb7e57cb0 in PQconsumeInput () from /usr/lib/libpq.so.3 #6 0x0806518c in get_result () #7 0x0806abe8 in io_loop_handler_run () #8 0x0806a28c in io_loop_run () #9 0x08058da5 in main () Also tryed compile with epoll, got this error: Jun 19 06:55:23 srv1 dovecot: auth(default): sql(ramas,192.168.0.3): Password query failed: Jun 19 06:55:23 srv1 dovecot: pop3-login: Disconnected: user=<ramas>, method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 06:55:26 srv1 dovecot: auth(default): io_loop_handle_add: epoll_ctl(3, 9): No such file or directory Jun 19 06:55:26 srv1 dovecot: pop3-login: Disconnected: method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 06:55:26 srv1 dovecot: child 11758 (auth) returned error 89 Jun 19 06:55:27 srv1 dovecot: auth(default): pgsql: Connected to hosting Jun 19 06:55:27 srv1 dovecot: pop3-login: Login: user=<ramas>, method=PLAIN, rip=192.168.0.3, lip=192.168.0.6, TLS Jun 19 06:55:27 srv1 dovecot: POP3(ramas): Disconnected: Logged out top=0/0, retr=2/3429, del=2/2, size=3395 Users passwords stored on PostgreSQL (7.4.11) another server. Machine - Linux, kernel 2.6.16.20 Thank you. Ramunas

2 2

[Dovecot] Just one user experiencing server timeouts
by Fran Fabrizio 01 Jul '06

01 Jul '06

[dovecot-1.0-0.beta2.7 on Fedora Core 5, maildir formatted mail directories, various clients: thunderbird 1.5.0.4 from FC4 and WinXP, SquirrelMail 1.4.6-5.fc5 RPM, various recent versions of Pine from various Fedoras and Redhat 9] I have just one mail user who experiences server timeouts when trying to delete a message (move it to Trash) or other common operations. This user has 4.1GB of mail spread over 200+ Maildir-formatted folders, so I immediately expected sheer volume as the problem - this user has by far the most mail. This user experiences the problem from multiple Thunderbird installs, from SquirrelMail, and from Pine. However, I created a new user account using our standard account creation processes, and did a direct copy of olduser's Maildir to newuser's homedir. Then I did a chown -R newuser ~newuser/Maildir, set up an account in Thunderbird for newuser's account, and tried for an hour to get a server timeout doing all the same operations that cause the timeout on olduser's account, with no timeouts. I absolutely cannot duplicate the behavior, but when I watch olduser do this from any of the above named clients, I see the timeouts on about 10% of the operations. I've been looking into this off and on for weeks, but I am baffled. I can't think of what is so specific about this one user's account that is causing the trip up. Both home directories are stored on the same filesystem and as I mentioned I made an exact duplicate of Maildir. I'm completely out of ideas, does anyone have any thoughts? Does Dovecot do any data tracking on a per user basis that could be confusing it, some cache I can clear? Dovecot has been restarted numerous times since the trouble started. -- Fran Fabrizio Senior Systems Analyst Department of Computer and Information Sciences University of Alabama at Birmingham http://www.cis.uab.edu/ 205.934.0653

2 1

[Dovecot] Problems with Sent folder
by james edwards 01 Jul '06

01 Jul '06

We are using dovecot-0.99.13-3.FC3; the users use IMAP. I have had several of these today where the user cannot write to their Sent folder on the server. The users do own everything in their home dir: [root@jidmail lcrdjav]# file Sent Sent: ISO-8859 HTML document text What is up with the HTML, I am not used to seeing this in any of the IMAP folders ? -- James H. Edwards Network Systems Administrator Judicial Information Division jedwards(a)nmcourts.com

2 1

[Dovecot] patch to make sieved compile & work
by Steffen Kaiser 01 Jul '06

01 Jul '06

Hello, attached you'll find a patch to make the Sieve decompiler located in dovecot-sieve/src/libsieve compile & work. To compile sieved I've extracted the two commands from the make process for sievec, see the attached sieved.compile.sh. Bye, -- Steffen Kaiser

2 1

[Dovecot] rc1 & password debug
by Thomas Hummel 01 Jul '06

01 Jul '06

Hello Timo, I just launched rc1 with auth_verbose = yes auth_debug = yes #auth_debug_passwords = no and on a wrong password, I see my crypted passwd in the log : userPassword(password)={Crypt}xxxxxxxx Is that normal, since I assume that auth_debug_passwords defaults to no ? -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 1