December 2004 - dovecot

[Dovecot] 1.0-test59
by Timo Sirainen 19 Dec '04

19 Dec '04

http://dovecot.org/test/ No-one had been testing 1.0-tests with Evolution? It was pretty much completely broken with messages having attachments. - test58's output stream code change were entirely wrong and caused bad breakages with mbox. - Named pipes are now treated as write-only mboxes (blocks if no-one is reading, perhaps it should timeout in a few seconds?) - FETCH BODY[n.xxx] replies were all wrong - LDAP authentication was crashing - pop3_uidl_format=%f from Andrey test60 will probably have keyword support. Its index file code is already working, with ability to set over 500k different keywords per mailbox (because message record size is limited to 65535 bytes - should be enough for everyone :). Code is still missing to notify other session about keyword changes, and storing the keywords into mbox/maildir. For mbox I can use X-Keywords header. There should probably be some configurable limit to how many keywords to set per mailbox.. Dovecot shouldn't mind if the X-Keywords header is huge, but other programs might. For maildir then.. I think I'll just implement it backwards compatible with 0.99.x, ie. store in maildir filename with a-z letters. That would make max. 26 keywords per mailbox. Except maybe I shouldn't limit it to that. The rest could be stored only in indexes. That however would make it necessary to keep indexes backwards compatible forever so data is not lost.

3 2

[Dovecot] 0.99.13-rc1
by Timo Sirainen 19 Dec '04

19 Dec '04

http://dovecot.org/rc/ I guess the RCing in 0.99.12 didn't help that much. SQL/LDAP authentication crashed because memory was freed wrong. Please test so it would actually work in 0.99.13. Also fixed SEARCH UNKEYWORD which wasn't working. Also added 1.0-test's oe-ns-eoh POP3 workaround built-in.

2 1

[Dovecot] Cygwin and index code
by Johannes Berg 19 Dec '04

19 Dec '04

As I can currently only work with windows (eek) I thought I'd try dovecot there. I already sent a patch to make dovecot compile under cygwin, but it still doesn't really work, here's part of a session that I started while my maildir was totally empty (only cur/new/tmp in ~/Maildir) $ ./imap.exe * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS] Logged in as jmberg A01 SELECT INBOX imap(jmberg): Warning: Compressing cache file /home/jmberg/Maildir/dovecot.index.cache imap(jmberg): Error: open() failed with file /home/jmberg/Maildir/dovecot.index.tmp: Permission denied A01 NO Internal error occured. Refer to server log for more information. [2004-12-17 15:51:06] A02 LOGOUT * BYE Logging out A02 OK Logout completed. A second session (some files were created by the first) yields this: $ ./imap.exe * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS] Logged in as jmberg A01 SELECT INBOX imap(jmberg): Error: open() failed with file /home/jmberg/Maildir/dovecot.index.tmp: Permission denied imap(jmberg): Error: rename(/home/jmberg/Maildir/dovecot.index.tmp, /home/jmberg/Maildir/dovecot.index) failed: Permission denied A01 NO Internal error occured. Refer to server log for more information. [2004-12-17 15:52:25] A02 LOGOUT * BYE Logging out A02 OK Logout completed. I think this is probably due to the indexing code opening the .tmp file and then unlinking it and trying to re-create it while the first is still open. Or something, I really am not sure. *Maybe* the index code might be made work if it creates a new temporary file-name every time it re-creates the file, but I don't understand the code well enough (yet) to give a better analysis of the problem. However, I do not think that this is really important. I certainly don't want to run dovecot on windows (I only saw cygwin compile in the todo and since I have a cygwin setup anyway I thought I'd try). The whole thing doesn't work anyway: [after correcting users, making directories, make install...] $ /usr/local/sbin/dovecot.exe dovecot: Dec 17 16:03:17 Info: Dovecot v1.0-test58 starting up dovecot: Dec 17 16:03:18 Error: login: fd_read() failed: Function not implemented dovecot: Dec 17 16:03:18 Error: close(mail client) failed: Bad file descriptor dovecot: Dec 17 16:03:18 Error: Login process died too early - shutting down dovecot: Dec 17 16:03:18 Error: imap-login: dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 32): Invalid argument dovecot: Dec 17 16:03:18 Error: login: fd_read() failed: Function not implemented dovecot: Dec 17 16:03:18 Error: close(mail client) failed: Bad file descriptor dovecot: Dec 17 16:03:18 Error: imap-login: dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 32): Invalid argument dovecot: Dec 17 16:03:18 Error: login: fd_read() failed: Function not implemented dovecot: Dec 17 16:03:18 Error: close(mail client) failed: Bad file descriptor dovecot: Dec 17 16:03:18 Error: imap-login: dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 32): Invalid argument dovecot: Dec 17 16:03:18 Error: auth(default): dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 256): Invalid argument dovecot: Dec 17 16:03:18 Error: child 2176 (auth) returned error 89 dovecot: Dec 17 16:03:18 Error: child 2192 (login) returned error 89 dovecot: Dec 17 16:03:18 Error: child 2212 (login) returned error 89 dovecot: Dec 17 16:03:18 Error: child 2232 (login) returned error 89 Maybe someone cares. If not, well, I had a less boring train ride ;) johannes

2 1

[Dovecot] building on cygwin
by Johannes Berg 19 Dec '04

19 Dec '04

Hi, attached patch makes dovecot build on cygwin (only have a windows computer at the moment :-/ ) It spews a lot of warnings, for example "unsigned int format but uint32_t argument". johannes Only in dovecot-1.0-test58.mod/: Makefile Only in dovecot-1.0-test58.mod/: config.h Only in dovecot-1.0-test58.mod/: config.log Only in dovecot-1.0-test58.mod/: config.status Only in dovecot-1.0-test58.mod/doc: Makefile Only in dovecot-1.0-test58.mod/: libtool Only in dovecot-1.0-test58.mod/src: Makefile Only in dovecot-1.0-test58.mod/src/auth: .deps Only in dovecot-1.0-test58.mod/src/auth: Makefile Only in dovecot-1.0-test58.mod/src/imap: .deps Only in dovecot-1.0-test58.mod/src/imap: Makefile Only in dovecot-1.0-test58.mod/src/imap-login: .deps Only in dovecot-1.0-test58.mod/src/imap-login: Makefile Only in dovecot-1.0-test58.mod/src/lib: .deps Only in dovecot-1.0-test58.mod/src/lib: Makefile Only in dovecot-1.0-test58.mod/src/lib-auth: .deps Only in dovecot-1.0-test58.mod/src/lib-auth: Makefile Only in dovecot-1.0-test58.mod/src/lib-charset: .deps Only in dovecot-1.0-test58.mod/src/lib-charset: Makefile Only in dovecot-1.0-test58.mod/src/lib-imap: .deps Only in dovecot-1.0-test58.mod/src/lib-imap: Makefile Only in dovecot-1.0-test58.mod/src/lib-index: .deps Only in dovecot-1.0-test58.mod/src/lib-index: Makefile diff -ur --strip-trailing-cr dovecot-1.0-test58/src/lib-index/mail-cache-decisions.c dovecot-1.0-test58.mod/src/lib-index/mail-cache-decisions.c --- dovecot-1.0-test58/src/lib-index/mail-cache-decisions.c 2004-11-24 19:40:17.000000000 +0100 +++ dovecot-1.0-test58.mod/src/lib-index/mail-cache-decisions.c 2004-12-16 15:31:24.659497600 +0100 @@ -71,7 +71,7 @@ #include "mail-cache-private.h" void mail_cache_decision_lookup(struct mail_cache_view *view, uint32_t seq, - unsigned int field) + uint32_t field) { struct mail_cache *cache = view->cache; const struct mail_index_header *hdr; @@ -115,7 +115,7 @@ } void mail_cache_decision_add(struct mail_cache_view *view, uint32_t seq, - unsigned int field) + uint32_t field) { struct mail_cache *cache = view->cache; uint32_t uid; Only in dovecot-1.0-test58.mod/src/lib-mail: .deps Only in dovecot-1.0-test58.mod/src/lib-mail: Makefile Only in dovecot-1.0-test58.mod/src/lib-ntlm: .deps Only in dovecot-1.0-test58.mod/src/lib-ntlm: Makefile Only in dovecot-1.0-test58.mod/src/lib-settings: .deps Only in dovecot-1.0-test58.mod/src/lib-settings: Makefile Only in dovecot-1.0-test58.mod/src/lib-sql: .deps Only in dovecot-1.0-test58.mod/src/lib-sql: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage: .deps Only in dovecot-1.0-test58.mod/src/lib-storage: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/index: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/index: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/index/maildir: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/index/maildir: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/index/mbox: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/index/mbox: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/register: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/register: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/register: mail-storage-register.c Only in dovecot-1.0-test58.mod/src/lib-storage/subscription-file: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/subscription-file: Makefile Only in dovecot-1.0-test58.mod/src/login-common: .deps Only in dovecot-1.0-test58.mod/src/login-common: Makefile Only in dovecot-1.0-test58.mod/src/master: .deps Only in dovecot-1.0-test58.mod/src/master: Makefile Only in dovecot-1.0-test58.mod/src/pop3: .deps Only in dovecot-1.0-test58.mod/src/pop3: Makefile Only in dovecot-1.0-test58.mod/src/pop3-login: .deps Only in dovecot-1.0-test58.mod/src/pop3-login: Makefile Only in dovecot-1.0-test58.mod/src/util: .deps Only in dovecot-1.0-test58.mod/src/util: Makefile diff -ur --strip-trailing-cr dovecot-1.0-test58/src/util/dovecotpw.c dovecot-1.0-test58.mod/src/util/dovecotpw.c --- dovecot-1.0-test58/src/util/dovecotpw.c 2004-07-30 05:16:23.000000000 +0200 +++ dovecot-1.0-test58.mod/src/util/dovecotpw.c 2004-12-16 15:34:03.818356800 +0100 @@ -7,7 +7,6 @@ #include <ctype.h> #include <fcntl.h> -#include <libgen.h> #include <stdio.h> #include <stdlib.h> #include <unistd.h> Only in dovecot-1.0-test58.mod/: stamp-h1 Only in dovecot-1.0-test58.mod/: stamp.h

2 2

[Dovecot] spam plugin
by Johannes Berg 19 Dec '04

19 Dec '04

Here's a new version, it compiles (and appears to work) except the part in "copy_reclassified". Can anyone help me (probably only Timo knows how) with that? http://johannes.sipsolutions.net/edit/Projects/dovecot-dspam-integration/ps… johannes

2 1

[Dovecot] 1.0-test58
by Timo Sirainen 19 Dec '04

19 Dec '04

http://dovecot.org/test/ - Fixed APPEND hanging in some situations. Didn't happen with mail_save_crlf=yes. - Added pop3_uidl_format setting. No need to patch sources anymore if you don't want the default. Does anyone want pop3_uidl_xuidl_header yes/no setting, with fallbacking to pop3_uidl_format if X-UIDL header isn't found? Shouldn't be difficult to do.. - Added mbox_very_dirty_syncs setting which tries to avoid re-reading mbox as long as possible. - CREATE dir/ wasn't working - If login_process_per_connection=no and auth process count > 1, each auth process listens in different socket. Login processes then connect to all these sockets and send requests to them in round robin. - Multiple auth sections in config file work now a bit better. dovecot-auth might still complain about timeouts though.

6 9

[Dovecot] permissions and location of .subscriptions
by Tom 19 Dec '04

19 Dec '04

What is the correct set of permissions for the file .subscriptions and what is the correct directory location? Thanks, Tom

2 1

[Dovecot] deploying dspam
by Johannes Berg 17 Dec '04

17 Dec '04

Hi everyone, I've been thinking of phasing out my spamassassin installation (it's hardly doing me any good these days) in favour of dspam. Now since I'm working on this anyway, I thought I'd configure it so when users get any spam, it is delivered into a special folder. I figure I need the 1.0 test series for this, so I can make that folder fixed. But, I also want to allow them to move spam in and out of that folder and dspam can learn it. Anyway, I found a message dating back a while where Timo says this could easily be implemented in a plugin (in the 1.0 test series), but I can't put my finger on how to do it. Does anyone have an example plugin that can run commands when mail is moved in or out of a special folder? Or is there any plugin-writing documentation? Thanks, johannes

17 39

Re: [Dovecot] deploying dspam
by Gunter Ohrner 17 Dec '04

17 Dec '04

Am Donnerstag, 16. Dezember 2004 11:46 schrieben Sie: > > script. Even there you can optimize a lot by changing some of the > > queries to allow indizes to take effect. > Have you done that, Yes. > and if so would you share? Yes, of course. I already submitted it to the dspam author but did not get any reaction so I don't know if he considered to include it. In dspam 3.0 the rule to clean up dspam_token_data was terribly stressing my system, changing it to the equivalent (I hope ;) - delete from dspam_token_data where ((innocent_hits=0 and spam_hits < 5) - or (innocent_hits=1 and spam_hits < 3) or (innocent_hits=2 and - spam_hits = 0)) and @a-to_days(last_hit) > 30; reduced the queries run time by a factor of 10 to 50 easily. I simply "flattened" the atrithmetic expression within the "where" clause to allow the indices to support this query. > But this is getting too much OT, maybe we should move over to the dspam > mailing list :) I'm not subscribed there - maybe now everything is said and everyone will excuse this OT mail? ;) Greetings, Gunter -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + http://aachen.uni-dsl.de/ - Der direkte Draht in's Hochschulnetz! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ 362) BSI: Eine Art Ghostbuster-Truppe für Sicherheitsfragen (Spiegel Online) -- http://www.iks-jena.de/mitarb/lutz/usenet/Fachbegriffe.der.Informatik.htm l#362 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + PGP-verschlüsselte Mails bevorzugt! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

1 0

Re: [Dovecot] deploying dspam
by Johannes Berg 16 Dec '04

16 Dec '04

Tom Allison wrote: > Shared Folder? > Wouldn't you have to do something like this anyways? Something like this in a very broad sense: I have exactly _one_ special folder, supposed to always contain only spam. > If you don't like the folders idea, then tagged the SUBJECT lines and > deliver everything as per usual. I don't do this, I opt for the > multiple folders.. Oh, I like the folders idea! I just don't like having to put the maintenance burden on me as a user. Why shouldn't the system do all this /behind the scenes/ with a little special help from the IMAP server? > It's one option. Just to provide some ideas on how it can work. But then, what's wrong with my other suggestion about making that scale by implementing your NewXY folders behind the scenes? johannes

1 0