March 2006 - dovecot - dovecot.org

[Dovecot] compilation and installation of dspam-plugin
by Stefan Schmidt 21 Mar '06

21 Mar '06

hello johannes, i just discovered your wonderful plugin for dovecot. it was pretty much exactly what i was looking for, only that i didn't know that yet :) "Instead of moving mail into special folders, the user has two actions available: moving it out of the SPAM folder and moving it into the SPAM folder. The dovecot plugin watches these actions [...] and tells dspam that it made an error and needs to re-classify the message, depending on the action the user took. The user can now move the message directly into whatever folder she choses, and it all works. [...]" i think this is the most usable and intuitive approach to dspam-training i have seen so far and would love to integrate dspam with this plugin into my current setup (postfix + maildrop + dovecot). i have installed dovecot via package from the debian stable section [1] therefore i am currently using version 0.99.14 in my setup. despite this difference in version i gave your betacode [2] a try together with the source of the corresponding dovecot-version [3], hoping it wouldn't crash and burn when used with my earlier version of dovecot. but i didn't get to the point where i could actually testdrive it. i tried compiling the plugin with the instructions contained in the file, but the compilation didn't suceed. ---------------------------------------------------------------------- stefan@myserver:~/sources/dovecot-dspam-plugin/dovecot-1.0.beta3/plugin$ gcc -fPIC -shared -Wall -I../src/ -I../src/lib -I.. -I../src/lib-storage -I../src/lib-mail -I../src/lib-imap -I../src/imap/ -DHAVE_CONFIG_H spam_plugin.c -o spam_plugin.so In file included from ../src/imap/common.h:4, from spam_plugin.c:32: ../src/lib/lib.h:6:22: config.h: No such file or directory In file included from ../src/lib/lib.h:23, from ../src/imap/common.h:4, from spam_plugin.c:32: ../src/lib/compat.h:31:4: #error uoff_t size not set In file included from /usr/include/sys/socket.h:35, from ../src/lib/compat.h:80, from ../src/lib/lib.h:23, from ../src/imap/common.h:4, from spam_plugin.c:32: /usr/include/bits/socket.h:36: error: conflicting types for `socklen_t' ../src/lib/compat.h:51: error: previous declaration of `socklen_t' In file included from /usr/include/netinet/in.h:23, from ../src/lib/compat.h:81, from ../src/lib/lib.h:23, from ../src/imap/common.h:4, from spam_plugin.c:32: /usr/include/stdint.h:111: error: conflicting types for `uint_fast32_t' ../src/lib/compat.h:46: error: previous declaration of `uint_fast32_t' /usr/include/stdint.h:141: error: conflicting types for `uintmax_t' ../src/lib/compat.h:38: error: previous declaration of `uintmax_t' In file included from ../src/lib/lib.h:23, from ../src/imap/common.h:4, from spam_plugin.c:32: ../src/lib/compat.h:107: error: redefinition of `struct iovec' In file included from ../src/imap/commands.h:6, from ../src/imap/client.h:4, from ../src/imap/common.h:5, from spam_plugin.c:32: ../src/lib-storage/mail-storage.h:435: error: syntax error before "mail_get_virtual_size" ../src/lib-storage/mail-storage.h:435: warning: type defaults to `int' in declaration of `mail_get_virtual_size' ../src/lib-storage/mail-storage.h:435: warning: data definition has no type or storage class ../src/lib-storage/mail-storage.h:438: error: syntax error before "mail_get_physical_size" ../src/lib-storage/mail-storage.h:438: warning: type defaults to `int' in declaration of `mail_get_physical_size' ../src/lib-storage/mail-storage.h:438: warning: data definition has no type or storage class In file included from ../src/imap/commands.h:7, from ../src/imap/client.h:4, from ../src/imap/common.h:5, from spam_plugin.c:32: ../src/lib-imap/imap-parser.h:45: error: syntax error before "uoff_t" ../src/lib-imap/imap-parser.h:45: warning: no semicolon at end of struct or union ../src/lib-imap/imap-parser.h:45: warning: no semicolon at end of struct or union ../src/lib-imap/imap-parser.h:47: error: syntax error before '}' token ../src/lib-imap/imap-parser.h:47: warning: type defaults to `int' in declaration of `_data' ../src/lib-imap/imap-parser.h:47: warning: data definition has no type or storage class ../src/lib-imap/imap-parser.h:48: error: syntax error before '}' token ../src/lib-imap/imap-parser.h:72: error: field `args' has incomplete type ../src/lib-imap/imap-parser.h:125: error: syntax error before "_imap_arg_literal_size_error" ../src/lib-imap/imap-parser.h:125: warning: type defaults to `int' in declaration of `_imap_arg_literal_size_error' ../src/lib-imap/imap-parser.h:125: warning: data definition has no type or storage class ---------------------------------------------------------------------- just in case it matters: i currently have gcc 3.3.5 installed. greetings, stefan [1] http://packages.debian.org/stable/mail/dovecot-common [2] http://snipurl.com/nvol [3] http://www.dovecot.org/releases/dovecot-1.0.beta3.tar.gz

2 2

[Dovecot] [patch] support tpop3d-style UIDLs
by Ben Winslow 20 Mar '06

20 Mar '06

Hello, I've attached a patch that adds an additional expando to pop3_uidl_format. The additional expando (%M) expands to the md5sum of the filename (which is already available via %f.) This UIDL style is compatible with tpop3d when using Maildir. The patch is against dovecot 1.0 beta3, and I'd love to see it be merged into the official tree. Comments welcome. -- Ben Winslow <rain(a)bluecherry.net>

1 0

Re: [Dovecot] LDA Sieve debugging
by Luca Corti 20 Mar '06

20 Mar '06

On Mon, 2006-03-20 at 13:25 -0500, Duncan Hutty wrote: > try using "if header :contains" instead of address. I've tried that. Unfortunately it does not work. I've also removed the compiled version of the sieve script hoping that it was not recompiled after the changes. I noticed it is not recompiled even if permissions are correct on the file AND directory. I really do not understand what this could be. thanks -- Luca Corti PGP Key ID 1F38C091 BOFH excuse of the moment: nesting roaches shorted out the ether cable

1 0

Re: [Dovecot] VERY cool add-on request.
by Johannes Berg 20 Mar '06

20 Mar '06

On Sat, 2006-03-18 at 09:25 -0500, David A. Lee wrote: > You refered to a specific one for dspam. > Would it be easy to generalize ? Yes, shouldn't be too hard. But the plugin also looks at headers etc. which would be very hard to capture in a config file. Well, not impossible, but cumbersome. I'm not sure what you're after but say you want to be able to define folder actions in a config file. Let me draw up a hypothetical config file example with the logic of the dspam plugin. The syntax is sort of borrowed from Exim :) ----begin folder action config---- copy into "SPAM" fail condition !${defined:header:X-DSpam-Signature} fail message "Message doesn't have dspam signature!" run "dspam --signature ${header:X-DSpam-Signature} --is-spam" copy outof "SPAM" ignore to "Trash" fail condition !${defined:header:X-DSpam-Signature} fail message "Message doesn't have dspam signature!" run "dspam --signature ${header:X-DSpam-Signature} --not-spam" ----end folder action config---- I'm sure others can come up with examples where the config file has to be even more elaborate... I can imagine having a 'pipe' action instead of 'run' that would give the command the message on stdin for example. johannes

3 2

[Dovecot] VERY cool add-on request.
by Adam M. Dunn 20 Mar '06

20 Mar '06

I would like to have the ability to execute a command on a folder based on a user doing something like copying a message to that folder. This could be accomplished with a config file directive. For example, this would be EXTREMEMLY useful as a spam learning hook. Take a scenario where each user has their own spamassassin bayes database, and you want to give the users the ability to train their own database based on what they think is SPAM. It would be nice to give all the users a folder called Spam, and tell them to just copy/move mail into that folder, and spamassassin will automatically learn about it. If we had a configuration hook where you could execute on a copy/move, then I could tell Dovecot whenever a user puts a message into the Spam folder, execute 'sa-learn --spam --file %s' on that message. Sure we could just do an external script in a cron job to do it every hour or something, which I'll probably do in the mean time, but often users will just delete messsages after they copy into it. Doing it through IMAP means spamassassin will learn about it immediately. How cool would that be? It seems like an easy hook to implement. I would like to patch it myself for my own use, but I'm not very proficient in C. I saw someone on the net patched Courier to do the same thing so I know I'm not alone in wanting this. Anyone know how I could patch it? Can we add that to the feature request list? ~Adam

8 12

[Dovecot] mbox to maildir conversion
by Brian Wilson 20 Mar '06

20 Mar '06

Timo writes: > BTW. Nowadays Dovecot includes its own conversion tool also, which might > work better than mb2md. Usage is something like: > > src/plugin/convert-tool user /home/user mbox:/home/user/mail:INBOX=/var/mail/%u maildir:/home/user/Maildir I would RTFM but searching wiki.dovecot.org turns up nothing. Give me more hints and I will add a new wiki page. The feedback the command gives is $ ./convert-tool Fatal: Usage: <username> <home dir> <source mail env> <dest mail env> Why does the tool want a home directory? What does it look for there? I know you say the syntax is the same for other tools but I don't know it for them yet either. :-) Guessing at the syntax for the source, it looks like the first thing is the format of the source (mbox:) followed by a directory containing mbox format files. The INBOX portion specifies the location of the mbox that the MDA puts incoming messages into. I can see the variables defined in doc/variables.txt, got that already. Is it intended to run both directions? That is, if I swap the last two args is will it convert maildirs into mboxes? This comment from Stian seemed pertinent as well. > But there is at least one "bug" with this; you should convert .'s in > mbox names to underscore or something, else it looks weird. Other than > that, it seems to work fine :) ..but I am unsure what 'looks weird' means. Can you give an example? Why is this tool under 'plugins' when it appears to be a separate utility? My guess is that it was easier to put there due to the build environment. Maybe it should install to a bin or sbin location? Thanks for all you do, Brian

2 2

[Dovecot] auto move of purged mail to trash
by David Powers 17 Mar '06

17 Mar '06

I am moving a courier installation over to Dovecot and I am wondering if there is a way to set Dovecot to automatically move purged items to trash (under IMAP). Additionally, is there a way to automatically delete old items from a Trash folder? -David

1 1

Re: [Dovecot] Converting huge mbox to Dovecot mbox + indexes
by Bertrand Leboeuf 17 Mar '06

17 Mar '06

My mistake, good point. I thought that creating the indexes would take a long time, but after a couple of tests, I found that Dovecot is so fast that it beats UW IMAP even while creating the indexes and after that, it is just fast. Thanks Bertrand >From: "David A. Lee" <dlee(a)calldei.com> > >I'm curious why this is an issue ? Wont dovecot make the indexes on first >use of the mbox if it finds no indexes ? > > > >> >From: Johannes Berg <johannes(a)sipsolutions.net> >>> >>>On Thu, 2006-03-16 at 15:30 -0500, Bertrand Leboeuf wrote: >>> >>>> I have ~500 users, some with HUGE mbox (500MB-1GB), >>>> is there a script to create the Dovecot indexes at night >>>> to help speed up the migration process. >>> >>>If you use the dovecot converter then indexes will be built during the >>>conversion. >>> >>>johannes >> >> Good, can I use convert-tool to do: mbox -> mbox + indexes >> >> I have not tested the maildir configs yet and I will >> have to deal with the number of files and their placement. >> >> Bertrand >> >>

2 1

Re: [Dovecot] Converting huge mbox to Dovecot mbox + indexes
by Bertrand Leboeuf 17 Mar '06

17 Mar '06

>From: Johannes Berg <johannes(a)sipsolutions.net> > >On Thu, 2006-03-16 at 15:30 -0500, Bertrand Leboeuf wrote: > >> I have ~500 users, some with HUGE mbox (500MB-1GB), >> is there a script to create the Dovecot indexes at night >> to help speed up the migration process. > >If you use the dovecot converter then indexes will be built during the >conversion. > >johannes Good, can I use convert-tool to do: mbox -> mbox + indexes I have not tested the maildir configs yet and I will have to deal with the number of files and their placement. Bertrand

2 1

[Dovecot] mbox to maildir: what about INBOX
by Bertrand Leboeuf 17 Mar '06

17 Mar '06

I migrated from UW IMAP/Qpopper to Dovecot using: # indexes on /var/indexes is faster: local, not NFS mouted default_mail_env = mbox:~/mail:INBOX=/var/mail/%u:INDEX=/var/indexes/%u # Qpopper pop3_reuse_xuidl = yes The new mail is sent to in /var/mail/%u in mbox format How can I migrate some users to maildir and have them receive their emails either in POP3 or IMAP. (lots of big files to convert) How does new email get spooled in the right INBOX (POP3/IMAP) ? Thanks. Bertrand Leboeuf leboeuf(a)emt.inrs.ca

1 0