- dovecot - dovecot.org

[Dovecot] Removing Duplicates
by Sabahattin Gucukoglu 23 Mar '10

23 Mar '10

Hi all, I am starting fresh with a local repository of mails, which almost certainly have duplicates in them. I am going to use maildirs, and ensure all mails are input with CRLFs. The question is: does anybody know how I can find and remove duplicates, either while injecting mail with IMAP, or afterward? I can use tools to find duplicate Message-IDs, but don't know of a way to remove duplicates in mailboxes that are already imported as opposed to incoming mail. Perhaps there is a way to use the IMAP protocol for this? Cheers, Sabahattin

4 4

[Dovecot] Debian Unstable Packages
by Sabahattin Gucukoglu 23 Mar '10

23 Mar '10

Hi all, Speaking of Debian, what relative position are the Debian Unstable (Sid) packages in to the latest "Bleeding edge" builds of RCS-based releases from the Wiki? If using Unstable is it recommended to stay or use the newer ones? I'd say it was production, yes, but I'm forgiving of problems in the latest releases, so long as they aren't meant to be beta (i.e., known breakages). Cheers, Sabahattin

2 1

[Dovecot] Dovecot Antispam - Unable to determine the runtime user
by lodan 23 Mar '10

23 Mar '10

Hi all, I have a small problem with the dovecot-antispam plugin. When I try to move a message to my spam folder, I have this error: IMAP4> 149 UID COPY 15 SPAM IMAP4< 149 NO [CANNOT] Failed to call dspam And in the server log file: mail dspam[12339]: Unable to determine the runtime user I'm running dspam 3.9.0 with dovecot+managesieve 1.2.10 and dovecot-antispam git (2010-03-22). Thanks for your help Best regards

1 0

[Dovecot] mbox + bzip2 +dovecot = crash?
by kjonca＠wp.pl 22 Mar '10

22 Mar '10

I have some archived mails in compressed (by bzip2) mboxes and I would like to read them via imap Unfortunately it looks like dovecot crashes when tries to read them :( #v+ kjonca@alfa:~/Mail/Old/Junk%sudo /usr/sbin/dovecot -n [sudo] password for kjonca: # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.7+2 i686 Debian squeeze/sid log_path: /var/log/dovecot log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap listen: alfa.kjonca localhost ssl: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 1 verbose_proctitle: yes mail_privileged_group: mail mail_debug: yes mbox_write_locks: fcntl dotlock mail_plugins: mail_log zlib mail_log_max_lines_per_sec: 0 namespace: type: private separator: / location: maildir:~/Mail/def:LAYOUT=fs:INBOX=~/Mail/def inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: #Old/ location: mbox:~/Mail/Old list: yes subscriptions: yes lda: postmaster_address: root@localhost log_path: ~/log/dovecot.log info_log_path: ~/log/deliver.log mail_plugins: sieve deliver_log_format: msgid=%m : Subject=%s : From=%f :%$ auth default: mechanisms: digest-md5 cram-md5 passdb: driver: pam args: dovecot passdb: driver: passwd-file args: scheme=plain-md5 /etc/security/dovecot.pwd userdb: driver: passwd #v- Then I try to read mailbox: #v+ kjonca@alfa:~/Mail/Old/Junk%mutt -f \=\#Old/Junk/2008.bz2 #v- In logs is: #v+ 2010-03-22 17:03:05 imap-login: Info: Login: user=<kjonca>, method=DIGEST-MD5, rip=127.0.0.1, lip=127.0.0.1, secured 2010-03-22 17:03:05 IMAP(kjonca): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2010-03-22 17:03:06 IMAP(kjonca): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_mail_log_plugin.so 2010-03-22 17:03:06 IMAP(kjonca): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_zlib_plugin.so 2010-03-22 17:03:06 IMAP(kjonca): Info: Effective uid=1000, gid=1000, home=/home/kjonca 2010-03-22 17:03:06 IMAP(kjonca): Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes 2010-03-22 17:03:06 IMAP(kjonca): Info: maildir: data=~/Mail/def:LAYOUT=fs:INBOX=~/Mail/def 2010-03-22 17:03:06 IMAP(kjonca): Info: fs: root=/home/kjonca/Mail/def, index=, control=, inbox=/home/kjonca/Mail/def 2010-03-22 17:03:06 IMAP(kjonca): Info: Namespace: type=private, prefix=#Old/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes 2010-03-22 17:03:06 IMAP(kjonca): Info: mbox: data=~/Mail/Old 2010-03-22 17:03:06 IMAP(kjonca): Info: mbox: INBOX defaulted to /home/kjonca/Mail/Old/inbox 2010-03-22 17:03:06 IMAP(kjonca): Info: fs: root=/home/kjonca/Mail/Old, index=, control=, inbox=/home/kjonca/Mail/Old/inbox 2010-03-22 17:03:06 IMAP(kjonca): Info: Namespace #Old/: Using permissions from /home/kjonca/Mail/Old: mode=0700 gid=-1 2010-03-22 17:03:50 dovecot: Error: child 27392 (imap) killed with signal 11 (core dumped) #v- core stack: #v+ kjonca@alfa:~/Mail/Old/Junk%gdb -c ~/core /usr/lib/dovecot/imap [..cut...] Core was generated by `imap [kjonca 127.0.0.1]'. Program terminated with signal 11, Segmentation fault. [New process 27392] #0 memmove () at ../sysdeps/i386/i686/memmove.S:97 97 ../sysdeps/i386/i686/memmove.S: No such file or directory. in ../sysdeps/i386/i686/memmove.S (gdb) bt #0 memmove () at ../sysdeps/i386/i686/memmove.S:97 #1 0x080f60c1 in i_stream_compress (stream=0x824ca48) at istream.c:393 #2 0xb77ce68a in ?? () from /usr/lib/dovecot/modules/imap/lib20_zlib_plugin.so #3 0x0824ca48 in ?? () #4 0x00000001 in ?? () #5 0xbf8efe78 in ?? () #6 0x080dc007 in mail_cache_decision_state_update (view=0x10ef4c52, seq=0, field=136628808) at mail-cache-decisions.c:83 #7 0x080f59bd in i_stream_seek_mark (stream=0x10ef4c51, v_offset=0) at istream.c:209 #8 0x080930fb in istream_raw_mbox_seek (stream=0x8268290, offset=0) at istream-raw-mbox.c:736 #9 0x080935b5 in mbox_file_seek (mbox=0x8261f30, view=0x8264390, seq=1, deleted_r=0xbf8eff8f) at mbox-file.c:177 #10 0x080956a2 in mbox_mail_seek (mail=<value optimized out>) at mbox-mail.c:85 #11 0x08095d7f in mbox_mail_get_received_date (_mail=0x826aa10, date_r=0xbf8efffc) at mbox-mail.c:117 #12 0x08069c18 in fetch_internaldate (ctx=0x824a360, mail=0x826aa10, context=0x0) at imap-fetch.c:719 #13 0x0806a39d in imap_fetch_more (ctx=0x824a360) at imap-fetch.c:473 #14 0x08062461 in cmd_fetch (cmd=0x824a210) at cmd-fetch.c:228 #15 0x08067b7c in client_command_input (cmd=0x824a210) at client.c:612 #16 0x08067c52 in client_command_input (cmd=0x824a210) at client.c:661 #17 0x08067ed5 in client_handle_input (client=0x8249f80) at client.c:702 #18 0x080686ff in client_input (client=0x8249f80) at client.c:753 #19 0x080f96a6 in io_loop_handler_run (ioloop=0x8247e18) at ioloop-epoll.c:208 #20 0x080f8b20 in io_loop_run (ioloop=0x8247e18) at ioloop.c:335 #21 0x08070ee4 in main (argc=3, argv=0xbf8f0374, envp=0xbf8f0384) at main.c:327 Current language: auto; currently asm #v- I tried to recompress these mboxes with gzip and dovecot perfectly works with them. KJ -- http://blogdebart.pl/2009/12/22/mamy-chorych-dzieci/ KRETYNIZM - ułomność predysponująca często do wampiryzmu (J.Collin de Plancy "Słownik wiedzy tajemnej")

2 2

[Dovecot] dovecot-2.0.beta4 mysql support in Solaris
by Tomi Vainio 22 Mar '10

22 Mar '10

Hi, I've been able to configure --with-mysql in Solaris 10 which has MySQL version 4.0.31 bundled in. Since beta4 build fails due to change in src/lib-sql/driver-mysql.c. I've never used this feature but so I don't need it. This is just a FYI if someone reads mailing list. "driver-mysql.c", line 139: undefined symbol: CLIENT_MULTI_RESULTS "driver-mysql.c", line 448: warning: implicit function declaration: mysql_next_result Tomppa

2 2

[Dovecot] Shared mailboxes basics
by Thomas Hummel 22 Mar '10

22 Mar '10

Hello Timo, I'm trying to set up shared mailboxes with dovecot-1.2.11/Maildir. I previsouly used public namespaces with 1.1+ to somehow implement them but I'm looking at the real ones now. I've read the Wiki but I'm still confused or not 100% sure about the following (basic) points : 1. Namespaces prefixes My understanding is that a namespace prefix is just an escape mechanism for the client to access the mailboxes this namespace holds. So the real location is _only_ defined by the "location" directive, independently of what the prefix is. So, for example, If you've got : prefix="foo/bar/" location=maildir:/some/folder/%u mailboxes are physically in /some/folder/%u, not in /foo/bar/some/folder/%u or something am I correct ? 2. Other Users mailboxes RFC234 states that shared mailboxes (which they call "Other Users" mailboxes) are "mailboxes from the Personal Namespaces of other users." Dovecot's Wiki takes as an example : # User's private mail location. mail_location = maildir:~/Maildir # You need to create also a private namespace: namespace private { separator = / prefix = #location defaults to mail_location. inbox = yes } namespace shared { separator = / prefix = shared/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = no list = children } and states : "This creates a shared/ namespace under which each user's mailboxes are." My understanding is that # User's private mail location. mail_location = maildir:~/Maildir and location = maildir:%%h/Maildir implies that mailboxes in both the private and the shared/ namespace are physically in the same location (under the "$HOME/Maildir" directory of the user who shares his mailbox) . Am I correct ? I tried the following set up : namespace private { separator = / location = maildir:/courriel/boites/%u:CONTROL=/courriel/meta/%u:INDEX=/var/dovecot-test/indexes/%1u/%u inbox = yes hidden = no list = yes subscriptions = yes } namespace shared { separator = / prefix = "#shared/%%u/" location = maildir:/courriel/boites/%%u:INDEX=/var/dovecot-test/indexes/%1u/%u/shared/%%u subscriptions = no list = yes # will try children later } the user doveimap has the following mailboxes : # pwd /courriel/boites # ls -l doveimap total 64 drwx------ 5 doveimap Invites 4096 Oct 23 13:38 .Trash drwxr-xr-x 5 doveimap Invites 4096 Oct 27 17:00 .sous drwxr-xr-x 5 doveimap Invites 4096 Oct 27 17:00 .sous.arbo drwxr-xr-x 5 doveimap Invites 4096 Oct 27 17:00 .sous.arbo.rescence drwx------ 5 doveimap Invites 4096 Oct 23 13:43 .testcopy drwx------ 2 doveimap Invites 4096 Mar 15 17:08 cur drwx------ 2 doveimap Invites 4096 Mar 15 17:07 new drwx------ 2 doveimap Invites 4096 Mar 15 17:07 tmp I can perform for instance : * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot test ready. x login doveimap xxxxxxxx x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in 1 setacl INBOX dovepop rl 1 OK Setacl complete. But isn't a client like Thunderbird (3.0.3) supposed to . show me the #shared (even if no one shares mailboxes to me) "folder" (because of list = yes )? . let me share, let's say the .sous.arbo mailbox ? If yes, how ? Or should I first pre-set some acl files ??? For now, it says : "This is a personnal mail folder. It is not shared." Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

3 18

[Dovecot] dovecot-2.0.beta3 tcpwrapper support in Solaris
by Tomi Vainio 22 Mar '10

22 Mar '10

Hi, 2.0 compiles fine in Solaris but and I've found only one glitch so far. Tcpwapper support needs some tweaks. I need to add CPPFLAGS=/usr/sfw/include because tcpd.h is in there. Then also LDFLAGS='-R/usr/sfw/lib -L/usr/sfw/lib' is needed. It would be nice to have --with-tcpwrap-dir or something. After this linking gives an error Undefined first referenced symbol in file deny_severity /usr/sfw/lib//libwrap.so allow_severity /usr/sfw/lib//libwrap.so These are not defined but application itself should define these globally so I've added these to configure and src/util/tcpwrap.c #include <syslog.h> int allow_severity = LOG_INFO; int deny_severity = LOG_WARNING; Tomppa

2 2

[Dovecot] Dovecot 1.2.11 renames Maildir filenames on first read of foreign POPstore - how to avoid
by Sam C. Nicholson !! 22 Mar '10

22 Mar '10

Greetings, I'm converting from a custom POPstore ( > 100,000 messages) which is Maildir-like and uses the filename as the UIDL and doesn't store it inside the message. I'm wondering whether there is hope for config-file options to keep devecot from renaming files when it first sees them, or whether I'm going to need to create a new backend for dovecot based on Maildir. The renaming not only blows my current UIDLs, it seems to upset Dovecot's indexing, Cheers! -sam My POPstore looks like this: /zdata/domain/%d/folders/%n/{cur, new, tmp}/ and message filenames like this: msg.yyyy:mm:dd:hh:mm:ss.random I was able to get Dovecot to see the store by the symlink: INBOX -> . Here are the log messages regarding the index warnings: Mar 22 07:45:52 POP3(scion(a)6ix.net): Warning: Fixed a duplicate: /zdata/domain/6ix.net/folders/scion/INBOX/cur/msg.2008:02:20:16:37:56.951.2376 -> 1269258346.M323507P15988.mailbase Mar 22 07:45:52 POP3(scion(a)6ix.net): Warning: Fixed a duplicate: /zdata/domain/6ix.net/folders/scion/INBOX/cur/msg.2008:01:08:00:00:50.25142.18396 -> 1269258346.M323508P15988.mailbase ^ |____Dovecot message name appears to increment here #dovecot -c config -n # 1.2.11: /home/scion/Packages/dovecot-1211/dovecot.conf.short Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 640). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.11 i86pc zfs log_path: /dev/stderr protocols: pop3 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/pop3-login mail_uid: popkorn mail_gid: popkorn mail_location: maildir:/zdata/domain/%d/folders/%n:LAYOUT=fs mail_debug: yes maildir_copy_preserve_filename: yes mail_executable: /usr/libexec/dovecot/pop3 mail_plugin_dir: /usr/lib/dovecot/pop3 pop3_enable_last: yes pop3_save_uidl: yes pop3_uidl_format: %f pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain passdb: driver: passwd-file args: scheme=crypt username_format=%n /zdata/domain/%d/userdb userdb: driver: static args: uid=popkorn gid=popkorn home=/zdata/domain/%d/folders/%n

3 2

[Dovecot] configure dovecot to read-only ?
by Frank Gadegast 22 Mar '10

22 Mar '10

Hi, I like to configure the use of IMAP to read-only on a special backup system. Users should only be able to read archived email, they should not be able to create folders or delete email. I know how to configure user- or folder-specific acls, but it seems to be a bit complicated to setup a ACL for every user. Any simple global option available ? Kind regards, Frank -- PHADE Software - PowerWeb http://www.powerweb.de Inh. Dipl.-Inform. Frank Gadegast mailto:frank@powerweb.de Schinkelstrasse 17 fon: +49 33200 52920 14558 Nuthetal OT Rehbruecke, Germany fax: +49 33200 52921 ====================================================================== Public PGP Key available for frank(a)powerweb.de

2 1

[Dovecot] Possible programming error in maildir_mail_get_save_date
by Rainer Weikusat 22 Mar '10

22 Mar '10

The maildir_mail_gate_save_date routine (lib-storage/index/maildir/maildir-mail.c) returns the save date when that was determined by looking at the ctime of the corresponding file. This is different from all other get_save_date routines which either return -1 if the date could not be determined or 0 to signal success. A particular problem caused by this would be that the first_nonexpunged_timestamp routine (plugins/expire/expire-plugin) never finds a not-yet-expired e-mail after the first message in a mailbox has been expunged when using the maildir storage and file ctimes for save dates, causing the expire_mailbox_transaction_commit function (same file) to delete expiry information for the mailbox in question from the expires table despite mails supposed to expire still exist. Patch below is against 1.2.11. ----- Index: dovecot/src/lib-storage/index/maildir/maildir-mail.c =================================================================== RCS file: /sysdata/cvs/dovecot/src/lib-storage/index/maildir/maildir-mail.c,v retrieving revision 1.1.1.2 retrieving revision 1.1.1.2.2.1 diff -u -r1.1.1.2 -r1.1.1.2.2.1 --- dovecot/src/lib-storage/index/maildir/maildir-mail.c 15 Mar 2010 18:18:14 -0000 1.1.1.2 +++ dovecot/src/lib-storage/index/maildir/maildir-mail.c 19 Mar 2010 22:33:44 -0000 1.1.1.2.2.1 @@ -154,7 +154,7 @@ return -1; *date_r = data->save_date = st.st_ctime; - return data->save_date; + return 0; } static int

2 1