- dovecot - dovecot.org

Re: [Dovecot] changing INTERNALDATE or similar
by Karl Rudnick 18 Jul '08

18 Jul '08

Looking at the IMAP4rev1 protocol (RFC 2060), we have the following definition: INTERNALDATE The internal date of the message. 2.3.3. Internal Date Message Attribute The internal date and time of the message on the server. This is not the date and time in the [RFC-822] header, but rather a date and time which reflects when the message was received. In the case of messages delivered via [SMTP], this SHOULD be the date and time of final delivery of the message as defined by [SMTP]. In the case of messages delivered by the IMAP4rev1 COPY command, this SHOULD be the internal date and time of the source message. In the case of messages delivered by the IMAP4rev1 APPEND command, this SHOULD be the date and time as specified in the APPEND command description. All other cases are implementation defined. How could any implementation of this protocol possibly use a file system time stamp to represent that important piece of meta-data, no matter where the file lives? It seems totally reasonable that this is what Outlook uses for the Received date (and I rarely defend Microsoft). This seems like a real design flaw in the dovecot implementation. I am fairly new to dovecot (and like many aspects of it over uw-imap), but having to really be careful with my mail store's mtimes borders on the absurd. I realize it is "implementation defined", but the intent of the definition surely does not refer to file system time stamps. Any chance this can be reconsidered? Is this an actual dovecot issue or a more general Maildir issue? On Fri, 2008-07-18 at 02:00 -0700, dovecot-request(a)dovecot.org wrote: > ------------------------------ > > Message: 4 > Date: Thu, 17 Jul 2008 23:12:55 +0300 > From: Timo Sirainen <tss(a)iki.fi> > Subject: Re: [Dovecot] changing INTERNALDATE or similar > To: richs(a)whidbey.net > Cc: Dovecot Mailing List <dovecot(a)dovecot.org> > Message-ID: <1216325575.31765.349.camel@hurina> > Content-Type: text/plain; charset="utf-8" > > On Thu, 2008-07-17 at 13:04 -0700, richs(a)whidbey.net wrote: > > I believe it's still true that any mail files that are IMAP STORE'd > > (uploaded) > > You mean IMAP APPENDed. > > > to Dovecot by a client will have a current mtime, rather than > > the "Date" in the message. That means might need to compare mtime's > to > > "Date" headers for new files that appear too. > > This is only because the client doesn't specify the date to APPEND > command. > > > Here we just patched Dovecot to treat "INTERNALDATE" the same as the > > "Date" header. Constantly verifying mtime's became too much of a > chore > > for those clients that rely on it (although this technically is > against > > the RFC). > > Would probably have been better to set the default INTERNALDATE based > on > the Date: header in APPEND command. Should be pretty easy to do with > Maildir I think.

3 5

[Dovecot] v1.1.0 released
by Timo Sirainen 18 Jul '08

18 Jul '08

http://dovecot.org/releases/1.1/dovecot-1.1.0.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.0.tar.gz.sig Two hours later than promised, I slept longer than intended. :) No changes since v1.1.rc13. Below are the largest changes since v1.0: * After Dovecot v1.1 has modified index or dovecot-uidlist files, they can't be opened anymore with Dovecot versions earlier than v1.0.2. * See doc/wiki/Upgrading.1.1.txt (or for latest changes, http://wiki.dovecot.org/Upgrading/1.1) for list of changes since v1.0 that you should be aware of when upgrading. + IMAP: Added support for UIDPLUS and LIST-EXTENDED extensions. + IMAP SORT: Sort keys are indexed, which makes SORT commands faster. + When saving messages, update cache file immediately with the data that we expect client to fetch later. + NFS caches are are flushed whenever needed. See mail_nfs_storage and mail_nfs_index settings. + Out of order command execution (SEARCH, FETCH, LIST), nonstandard command cancellation (X-CANCEL <tag>) + IMAP: STATUS-IN-LIST draft implementation + Expire plugin can be used to keep track of oldest messages in specific mailboxes. A nightly run can then quickly expunge old messages from the mailboxes that have them. The tracking is done using lib-dict, so you can use either Berkeley DB or SQL database. + Namespaces are supported everywhere now. + Namespaces have new list and subscriptions settings. + Full text search indexing support with Lucene and Squat backends. + OTP and S/KEY authentication mechanisms (by Andrey Panin). + mbox and Maildir works with both Maildir++ and FS layouts. You can change these by appending :LAYOUT=maildir++ or :LAYOUT=fs to mail_location. + LDAP: Support templates in pass_attrs and user_attrs + Support for listening in multiple IPs/ports. + Quota plugin rewrite: Support for multiple quota roots, warnings, allow giving storage size in bytes or kilo/mega/giga/terabytes, per-mailbox quota rules. + Filesystem quota backend supports inode limits, group quota and RPC quota for NFS. + SEARCH and SORT finally compare non-ASCII characters case-insensitively. We use i;unicode-casemap algorithm. + Config files support splitting values to multiple lines with \

12 26

[Dovecot] Kerberos check logic incorrect
by Bryan Jacobs 18 Jul '08

18 Jul '08

In configure.in, there is a check that does `krb5-config --version | grep -v 1\.2`, making sure there is no "1.2" in the version of Kerberos in use. This is to prevent compiling against MIT Kerberos version 1.2, which is too old for Dovecot. Unfortunately for this idea, Heimdal 1.2.1 is out. And Dovecot builds fine against it. Whoever committed this check also appears to have removed the comment warning that it was broken, to add insult to injury. Please fix your checks to be for FEATURES, not version numbers. You never know when something else that correctly implements the features you want will come along. Bryan Jacobs

2 1

Re: [Dovecot] changing INTERNALDATE or similar
by Rudnick, Karl 18 Jul '08

18 Jul '08

I successfully executed the script which "fixed" my mail store. I also see now why there isn't a buttoned down solution out there. The basic steps are simple as outlined below, but when dealing with ~35,000 emails going back before 1993, there were just about a dozen that didn't adhere to the "Date:" screening and subsequent capture for use by "touch --date". Adding these exceptions to my script completely automated the INTERNALDATE resetting, but I would not publish this publicly on the internet. Nevertheless, I would share it with anyone who requests through this mail group given the caveat that it is only guaranteed to work for MY personal data store. Thanks - Karl -----Original Message----- From: Rudnick, Karl Sent: Thursday, July 17, 2008 9:06 AM To: dovecot(a)dovecot.org Cc: Timo Sirainen Subject: RE: [Dovecot] changing INTERNALDATE or similar Terrific - I'll just write a script to: 1. create a list of all Maildir folders ending in "/cur" 2. remove dovecot.index* in each folder 3. For each mail file in each Mailder /cur folder: a. grep/sed "Date:" to grab first date/time stamp in email b. pipe the output of a. into "touch --date" for that file On my windows side, all the imap info is saved in one pst file in "C:\Documents and Settings\<user>\Local Settings\Application Data\Microsoft\Outlook\Outlook*imap*.pst" and if I blow it away it gets correctly rebuilt - I just tested it and the blown away index files get rebuilt so that Outlook then has the correct Received date displayed. Pretty easy to do, but surprised a script wasn't openly available - or at least my googling skills weren't good enough. Since I have ~35,000 emails in about 450 folders, this needs to be scripted. I'll make it available when I get it smoothed out. Thanks again for the clarification. - Karl -----Original Message----- From: Timo Sirainen [mailto:tss@iki.fi] Sent: Thursday, July 17, 2008 4:58 AM To: Rudnick, Karl; Dovecot Mailing List Subject: Re: [Dovecot] changing INTERNALDATE or similar On Wed, 2008-07-16 at 16:56 -0700, Karl Rudnick wrote: > I have a question which others must have encountered. I switched from > uw-imap to dovecot-imap a few months ago and moved my fairly large mail > archive (~15 yrs) by simply mounting both accounts in a mail app and > simply copying my folders over. This worked well, and all my mail is in > order when I view it in evolution or thunderbird on any number of > machines. However, since our company uses MS Exchange Server, when I add > my dovecot imap account to outlook, everything is great except the > received dates - it looks like the date I made the transition, but in > all instances it's not simply the time stamp in the Maildir folder. I > googled around on this and have gathered that this date is coming > somewhere from within the dovecot index file. INTERNALDATE comes from the maildir files' mtimes. So you can use whatever utility/script you want to modify the mtime (I don't have any suggestions). Then delete dovecot.index.cache file to make sure the old value wasn't cached. You might also have to recreate the account in your clients to make sure they haven't cached the old values.

1 0

[Dovecot] changing INTERNALDATE or similar
by Karl Rudnick 17 Jul '08

17 Jul '08

I have a question which others must have encountered. I switched from uw-imap to dovecot-imap a few months ago and moved my fairly large mail archive (~15 yrs) by simply mounting both accounts in a mail app and simply copying my folders over. This worked well, and all my mail is in order when I view it in evolution or thunderbird on any number of machines. However, since our company uses MS Exchange Server, when I add my dovecot imap account to outlook, everything is great except the received dates - it looks like the date I made the transition, but in all instances it's not simply the time stamp in the Maildir folder. I googled around on this and have gathered that this date is coming somewhere from within the dovecot index file. Is there a utility for scanning that so I can ascertain where the date shown in Outlook is coming from? Is there also a utility which would just reset the INTERNALDATE (or whatever it is that Outlook is keying on) to the date in the message on the "Date: ..." line? This issue is not life threatening as I don't use Outlook much, but when I do, it is confusing to not have the "Received" column be meaningful, especially for sorting. Thanks for any help - Karl

4 4

[Dovecot] Change text from default overquota message - Possible?
by k bah 17 Jul '08

17 Jul '08

I'm using Dovecot 1.0.5-6 (SuSE 10.3) and using dovecot deliver. Is it possible to change the subject/body of the default overquota message (it says "Automatically rejected mail" on the subject) and also the text from the message? I don't wan't to "hack" anything, just if it's possible to do by editing config files. thanks = Web-Based Privileges Certification Quickly setup a collaborative Web-based facility for business managers to certify authorizations and IT privileges. Satisfy requirements for SOX, HIPAA, Privacy, and other regulations. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a526c7aa7690b483fc8ec20… -- Powered by Outblaze

2 1

[Dovecot] thanks
by Andrew Schulman 17 Jul '08

17 Jul '08

Here's just a note of thanks to the developers of Dovecot. I first starting using just the Dovecot IMAP server about a year ago, and it's been working fine for that. More recently I've started to use the managesieve and LDA components as well, and what I find now is that this system works well and is straightforward to configure, well-integrated, and relatively well documented. Also, the LDA has a significantly stronger set of sieve capabilities than exim's. All in all, Dovecot is doing a lot of work for me now and doing it well. Hats off to the developers. Andrew.

1 0

[Dovecot] question dbox folders subscription
by Robert Schetterer 17 Jul '08

17 Jul '08

Hi, creating a imap dbox folder and deletion now works with thunderbird, but the subscription file seems not be updated ,somekind. After the deletion of a folder it apears again after restart thunderbird .Then ,by click on it , you get message , folder not exists ( which is true ) but for disapaer the folder must be be manually unsubscribed. this isnt the same behavior like i.e with maildir with maildir the deleted folder shows up too, after restart, but with clicking on it, it disapaers without any message to tb anyone an idea to this? -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 3

[Dovecot] child xxxxx (imap) returned error 83 (Out of memory)
by martin f krafft 17 Jul '08

17 Jul '08

Hi list, > Jul 17 12:15:10 seamus dovecot: IMAP(someone(a)somehost.org): block_alloc(): Out of memory > Jul 17 12:15:10 seamus dovecot: child 26181 (imap) returned error 83 (Out of memory) I found those two entries in the logs this morning. The system has ample free memory. What's going on? -- martin | http://madduck.net/ | http://two.sentenc.es/ "i wish i hadn't slept all day, it's really lowered my productivity" -- robert mcqueen spamtraps: madduck.bogus(a)madduck.net

2 3

[Dovecot] folder deletion fails dbox
by Robert Schetterer 17 Jul '08

17 Jul '08

Hi Timo, playing a lot with dbox but folder deletion seems to me broken, whatever setting i tested i cant delete subfolders with thunderbird, i first thought about acls but deactivate acl didnt helped splitting control an index files from dbox also didnt work, i cant find any failure message in the logs, but there is also no entry for delete trys all debug level are in the highest stage on this testing server i used the last 1.1.1 from the debian rep wich is brand new from tonight as your expansion patch from %d with deliver is included and works -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 2