April 2006 - dovecot - dovecot.org

[Dovecot] Re: mail shown throught outlook, shows todays date
by richs＠whidbey.net 03 May '06

03 May '06

> bclark wrote: > > > The interesting thing is, once I have some mail on the dovecot, > the date > > displayed on Mozilla is correct, but the mail shown throught > outlook, > > shows todays date (thats for all mail). > > Each mail has (at least) two dates : the date it was sent (stored > in the > headers), and the date it arrived (in Maildir, the date of the > file). Most > likely, Mozilla and SquirrelMail are showing the date in the > headers, and Outloo > is showing the arrival date. > > This problem has come up a few times, I believe. As I recall, most > mail clients > allow you to select which date to sort by. If you can't find the > option, it may > be somewhere in this list's archives. > > > Almost seems as Outlook (office 2000) looks at the date / time > stamp of > > the file it self as opposed to opening and reading the mail and > reading > > the necassry tags. > > That's my assessment, also. > > > If anyone could help me understand this (is this a dovecot issue), I > > would really appreciate it. > > I don't believe it's a dovecot issue, per se. > > -- > Curtis Maloney > cmaloney <at> cardgate.net I've been testing Dovecot 1.0beta7 to implement IMAP for the first time, and have had a good experience so far. But like Curtis and Brent, I found that Outlook and Outlook Express display "incorrect" dates on messages uploaded via APPEND. That's because they sort messages using INTERNALDATE: wea3 SELECT "Test Folder" pqng UID FETCH 1:* (UID FLAGS RFC822.SIZE BODY.PEEK[HEADER] INTERNALDATE) Some have created scripts to sync file timestamps with "Date" headers, which conflicts with the concept of "INTERNALDATE". Others ask users to add the "Date Sent" column, but those dates are only revealed after a message is viewed. I'd like to propose the attached patch to add an optional "outlook- dates" IMAP workaround, which returns the message "Date:" even when INTERNALDATE is specified. Since "BODY.PEEK" is being called anyway, our tests didn't reveal any performance impact. Can anyone think of a scenario this would negatively impact? Another option might be to patch the APPEND function? Thanks! Rich Sandberg richs(a)whidbey.net

4 7

[Dovecot] Expunge is not expunging unless it is called twice
by Bill Boebel 03 May '06

03 May '06

Dovecot is requiring two "expunge" calls before it deletes an email. It just seems to ignore the first expunge call, leaving the email file in the maildir cur/ folder. Any idea why? I even waited 10 seconds after setting the Deleted flag, but still the first expunge call did nothing.... 1 OK User logged in 2 select "INBOX" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 12 EXISTS * 0 RECENT * OK [UIDVALIDITY 1144082550] UIDs valid * OK [UIDNEXT 1509] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID STORE 1511 +FLAGS (\Deleted) * 12 FETCH (UID 1508 FLAGS (\Deleted \Seen)) 3 OK Store completed. 4 expunge 4 OK Expunge completed. 5 expunge * 12 EXPUNGE 5 OK Expunge completed.

2 1

[Dovecot] errors while testing with imaptest
by Jens Laas 03 May '06

03 May '06

I get lots of these (in error log): dovecot: Apr 28 14:50:03 Error: IMAP(jenslt): Corrupted index cache file /home0/jenslt/.imap/INBOX/dovecot.index.cache: record points outside file And some of these: dovecot: Apr 28 14:50:03 Error: IMAP(jenslt): Corrupted index cache file /home0/jenslt/.imap/INBOX/dovecot.index.cache: field index too large (2037149797 >= 19) Should I worry or not? (Assuming its not due to me having broken imaptest). This was with command: imaptest jenslt@xxxx:yyy pass=xxxx clients=40 msgs=300 Local software raid 5 on linux 2.6.16.11 on reiserfs. Cheers, Jens ----------------------------------------------------------------------- 'Old C programmers don't die ... they're just cast into void*' ----------------------------------------------------------------------- Jens Låås Email: jens.laas(a)data.slu.se Department of Computer Services, SLU Phone: +46 18 67 35 15 Vindbrovägen 1 P.O. Box 7079 S-750 07 Uppsala SWEDEN -----------------------------------------------------------------------

2 1

[Dovecot] Dovecot LDA - Performance/issues versus postfix delivery? Also, installing on OS X?
by Dean Blackburn 03 May '06

03 May '06

Can anyone give me an idea of whether or not dovecot-lda can solve the following issue: We seem to have constantly-corrupting dovecot* files for people who fit one (or more) of the following categories: 1) 1000+ message inboxes; 2) multiple clients simultaneously checking mail; 3) people receiving a lot of mail, and/or the server receiving and trying to deliver a single message to all users at once We're using straight postfix maildir delivery, and while the mail keeps coming, we start to see a lot of "temp.xxxx.xxxx.xxx" type lockfiles build up after any inconsistencies appear in the Inbox indexes, and clients start to report timeouts and/or crash as a result. Would switching to LDA by itself resolve this issue (on the argument that delivery would ALSO update the indexes every time), or is there some more fundamental issue we are having that is causing the inconsistency to arise? On a related note: I noticed the darwinports version of 1.0beta7 does not include the code for dovecot-lda... Does anyone have experience setting this up? Thanks! -deano

3 3

[Dovecot] blank forwarded messages
by lenny＠edpausa.com 02 May '06

02 May '06

Just switched from uw to dovecot ( latest beta3 + lda ) on production system and everything seems fine except... There's some strange problem with forwarding messages from thundebird, the body of the forwarded message is always completely blank - 0 byte size. Forwarding from squrrel, horde, eudora and outlook works fine. Client setup on thunderbird installs hasn't changed a bit. I'm still investigating why this is happening. Has anyone run into this ?

1 2

Re: [Dovecot] Maildir + NFS + multiple machines = spectacular failure
by Apps Lists 02 May '06

02 May '06

Rich, We're also in the process of setting up a GFS/Cluster with CentOS. I'm hopeful this will eliminate some of the issues. I'll keep everyone posted. Steve > Hi Steve, > > We'll give that a try. I'm sure users would prefer a slightly slower > mail experience if it ensured accurate mail lists and reduced the > chance for lost mail. > > Rich Sandberg > richs(a)whidbey.net > Systems & Network Administrator > Whidbey Telecom Network Operations > > > > On Apr 28, 2006, at 9:37 AM, Apps Lists wrote: > >> Hi Rich. >> >> I've seen a lot of the same IMAP errors... haven't played with POP >> yet. >> >> You might want to try adding "noac" to the mount options... your >> line.. >> >> nfshost:/var/mail /var/mail nfs >> rw,hard,intr,rsize=8192,wsize=8192 0 0 >> >> .... would become: >> >> >> nfshost:/var/mail /var/mail nfs >> rw,hard,intr,rsize=8192,wsize=8192,noac 0 0 >> >> >> .... and see if that helps. I haven't seen much if any difference. >> >> What I don't understand is how some people are running what appears >> to be >> the same configuration ... RHEL/CentOS ... NFS3, 2+ Dovecot >> machines with >> IMAP and have no problems. >> >> I'd love to get to the bottom of this. >> >> Steve >> >>> We're using 2.6.9-34, the latest RHEL4 kernel, over NFSv3 with 3 >>> Dovecot servers. Our most concerning episode was a failed APPEND >>> operation (with a set of folders containing 200 messages): >>> >>> IMAP(username): Corrupted transaction log file /var/mail/username/ >>> Maildir/dovecot.index.log: unexpected end of file while reading >>> header >>> >>> That resulted in one of the new APPENDed mail folders and content >>> being lost. We see those errors at other times too, although they >>> don't always end in a noticeable failure. >>> >>> Continuous other errors we see that might be NFS related: >>> >>> IMAP(username): close() failed with index cache file /var/mail/ >>> username/Maildir/.Deleted Messages/dovecot.index.cache: Stale NFS >>> file >>> handle >>> IMAP(username): Corrupted index cache file /var/mail/username/ >>> Maildir/.OldMail/dovecot.index.cache: invalid record size >>> IMAP(username): close() failed with index file /var/mail/username/ >>> Maildir/.INBOX.Security/dovecot.index: Bad file descriptor >>> >>> We also see errors with POP3, which would rarely benefit from indexes >>> (since 92% of our users RETR-and-DELE messages): >>> >>> POP3(username): file_dotlock_create() failed with file /var/mail/ >>> username/Maildir/dovecot.index.log: Stale NFS file handle >>> POP3(username): Corrupted transaction log file /var/mail/username/ >>> Maildir/dovecot.index.log: record size too small (type=0x8080, >>> offset=9056, size=0) >>> POP3(username): Our dotlock file /var/mail/username/Maildir/ >>> dovecot.index.log.lock was deleted (kept it -118 secs) >>> POP3(username): Timeout while waiting for release of dotlock for >>> transaction log file /var/mail/username/Maildir/dovecot.index.log >>> >>> We've tried manually removing "dovecot*" from all folders, allowing >>> the indexes to be re-built, but the errors return. >>> >>> Excerpt from our config: >>> >>> mail_cache_fields mail_never_cache_fields mail_cache_min_mail_count >>> >> 1000 mailbox_idle_check_interval = 10 mail_full_filesystem_access >>> = no >>> mail_read_mmaped = no >>> mmap_disable = yes >>> mmap_no_write = no >>> lock_method = dotlock >>> maildir_stat_dirs = yes >>> maildir_copy_with_hardlinks = no >>> >>> Our NFS mount: >>> >>> nfshost:/var/mail /var/mail nfs >>> rw,hard,intr,rsize=8192,wsize=8192 0 0 >>> >>> I've read some of the list archives about disabling the index files. >>> We realize that indexes should be beneficial, but we'd like to at >>> least experiment with a "no index" install. This would solve some of >>> the NFS locking issues, eliminate the need to modify our MTA >>> behavior, and remove (potentially) millions of files from the system. >>> >>> Did anyone discover a method to cleanly disable the indexes? At least >>> for POP3? >>> >>> Thanks! >>> >>> Rich Sandberg >>> richs(a)whidbey.net >>> >>> >>> On Apr 28, 2006, at 6:59 AM, Luis Melendez wrote: >>> >>>> Hi all. >>>> We also had problems with client NFS locking using RHEL4, kernel >>>> 2.6.9 >>>> Some of them were solved updating the kelnel from RedHat. >>>> Hope this helps. >>>> >>>> Regards. >>>> >>>> Apps Lists wrote: >>>> >>>>> I'm running beta7 on two machines, with maildir on NFS. I have >>>>> lockd >>>>> running on all machines. I've found that Dovecot is highly >>>>> unstable with >>>>> NFS when accessing a mailbox on more than one machine at the same >>>>> time. >>>>> >>>>> Both dovecot machines have: >>>>> >>>>> mmap_disable = yes >>>>> lock_method = fcntl >>>>> >>>>> NFS is version 3, exported from a third linux machine. All >>>>> machines are >>>>> running 2.6.9 kernel. >>>>> >>>>> Any ideas what's going wrong here? >>>>> >>>>> Steve >>>>> >>>>> >>>>> *** dev4 *** >>>>> >>>>> Apr 28 09:17:40 dev4 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146230258.P2889Q0M407851.dev4.neonova.net:2, >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Extension >>>>> introduction for unknown id 0 >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: IMAP(jtest): file mail-index.c: line >>>>> 883 >>>>> (mail_index_sync_from_transactions): assertion failed: >>>>> (hdr.log_file_int_offset == (*map)->hdr.log_file_int_offset) >>>>> >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: child 2889 (imap) killed with >>>>> signal 6 >>>>> >>>>> >>>>> *** dev3 *** >>>>> >>>>> >>>>> >>>>> Apr 28 09:17:39 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146230254.P2888Q0M651598.dev4.neonova.net >>>>> >>>>> Apr 28 09:17:41 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4036 -> 1772 >>>>> >>>>> Apr 28 09:17:44 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4036 -> 1774) >>>>> >>>>> Apr 28 09:17:45 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146145480.P5976Q0M245663.dev3.neonova.net:2, >>>>> >>>>> Apr 28 09:17:46 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4038 -> 1774 >>>>> >>>>> Apr 28 09:17:47 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4038 -> 1775) >>>>> >>>>> Apr 28 09:17:48 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146145480.P5976Q0M245663.dev3.neonova.net:2, >>>>> >>>>> Apr 28 09:17:49 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4039 -> 1775) >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Extension >>>>> introduction for unknown id 0 >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): file mail-index.c: line >>>>> 881 >>>>> (mail_index_sync_from_transactions): assertion failed: >>>>> (hdr.messages_count >>>>> == (*map)->hdr.messages_count) >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4039 -> 1775) >>>>> >>>>> Apr 28 09:17:51 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Append with >>>>> UID >>>>> 1775, but next_uid = 4039 >>>>> >>>>> Apr 28 09:17:51 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Append with >>>>> UID >>>>> 1775, but next_uid = 4039 >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Unexpected >>>>> transaction log >>>>> desync with index /var/mailstore/72/af/375887/Maildir/dovecot.index >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Disconnected: >>>>> Mailbox is >>>>> in >>>>> inconsistent state, please relogin. >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4039 -> 1776 >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> +---------------------------------------------- >>>> ^-----------------------+ >>>> | Luis Meléndez Aganzo ^ Email: >>>> luism(a)uco.es | >>>> | Servicio de Informática ^ Tlf: 34-(9) >>>> 57-211022 | >>>> | Analista - Área de Sistemas ^ Fax: 34-(9) >>>> 57-218116 | >>>> | Universidad de Córdoba (SPAIN) ^ http:// >>>> www.uco.es | >>>> +---------------------------------------------- >>>> ^-----------------------+

3 5

[Dovecot] fedora core 4 + mysql 5 + dovecot
by dave 02 May '06

02 May '06

hi all just a quick question i have dovecot (0.99.14 yum install) running on my fc4 server to get this working, i had to downgrade from mysql 5 to fedora's mysql rpm's i really would prefer to use mysql 5, but to satisfy the dependencies, i had to go to mysql 4 now, i just want to know if there is an rpm (linux rather than specific fc4 version is fine) out there for dovecot, that i can use with mysql 5 definitely prefer rpm's to src as i don't really like getting into the nitty gritty of config/setup thanks dave -- http://dtracorp.com

2 2

[Dovecot] How to notify dovecot that maildir contents is changed by third-party helper ?
by Илья Евсеев 02 May '06

02 May '06

Hi, folks! How to notify dovecot that maildir contents is changed by third-party helper? My script performs spam cleanup, but all index/cache files (dovecot-uidlist, dovecot.index, dovecot.index.cache and dovecot.index.log) still unchanged, so, Web-frontend (IlohaMail over IMAP) displays taht mailbox contents isn't refreshed. Dovecot 1.0-alpha5 under FreeBSD 4.11. mail = maildir:/var/vmail/default/%1n/%n WBR, Ilya ------------------------------------------------- #!/bin/bash # # CleanupMailboxSpam # # Tracks mail directories of Dovecot IMAP server # and moves/removes all messages marked as spam by SpamAssassin: # # * When mailbox contains "KillSpam.<number>" subfolder, # all spam messages with score >= <number> are removed. # * When mailbox contains "Spam" subfolder, # all remaining spam messages are moved to this subfolder. # * When mailbox contains "KillSpam" subfolder, # all remaining spam messages are removed. # # TODO: update indexes and caches on altered mail folders!!! # # Only for testing: doit=echo; export doit; ... # This prints all modification commands instead of executing them. # # Written at Apr 2006 by evseev(a)sertolovo.ru # VMAIL_TOPDIR=/var/vmail FIND_DEPTH=4 # Debugging values VMAIL_TOPDIR=/var/vmail/default/e/evseev FIND_DEPTH=1 INBOX_DIRNAME=cur KILLSPAM_DIRNAME='.KillSpam' SPAM_DIRNAME='.Spam' MSGHEADLEN=30 RM="/bin/rm -f" MV="/bin/mv -f" #========= Routines ==========================================# IsSpamFile() { local msgfile="$1" score2clean="$2" local spamstatus=$(head -$MSGHEADLEN "$msgfile" | egrep '^X-Spam-Status: Yes') test -z "$spamstatus" && return 1 if [ -n "$score2clean" ]; then local spamscore=${spamstatus##*score=} spamscore=${spamscore%%.*} test "$spamscore" -lt "$score2clean" && return 1 fi return 0 } KillSpamInFolder() # $1 = kill-label folder to check { local dir2clean=$(dirname $1)/$INBOX_DIRNAME local score2clean=$(basename $1) score2clean=${score2clean##${KILLSPAM_DIRNAME}.} test "$score2clean" -ge 1 -a "$score2clean" -le 50000 > /dev/null 2>&1 || score2clean= find "$dir2clean" -type f | while read f; do IsSpamFile "$f" "$score2clean" && $doit $RM "$f" done } MoveSpamToFolder() # $1 = spam folder to consume spam { local dir2check=$(dirname $1)/$INBOX_DIRNAME find "$dir2check" -type f | while read f; do IsSpamFile "$f" && $doit $MV "$f" "${1}/$INBOX_DIRNAME" done } DoOnSubFolders() # $1 = dirmask to find, $2 = action to apply { find $VMAIL_TOPDIR/ -mindepth $FIND_DEPTH -maxdepth $FIND_DEPTH \ -type d -iname "$1" \ | while read d; do "$2" "$d" done } #========= Main ==============================================# DoOnSubFolders "${KILLSPAM_DIRNAME}?*" KillSpamInFolder DoOnSubFolders "${SPAM_DIRNAME}" MoveSpamToFolder DoOnSubFolders "${KILLSPAM_DIRNAME}" KillSpamInFolder ## EOF ##

2 1

[Dovecot] Documentation for ACL support
by Michael Renner 02 May '06

02 May '06

Hi, the changelog of beta4 suggested that ACL support was added but I couldn't find any documentation for it neither in the tarball nor in the wiki. Timo, do you already have some writeups regarding the ACLs or do I have to RTFS? best regards, Michael

2 1

[Dovecot] FreeBSD 6 - DirectAdmin - dovecot
by Floris van den Berg 29 Apr '06

29 Apr '06

Since version 1.0 I experience strange problems with dovecot. At the moment I have beta 7 installed. I use FreeBSD 6.0. * Pop3 works * Imap works, but only when i telnet to localhost * In all other cases I can't connect to the server. Tried with squirrelmail, uebimau and thunderbird. Squirrelmail after a long time waiting: "ERROR: Connection dropped by IMAP server." Happens too with firewall switched off. Happens too when i restart exim and dovecot. /var/log/maillog mentions something about Inactivity. When i do tail -f /var/log/maillog and try to connect using squirrel, i see hardly any imap messages fly by, except 'inactivity'. Any ideas? Floris

1 0