- dovecot - dovecot.org

[Dovecot] create_dovecot_shares
by Gavin Henry 02 May '06

02 May '06

Dear All, We've been working on this for a client to help create and manage maildir shares, via the dovecot-shared file. Our problems are creating lots of dovecot-shared files and permissions and monitoring new Maildir folders that get added by the user (maybe a better way, would love to know). The tool is almost done, with the docs at: http://www.suretecsystems.com/our_docs/create_dovecot_shares.html Maybe this can be of use to others when it's finished. Thanks, Gavin. P.S> Might be redundant a little when the ACLs are complete, as per Timos' e-mail earlier today: http://dovecot.org/pipermail/dovecot/2006-May/012991.html -- Kind Regards, Gavin Henry. Managing Director. T +44 (0) 1224 279484 M +44 (0) 7930 323266 F +44 (0) 1224 742001 E ghenry(a)suretecsystems.com Open Source. Open Solutions(tm). http://www.suretecsystems.com/

2 3

[Dovecot] Assertion failed
by Jonathan Knight 02 May '06

02 May '06

We're in a bit of a panic here as we're getting a lot of errors along the lines of: May 2 12:39:00 lenny dovecot: IMAP(XXXXX): file mbox-sync-rewrite.c: line 106 (mbox_sync_headers_add_space): assertion failed: (start_pos < data_size) We didn't see this until our mail servers went under a full load and now we've trashed the ability of nearly all our users to read email. We saw this first under 1.0Beta3 and we've tried building 1.0Beta7 and its made no difference. I've tried fiddling with the "dirty" settings for the indices and banning mmap to see if there's any way way of avoiding the broken code, but with no luck. We're running White Box EL4 (2.6 Linux kernel) Does anyone know a workaround or whether there is an older version that doesn't have the bug? We desperately need to get an email service running and I don't want to go back to (shudder) UW-imap if I can help it but my options are limited at the moment. -- ______ J.Knight(a)kis.keele.ac.uk Jonathan Knight, / Keele Information Services / _ __ Telephone: +44 1782 583478 University of Keele, Keele, (_/ (_) / / Fax : +44 1782 713082 Staffordshire. ST5 5BG. U.K.

5 9

[Dovecot] Dovecot and NFS with file locking
by Nate Sanders 02 May '06

02 May '06

Greetings all, I'm trying to get an understanding of a problem we are facing here. We're currently running dovecot 1.0-beta3 and have a long standing issue of system crashes on our mail server (Debian Linux 2.4.27-2-k7-smp). Here's what is happening: The machine hangs and the system load climbs as high as 80.0+. Yet, the system response is not effected. Command line is still responds instantly. There are multiple running dovecot PIDs, even if I stop the service. If I try to kill or -9 the PIDs, they will not die. The machine is DOA and must be forcefully restarted. Issuing a reboot will cause the machine to hang when it attempts to unmount network shares. Here's the setup: - Dovecot 1.0-beta3 - lock_method = dotlock - mmap_disable = yes /var/mail is store locally on the mail server and access via NFS to ALL remote machines. All remote machines have /var/mail sym linked to the NFS share on Mail. /home on Mail is NFS'd to another set of servers where IMAP mail folders reside in mbox format. All client machines have /home sym linked to the second NFS server. In other words, there's a lot of NFS shares and one mail transaction can involve 3 machines. What I'm trying to find out is the current state of NFS locking with Dovecot. This system hang happens 1-3 times a week. The current /home NFS mounts are running from SGI machines on IRIX 6.5. Clients are all Linux (debian) 2.4 or Linux (ubuntu) 2.6. Is our setup too much for Dovecot to handle? Are there other variables we're not looking at here? Thanks everyone. -- ============================================== Nate Sanders nate(a)ima.umn.edu Associate Systems Manager (612) 624 - 4353 http://www.ima.umn.edu/ ============================================== Institute for Mathematics and its Applications University of Minnesota 400 Lind Hall, 207 Church St. SE Minneapolis, MN 55455-0463 ==============================================

3 4

[Dovecot] blank forwarded messages
by lenny＠edpausa.com 02 May '06

02 May '06

Just switched from uw to dovecot ( latest beta3 + lda ) on production system and everything seems fine except... There's some strange problem with forwarding messages from thundebird, the body of the forwarded message is always completely blank - 0 byte size. Forwarding from squrrel, horde, eudora and outlook works fine. Client setup on thunderbird installs hasn't changed a bit. I'm still investigating why this is happening. Has anyone run into this ?

1 2

Re: [Dovecot] FreeBSD 6 - DirectAdmin - dovecot
by Floris van den Berg 02 May '06

02 May '06

Jim Trigg schreef: > On Tue, May 2, 2006 1:15 am, Floris van den Berg wrote: > >> Since version 1.0 I experience strange problems with dovecot. At the >> moment I have beta 7 installed. I use FreeBSD 6.0. >> >> * Pop3 works >> * Imap works, but only when i telnet to localhost >> * In all other cases I can't connect to the server. Tried with >> squirrelmail, uebimau and thunderbird. Squirrelmail after a long time >> waiting: "ERROR: Connection dropped by IMAP server." >> > > What happens if you try to telnet to the imap port other than localhost? > > Jim > > Hi, that works too. It didn't work before because i didn't properly disable the firewall. Floris

2 4

Re: [Dovecot] Maildir + NFS + multiple machines = spectacular failure
by Apps Lists 02 May '06

02 May '06

Rich, We're also in the process of setting up a GFS/Cluster with CentOS. I'm hopeful this will eliminate some of the issues. I'll keep everyone posted. Steve > Hi Steve, > > We'll give that a try. I'm sure users would prefer a slightly slower > mail experience if it ensured accurate mail lists and reduced the > chance for lost mail. > > Rich Sandberg > richs(a)whidbey.net > Systems & Network Administrator > Whidbey Telecom Network Operations > > > > On Apr 28, 2006, at 9:37 AM, Apps Lists wrote: > >> Hi Rich. >> >> I've seen a lot of the same IMAP errors... haven't played with POP >> yet. >> >> You might want to try adding "noac" to the mount options... your >> line.. >> >> nfshost:/var/mail /var/mail nfs >> rw,hard,intr,rsize=8192,wsize=8192 0 0 >> >> .... would become: >> >> >> nfshost:/var/mail /var/mail nfs >> rw,hard,intr,rsize=8192,wsize=8192,noac 0 0 >> >> >> .... and see if that helps. I haven't seen much if any difference. >> >> What I don't understand is how some people are running what appears >> to be >> the same configuration ... RHEL/CentOS ... NFS3, 2+ Dovecot >> machines with >> IMAP and have no problems. >> >> I'd love to get to the bottom of this. >> >> Steve >> >>> We're using 2.6.9-34, the latest RHEL4 kernel, over NFSv3 with 3 >>> Dovecot servers. Our most concerning episode was a failed APPEND >>> operation (with a set of folders containing 200 messages): >>> >>> IMAP(username): Corrupted transaction log file /var/mail/username/ >>> Maildir/dovecot.index.log: unexpected end of file while reading >>> header >>> >>> That resulted in one of the new APPENDed mail folders and content >>> being lost. We see those errors at other times too, although they >>> don't always end in a noticeable failure. >>> >>> Continuous other errors we see that might be NFS related: >>> >>> IMAP(username): close() failed with index cache file /var/mail/ >>> username/Maildir/.Deleted Messages/dovecot.index.cache: Stale NFS >>> file >>> handle >>> IMAP(username): Corrupted index cache file /var/mail/username/ >>> Maildir/.OldMail/dovecot.index.cache: invalid record size >>> IMAP(username): close() failed with index file /var/mail/username/ >>> Maildir/.INBOX.Security/dovecot.index: Bad file descriptor >>> >>> We also see errors with POP3, which would rarely benefit from indexes >>> (since 92% of our users RETR-and-DELE messages): >>> >>> POP3(username): file_dotlock_create() failed with file /var/mail/ >>> username/Maildir/dovecot.index.log: Stale NFS file handle >>> POP3(username): Corrupted transaction log file /var/mail/username/ >>> Maildir/dovecot.index.log: record size too small (type=0x8080, >>> offset=9056, size=0) >>> POP3(username): Our dotlock file /var/mail/username/Maildir/ >>> dovecot.index.log.lock was deleted (kept it -118 secs) >>> POP3(username): Timeout while waiting for release of dotlock for >>> transaction log file /var/mail/username/Maildir/dovecot.index.log >>> >>> We've tried manually removing "dovecot*" from all folders, allowing >>> the indexes to be re-built, but the errors return. >>> >>> Excerpt from our config: >>> >>> mail_cache_fields mail_never_cache_fields mail_cache_min_mail_count >>> >> 1000 mailbox_idle_check_interval = 10 mail_full_filesystem_access >>> = no >>> mail_read_mmaped = no >>> mmap_disable = yes >>> mmap_no_write = no >>> lock_method = dotlock >>> maildir_stat_dirs = yes >>> maildir_copy_with_hardlinks = no >>> >>> Our NFS mount: >>> >>> nfshost:/var/mail /var/mail nfs >>> rw,hard,intr,rsize=8192,wsize=8192 0 0 >>> >>> I've read some of the list archives about disabling the index files. >>> We realize that indexes should be beneficial, but we'd like to at >>> least experiment with a "no index" install. This would solve some of >>> the NFS locking issues, eliminate the need to modify our MTA >>> behavior, and remove (potentially) millions of files from the system. >>> >>> Did anyone discover a method to cleanly disable the indexes? At least >>> for POP3? >>> >>> Thanks! >>> >>> Rich Sandberg >>> richs(a)whidbey.net >>> >>> >>> On Apr 28, 2006, at 6:59 AM, Luis Melendez wrote: >>> >>>> Hi all. >>>> We also had problems with client NFS locking using RHEL4, kernel >>>> 2.6.9 >>>> Some of them were solved updating the kelnel from RedHat. >>>> Hope this helps. >>>> >>>> Regards. >>>> >>>> Apps Lists wrote: >>>> >>>>> I'm running beta7 on two machines, with maildir on NFS. I have >>>>> lockd >>>>> running on all machines. I've found that Dovecot is highly >>>>> unstable with >>>>> NFS when accessing a mailbox on more than one machine at the same >>>>> time. >>>>> >>>>> Both dovecot machines have: >>>>> >>>>> mmap_disable = yes >>>>> lock_method = fcntl >>>>> >>>>> NFS is version 3, exported from a third linux machine. All >>>>> machines are >>>>> running 2.6.9 kernel. >>>>> >>>>> Any ideas what's going wrong here? >>>>> >>>>> Steve >>>>> >>>>> >>>>> *** dev4 *** >>>>> >>>>> Apr 28 09:17:40 dev4 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146230258.P2889Q0M407851.dev4.neonova.net:2, >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Extension >>>>> introduction for unknown id 0 >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: IMAP(jtest): file mail-index.c: line >>>>> 883 >>>>> (mail_index_sync_from_transactions): assertion failed: >>>>> (hdr.log_file_int_offset == (*map)->hdr.log_file_int_offset) >>>>> >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: child 2889 (imap) killed with >>>>> signal 6 >>>>> >>>>> >>>>> *** dev3 *** >>>>> >>>>> >>>>> >>>>> Apr 28 09:17:39 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146230254.P2888Q0M651598.dev4.neonova.net >>>>> >>>>> Apr 28 09:17:41 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4036 -> 1772 >>>>> >>>>> Apr 28 09:17:44 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4036 -> 1774) >>>>> >>>>> Apr 28 09:17:45 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146145480.P5976Q0M245663.dev3.neonova.net:2, >>>>> >>>>> Apr 28 09:17:46 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4038 -> 1774 >>>>> >>>>> Apr 28 09:17:47 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4038 -> 1775) >>>>> >>>>> Apr 28 09:17:48 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146145480.P5976Q0M245663.dev3.neonova.net:2, >>>>> >>>>> Apr 28 09:17:49 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4039 -> 1775) >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Extension >>>>> introduction for unknown id 0 >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): file mail-index.c: line >>>>> 881 >>>>> (mail_index_sync_from_transactions): assertion failed: >>>>> (hdr.messages_count >>>>> == (*map)->hdr.messages_count) >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4039 -> 1775) >>>>> >>>>> Apr 28 09:17:51 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Append with >>>>> UID >>>>> 1775, but next_uid = 4039 >>>>> >>>>> Apr 28 09:17:51 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Append with >>>>> UID >>>>> 1775, but next_uid = 4039 >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Unexpected >>>>> transaction log >>>>> desync with index /var/mailstore/72/af/375887/Maildir/dovecot.index >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Disconnected: >>>>> Mailbox is >>>>> in >>>>> inconsistent state, please relogin. >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4039 -> 1776 >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> +---------------------------------------------- >>>> ^-----------------------+ >>>> | Luis Meléndez Aganzo ^ Email: >>>> luism(a)uco.es | >>>> | Servicio de Informática ^ Tlf: 34-(9) >>>> 57-211022 | >>>> | Analista - Área de Sistemas ^ Fax: 34-(9) >>>> 57-218116 | >>>> | Universidad de Córdoba (SPAIN) ^ http:// >>>> www.uco.es | >>>> +---------------------------------------------- >>>> ^-----------------------+

3 5

[Dovecot] FreeBSD 6 - DirectAdmin - dovecot
by Floris van den Berg 02 May '06

02 May '06

Since version 1.0 I experience strange problems with dovecot. At the moment I have beta 7 installed. I use FreeBSD 6.0. * Pop3 works * Imap works, but only when i telnet to localhost * In all other cases I can't connect to the server. Tried with squirrelmail, uebimau and thunderbird. Squirrelmail after a long time waiting: "ERROR: Connection dropped by IMAP server." Happens too with firewall switched off. Happens too when i restart exim and dovecot. /var/log/maillog mentions something about Inactivity. When i do tail -f /var/log/maillog and try to connect using squirrel, i see hardly any imap messages fly by, except 'inactivity'. Any ideas? Floris

3 3

[Dovecot] beta7 imap core, no assert
by Jeff A. Earickson 02 May '06

02 May '06

Timo, I noticed this core dump from imap the other day from one of our users; there was no assertion. GDB output attached, I have saved the core if you need more information. Jeff Earickson Colby College

1 0

[Dovecot] backup strategie - any ideas and tips
by Götz Reinicke 02 May '06

02 May '06

Hi, we run a dovecot mail-server with about 50GB of e-mail and at the moment users are responsebil for macking ther own backup of e-mails. But I'd like to have also a backup of the mail, beckause not all users do ther backups ... We use mbox-format-mailboxes. Any ideas how to backup the mailboxes without stopping the server, doing a backup to disk/tape/...? Thanks for any ideas ant tips! Regards Götz Reinicke -- Götz Reinicke IT Koordinator - IT OfficeNet Tel. +49 (0) 7141 - 969 420 Fax +49 (0) 7141 - 969 55 420 goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg Mathildenstr. 20 71638 Ludwigsburg www.filmakademie.de

7 8

[Dovecot] mail messages moving between mailfolders
by taras＠elantech.ru 02 May '06

02 May '06

Hello to all! I'm using IMAP-based antispam self-learning. I have a folder "spam" in each Maildir in which I place spam-tagged messages during delivery. If antispam filter makes mistake, user can drag'n'drop message to/from "spam" folder. I running perl-script periodicaly and retrain spam-filter (dSpam). Now I must scan all messages, but it's not a good practice (server load depends from mail volume, not user activity) so I want add a "hook" to IMAP-server, i.e. I want server to report me something like "date: file1 -> file2" via any IPC (socket?) or log file while user moves messages across different mail folders. Overload from antispam retraining will be function from user activity with such feature added. P.S.: Now I'm using courier, but want to try dovecot. Sorry for bad English. With respect, Taras. -- С уважением, Савчук Тарас "ЭЛАНТЕК" +7 (495) 589 68 81 +7 (926) 575 22 11 http://www.elantech.ru

3 6