- dovecot - dovecot.org

[Dovecot] madvise() errors
by Mark E. Mallett 02 May '06

02 May '06

(I think this has been mentioned before.) Do these hurt?: May 2 13:41:30 sysname dovecot: POP3(xxxx): madvise() failed with file /users/xx/xxxx/Maildir/dovecot.index.log: Operation not supported I think not, since I've been seeing them forever. But they do muddy the logs. This is on an old BSD/OS server, where the man page for madvise ends with: BUGS This call is not yet supported. The messages are *only* about index.log files. Would it be possible to either suppress the log message if the error is specifically "not supported" or, better yet, detect it at configure time? Completely understandable if it's not worth the effort, though. mm

2 2

Re: [Dovecot] managesieve daemon
by Gerald Dachs 02 May '06

02 May '06

On Tue, 02 May 2006 15:10:16 -0500 Richard Laager <rlaager(a)wiktel.com> wrote: > On Tue, 2006-05-02 at 13:00 +0200, Gerald Dachs wrote: > > Is this interesting > > for somebody else? > > I would be interested in this for a migration at work. I may be able to > provide financial just one hour ago I broke an AMD 2700+ XP CPU (yes, it's physically broken), because I am stupid, so one of my development machines is down and my finance minister (my wife) would kill me (or would be angry with me, that would be more worse than being killed) if I would ask for a new CPU. So a contribution in form of another fast XP CPU would speed up the process ;), but is not absolutely necessary, because I can set up another machine. > or code contributions as well. only if you have something ready. The server itself is running, I use libut for this, I highly recomend this http://libut.sourceforge.net/primer.html. Last thing I was working on before the machine died (code is safe), was the command parser with flex, not ready yet. Iater I could need help with the autoconf, automake stuff, this is not one of my strength. Gerald

1 0

[Dovecot] create_dovecot_shares
by Gavin Henry 02 May '06

02 May '06

Dear All, We've been working on this for a client to help create and manage maildir shares, via the dovecot-shared file. Our problems are creating lots of dovecot-shared files and permissions and monitoring new Maildir folders that get added by the user (maybe a better way, would love to know). The tool is almost done, with the docs at: http://www.suretecsystems.com/our_docs/create_dovecot_shares.html Maybe this can be of use to others when it's finished. Thanks, Gavin. P.S> Might be redundant a little when the ACLs are complete, as per Timos' e-mail earlier today: http://dovecot.org/pipermail/dovecot/2006-May/012991.html -- Kind Regards, Gavin Henry. Managing Director. T +44 (0) 1224 279484 M +44 (0) 7930 323266 F +44 (0) 1224 742001 E ghenry(a)suretecsystems.com Open Source. Open Solutions(tm). http://www.suretecsystems.com/

2 3

[Dovecot] Assertion failed
by Jonathan Knight 02 May '06

02 May '06

We're in a bit of a panic here as we're getting a lot of errors along the lines of: May 2 12:39:00 lenny dovecot: IMAP(XXXXX): file mbox-sync-rewrite.c: line 106 (mbox_sync_headers_add_space): assertion failed: (start_pos < data_size) We didn't see this until our mail servers went under a full load and now we've trashed the ability of nearly all our users to read email. We saw this first under 1.0Beta3 and we've tried building 1.0Beta7 and its made no difference. I've tried fiddling with the "dirty" settings for the indices and banning mmap to see if there's any way way of avoiding the broken code, but with no luck. We're running White Box EL4 (2.6 Linux kernel) Does anyone know a workaround or whether there is an older version that doesn't have the bug? We desperately need to get an email service running and I don't want to go back to (shudder) UW-imap if I can help it but my options are limited at the moment. -- ______ J.Knight(a)kis.keele.ac.uk Jonathan Knight, / Keele Information Services / _ __ Telephone: +44 1782 583478 University of Keele, Keele, (_/ (_) / / Fax : +44 1782 713082 Staffordshire. ST5 5BG. U.K.

5 9

[Dovecot] Dovecot and NFS with file locking
by Nate Sanders 02 May '06

02 May '06

Greetings all, I'm trying to get an understanding of a problem we are facing here. We're currently running dovecot 1.0-beta3 and have a long standing issue of system crashes on our mail server (Debian Linux 2.4.27-2-k7-smp). Here's what is happening: The machine hangs and the system load climbs as high as 80.0+. Yet, the system response is not effected. Command line is still responds instantly. There are multiple running dovecot PIDs, even if I stop the service. If I try to kill or -9 the PIDs, they will not die. The machine is DOA and must be forcefully restarted. Issuing a reboot will cause the machine to hang when it attempts to unmount network shares. Here's the setup: - Dovecot 1.0-beta3 - lock_method = dotlock - mmap_disable = yes /var/mail is store locally on the mail server and access via NFS to ALL remote machines. All remote machines have /var/mail sym linked to the NFS share on Mail. /home on Mail is NFS'd to another set of servers where IMAP mail folders reside in mbox format. All client machines have /home sym linked to the second NFS server. In other words, there's a lot of NFS shares and one mail transaction can involve 3 machines. What I'm trying to find out is the current state of NFS locking with Dovecot. This system hang happens 1-3 times a week. The current /home NFS mounts are running from SGI machines on IRIX 6.5. Clients are all Linux (debian) 2.4 or Linux (ubuntu) 2.6. Is our setup too much for Dovecot to handle? Are there other variables we're not looking at here? Thanks everyone. -- ============================================== Nate Sanders nate(a)ima.umn.edu Associate Systems Manager (612) 624 - 4353 http://www.ima.umn.edu/ ============================================== Institute for Mathematics and its Applications University of Minnesota 400 Lind Hall, 207 Church St. SE Minneapolis, MN 55455-0463 ==============================================

3 4

[Dovecot] blank forwarded messages
by lenny＠edpausa.com 02 May '06

02 May '06

Just switched from uw to dovecot ( latest beta3 + lda ) on production system and everything seems fine except... There's some strange problem with forwarding messages from thundebird, the body of the forwarded message is always completely blank - 0 byte size. Forwarding from squrrel, horde, eudora and outlook works fine. Client setup on thunderbird installs hasn't changed a bit. I'm still investigating why this is happening. Has anyone run into this ?

1 2

Re: [Dovecot] FreeBSD 6 - DirectAdmin - dovecot
by Floris van den Berg 02 May '06

02 May '06

Jim Trigg schreef: > On Tue, May 2, 2006 1:15 am, Floris van den Berg wrote: > >> Since version 1.0 I experience strange problems with dovecot. At the >> moment I have beta 7 installed. I use FreeBSD 6.0. >> >> * Pop3 works >> * Imap works, but only when i telnet to localhost >> * In all other cases I can't connect to the server. Tried with >> squirrelmail, uebimau and thunderbird. Squirrelmail after a long time >> waiting: "ERROR: Connection dropped by IMAP server." >> > > What happens if you try to telnet to the imap port other than localhost? > > Jim > > Hi, that works too. It didn't work before because i didn't properly disable the firewall. Floris

2 4

Re: [Dovecot] Maildir + NFS + multiple machines = spectacular failure
by Apps Lists 02 May '06

02 May '06

Rich, We're also in the process of setting up a GFS/Cluster with CentOS. I'm hopeful this will eliminate some of the issues. I'll keep everyone posted. Steve > Hi Steve, > > We'll give that a try. I'm sure users would prefer a slightly slower > mail experience if it ensured accurate mail lists and reduced the > chance for lost mail. > > Rich Sandberg > richs(a)whidbey.net > Systems & Network Administrator > Whidbey Telecom Network Operations > > > > On Apr 28, 2006, at 9:37 AM, Apps Lists wrote: > >> Hi Rich. >> >> I've seen a lot of the same IMAP errors... haven't played with POP >> yet. >> >> You might want to try adding "noac" to the mount options... your >> line.. >> >> nfshost:/var/mail /var/mail nfs >> rw,hard,intr,rsize=8192,wsize=8192 0 0 >> >> .... would become: >> >> >> nfshost:/var/mail /var/mail nfs >> rw,hard,intr,rsize=8192,wsize=8192,noac 0 0 >> >> >> .... and see if that helps. I haven't seen much if any difference. >> >> What I don't understand is how some people are running what appears >> to be >> the same configuration ... RHEL/CentOS ... NFS3, 2+ Dovecot >> machines with >> IMAP and have no problems. >> >> I'd love to get to the bottom of this. >> >> Steve >> >>> We're using 2.6.9-34, the latest RHEL4 kernel, over NFSv3 with 3 >>> Dovecot servers. Our most concerning episode was a failed APPEND >>> operation (with a set of folders containing 200 messages): >>> >>> IMAP(username): Corrupted transaction log file /var/mail/username/ >>> Maildir/dovecot.index.log: unexpected end of file while reading >>> header >>> >>> That resulted in one of the new APPENDed mail folders and content >>> being lost. We see those errors at other times too, although they >>> don't always end in a noticeable failure. >>> >>> Continuous other errors we see that might be NFS related: >>> >>> IMAP(username): close() failed with index cache file /var/mail/ >>> username/Maildir/.Deleted Messages/dovecot.index.cache: Stale NFS >>> file >>> handle >>> IMAP(username): Corrupted index cache file /var/mail/username/ >>> Maildir/.OldMail/dovecot.index.cache: invalid record size >>> IMAP(username): close() failed with index file /var/mail/username/ >>> Maildir/.INBOX.Security/dovecot.index: Bad file descriptor >>> >>> We also see errors with POP3, which would rarely benefit from indexes >>> (since 92% of our users RETR-and-DELE messages): >>> >>> POP3(username): file_dotlock_create() failed with file /var/mail/ >>> username/Maildir/dovecot.index.log: Stale NFS file handle >>> POP3(username): Corrupted transaction log file /var/mail/username/ >>> Maildir/dovecot.index.log: record size too small (type=0x8080, >>> offset=9056, size=0) >>> POP3(username): Our dotlock file /var/mail/username/Maildir/ >>> dovecot.index.log.lock was deleted (kept it -118 secs) >>> POP3(username): Timeout while waiting for release of dotlock for >>> transaction log file /var/mail/username/Maildir/dovecot.index.log >>> >>> We've tried manually removing "dovecot*" from all folders, allowing >>> the indexes to be re-built, but the errors return. >>> >>> Excerpt from our config: >>> >>> mail_cache_fields mail_never_cache_fields mail_cache_min_mail_count >>> >> 1000 mailbox_idle_check_interval = 10 mail_full_filesystem_access >>> = no >>> mail_read_mmaped = no >>> mmap_disable = yes >>> mmap_no_write = no >>> lock_method = dotlock >>> maildir_stat_dirs = yes >>> maildir_copy_with_hardlinks = no >>> >>> Our NFS mount: >>> >>> nfshost:/var/mail /var/mail nfs >>> rw,hard,intr,rsize=8192,wsize=8192 0 0 >>> >>> I've read some of the list archives about disabling the index files. >>> We realize that indexes should be beneficial, but we'd like to at >>> least experiment with a "no index" install. This would solve some of >>> the NFS locking issues, eliminate the need to modify our MTA >>> behavior, and remove (potentially) millions of files from the system. >>> >>> Did anyone discover a method to cleanly disable the indexes? At least >>> for POP3? >>> >>> Thanks! >>> >>> Rich Sandberg >>> richs(a)whidbey.net >>> >>> >>> On Apr 28, 2006, at 6:59 AM, Luis Melendez wrote: >>> >>>> Hi all. >>>> We also had problems with client NFS locking using RHEL4, kernel >>>> 2.6.9 >>>> Some of them were solved updating the kelnel from RedHat. >>>> Hope this helps. >>>> >>>> Regards. >>>> >>>> Apps Lists wrote: >>>> >>>>> I'm running beta7 on two machines, with maildir on NFS. I have >>>>> lockd >>>>> running on all machines. I've found that Dovecot is highly >>>>> unstable with >>>>> NFS when accessing a mailbox on more than one machine at the same >>>>> time. >>>>> >>>>> Both dovecot machines have: >>>>> >>>>> mmap_disable = yes >>>>> lock_method = fcntl >>>>> >>>>> NFS is version 3, exported from a third linux machine. All >>>>> machines are >>>>> running 2.6.9 kernel. >>>>> >>>>> Any ideas what's going wrong here? >>>>> >>>>> Steve >>>>> >>>>> >>>>> *** dev4 *** >>>>> >>>>> Apr 28 09:17:40 dev4 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146230258.P2889Q0M407851.dev4.neonova.net:2, >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Extension >>>>> introduction for unknown id 0 >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: IMAP(jtest): file mail-index.c: line >>>>> 883 >>>>> (mail_index_sync_from_transactions): assertion failed: >>>>> (hdr.log_file_int_offset == (*map)->hdr.log_file_int_offset) >>>>> >>>>> >>>>> Apr 28 09:17:41 dev4 dovecot: child 2889 (imap) killed with >>>>> signal 6 >>>>> >>>>> >>>>> *** dev3 *** >>>>> >>>>> >>>>> >>>>> Apr 28 09:17:39 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146230254.P2888Q0M651598.dev4.neonova.net >>>>> >>>>> Apr 28 09:17:41 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4036 -> 1772 >>>>> >>>>> Apr 28 09:17:44 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4036 -> 1774) >>>>> >>>>> Apr 28 09:17:45 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146145480.P5976Q0M245663.dev3.neonova.net:2, >>>>> >>>>> Apr 28 09:17:46 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4038 -> 1774 >>>>> >>>>> Apr 28 09:17:47 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4038 -> 1775) >>>>> >>>>> Apr 28 09:17:48 dev3 dovecot: IMAP(jtest): Duplicate file in >>>>> uidlist file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: >>>>> 1146145480.P5976Q0M245663.dev3.neonova.net:2, >>>>> >>>>> Apr 28 09:17:49 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4039 -> 1775) >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Extension >>>>> introduction for unknown id 0 >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): file mail-index.c: line >>>>> 881 >>>>> (mail_index_sync_from_transactions): assertion failed: >>>>> (hdr.messages_count >>>>> == (*map)->hdr.messages_count) >>>>> >>>>> Apr 28 09:17:50 dev3 dovecot: IMAP(jtest): >>>>> /var/mailstore/72/af/375887/Maildir/dovecot-uidlist: next_uid was >>>>> lowered >>>>> (4039 -> 1775) >>>>> >>>>> Apr 28 09:17:51 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Append with >>>>> UID >>>>> 1775, but next_uid = 4039 >>>>> >>>>> Apr 28 09:17:51 dev3 dovecot: IMAP(jtest): Corrupted transaction >>>>> log file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index.log: Append with >>>>> UID >>>>> 1775, but next_uid = 4039 >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Unexpected >>>>> transaction log >>>>> desync with index /var/mailstore/72/af/375887/Maildir/dovecot.index >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Disconnected: >>>>> Mailbox is >>>>> in >>>>> inconsistent state, please relogin. >>>>> >>>>> Apr 28 09:17:52 dev3 dovecot: IMAP(jtest): Fixed index file >>>>> /var/mailstore/72/af/375887/Maildir/dovecot.index: >>>>> first_recent_uid_lowwater 4039 -> 1776 >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> +---------------------------------------------- >>>> ^-----------------------+ >>>> | Luis Meléndez Aganzo ^ Email: >>>> luism(a)uco.es | >>>> | Servicio de Informática ^ Tlf: 34-(9) >>>> 57-211022 | >>>> | Analista - Área de Sistemas ^ Fax: 34-(9) >>>> 57-218116 | >>>> | Universidad de Córdoba (SPAIN) ^ http:// >>>> www.uco.es | >>>> +---------------------------------------------- >>>> ^-----------------------+

3 5

[Dovecot] FreeBSD 6 - DirectAdmin - dovecot
by Floris van den Berg 02 May '06

02 May '06

Since version 1.0 I experience strange problems with dovecot. At the moment I have beta 7 installed. I use FreeBSD 6.0. * Pop3 works * Imap works, but only when i telnet to localhost * In all other cases I can't connect to the server. Tried with squirrelmail, uebimau and thunderbird. Squirrelmail after a long time waiting: "ERROR: Connection dropped by IMAP server." Happens too with firewall switched off. Happens too when i restart exim and dovecot. /var/log/maillog mentions something about Inactivity. When i do tail -f /var/log/maillog and try to connect using squirrel, i see hardly any imap messages fly by, except 'inactivity'. Any ideas? Floris

3 3

[Dovecot] beta7 imap core, no assert
by Jeff A. Earickson 02 May '06

02 May '06

Timo, I noticed this core dump from imap the other day from one of our users; there was no assertion. GDB output attached, I have saved the core if you need more information. Jeff Earickson Colby College

1 0