- dovecot - dovecot.org

[Dovecot] Problems using GFS2 and clustered dovecot
by David Craigon 06 Apr '07

06 Apr '07

I am trying to use dovecot. I've got a GFS2 shared volume on two servers with dovecot running on both. On one server at a time, it works. The test I am trying is to attach two mail programs (MUA) via IMAPS (Thunderbird and Evolution as it happens). I've attached one mail program to each IMAPS server. I am trying to move emails around in one program (from folder to folder), and then checking it on the other program. I'm testing in effect how it would work if my users log on twice and end up on different servers. I seem to suffer from never ending index file corruption: Apr 4 16:55:49 mailstore-b dovecot: IMAP(david(a)everybody-loves.craigon.co.uk): Corrupted transaction log file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex.log: end_offset (284) > current sync_offset (104) Apr 4 16:55:49 mailstore-b dovecot: IMAP(david(a)everybody-loves.craigon.co.uk): broken sync positions in index file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex Apr 4 16:55:49 mailstore-b dovecot: IMAP(david(a)everybody-loves.craigon.co.uk): fscking index file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex Apr 4 16:55:49 mailstore-b dovecot: IMAP(david(a)everybody-loves.craigon.co.uk): Fixed index file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex: log file sync pos 1,284 -> 1, 104 Apr 4 16:55:50 mailstore-b dovecot: IMAP(david(a)everybody-loves.craigon.co.uk): Unexpected transaction log desync with index /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex Apr 4 16:56:18 mailstore-b dovecot: IMAP(david(a)everybody-loves.craigon.co.uk): Transaction log file /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.ind ex.log: marked corrupted This happens pretty quickly. I can also get message duplication- if I move a message from one server to another, I can get a message in the original folder and the destination folder. I am using RC28. I have tried using fcntl locking and dotlocking with equal lack of success. Can anyone offer any advice? David Griffin Information Systems Ltd 20 St Christopher's Way, Pride Park, Derby DE24 8JY www.griffin.com <http://www.griffin.com/> Registered in England and Wales. Company Registration Number: 3676297. VAT Number: 716604053

5 4

[Dovecot] managesieve proxy
by Marshal Newrock 06 Apr '07

06 Apr '07

We have dovecot on a pop/imap server working as a proxy to dovecot on the backend storage servers. This is working fine, but the difficulty is that if I use, for example, avelsieve in squirrelmail, it doesn't know where to connect. I imagine the same problem would exist with sieve-capable mail clients such as KMail, especially since the outside world isn't allowed to connect directly to the storage servers. Does anyone know of a way to proxy managesieve? -- Marshal Newrock Ideal Solution, LLC - http://www.idealso.com

3 3

[Dovecot] truncated maildir root?
by Joe Wong 06 Apr '07

06 Apr '07

Hello, I have successfully configure dovecot to lookup my existing user database to lookup the homedir. However, I found the following from the log: dovecot: Apr 05 04:05:16 Info: IMAP(joewong99:tkodog.no-ip.com): Effective uid=1001, gid=1001, home=/mnt/mailmountpoint/4/22/3/joewong99:tkodog.no-ip.com@tkodog_no-ip_com dovecot: Apr 05 04:05:16 Info: IMAP(joewong99:tkodog.no-ip.com): maildir: data=/mnt/mailmountpoint/4/22/3/joewong99:tkodog.no-ip.com@tkodog_no-ip_com/Maildir dovecot: Apr 05 04:05:16 Info: IMAP(joewong99:tkodog.no-ip.com): maildir: root=/mnt/mailmountpoint/4/22/3/joewong99, index=/mnt/mailmountpoint/4/22/3/joewong99, control=, inbox= The "root" is truncated after the colon. Can I configure dovecot not to do it? I have 10000 messages in /mnt/mailmountpoint/4/22/3/joewong99:tkodog.no-ip.com@tkodog_no-ip_com/Maildir but SELECT INBOX show no messages. Regards, - Joe

2 1

[Dovecot] GSS/Kerb5, Solaris 10, how to build?
by Jeff A. Earickson 06 Apr '07

06 Apr '07

Gang, I've been trying to build rc29 under Solaris 10 using either "--with-gssapi" or Kerberos 5 ticket usage. I'm trying to figure out how to set up fetchmail on another S10 box to do IMAP fetches from dovecot without having to enter a password. No matter what configure option I try, I get Building with GSSAPI support ........ : no at the end of the configure. I searched the list archives and I see some discussion from Dan Price about Solaris 11 builds. Is gssapi supposed to work with Solaris 10? Advice please? My dovecot server is a Kerberos 5 client of Active Directory, with PAM configured to do TGT exchanges. I can login to the system with my AD password, ssh to other Kerb clients without having to type in passwords -- Kerberos works at the OS level. Jeff Earickson Colby College

2 1

[Dovecot] changing fs separator for maildir (suggestions?)
by Justin McAleer 05 Apr '07

05 Apr '07

Since we're migrating from an existing system that allows periods in folder names, I believe we must continue to allow them. So, I am deciding what to use as the separator instead. Right now, I'm leaning towards the backtick (`), since I don't think I have ever used it unless I was trying to execute an external command in some code. So, can anybody think of reasons not to use it, or have a better idea?

1 0

Re: [Dovecot] Problems using GFS2 and clustered dovecot
by David Craigon 05 Apr '07

05 Apr '07

Well, I'm not paying for it. And I've managed to fix the comedy stability I've come across so far, but you're right- I haven't really loaded the system up yet. My rationale is that I want a filesystem I can share between several servers, reducing the points of failure as far as I can down. We've got a large iSCSI SAN we've already bought for other projects, and I'd like to use that for our storage. So using NFS, I'd have to have another server in front of my SAN that act as an NFS server (presuambly as a single point of failuire), and the mail servers as NFS clients. I'd rather have the servers talk to the SAN directly. Besides, NFS never really works for me, but I'm sure I could overcome that. Anyway, I don't think it's a GFS problem so far. David > -----Original Message----- > From: dovecot-bounces(a)dovecot.org > [mailto:dovecot-bounces@dovecot.org] On Behalf Of Justin McAleer > Sent: 05 April 2007 13:37 > To: dovecot(a)dovecot.org > Subject: Re: [Dovecot] Problems using GFS2 and clustered dovecot > > David Craigon wrote: > > I am trying to use dovecot. I've got a GFS2 shared volume on two > > servers with dovecot running on both. On one server at a > time, it works. > > > > > > Sorry to not answer your question directly, but do you have a > good reason to be using GFS instead of NFS? We experimented > with GFS last year (granted, not GFS2), and found its > performance pretty horrible and its stability comically > bad... had we been paying for it, however, it wouldn't have > been funny. OCFS2 was better, but still unreliable. Lustre > was the best we found (it worked, at least), but it required > a lot of hardware/admin overhead. We tried other clustering > filesystems as well, and none of them was worth the trouble. > > > The test I am trying is to attach two mail programs (MUA) via IMAPS > > (Thunderbird and Evolution as it happens). I've attached one mail > > program to each IMAPS server. I am trying to move emails > around in one > > program (from folder to folder), and then checking it on the other > > program. I'm testing in effect how it would work if my users log on > > twice and end up on different servers. > > > > I seem to suffer from never ending index file corruption: > > > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Corrupted > transaction log > > file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > end_offset (284) > current sync_offset (104) Apr 4 16:55:49 > > mailstore-b > > dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): broken sync positions in > > index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): fscking index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Fixed index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex: > > log file sync pos 1,284 -> 1, 104 > > Apr 4 16:55:50 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Unexpected > transaction log > > desync with index > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:56:18 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Transaction log file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > marked corrupted > > > > This happens pretty quickly. I can also get message > duplication- if I > > move a message from one server to another, I can get a > message in the > > original folder and the destination folder. > > > > I am using RC28. I have tried using fcntl locking and > dotlocking with > > equal lack of success. > > > > Can anyone offer any advice? > > > > David > > > > > > Griffin Information Systems Ltd > > 20 St Christopher's Way, > > Pride Park, > > Derby > > DE24 8JY > > www.griffin.com <http://www.griffin.com/> > > > > Registered in England and Wales. Company Registration > Number: 3676297. > > VAT Number: 716604053 > > > > > > > > >

1 0

Re: [Dovecot] Problems using GFS2 and clustered dovecot
by David Craigon 05 Apr '07

05 Apr '07

Sorry, it's just struck me that I've missed out the most important information- I am using maildir++. Sorry :-(. The index files are kept on the shared volume. And to answer the other question again, mmap is off. David > -----Original Message----- > From: Andrey Panin [mailto:pazke@donpac.ru] > Sent: 05 April 2007 10:25 > To: David Craigon > Cc: dovecot(a)dovecot.org > Subject: Re: [Dovecot] Problems using GFS2 and clustered dovecot > > On 095, 04 05, 2007 at 09:58:44AM +0100, David Craigon wrote: > > I am trying to use dovecot. I've got a GFS2 shared volume on two > > servers with dovecot running on both. On one server at a > time, it works. > > > > The test I am trying is to attach two mail programs (MUA) via IMAPS > > (Thunderbird and Evolution as it happens). I've attached one mail > > program to each IMAPS server. I am trying to move emails > around in one > > program (from folder to folder), and then checking it on the other > > program. I'm testing in effect how it would work if my users log on > > twice and end up on different servers. > > > > I seem to suffer from never ending index file corruption: > > Where are index files located ? > > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Corrupted > transaction log > > file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > end_offset (284) > current sync_offset (104) Apr 4 16:55:49 > > mailstore-b > > dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): broken sync positions in > > index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): fscking index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:55:49 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Fixed index file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex: > > log file sync pos 1,284 -> 1, 104 > > Apr 4 16:55:50 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Unexpected > transaction log > > desync with index > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex > > Apr 4 16:56:18 mailstore-b dovecot: > > IMAP(david(a)everybody-loves.craigon.co.uk): Transaction log file > > > /mnt/mailstore/e/everybody-loves.craigon.co.uk/d/david/.fish/dovecot.i > > nd > > ex.log: > > marked corrupted > > > > This happens pretty quickly. I can also get message > duplication- if I > > move a message from one server to another, I can get a > message in the > > original folder and the destination folder. > > > > I am using RC28. I have tried using fcntl locking and > dotlocking with > > equal lack of success. > > > > Can anyone offer any advice? > > > > David > > > > > > Griffin Information Systems Ltd > > 20 St Christopher's Way, > > Pride Park, > > Derby > > DE24 8JY > > www.griffin.com <http://www.griffin.com/> > > > > Registered in England and Wales. Company Registration > Number: 3676297. > > VAT Number: 716604053 > > > > > > > > -- > Andrey Panin | Linux and UNIX system administrator > pazke(a)donpac.ru | PGP key: wwwkeys.pgp.net >

1 0

Re: [Dovecot] Problems using GFS2 and clustered dovecot
by David Craigon 05 Apr '07

05 Apr '07

Yes > -----Original Message----- > From: Tomi Hakala [mailto:tomi.hakala@pobox.fi] > Sent: 05 April 2007 11:30 > To: David Craigon > Cc: dovecot(a)dovecot.org > Subject: Re: [Dovecot] Problems using GFS2 and clustered dovecot > > On Thu, 2007-04-05 at 09:58 +0100, David Craigon wrote: > > I am trying to use dovecot. I've got a GFS2 shared volume on two > > servers with dovecot running on both. On one server at a > time, it works. > > Do you have mmap disabled? > > Tomi > >

1 0

[Dovecot] solaris 10 dovecot-1.0.rc29 - building issue
by Davide Vaghetti 05 Apr '07

05 Apr '07

Hi all, I'm having terrible time, and a lot of core dumps, building dovecot on Solaris 10. My environment: gcc 3.3.2 LDFLAGS=-L/usr/local/ssl/lib -lssl -lcrypto \ -L/usr/local/BerkeleyDB.4.2/lib -ldb -L/usr/local/lib -lldap CPPFLAGS=-I/usr/local/BerkeleyDB/include \ -I/usr/local/include -I/usr/local/ssl/include my configure: ./configure --prefix=/usr/local --with-ldap ...that is: Install prefix ...................... : /usr/local File offsets ........................ : 64bit I/O loop method ..................... : poll File change notification method ..... : none Building with SSL support ........... : yes (OpenSSL) Building with IPv6 support .......... : yes Building with pop3 server ........... : yes Building with mail delivery agent .. : yes Building with GSSAPI support ........ : no Building with user database modules . : static prefetch passwd passwd-file checkpassword ldap (modules) Building with password lookup modules : passwd passwd-file shadow pam checkpassword ldap (modules) Building with SQL drivers ............: When I try to actually make it, this is the result: Making all in imap make[3]: Entering directory `/usr/local/src/dovecot-1.0.rc29/src/imap' /bin/ksh ../../libtool --tag=CC --mode=link gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -export-dynamic -L/usr/local/ssl/lib -L/usr/local/BerkeleyDB.4.2/lib -L/usr/local/lib -o imap cmd-append.o cmd-capability.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-messageset.o imap-search.o imap-sort.o imap-sync.o imap-thread.o mail-storage-callbacks.o main.o namespace.o ../lib-storage/register/libstorage-register.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/mbox/libstorage_mbox.a ../../src/lib-storage/index/dbox/libstorage_dbox.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-index/libindex.a ../lib-storage/libstorage.a ../lib-storage/subscription-file/libstorage_subscription_file.a ../lib-imap/libimap.a ../lib-mail/libmail.a ../lib-dict/libdict.a ../lib-charset/libcharset.a ../lib/liblib.a ../lib/mountpoint.o /usr/local/lib/libiconv.so -L/usr/openwin/lib -R/usr/local/lib -export-dynamic -lsocket -lnsl -lrt -lsendfile gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -o imap cmd-append.o cmd-capability.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-messageset.o imap-search.o imap-sort.o imap-sync.o imap-thread.o mail-storage-callbacks.o main.o namespace.o ../lib/mountpoint.o /usr/local/lib/libiconv.so -L/usr/local/ssl/lib -L/usr/local/BerkeleyDB.4.2/lib -L/usr/local/lib ../lib-storage/register/libstorage-register.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/mbox/libstorage_mbox.a ../../src/lib-storage/index/dbox/libstorage_dbox.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-index/libindex.a ../lib-storage/libstorage.a ../lib-storage/subscription-file/libstorage_subscription_file.a ../lib-imap/libimap.a ../lib-mail/libmail.a ../lib-dict/libdict.a ../lib-charset/libcharset.a ../lib/liblib.a -L/usr/openwin/lib -lsocket -lnsl -lrt -lsendfile -R/usr/local/lib make[3]: *** [imap] Bus Error (core dumped) make[3]: *** Deleting file `imap' make[3]: Leaving directory `/usr/local/src/dovecot-1.0.rc29/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/local/src/dovecot-1.0.rc29/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-1.0.rc29' make: *** [all] Error 2 I tried the rc27 and rc28 too with the same results. Does anybody experienced similar issues ? thanks in advance bye -- Davide Vaghetti Centro SerRA - University of Pisa NOC

3 4

Re: [Dovecot] compiling dovecot on aix gcc 3.3.2
by Ralf Becker 05 Apr '07

05 Apr '07

Hello funkypunky drunky, on AIX dovecot plugins (which are shared objects = .so) are a little bit problematic. It is not enough to activate run time linking by using -brtl and make the main program (dovecot) to be able to use shared objects. When a share object does function calls back into the main program, all these functions (=symbols) in dovecot have to be explicitly exported. Otherwise you see "signal 11" or so. Because this is very fiddly, there is a linker flag -bexpall to export all symbols of the main program (dovecot)... but this does seemingly not work with symbols defined in static libraries (.a). While dovecot build creates static libraries to keep the linker command line small, but does *not* generate export files (.exp) containing the libraries globals symbols, the compile time linker does not known anything about them. I think, if dovecot build would use libtool to create the libraries, libtool would export the libraries symbols to fix this. And this is, what my script does. It looks on the compiler command line for library file (.a) and exports all global symbols to an .exp file. The paths of these .exp files are appended to the original compiler command line and so -bexpall knows about the globale symbols defined in the libraries and is able to export them. I don't know if this information is useful for you, because you're using gcc. But if you are using AIX ld (instead of gnu ld) you have to deal with this problem, I think. Regards, Ralf funkypunky drunky schrieb: > Hi Ralf > I check your script. But i cannot udnerstand what you do. R u trying to > export the library of the dovecot? I cannot go deeper. Anyway would you > like to tell what did you do with XLC compiler. Maybe i can setup the > analogy of it when using gcc instead of XLC. > Best regards. > > > 2007/3/27, Ralf Becker <beckerr(a)fh-trier.de <mailto:beckerr@fh-trier.de>>: > > Hello! > > Have you tried to export all symbols defined in lib archives generated > while dovecot is build? I've had this problem on aix with xlC and > solved > it by writing an compiler script for doing that. > > See > http://www.dovecot.org/list/dovecot/2007-February/019226.html > and > http://wiki.dovecot.org/AixPluginsSupport > > Regards, Ralf > > Timo Sirainen schrieb am 26.03.2007 21:08: > > On Mon, 2007-03-26 at 09:24 +0300, funkypunky drunky wrote: > >> I pasted the output of gdb. I hope it is usefull. Thanx > >> > >> This GDB was configured as "powerpc-ibm-aix5.1.0.0"... > >> Core was generated by `imap'. > >> Program terminated with signal 11, Segmentation fault. > >> #0 0xd1a468cc in i_malloc () > >> from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so > >> (gdb) bt full > >> #0 0xd1a468cc in i_malloc () > >> from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so > >> No symbol table info available. > >> #1 0xd1a47cc8 in quota_init () at quota.c:32 > > > > So it crashes at the first Dovecot function it tries to call. Perhaps > > the imap binary isn't exporting the symbols, or something like that. > > I've no idea. Anyway it is most likely related to some linking or > > compiling flags (or the linker/compiler itself). > > > > -- > ______________________________________________________________________ > > Dipl.-Inform. (FH) Ralf Becker Rechenzentrum (r/ft) der FH Trier > (Network|Mail|Web|Firewall) University of applied sciences > Administrator Schneidershof, D-54293 Trier > > Mail: beckerr(a)fh-trier.de > <mailto:beckerr@fh-trier.de> Fon: +49 651 8103 499 > WWW: http://www.fh-trier.de/~beckerr Fax: +49 651 8103 214 > PGP: http://www.fh-trier.de/~beckerr/pgp ICQ: <available> > ______________________________________________________________________ > > Wenn Gott gewollt haette, dass E-Mail in HTML geschrieben wuerden, > endeten Gebete traditionell mit </amen>. (Tom Listen) > > -- ______________________________________________________________________ Dipl.-Inform. (FH) Ralf Becker Rechenzentrum (r/ft) der FH Trier (Network|Mail|Web|Firewall) University of applied sciences Administrator Schneidershof, D-54293 Trier Mail: beckerr(a)fh-trier.de Fon: +49 651 8103 499 WWW: http://www.fh-trier.de/~beckerr Fax: +49 651 8103 214 PGP: http://www.fh-trier.de/~beckerr/pgp ICQ: <available> ______________________________________________________________________ Wenn Gott gewollt haette, dass E-Mail in HTML geschrieben wuerden, endeten Gebete traditionell mit </amen>. (Tom Listen)

2 4