- dovecot - dovecot.org

[Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size
by florent＠coppint.com 09 Dec '11

09 Dec '11

Hi all, I got a problem with a Dovecot IMAP/POP installation. Since a recent failure of our distributed file system (no loss of data btw), Dovecot seems to have a problem with index cache files. For a lot of accounts, I have this error in logs: Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size If I delete all files from /indexes/ directory, it still occurs... Do you see what can cause this problem ? Or what information can I provide to help ? Our distributed FS is MooseFS. Dovecot is configured like if it was NFS (no mmap, etc...). Thank you for your help :) Flo

2 1

Re: [Dovecot] sql dict: commit failed: MySQL server has gone away
by Mark Zealey 08 Dec '11

08 Dec '11

Thanks Timo, this patch applied clean against 2.0.16 just running it on live for the past few minutes & seems to have fixed the issues. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 07:14 To: Timo Sirainen Cc: dovecot(a)dovecot.org Subject: RE: [Dovecot] sql dict: commit failed: MySQL server has gone away Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark

1 0

[Dovecot] 2.1.rc1 (1e118913348b): Panic: file mail-user.c: line 128 (mail_user_ref): assertion failed: (user->refcount > 0)
by Pascal Volk 08 Dec '11

08 Dec '11

Hi Timo, right after delivering the message to the INBOX the lmtp crashes. I wonder about the "Sent" in the attached backtrace. Regards, Pascal -- The trapper recommends today: c01dcofe.1134117(a)localdomain.org

2 2

[Dovecot] problems when using dsync between servers
by Yann Dupont 08 Dec '11

08 Dec '11

Hello, I'm trying to migrate from maildir++ to mdbox. The maildir++ is a leftover of our previous setup (was using courier) We have 3 virtuals servers for our +70000 accounts. Now, I'd like to use mdbox, so I'm trying using dsync for that. I setup a new virtual server, configured for mdbox. 1st, I tried a basic setup: I established a file with all my accounts (taken from LDAP) and then I use this script : FILENAME=$1 while read LINE do dsync -u $LINE backup $LINE@my_new_server done < $FILENAME But it's quite slow and dsync hangs. So I tried another approach using multi threaded python. Much faster (using all the cores), but dsync still hangs on some accounts. After a certain time dsync exit with an error like that : Panic: file dsync-worker-local.c: line 1688 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync-remote(E072184L): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd8a) [0x7f34fc577d8a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f34fc577e72] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f34fc55119f] -> dsync() [0x40ff0b] -> dsync() [0x410142] -> dsync(dsync_worker_msg_save+0x99) [0x40f639] -> dsync() [0x40e24a] -> dsync() [0x40d8ef] -> dsync() [0x40dbfc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f34fc5830d8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f34fc58403f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f34fc583068] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f34fc5713a3] -> dsync(main+0x9e1) [0x4078b1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f34fbde9c4d] -> dsync() [0x406cf9] This is on a RUNNNING server. My aim was to make some pass on the running server, then stop it and make a last pass to finish the process. Is dsync supposed to run only on a stopped server ? Is my approach totally wrong ? -- Yann Dupont - Service IRTS, DSI Université de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont(a)univ-nantes.fr

2 2

[Dovecot] sql dict: commit failed: MySQL server has gone away
by Mark Zealey 08 Dec '11

08 Dec '11

Following on from this thread: http://www.dovecot.org/list/dovecot/2010-September/052704.html <https://owa2010.webfusion.com/owa/redir.aspx?C=a447887e3d204944a8c766142df4…> in 2.0.16 I am seeing the same issues. I believe this would be related to some timeouts set on our mysql servers which are pretty low (30 or 60 seconds or so to drop idle connections). This is happening for imap, pop and lmtp processes when they try to update quotas stored in a mysql database; presumably it is the dict process that actually has these issues - the lmtp delivery isn't lasting longer than 1 second so shouldn't be seeing any timeouts there. This is always followed by the "Error: dict quota: Quota update failed, it's now desynced" line; presumably it is telling the truth but I'm not sure how I could tell. We are also seeing this "MySQL server has gone away" issue in login processes but it isn't causing an issue there as presumably dovecot transparently retries rather than just giving up as it seems to in the quota updates. Any thoughts or advice would be appreciated. Mark

3 2

[Dovecot] Assertion failure in 2.0.16 - SEARCH ()
by Daniel Colascione 08 Dec '11

08 Dec '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Nov 25 22:25:39 dancol dovecot: master: Error: service(imap): child 25115 killed with signal 6 (core dumps disabled) Nov 25 22:25:59 dancol dovecot: imap(dancol): Panic: file mail-search-build.c: line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != NULL) Nov 25 22:25:59 dancol dovecot: imap(dancol): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3d291) [0xb7636291] -> /usr/lib/dovecot/libdovecot.so.0(+0x3d2ff) [0xb76362ff] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0xb760bb7a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x24109) [0xb7692109] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x24177) [0xb7692177] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_build+0x82) [0xb7692242] - -> dovecot/imap [dancol 127.0.0.1 SEARCH](imap_search_args_build+0x4a) [0x805db5a] -> dovecot/imap [dancol 127.0.0.1 SEARCH](cmd_search+0xbf) [0x80537ef] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x80568cc] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x80569a2] -> dovecot/imap [dancol 127.0.0.1 SEARCH](client_handle_input+0x175) [0x8056c25] -> dovecot/imap [dancol 127.0.0.1 SEARCH](client_input+0x5f) [0x80574cf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x51) [0xb76430d1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd3) [0xb7644193] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0xb7643050] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb762ec1a] -> dovecot/imap [dancol 127.0.0.1 SEARCH](main+0x315) [0x805fef5] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe6) [0xb74b6c76] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x804eb81] $ telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . LOGIN dancol XXXXXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in . SELECT rss * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 8 EXISTS * 0 RECENT * OK [UIDVALIDITY 1322264663] UIDs valid * OK [UIDNEXT 11] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest . OK [READ-WRITE] Select completed. . SEARCH () Connection closed by foreign host. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: GPGTools - http://gpgtools.org iEYEARECAAYFAk7QiNcACgkQ17c2LVA10VvhHACgihmbmTjVNl/PbKcreIDRTKpC 5wkAoJd9FHXM4GhPfnVUjwrpdsqnVQ6E =RlpQ -----END PGP SIGNATURE-----

2 1

[Dovecot] POP3/IMAP crash signal 10
by Patrick Wood 08 Dec '11

08 Dec '11

Hi, I'm building a Postfix/Dovecot mail server and while I am able to send/receive emails using telnet, after establishing a connection to Dovecot via a client (Mail Live, Thunderbird etc) the following appears in the logs: Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.info] pop3-login: Login: user=<user(a)domain.com>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, mpid=282 78 Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.error] master: Error: service(pop3-login): child 28277 killed with signal 10 (core not dumped - set service pop3-log in { drop_priv_before_exec=yes }) Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.info] pop3(user(a)domain.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/5, size=3250 I also experience very poor connectivity to the server, with Microsoft Mail and Thunderbird regularly failing to connect (connection errors in the client and no login attempt in the dovecot logs). I assume this is related to the issue above. I am running dovecot 2.0.16 on Solaris 10 SPARC using a ZFS filesystem for mailbox storage. Here is my configuration: # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4u zfs auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:/storage0/home/vmail/%d/%n/Maildir mail_plugins = quota passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=1G } postmaster_address = root(a)domain.com sendmail_path = /usr/lib/sendmail ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = quota quota imap_quota } protocol lda { mail_plugins = quota quota } protocol pop3 { mail_plugins = quota quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } I'm tearing my hair out! Hopefully someone can see something I'm missing

2 1

[Dovecot] Questions about Proxy/Director (was: Re: Indexes to MLC-SSD)
by Patrick Westenberg 08 Dec '11

08 Dec '11

Jan-Frode Myklebust schrieb: > Yes, and in ascii-art this becomes :-) > > MTA -(lmtp)--> dovecot-director ---(lmtp)---> backend-server1 > \---(lmtp)---> backend-server2 > > > IMAP-user -(imap)--> dovecot-director --(imap) --> backend-server1 > \--(imap) --> backend-server2 I failed creating a nice ascii view ;-) However, I have some more questions: - What happens if the MTA accepted a message but the backend-server fails and is unable to store it? - What about load-balancing and/or failover? Maybe all users on backend-server1 are fetching their mails causing high load while backend-server2 is idle. Is it possible to specify more than one backend-server IPs as I can do for the database hosts for userdb queries?

3 6

[Dovecot] v2.1.rc1 missing SnowballAnalyzer.h
by Eray Aslan 08 Dec '11

08 Dec '11

While trying to test v.2.1.rc1 with configure \ --with-lucene \ --without-stemmer \ [...] I get the following error: [...] /bin/sh ../../../libtool --tag=CXX --mode=compile i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c -o lucene-wrapper.lo lucene-wrapper.cc libtool: compile: i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c lucene-wrapper.cc -fPIC -DPIC -o .libs/lucene-wrapper.o lucene-wrapper.cc:26:30: fatal error: SnowballAnalyzer.h: No such file or directory compilation terminated. make[4]: *** [lucene-wrapper.lo] Error 1 The offending line in lucene-wrapper.cc is: #include "SnowballAnalyzer.h" Sure enough, there is no SnowballAnalyzer.h in the tarball. Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: [...] noinst_HEADERS = \ fts-lucene-plugin.h \ lucene-wrapper.h SnowballAnalyzer.h \ SnowballFilter.h -- Eray Aslan

2 1

[Dovecot] lazy_expunge plugin and folder subscription trouble
by Jürgen Obermann 08 Dec '11

08 Dec '11

Hello, I wanted to test the lazy expunge plugin together with mdbox. It seems to me that the folder subscriptions file in the mdbox directory was overwritten with only a few folder names every time I added or removed something in the list of subscribed folders, or even if I turned the imap folder subscription feature off and on. Here is my setup: # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v mail_location = mdbox:~/mdbox mail_plugins = mail_log notify quota lazy_expunge zlib mdbox_rotate_interval = 1 days mdbox_rotate_size = 16 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } namespace { location = maildir:/var/mail/public:CONTROL=~/Maildir/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace { location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = .EXPUNGED/ separator = / } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts fts = squat lazy_expunge = .EXPUNGED/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = fs:Home-Verzeichnis:noenforcing sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 3 } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = </etc/ssl/horus.crt ssl_key = </etc/ssl/horus.key syslog_facility = local0 userdb { driver = passwd } version_ignore = yes protocol lda { info_log_path = log_path = mail_plugins = mail_log notify quota lazy_expunge zlib sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 20 mail_plugins = mail_log notify quota lazy_expunge zlib autocreate fts fts_squat imap_quota imap_zlib } protocol lmtp { mail_plugins = mail_log notify quota lazy_expunge zlib sieve } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xv%08Xu } -- Hochschulrechenzentrum der | Mail: Juergen.Obermann(a)hrz.uni-giessen.de Justus-Liebig-Universitaet | WWW: http://www.uni-giessen.de/obermann/ Heinrich-Buff-Ring 44 | Tel: 0641-99-13054 (0641-99-13001) D-35392 Giessen, Germany | Fax: 0641-99-13009

2 1