[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)

Fri Jan 4 13:56:35 EET 2013

Am Freitag, 4. Januar 2013, 05:21:37 schrieb Timo Sirainen:
> On 31.12.2012, at 5.23, Marc Schiffbauer <m at sys4.de> wrote:
> > I am having a problem indexing one of my mailboxes using the solr fts
> > backend in dovecot 2.1.12 For many mailboxes it works just fine, but on
> > one mailbox I currently always get a panic.
> ..
> 
> > SEVERE: java.lang.RuntimeException: [was class
> > java.io.CharConversionException] Invalid UTF-8 start byte 0xf8 (at char
> > #483989, byte #532382)
> Looks like the same issue I was trying to debug with the other guy also, but
> I couldn't figure out how that happens. Dovecot shouldn't be sending such
> data to Solr. Can you record the TCP traffic between Dovecot and Solr when
> this happens, and send it to me?

I have now captured the network traffic and I think the culprit is a mail sent 
by the logcheck service via the local nullmailer MTA. The message contains a 
postgresql log where a big amount of garbage has been recorded that has been 
tried to execute in postgres which it denied to do.

This looks a bit like that:

<doc><field name="uid">68058</field><field 
name="box">a8ca17d0b2a8e8540c196f21010a26e1</field><field 
name="user">xxxx at xxxxxxxxxxx.net</field><field 
name="id">68058/a8ca17d0b2a8e8540c196f21010a26e1/xxxx at xxxxxxxxxxx.net</field><field 
name="body">
Security Violations
=-=-=-=-=-=-=-=-=-=
Jan 12 23:16:00 pluto postgres[18413]: [11-577] `?
5l#027ï¿½gï¿½xï¿½v#017ï¿½~ï¿½]ï¿½j#006ï¿½#037ï¿½Í<9b>ï¿½!=l#037ï¿½Myï¿½iï¿½Zï¿½vï¿½#&K#024t#002Nï¿½?ï¿½<ï¿½xMï¿½ipï¿½Y9×<89>fï¿½#015ï¿½
Jan 12 23:23:06 pluto postgres[2573]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:24:01 pluto postgres[21886]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:25:32 pluto postgres[22397]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:28:25 pluto postgres[23774]: [3-1] LOG:  received smart shutdown 
request
Jan 12 23:47:13 pluto postgres[32759]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:47:39 pluto postgres[521]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:47:48 pluto postgres[574]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:52:26 pluto postgres[644]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:16:00 pluto postgres[18413]: [11-577] `?
5l#027ï¿½gï¿½xï¿½v#017ï¿½~ï¿½]ï¿½j#006ï¿½#037ï¿½Í<9b>ï¿½!=l#037ï¿½Myï¿½iï¿½Zï¿½vï¿½#&K#024t#002Nï¿½?ï¿½<ï¿½xMï¿½ipï¿½Y9×<89>fï¿½#015ï¿½
Jan 12 23:23:06 pluto postgres[2573]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:24:01 pluto postgres[21886]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:25:32 pluto postgres[22397]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:28:25 pluto postgres[23774]: [3-1] LOG:  received smart shutdown 
request
Jan 12 23:47:13 pluto postgres[32759]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:47:39 pluto postgres[521]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:47:48 pluto postgres[574]: [3-1] LOG:  received fast shutdown 
request
Jan 12 23:52:26 pluto postgres[644]: [3-1] LOG:  received fast shutdown 
request

Unusual System Events
=-=-=-=-=-=-=-=-=-=-=
Jan 12 23:15:37 pluto postgres[18392]: [3-1] FATAL:  database "drupal" does 
not exist
Jan 12 23:16:00 pluto postgres[18413]: [3-1] ERROR:  syntax error at or near 
"#037" at character 1
Jan 12 23:16:00 pluto postgres[18413]: [3-2] STATEMENT:
Jan 12 23:16:00 pluto postgres[18413]: [3-3]  
#037ï¿½#010ï¿½"ï¿½6ï¿½5mVIpï¿½#027ï¿½Nï¿½Û<9b>_?ï¿½uï¿½o6yï¿½8ï¿½#023ï¿½go#177ï¿½#0370ï¿½sqÔ<94>ï¿½_ï¿½Õ¾ï¿½7ï¿½Å<8b>#177#177ï¿½wÚ¿ï¿½6zï¿½R8#004ï¿½#003#024ï¿½wï¿½A\ï¿½+-.#023ï¿½Î<9e>ï¿½dï¿½,Mï¿½kï¿½?Jï¿½-
Jan 12 23:16:00 pluto postgres[18413]: [3-4] ï¿½bï¿½5/#033H#036ï¿½^hï¿½|
Ý¿ï¿½_#177ï¿½rï¿½bfï¿½wï¿½'ï¿½#0374ï¿½?ï¿½?Lï¿½Ó»ï¿½~ï¿½Aï¿½Oï¿½#007ï¿½5ï¿½Dï¿½#177ï¿½_ï¿½|
ï¿½|ï¿½#007Øª#025ï¿½i^60
[...]

As the traffic contains other sensitive information I will sent you the 
complete files offlist, I hope thats ok for you.

TIA
-Marc
-- 
[*] sys4 AG

http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstraße 15, 81669 München

Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263
Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer
Aufsichtsratsvorsitzender: Joerg Heidrich
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 190 bytes
Desc: This is a digitally signed message part.
URL: <http://dovecot.org/pipermail/dovecot/attachments/20130104/7fe31ce8/attachment.bin>