Am Freitag, 4. Januar 2013, 05:21:37 schrieb Timo Sirainen:
On 31.12.2012, at 5.23, Marc Schiffbauer m@sys4.de wrote:
I am having a problem indexing one of my mailboxes using the solr fts backend in dovecot 2.1.12 For many mailboxes it works just fine, but on one mailbox I currently always get a panic. ..
SEVERE: java.lang.RuntimeException: [was class java.io.CharConversionException] Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) Looks like the same issue I was trying to debug with the other guy also, but I couldn't figure out how that happens. Dovecot shouldn't be sending such data to Solr. Can you record the TCP traffic between Dovecot and Solr when this happens, and send it to me?
I have now captured the network traffic and I think the culprit is a mail sent by the logcheck service via the local nullmailer MTA. The message contains a postgresql log where a big amount of garbage has been recorded that has been tried to execute in postgres which it denied to do.
This looks a bit like that:
<doc><field name="uid">68058</field><field name="box">a8ca17d0b2a8e8540c196f21010a26e1</field><field name="user">xxxx@xxxxxxxxxxx.net</field><field name="id">68058/a8ca17d0b2a8e8540c196f21010a26e1/xxxx@xxxxxxxxxxx.net</field><field name="body"> Security Violations
Jan 12 23:16:00 pluto postgres[18413]: [11-577] ? 5l#027�g�x�v#017�~�]�j#006�#037�Í<9b>�!=l#037�My�i�Z�v�#&K#024t#002N�?�<�xM�ip�Y9×<89>f�#015� Jan 12 23:23:06 pluto postgres[2573]: [3-1] LOG: received fast shutdown request Jan 12 23:24:01 pluto postgres[21886]: [3-1] LOG: received fast shutdown request Jan 12 23:25:32 pluto postgres[22397]: [3-1] LOG: received fast shutdown request Jan 12 23:28:25 pluto postgres[23774]: [3-1] LOG: received smart shutdown request Jan 12 23:47:13 pluto postgres[32759]: [3-1] LOG: received fast shutdown request Jan 12 23:47:39 pluto postgres[521]: [3-1] LOG: received fast shutdown request Jan 12 23:47:48 pluto postgres[574]: [3-1] LOG: received fast shutdown request Jan 12 23:52:26 pluto postgres[644]: [3-1] LOG: received fast shutdown request Jan 12 23:16:00 pluto postgres[18413]: [11-577] ?
5l#027�g�x�v#017�~�]�j#006�#037�Í<9b>�!=l#037�My�i�Z�v�#&K#024t#002N�?�<�xM�ip�Y9×<89>f�#015�
Jan 12 23:23:06 pluto postgres[2573]: [3-1] LOG: received fast shutdown
request
Jan 12 23:24:01 pluto postgres[21886]: [3-1] LOG: received fast shutdown
request
Jan 12 23:25:32 pluto postgres[22397]: [3-1] LOG: received fast shutdown
request
Jan 12 23:28:25 pluto postgres[23774]: [3-1] LOG: received smart shutdown
request
Jan 12 23:47:13 pluto postgres[32759]: [3-1] LOG: received fast shutdown
request
Jan 12 23:47:39 pluto postgres[521]: [3-1] LOG: received fast shutdown
request
Jan 12 23:47:48 pluto postgres[574]: [3-1] LOG: received fast shutdown
request
Jan 12 23:52:26 pluto postgres[644]: [3-1] LOG: received fast shutdown
request
Unusual System Events
Jan 12 23:15:37 pluto postgres[18392]: [3-1] FATAL: database "drupal" does
not exist
Jan 12 23:16:00 pluto postgres[18413]: [3-1] ERROR: syntax error at or near
"#037" at character 1
Jan 12 23:16:00 pluto postgres[18413]: [3-2] STATEMENT:
Jan 12 23:16:00 pluto postgres[18413]: [3-3]
#037�#010�"�6�5mVIp�#027�N�Û<9b>_?�u�o6y�8�#023�go#177�#0370�sqÔ<94>�_�վ�7�Å<8b>#177#177�wڿ�6z�R8#004�#003#024�w�A\�+-.#023�Î<9e>�d�,M�k�?J�-
Jan 12 23:16:00 pluto postgres[18413]: [3-4] �b�5/#033H#036�^h�|
ݿ�_#177�r�bf�w�'�#0374�?�?L�ӻ�~�A�O�#007�5�D�#177�_�|
�|�#007ت#025�i^60
[...]
As the traffic contains other sensitive information I will sent you the complete files offlist, I hope thats ok for you.
TIA -Marc
[*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München
Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich