fts indexer stuck on very large plaintext messages

Hi,

I recently fts indexed a users mailbox with xapian which had 10-15 very large plaintext messages (>20Mb). The content of these messages was mostly a list of all files on a linux server (tripwire and backup reports).

The indexer-worker process was completely stuck processing these messages, cpu pegged at 100% running continuously for multiple days.

I was wondering if there is way to avoid this issue. It would be great if I could configure limits for the fts indexing process.