Hi Marc,

[+list since I'm unlikely to be able to solve this problem myself]

I am trying to setup a debian testing (wheeze) mail server using postfix, dovecot and amavisd-new with spamassassin. I have everything working fine, using mdbox mailboxes and system users. As a final touch for this setup, I wanted to be able to train the (global) bayes database directly through IMAP.

Hence, I installed your plugin (directly from the official debian repositories) and set it up to report mails to spamassassin. I am using the "pipe" backend to call a wrapper script, that stores the mail into a temporary file and launches sa-learn to learn it. My tests indicate that this is working properly.

Ok, nice.

However, when the dovecot-antispam plugin is enabled, I have a weird problem sending emails. This is, whenever my MUA tries to save the just sent message to the "Sent" folder, dovecot shows the following error:

Hmm, ok, let's see

...

---

Dovecot's error log:

Jun 4 22:35:14 aiur dovecot: imap(user): Error: mdbox /home/user/.mdbox/mailboxes/Sent/dbox-Mails: map uid lost for uid 0 Jun 4 22:36:06 aiur dovecot: imap(user): Error: /home/user/.mdbox/mailboxes/Spam/dbox-Mails/dovecot.index reset, view is now inconsistent Jun 4 22:36:09 aiur dovecot: imap(user): Error: Log synchronization error at seq=8,offset=27592 for /home/user/.mdbox/storage/dovecot.map.index: Append with UID 56056, but next_uid = 56057 Jun 4 22:36:09 aiur dovecot: lda(user): Error: Log synchronization error at seq=8,offset=27592 for /home/user/.mdbox/storage/dovecot.map.index: Append with UID 56056, but next_uid = 56057 Jun 4 22:36:10 aiur dovecot: imap(user): Error: /home/user/.mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent

As a result, the MUA hangs for a while (some minute and a half). After that it closes the IMAP session properly, but I am left with two copies of the sent email in the "Sent" folder: one that is marked as unread and one that is not.

Curious. I think the problem is likely the mdbox storage... There have always been some issues with it and the antispam plugin when combined. The first issue was that we couldn't access the raw text or something ... not sure what's up now.

...

IMAP Conversation (as logged by roundcube webmail)

...

[04-Jun-2012 22:35:14 +0200]: [4A68] C: A0005 APPEND INBOX.Sent (\Seen) {519+} [04-Jun-2012 22:35:14 +0200]: [4A68] C: Received: from cpe-76-169-183-245.socal.res.rr.com ([76.169.183.245]) by server.domain.tld with HTTP (HTTP/1.1 POST); Mon, 04 Jun 2012 22:35:14 +0200 MIME-Version: 1.0 ... [04-Jun-2012 22:36:10 +0200]: [4A68] S: A0005 OK [APPENDUID 1338488996 4274] Append completed.

That looks ... pretty normal.

At this point, I do not know what else to try or how to fix this problem. Thus, I have had to disable your plugin for now. Do you have any ideas on how to proceed? I can give you access to this machine if need be (it's a personal server).

Unfortunately, I don't. I can only suggest, as a test, trying with some other storage format -- I only use Maildir -- to see if the problem is really in the interaction with mdbox. I'm fairly sure that's likely the problem, maybe the plugin doesn't pass something through append that is needed by mdbox, but I've never even attempted to understand mdbox.

Maybe Timo can comment. Timo, you can find the latest code here: http://git.sipsolutions.net/?p=dovecot-antispam.git;a=summary

johannes