BUG: sieve does not set seen-Flag

Jakobus Schürz wertstoffe at nurfuerspam.de
Wed Dec 5 23:29:22 EET 2018


Ok. I told you, that all and every Flag is set, except \Seen... I tried
to figure out, whats happening here... And my dovecot is not working as
it is designed...

It's nice to see, that dovecot is working for you... but here it is not
working as it should...
Changing to cyrus? What should i do? Where i can find debug-infos?

Please understand me right... It is nice for you, if dovecot does, what
you expect... It is nice. But here it does not work correctly. dovecot
makes a big mistake. And i try to give as much information, as i'm
possible to give...
Nice to hear, that your dovecot copies the Seen-Flag... my dovecot does
not copy the Seen-flag. It ignores it. But WHY. Fucking WHY???

Are there some posibilities to turn up log level? more than i know? How
can i get more debug-level? That are the informations, i need to know..
It is useless for me, when i know, that dovecot works for you. My
dovecot does not its job. And i need to know, how i can debug this shit.
I hope, you understand me. If your dovecot works as expected... it's
nice for you... it does not help me. I need definitly other informations...


Jakob

Am 05.12.18 um 22:18 schrieb Larry Rosenman:
> We've all shown the way it should work, and what DOES work for us. 
> There appears to be <something> different about your setup.
>
> I've showed you my spam sieve filter that does set \Seen.  
>
> I deliver my mail via dovecot LMTP to mbox formatted files. 
>
> What's different in your setup?
>
> Those \Seen flags are visible in ALL the clients I use (Outlook,
> Outlook Android, Gmail Android, Neomutt).
>
>
>
> On Wed, Dec 5, 2018 at 3:15 PM Jakobus Schürz
> <wertstoffe at nurfuerspam.de <mailto:wertstoffe at nurfuerspam.de>> wrote:
>
>     Hello!
>     is anybody else here??? Are my informations to much? Am I alone
>     with this fucking shit? Are my informations to less??? Why do I
>     have the feeling, nobody else is interesting in this problem?
>
>
>     Jakob
>
>     Am 05.12.18 um 11:37 schrieb Jakobus Schürz:
>>
>>     What really strange is:
>>
>>     There is a seen message
>>
>>     1544001025.M268344P5000.mymail,S=2804,W=2861:2,S
>>
>>     Shown in Thunderbird as seen. Then i move this message to INBOX,
>>     and the logs say:
>>
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: Mailbox INBOX: Mailbox opened because: UID move
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: imapsieve: mailbox INBOX: MOVE event
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Error: Log synchronization error at seq=22,offset=31692 for /var/lib/dovecot/db/indexes/Maildir/user.name/INBOX/dovecot.index <http://user.name/INBOX/dovecot.index>: Append with UID 861, but next_uid = 862
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Warning: fscking index file /var/lib/dovecot/db/indexes/Maildir/user.name/INBOX/dovecot.index <http://user.name/INBOX/dovecot.index>
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: sieve: Pigeonhole version 0.5.4 (60b0f48d) initializing
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.4 (60b0f48d) loaded
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.4 (60b0f48d) loaded
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`INBOX/Junk' from=`*' causes=(COPY) => before=`file:/etc/dovecot/sieve/report-spam.sieve' after=(none)
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`INBOX/Junk' causes=(COPY) => before=`file:/etc/dovecot/sieve/report-ham.sieve' after=(none)
>>     *Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name
>>     <http://user.name>)<5276><+eYG4kJ85DMuffon>: copy from
>>     INBOX/Arbeiten/bla: box=INBOX, uid=861,
>>     msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com>
>>     <mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com>,
>>     from=user.name at bla.com <mailto:from=user.name at bla.com>,
>>     subject=TEST006, flags=()*
>>     Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: expunge: box=INBOX/Arbeiten/bla, uid=16, msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com> <mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com>, from=user.name at bla.com <mailto:from=user.name at bla.com>, subject=TEST006, flags=(\Seen)
>>
>>     The fat line shows, that the copied message has no flags. The
>>     next line shows, that the expunged message has the \Seen-Flag...
>>     That is strange. Do YOU have any idea, what can cause this?
>>
>>     The filename in the new folder is:
>>
>>     1544001025.M268344P5000.mymail,S=2804,W=2861:2,
>>
>>
>>     Then I deactivated the actions on COPY (the two lines above the
>>     fat line) and moved this message back:
>>
>>     Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Debug: Mailbox INBOX/Arbeiten/bla: Mailbox opened because: UID move
>>     Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Debug: acl vfile: file /var/mail/user.name/Maildir/Arbeiten/bla/dovecot-acl <http://user.name/Maildir/Arbeiten/bla/dovecot-acl> not found
>>     Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Debug: imapsieve: mailbox INBOX/Arbeiten/bla: MOVE event
>>     Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Error: Log synchronization error at seq=2,offset=20716 for /var/lib/dovecot/db/indexes/Maildir/user.name/Arbeiten/bla/dovecot.index <http://user.name/Arbeiten/bla/dovecot.index>: Append with UID 18, but next_uid = 19
>>     Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Warning: fscking index file /var/lib/dovecot/db/indexes/Maildir/user.name/Arbeiten/bla/dovecot.index <http://user.name/Arbeiten/bla/dovecot.index>
>>     *Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name
>>     <http://user.name>)<5646><NgXXBUN86TMuffon>: copy from INBOX:
>>     box=INBOX/Arbeiten/bla, uid=18,
>>     msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com>
>>     <mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com>,
>>     from=user.name at bla.com <mailto:from=user.name at bla.com>,
>>     subject=TEST006, flags=()*
>>     Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: expunge: box=INBOX, uid=861, msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com> <mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel at bla.com>, from=user.name at bla.com <mailto:from=user.name at bla.com>, subject=TEST006, flags=(\Seen)
>>
>>     The fat line again shows, that the message has no flags set (but
>>     i klicked it in thunderbird, and it was shown as seen, before i
>>     moved it. Filenamebehaviour is as before. The file in the
>>     copy-destination has no S for seen...
>>
>>     Is there a posibility, that there is a connection to the "Log
>>     synchronization error"? On each and every move-Action, at the
>>     beginning the logs show this error (i reported also yesterday and
>>     month before!)
>>
>>     jakob
>>
>>     Am 05.12.18 um 09:24 schrieb Jakobus Schürz:
>>>     Does it matter, if the keyword-files do not match?
>>>
>>>     In one of the two folders is the content of dovecot-keywords
>>>
>>>     0 $label3
>>>     1 Junk
>>>     2 NonJunk
>>>
>>>     in the other folder:
>>>
>>>     0 $label3
>>>     1 NonJunk
>>>     2 Junk
>>>     3 redirected
>>>     4 $label2
>>>     5 $label4
>>>     6 Seen
>>>
>>>     As i said, i use $labes[1-4] from thunderbird.
>>>     And i use as MUA Thunderbird, Androids Gmail-App, Horde webmail,
>>>     somtimes samsungs mail-app on android, k9mail on android (not now), and
>>>     evolution from gnome.
>>>     But... the Filename loses the S, when copying the file to another folder
>>>     with all of the mailclients. As i showed you.
>>>
>>>     I also deactivated all of the sievescripts in dovecot (i have some
>>>     before, some after, the two for setting and removing Junk and \seen as
>>>     described at the begin of this thread, and user-sieve-scripts), and
>>>     dovecot again sets a moved message to unread and recent...
>>>
>>>     I also tested it for another user. The same.
>>>
>>>     And it is ONLY the Seen-Flag, which does not work on setting it via
>>>     sieve. Or maybe, setting a message as \Recent removes the \Seen-Flag? 
>>>     And dovecot sets every new message in a folder to \Recent, independend
>>>     where it comes from???
>>>     Sorry, I'm not a programmer ;-)
>>>
>>>     But i try to describe it as good as possible, what i can see on my machine.
>>>
>>>     Hopefully i have time to setup a second mailserver for testing-purpose,
>>>     to test, what's going on. Is it the rest of kopano, which shits into my
>>>     dovecot, or some misconfiguration, or the ldap-connection?
>>>
>>>     There is exim4, which pipes the emails to /usr/lib/dovecot/deliver
>>>
>>>     But when i move emails around from one imap-folder to another one, there
>>>     is no exim...
>>>
>>>     The other thing is (as shown in a mail before), i have rspamd, to which
>>>     i pipe messages, when i move them from Junk to anywhere - learning ham,
>>>     and move them from anywhere to Junk - learning spam. This process only
>>>     sends a copy of the already moved message to rspamc...
>>>
>>>     The filesystem has read/write permissions for vmail:vmail, which i user
>>>     for the mailboxes and dovecot-process...
>>>
>>>     For me, it looks like when dovecot copys or put a message to a folder,
>>>     it sets it default to unseen and recent. Is there maybe an option, which
>>>     has influence for this behaviour?
>>>
>>>     And i do not move messages directly on filesystem with cp, mv or other
>>>     filesystemtools.
>>>
>>>     Jakob
>>>
>>>     Am 05.12.18 um 01:21 schrieb Ralph Seichter:
>>>>     * Jakobus Schürz:
>>>>
>>>>>     1543935543.M447415P13997.mymail,S=726,W=748:2,Sa
>>>>>
>>>>>     Then i move this email to another IMAP-Folder, and then there is the
>>>>>     filename
>>>>>
>>>>>     1543935543.M447415P13997.mymail,S=726,W=748:2,
>>>>>
>>>>>     As expected, the seen-flag disappeared... the same as thunderbird
>>>>>     shows.
>>>>     And what about the "dovecot-keywords" files in both folders? Do they
>>>>     match? The letter "a" seems to indicates that there is at least one
>>>>     non-standard flag defined in the source folder's keywords. By the way,
>>>>     can I assume you move messages only by using Thunderbird/IMAP and not by
>>>>     manipulating the file system?
>>>>
>>>>     Here's how things look on my server:
>>>>
>>>>       # On arrival (UNSEEN)
>>>>       1543968031.M941319P5841.foo,S=1390,W=1422:2,
>>>>       # After reading (SEEN)
>>>>       1543968031.M941319P5841.foo,S=1390,W=1422:2,S
>>>>       # After being moved to another folder (SEEN)
>>>>       1543968031.M941319P5841.foo,S=1390,W=1422:2,S
>>>>
>>>>     I can use IMAP search terms SEEN and UNSEEN as indicated above, and I
>>>>     see the same message state displayed in Notmuch mail (my default, it
>>>>     accesses Dovecot's Maildir storage directly) and various IMAP clients
>>>>     connecting to Dovecot. Things are working just fine here.
>>>>
>>>>     -Ralph
>
>
>
> -- 
> Larry Rosenman                     http://www.lerctr.org/~ler
> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
> <mailto:larryrtx at gmail.com>
> US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dovecot.org/pipermail/dovecot/attachments/20181205/48547d82/attachment-0001.html>


More information about the dovecot mailing list