Re: BUG: sieve does not set seen-Flag

Ok. I told you, that all and every Flag is set, except \Seen... I tried to figure out, whats happening here... And my dovecot is not working as it is designed...

It's nice to see, that dovecot is working for you... but here it is not working as it should... Changing to cyrus? What should i do? Where i can find debug-infos?

Please understand me right... It is nice for you, if dovecot does, what you expect... It is nice. But here it does not work correctly. dovecot makes a big mistake. And i try to give as much information, as i'm possible to give... Nice to hear, that your dovecot copies the Seen-Flag... my dovecot does not copy the Seen-flag. It ignores it. But WHY. Fucking WHY???

Are there some posibilities to turn up log level? more than i know? How can i get more debug-level? That are the informations, i need to know.. It is useless for me, when i know, that dovecot works for you. My dovecot does not its job. And i need to know, how i can debug this shit. I hope, you understand me. If your dovecot works as expected... it's nice for you... it does not help me. I need definitly other informations...

Jakob

Am 05.12.18 um 22:18 schrieb Larry Rosenman:

We've all shown the way it should work, and what DOES work for us.  There appears to be <something> different about your setup.

I've showed you my spam sieve filter that does set \Seen.  

I deliver my mail via dovecot LMTP to mbox formatted files. 

What's different in your setup?

Those \Seen flags are visible in ALL the clients I use (Outlook, Outlook Android, Gmail Android, Neomutt).

On Wed, Dec 5, 2018 at 3:15 PM Jakobus Schürz mailto:wertstoffe@nurfuerspam.de> wrote:

Hello!
is anybody else here??? Are my informations to much? Am I alone
with this fucking shit? Are my informations to less??? Why do I
have the feeling, nobody else is interesting in this problem?


Jakob

Am 05.12.18 um 11:37 schrieb Jakobus Schürz:

...

What really strange is:

There is a seen message

1544001025.M268344P5000.mymail,S=2804,W=2861:2,S

Shown in Thunderbird as seen. Then i move this message to INBOX,
and the logs say:

Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: Mailbox INBOX: Mailbox opened because: UID move
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: imapsieve: mailbox INBOX: MOVE event
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Error: Log synchronization error at seq=22,offset=31692 for /var/lib/dovecot/db/indexes/Maildir/user.name/INBOX/dovecot.index <http://user.name/INBOX/dovecot.index>: Append with UID 861, but next_uid = 862
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Warning: fscking index file /var/lib/dovecot/db/indexes/Maildir/user.name/INBOX/dovecot.index <http://user.name/INBOX/dovecot.index>
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: sieve: Pigeonhole version 0.5.4 (60b0f48d) initializing
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.4 (60b0f48d) loaded
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.4 (60b0f48d) loaded
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`INBOX/Junk' from=`*' causes=(COPY) => before=`file:/etc/dovecot/sieve/report-spam.sieve' after=(none)
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`INBOX/Junk' causes=(COPY) => before=`file:/etc/dovecot/sieve/report-ham.sieve' after=(none)
*Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name
<http://user.name>)<5276><+eYG4kJ85DMuffon>: copy from
INBOX/Arbeiten/bla: box=INBOX, uid=861,
msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com>
<mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com>,
from=user.name@bla.com <mailto:from=user.name@bla.com>,
subject=TEST006, flags=()*
Dec 05 10:22:23 mymail dovecot[24019]: imap(user.name <http://user.name>)<5276><+eYG4kJ85DMuffon>: expunge: box=INBOX/Arbeiten/bla, uid=16, msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com> <mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com>, from=user.name@bla.com <mailto:from=user.name@bla.com>, subject=TEST006, flags=(\Seen)

The fat line shows, that the copied message has no flags. The
next line shows, that the expunged message has the \Seen-Flag...
That is strange. Do YOU have any idea, what can cause this?

The filename in the new folder is:

1544001025.M268344P5000.mymail,S=2804,W=2861:2,


Then I deactivated the actions on COPY (the two lines above the
fat line) and moved this message back:

Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Debug: Mailbox INBOX/Arbeiten/bla: Mailbox opened because: UID move
Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Debug: acl vfile: file /var/mail/user.name/Maildir/Arbeiten/bla/dovecot-acl <http://user.name/Maildir/Arbeiten/bla/dovecot-acl> not found
Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Debug: imapsieve: mailbox INBOX/Arbeiten/bla: MOVE event
Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Error: Log synchronization error at seq=2,offset=20716 for /var/lib/dovecot/db/indexes/Maildir/user.name/Arbeiten/bla/dovecot.index <http://user.name/Arbeiten/bla/dovecot.index>: Append with UID 18, but next_uid = 19
Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: Warning: fscking index file /var/lib/dovecot/db/indexes/Maildir/user.name/Arbeiten/bla/dovecot.index <http://user.name/Arbeiten/bla/dovecot.index>
*Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name
<http://user.name>)<5646><NgXXBUN86TMuffon>: copy from INBOX:
box=INBOX/Arbeiten/bla, uid=18,
msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com>
<mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com>,
from=user.name@bla.com <mailto:from=user.name@bla.com>,
subject=TEST006, flags=()*
Dec 05 10:29:52 mymail dovecot[5621]: imap(user.name <http://user.name>)<5646><NgXXBUN86TMuffon>: expunge: box=INBOX, uid=861, msgid=<a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com> <mailto:a0c120f23b6a42cba283cd12f8fc7c864747d36d.camel@bla.com>, from=user.name@bla.com <mailto:from=user.name@bla.com>, subject=TEST006, flags=(\Seen)

The fat line again shows, that the message has no flags set (but
i klicked it in thunderbird, and it was shown as seen, before i
moved it. Filenamebehaviour is as before. The file in the
copy-destination has no S for seen...

Is there a posibility, that there is a connection to the "Log
synchronization error"? On each and every move-Action, at the
beginning the logs show this error (i reported also yesterday and
month before!)

jakob

Am 05.12.18 um 09:24 schrieb Jakobus Schürz:

...

Does it matter, if the keyword-files do not match?

In one of the two folders is the content of dovecot-keywords

0 $label3
1 Junk
2 NonJunk

in the other folder:

0 $label3
1 NonJunk
2 Junk
3 redirected
4 $label2
5 $label4
6 Seen

As i said, i use $labes[1-4] from thunderbird.
And i use as MUA Thunderbird, Androids Gmail-App, Horde webmail,
somtimes samsungs mail-app on android, k9mail on android (not now), and
evolution from gnome.
But... the Filename loses the S, when copying the file to another folder
with all of the mailclients. As i showed you.

I also deactivated all of the sievescripts in dovecot (i have some
before, some after, the two for setting and removing Junk and \seen as
described at the begin of this thread, and user-sieve-scripts), and
dovecot again sets a moved message to unread and recent...

I also tested it for another user. The same.

And it is ONLY the Seen-Flag, which does not work on setting it via
sieve. Or maybe, setting a message as \Recent removes the \Seen-Flag? 
And dovecot sets every new message in a folder to \Recent, independend
where it comes from???
Sorry, I'm not a programmer ;-)

But i try to describe it as good as possible, what i can see on my machine.

Hopefully i have time to setup a second mailserver for testing-purpose,
to test, what's going on. Is it the rest of kopano, which shits into my
dovecot, or some misconfiguration, or the ldap-connection?

There is exim4, which pipes the emails to /usr/lib/dovecot/deliver

But when i move emails around from one imap-folder to another one, there
is no exim...

The other thing is (as shown in a mail before), i have rspamd, to which
i pipe messages, when i move them from Junk to anywhere - learning ham,
and move them from anywhere to Junk - learning spam. This process only
sends a copy of the already moved message to rspamc...

The filesystem has read/write permissions for vmail:vmail, which i user
for the mailboxes and dovecot-process...

For me, it looks like when dovecot copys or put a message to a folder,
it sets it default to unseen and recent. Is there maybe an option, which
has influence for this behaviour?

And i do not move messages directly on filesystem with cp, mv or other
filesystemtools.

Jakob

Am 05.12.18 um 01:21 schrieb Ralph Seichter:

...

* Jakobus Schürz:

...

1543935543.M447415P13997.mymail,S=726,W=748:2,Sa

Then i move this email to another IMAP-Folder, and then there is the
filename

1543935543.M447415P13997.mymail,S=726,W=748:2,

As expected, the seen-flag disappeared... the same as thunderbird
shows.

And what about the "dovecot-keywords" files in both folders? Do they
match? The letter "a" seems to indicates that there is at least one
non-standard flag defined in the source folder's keywords. By the way,
can I assume you move messages only by using Thunderbird/IMAP and not by
manipulating the file system?

Here's how things look on my server:

  # On arrival (UNSEEN)
  1543968031.M941319P5841.foo,S=1390,W=1422:2,
  # After reading (SEEN)
  1543968031.M941319P5841.foo,S=1390,W=1422:2,S
  # After being moved to another folder (SEEN)
  1543968031.M941319P5841.foo,S=1390,W=1422:2,S

I can use IMAP search terms SEEN and UNSEEN as indicated above, and I
see the same message state displayed in Notmuch mail (my default, it
accesses Dovecot's Maildir storage directly) and various IMAP clients
connecting to Dovecot. Things are working just fine here.

-Ralph

-- Larry Rosenman                     http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c)     E-Mail: larryrtx@gmail.com mailto:larryrtx@gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106