dovecot and broken uidlist

Sat Jan 23 01:59:41 EET 2021

Hi,

after some tests I notice a difference in dovecot-uidlist line format 
when message is read from "old kernel" and "new kernel":

81184 G1611334252.M95445P32580.mail05.myserver.com 
:1611334252.M95445P32580.mail05.myserver.com,S=38689,W=39290
81185 G1611336004.M47750P3921.mail01.myserver.com 
:1611336004.M47750P3921.mail01.myserver.com,S=15917,W=16212
81186 G1611338535.M542784P10852.mail03.myserver.com 
:1611338535.M542784P10852.mail03.myserver.com,S=12651,W=12855
81187 G1611341375.M164702P13505.mail01.myserver.com 
:1611341375.M164702P13505.mail01.myserver.com,S=8795,W=8964
81189 G1611354389.M984432P14754.mail06.myserver.com 
:1611354389.M984432P14754.mail06.myserver.com,S=3038,W=3096
81191 :1611355746.M365669P10402.mail03.myserver.com,S=3049,W=3107
81193 :1611356442.M611719P20778.mail01.myserver.com,S=1203,W=1230
81194 G1611356752.M573233P27082.mail01.myserver.com 
:1611356752.M573233P27082.mail01.myserver.com,S=1210,W=1238
81195 G1611356991.M905681P30704.mail01.myserver.com 
:1611356991.M905681P30704.mail01.myserver.com,S=1220,W=1249
81197 :1611357210.M42178P1962.mail01.myserver.com,S=1220,W=1250
81199 :1611357560.M26894P7157.mail01.myserver.com,S=1233,W=1264

With "old kernel" (where all works fine) UID number are incremental and 
in the line there is one more field that start with "G1611...".

With "new kernel" (where error comes) UID number skip always a number 
and the field "G1611..." is missing.

Maciej, do you also have this behavior?

Why Dovecot create different uidlist line format with different kernel?

Il 22/01/21 17:50, Maciej Milaszewski ha scritto:
> Hi
> I using pop/imap and LMTP via director and user go back in dovecot node
>
> Current: 10.0.100.22 (expires 2021-01-22 17:42:44)
> Hashed: 10.0.100.22
> Initial config: 10.0.100.22
>
> I have 6 dovecot backands and index via local ssd disk
> mail_location = maildir:~/Maildir:INDEX=/var/dovecot_indexes%h
>
> user never log in two different nodes in this same time
>
> I update debian from 8 to 9 (and to 10) and tested via kerlnel 4.x and
> 5.x and problem exists
> If I change kernel to 3.16.x problem not exists
> I tested like:
>
> problem exists:
> dovecot1-5 with 4.x
> and
> dovecot1-4 - with 3.19.x
> dovecot5 - with 4.x
> and
> dovecot1-5 - with 5.x
> and
> dovecot1-4 - with 4.x
> dovecot5 - with 5.x
>
> not exists:
> dovecot1-5 - with 3.19.x
>
> not exists:
> dovecot1-5 - with 3.19.x+kernel-care
>
> I use NetAPP with mount options:
> rw,sec=sys,noexec,noatime,tcp,soft,rsize=32768,wsize=32768,intr,nordirplus,nfsvers=3,actimeo=120
> I try with nocto and without nocto
>
> big guys from NetApp says "nfs 4.x need auth via kerberos ...."
>
>
>
> On 22.01.2021 16:08, Alessio Cecchi wrote:
>> Hi Maciej,
>>
>> I'm using LDA for delivery email in mailbox (Maildir) and I
>> think(hope) that switching to LMTP via director will fix my problem,
>> but I d'ont know why wiht old kernel works and with recent no.
>>
>> Are you using POP/IMAP and LMTP via director so any update to dovecot
>> indexes is done from the same server?
>>
>> Il 19/01/21 16:22, Maciej Milaszewski ha scritto:
>>> Hi
>>> I use lmtp and you ?
>>>
>>> On 19.01.2021 10:45, Alessio Cecchi wrote:
>>>> Hi Maciej,
>>>>
>>>> I had the same issue when I switched dovecot backend from Cento 6 to
>>>> Centos 7.
>>>>
>>>> Also my configuration is similar to you, Dovecot Direcot, Dovecot
>>>> backend that share Maildir via NFS on NetApp.
>>>>
>>>> For local delivery of emails are you using LDA or LMTP? I'm using LDA.
>>>>
>>>> Let me know.
>>>>
>>>> Thanks
>>>>
>>>> Il 13/01/21 15:56, Maciej Milaszewski ha scritto:
>>>>> Hi
>>>>> I have been trying resolve my problem with dovecot for a few days and I
>>>>> dont have idea....
>>>>>
>>>>> My environment is: dovecot director+5 dovecot guest
>>>>>
>>>>> dovecot-2.2.36.4 from source
>>>>> Linux 3.16.0-11-amd64
>>>>> storage via nfs (NetApp)
>>>>>
>>>>> all works fine but when I update OS from debian 8 (kernel 3.16.x) to
>>>>> debian 9 (kernel 4.9.x ) sometimes I get random in logs:
>>>>> Broken dovecot-uidlist
>>>>>
>>>>> examle:
>>>>> Error: Broken file
>>>>> /vmail2/po/pollygraf.xxx_pg_pollygraf/Maildir/dovecot-uidlist line 88:
>>>>> Invalid data:
>>>>>
>>>>> (for random users - sometimes 10 error in day per node, some times more)
>>>>>
>>>>> File looks ok
>>>>>
>>>>> But if I change kernel to 3.16.x problem with "Broken file
>>>>> dovecot-uidlist"  - not exists
>>>>> if turn to 4.9 or 5.x - problem exists
>>>>>
>>>>> I have storage via nfs with opions:
>>>>> rw,sec=sys,noexec,noatime,tcp,hard,rsize=65536,wsize=65536,intr,nordirplus,nfsvers=3,tcp,actimeo=120
>>>>> I tested with "nocto" or without "nocto" - nothing changes ......
>>>>>
>>>>> nfs options in node:
>>>>> mmap_disable = yes
>>>>> mail_fsync = always
>>>>>
>>>>> I bet the configuration is correct and I wonder why the problem occurs
>>>>> with other kernels
>>>>> 3.x.x - ok
>>>>> 4.x - not ok
>>>>>
>>>>> I check and user who have problem did not connect to another node in
>>>>> this time
>>>>>
>>>>> I dont have idea why problem exists on the kernel 4.x but not in 3.x
>>>>>
>>>>>
>>>> -- 
>>>> Alessio Cecchi
>>>> Postmaster @ http://www.qboxmail.it
>>>> https://www.linkedin.com/in/alessice
>> -- 
>> Alessio Cecchi
>> Postmaster @ http://www.qboxmail.it
>> https://www.linkedin.com/in/alessice
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dovecot.org/pipermail/dovecot/attachments/20210123/6b1fb250/attachment.html>