dovecot and broken uidlist

[Maciej Milaszewski]

Hi
I using pop/imap and LMTP via director and user go back in dovecot node

Current: 10.0.100.22 (expires 2021-01-22 17:42:44)
Hashed: 10.0.100.22
Initial config: 10.0.100.22

I have 6 dovecot backands and index via local ssd disk
mail_location = maildir:~/Maildir:INDEX=/var/dovecot_indexes%h

user never log in two different nodes in this same time

I update debian from 8 to 9 (and to 10) and tested via kerlnel 4.x and
5.x and problem exists
If I change kernel to 3.16.x problem not exists
I tested like:

problem exists:
dovecot1-5 with 4.x
and
dovecot1-4 - with 3.19.x
dovecot5 - with 4.x
and
dovecot1-5 - with 5.x
and
dovecot1-4 - with 4.x
dovecot5 - with 5.x

not exists:
dovecot1-5 - with 3.19.x

not exists:
dovecot1-5 - with 3.19.x+kernel-care

I use NetAPP with mount options:
rw,sec=sys,noexec,noatime,tcp,soft,rsize=32768,wsize=32768,intr,nordirplus,nfsvers=3,actimeo=120
I try with nocto and without nocto

big guys from NetApp says "nfs 4.x need auth via kerberos ...."



On 22.01.2021 16:08, Alessio Cecchi wrote:
>
> Hi Maciej,
>
> I'm using LDA for delivery email in mailbox (Maildir) and I
> think(hope) that switching to LMTP via director will fix my problem,
> but I d'ont know why wiht old kernel works and with recent no.
>
> Are you using POP/IMAP and LMTP via director so any update to dovecot
> indexes is done from the same server?
>
> Il 19/01/21 16:22, Maciej Milaszewski ha scritto:
>> Hi
>> I use lmtp and you ?
>>
>> On 19.01.2021 10:45, Alessio Cecchi wrote:
>>> Hi Maciej,
>>>
>>> I had the same issue when I switched dovecot backend from Cento 6 to
>>> Centos 7.
>>>
>>> Also my configuration is similar to you, Dovecot Direcot, Dovecot
>>> backend that share Maildir via NFS on NetApp.
>>>
>>> For local delivery of emails are you using LDA or LMTP? I'm using LDA.
>>>
>>> Let me know.
>>>
>>> Thanks
>>>
>>> Il 13/01/21 15:56, Maciej Milaszewski ha scritto:
>>>> Hi
>>>> I have been trying resolve my problem with dovecot for a few days and I
>>>> dont have idea....
>>>>
>>>> My environment is: dovecot director+5 dovecot guest
>>>>
>>>> dovecot-2.2.36.4 from source
>>>> Linux 3.16.0-11-amd64
>>>> storage via nfs (NetApp)
>>>>
>>>> all works fine but when I update OS from debian 8 (kernel 3.16.x) to
>>>> debian 9 (kernel 4.9.x ) sometimes I get random in logs:
>>>> Broken dovecot-uidlist
>>>>
>>>> examle:
>>>> Error: Broken file
>>>> /vmail2/po/pollygraf.xxx_pg_pollygraf/Maildir/dovecot-uidlist line 88:
>>>> Invalid data:
>>>>
>>>> (for random users - sometimes 10 error in day per node, some times more)
>>>>
>>>> File looks ok
>>>>
>>>> But if I change kernel to 3.16.x problem with "Broken file
>>>> dovecot-uidlist"  - not exists
>>>> if turn to 4.9 or 5.x - problem exists
>>>>
>>>> I have storage via nfs with opions:
>>>> rw,sec=sys,noexec,noatime,tcp,hard,rsize=65536,wsize=65536,intr,nordirplus,nfsvers=3,tcp,actimeo=120
>>>> I tested with "nocto" or without "nocto" - nothing changes ......
>>>>
>>>> nfs options in node:
>>>> mmap_disable = yes
>>>> mail_fsync = always
>>>>
>>>> I bet the configuration is correct and I wonder why the problem occurs
>>>> with other kernels
>>>> 3.x.x - ok
>>>> 4.x - not ok
>>>>
>>>> I check and user who have problem did not connect to another node in
>>>> this time
>>>>
>>>> I dont have idea why problem exists on the kernel 4.x but not in 3.x
>>>>
>>>>
>>> -- 
>>> Alessio Cecchi
>>> Postmaster @ http://www.qboxmail.it
>>> https://www.linkedin.com/in/alessice
> -- 
> Alessio Cecchi
> Postmaster @ http://www.qboxmail.it
> https://www.linkedin.com/in/alessice