I have to say I'm totally baffled since I do nothing when LetsEncrypt renews the certificate.
I know the cert has been updated because the mail clients asks me if I trust the certificate.
Curious. The mail clients really shouldn't ask anything when
encountering a valid certificate.
Are you sure the client isn't asking you to trust an expired
certificate?