December 2014 - dovecot

[Dovecot] Doveadm sometimes failed "to iterate through some users" after upgrade to 2.2
by David Davidov 12 Dec '14

12 Dec '14

> Yes, after an upgrade works fine. Hello, Unfortunately this issue hits again. I installed the latest stable version 2.2.15 and got the following error # doveadm expunge -u "^o^(a)dave.s484.qa-team.net" mailbox 'INBOX.Junk Mail' SAVEDBEFORE 7d doveadm(^o^(a)dave.s484.qa-team.net): Error: userdb lookup(^o^(a)dave.s484.qa-team.net): Disconnected unexpectedly doveadm(^o^(a)dave.s484.qa-team.net): Fatal: User lookup failed: Internal error occurred. Refer to server log for more information. # echo $? 75 Our production servers run 2.2.13, where the situation is the same. regards, David Davidov System administrator @ icdsoft.com -- David Davidov | System Administrator | ICDSoft Ltd.

2 1

Dsync issues between Cyrus and Dovecot
by Ovidiu Moldovan 12 Dec '14

12 Dec '14

Hello, I have some issues related with dsync when trying to perform two way synchronization between Cyrus and Dovecot. 1st time synchronization always works and email, folders, flags can be synced between these but once for example in dovecot side the user creates a folder, dsync fails with the following errors: Debug: brain M: Other brain should change mailbox INBOX/dove GUID c77e7711be9a6c77fc845ea745963ddb -> df0d180f71e38a544f9e00008aa015be Debug: brain M: out state=master_send_mailbox changed=1 Debug: brain S: in state=recv_mailbox_tree_deletes Error: Can't create mailbox INBOX/dove: Mailbox already exists INBOX/dove folder was created in Dovecot side and does not exist in Cyrus side. I have tried full sync or backup but without any luck. If I delete the folder from Dovecot side the sync works fine again. I can post more info on the configuration if needed. Thank you, Ova

2 1

R: Re: R: Re: Duplicate messages
by absolutely_free＠libero.it 12 Dec '14

12 Dec '14

Hi, I mounted both network storage on this server. After that, I used: # nice -n 19 rsync -av --progress /mnt/old/domains/* /var/spool/pop/domains/ >----Messaggio originale---- >Da: skdovecot(a)smail.inf.fh-brs.de >Data: 12/12/2014 12.01 >A: "absolutely_free(a)libero.it"<absolutely_free(a)libero.it> >Cc: <dovecot(a)dovecot.org> >Ogg: Re: R: Re: Duplicate messages > >-----BEGIN PGP SIGNED MESSAGE----- >Hash: SHA1 > >On Fri, 12 Dec 2014, absolutely_free(a)libero.it wrote: > >> with rsync > >would you be more specific: > >which command line, how did you shut users out etc.pp. > >> >>> ----Messaggio originale---- >>> Da: skdovecot(a)smail.inf.fh-brs.de >>> Data: 12/12/2014 9.44 >>> A: "absolutely_free(a)libero.it"<absolutely_free(a)libero.it> >>> Cc: <dovecot(a)dovecot.org> >>> Ogg: Re: Duplicate messages >>> >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Fri, 12 Dec 2014, absolutely_free(a)libero.it wrote: >>>> >>>> Hi, >>>> I just moved mail spool to a different network storage. >>>> Now, several users are complaining about duplicate message that are fetched >> by their clients (Outlook, Microsoft Outlook). >>>> What is the reason? >>> >>> How did you moved the message to the other network storage? >>> >>>> mail_location = maildir:/coraid-s2l2/domains >>> >>> - -- >>> Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1.4.11 (GNU/Linux) >>> >>> iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0 >>> Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1 >>> fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+ >>> yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv >>> y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE >>> rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw== >>> =qlBd >>> -----END PGP SIGNATURE----- >>> >> > >- -- >Steffen Kaiser >-----BEGIN PGP SIGNATURE----- >Version: GnuPG v1.4.11 (GNU/Linux) > >iQEVAwUBVIrK9Xz1H7kL/d9rAQL6BQgAjKW48XJ21iPtZ+fTZgxEC00uA7cjvwZM >EYV9wThONbvP6zCLsbjKPOCiWX4f9NwHobgkkTIBtGogF0obNvUY2tiIRWRzwGO0 >31M/53iJ7ORNy9IZg3u5r1NPcklXhsjuy4cWyj13jN2FhY2xHJGqJWujtM5dCAe0 >Qq3KDH0yvJQSMJIMF2Eb4M59xD6hvXMR7qSH3ShI8DxUa0JSg7hlSTKM4Ak54dPb >GObJBiAqR9TUJ5lBFvoxmt2EyAnl4h0YURdwfuCyv+vYkP0GVat5p9hHRUPDc3cU >k4MrgdcVDJI5+VMzKOhcovEZ3o2k5ChGXIdzHjvp79VB1VyZsvViyQ== >=QeMJ >-----END PGP SIGNATURE----- >

1 0

PATCH - add username_format to the PAM auth module
by Bradley Kite 12 Dec '14

12 Dec '14

Hi there, Other auth modules (eg passwd-file) allow a username_format to be specified, but not the PAM module. The use-case, is where I want a static userdb configuration which takes the domain into account but still want to use PAM for authentication, eg: userdb { driver = static args = uid=8 gid=12 home=/mnt/storage/mail/vhosts/%d/%n } passdb { driver = pam args = username_format=%n allow_pam_transform=no dovecot } The global "auth_username_format" setting ends up changing the username, so looses the ability to have different mailboxes based on domain. There is also a new setting, allow_pam_transform which stops the username being changed after a successful authentication. Normally, if PAM changes the username, then dovecot must update its record of the username for further processing - but in this use case we must disable this function. -- Brad.

1 0

R: Re: Duplicate messages
by absolutely_free＠libero.it 12 Dec '14

12 Dec '14

Hi Steffen, with rsync Thank you >----Messaggio originale---- >Da: skdovecot(a)smail.inf.fh-brs.de >Data: 12/12/2014 9.44 >A: "absolutely_free(a)libero.it"<absolutely_free(a)libero.it> >Cc: <dovecot(a)dovecot.org> >Ogg: Re: Duplicate messages > >-----BEGIN PGP SIGNED MESSAGE----- >Hash: SHA1 > >On Fri, 12 Dec 2014, absolutely_free(a)libero.it wrote: >> >> Hi, >> I just moved mail spool to a different network storage. >> Now, several users are complaining about duplicate message that are fetched by their clients (Outlook, Microsoft Outlook). >> What is the reason? > >How did you moved the message to the other network storage? > >> mail_location = maildir:/coraid-s2l2/domains > >- -- >Steffen Kaiser >-----BEGIN PGP SIGNATURE----- >Version: GnuPG v1.4.11 (GNU/Linux) > >iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0 >Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1 >fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+ >yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv >y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE >rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw== >=qlBd >-----END PGP SIGNATURE----- >

2 1

Error: mremap_anon(###) failed: Cannot allocate memory
by Andy Dills 12 Dec '14

12 Dec '14

We're running dovecot 2.2.15 with pigeonhole 0.4.6, in a clustered environment, nfs with proxy and backend on all servers. I've been seeing some odd errors from lmtp: Error: mremap_anon(127930368) failed: Cannot allocate memory It seems to affect specific users, but it doesn't seem to manifest in any particular way; no user complaints. Just the occasional log message. I would guess this is a bug? I'm open to suggestions and I'd be happy to post config if somebody has an idea. Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

2 3

LMTP BUG
by Peter Hodur 12 Dec '14

12 Dec '14

Hello, just setting up mail hub with Postfix & Dovecot I have found BUG in LMTP implementation. * assumptions - latest stable Postix & Dovecot, - Postfix delivers via Dovecot LMTP (virtual_transport = lmtp:127.0.0.1:24), - Dovecot userdb & passwd lookups are made via custom checkpassword interface, - each user (email account) has different UID/GID * description LMTP process must run as root to be able to deliver msgs to each user. It drops privileges temporarily when delivering and then restoring effective UID/GID to root (saved one). The problem is, when an attempt with more than ONE recipients is made. More than one recipient within single session. It seems, that Dovecot LMTP restores root privileges not between each recipient delivery attempt but after whole transaction. The only solution is throttle Postfix to send single message with multiple recipients as many small transactions - all with only ONE rcpt. lmtp_destination_recipient_limit=1 makes this magic. Otherwise you can find: Dec 12 03:30:36 vm dovecot: lmtp(3580, info(a)xxx.com) Fatal: setgid(48672 from userdb lookup) failed with euid=33001, gid=43570, egid=43570: Operation not permitted (This binary should probably be called with process group set to 4867 2 instead of 43570) Can someone confirm that this is an error/bug? Thanks Pete

1 0

[Corrected] Can't get shared public folders working
by Randall Gellens 12 Dec '14

12 Dec '14

I'm trying to use a shared public namespace. My mail client says it exists, and I can telnet in and SELECT it, but sieve scripts can't write to it. The configuration in /etc/dovecot/conf.d/10-mail.conf: # Shared namespace for Foo stuff namespace { type = public separator = '/' prefix = "#Foo/" location = maildir:/local/mnt/mail/shared:INDEXPVT=/local/mnt/mail/%n/shared:LAYOUT=fs # Use the default namespace for saving subscriptions. #subscriptions = no # List the shared/ namespace only if there are visible shared mailboxes. #list = children } I created the location, owned by the vmail user: $ ls -ld /local/mnt/mail/shared drwxr-xr-x 4 vmail vmail 4096 Dec 11 12:38 /local/mnt/mail/shared I created the subfolders, verified that they are there. Also, I see that Dovecot created a dovecot.mailbox.log file: $ ls -l /local/mnt/mail/shared total 12 -rw-r--r-- 1 vmail vmail 96 Dec 11 12:38 dovecot.mailbox.log drwxr-xr-x 3 vmail vmail 4096 Dec 11 12:37 Foo-Bugs drwxr-xr-x 3 vmail vmail 4096 Dec 11 12:38 Foo-Patches The dovecot.mailbox.log file is empty: $ more /local/mnt/mail/shared/dovecot.mailbox.log The intermediate folder is empty: $ ls -l /local/mnt/mail/shared/Foo-Bugs/ total 4 drwxr-xr-x 5 vmail vmail 4096 Dec 11 12:36 Foo-Bugs-New The mailbox has some folders in it: $ ls -l /local/mnt/mail/shared/Foo-Bugs/Foo-Bugs-New/ total 12 drwxr-xr-x 2 vmail vmail 4096 Dec 11 12:36 cur drwxr-xr-x 2 vmail vmail 4096 Dec 11 12:36 new drwxr-xr-x 2 vmail vmail 4096 Dec 11 12:36 tmp They seem to be empty: $ ls -l /local/mnt/mail/shared/Foo-Bugs/Foo-Bugs-New/* /local/mnt/mail/shared/Foo-Bugs/Foo-Bugs-New/cur: The Sieve log insists the mailbox doesn't exist: $ more /local/mnt/home/Foo-bugs/.dovecot.sieve.log sieve: info: started log at Dec 11 15:35:20. error: msgid=<p06240614d0afdab4a086(a)[99.111.97.136]>: failed to store into mailbox '#Foo/Foo-Bugs/Foo-Bugs-New': Mailbox doesn't exist: #Foo/Foo-Bugs/Foo-Bugs-New. info: msgid=<p06240614d0afdab4a086(a)[99.111.97.136]>: stored mail into mailbox 'INBOX'. But if I telnet into the server, the mailbox shows up: a1 list "" * * LIST (\HasNoChildren \Junk) "/" Junk * LIST (\Noselect \HasChildren) "/" #Foo * LIST (\Noselect \HasChildren) "/" #Foo/Foo-Patches * LIST (\HasNoChildren) "/" #Foo/Foo-Patches/Foo-Patches-New * LIST (\Noselect \HasChildren) "/" #Foo/Foo-Bugs * LIST (\HasNoChildren) "/" #Foo/Foo-Bugs/Foo-Bugs-New * LIST (\HasNoChildren) "/" INBOX a1 OK List completed. And I can SELECT it: a2 select "#Foo/Foo-Bugs/Foo-Bugs-New" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1418343553] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences a2 OK [READ-WRITE] Select completed (0.006 secs). So why can't the Sieve script store into it? -- Randall Gellens Opinions are personal; facts are suspect; I speak for myself only -------------- Randomly selected tag: --------------- I must have a prodigious quantity of mind; it takes me as much as a week sometimes to make it up. --Mark Twain, _The Innocents Abroad_

1 0

Can't get shared public folders working
by Randall Gellens 12 Dec '14

12 Dec '14

I'm trying to use a shared public namespace. Clients say it exists, but sieve scripts can't write to it. The configuration in /etc/dovecot/conf.d/10-mail.conf: # Shared namespace for Foo stuff namespace { type = public separator = '/' prefix = "#Foo/" location = maildir:/local/mnt/mail/shared:INDEXPVT=/local/mnt/mail/%n/shared:LAYOUT=fs # Use the default namespace for saving subscriptions. #subscriptions = no # List the shared/ namespace only if there are visible shared mailboxes. #list = children } I created the location, owned by the vmail user: $ ls -ld /local/mnt/mail/shared drwxr-xr-x 4 vmail vmail 4096 Dec 11 12:38 /local/mnt/mail/shared I created the subfolders, verified that they are there. Also, I see that Dovecot created a dovecot.mailbox.log file: $ ls -l /local/mnt/mail/shared total 12 -rw-r--r-- 1 vmail vmail 96 Dec 11 12:38 dovecot.mailbox.log drwxr-xr-x 3 vmail vmail 4096 Dec 11 12:37 Foo-Bugs drwxr-xr-x 3 vmail vmail 4096 Dec 11 12:38 Foo-Patches The dovecot.mailbox.log file is empty: $ more /local/mnt/mail/shared/dovecot.mailbox.log The intermediate folder is empty: $ ls -l /local/mnt/mail/shared/Foo-Bugs/ total 4 drwxr-xr-x 5 vmail vmail 4096 Dec 11 12:36 Foo-Bugs-New The mailbox has some folders in it: $ ls -l /local/mnt/mail/shared/Foo-Bugs/Foo-Bugs-New/ total 12 drwxr-xr-x 2 vmail vmail 4096 Dec 11 12:36 cur drwxr-xr-x 2 vmail vmail 4096 Dec 11 12:36 new drwxr-xr-x 2 vmail vmail 4096 Dec 11 12:36 tmp They seem to be empty: $ ls -l /local/mnt/mail/shared/Foo-Bugs/Foo-Bugs-New/* /local/mnt/mail/shared/Foo-Bugs/Foo-Bugs-New/cur: The Sieve log insists the mailbox doesn't exist: $ more /local/mnt/home/Foo-bugs/.dovecot.sieve.log sieve: info: started log at Dec 11 15:35:20. error: msgid=<p06240614d0afdab4a086(a)[99.111.97.136]>: failed to store into mailbox '#Foo/Q popper-Bugs/Foo-Bugs-New': Mailbox doesn't exist: #Foo/Foo-Bugs/Foo-Bugs-New. info: msgid=<p06240614d0afdab4a086(a)[99.111.97.136]>: stored mail into mailbox 'INBOX'. But if I telnet into the server, the mailbox shows up: a1 list "" * * LIST (\HasNoChildren \Junk) "/" Junk * LIST (\Noselect \HasChildren) "/" #Foo * LIST (\Noselect \HasChildren) "/" #Foo/Foo-Patches * LIST (\HasNoChildren) "/" #Foo/Foo-Patches/Foo-Patches-New * LIST (\Noselect \HasChildren) "/" #Foo/Foo-Bugs * LIST (\HasNoChildren) "/" #Foo/Foo-Bugs/Foo-Bugs-New * LIST (\HasNoChildren) "/" INBOX a1 OK List completed. And I can SELECT it: a2 select "#Foo/Foo-Bugs/Foo-Bugs-New" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1418343553] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences a2 OK [READ-WRITE] Select completed (0.006 secs). So why can't the Sieve script store into it? -- Randall Gellens Opinions are personal; facts are suspect; I speak for myself only -------------- Randomly selected tag: --------------- Broad-mindedness: The result of flattening high-mindedness out.

1 0

mdbox backup strategy
by Jiří František 11 Dec '14

11 Dec '14

Hi, now we backup maildir with rdiff-backup every single day. Backup takes almost 20hours. I would like to switch to mdbox, but how to acomplish possibility of restore emails from any date what I want? Now if I need to restore mails from the day before yesterday I put the right date to parametrs of rdiff-backup restore command and I get what I want. But if I use doveadm backup I have backup only from last run. Because we have tens of TB email I couldn't do full backup every single day. Is it possible to restore state of mailbox from backup run before the last run if I use doveadm? I don't want do full backup every day, because backup storage is not unlimited. Thank you Jiri

1 0