February 2016 - dovecot

Re: dovecot Digest, Vol 154, Issue 14
by Richard Platel 18 Feb '16

18 Feb '16

Thanks, Hajo This mostly works, but we can’t seem to send an arbitrary mailbox name with UserDB, we have to initialize it in the config: "namespace/inbox/mailbox=Junk namespace/inbox/mailbox/Junk/name"="Spam" seems to initialize the folder somehow so that the subsequent "namespace/inbox/mailbox/Junk/auto"="subscribe" and "namespace/inbox/mailbox/Junk/special_use"="\Junk" have something to act upon. (the first line doesn't work quite properly, however - it ends up causing a folder named "" to show up) we've noticed that if we set a very minimal config for the mailbox in the main config (that wouldn't cause the mailbox to be autocreated), that this also initializes the folder name allowing for subsequent auto and subscribe directives to be processed for it: namespace inbox { inbox = yes mailbox "Spam" { auto = no } } is there some userdb response that will simply initialize the folder (without doing any name remapping) in the same way that the above config lines do? we have tried a few things based off Hajo's first line, but nothing we guess at seems to do the trick. ie: "namespace/inbox/mailbox"="Spam" "namespace/inbox/mailbox=Spam"=“Spam" > > ------------------------------ > > Message: 2 > Date: Tue, 9 Feb 2016 23:33:53 +0100 > From: Hajo Locke <Hajo.Locke(a)gmx.de> > To: dovecot(a)dovecot.org > Subject: Re: Per-user special folder? > Message-ID: <56BA6951.8010000(a)gmx.de> > Content-Type: text/plain; charset=windows-1252; format=flowed > > Hello, > > Am 09.02.2016 um 22:28 schrieb Richard Platel: >> Hi >> >> It's possible to mark some folders as special use for IMAP in the config like: >> >> namespace inbox { >> mailbox Spam { >> special_use = \Junk >> } >> } >> >> >> Our webmail allows users to use an arbitrary folder for Spam, and we have this settings and we'd like to return it in from our UserDB (which is a custom dict proxy). >> >> For testing were able to set a namespace parameter like "separator" by returning: >> "namespace/inbox/separator" : "=", >> >> from UserDB, but can't figure out a way to set mailbox settings, >> >> "namespace/inbox/mailbox Spam/special_use" : "\Junk", for example doesn't work. >> >> Is there a way to return this setting from a UserDB query? >> > we use this a lot with userdb to allow individual folders marked as special. > your userbd-query should return something like this: > > namespace/inbox/mailbox=Junk namespace/inbox/mailbox/Junk/name=Spam > namespace/inbox/mailbox/Junk/auto=subscribe > namespace/inbox/mailbox/Junk/special_use=\Junk > Spam is visible name in this case. > > Hajo

2 2

doveadm backup to local drive
by Terry Barnum 17 Feb '16

17 Feb '16

I'm trying to get doveadm to backup all users to a local drive without any luck. $ sudo doveadm backup -A /Volumes/mail_bak/mailstore_backup/ Error: User listing returned failure doveadm: Error: Failed to iterate through some users The doveadm-backup man page has the instruction to make sure the iterate query matches the database layout but I'm not sure what that means. If the user_query in dovecot-sql.conf.ext looks like this, what should the iterate_query look like? user_query = \ SELECT '/opt/local/virtual/%d/%n/mail' as home, \ 'maildir:/opt/local/virtual/%d/%n/mail' as mail, 501 as uid, \ 501 as gid, concat("*:storage=", quota) AS quota \ FROM mailbox WHERE username = "%u" AND active = "1" # Query to get a list of all usernames. iterate_query = SELECT username AS user FROM users Thanks, -Terry Terry Barnum digital OutPost Carlsbad, CA http://www.dop.com 800/464-6434

1 1

Dovecot IMAP permissions issue (see original)
by Steve Cole 17 Feb '16

17 Feb '16

/ >/What purpose does vpopmail serve that dovecot alone does not? Isn't it > just an ancient leftover from historic qmail times? qmail and vpopmail are still quite prominent on the Internet. I see no reason to change my setup at the moment. Possibly I could re-architect to read user info directly from mysql but that would not help with the fact that dovecot then likely read or write as the wrong userid on the system (since mailboxes are virtual). Have recreated the same issue (sans mysql) on another vpopmail system. Regardless, it is a bug. From my process list: 25813 vpopmail 20 0 26468 4984 4016 R 0.7 0.0 0:00.02 imap 26730 vpopmail 20 0 28332 5940 4212 S 0.7 0.0 0:00.06 imap For certain, imap being ANY other user than root means that the /var/run/dovecot/imap-* sockets would be unwritable.

1 0

How to understand NFS lookup (requests) spike?
by Alessio Cecchi 17 Feb '16

17 Feb '16

Hi, I'm are running a classic Dovecot setup: About ten thousand connected users mailbox in Maildir format shared via NFS (NetApp) Director for POP/IMAP Delivery via Dovecot LDA All works fine but sometimes I see a spike on the load of POP/IMAP servers and high disk usage (close to 100%) on NFS NetApp. When this happens on NFS stats (of POP/IMAP) I can see an high volume of "lookup, remove, rename" requests. Example (avg is during normal load, max is request number during the spike): Lookup avg 100 max 700 Remove avg 50 max 300 Rename avg 50 max 300 Getattr avg 200 max 250 Total NFS avg 600 max 1800 I think that some users are doing some kinds of "intensive" operations on their mailbox but what and who? I am currently using "iotop" to monitor the activity of individual users but I can't figure out who is causing the high number of I/O requests. Have you any suggestions? Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

2 1

sieve: store string list in varable
by whats_up＠gmx.net 17 Feb '16

17 Feb '16

Hi, I'm working on a Sieve script and want to store a list of addresses in a variable to easily access the list multiple times later. For example I want to transform this: if address :is "from" ["daffy.duck(a)example.com", "porky.pig(a)example.com", "speedy.gonzales(a)example.com"] { fileinto "friends"; } into something like this: require ["fileinto", "variables"]; set "friends" ["daffy.duck(a)example.com", "porky.pig(a)example.com", "speedy.gonzales(a)example.com"] if address :is "from" $friends { fileinto "friends"; } Any ideas on this? regards Knut

2 3

more than 6000 subfolders in the same level
by Chris 16 Feb '16

16 Feb '16

Dear All, I'm going to use a public namespace with more than 6000 folders and subfolders. On the local ext4-filesystem the nested IMAP subfolders will all be in the same directory: /var/vmail/public/folder1 /var/vmail/public/folder1.subfolder1a /var/vmail/public/folder1.subfolder1b ... Is this possible without any performance issues? Would it be better to use "real" subfolders with / as separator? Is / separator for public namespace and . for private namespace possible? - Chris

2 1

the prefix number of the configuration filename
by Dogz 16 Feb '16

16 Feb '16

Hi all, I am very curious about the prefix number of the configuration filename, such as 10-auth.conf 10-director.conf 10-logging.conf 10-mail.conf 10-master.conf 10-ssl.conf 15-lda.conf 15-mailboxes.conf 20-imap.conf 20-lmtp.conf 20-managesieve.conf 20-pop3.conf 90-acl.conf 90-plugin.conf 90-quota.conf 90-sieve.conf 90-sieve-extprograms.conf What are those meanings of 10,15,20 and 90 ? Please advise me and thank you in advance. -- Best Regards, Dogz

3 3

Accessing to mail as another user
by Angel L. Mateo 16 Feb '16

16 Feb '16

Hello, I'm looking for a way to access to a POP/IMAP account as another user different than me, but using my password. That is, I'm "someone(a)domain.com" and I want to access to "anotherone(a)domain.com" mailbox using the password of "someone(a)domain.com", not the "anotherone(a)domain.com" (something similar to master passwords, but without sharing any password). Obviously, in my LDAP backend I can configure something to authorize "someone" to access to "anotherone"'s mailbox. At this momment, I'm trying to use someone@domain.com@anotherone@domain.com as username, with a passdb that uses %{username}@%{domain_first} to authenticate the user, but I'm having problem to configure a userdb map to get the mailbox, because the %{domain_first} variable returns just "domain.com". To fix this, I could use "someone@anotherone@domain.com", but this has problems with virtual domains an different users with same username (someone(a)domain.com and someone(a)otherdomain.com) Looking at documentation, at [1], in the "auth_user" variable says: "... If username changes during authentication, this value contains the original username..." what leads me to think that there is some way to change the user during the authentication process, but I don't know how or maybe I'm assuming wrong. Any help with this? Thank you [1] http://wiki.dovecot.org/Variables -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

4 6

Pigeonhole and duplicate checking
by Dan Ragle 16 Feb '16

16 Feb '16

I spent some time setting up Dovecot LMTP with Pigeonhole this weekend. I got most of the things I wanted to working but have a few issues that I'm hoping that someone might be able to help with. First, I'm running the stock version of the tools from the core repos for CentOS/6, which means Dovecot 2.0.9 and Pigeonhole 0.2.2. Unfortunately, I don't expect to be able to upgrade those anytime soon, so I'm hoping I can find workarounds for my existing versions. My mailserver is sendmail, I linked to Dovecot LMTP by adding: FEATURE(`local_lmtp', `[IPC]', `FILE /var/run/dovecot/lmtp')dnl to my sendmail.mc. In my prior procmail setup, I auto-forwarded all my SPAM E-mail to a separate user on the system with their own account (called spamuser). In the Pigeonhole setup it looks like I have to redirect those messages (i.e., redirect "spamuser(a)mydomain.com";). That works, but I'm having issues with "duplicate" messages getting delivered directly to my inbox instead of getting redirected. IOW, my regular user's .dovecot.sieve has: if header :contains "X-Spam-Flag" "YES" { redirect "spamuser(a)mydomain.com"; stop; } and the spamuser's .dovecot.sieve has: require ["imap4flags"]; setflag "\\seen"; (this system is entirely for personal use, no concerns with a user's Spam being seen via the separate spamuser account). Now, the problem I'm having is that sometimes a message arrives with a duplicate message-ID. Here's an abbreviated example from my maillog: Feb 15 00:30:46 myhost sendmail[26844]: u1F5UeBP026844: from=<ciuehazt(a)autoonecareers.com>, size=613, class=0, nrcpts=1, msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>, proto=SMTP, daemon=MTA, relay=117.27.191.61.broad.static.hf.ah.cndata.com [61.191.27.117] (may be forged) Feb 15 00:31:05 myhost dovecot: lmtp(26856): Connect from local Feb 15 00:31:07 myhost sendmail[26867]: u1F5UvFi026867: from=<ciuehazt(a)autoonecareers.com>, size=613, class=0, nrcpts=1, msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>, proto=SMTP, daemon=MTA, relay=117.27.191.61.broad.static.hf.ah.cndata.com [61.191.27.117] (may be forged) Feb 15 00:31:10 myhost dovecot: lmtp(26856, dmr): 7Hj/LoBiwVboaAAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: forwarded to <spamuser(a)mydomain.com> Feb 15 00:31:10 myhost dovecot: lmtp(26856): Disconnect from local: Client quit Feb 15 00:31:10 myhost dovecot: lmtp(26893): Connect from local Feb 15 00:31:10 myhost dovecot: lmtp(26893, spamuser): 9TPnN55iwVYNaQAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: stored mail into mailbox 'INBOX' Feb 15 00:31:11 myhost dovecot: lmtp(26893): Disconnect from local: Client quit Feb 15 00:31:18 myhost dovecot: lmtp(26893): Connect from local Feb 15 00:31:18 myhost dovecot: lmtp(26893, dmr): +TPnN55iwVYNaQAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: discarded duplicate forward to <spamuser(a)biblestuph.com> Feb 15 00:31:18 myhost dovecot: lmtp(26893, dmr): +TPnN55iwVYNaQAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: stored mail into mailbox 'INBOX' So the first message comes in and is redirected properly to my spamuser and stored in the inbox. The second one comes in, pigeonhole sees it's a duplicate, refuses to redirect it, and stores it in my inbox instead. I tried forcing the .dovecot.lda-dupes file to be a symlink to /dev/null just to see if it would work, but unfortunately dovecot just recreates it as a normal file the next time it delivers to that user. Ideally, I'd like to just discard the duplicates. It looks like there is duplicate testing functionality available, but not until later versions of Dovecot/Pigeonhole. Is there anyway I can either just discard the duplicates, or get them to be redirected to the spamuser? Also, some other questions I came up with along the way: Is there any way I can force a message to fileinto a different user's Mailbox? I'm guessing no since it appears that the lmtp drops root privileges before the global sieve script is interpreted, but thought I'd ask anyway. I did try: fileinto "/var/mail/spamuser"; But Dovecot complained, something about the mailbox pattern being invalid. If it were possible, I would think it would want something like fileinto "spamuser:INBOX"; instead, but I don't know if that is even possible. In a global sieve script, is there anyway to know/test which system user is the targeted user for delivery? So in a global sieve_before script I could test the target user, and if it's spamuser just file it immediately and stop with no further testing? Thanks for any assistance! Dan

2 2

Health check for dsync?
by Rich Wales 16 Feb '16

16 Feb '16

I am syncing two Dovecot sites using dsync. Are there any tools available to confirm that dsync is (or is not) running properly between the two sites? (E.g., something I could run periodically in Nagios?) Rich Wales richw(a)richw.org

1 0