- dovecot - dovecot.org

[Dovecot] Creating Maildir and populating with emails via external Python process
by Bradley Rintoul 26 Oct '12

26 Oct '12

Hello: I'm using Dovecot to provide IMAP services for Thunderbird clients. The user's mail is stored in Maildir format and the individual emails which the user "receives" are actually downloaded and put into the Maildir "repository" using a Python email client (POP3 client). I am trying to create the dovecot-uidlist file and maintain the "next UID" value within it, but I am having trouble with the UIDVALIDITY and the 128 bit mailbox global UID among other things. How can I "seed" a dovecot-uidlist file with these values..? Sorry if the information is not much to go on, please let me know what more information you might need to help point me in the right direction. Thanks, B. RIntoul

7 13

[Dovecot] spamc can't seem to call /usr/lib/dovecot/deliver
by Troy Vitullo 25 Oct '12

25 Oct '12

Hi, My server uses a system comprised of postfix, dovecot and dspam to filter and deliver mail. Postfix used the following flags in calling spamc and dovecot: flags=DRhu user=dovecot:secmail argv=/usr/bin/spamc -u ${recipient} -e /usr/lib/dovecot/deliver -d ${recipient} after an upgrade from Debian lenny to squeeze we were able to get everything working except spam filtering. Spamassassin is able to judge whether the mail coming in is spam but everything stops there. In mail.err I see: pamc[3608]: exec failed: Permission denied spamc shows the same thing in syslog: exec failed: Permission denied postfix delays the email: postfix/pipe[3607]: 50DEFF180EE: to=<[mail]>, relay=dovecot, delay=1.7, delays=0.07/0.01/0/1.6, dsn=4.3.0, status=deferred (system resource problem) Here are the permissions for deliver: -rwsr-x--- 1 root dovecot 865084 May 25 2011 /usr/lib/dovecot/deliver Here are the relevant groups: s1:~# grep dovecot /etc/group secmail:x:119:postfix,spamd,dovecot dovecot:x:111: here's the dovecot user: s1:~# grep dovecot /etc/passwd dovecot:x:108:111:Dovecot mail server,,,:/usr/lib/dovecot:/bin/false here's dovecot -n: # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 6.0.6 base_dir: /var/run/dovecot/ protocols: imap imaps pop3s pop3 ssl_cert_file: /etc/ssl/certs/s1.troyvit.com.cert ssl_key_file: /etc/ssl/private/s1.troyvit.com.key ssl_cipher_list: ALL:!LOW disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:%h/Maildir/ mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls, oe-ns-eoh pop3_logout_format(default): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_logout_format(imap): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_logout_format(pop3): top=%t/%T, retr=%r/%R, del=%d/%m, size=%s namespace: type: private separator: / inbox: yes list: yes subscriptions: yes lda: postmaster_address: postmaster(a)sphere.local auth_socket_path: /var/run/dovecot/auth-master mail_plugin_dir: /usr/lib/dovecot/modules/lda/ mail_plugins: sieve auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: dovecot passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 438 user: dovecot plugin: sieve_global_path: /etc/dovecot/default.sieve sieve: /srv/%d/mail/%n/%n.sieve Many thanks in advance for any advice you can give. Troy

4 25

[Dovecot] Dovecot: pipe() failed: Too many open files
by Fasil 25 Oct '12

25 Oct '12

Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files 1024 1024 files Please advice how to get rid off this. Fasil.

3 4

[Dovecot] dovecot auth against AD on samba4
by Carsten Laun-De Lellis 24 Oct '12

24 Oct '12

Hi group I am currently running a mail server on ubuntu 11.04 with postfix 2.8.5, dovecot dovecot 2.0.13 and openldap 2.4.23. I have now read about sogo and I am thinking about installing it because of it's native outlook support capabilities. The ZEG appliance wouldn't be an option for me because I use a virtual server from a provider where I can't install my own vm or even an iso. When I go thru the documentation there is a part with installing OpenChange based on samba4. As far as I understood the OpenChange authentication is against the samba4 AD. Actually there is no support in syncing the AD against an OpenLdap Server and I would have to change the OpenLdap port because the AD is listening on port 389. To change the port wouldn't be a big deal, but what i was thinking about to run the dovecot auth also against the samba 4 AD. I searched around on the internet but didn't find a doc yet how to do that. Does anyone here could provide me with a link or a how-to ? Thanks very much in advance. Regards, Carsten Laun-De Lellis Hauptstrasse 13 D-67705 Trippstadt Phone: +49 6306 992140 Fax: +49 6306 992142 Mobile: +49 151 27530865 email: carsten.delellis(a)delellis.net

2 2

[Dovecot] Clarifications on Pigeonhole and MySQL lookups
by Sandro Tosi 24 Oct '12

24 Oct '12

Hello, we're scouting if it's possible to use Pigeonhole (currently v0.3.1, as this will be provided with an upcoming Debian package) with MySQL dict lookups with the mail setup we're designing. Our (main) goals are: 1. store the filters on the database 2. allow each user to enable/disable any of the filters set we provide (it's a static set of some general filters, available to all the users; we're currently not providing the possibility to users to write their own filters) For point 1) we already see[1] that's possible, but it uses the map construct that might not fit with our current database structure: we have a domain table (storing the domain info) and a mailbox table (storing the mailbox info, but the username is composed by the local part, stored in this table, and the domain part is a FK to the domain table, using an id). Do you think it's possible to run a join query on domain+mailbox to retrieve the mailbox_id needed to query the table for the filters? Or do we have to create the filter table and store the local(a)domain.ext info there ("relaxing" the integrity relationships between tables)? How do we specify which filters are enabled for any given user? We originally thought of an "Enabled" field on the filter table, but in the example in the doc[1] I hadn't seen a way to do that: it seems like the filter list is specified in the proxy definition - am I wrong? How can we do that? [1] http://hg.rename-it.nl/dovecot-2.1-pigeonhole/file/e9ed5d5cef4b/doc/script-… I think it's enough for now, maybe additional questions will arise going deeper in details :) Thanks in advance, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi(a)register.it

2 4

[Dovecot] Maildir hardlinks
by Benedetto Vassallo 23 Oct '12

23 Oct '12

Hello list, Excuse me for my poor english. I have updated on a test server dovecot 2.0.13 to dovecot 2.1.1. All works fine, but with the new version it seems that dovecot don't do hardlinks when deliver a message to multiple users. I have checked my config and the only rule I can see aboout that is maildir_copy_with_hardlinks = yes in /etc/dovecot/conf.d/10-mail.conf My mail location config is mail_location = maildir:~/MailDir:LAYOUT=fs I tryed using lmtp directly issuing 'telnet localhost 24' and sending a test message to 3 recipients. Then issuing a 'ls -il' in the "new" directory of that users, I saw the inode was not the same. I rechecked my config and take a look in the wiki and in the list for someone who had the same problems, but found nothing. Maybe I did something wrong, but I can't understand what. Can you help me? Thank you -- Benedetto Vassallo Sistema Informativo di Ateneo Settore Gestione Reti Hardware e Software U.O.B. Sviluppo e manutenzione dei sistemi Università degli studi di Palermo Phone: +3909123860056 Fax: +390916529124 ------------------------------------------------------------------------- This message was sent using the University of Palermo web mail interface.

3 7

[Dovecot] [2.2-UNSTABLE] compilation error: 'POSIX_FADV_WILLNEED' undeclared
by Michael Grimm 23 Oct '12

23 Oct '12

Hi -- I am trying to compile 2.2 (acd76b5272e9) at FreeBSD 9.0: | libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I/usr/local/include -std=gnu99 -O2 -Wall -W -Wmissing-prototypes \ -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 \ -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 \ -I/usr/local/include -MT fs-posix.lo -MD -MP -MF .deps/fs-posix.Tpo \ -c fs-posix.c -fPIC -DPIC -o .libs/fs-posix.o | fs-posix.c: In function 'fs_posix_prefetch': | fs-posix.c:298: warning: implicit declaration of function 'posix_fadvise' | fs-posix.c:298: error: 'POSIX_FADV_WILLNEED' undeclared (first use in this function) | fs-posix.c:298: error: (Each undeclared identifier is reported only once | fs-posix.c:298: error: for each function it appears in.) | gmake[3]: *** [fs-posix.lo] Error 1 | gmake[3]: Leaving directory `/usr/local/etc/dovecot/SOURCE/dovecot-2.2/src/lib-fs' | gmake[2]: *** [all-recursive] Error 1 | gmake[2]: Leaving directory `/usr/local/etc/dovecot/SOURCE/dovecot-2.2/src' | gmake[1]: *** [all-recursive] Error 1 | gmake[1]: Leaving directory `/usr/local/etc/dovecot/SOURCE/dovecot-2.2' | gmake: *** [all] Error 2 From configure logfile: | checking for posix_fadvise... no After a modification (stolen from src/lib-storage/index/index-mail.c) ... | --- dovecot-2.2-modified/src/lib-fs/fs-posix.c 2012-10-23 20:27:31.348919455 +0200 | +++ dovecot-2.2/src/lib-fs/fs-posix.c 2012-10-23 20:26:39.435300269 +0200 | @@ -295,10 +295,12 @@ | return TRUE; | } | | +#if defined(HAVE_POSIX_FADVISE) && defined(POSIX_FADV_WILLNEED) | if (posix_fadvise(file->fd, 0, length, POSIX_FADV_WILLNEED) < 0) { | i_error("posix_fadvise(%s) failed: %m", _file->path); | return TRUE; | } | +#endif | return FALSE; | } ... the compilations runs to completion, and dovecot-2.2 UNSTABLE is running. But: I do not have the knowledge to judge if that "fix" will be the right one. Just to let you know and with regards, Michael

1 0

[Dovecot] index files created improperly in dovecot 1.2.16
by john roman 23 Oct '12

23 Oct '12

Greetings, It seems to be a problem that ive seen occasionally on the web with few results as to a solution, but im experiencing it as well. Namely, dovecot creates index logs for users with a 600 permission, when it should create with a 700 permission. My indexes are stored in /var/indexes with the directory at 777 permission, the users are identified in MySQL. The error is as follows: Oct 23 09:03:13 mailer01 dovecot: POP3 (johnr(a)testing.com) stat(/var/indexes/j/johnr(a)testing.com/.INBOX) failed: Permission denied (euid=10509305(x10509305) egid=81607(pg199275) missing +x perm: /var/indexes/j) the permissions of /var/indexes/j are 700, owned by the euid and egid effectively. the only file that does not have this permission is in /var/indexes/j/johnr(a)testing.com/.INBOX/dovecot.index.log, at 600.

1 0

[Dovecot] 76Gb to 146Gb [Resolved]
by Spyros Tsiolis 23 Oct '12

23 Oct '12

Hello all, I would like to thank you all for your kind replies and feedback in regards to migrating from a smaller hdd to a bigger one (namely from 72gb to 146gb). I finally found a painless way of doing this. Since I believe that this is still an off-topic post, if anyone is interested in the solution i've adopted for this, let me know by replying to me privately. If, however, you don't mind me posting here, let me know. Many many thanks go to Alexander Hoogerhuis, the "mad Norwegian" :-) who helped me on this too much to describe here. Alex, you are a true sport. Thank you again people. All the Best, spyros ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

1 0

[Dovecot] Dovecot LDA message save logging
by Dominic Malolepszy 23 Oct '12

23 Oct '12

Hi, Is there any option in Dovecot that enables logging the full path of where a message is saved in the backend? Dominic

2 1

[Dovecot] Anybody recognize these log lines?
by Knute Johnson 23 Oct '12

23 Oct '12

WARN: Duplicate profile 'Dovecot POP3', using last found WARN: Duplicate profile 'Dovecot Secure POP3', using last found WARN: Duplicate profile 'Dovecot IMAP', using last found WARN: Duplicate profile 'Dovecot Secure IMAP', using last found Anybody know if these are dovecot generated? Thanks, -- Knute Johnson

2 2

[Dovecot] (new) director issues in 2.1.10
by Kelsey Cummings 23 Oct '12

23 Oct '12

Timo - I upgraded to 2.1.10 on our director servers two nights ago and apart from errors associated with the directors processes restarting everything looked great for ~24 hours until I failed our the real servers last night to update the nfs mount options for the spools. I followed the suggested procedure for each backend server, just run on one of the directors, which seemed to work as expected. doveadm director add x.x.x.x 0 doveadm director flush x.x.x.x The following errors on the directors that started after this went unnoticed until this AM. director: User bb host lookup failed: Timeout - queued for 30 secs (Ring synced for 36 secs) director: User cc host lookup failed: Timeout - queued for 48 secs (Ring synced for 66 secs, user refreshed 12 secs ago) director: User dd host lookup failed: Timeout - queued for 124 secs (Ring synced for 119 secs, weak user, user refreshed 155 secs ago) director: User ee host lookup failed: Timeout - queued for 79 secs (Ring synced for 119 secs, weak user, user refreshed 113 secs ago) ... User ff host lookup failed: Timeout - queued for 30 secs (Ring synced for 7427 secs, weak user, user refreshed 620 secs ago) This continued, combined with occasional login timeouts (as reported by some internal imap clients.) The login delays/timeouts got bad enough that our load balancers dropped both the servers while I was investigating. They seem to be okay after being restarted. -K

2 5

[Dovecot] auth timeout state=2, bad?
by Bernhard Schmidt 22 Oct '12

22 Oct '12

Hello, we run Dovecot 2.1.7 as SASL backend for our Postfix SMTP-AUTH farm and see this error message occasionally Oct 22 16:15:32 lxmhs52 dovecot: auth: PLAIN(?,xx.xx.xx.xx): Request 0.21 timeouted after 150 secs, state=2 Since it is mostly the same IP repeating I'm assuming it's a client issue. Is that correct? What could cause this? Can we safely ignore it? Thanks, Bernhard

2 1

[Dovecot] Marking all mail in one folder of public mailbox as read
by Frerich Raabe 22 Oct '12

22 Oct '12

Hi, I'm running Dovecot 1.2.17 on FreeBSD 9 to serve an archive of a few internal mailinglists. The archive is implemented using a public namespace: namespace private { separator = / prefix = inbox = yes } namespace public { separator = / prefix = Lists/ location = maildir:/home/vmail/lists/Maildir:CONTROL=~/Maildir/lists:INDEX=~/Maildir/lists subscriptions = no } As you can see, the CONTROL/INDEX files are stored per-user to allow private \Seen flags. The different mailinglists are all sent to the 'lists' user which has a Sieve script to file them into different folders, so I have directories on my harddisk like /home/vmail/lists/Maildir/.somelist /home/vmail/lists/Maildir/.anotherlist Now, I'd like to mark the mail in *one* of those folders as \Seen by default. If the INDEX files weren't per-user, it would simply be a matter of using 'addflag "\Seen";' in the Sieve script of the lists user. Alas, this has no effect. Hence my question - how can I have the mail of just one mailinglist get marked as "read" for all users? So far, the only option I see is to add a second public namespace, with a different prefix - and this namespace doesn't use private CONTROL/INDEX files. However, I'd like to keep using the "Lists" prefix if possible to avoid too many changes to the clients. -- Frerich Raabe - raabe(a)froglogic.com www.froglogic.com - Multi-Platform GUI Testing

2 2

[Dovecot] Segmentation fault in doveadm with lib01_acl_plugin.so
by Alessio Cecchi 22 Oct '12

22 Oct '12

Hi, I'm running dovecot 2.1.10 on Debian 6. When I run "doveadm expunge -A mailbox Trash savedbefore 30d" it crash with "Segmentation fault" [15022673.496902] doveadm[13072]: segfault at 8 ip 00007f4b7041f551 sp 00007fffdab4f8c0 error 4 in lib01_acl_plugin.so[7f4b70415000+10000] If I add -D to doveadm I can see this: doveadm(myuser(a)mydomain.com): Debug: Added userdb setting: plugin/quota_rule=*:backend=524288000S doveadm(myuser(a)mydomain.com): Debug: Effective uid=89, gid=89, home=/home/vpopmail/domains/2/mydomain.com/myuser doveadm(myuser(a)mydomain.com): Debug: Quota root: name=UserQuota backend=maildir args= doveadm(myuser(a)mydomain.com): Debug: Quota rule: root=UserQuota mailbox=* bytes=524288000 messages=0 doveadm(myuser(a)mydomain.com): Debug: Quota rule: root=UserQuota mailbox=Trash bytes=+104857600 messages=0 doveadm(myuser(a)mydomain.com): Debug: Quota root: name=User quota backend=dict args=:noenforcing:proxy::quota doveadm(myuser(a)mydomain.com): Debug: dict quota: user=myuser(a)mydomain.com, uri=proxy::quota, noenforcing=1 doveadm(myuser(a)mydomain.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir doveadm(myuser(a)mydomain.com): Debug: maildir++: root=/home/vpopmail/domains/2/mydomain.com/myuser/Maildir, index=, control=, inbox=/home/vpopmail/domains/2/mydomain.com/myuser/Maildir, alt= doveadm(myuser(a)mydomain.com): Debug: acl: initializing backend with data: vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 doveadm(myuser(a)mydomain.com): Debug: acl: acl username = myuser(a)mydomain.com doveadm(myuser(a)mydomain.com): Debug: acl: owner = 1 doveadm(myuser(a)mydomain.com): Debug: acl vfile: Global ACL directory: /usr/local/dovecot-2.1/etc/dovecot/global-acls doveadm(myuser(a)mydomain.com): Debug: Namespace : type=shared, prefix=shared/%n/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/Maildir:INDEX=~/Maildir/shared/%u doveadm(myuser(a)mydomain.com): Debug: shared: root=/usr/local/dovecot-2.1/var/run/dovecot, index=, control=, inbox=, alt= doveadm(myuser(a)mydomain.com): Debug: acl: initializing backend with data: vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 doveadm(myuser(a)mydomain.com): Debug: acl: acl username = myuser(a)mydomain.com doveadm(myuser(a)mydomain.com): Debug: acl: owner = 0 doveadm(myuser(a)mydomain.com): Debug: acl vfile: Global ACL directory: /usr/local/dovecot-2.1/etc/dovecot/global-acls doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=276 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=277 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=278 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=279 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=280 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=281 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=282 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=283 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=284 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=285 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=286 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=287 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=288 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=289 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=290 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=291 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=292 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=293 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=294 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=295 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=296 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=297 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=298 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=299 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=300 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=301 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=302 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=303 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=304 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=305 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=306 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=307 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=308 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=309 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=310 doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls//.DEFAULT not found doveadm(myuser(a)mydomain.com): Debug: Namespace : Using permissions from /home/vpopmail/domains/2/mydomain.com/myuser/Maildir: mode=0700 gid=-1 doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Drafts not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Drafts/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Spam not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Spam/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Sent not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Sent/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Trash not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Trash/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/INBOX not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/dovecot-acl not found Segmentation fault If I disable "acl" plugin in dovecot all works fine. I think that this problem is connected with "Dovecot deliver Segmentation fault when arrive the first message" http://www.dovecot.org/list/dovecot/2012-September/068343.html that I'm still experiencing. How can get core dumps from "doveadm"? This is my dovecot config with acl enabled: # 2.1.10: /usr/local/dovecot-2.1/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_cache_size = 512 k auth_worker_max_count = 60 default_login_user = nobody dict { acl = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-share-folder.conf quota = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/dovecot-2.1/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl quota = maildir:UserQuota quota2 = dict:User quota::noenforcing:proxy::quota quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_default = /usr/local/dovecot-2.1/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve sendmail_path = /var/qmail/bin/sendmail service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { service_count = 0 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } ssl_cert = </etc/ssl/certs/wildcard.net.pem ssl_key = </etc/ssl/private/wildcard.net.key userdb { args = /usr/local/dovecot-2.1/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { log_path = /var/log/dovecot/lda.log mail_plugins = quota acl sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 20 mail_plugins = quota acl imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 5 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Thanks

4 6

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 22 Oct '12

22 Oct '12

David Mehler wrote: > Thanks, so if I understand what your saying the reason I'm getting the > column update issues is Dovecot is reading from and writing to the > quota and quota_messages columns in my virtual_users table? > > My database user I believe only has select permissions on that table. > > So, I either need another table and to adjust my dovecot-dict.sql file > for that table, that's where Dovecot will write to, or two more > columns in the virtual_users table? > > Which way do you recommend? I would recommend to create a new table for dovecot_usage where dovecot is granted write permission. Regards Daniel

2 1

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 21 Oct '12

21 Oct '12

Hi Dave, David Mehler wrote: > Thanks for all your help so far. I have per-user quotas now working, I > had to also alter my dict config file as well. I am having two > outstanding issues, actually one outstanding issue and one question. > > Here's the question, given that the userdb sql query returns a default > quota entry for rows of zero in quota and quota_messages is the > default quota section needed in 90-quota.conf? > > plugin { > quota_rule = *:storage=1G > quota_rule2 = Trash:storage=+100M > } You need quota_rule2 to give the user some additional space in the Trash folder if he/she wants to delete messages when over quota. The dict is also needed for quota lookup from the database. The only thing which might be omitted is the global quota_rule since it is returned by the userdb/passwd in any case, but I'm not sure what happens if you only configure a "quota_rule2" without configuring a "quota_rule". > My outstanding issue is whenever I as the root mysql user update a > user's quota the other user also gets an update, I noticed with one > the messages column on the other user went from 0 to 2, another time > the quota value went up from 0 to 3500 it seems random. You should not be accounting the actual mailbox usage in the same virtual_users table as the quota is read from. Use *different* column or table name in your dict file where dovecot may write the current storage/message count. > dovecot-dict-sql.conf.ext > > map { > pattern = priv/quota/storage > table = virtual_users > username_field = user > value_field = quota value_field should be current_quota_storage (writable column) > } > map { > pattern = priv/quota/messages > table = virtual_users > username_field = user > value_field = quota_messages value_field should be current_quota_messages (writable column) > I'd like to know why these columns are updating. Dovecot stores the current storage and mailcount in there. These columns should be different from the columns defining the maximum limit. Regards Daniel

1 0

[Dovecot] fstat() failed with file */dovecot.index.log
by Nicolás 21 Oct '12

21 Oct '12

Hi list! I'm using Dovecot along with Postfix (with MySQL) and I'm having some curious error messages in the mail log. Everything runs normally and suddenly I start viewing messages like these: Oct 12 14:24:23 dovecot: last message repeated 5 times Oct 12 14:25:23 dovecot: last message repeated 6 times Oct 12 14:26:23 dovecot: last message repeated 6 times Oct 12 14:27:23 dovecot: last message repeated 6 times Oct 12 14:29:22 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory Oct 12 14:30:23 dovecot: last message repeated 5 times Oct 12 14:31:23 dovecot: last message repeated 6 times Oct 12 14:33:22 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory Oct 12 14:34:23 dovecot: last message repeated 5 times Oct 12 14:35:23 dovecot: last message repeated 6 times Oct 12 14:36:01 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory This file which Dovecot references to indeed exists, is accesible, etc. Once I get the first of these messages, the user stops receiving e-mails (the mail server keeps receiving them normally, though) until he restarts the mail client. Then the error msg is gone and he receives all their unreceived messages. This error appears in 6-12h. intervals once the user starts their client. Version is 2.0.19, and dovecot -n is: root@mail:~# dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-32-generic-pae i686 Ubuntu 12.04.1 LTS ext4 disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/home/vmail/%d/%n/Maildir mailbox_idle_check_interval = 2 mins namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = root } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes driver = static } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /home/vmail/dovecot-deliver.log postmaster_address = postmaster(a)devels.es } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } Thanks so much for any help! Nicolás

2 5

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 20 Oct '12

20 Oct '12

David Mehler wrote: > Thanks for your reply. So with the extending of the query to return a > default quota rule, do you have an example of that by the way, does > that mean I only have to put the overrided users in the quota table? Assuming that quota values are in the dovecot_users table... # passdb with userdb prefetch and default quota of 1024M for quota=0 rows # The userdb_ prefix is for prefetch userdb entries in password_query password_query = SELECT username AS user, \ password AS password, \ home AS userdb_home, \ uid AS userdb_uid, \ gid AS userdb_gid, \ CASE quota \ WHEN 0 \ THEN '*:bytes=1024M:messages=0' \ ELSE \ CONCAT('*:bytes=', CAST(quota AS CHAR), 'M:messages=', CAST(quota_message AS CHAR)) \ END AS `userdb_quota_rule` \ FROM dovecot_users \ WHERE username='%u'; # user_query with default quota of 1024M for quota=0 rows user_query = SELECT username AS user, \ home AS home, \ uid AS uid, \ gid as gid, \ CASE quota \ WHEN 0 \ THEN '*:bytes=1024M:messages=0' \ ELSE \ CONCAT('*:bytes=', CAST(quota AS CHAR), 'M:messages=', CAST(quota_message AS CHAR)) \ END AS `quota_rule` \ FROM dovecot_users \ WHERE username='%u'; Your user_query needs to return a row if the user exists, otherwise dovecot will assume that the user does not exist and the mail or user will be rejected. Regards Daniel -- https://plus.google.com/103021802792276734820

1 0

[Dovecot] still having difficulties with per-user quotas
by David Mehler 20 Oct '12

20 Oct '12

Hello, I am trying to get per-user quotas working. My thanks to all who have helped so far. To recap I am running Dovecot 2.1 and Mysql where I've got my virtual users. All virtual users are under the system user vmail with a UID and GID of 5000. Looking over the wiki docs I've added a quota table and got the dict service working, I am not having problems with permissions or the login username and password, all that is working fine. Here's my current doveconf -n output it is producing the following debug error related to the userdb sql query: # 2.1.10: /etc/dovecot/dovecot.conf # XXX dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 5000 first_valid_uid = 5000 hostname = XXX last_valid_gid = 5000 last_valid_uid = 5000 mail_location = maildir:/home/vmail/%d/%n:LAYOUT=fs mail_plugins = " quota" namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 ::1 } inet_listener imaps { address = xxx xxxx ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = </etc/ssl/certs/server.crt ssl_key = </etc/ssl/private/server.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = " quota imap_quota" } Oct 19 15:23:52 auth-worker(29279): Info: mysql(/var/run/mysqld/mysqld.sock): Connected to database mail Oct 19 15:23:52 auth-worker(29279): Debug: sql(xxx,::1): query: SELECT user as user, password FROM virtual_users WHERE user='xxx@domain'; Oct 19 15:23:52 auth: Debug: client passdb out: OK 1 user=xxx Oct 19 15:23:52 auth: Debug: master in: REQUEST 3523346433 29276 1 f5cd16e3f5e078c28d850749e42c86cc Oct 19 15:23:52 auth-worker(29279): Debug: sql(xxx,::1): SELECT concat('*:storage=', bytes, 'M') as quota_rule FROM quota WHERE username='xxx'; Oct 19 15:23:52 auth: Debug: master userdb out: USER 3523346433 xxx quota_rule=*:storage=368485M Oct 19 15:23:52 imap-login: Info: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=29282, secured, session=</xKpcW7MFgAAAAAAAAAAAAAAAAAAAAAB> Oct 19 15:23:52 imap(xxx): Error: user xxx: Couldn't drop privileges: User is missing UID (see mail_uid setting) Oct 19 15:23:52 imap(xxx): Error: Internal error occurred. Refer to server log for more information. I am wanting a majority of my users to have the global 1GB quota, but the users in the quota table to have given quotas. Here's what the virtual_users and quota tables look like: mysql> describe virtual_users; +-----------+--------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra | +-----------+--------------+------+-----+---------+----------------+ | id | int(11) | NO | PRI | NULL | auto_increment | | domain_id | int(11) | NO | MUL | NULL | | | user | varchar(40) | NO | | NULL | | | password | varchar(128) | NO | | NULL | | +-----------+--------------+------+-----+---------+----------------+ 4 rows in set (0.00 sec) mysql> describe quota; +----------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +----------+--------------+------+-----+---------+-------+ | username | varchar(100) | NO | PRI | NULL | | | bytes | bigint(20) | NO | | 0 | | | messages | int(11) | NO | | 0 | | +----------+--------------+------+-----+---------+-------+ 3 rows in set (0.00 sec) I'd appreciate any help. Thanks. Dave.

2 3

[Dovecot] Dovecot 2 and TCP-Keepalive
by Sven Hartge 20 Oct '12

20 Oct '12

Hi! I am about to migrate a perdition-based IMAP/POP3 proxy to Dovecot. Unfortunately some users are behind a firewall/NAT setup which throws away seemingly idle TCP connections sooner than the established default of 24 hours (more likely after 30 minutes ...) resulting in all kinds of weird client behavior. And unfortunately² this firewall/NAT setup is outside of my control and I have no means of correcting this (in my opinion) flawed configuration. Now, with perdition I was able to use the --tcp_keepalive option which totally solved the mentioned weird client behavior. My question is: does Dovecot2 use TCP-Keepalive on its sockets per default or do I need to enable it some way I have not yet discovered? The manual and wiki only talk about "keepalive" in connection with the IMAP protocol and IDLE and my C-fu is too weak to understand the source code. Grüße, Sven. -- Sigmentation fault. Core dumped.

2 2

[Dovecot] Dovecot 2 quota limit and actual size (mysql)
by wamp 20 Oct '12

20 Oct '12

Hello, Can You explain to me how dovecot-lda knows actual size of virtual user directory? I want to keep max size of user directory in mysql - should I also use some kind of script to upgrade actual size information in mysql ? I read docs from wiki but still dont know it. thanks -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecot-2-quota-limit-and-actual-size-… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Question about salted hashes
by Tobias Maffert 19 Oct '12

19 Oct '12

Hello. I'm switching from b1gmail to my own setup which consists of Postfix+Dovecot+MySQL (and maybe VBoxAdm). There are two problems: - b1gmail is using unsalted MD5 hashes. Is there any good way to make my new setup backward compatible? So I don't have to force all of my 50k users to change their password. - How do I change my setup to salted SHA256 (or an even better algorithm). And how do I make the hashes compatible between Postfix, Dovecot, MySQL (and maybe VBoxAdm)? My system: Debian Squeeze Postfix version: 2.7.1 Dovecot version: 1.2.15 ----------------------------------------------- dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.6 protocols: imap pop3 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_access_groups: vmail mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v lda: postmaster_address: <postmaster-address> auth_socket_path: /var/run/dovecot/auth-master mail_plugins: quota sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login user: vmail passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: quota: maildir ----------------------------------------------- driver = mysql connect = host=127.0.0.1 dbname=smail user=smail password=mypw default_pass_scheme = CRYPT password_query = SELECT username AS user, password_enc AS password, CONCAT(homedir, maildir) AS userdb_home, uid AS userdb_uid, gid AS userdb_gid, CONCAT('maildir:', homedir, maildir) AS userdb_mail, CONCAT('maildir:storage=', (quota*1024)) as userdb_quota FROM mail_users WHERE (username = '%u' OR email = '%u') AND ((imap = 1 AND '%Ls' = 'imap') OR (pop3 = 1 AND '%Ls' = 'pop3') OR '%Ls' = 'smtp') user_query = SELECT CONCAT(homedir, maildir) AS home, CONCAT('maildir:', homedir, maildir) AS mail, uid, gid, CONCAT('*:storage=', (quota*1024)) as quota_rule FROM mail_users WHERE (username = '%u' OR email = '%u') ----------------------------------------------- Regards, Tobi M.

2 1

[Dovecot] Add S=<size> to maildirfile
by Alessio Cecchi 19 Oct '12

19 Oct '12

Hi, in some old Maildir/ I have file without the S=<size> in file name. Is possibile to add the size to the file name with some tools like doveadm? Are there other methods to update these file? Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

4 4

[Dovecot] Emails from invalid local accounts
by Steven Kiehl 19 Oct '12

19 Oct '12

Hi, I'm using dovecot 1.2.9 in a postfix/dovecot setup and I'm having issues with receiving spam where the "from" header contains an address like accounting(a)mydomain.com. Is there some way I can filter out these emails coming from outside our network with an account associated with our network which doesn't exist? Do I just need to configure some custom process to evaluate these addresses, or is there some way either in dovecot or spamassassin to do this? Thanks, Steve K

3 4