- dovecot - dovecot.org

[Dovecot] 2.0beta3 10876:370ee9717a6c broke listen on literal IPv6 address
by Bernhard Schmidt 19 Mar '10

19 Mar '10

Hi, apparently the following change in dovecot hg * New revision (10876:370ee9717a6c) in dovecot Mercurial repository: - config: Forgot to add header file. broke listen = 83.170.6.69, 2001:1b10:1000::110:1:1 mail.svr02.mucip.net:~# dovecot -F -c /etc/dovecot/dovecot.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:29: listen=..:port has been replaced by service { inet_listener { port } } doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: duplicate listener: 1: Is this even possible? That doesn't make sense to me, but Stephan's +29 works fine for me, +30 (with just that change according to changelog) doesn't. Bernhard

2 5

[Dovecot] GlusterFs - Any new progress reports?
by Ed W 18 Mar '10

18 Mar '10

GlusterFs always strikes me as being "the solution" (one day...). It's had a lot of growing pains, but there have been a few on the list had success using it already. Given some time has gone by since I last asked - has anyone got any more recent experience with it and how has it worked out with particular emphasis on Dovecot maildir storage? How has version 3 worked out for you? Anyone had success using some other clustered/HA filestore with dovecot who can share their experience? (OCFS/GFS over DRBD, etc?) My interest is more in bootstrapping a more highly available system from lower quality (commodity) components than very high end use Thanks Ed W

8 18

Re: [Dovecot] sieve vacation
by Martin F. Foster 18 Mar '10

18 Mar '10

Following from Steffen Kaiser's response, RFC5230 explains the conditions necessary for the Sieve Vacation extension to trigger a response. This says: "Vacation" MUST NOT respond to a message unless the recipient user's email address is in a "To", "Cc", "Bcc", "Resent-To", "Resent-Cc", or "Resent-Bcc" line of the original message. So your scenario 4 happens when the sender is only in the envelope, and not in the headers. For example: this transaction will get a response because the mailbox address is in the To: header ehlo there.com mail from: <dude(a)there.com> rcpt to: <user(a)domain.tld> << envelope recipient, mailsystem routes with this information data To: "Some User" <user(a)domain.tld> << header recipient must be correlated for Sieve Vacation to send a response From: "Dude" <dude(a)there.com> Subject: message Hi there . This transaction will not get a response, and will trigger the "discarding vacation response for message implicitly delivered to <user(a)domain.tld> " log: ehlo there.com mail from: <dude(a)there.com> rcpt to: <user(a)domain.tld> data Subject: message Hi there . Cheers, -Martin Foster Le 12-Feb-10 21:00, dovecot-request(a)dovecot.org a écrit : > Message: 9 > Date: Fri, 12 Feb 2010 09:18:23 +0100 > From: Lampa<lampacz(a)gmail.com> > Subject: [Dovecot] sieve vacation > To: Dovecot Mailing List<dovecot(a)dovecot.org> > Message-ID: > <9aef75b11002120018v69f185b5hb0a9e0f7dad1e5c5(a)mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > > Hello, > > scenario: > > OK 1. created vacation script (see below) > OK 2. send message fromuser(a)anotherdomain.tld touser(a)domain.tld => > got auto vacation response (2010-02-11T19:42:13) > OK 3. send message fromuser(a)anotherdomain.tld touser(a)domain.tld => > no response (is ok because ":days 1" settings) (2010-02-11T19:47:46) > BAD 4. send message fromanotheruser(a)anotherdomain.tld to > user(a)domain.tld => no response (2010-02-11T19:48:04) > > > Why is discarding vacation response for message implicitly delivered > to<user(a)domain.tld> ? > > log: > 2010-02-11T19:42:13.669321+01:00 hermes dovecot: > deliver(user(a)domain.tld): sieve: > msgid=<052a01caab49$ec4752e0$c4d5f8a0$@tld>: sent vacation response to > <user(a)anotherdomain.tld> > 2010-02-11T19:42:13.732541+01:00 hermes dovecot: > deliver(user(a)domain.tld): sieve: > msgid=<052a01caab49$ec4752e0$c4d5f8a0$@tld>: stored mail into mailbox > 'INBOX' > 2010-02-11T19:47:46.271534+01:00 hermes dovecot: > deliver(user(a)domain.tld): sieve: > msgid=<053201caab4a$b295ece0$17c1c6a0$@tld>: discarded duplicate > vacation response to<user(a)anotherdomain.tld> > 2010-02-11T19:47:46.275891+01:00 hermes dovecot: > deliver(user(a)domain.tld): sieve: > msgid=<053201caab4a$b295ece0$17c1c6a0$@tld>: stored mail into mailbox > 'INBOX' > 2010-02-11T19:48:04.958622+01:00 hermes dovecot: > deliver(user(a)domain.tld): sieve: > msgid=<053701caab4a$bda90220$38fb0660$@tld>: discarding vacation > response for message implicitly delivered to<user(a)domain.tld> > 2010-02-11T19:48:04.965875+01:00 hermes dovecot: > deliver(user(a)domain.tld): sieve: > msgid=<053701caab4a$bda90220$38fb0660$@tld>: stored mail into mailbox > 'INBOX' > > vacation script: > ----------- > require "vacation"; > > vacation > :days 1 > :subject "Auto reply" > > "auto reply message"; > -------------- > > Thank you > -- Lampa ------------------------------

3 4

[Dovecot] Dovecot 2.0 b13e01d82083
by Renaud Allard 18 Mar '10

18 Mar '10

Hello, I was trying to compile Dovecot 2.0 b13e01d82083, and I found this when doing make: Making all in lib test -f UnicodeData.txt || wget http://www.unicode.org/Public/UNIDATA/UnicodeData.txt /bin/sh: wget: not found I think it's probably not the best idea to assume everyone has wget installed. Perhaps it is installed by default on linux, but probably not on all other platforms. Why not just include the UnicodeData.txt file? Best Regards

2 1

[Dovecot] quota usage
by Papp Tamás 18 Mar '10

18 Mar '10

hi All! Dovecot's version is 1.2.11-0~auto+0 from http://xi.rename-it.nl/debian/ . dovecot.conf: dict { quota = mysql:/data/apps/dovecot/dict-sql.conf #expire = db:/var/lib/dovecot/expire.db } /data/apps/dovecot/dict-sql.conf: connect = host=127.0.0.1 dbname=db user=user password=pw map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } The problem is that the mailbox is almost empty: $ du -sh . 228K . But the quota usage show something else: mysql> select bytes,messages from quota where username='<user>'; +-----------+----------+ | bytes | messages | +-----------+----------+ | 217699358 | 987 | +-----------+----------+ What could be a problem, how can I fix this? Thank you very much, tamas

2 1

[Dovecot] .mailboxlist location
by Dave Brenner 18 Mar '10

18 Mar '10

Greetings. On our 1.2.9 setup, we are finding that .mailboxlist (we recompiled to use this name rather than .subscriptions) ends up in the user's ~/mail folder. We'd like this file to be stored in ~/ instead. Is this possible without changing namespaces (for UW compatibility) and/or userdb mail location? Thanks! -- Dave Brenner - david(a)toledotel.com The Toledo Telephone Company, Inc.

2 4

[Dovecot] v1.2.11 released
by Timo Sirainen 18 Mar '10

18 Mar '10

http://dovecot.org/releases/1.2/dovecot-1.2.11.tar.gz http://dovecot.org/releases/1.2/dovecot-1.2.11.tar.gz.sig mbox users really should upgrade, because by sending a message with a huge header you could basically cause a DoS (this problem exists only with v1.2.x, not with v1.0 or v1.1). - mbox: Message header reading was unnecessarily slow. Fetching a huge header could have resulted in Dovecot eating a lot of CPU. Also searching messages was much slower than necessary. - mbox, dbox, cydir: Mail root directory was created with 0770 permissions, instead of 0700. - maildir: Reading uidlist could have ended up in an infinite loop. - IMAP IDLE: v1.2.7+ caused extra load by checking changes every 0.5 seconds after a change had occurred in mailbox

2 2

Re: [Dovecot] I stream read - stale NFS file handle (reboot of server)
by Damon Atkins 18 Mar '10

18 Mar '10

In the old days NFS Shared Path had a static handle (ie a number), normal based on some number pulled out of the file system/inode. To fix (well work around) a security issue, for about 10+ years now, when a NFS server reboots, it generates a new random handle for the NFS Share. (sever may generate a new random handle per mount request) The NFS Stale Handle happens when the client is still using the old NFS handle, the only fix is a remount Some NFSv3 server let you fix the handle id for NFS share so it does not change over reboots. (this is how NFS clustering works, sometimes you need to install cluster software if the exportfs/share command does not let you hard code the fsid by hand. The other option is to use NFSv4 which is design to handle reboots by servers.

4 6

[Dovecot] dovecot 2.0beta3 installation
by Renaud Allard 17 Mar '10

17 Mar '10

Hello, I tried to install dovecot 2.0 beta3 and deliver seems to look for its config file in unusual places. In my exim logs, I get: 010-03-17 13:39:24 [31257] 1NrsWt-0004T0-1K <email(a)example.com>: dovecot_delivery transport output: lda: Fatal: User lookup failed: net_connect_unix(/opt/dovecot/etc/dovecot/dovecot.conf) failed: No such file or directory 2010-03-17 13:39:24 [31257] 1NrsWt-0004T0-1K == email(a)example.com (email(a)example.com) <email(a)example.com> R=local_user T=dovecot_delivery defer (0): Child process of dovecot_delivery transport returned 75 (could mean temporary error) from command: /opt/dovecot/libexec/dovecot/deliver Dovecot have been started with the following command: /opt/dovecot/sbin/dovecot -F -c /etc/dovecot/dovecot2.conf Furthermore, it has been compiled with: --prefix=/opt/dovecot --sysconfdir=/etc I don't see why it searches for /opt/dovecot/etc/dovecot/dovecot.conf Also, I didn't really find out how to convert the v1.2 config snippet: auth default { mechanisms = digest-md5 cram-md5 ntlm login plain passdb passwd-file { args = /etc/cram.pwd } userdb passwd { } userdb passwd-file { args = /etc/passwd } socket listen { client { path = /var/run/dovecot/auth-client mode = 0666 } } user = exim } I tried the following, but it does not seem to work as I get an authentication socket protocol error service auth { unix_listener /var/run/dovecot/auth-client { mode = 0666 } } Thanks for you help

2 6

[Dovecot] Testing EXTERNAL AUTHENTICATION
by Stephen Feyrer 17 Mar '10

17 Mar '10

Hi. I'm trying to test EXTERNAL AUTHENTICATION in Dovecot. To do this I first configured Thunderbird and Opera to use my server, neither of them were successful. As a result I contacted both organisations to enquire if they supported EXTERNAL AUTHENTICATION in their products. Thunderbird responded and said yes. However, on closer inspection my contact at Thunderbird identified that support for EXTERNAL AUTHENTICATION was poor at best and then only in SMTP. From that point on, my contact has been trying to implement support in Thunderbird. I've also try to test using openssl s_client which is detailed below. As far as I can tell my problems appear after the authentication. I don't know what the problem is only that there is one. [~] # dovecot -n # 1.2.10: /opt/etc/dovecot/dovecot.conf # OS: Linux 2.6.12.6-arm1 armv5tejl ext3 base_dir: /opt/var/run/dovecot/ log_path: /opt/var/log/dovecot/messages info_log_path: /opt/var/log/dovecot/info protocols: imaps listen: [::] ssl_ca_file: /opt/etc/domain.ca/cacrl.pem ssl_cert_file: /opt/etc/domain.ca/newcerts/mail.cer ssl_key_file: /opt/etc/domain.ca/private/mail.key ssl_cipher_list: ALL:!LOW:!SSLv2 ssl_verify_client_cert: yes verbose_ssl: yes login_dir: /opt/var/run/dovecot//login login_executable: /opt/libexec/dovecot/imap-login login_process_size: 32 mail_location: dbox:/share/MD0_DATA/mail/%u mail_debug: yes dbox_rotate_days: 0 imap_id_send: * imap_id_log: * lda: postmaster_address: postmaster(a)ksudra.net auth default: mechanisms: EXTERNAL realms: ksudra.net default_realm: ksudra.net user: admin verbose: yes debug: yes ssl_require_client_cert: yes ssl_username_from_cert: yes passdb: driver: passwd-file args: /opt/etc/dovecot/passwd userdb: driver: passwd [~] # openssl s_client -cert Stephen.pem -connect 10.1.1.245:993 <-- snip --> SSL handshake has read 4460 bytes and written 2451 bytes --- New, TLSv1/SSLv3, Cipher is DHE-RSA-AES256-SHA Server public key is 4096 bit Compression: NONE Expansion: NONE SSL-Session: Protocol : TLSv1 Cipher : DHE-RSA-AES256-SHA Session-ID: [...] Session-ID-ctx: Master-Key: [...] Key-Arg : None Krb5 Principal: None Start Time: 1268756439 Timeout : 300 (sec) Verify return code: 19 (self signed certificate in certificate chain) --- * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=EXTERNAL] Dovecot ready. 01 AUTHENTICATE EXTERNAL + 01 list "" * 01 NO [ALERT] Invalid base64 data in continued response 01 select inbox 01 BAD Error in IMAP command received by server. 02 select inbox 02 BAD Error in IMAP command received by server. DONE [~] # tail -f /opt/var/log/dovecot/info Mar 16 16:51:14 auth(default): Info: new auth connection: pid=9176 Mar 16 16:51:16 imap-login: Info: Valid certificate: /O=ksudra.net/OU=Ksudra CA/emailAddress=certs(a)ksudra.net/L=Wilmslow/ST=Cheshire/C=GB/CN=ksudra.net Mar 16 16:51:16 imap-login: Info: Valid certificate: /C=GB/ST=Cheshire/O=ksudra.net/OU=Stephen Feyrer/CN=Stephen Mar 16 16:52:06 auth(default): Info: client in: AUTH 1 EXTERNAL service=imap secured valid-client-cert cert_username=Stephen lip=10.1.1.245 rip=10.1.1.4 lport=993 rport=45379 Mar 16 16:52:06 auth(default): Info: client out: CONT 1 Mar 16 16:52:42 imap-login: Info: Valid certificate: /O=ksudra.net/OU=Ksudra CA/emailAddress=certs(a)ksudra.net/L=Wilmslow/ST=Cheshire/C=GB/CN=ksudra.net Mar 16 16:52:42 imap-login: Info: Valid certificate: /C=GB/ST=Cheshire/O=ksudra.net/OU=Stephen Feyrer/CN=Stephen Mar 16 16:52:42 auth(default): Info: client in: AUTH 1 EXTERNAL service=imap secured valid-client-cert cert_username=Stephen lip=10.1.1.245 rip=10.1.1.4 lport=993 rport=45381 Mar 16 16:52:42 auth(default): Info: client out: CONT 1 Mar 16 16:52:42 auth(default): Info: client in: CONT<hidden> Mar 16 16:52:42 auth(default): Info: EXTERNAL(Stephen,10.1.1.4): Invalid base64 data in continued response Mar 16 16:52:42 auth(default): Info: client out: FAIL 1 reason=Invalid base64 data in continued response Mar 16 16:52:42 auth(default): Info: new auth connection: pid=9182 Mar 16 16:52:45 auth(default): Info: client in: CONT<hidden> Mar 16 16:52:45 auth(default): Info: EXTERNAL(Stephen,10.1.1.4): Invalid base64 data in continued response Mar 16 16:52:45 auth(default): Info: client out: FAIL 1 reason=Invalid base64 data in continued response Mar 16 16:52:47 imap-login: Info: Aborted login (cert required, client didn't start TLS): method=EXTERNAL, rip=10.1.1.4, lip=10.1.1.245, TLS Mar 16 16:54:36 imap-login: Info: Valid certificate: /C=GB/ST=Cheshire/O=ksudra.net/OU=Stephen Feyrer/CN=Stephen Mar 16 16:54:36 auth(default): Info: new auth connection: pid=9188 Mar 16 16:54:37 auth(default): Info: client in: AUTH 1 EXTERNAL service=imap secured valid-client-cert cert_username=Stephen lip=10.1.1.245 rip=10.1.1.4 lport=993 rport=49113 Mar 16 16:54:37 auth(default): Info: client out: CONT 1 Mar 16 16:54:37 auth(default): Info: client in: CONT<hidden> Mar 16 16:54:37 auth(default): Info: EXTERNAL(Stephen,10.1.1.4): Invalid base64 data in continued response Mar 16 16:54:37 auth(default): Info: client out: FAIL 1 reason=Invalid base64 data in continued response Mar 16 16:54:42 imap-login: Info: Aborted login (cert required, client didn't start TLS): method=EXTERNAL, rip=10.1.1.4, lip=10.1.1.245, TLS Mar 16 16:54:49 imap-login: Info: Valid certificate: /O=ksudra.net/OU=Ksudra CA/emailAddress=certs(a)ksudra.net/L=Wilmslow/ST=Cheshire/C=GB/CN=ksudra.net Mar 16 16:54:49 imap-login: Info: Valid certificate: /C=GB/ST=Cheshire/O=ksudra.net/OU=Stephen Feyrer/CN=Stephen -- kind regards Stephen Feyrer.

3 12

[Dovecot] sieve fileinto rule (pigeonhole)
by Oliver Eales 17 Mar '10

17 Mar '10

Hello, i discovered that when a sieve rule "fileinto drawer;" tries to deliver a mail into a non existent drawer, the drawer gets created. This is neat, but is there also a way to automatically subcribe to the created folder ? Regards, Oliver Eales

2 4

[Dovecot] qmail-secretary plugin for dovecot deliver
by Rajkumar S 17 Mar '10

17 Mar '10

Hi, I have been using qmail-ldap for quite some time and now moved to postfix/dovecot. One feature that I miss is that provided by qmail-secretary. qmail-secretary basically is a mail list manager with following features: 1 no limit, just explode to all members 2 members only, as the name says; only members are allowed (based on envelope sender, so not very secure, everybody can fake that) 3 sender confirm, sender has to confirm submission and return address like DJBs qmail-secretary 4 moderated, moderator(s) have to accept every message; there are DN and RFC822 moderators All configuration (name, members, moderated etc...) are taken from LDAP. I had gone through the code and from what I understand for each 4 delivery types it works as follows: 1. Just deliver to all recipients (say, inject it via sendmail). 2. verify if envelope sender is in allowed list and proceed as above. 3. 1. create a random hash 2. save the mail in new/ with hash as filename 3. create a new mail with listname-confirm-hash(a)domain.com and send 4. If that mail comes back, deliver the mail to all recipients. 4. 1. as above but using listname-approve-hash and list-name-reject-hash 2. move the msg to cur/ 3. if appropriate reply comes retrieve the mail from cur/ and send to all recipient. qmail-secretary is invoked by qmail-local and thus this is a nice candidate for a deliver plugin. Before I start coding I just want to check if there is any gotchas that I am missing? I assume all these operations can be performed as a deliver plugin and that deliver plugin is the correct place for such functionality. It goes without saying that I would be contributing this plugin back to dovecot. with regards, raj

4 9

Re: [Dovecot] [xmail] XMail + Dovecot
by Sabahattin Gucukoglu 17 Mar '10

17 Mar '10

What, exactly, is the problem? How do you want Dovecot and XMail to work together? I am setting up Dovecot to read from standard Maildirs in user home directories, because I am using a separate delivery agent (TMDA but would work for maildrop, Dovecot's deliver program and others) to deliver mails using mailproc.tab. So, even while XMail runs as root, Dovecot need not and there is no problem getting it to work just like with other MTAs. XMail can't help with delivery to Maildir because it runs as root, and unless you mess about with packet filters to non-root it you'll still end up using for instance XACLs to allow Dovecot to read the mails. For authentication of XMail to Dovecot you would have to write external authentication helpers that use Dovecot's protocol. Or, you can use checkpassword or PAM-POP3 or something else to try getting Dovecot to authenticate against the active XMail list of users. Or you can just do what I do, maintain two databases and keep them in sync. Cheers, Sabahattin

1 0

[Dovecot] Design: Asynchronous I/O for single/multi-dbox
by Timo Sirainen 17 Mar '10

17 Mar '10

The long term plan is to get all of Dovecot disk I/O asynchronous. The first step to that direction would be to make dbox/mdbox I/O asynchronous. This might also allow mbox/maildir to become partially asynchronous. http://www.dovecot.org/list/dovecot/2009-December/045481.html already started describing how the lib-storage API could be changed to support high-latency storages. Adding support for all of the paralellism would be nice, but probably not necessary as the first step. Then again, the API changes are necessary, so the parallelism optimizations probably aren't a huge task on top of that. Besides the API changes described in the above link, another change that's necessary is to add mail_get_nonblocking_stream(). The returned stream can return EAGAIN whenever it would need to block. Whenever sending message data to client, this stream would have to be used. It would also be used internally by all of message parsing/searching code. Luckily all of that already supports nonblocking input or can be easily modified to support it. Below are some thoughts how to go forward with this. I originally thought about writing a more specific plan, but I think this is good enough now to start coding. The target Dovecot version is v2.1, not v2.0. Filesystem API ============== The idea is to first abstract out all POSIX filesystem accessing in dbox/mdbox code. Non-blocking I/O works pretty nicely for socket I/O, so I thought I'd use a similar API for disk I/O as well: handle = open(path, mode) - this function can't fail. it's executed asynchronously. - mode=read-only: no writing to file - mode=append: appending to file is allowed handle = create(path, mode, permissions) - this function can't fail. it's executed asynchronously. - mode=fail-if-exists: commit() fails if file already exists - mode=replace-if-exists: commit() replaces file if it already exists - permissions: i'm not entirely sure how this works yet. but it should contain mode and gid in some format set_input_callback(handle, callback, context) set_output_callback(handle, callback, context) - call the callback when more data can be read/written ret = pread(handle, buf, size, offset) - just like pread(), but can fail with EAGAIN if there are no bytes already buffered. so the idea is that the backend implementation would buffer/readahead data, which would be returned by this call. this would require memcpy()ing all data, but it might get too complex/fragile if it was asynchronously written to given buffer. ret = write(handle, buf, size) - append data to given file and return how many bytes were actually added to write buffer. works in a similar way than writing to socket. data can only be appended to files, there is no support for overwriting data. - no writes will be visible to reads until commit() is called ret = commit(handle, [filename]) - commit all previous writes to disk. either returns success/EAGAIN. - if filename is given and a new file is being created, the filename is changed to the given one instead of using the original path's filename. this is needed because e.g. mdbox saving can write many temp files in a single transaction and only at commit stage it locks the index files and knows what the filenames will be. rollback(handle) - rollback all previous writes. close(handle) - if file was created and not committed, the temp file will be deleted - does implicit rollback ret = try_lock(handle) - this isn't an asynchronous operation! it assumes that locking state is kept in memory, so that the operation will be fast. if backend doesn't support locking or it's slow, single-dbox should be used (instead of multi-dbox), because it doesn't need locking. - returns success or "already locked" - only exclusive locking is possible Async IO streams ================ Async input streams are created with FS API handle, so it's possible to start reading from them before the file has even been open()ed. The callers must be aware of this and realize that read() can fail with ENOENT, etc. Async input streams' read() would work exactly as file_istream works for non-blocking sockets: It would return data that is already buffered in memory. If there's nothing, it returns EAGAIN. The FS API's set_input_callback() can be used to set a callback function that is called whenever there's more data available in the buffer. Async output streams also work the same as non-blocking file_ostreams: write() returns the number of bytes added to buffer. When buffer becomes full, it starts returning EAGAIN. The ostream handles flushing internally the same way as file_ostreams does, although instead of using io_add(IO_WRITE) it uses FS API's set_output_callback(). If callers need to know when more data can be written or when all of the data has been written, it can override the ostream's flush_callback, just like with file_ostreams. Async IO for FS API backend =========================== So now that all of the APIs have been designed, all that's needed to do is to write a simple FS API implementation using kernel's async IO API, right? Wrong. There is no usable async IO API in Linux, and probably nowhere else either: * POSIX AIO isn't supported by Linux kernel. And even if it was, it only supports async reads/writes, not async open(). * Linux kernel has its own native AIO implementation! ..But it only works with direct IO, which makes it pretty much useless for almost everyone. There have been many different attempts to get buffered AIO support to Linux, but all of them have failed. So for now the only practical way is to implement it with threads. There are several libraries that could make this easier.. But all of them enable (and require) full thread safety for libc calls. I don't really like that. Dovecot isn't using threads, I shouldn't pay the penalty of using extra locking when it's really not necessary. So I was thinking about doing the async IO in two ways: 1) For Linux/x86/x86-64 (and maybe others) implement a version that creates threads with clone() and uses lockless queues for communicating between the async io worker threads. The threads won't use malloc() or any other unsafe calls, so this should be pretty nice. 2) Fallback version that uses pthreads with mutexes. Is 2) going to be noticeably slower than 1)? Probably not.. In both cases there is also the problem of how many worker threads to create. I've really no idea, kernel would be so much better in deciding that.. I guess that also depends on how many processes Dovecot is configured to run on (and how busy they are at the moment). Maybe it could be just a globally configurable number of threads/process, defaulting to something like 10. dbox changes ============ Most of the dbox code shouldn't be too difficult to change to using the FS API. The one exception is writing messages. Currently the format looks like: <dbox header magic (2 bytes)> <dbox message header, which contains message size><lf> <message> <dbox metadata magic (2 bytes)><lf> <dbox metadata> <lf> The problem is that the message size isn't always known before the message is written. So currently the code just pwrite()s the size afterwards, but this is no longer possible with the new FS API. One possibility would be to buffer the message in memory, but that could waste a lot of memory since messages can be large. So the only good solution is to change the dbox file format to contain the message size after the message. At the same time the dbox format could be cleaned up from old broken ideas as well. The reading code could support the old version format as well, because reading isn't a problem. The new dbox format could look like: <dbox header magic (2 bytes)> <dbox unique separator (random 16 bytes or so)><lf> <message> <dbox metadata magic (2 bytes)> <dbox unique separator, same as above><message size><lf> <dbox metadata, last item being metadata size> <lf> The unique separator exists there primarily for fixing corrupted dbox storage, so it can (quite) reliably recognize where a message ends. Multi-dbox's indexes contain already the message offset + size of (message+metadata), i.e. offset+size = offset of next message. The size is primarily used to figure out if more data can be appended to the file (so it won't grow too large). This size could just be changed to become message's size and the check just changed to assume metadata size would be e.g. 512 bytes. It won't really matter in practise. So then the reading code could get the message's size from the index. Single-dbox doesn't have such index. There are two ways to solve the problem there (both actually would work for multi-dbox too): 1) Metadata block can be found by reading backwards from end of file. For example read the last 512 bytes of the file and find the metadata magic block. Get the message's size from there. 2) Create an istream that simply reads until it reaches dbox metadata magic and unique separator. And to be absolutely sure it reached the correct end of message, it can also check that the rest of the data in the stream contains only a valid metadata block.

8 28

[Dovecot] how configure quotas with dovecot and mysql databases
by Wilberth Pérez 17 Mar '10

17 Mar '10

some one knows, how to configure quotas with dovecot and mysql databases ? my dovecot was compiled with: CPPFLAGS=-I/opt/mysql/include/mysql LDFLAGS=-L/opt/mysql/lib/mysql ./ configure --with-sql --with-mysql and my dovecot.conf and dovecot-sql.conf have the following configurations: =========== dovecot.conf =========== protocol imap { listen = *:143 mail_plugins = quota imap_quota } protocol pop3 { listen = *:110 mail_plugins = quota } plugin { quota = maildir:storage=30M quota_rule = *:storage=30M quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2 = storage=80%% /usr/local/bin/quota-warning.sh 80 } ============ dovecot-sql.conf ============ driver = mysql connect = host=localhost dbname=mail user=mail password=mail user_query = SELECT 1 AS gid, concat('maildir:storage= ', quota_kb) AS quota FROM users WHERE user = 'testuser'; I test my configuration and don't show errors , however, dovecot never show me my quota configuration. I will be omitting something ? Cheers. -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo: wilberth.perez(a)uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 --------------------------------------------------------

1 0

[Dovecot] Dovecot 2.0beta3: Crash with mail_log plugin enabled
by Thomas Leuxner 17 Mar '10

17 Mar '10

Latest from Mercurial. Dovecot crashes with 'mail_log' and 'notify' plugins enabled when deleting a message: [08:22] root spectre:~# gdb /usr/lib/dovecot/imap /tmp/core GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu"... warning: Can't read pathname for load map: Input/output error. Reading symbols from /usr/lib/dovecot/libdovecot-storage.so.0...Reading symbols from /usr/lib/debug/usr/lib/dovecot/libdovecot-storage.so.0.0.0...done. done. Loaded symbols for /usr/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/lib/dovecot/libdovecot.so.0...Reading symbols from /usr/lib/debug/usr/lib/dovecot/libdovecot.so.0.0.0...done. done. Loaded symbols for /usr/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux-x86-64.so.2...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib/libpthread.so.0...done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /usr/lib/dovecot/modules/lib01_acl_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib01_acl_plugin.so...done. done. Loaded symbols for /usr/lib/dovecot/modules/lib01_acl_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib02_imap_acl_plugin.so...done. done. Loaded symbols for /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib10_quota_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib10_quota_plugin.so...done. done. Loaded symbols for /usr/lib/dovecot/modules/lib10_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so...done. done. Loaded symbols for /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib15_notify_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib15_notify_plugin.so...done. done. Loaded symbols for /usr/lib/dovecot/modules/lib15_notify_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_mail_log_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_mail_log_plugin.so...done. done. Loaded symbols for /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. [New process 2151] #0 0x00007f5c79480ed5 in raise () from /lib/libc.so.6 #0 0x00007f5c79480ed5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007f5c794823f3 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007f5c79be62c5 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:164 backtrace = 0x61f660 "/usr/lib/dovecot/libdovecot.so.0 [0x7f5c79be62b2] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f5c79be631a] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f5c79be66c3] -> /usr/lib/dovecot/libdovecot-st"... #3 0x00007f5c79be631a in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=<value optimized out>, args=<value optimized out>) at failures.c:592 No locals. #4 0x00007f5c79be66c3 in i_panic (format=<value optimized out>) at failures.c:230 args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffffffd370, reg_save_area = 0x7fffffffd2b0}} #5 0x00007f5c79e72748 in view_lookup_uid (view=0x6614c0, seq=0, uid_r=0x7fffffffd39c) at mail-index-view.c:210 __PRETTY_FUNCTION__ = "view_lookup_uid" #6 0x00007f5c79e589c6 in mail_cache_decision_state_update (view=0x661800, seq=2151, field=12) at mail-cache-decisions.c:82 cache = (struct mail_cache *) 0x65e790 hdr = <value optimized out> uid = <value optimized out> __PRETTY_FUNCTION__ = "mail_cache_decision_state_update" #7 0x00007f5c79e5a4b0 in mail_cache_lookup_headers (view=0x661800, dest=0x67be28, seq=0, field_idxs=0x7fffffffd56c, fields_count=1) at mail-cache-lookup.c:484 _data_stack_cur_id = 5 ret = <value optimized out> #8 0x00007f5c79e88d22 in index_mail_get_raw_headers (mail=0x67b618, field=0x7f5c78608dc7 "Message-ID", value_r=0x7fffffffd5c8) at index-mail-headers.c:614 headers = {0x67b618 "\230?e", 0x7f5c79bfda98 "H\201??"} value = <value optimized out> headers_ctx = <value optimized out> data = <value optimized out> field_idx = 12 dest = (string_t *) 0x67be28 i = <value optimized out> len = <value optimized out> ret = <value optimized out> header_values = {arr = {buffer = 0x661ec8, element_size = 6692576}, v = 0x661ec8, v_modifiable = 0x661ec8} __PRETTY_FUNCTION__ = "index_mail_get_raw_headers" #9 0x00007f5c79e892bf in index_mail_get_first_header (_mail=0x67b618, field=0x7f5c78608dc7 "Message-ID", decode_to_utf8=false, value_r=0x7fffffffd620) at index-mail-headers.c:771 list = (const char * const *) 0x80 ret = 8 i = 0 #10 0x00007f5c786085cc in mail_log_append_mail_header (str=0x61f4d8, mail=0x867, name=0x7f5c78608dd2 "msgid", header=0xffffffffffffffff <Address 0xffffffffffffffff out of bounds>) at mail-log-plugin.c:174 value = 0x8 <Address 0x8 out of bounds> #11 0x00007f5c786087be in mail_log_append_mail_message (ctx=0x661ec8, mail=0x67b618, event=MAIL_LOG_EVENT_SAVE, desc=0x61f4b0 "copy from INBOX") at mail-log-plugin.c:219 _data_stack_cur_id = 4 #12 0x00007f5c7880ba57 in notify_contexts_mail_copy (src=0x6636f8, dst=0x67b618) at notify-plugin.c:69 ctx = (struct notify_context *) 0x642310 mail_txn = (struct notify_mail_txn *) 0x0 #13 0x00007f5c7880c1e3 in notify_copy (ctx=0x667ed0, mail=0x6636f8) at notify-storage.c:113 ret = <value optimized out> #14 0x00007f5c79e4e29a in mailbox_copy (_ctx=0x7fffffffd7a0, mail=0x6636f8) at mail-storage.c:1330 ctx = (struct mail_save_context *) 0x667ed0 box = (struct mailbox *) 0x65cc98 keywords = (struct mail_keywords *) 0x67b300 ret = <value optimized out> #15 0x0000000000409631 in cmd_copy (cmd=0x650f38) at cmd-copy.c:66 client = (struct client *) 0x6507d8 dest_ns = <value optimized out> dest_storage = <value optimized out> destbox = (struct mailbox *) 0x65cc98 t = (struct mailbox_transaction_context *) 0x661080 search_args = (struct mail_search_args *) 0x65bc88 messageset = 0x652888 "4891" mailbox = 0x652890 "Trash" src_uidset = <value optimized out> sync_flags = <value optimized out> imap_flags = <value optimized out> changes = {pool = 0x0, uid_validity = 9, saved_uids = {arr = {buffer = 0x7f5c795563a0, element_size = 0}, v = 0x7f5c795563a0, v_modifiable = 0x7f5c795563a0}, ignored_uid_changes = 6418664, ignored_modseq_changes = 0} copy_count = 1 msg = <value optimized out> ret = 1 __PRETTY_FUNCTION__ = "cmd_copy" #16 0x000000000040f9dc in client_command_input (cmd=0x650f38) at imap-client.c:647 client = (struct client *) 0x6507d8 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #17 0x000000000040fa8d in client_command_input (cmd=0x650f38) at imap-client.c:697 client = (struct client *) 0x6507d8 command = (struct command *) 0x6 __PRETTY_FUNCTION__ = "client_command_input" #18 0x000000000040fc05 in client_handle_input (client=0x6507d8) at imap-client.c:738 _data_stack_cur_id = 3 ret = 25 remove_io = <value optimized out> handled_commands = false __PRETTY_FUNCTION__ = "client_handle_input" #19 0x0000000000410642 in client_input (client=0x6507d8) at imap-client.c:789 cmd = <value optimized out> output = (struct ostream *) 0x650db8 bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #20 0x00007f5c79bf0feb in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x6277d0 event = (const struct epoll_event *) 0x627840 list = (struct io_list *) 0x650e90 io = (struct io_file *) 0x65b820 tv = {tv_sec = 1799, tv_usec = 999883} t_id = 2 msecs = <value optimized out> ret = 1 call = <value optimized out> #21 0x00007f5c79bf0168 in io_loop_run (ioloop=0x6275c0) at ioloop.c:350 No locals. #22 0x00007f5c79be0143 in master_service_run (service=0x627490, callback=0x867) at master-service.c:478 No locals. #23 0x0000000000418681 in main (argc=1, argv=0x627370) at main.c:313 service_flags = <value optimized out> storage_service_flags = <value optimized out> postlogin_socket_path = 0x0 set_roots = {0x41b980, 0x0}

3 10

[Dovecot] Dovecot 2.0beta3: Auth master process is now running as default_internal_user
by Thomas Leuxner 16 Mar '10

16 Mar '10

Hi, with 'changeset 10910' the Auth master process is running as 'default_internal_user' now (dovecot). This requires permissions tuning for 'passwd-files' at least, while other plugins would run in a different user context, 'vmail' in my setup. I see that this may be safer, just wondering how to streamline the config: [20:27] root spectre:/var/vmail/conf.d# l drwxr-x--- 4 dovecot vmail 4096 2010-03-14 17:40 leuxner.net [20:27] root spectre:/var/vmail/conf.d# l leuxner.net/ drwx------ 2 vmail vmail 4096 2010-03-14 13:09 acls -r-------- 1 dovecot vmail 125 2010-02-07 13:08 passwd drwx------ 2 vmail vmail 4096 2010-03-14 12:13 sieve [20:27] root spectre:/var/vmail/conf.d# cat leuxner.net/passwd tlx@leuxner.net:{SSHA}xxxx:5000:5000::/var/vmail/leuxner.net/tlx::userdb_quota_rule=*:storage=5G […] Regards Thomas

2 3

[Dovecot] ACL problem
by SZÉKELYI Szabolcs 16 Mar '10

16 Mar '10

Hey, I seem to have a problem with ACLs. I'm trying to use them on shared folders those work fine without it. But as soon as I enable the plugin and create the dovecot-acl files, they disappear. I used strace to see if there's a problem with file permissions, but it looks like Dovecot doesn't even attempt to access the dovecot-acl file in the maildir, only the dovecot-acl-list files. However, it does look for dovecot-acl files in users' home directories. Maybe the ACL plugin is enabled only for the private mailboxes, not for the public ones, but I want right the opposite. How can I achieve it? Please find my dovecot config below. Thanks, -- cc # 1.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.4 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps ssl: required ssl_cert_file: /etc/ssl/certs/imapd.pem ssl_key_file: /etc/ssl/private/imapd.key.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mbox_write_locks: fcntl dotlock mail_plugins: acl namespace: type: private location: mbox:%h:INBOX=/var/mail/%u inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Logs/ location: maildir:/data/mail/logs:LAYOUT=fs:INDEX=~/.imap- public/Logs:CONTROL=~/.imap-public/Logs list: yes auth default: passdb: driver: pam userdb: driver: passwd plugin: acl: vfile

2 3

[Dovecot] Dovecot 2.0beta3 LMTP hanging when delivering into a non-existing mailbox
by Bernhard Schmidt 16 Mar '10

16 Mar '10

Hi, another LMTP problem. When a sieve userscript tries to fileinto a nonexisting mailbox the LMTP process hangs. Mar 12 12:55:28 mail dovecot: lmtp(1328, berni(a)vmail.mail.mucip.net) kPpuOKArmkswBQAA/GZUZg: sieve: msgid=<201003111751.o2BHpTbX069309(a)squid-cache.org>: failed to store into mailbox 'squidbugs': Mailbox doesn't exist: squidbugs after that I cannot get a LMTP connection anymore (TCP connect works, but I don't see a server banner) until I send SIGKILL to the running lmtp process. SIGTERM is not enough. strace looks like this: gettimeofday({1268394998, 961094}, NULL) = 0 stat("/var/cache/dovecot/b/berni/.squidbugs", 0x7fff202e5040) = -1 ENOENT (No such file or directory) stat("/var/mail/vmail/b/berni/.squidbugs", 0x7fff202e5000) = -1 ENOENT (No such file or directory) stat("/var/mail/vmail/b/berni", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/var/mail/vmail/b/berni/.squidbugs", 0x7fff202e5000) = -1 ENOENT (No such file or directory) stat("/var/mail/vmail/b/berni", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/var/mail/vmail/b/berni/.squidbugs/tmp", 0x7fff202e5070) = -1 ENOENT (No such file or directory) stat("/var/mail/vmail/b/berni/.squidbugs", 0x7fff202e5120) = -1 ENOENT (No such file or directory) write(2, "\1\0041337 llrFJeUrmks5BQAA/GZUZg: s"..., 166) = 166 rt_sigprocmask(SIG_BLOCK, [CHLD], [], 8) = 0 rt_sigaction(SIGCHLD, NULL, {SIG_DFL, [], 0}, 8) = 0 rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0 nanosleep({86400, 0}, I'm on 10869:bf978f2de0fd. Bernhard

2 2

[Dovecot] segfault with vpopmail 5.5.0
by Giuseppe Iuculano 16 Mar '10

16 Mar '10

Hi, version: 1.2.10 OS: Debian unstable/x86_64 [118905.528497] dovecot-auth[3856]: segfault at 0 ip (null) sp 00007fff6666ad98 error 14 in dovecot-auth[400000+61000] 2010-02-26 22:17:45 dovecot: Error: child 3856 (auth) killed with signal 11 (core dumped) (gdb) bt full #0 0x0000000000000000 in ?? () No symbol table info available. #1 0x0000000000423b0e in vpopmail_lookup_vqp (request=0x726f68, vpop_user=0x7fff6666ae20 "postmaster", vpop_domain=0x7fff6666adc0 "test.bogus") at userdb-vpopmail.c:43 vpw = <value optimized out> #2 0x0000000000421376 in vpopmail_password_lookup (auth_request=0x7fff6666ae20, cleartext=false, result_r=0x7fff6666aebc) at passdb-vpopmail.c:65 vpop_user = "postmaster", '\000' <repeats 70 times> vpop_domain = "test.bogus", '\000' <repeats 70 times> vpw = <value optimized out> password = <value optimized out> #3 0x00000000004215ad in vpopmail_verify_plain (request=0x7fff6666ae20, password=0x704360 "test", callback=0x415500 <auth_request_verify_plain_callback>) at passdb-vpopmail.c:119 result = <value optimized out> scheme = <value optimized out> tmp_pass = <value optimized out> crypted_pass = <value optimized out> ret = <value optimized out> #4 0x0000000000415391 in auth_request_verify_plain (request=0x726f68, password=0x704360 "test", callback=0x41eb90 <plain_verify_callback>) at auth-request.c:509 passdb = 0x70ca40 result = <value optimized out> cache_key = <value optimized out> __PRETTY_FUNCTION__ = "auth_request_verify_plain" #5 0x000000000041a6f7 in mech_plain_auth_continue (request=0x726f68, data=<value optimized out>, data_size=<value optimized out>) at mech-plain.c:58 authid = 0x704340 "" authenid = 0x704341 "postmaster(a)test.bogus" error = <value optimized out> pass = 0x704360 "test" count = 2 #6 0x0000000000415d41 in auth_request_handler_auth_begin (handler=0x7192f8, args=<value optimized out>) at auth-request-handler.c:388 mech = <value optimized out> request = 0x726f68 list = 0x24 name = 0x704308 "@Cp" arg = 0x704195 "AHBvc3RtYXN0ZXJAdGVzdC5ib2d1cwB0ZXN0" initial_resp = 0x704195 "AHBvc3RtYXN0ZXJAdGVzdC5ib2d1cwB0ZXN0" initial_resp_len = 2 id = <value optimized out> buf = 0x704308 #7 0x0000000000411549 in auth_client_handle_line (conn=0x717f70) at auth-client-connection.c:174 No locals. #8 auth_client_input (conn=0x717f70) at auth-client-connection.c:250 _data_stack_cur_id = 3 line = 0x7182b6 "AUTH\t1\tPLAIN\tservice=pop3\tlip=XXX.XXX.XXX.XXXcensored\trip=XXX.XXX.XXX.XXXcensored\tlport=110\trport=41899\tresp=AHBvc3RtYXN0ZXJAdGVzdC5ib2d1cwB0ZXN0" ret = <value optimized out> #9 0x000000000043643d in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:208 ctx = 0x70f3e0 event = 0x70f450 list = 0x718280 io = 0x718240 ---Type <return> to continue, or q <return> to quit--- tv = {tv_sec = 4, tv_usec = 999573} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 call = <value optimized out> #10 0x00000000004358b8 in io_loop_run (ioloop=0x70c380) at ioloop.c:335 No locals. #11 0x0000000000419efe in main (argc=<value optimized out>, argv=<value optimized out>) at main.c:347 foreground = false Cheers, Giuseppe

2 4

[Dovecot] Authentication userdb file / configuration help - newbie question...
by Zilon X 16 Mar '10

16 Mar '10

Hi All, I need to configure Dovecot with a XMail server ( www.xmailserver.org ) - this server uses a userdb file with the following format: "domain"[TAB]"account"[TAB]"encrypted-passwd"[TAB]"account-id"[TAB]"account-dir"[TAB]"account-type"[NEWLINE] How can authenticate Dovecot against this userdb file? Was anyone doing that? Maybe, can I authenticate Dovecot using SMTP Auth? Thank you for any help!

2 1

[Dovecot] Dovecot 2.0b3: mdbox with incorrect ACL file permissions crashes
by Thomas Leuxner 16 Mar '10

16 Mar '10

Hi, played around with 'mdbox' format some more. Converted my personal mailbox with latest Dovecot and dsync from HG: dsync convert -u login(a)yourdomain.com mdbox:~/mdbox One thing I noticed is, that dsync does not take care of existing 'dovecot-acl' files, which it should migrate/copy from my point of view, but simply skips them. Anyway I copied over the ACLs manually and forgot to set the rights accordingly. So the files were owned by 'root:vmail' instead of 'vmail:vmail' in my setup. Voilà Dovecot crashed, where it should really throw a warning or ignore the owner and work with the group permissions: Mar 2 19:27:52 spectre dovecot: imap(tlx(a)leuxner.net): acl vfile: file /var/vmail/conf.d/leuxner.net/acls/Support/Serverloft not found Mar 2 19:27:52 spectre dovecot: imap(tlx(a)leuxner.net): acl vfile: no access to file /var/vmail/leuxner.net/tlx/mdbox/mailboxes/Support/Serverloft/dbox-Mails/dovecot-acl Mar 2 19:27:52 spectre dovecot: imap(tlx(a)leuxner.net): Panic: file acl-cache.c: line 295 (acl_cache_update_rights): assertion failed: (obj_cache->my_current_rights != &negative_cache_entry) Mar 2 19:27:52 spectre dovecot: imap(tlx(a)leuxner.net): Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x7f4d8595ffb2] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f4d8596001a] -> /usr/lib/dovecot/libdovecot.so.0 (i_error+0) [0x7f4d859603c3] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f4d84da690b] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f4d84da4249] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0 x7f4d84da4572] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f4d84da472e] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f4d84da2aba] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(acl_object_get_m y_rights+0x65) [0x7f4d84da2b85] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f4d84da8fd9] -> dovecot/imap [tlx(a)leuxner.net 84.58.106.99 STATUS](client_find_namespace+0x17f) [0x41149f] -> dovecot/imap [t lx(a)leuxner.net 84.58.106.99 STATUS](cmd_status+0xfc) [0x40dc2c] -> dovecot/imap [tlx(a)leuxner.net 84.58.106.99 STATUS] [0x40f9bc] -> dovecot/imap [tlx(a)leuxner.net 84.58.106.99 STATUS] [0x40fa6d] -> dovecot/imap [tlx(a)leuxner.net 84.58.106.99 STATUS](client_handle_input+0x45) [0x40fbe5] -> dovecot/imap [tlx(a)leuxner.net 84.58.106.99 STATUS](client_input+0x62) [0x410622] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handl er_run+0xcb) [0x7f4d8596abab] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f4d85969d28] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f4d85959eb3] -> dovecot/imap [tlx(a)leuxner.n et 84.58.106.99 STATUS](main+0x191) [0x418661] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f4d851e71a6] -> dovecot/imap [tlx(a)leuxner.net 84.58.106.99 STATUS] [0x4084e9] Mar 2 19:27:52 spectre dovecot: master: service(imap): child 30281 killed with signal 6 (core dumps disabled) Regards Thomas

2 1

[Dovecot] acl_shared_dict Format for text files
by Mario Antonio 16 Mar '10

16 Mar '10

If using just a text file for Shared Mailbox Listing, How is the format of that file? acl_shared_dict = file:/vmail/%d/shared.txt Is this the format for shared.txt?: fromuser1(a)doamin.com touser2(a)domain.com 1 fromuser3(a)doamin.com touser4(a)domain.com 1 Regards, Mario Antonio

2 2

[Dovecot] Shared folders
by Неворотин Вадим 16 Mar '10

16 Mar '10

I need to create a shared folder (mailbox for group mailing list) with access of several accounts to it. But all peoples with access to this mailbox should be able to work with this folder absolutely in the same way, as with local mailbox. Each user should be able to delete emails and mark it as readed. But this changes must be only for one user, not for others. For example user1 and user2 have access to folder Trades. There is a new incoming mail. User1 read it and delete. But in user2's client this mail must be not readed and not deleted. So there should be only one copy of a email (in group mailbox), but state (unreaded|readed|deleted) of this email shoud be different for each user. Can I do this with dovecot? Yes, I know that I can send a copy of group letter to each user's mailbox, but unfortunately I has a lot of groups and very big letters, so I can't duplicate each letter to many mailboxes. The purpose is to story only one instance of each letter, but to allow users to work with it like with their own letters. Now I use Maildir++ mailboxes.

1 0

[Dovecot] Quota plugin and SQL
by David 16 Mar '10

16 Mar '10

I have read through http://wiki.dovecot.org/Quota/Dict, which suggests a database schema for using quota. For 1.2, this includes a username, bytes and messages. Is there any way to modify the queries used to split out username into localpart and domain? This would enable me to put the current quota information in my main mailbox table and display it to users in my admin interface. Or possibly it should be in a separate table for a reason, and I should be look there for the values? Thanks, David

6 9

[Dovecot] extraneous mail folder created
by John Moorhouse 16 Mar '10

16 Mar '10

I'm trying to set up dovecot on a Fedora box for about 5 users, I have a raid 5 array that is used for home folders etc mounted on /home, and I've created a directory /home/mail, which I have used a sym link to map /var/mail to. I've created folders for each of the users with relevant permissions and edited the dovecote config with:- namespace private { separator = / prefix = "#dbox/" location = dbox:~/mail:INBOX=/var/mail/%u inbox = yes hidden = yes list = no # for v1.1+ } namespace private { separator = / prefix = location = dbox:/var/mail/%u/mail } This all seems to work with the exception that when a imap client attaches to dovecot an empty folder called 'mail' is created in the users home directory. so for client jenni, whist all her emails etc are stored in /home/mail/jenni/ for INBOX and /home/mail/jenni/mail/ for folders etc, an empty folder is created as /home/jenni/mail/ Any help appreciated John

2 1

[Dovecot] IMAP proxy configuration
by Leonardo Rodrigues 16 Mar '10

16 Mar '10

i know dovecot can act as IMAP and POP3 proxy ..... but i'm having a hard time configuring it. Actually i'm using a simple dovecot configuration with virtual users stored on MySQL. My dovecot-sql.conf is pretty simple: [root@correio dovecot]# cat dovecot-sql.conf driver = mysql connect = host=localhost dbname=DATABASE user=USERNAME password=PASSWORD default_pass_scheme = PLAIN # Get the mailbox user_query = select '/var/spool/mail/%u' as home, 'maildir:/var/spool/mail/%u' as mail, 8 as uid, 12 as gid, concat('*:storage=', quota) as quota_rule, 'Trash:storage=100M' as quota_rule2 from emails where endereco = '%u' and ativa = '1' # Get the password password_query = select endereco as user, password, '/var/spool/mail/%u' as userdb_home, 'maildir:/var/spool/mail/%u' as userdb_mail, 8 as userdb_uid, 12 as userdb_gid, concat('*:storage=', quota) as userdb_quota_rule, 'Trash:storage=100M' as userdb_quota_rule2 from emails where endereco = '%u' and ativa = '1' [root@correio dovecot]# i've read several docs about configuring proxy on dovecot but all of them says about proxying specific users .... i'm interested on proxying some domains. I couldnt find a way to configure that nor some howto similar to that. could anyone point me some documentation on configuring dovecot as IMAP/POP3 proxy for a full domain and not specific users ? Ideally i would have a list of domains that should be proxied to somewhere else and all the other domains would be threated locally. Thanks. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

4 10

[Dovecot] dovecot-2.0.beta3 does not create dovecot/login directory
by Jürgen Bereuter 16 Mar '10

16 Mar '10

Hello, i build the beta3 of dovecot 2.0 on Opensolaris (SunOS sol 5.11 snv_134 i86pc i386), restarted and dovecot logs the following error. I created the directory path /var/run/dovecot/login and voila, imap is starting up without any problems. But as soon as i reboot the PC (it is only a pseudo private server), the new directory gets deleted (as expected and planed, as fa as i know), but not to be (re)created. Not a big problem, but i think it is worth to mention it. Perhaps i am wrong and messed something completely up, in that case i would be glad to receive a clue. Thanks, bye, jürgen Permissions of /var/run/dovecot are drwxr-xr-x 4 root root 573 Mär 15 21:03 dovecot Mar 15 20:12:54 imap-login: Info: Login: user=<xxxxxx>, method=PLAIN, rip=xx.xx.xx.xx, lip=10.0.0.5 Mar 15 20:25:22 imap(jub): Warning: Killed with signal 15 (by pid=846 uid=0 code=kill) Mar 15 20:25:22 imap(jub): Info: Server shutting down. bytes=31/428 Mar 15 20:25:22 imap(jub): Warning: Killed with signal 15 (by pid=846 uid=0 code=kill) Mar 15 20:25:22 imap(jub): Info: Server shutting down. bytes=1071/3075 Mar 15 20:25:22 imap(jub): Warning: Killed with signal 15 (by pid=846 uid=0 code=kill) Mar 15 20:25:22 imap(jub): Info: Server shutting down. bytes=504/1548 Mar 15 20:25:22 imap(jub): Warning: Killed with signal 15 (by pid=846 uid=0 code=kill) Mar 15 20:25:22 imap(jub): Info: Server shutting down. bytes=1176/1090254 Mar 15 20:25:22 log: Warning: Killed with signal 15 (by pid=846 uid=0 code=kill) Mar 15 20:25:22 master: Warning: Killed with signal 15 (by pid=846 uid=0 code=kill) Mar 15 20:26:48 master: Error: opendir(/var/run/dovecot//login) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/ssl-params) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/imap) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/dns-client) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/auth) failed: No such file or directory Mar 15 20:26:51 master: Fatal: Failed to start listeners Mar 15 20:26:51 master: Error: opendir(/var/run/dovecot//login) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/ssl-params) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/imap) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/dns-client) failed: No such file or directory Mar 15 20:26:51 master: Error: bind(/var/run/dovecot//login/auth) failed: No such file or directory Mar 15 20:26:51 master: Fatal: Failed to start listeners Mar 15 20:26:52 master: Error: opendir(/var/run/dovecot//login) failed: No such file or directory Mar 15 20:26:52 master: Error: bind(/var/run/dovecot//login/ssl-params) failed: No such file or directory Mar 15 20:26:52 master: Error: bind(/var/run/dovecot//login/imap) failed: No such file or directory Mar 15 20:26:52 master: Error: bind(/var/run/dovecot//login/dns-client) failed: No such file or directory Mar 15 20:26:52 master: Error: bind(/var/run/dovecot//login/auth) failed: No such file or directory Mar 15 20:26:52 master: Fatal: Failed to start listeners

2 1

[Dovecot] I stream read - stale NFS file handle
by Joe 16 Mar '10

16 Mar '10

Hi, I am running dovecot/postfix/amavisd within a jail on freebsd. I have a nullfs mounted within the jail that links back to an NFS server. I am constantly getting these errors and my mail never gets delivered. I am hoping someone has a fix for me! Mar 15 18:26:02 deliver(boomer(a)vximultimedia.com): Error: copy: i_stream_read() failed: Stale NFS file handle Mar 15 18:26:02 deliver(boomer(a)vximultimedia.com): Info: msgid=<5b7860d51003151439y3c06e019y4bf5992b220b8150(a)mail.gmail.com>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2010-03-15 18:26:01]

4 4

[Dovecot] Courier to dovecot migrations
by Daniel Grilo 16 Mar '10

16 Mar '10

Dear All, I saw some topics discussed in forums about this, but none with my problems :( Currently we have a mailserver postfix with courier-imap-4.1.1, and courier-pop3 and courier-authlib. Our Maildir's are written in the users home directory (ex: ~/Maildir) I'm now migrating the mailserver to other cluster and installing with dovecot. We're also moving the Maildir's to other directory (ex: /opt/mailboxes/%u) I've ran your perl script courier-dovecot-migrate-1.0.pl which worked just great (as far as I can tell from the OK messages) .. but when configuring my mail client for this account I get the following: Mar 16 09:49:27 magenta dovecot: auth(default): master out: USER 69 scanner system_user=scanner uid=734 gid=100 home=/home/scanner Mar 16 09:49:27 magenta dovecot: imap-login: Login: user=<scanner>, method=PLAIN, rip=::ffff:192.168.1.210, lip=::ffff:192.168.1.110 Mar 16 09:49:27 magenta dovecot: IMAP(scanner): Effective uid=734, gid=100, home=/home/scanner Mar 16 09:49:27 magenta dovecot: IMAP(scanner): maildir: data=/opt/mailboxes/scanner Mar 16 09:49:27 magenta dovecot: IMAP(scanner): maildir: root=/opt/mailboxes/scanner, index=/opt/mailboxes/scanner, control=, inbox= Mar 16 09:49:27 magenta dovecot: IMAP(scanner): stat(/opt/mailboxes/scanner/cur) failed: Permission denied Mar 16 09:49:27 magenta dovecot: IMAP(scanner): stat(/opt/mailboxes/scanner/cur) failed: Permission denied [root@magenta ~]# ls -la /opt/mailboxes/ total 36 drwxrwx--- 4 root dovecot 4096 Mar 15 11:49 . drwxr-xr-x 6 root dovecot 4096 Mar 9 2009 .. drwxrwx--- 2 root root 16384 Feb 10 15:55 lost+found drwx------ 9 scanner users 4096 Mar 15 11:56 scanner The second problem is between postfix / dovecot.. When I send an email to this user I get the following: Mar 16 09:52:11 magenta postfix/local[19065]: warning: connect #1 to subsystem private/dovecot: Connection refused Mar 16 09:52:12 magenta postfix/local[19064]: warning: connect #5 to subsystem private/dovecot: Connection refused I've the following on my /etc/postfix/main.cf ## deliver with dovecot dovecot_destination_recipient_limit = 1 mailbox_transport = dovecot smtpd_sasl_auth_enable = yes smtpd_client_restrictions = permit_sasl_authenticated I hope you can give me a hand on this :) If you need further information, please let me know (perhaps I forgot something) Best Regards Daniel -- Daniel Grilo Partner of Grupo PDM Av. Conde Valbom 30, 3o 1050-068 Lisboa (Portugal) web: http://www.pdmfc.com Tel: +351 21 357 20 29 // mobile: +351 91 388 94 39 (ext: 716) Fax: +351 21 357 20 31 Your mode of life will be changed for the better because of good news soon.

3 5

[Dovecot] public folders grayed out
by Harald Dunkel 16 Mar '10

16 Mar '10

Hi folks, I have configured a public folder as described on the Wiki (more or less; see below), but in TB3 I see the "Public" folder grayed out. I cannot subscribe. Toggling the subscriptions flag doesn't help. What did I miss here? Any helpful comment would be highly appreciated. If this is a TB3 problem: Which MUA would you suggest? Regards Harri ------------------------------------------------------------ # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-trunk-amd64 x86_64 Debian squeeze/sid log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_capability(default): CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH imap_capability(imap): CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH imap_capability(pop3): imap_capability(managesieve): imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): namespace: type: private separator: / location: maildir:/var/spool/imap/%u:LAYOUT=fs inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/var/spool/imap/public:LAYOUT=fs list: yes auth default: passdb: driver: pam userdb: driver: passwd

2 3

Re: [Dovecot] imap support for attachement deletion?
by Louis-David Mitterrand 16 Mar '10

16 Mar '10

On Sat, Mar 13, 2010 at 12:25:49PM +0100, Oliver Eales wrote: > > Am 13.03.2010 um 11:26 schrieb Louis-David Mitterrand: > > > Hi, > > > > Does dovecot support in-place attachement deletion? > > > > Mutt currently uploads a new message after deleting attachements. Is > > there a better, imap way to do it? > > Hello, > no, this is the IMAP way to do it. > Via IMAP you can't modify a message, only its attributes (flags) On the mutt-dev list someone pointed out the APPEND spec from the IMAP4rev1 standard: If a date-time is specified, the internal date SHOULD be set in the resulting message; otherwise, the internal date of the resulting message is set to the current date and time by default. Does dovecot honor a date-time passed during APPEND?

2 1

[Dovecot] Disconnected BUG Unknown internal error bytes
by Clovis Tristao 15 Mar '10

15 Mar '10

Hi, I'm using dovecot current version 1.2.11, and is showing the following error when users connect via IMAP. dovecot: IMAP(<user>): Disconnected: BUG: Unknown internal error bytes=77/773 What's happen? How to solve this problem? Thanks a lot, Clóvis -- Clovis Tristao - UNICAMP/Faculdade de Engenharia Agricola Administrador de Redes - Secao de Informatica (SINFO) E-mail: clovis(a)feagri.unicamp.br http://www.feagri.unicamp.br Fone(0xx19) 35211031-35211038-91173116 ou FAX(55xx19) 35211005/35211010

3 7

[Dovecot] deleted_to_trash 0.2 cannot compile on ubuntu 8.1 with dovecot 1.1.4
by Chan, Philip Lee Kwok 15 Mar '10

15 Mar '10

Hi, Is there any trick to make it compile? Thanks a lot. Regards, Philip 15/F, 2 IFC Tel: +852 39838782 This email and any attachments are confidential and may also be privileged. If you are not the addressee, do not disclose, copy, circulate or in any other way use or rely on the information contained in this email or any attachments. If received in error, notify the sender immediately and delete this email and any attachments from your system. Emails cannot be guaranteed to be secure or error free as the message and any attachments could be intercepted, corrupted, lost, delayed, incomplete or amended. Standard Chartered PLC and its subsidiaries do not accept liability for damage caused by this email or any attachments and may monitor email traffic. Standard Chartered PLC is incorporated in England with limited liability under company number 966425 and has its registered office at 1 Aldermanbury Square, London, EC2V 7SB. Standard Chartered Bank ("SCB") is incorporated in England with limited liability by Royal Charter 1853, under reference ZC18. The Principal Office of SCB is situated in England at 1 Aldermanbury Square, London EC2V 7SB. In the United Kingdom, SCB is authorised and regulated by the Financial Services Authority under FSA register number 114276. If you are receiving this email from SCB outside the UK, please click http://www.standardchartered.com/global/email_disclaimer.html to refer to the information on other jurisdictions.

1 0

[Dovecot] Fatal: open() failed for /var/run/dovecot/login: Permission denied
by Andy Yen 15 Mar '10

15 Mar '10

I keep getting this message when I try to start dovecot using the -F option. Fatal: open() failed for /var/run/dovecot/login: Permission denied Checking /var/run/dovecot/login folder permissions does not seem to indicate anything wrong as root has all the permissions it needs. If I am not mistaken, dovecot can run as root while in the login directory correct? When I try to start the dovecot service, it fails with the message: dovecot dead but subsys locked. Can anybody help me resolve this issue? I am running RHEL5.4. Thanks in advance.

2 1

[Dovecot] Extra Imap processes
by Dominique St-Amand 15 Mar '10

15 Mar '10

Hello fellow dovecot users! I have a question for you guys. I have a server running dovecot/exim and I allow both pop/pops and imap/imaps. When I look at the running processes, I see a lot of imap processes that look like the following: imap [user(a)domain.tld USER_IP] Sometimes, there are duplicates imap [user(a)domain.tld USER_IP] processes. I was wondering, how come those processes don't quit and stick around in the system? Should they quit after the user issued the disconnect command from its mail client? Also, is there any way to actually make them to quit or should I make a shell script that runs at a certain period of time and actually kill those processes? Thanks

2 1

[Dovecot] dovecot dead but subsys locked: auth process died to early, error 127
by Andy Yen 15 Mar '10

15 Mar '10

I am having trouble starting up dovecot on my RHEL5 server. When starting the dovecot service, I get: dovecot dead but subsys locked Looking into the mail logs, I find: dovecot: Auth process died too early - shutting down dovecot: child 4165 (auth) returned error 127 Does anybody know how I can fix this? Thanks in advance.

2 1

[Dovecot] Status update
by Timo Sirainen 14 Mar '10

14 Mar '10

Looks like I'm pretty badly lagged behind emails in mailing list and in my INBOX. I should read and do something about maybe 150 messages. The good thing at least is that v2.0 is getting closer. Only 3 larger things left besides bug fixing: 1. config handling is too slow 2. I just noticed auth cache is only for passdb. it really should be changed to cache userdb too. 3. fts-solr should optionally use mailbox GUIDs instead of mailbox names And 2 and 3 are actually old problems..

1 0

[Dovecot] Dovecot 2.0beta3: Auth changes in Mercurial
by Thomas Leuxner 14 Mar '10

14 Mar '10

Hi Timo, are the latest 'Auth-Changes' supposed to be complete? They break 'alias(a)domain.tld' logins for me. Regards Thomas

2 4

[Dovecot] bug or feature?
by zhong ming wu 14 Mar '10

14 Mar '10

Dear List If ssl_username_from_cert = yes then setting of auth_username_chars is not respected. (It may be that anything goes in that case) Also how can I include space (0x20) in auth_username_chars if I don't use ssl_username_from_cert = yes Thanks mr.wu

2 1

[Dovecot] I need IMAP stress testing tool with SEARCH command
by Ernesto Revilla 14 Mar '10

14 Mar '10

Hi. Does anyone know of a good imap stress testing tool? And one which supports SEARCH commands? I have to compare Courier and Dovecot. I already did some tests using a modified postal/rabid package. I would be thankfully for any hints. Best regards. Erny Yaco Sistemas Spain

2 2

[Dovecot] Bug in driver-mysql.c + fix
by Alain Williams 13 Mar '10

13 Mar '10

I tried to use MySQL stored procedures from dovecot: password_query = CALL user_pass_check('%n', '%d', '%w') user_query = CALL user_info('%n', '%d') This failed with the message: User query failed: PROCEDURE imap.user_info can't return a result set in the given context The root of this problem is that mysql_real_connect() needs to be called with option CLIENT_MULTI_RESULTS and mysql_next_result() called to retrieve extra results (that will not exist in the way that we use it). I attach a patch that fixes this problem -- the patch is against dovecot-1.2.10. This works for me ... but could probably do with testing by other people. BTW: I got the same problem with exim this morning, wrote a patch that has now been accepted. The dovecot patch is similar. I am looking to use mysql procedures, there are some interesting things that can be done. Two suggestions that I have will help with this: 1) There be variable (say) %o - this be the obscured password, ie what password_query returns. 2) that dovecot look for either ''password_query'' as above, or ''password_check''. password_check would NOT return a password, but would be given %o and determine itself if the password is correct. It would return the other values (user, userdb_home, ...) and auth_result that would encode success/retry/fail (0, 1, 2 - or maybe more structured [**]) and auth_reason some human readable reason. The ''nologin'' value encodes some of this. The motivation for this is that my stored procedure will record the number of successive login failures and lock the account after 3 of them. It would also be possible to do time based restrictions & the such. Also: by passing %o the password is not sent in plain to the database server - which will increase security. I will publish my stored procedures when done. Regards [**] eg taking ideas from the HTTP codes: 200 - OK 300 5 - try again in 5 minutes 301 2 9 - try again on tuesday at 9am 400 - Login forbidden, no reason given 401 - bad username and/or password 402 - account locked administratively 403 - too many failed login attempts 500 - authentication system error The above would allow a native language version of auth_reason to be produced -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 http://www.phcomp.co.uk/ Parliament Hill Computers Ltd. Registration Information: http://www.phcomp.co.uk/contact.php Past chairman of UKUUG: http://www.ukuug.org/ #include <std_disclaimer.h>

2 5

[Dovecot] Plugin like zlib
by Alex Baule 13 Mar '10

13 Mar '10

Hi everyone. I rebuild a plugin, based on zlib plugin. The changes between this plugin and zlib, is the zlib stuffs is replaced by open, read, lseek, close. With "plain-text" files, its works ok. So, my file is encrypt, and the result from decrypt file is different from fread. Like zlib, i read from fread the size variable, but the value added in seek_offset and pos is the result from decrypt, and it can be dfferent from fread. Like zlib, my file size is different from email. In zlib the file is smaller than the email. In my file, the file is bigger than the email. OK, lets go to the problem now. when the email arrives in the new folder, by imap, the stat (read my file by "while (i_stream_emexis_read(stream) > 0)" like zlib) and the seek works fine....the email is readed and the final stat size is the decrypted size of my email (smaller than original file). When I receive the email, clicking in "Send/Receive", The read function is aborted because the size to read (like zlib) is negative. I put some debug in my plugin, and print some stuffs about the functions. Email decryt size = 49556 Email encrypt size = 49568 Attachements: mail-arrived, is when the email arrives, and it's ok the read. mail-receive, is when the email is received, and have the error. maillog is the /var/log/mail The bigger difference from zlib is the i_stream_zlib_read part.... do { ret = read(zstream->fd ,crypttext, size); fprintf(zstream->debug,"DENTRO DA READ RET = %d -- ERRNO = %d -- STR = |%s|\n", ret, errno, strerror(errno)); if(ret > 0){ EVP_DecryptUpdate(&ctx, plaintext, &plain_len, crypttext, ret); memcpy(stream->w_buffer + stream->pos , plaintext, plain_len); bzero (plaintext, DEFAULT_MAX_BUFFER_SIZE); EVP_DecryptFinal(&ctx, plaintext, &plain_len_final); memcpy(stream->w_buffer + stream->pos + plain_len , plaintext, plain_len_final); } } while (ret < 0 && errno == EINTR && stream->istream.blocking); *retc *= plain_len + plain_len_final; if (ret == 0 ) { /* EOF */ stream->istream.eof = TRUE; return -1; } if (ret < 0) { if (errno == EAGAIN) { i_assert(!stream->istream.blocking); ret = 0; // } else { // i_assert(errno != 0); // stream->istream.stream_errno = errno; // return -1; } } fprintf(zstream->debug,"READ RET = %d -- ERRNO = %d -- STR = |%s|\n", ret, errno, strerror(errno)); fprintf(zstream->debug,"stream->pos = %d -- zstream->seek_offset = %d\n", stream->pos, zstream->seek_offset); zstream->seek_offset += *retc*; stream->pos += *retc*; i_assert(ret > 0); fprintf(zstream->debug,"READ RET DECRYPT = %d -- stream->pos = %d -- zstream->seek_offset = %d\n", ret, stream->pos, zstream->seek_offset); fprintf(zstream->debug,"********************** FINISH READ *********************\n"); fflush(zstream->debug); return *retc;* The* retc* is the result from decrypt. In mail-receive file (line 38), there is the error, at some point along the read/send email, the stream->pos (its returned by i_stream_compress, with stream->pos -= stream->skip) is changed out from context and the size to read is negative, but i don't understand why. Someone can help me find out what happens ?

2 1

[Dovecot] Sendmail / Dovecot Config
by John Moorhouse 13 Mar '10

13 Mar '10

I'm trying to set up dovecot on a Fedora box for about 5 users, I have a raid 5 array that is used for home folders etc mounted on /home, and I've created a directory /home/mail, which I have used a sym link to map /var/mail to. I've created folders for each of the users with relevant permissions and edited the dovecote config with:- namespace private { separator = / prefix = "#dbox/" location = dbox:~/mail:INBOX=/var/mail/%u inbox = yes hidden = yes list = no # for v1.1+ } namespace private { separator = / prefix = location = dbox:/var/mail/%u/mail } I was hoping that this would create a inbox in the root of each users folder in the mail directory and a sub folder to hold any user created folders. This all seems to work as I can create folders, copy emails to them r-arrange the folders etc as I want via a mail client using imap on 143. My only problem is that I have also configured send mail as best as I know to listen on port 25 as an SMPT client but any emails sent to it to one of the email addresses are saved by sendmail to /var/spool/mail/username and not picked up by dovecot Thanks John

2 2

[Dovecot] imap support for attachement deletion?
by Louis-David Mitterrand 13 Mar '10

13 Mar '10

Hi, Does dovecot support in-place attachement deletion? Mutt currently uploads a new message after deleting attachements. Is there a better, imap way to do it?

1 0

[Dovecot] how quotas works with postfix and dovecot
by Wilberth Pérez 13 Mar '10

13 Mar '10

Hi everybody any one knows, how i could edit dovecot to assign user quotas ? I have now configured my dovecot.conf on this way: protocol imap { listen = *:143 mail_plugins = quota imap_quota } protocol pop3 { listen = *:110 mail_plugins = quota } plugin { quota = fs:INBOX:mount=/ quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 } however when a test my quota: quota -v user1 Disk quotas for user1 (uid 107): Filesystem *usage* *quota* limit timeleft files quota limit timeleft /var/mail 16911 10240 20480 NOT STARTED 49 1000 1500 dovecot or postfix (i don't know who really should sendme the messsage) never sendme an quota warning someone knows what happen ? -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo:wilberth.perez@uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 -------------------------------------------------------- -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo: wilberth.perez(a)uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 --------------------------------------------------------

3 5

[Dovecot] Emails Disappearing -- Mystery
by Mario Antonio 12 Mar '10

12 Mar '10

I got a case that I haven't been able to resolve. I hope somebody can give me some hints. One of our users is reporting emails disappearing in front of his eyes, (Right ... emails filters at the client side ....) Server does not have global sieve filter enabled (no file present), even though this configuration is present: sieve_global_path=/vmail/globalsieverc User does not have any sieve scripts enabled at the server side. Ok, 1) The user shuts down his apple mail software, his Iphone, and the Web interface: 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Connection closed bytes=2188/6499 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Connection closed bytes=3887/7336 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Connection closed bytes=5873/68309 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Disconnected in IDLE bytes=4514/547136 2) He generates the troublesome emails from a notification system in Craiglist .... We can see the email hitting the inbox (we also see in Postfix this email going to Dovecot) 2010-03-11 15:54:48 deliver(my_user(a)mydomain.com): Info: From=noreply(a)craigslist.org : msgid=<20100311205447.0C0FE118B04(a)web8p.int.craigslist.org> : saved mail to INBOX 3) Email is deleted !!! 2010-03-11 15:54:49 IMAP(my_user(a)mydomain.com): Info: delete: uid=10719, flags=(\Deleted \Recent $Junk), msgid=<20100311205447.0C0FE118B04(a)web8p.int.craigslist.org>, from=craigslist.org <noreply(a)craigslist.org>, subject=POST/EDIT/DELETE : (accounting/financejobs) Test Post 2010-03-11 15:54:49 IMAP(my_user(a)mydomain.com): Info: expunge: uid=10719, flags=(\Deleted \Recent $Junk), msgid=<20100311205447.0C0FE118B04(a)web8p.int.craigslist.org>, from=craigslist.org <noreply(a)craigslist.org>, subject=POST/EDIT/DELETE : (accounting/finance jobs) Test Post , size=2776 Who is deleting this email ? I can see the flag $Junk ... perhaps some filter somewhere is seeing that flag and proceeding to delete it. If I understand sieve filters at the server side, they will act in the deliver process. So once the email is saved into INBOX, sieve filters will not count. Am I right? Any Hints? # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686-bigmem i686 Debian 5.0.4 xfs Regards, Mario Antonio

2 2

Re: [Dovecot] nosql (it was mogilefs)
by fernando＠dfcom.com.br 12 Mar '10

12 Mar '10

Yes, I´ve read these doc. I was just considering if someone had any experience with Mogile in email environment. Well, actually I´m trying to figure out if one of those nosql systems can store and scale email systems (ie, mailboxes - instead of maildir). I know mysql is always quoted as an option and discussed sometimes in the list. I think it´s an unnecessary overhead and bottleneck. As brainstorm. How about Cassandra, Tokyo-Tirant, Redis, and so on. Have you ever worked or tested one of them at production or even testing environment ? What do you think ? Best Regards, Fernando >---- Original Message ---- >From: Robert Schetterer <robert(a)schetterer.org> >To: dovecot(a)dovecot.org >Sent: Qua, Mar 10, 2010, 4:46 PM >Subject: Re: [Dovecot] mogilefs > >Am 10.03.2010 20:23, schrieb fernando(a)dfcom.com.br: >> Hi list, >> >> Have you ever heard or tried mogilefs? (http://danga.com/mogilefs/) >> >> Do you think suitable for dovecot/mail environments ? >> >> Regards, >> Fernando >> > >sounds not ready for mail > >MogileFS is not: > > * POSIX Compliant -- you don't run regular Unix applications or >databases against MogileFS. It's meant for archiving write-once files >and doing only sequential reads. (though you can modify a file by way of >overwriting it with a new version) Notes: > o Yes, this means your application has to specifically use a >MogileFS client library to store and retrieve files. The steps in >general are 1) talk to a tracker about what you want to put or get, 2) >read/write to one of the places it told you you could (it'll pick >storage node(s) for you as part of its load balancing), using HTTP GET/PUT > o We've prototyped a FUSE binding, so you could use MogileFS >without application support, but it's not production-ready. > > >-- >Best Regards > >MfG Robert Schetterer > >Germany/Munich/Bavaria

2 1

[Dovecot] patch: allow proxy to lookup host by name
by Martin F. Foster 12 Mar '10

12 Mar '10

This patch allows the dovecot proxy processes to lookup the destination host by name instead of IP address. Tested agains 1.2.10, expected to work against 1.2.11. The patch is pretty straightforward, it's making it work within the restrictions of the login process that's more interesting. I have made some changes to the wiki (pending approval) to - enhance the discussion of proxy with LDAP http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy - discuss the implication of this patch w.r.t. the login_chroot configuration parameter: http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy/HostLookup Feedback is appreciated, particulary from a security standpoint. Cheers, -Martin Foster martin_foster(a)netlog.net dump of wiki info, for the lazy. It will look better if viewed from the URL: http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy/HostLookup For all released versions of Dovecot, the "host" referred to in a proxy or proxy_maybe lookup must be an IP address see: the main PasswordDatabase/ExtraFields/Proxy <http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy> page for more info A patch is available to enable lookups, but it has some imporant caveats due to the nature of the LoginProcess <http://wiki.dovecot.org/LoginProcess> that the proxy function is a part of. This page exists to discuss these. The Problem Proxying is done from the dovecot login processes, both pop3-login & imap-login call code in src/login-common/login-proxy.c to handle the proxying to the given host. If the host is not an IP address, name resolution must be done. Two options from dovecot's configuration: 1. Dovecot running with roots Dovecot is started as root and drops privileges later; this is the recommended way of running Dovecot. Set by the config option: login_chroot = yes. In this mode, the login process is chrooted to login_dir, from which the proposed patch adds name resolution. Resolution is done via dovecot's net_gethostbyname() function - a wrapper for getaddrinfo/gethostbyname depending on compile-time platform support. These functions need access to the name service switch configuration, then whatever dependencies are required to consult the host resolution databases stipulated. so, if the /etc/nsswitch.conf hosts entry is: hosts: dns files Then the system will need access to /etc/resolv.conf and the nss_dns libraries for "dns" lookup, and /etc/hosts for "files" lookup. The exact files will vary by platform/operating system, but these all need to be available in the chroot for the lookup to succeed. and, if dovecot.conf has: login_chroot = yes login_dir = /var/run/dovecot/login login_user = dovecotuser Then for the nsswitch.conf entry above, the following files need to be copied (not symbolically linked!) to the chroot. This example is for a 64-bit RHEL5 system, with 64-bit dovecot daemon. Ownership of the new directories must be set to whatever the login_user is set to. mkdir /var/run/dovecot/login/etc mkdir /var/run/dovecot/login/lib64 cp /etc/nsswitch.conf /etc/resolv.conf /etc/hosts /var/run/dovecot/login/etc cp /lib64/libnss_dns.so.2 /var/run/dovecot/login/lib64 chown -R dovecotuser:dovecotuser /var/run/dovecot/login/etc chown -R dovecotuser:dovecotuser /var/run/dovecot/login/lib64 Remember that the ownership of the login_dir itself *must not* be changed. So: # ls -ld /var/run/dovecot/login/ drwxr-x--- 4 root dovecotuser 4096 Mar 12 06:48 /var/run/dovecot/login/ Troubleshooting If the lookup fails because of a perceived lookup-in-chroot issue, an error message of this form will be printed to the logs dovecot: pop3-login: proxy(test(a)domain1.test): cannot resolve mailhost.domain1.test. If name resolution is working outside dovecot, it may be a chroot issue. See LoginProcess on wiki, and login_dir& login_chroot in config. Clients will receive a much less descript general error message, for example with POP3: -ERR [IN-USE] Account is temporarily unavailable. Things to check 1. does name resolution work for normal users? the dovecot user? 2. are all the files required by the Name Service Switch's configuration available? Use a process tracing tool such as strace or truss against the pop3-login or imap-login processes to check. 3. are other security measures interfering? eg: 1. SELinux <http://en.wikipedia.org/wiki/Security-Enhanced_Linux> (RedHat <http://www.redhat.com/rhel/> EL, CentOS, Oracle EL) 2. AppArmor <http://en.wikipedia.org/wiki/AppArmor> (SuSE, Ubuntu?) 3. RBAC (Solaris, OpenSolaris <http://en.wikipedia.org/wiki/Open_Solaris>) Caveats This procedure allows the chroot'ed login to do something, which forms a security risk if the libraries in the chroot are exploitable. It will be up to the operator to ensure that the copy of the files in the chroot get updated whenver the copies in the real filesystem do. On systems where the chroot is on the same filesystem/partition that the original file copies are, hard links (again: no soft links!) could be used to accomplish this. 2. Dovecot running without roots (RootLess) Dovecot is started as whatever user/group is used to start the master daemon. See the discussion on Rootless <http://wiki.dovecot.org/HowTo/Rootless> for reasons why this is not the recommended way of running Dovecot, which includes a discussion on how this is more likely to be less secure. In dovecot.conf, rootless is selected by setting: login_chroot = no In this mode, the login process will have access to the required Name Service Switch configuration files and their dependencies if the user that started dovecot did. No further configuration is required for the proxy process to lookup hostnames.

4 3

[Dovecot] Scalability plans: Abstract out filesystem and make it someone else's problem
by Timo Sirainen 12 Mar '10

12 Mar '10

This is something I figured out a few months ago, mainly because this one guy at work (hi, Stu) kept telling me my multi-master replication plan sucked and we should use some existing scalable database. (I guess it didn't go exactly like that, but that's the result anyway.) So, my current plan is based on a couple of observations: * Index files are really more like memory dumps. They're already in an optimal format for keeping them in memory, so they can be just mmap()ed and used. Doing some kind of translation to another format would just make it more complex and slower. * I can change all indexing and dbox code to not require any locks or overwriting files. I just need very few filesystem operations, primarily the ability to atomically append to a file. * Index and mail data is very different. Index data is accessed constantly and it must be very low latency or performance will be horrible. It practically should be in memory in local machine and there shouldn't normally be any network lookups when accessing it. * Mail data on the other hand is just written once and usually read maybe once or a couple of times. Caching mail data in memory probably doesn't help all that much. Latency isn't such a horrible issue as long as multiple mails can be fetched at once / in parallel, so there's only a single latency wait. So the high level plan is: 1. Change the index/cache/log file formats in a way that allows lockless writes. 2. Abstract out filesystem accessing in index and dbox code and implement a regular POSIX filesystem support. 3. Make lib-storage able to access mails in parallel and send multiple "get mail" requests in advance. (3.5. Implement async I/O filesystem backend.) 4. Implement a multi-master filesystem backend for index files. The idea would be that all servers accessing the same mailbox must be talking to each others via network and every time something is changed, push the change to other servers. This is actually very similar to my previous multi-master plan. One of the servers accessing the mailbox would still act as a master and handle conflict resolution and writing indexes to disk more or less often. 5. Implement filesystem backend for dbox and permanent index storage using some scalable distributed database, such as maybe Cassandra. This is the part I've thought the least about, but it's also the part I hope to (mostly) outsource to someone else. I'm not going to write a distributed database from scratch.. This actually should solve several issues: * Scalability, of course. It'll be as scalable as the distributed database being used to store mails. * NFS reliability! Even if you don't care about any of these alternative databases, this still solves NFS caching problems. You'd keep using the regular POSIX FS API (or async FS api) but with the in-memory index "cache", so only a single server is writing to mailbox indexes at the same time. * Shared mailboxes. The filesystem API is abstracted, so it should be possible to easily add another layer to handle accessing other users' mails from both local and remote servers. This should finally make it possible to easily support shared mailboxes with system users.

17 82