- dovecot - dovecot.org

[Dovecot] dsync problems
by Micah Anderson 17 Nov '11

17 Nov '11

When a user renames their username, I am using dsync to copy their mail over to the new username's mail location[0]. Some of the dsyncs are failing with errors that I dont know how to work with, for example: dsync(<username>): Error: Trying to open a non-listed mailbox with guid=41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: msg iteration failed: Couldn't open mailbox 41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=42fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=43fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=44fcd40303c8a64e432300007ef44c7a ERROR: dsync failed, exit code: 256 The errors cause a non-zero exit code from dsync, which causes my rename script to bail out. What are these errors, and how can I fix them? Thanks, micah 0. Why use dsync instead of a simple mv operation? This seems to be necessary for two corner cases: 1. dovecot creates the new mailbox automatically when the user logs in or receives a mail, so if the user changes their mail and logs in or receives an email before the move has been done, then the mailbox is created and then a move command will fail. 2. If there has been new mail created under the new name, we can't just simply remove the stuff that is automatically created there and replace it with the old things because we could potentially be removing mail that has been delivered in the mean time. I'd be really interested if people had suggestions for a better mechanism, or perhaps a way to have dovecot not create the new mail location automatically. --

3 2

[Dovecot] 2.1: virtual plugin and lsub
by e-frog 17 Nov '11

17 Nov '11

Hi Timo, I'm using the virtual plugin and have 2 mailboxes configured in the "virtual" namespace (dovecot -n attached). Using lsub with dovecot 2.0.15 leads to the following result: 1 lsub "" "virtual/*" * LSUB () "/" "virtual/Lists" * LSUB () "/" "virtual/unread" 1 OK Lsub completed. However with dovecot 2.1 (latest hg as of today) and the same config there is a 3rd mailbox "virtual" listed which doesn't exist: 1 lsub "" "virtual/*" * LSUB () "/" "virtual" * LSUB () "/" "virtual/Lists" * LSUB () "/" "virtual/unread" 1 OK Lsub completed. Thunderbird shows the "virtual" mailbox as selectable and not grayed out as with 2.0.15. Clicking on that mailbox gives an error message "Mailbox doesn't exist: virtual". Thanks, e-frog

2 3

[Dovecot] Performance-Tuning
by Peer Heinlein 17 Nov '11

17 Nov '11

Hi, I have > 11 TB hard used Mailstorage, saved als maildir in ext3 on HP EVA. I always wanted to make some mesurements about several influences to the performance (switch to ext4, switch to mdbox), but I never had enough time to do that. At the moment I *need* more speed, we have too much waitI/O on the system and I already used all other performance and tuning-tricks (separated cache, noatime, fsync and all that stuff). I have to change my setup, maybe somebody else here have hard facts: *) Is ext4 faster? How much faster? *) Is it faster because of the ext4 kernel-module (which can be used on ext3 to) or because of the ext4 filesystem layout? *) Is mdbox really faster? I'd like to have mdbox to have better performance in running my backup-processes. But does it bring some performance boosts to? Thanks for any hints an tricks, Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

13 25

[Dovecot] Port variable in LMTP userdb lookups?
by Mark Zealey 17 Nov '11

17 Nov '11

Hi all, I'm currently changing some systems to use the redirector service, which means that to get local deliveries going I need to get lmtp set up so it can be redirected as well. This is working fine, however we have a number of different ports running on our servers depending on which brand a customer is using. When the time comes to do the user look up, we use (port, user, domain) to do a unique database lookup which works fine for everything (proxied pop, imap, lmtp & straight pop, imap) but not straight lmtp - perhaps because it doesn't have a 2-stage login process unlike the pop/imap protocols. Looking at the SQL query we are issuing, the %a port variable is set to 0 even though the connection is coming in from TCP. Is there a way to change this? We are running dovecot 2.0.12 however looking through the changelogs I can't see this would be fixed in the newest version. Thanks, Mark

3 4

Re: [Dovecot] Please advise on very fast search
by Alexander Chekalin 17 Nov '11

17 Nov '11

Thanks, Robert, will take a look at. What I'm afraid for is how database storage should be planned (storage, CPU, RAM, scaling when will be over-filled). When dealing with files (I'm using maildir), it is much easy to understand and to fix just about everything. Adding database involves tune it up too, and I'll have more points of 'tune it a bit' In fact work with Dovecot is pretty nice, but I think I can tune it to work faster. I now run it on FreeBSD (on UFS2), maybe I should change OS + FS, but need to test (really hope ZFS disks on SAS drives will help; still find no benchmarks on such a setup). Will also try to use full text search, but afraid of index size (and I need no search on body, just on headers). Anyway thank your for pointing me in right directions! Yours, Alexander

3 16

[Dovecot] Getting started with sieve and conversion from procmail
by Alex 17 Nov '11

17 Nov '11

Hi, I have a fedora15 system with dovecot-v2.0.15, dovecot-pigeonhole and and amavisd-new and would like to implement it on my system using postfix. I've read the basic wiki documentation, but I really can't figure out the proper starting point in my case. I've enabled "protocol lda" in 15-lda.conf and added "sieve" to the list of mail_plugins. I'm trying to adapt postfix to use deliver as its LDA for multiple virtual domains. I've added the following to master.cf: dovecot unix - n n - - pipe flags=DRhu user=dovecot:dovecot argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} -a "${RECIPIENT}" Is that the proper format? Is it okay to use the dovecot user here, or should I create a new user? What permissions does this user need to possess? I've added the following to main.cf: dovecot_destination_recipient_limit = 1 virtual_transport = dovecot I have a number of procmail scripts and I've converted them to sieve, but they didn't convert very well. Can someone show me how to convert the following: :0 { :0 fhW | /home/alex/bin/process-mail.pl } The script skipped right over that. I'm also trying to convert the following: :0 * (RCVD_IN_DNSWL_HI|RCVD_IN_DNSWL_LOW|RCVD_IN_HOSTKARMA_W) * !USER_IN_WHITELIST * !BAYES_00 * !URIBL_ * !KHOP_RCVD_UNTRUST * !RCVD_IN_DNSWL_MED * !SPF_SOFTFAIL * SPF_HELO_PASS * SPF_PASS { LOG="DNSWL: " :0: whitelist/dnswl } The script only produced the following: if true { if true { if true { if true { if true { if true { if true { if true { if true { if true { fileinto "{"; fileinto " LOG="DNSWL: ""; fileinto " :0:"; fileinto " whitelist/dnswl"; fileinto "}"; } Any ideas greatly appreciated. Thanks, Alex

4 22

[Dovecot] v2.0.16 released
by Timo Sirainen 17 Nov '11

17 Nov '11

http://dovecot.org/releases/2.0/dovecot-2.0.16.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.16.tar.gz.sig I only now noticed that the VSZ limits weren't being enforced with earlier v2.0.x releases (or they were set 1024 times too high). So if a Dovecot process was leaking memory, it wasn't being killed by kernel. Now that this enforcing is done, some installations will probably start seeing errors about reaching these limits in normal operation. The default_vsz_limit is 256 MB. You may want to increase it in larger installations to 1 GB just in case. Besides the changes listed below, a lot of smaller fixes were done. v2.0.16 2011-11-17 Timo Sirainen <tss(a)iki.fi> * VSZ limits weren't being enforced for any processes. On server with large mailboxes you may now see errors about it if the limits aren't high enough. To fix them, either increase individual service { vsz_limit } values or simply increase the default_vsz_limit setting. * Proxying: If using ssl=yes or starttls=yes with a hostname (not IP) as proxy destination, require that the certificate matches the given hostname. * LMTP: Changed default client_limit to 1. This should improve LMTP throughput with default settings. * dsync: Quota is no longer enforced (i.e. dsync can't fail because user is over quota). + Added "auto" mail storage driver, which can be used to autodetect mailbox location and format. This behavior is already the default for empty mail_location setting, so this change is mainly useful for shared namespace's location setting. + checkpassword: Export all auth %variables to AUTH_* environment.

1 0

[Dovecot] Bus factor of dovecot / GIT
by Thomas Koch 16 Nov '11

16 Nov '11

Hi, somebody from the kolab groupware project recently explained me that the Bus- Factor[1] of around 1 would be one of their primary reasons not to use Dovecot and stick with Cyrus. What do you think about that? Is the bus factor much higher then 1? [1] http://en.wikipedia.org/wiki/Bus_factor Somehow related: Since the free software world[2] slowly converges towards GIT as the "one and only" VCS, have you thought about a switch? It's much more likely that somebody checks out your code, looks into it and provides patches if the VCS is already installed. [2] Android, Debian, Drupal, Eclipse, Fedora, Gnome, KDE, Linux Kernel, Perl, PHP (ongoing), PostgreSQL, Qt, Ruby on Rails, X.org (freedesktop.org) Best regards, Thomas Koch, http://www.koch.ro

6 6

[Dovecot] submission_host problem
by Bambero 16 Nov '11

16 Nov '11

Hello, I configured dovecot to use submission smtp host becouse of chroot. submission_host = 127.0.0.1 Unfortunatelly: Nov 12 05:11:15 myhost exim[23366]: 2011-11-12 05:11:15 SMTP protocol synchronization error (next input sent too soon: pipelining was not advertised): rejected "EHLO myhost" H=localhost [127.0.0.1] next input="MAIL FROM:<root@myhost>\\r\\n" Nov 12 05:11:15 myhost exim[23366]: 2011-11-12 05:11:15 SMTP protocol synchronization error (next input sent too soon: pipelining was not advertised): rejected "EHLO myhost" H=localhost [127.0.0.1] next input="MAIL FROM:<root@myhost>\\r\\n" Nov 12 05:11:15 myhost dovecot: lda(alias(a)apisoft.pl): Error: smtp(127.0.0.1): RCPT TO failed: 554 SMTP synchronization error Nov 12 05:11:15 myhost dovecot: lda(alias(a)apisoft.pl): Error: sieve: msgid=<E1RP4uv-00043S-L7@myhost>: failed to redirect message to <bambero(a)gmail.com> (refer to server log for more information) Does anyone know how to fix it ? Regards, Bambero

4 10

[Dovecot] Glued-together private namespaces
by Mark Moseley 16 Nov '11

16 Nov '11

I've been goofing with this all day with 2.0.15 and I'm starting to realize that either a) I'm not that smart, b) it's been so long since I messed with namespaces that I'm going about it completely wrong, or c) it's just not possible. I haven't posted 'doveconf -n' and other details, because mainly I'm just looking for 'yes, this is possible' or 'no, you're smoking crack' before posting further details. At this point, it's all maildir and moving to mdbox, while highly desirable in the future, is not possible in the near- to medium-term. I'm trying to glue a namespace underneath INBOX: namespace INBOX { type = private separator = . prefix = INBOX. # Yes, this used to be on Courier inbox = yes list = yes hidden = no subscriptions = yes location = maildir:~/Maildir } namespace archive { type = private separator = . prefix = INBOX.Archives. inbox = no list = children subscriptions = yes location = maildir:~/Maildir-Archive } I've tried putting namespace archive's 'prefix' as just "Archives", but Tbird doesn't seem to see this namespace, regardless of how much I futz with the imap settings in tbird. With the above setup, it actually seems to work correctly (provided ~/Maildir-Archive exists), though I'm sure a big gotcha is waiting in the wings. I can move messages around, create subfolders, subscribe to folders in ~/Maildir-Archive). The only thing I can't seem to get working is quotas. With my password_query like: password_query = ... CONCAT( '*:bytes=', "1M" ) AS 'userdb_quota_rule', \ CONCAT( '*:messages=10' ) AS 'userdb_quota_rule2', \ CONCAT( 'INBOX.Archives:bytes=+4900M' ) AS 'userdb_quota_rule3', \ CONCAT( 'INBOX.Archives:messages=+3900' ) AS 'userdb_quota_rule4' ... only the default quota seems to be in place for any subfolder of INBOX.Archives and for INBOX.Archives itself, i.e. *:bytes still applies to INBOX.Archives. The debug log show that: Debug: Quota root: name=User quota backend=maildir args= Debug: Quota rule: root=User quota mailbox=* bytes=1048576 messages=0 Debug: Quota rule: root=User quota mailbox=* bytes=1048576 messages=10 Debug: Quota rule: root=User quota mailbox=INBOX.Archives bytes=+5138022400 messages=0 Debug: Quota rule: root=User quota mailbox=INBOX.Archives bytes=+5138022400 messages=+3900 These are wildly stupid quotas but they're just there to test. With INBOX already at capacity (byte-wise; only set to a meg), copying large messages inside INBOX.Archives fails (only copying a 800k message but the quota should be 5gig now). Again, before I post configs, I'm just curious if what I'm trying to do isn't remotely possible, or that I'm approaching this entirely wrongly. Thanks!

2 6