- dovecot - dovecot.org

[Dovecot] Dovecot performance issues with many writes
by Andy Robbins 21 Nov '11

21 Nov '11

We are currently experiencing performance issue with our Dovecot system which we believe is caused by excessive writes to the dovecot files. The confusing thing is that we are seeing more writes than reads on our Dovecot volume when you would assume that most of the IO should be reads from customers checking their mail. We're seeing reads vs. writes similar to the following: # iostat -d 5 -x Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s avgrq-sz avgqu-sz await svctm %util dm-4 0.00 0.00 485.80 865.80 3886.40 6926.40 8.00 28.69 19.63 0.70 94.00 drbd0 0.00 0.00 485.80 865.80 3886.40 6926.40 8.00 111.42 94.44 0.74 99.60 We can't figure out why we would be seeing twice as many writes as we are reads. Could this have something to do with the index files? Appreciate any assistance on this issue.

5 10

[Dovecot] uid=error
by Paresh Chalke 21 Nov '11

21 Nov '11

Hi Timo, We are facing this issue on our mail server 1. Two email id's are mapped to a same account 2. If I send a mail to both the account simultaneously i get below error "Nov 21 12:13:37 blade8 dovecot: lda(kapil.gupta(a)qlc.in): save: box=INBOX, uid=error, msgid=<1321857820.4ec9f31ce638c(a)SwiftMailer.generated>, size=10921" 3. Due to this the mail is delivered only to 1 email id. 4. I am loosing all my mails. Kindly help in the same ASAP. Regards, Paresh Chalke

3 3

[Dovecot] Question about imaps
by jgiles＠cybermesa.com 21 Nov '11

21 Nov '11

Hi List! Had a questions about imap vs. imaps. I read the ssl article at http://wiki2.dovecot.org/SSL and from what I am reading, imaps is no longer needed as imap with initiate SSL/TLS on its own if STARTTLS is started and I have disable_plaintext_auth=yes and ssl=required settings. I do have SSL up and working, and can connect using imap (143) to my server without issue, but was not able to connect using imaps (993) using Kmail as my client. I Was getting a client error stating that the authentication failed using my password. However, there was nothing in the mail.err or mail.log file even when I enable debugging. If I specify imaps as my only protocol, then dovecot fails to even start without any error loging at all. As I stated, imap works just fine. So, is imaps deprecated as mentioned in the article and imaps no longer needed? I am running Dovecot 2.0.13 on an Ubuntu 11.10 64bit server. This server is simply an imap serer and not a MTA (No postfix or sendmail installed.) Thanks! Joe

4 4

[Dovecot] Iterate over domain
by Francisco Wagner C. Freire 21 Nov '11

21 Nov '11

Hello, We need to use doveadm commands on all accounts of a single domain, for now i need to query the database using scripts and for each one user, run doveadm. I can use iterate but, only for all server accounts, have any way to use doveadm iterate over a single domain? Thanks

2 1

[Dovecot] issues with 2.1b1 on OS X
by metro_domain_admin＠fastmail.fm 21 Nov '11

21 Nov '11

Two issues came up for me when building 2.1beta1 on OS X (10.5.8 on PPC). The first was already mentioned in an earlier thread by a BSD user (http://dovecot.org/list/dovecot/2011-September/061201.html) I just wanted to point out that the error is still occurring in spite of a new test for GNU ld in the configure script. I needed to remove "-no-undefined" specifically: #NOPLUGIN_LDFLAGS="-no-undefined" if test "$with_gnu_ld" = yes; then NOPLUGIN_LDFLAGS="$NOPLUGIN_LDFLAGS -Wl,--as-needed" fi More important, Dovecot aborts on launch with the following error: Nov 19 10:23:52 kerio2 dovecot[33553]: master: Fatal: kevent(EV_ADD, READ, 16) failed: Invalid argument I configured using the same args as I had used successfully on 2.0.15: --with-gssapi --with-ldap --with-sql --prefix=/opt/dovecot-2.X.X. I also tried an exact copy of my known-good config from 2.0.15, to no avail. Thanks, Tony

2 2

Re: [Dovecot] Mail_quota plugin and LDAP on Dovecot 1.2
by Victor 21 Nov '11

21 Nov '11

Thank a lot, your were completely in the truth Victor Onate

1 0

[Dovecot] Using google 2 step authentication
by Davide Cavion 20 Nov '11

20 Nov '11

Google authenticator has a PAM interface: http://code.google.com/p/google-authenticator/wiki/PamModuleInstructions Have someone tried implementing it onto Dovecot? It would be really great if you consider your emails important!

2 2

[Dovecot] Released Pigeonhole v0.2.5 for Dovecot v2.0.16
by Stephan Bosch 19 Nov '11

19 Nov '11

Hello Dovecot users, Before I move active development of Pigeonhole to Dovecot v2.1, I first release all the pending bug fixes and small improvements. Changelog v0.2.5: + Sieve vacation extension: made discard message for implicit delivery more verbose - The sieve-test tool: mixed up original and final envelope recipient in implementation of command line arguments. - Sieve vacation extension: resolved FIXME regarding the use of variables in the :handle argument. Variables are now handled correctly. - Sieve body extension: fixed handling of :content "message/rfc822". This now yields the headers of the embedded message as required by the specification. Handling of :content "multipart" remains to be fixed. - LDA Sieve plugin: fixed problem with recipient_delimiter configuration. Now it falls back to global recipient_delimiter setting if plugin/recipient_delimiter is not set. The release is available as follows: http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.5.tar.gz http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.5.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.0 wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] CCing outbound IMAP mail?
by Dave Stevens 18 Nov '11

18 Nov '11

For some users on my site I'd like to be able to CC a particular user on all outgoing IMAP mails. Incoming I can do but don't see how to do outgoing. Ideas? Dave -- It is told that such are the aerodynamics and wing loading of the bumblebee that, in principle, it cannot fly...if all this be true...life among bumblebees must bear a remarkable resemblance to life in the United States. -- John Kenneth Galbraith, in American Capitalism: The Concept of Countervailing Power

3 2

[Dovecot] Mail_quota plugin and LDAP on Dovecot 1.2
by Victor 18 Nov '11

18 Nov '11

Hi, I'm new in this List, but I have 6 years using Dovecot on my debian from etch,lenny and now squeeze Package: dovecot-imapd Version: 1:1.2.15-4 Tags: squeeze -- System Information: Debian Release: 6.0 APT prefers stable APT policy: (500, 'stable') Architecture: amd64 (x86_64) Kernel: Linux 2.6.32-5-amd64 (SMP w/24 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages dovecot-imapd depends on: ii dovecot-common 1:1.2.15-4 secure mail server that supports m ii libc6 2.11.2-10 Embedded GNU C Library: Shared lib ii libldap-2.4-2 2.4.23-7 OpenLDAP libraries ii libssl0.9.8 0.9.8o-4 SSL shared libraries the quota_imap plugin not working when I use against MailquotaSize Attribute of LDAP users. this setup works perfectly on lenny and dovecot-imapd 1:1.0.15-2.3 but on squeeze dovecot-imad 1:1.2.15-7 doesn't work, the service is up, but The quota does not display. In logs nothing happens the configuration in dovecot.conf below protocol imap { mail_plugins = quota imap_quota } protocol lda { mail_plugins = quota } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } the configuration in dovecot-ldap.conf below uris = ldap://server-ldap.com.ve auth_bind = yes ldap_version = 3 base = dc=dominio,dc=com,dc=uk deref = never scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,mail=Maildir,mailQuotaSize=quota=dirsize:storage user_filter = (&(objectClass=posixAccount)(uid=%u)) pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid pass_filter = (&(objectClass=posixAccount)(uid=%u)) This is the same configuration in the 6 last years. So, I would really appreciate if give me a hand which are more than 15000 Users who administered easily taking the quota in the LDAP attribute. and I want to keep the scheme. Thz Victor Onate Usuario Linux

2 1

[Dovecot] setting up multiple listeners
by David Mehler 18 Nov '11

18 Nov '11

Hello, I'm using Dovecot v2 and am atempting to get webmail going. I'm trying to set up imap so that port 993 only is listening on the external interface, for both ipv4 and ipv6, but that on localhost only again for ipv4 and ipv6 unencrypted port 143 is active. I've tried various combinations but keep getting an error invalid number. I've googled and not come up with the missing point. Thanks. Dave.

2 1

[Dovecot] dsync problems
by Micah Anderson 17 Nov '11

17 Nov '11

When a user renames their username, I am using dsync to copy their mail over to the new username's mail location[0]. Some of the dsyncs are failing with errors that I dont know how to work with, for example: dsync(<username>): Error: Trying to open a non-listed mailbox with guid=41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: msg iteration failed: Couldn't open mailbox 41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=42fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=43fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=44fcd40303c8a64e432300007ef44c7a ERROR: dsync failed, exit code: 256 The errors cause a non-zero exit code from dsync, which causes my rename script to bail out. What are these errors, and how can I fix them? Thanks, micah 0. Why use dsync instead of a simple mv operation? This seems to be necessary for two corner cases: 1. dovecot creates the new mailbox automatically when the user logs in or receives a mail, so if the user changes their mail and logs in or receives an email before the move has been done, then the mailbox is created and then a move command will fail. 2. If there has been new mail created under the new name, we can't just simply remove the stuff that is automatically created there and replace it with the old things because we could potentially be removing mail that has been delivered in the mean time. I'd be really interested if people had suggestions for a better mechanism, or perhaps a way to have dovecot not create the new mail location automatically. --

3 2

[Dovecot] 2.1: virtual plugin and lsub
by e-frog 17 Nov '11

17 Nov '11

Hi Timo, I'm using the virtual plugin and have 2 mailboxes configured in the "virtual" namespace (dovecot -n attached). Using lsub with dovecot 2.0.15 leads to the following result: 1 lsub "" "virtual/*" * LSUB () "/" "virtual/Lists" * LSUB () "/" "virtual/unread" 1 OK Lsub completed. However with dovecot 2.1 (latest hg as of today) and the same config there is a 3rd mailbox "virtual" listed which doesn't exist: 1 lsub "" "virtual/*" * LSUB () "/" "virtual" * LSUB () "/" "virtual/Lists" * LSUB () "/" "virtual/unread" 1 OK Lsub completed. Thunderbird shows the "virtual" mailbox as selectable and not grayed out as with 2.0.15. Clicking on that mailbox gives an error message "Mailbox doesn't exist: virtual". Thanks, e-frog

2 3

[Dovecot] Performance-Tuning
by Peer Heinlein 17 Nov '11

17 Nov '11

Hi, I have > 11 TB hard used Mailstorage, saved als maildir in ext3 on HP EVA. I always wanted to make some mesurements about several influences to the performance (switch to ext4, switch to mdbox), but I never had enough time to do that. At the moment I *need* more speed, we have too much waitI/O on the system and I already used all other performance and tuning-tricks (separated cache, noatime, fsync and all that stuff). I have to change my setup, maybe somebody else here have hard facts: *) Is ext4 faster? How much faster? *) Is it faster because of the ext4 kernel-module (which can be used on ext3 to) or because of the ext4 filesystem layout? *) Is mdbox really faster? I'd like to have mdbox to have better performance in running my backup-processes. But does it bring some performance boosts to? Thanks for any hints an tricks, Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

13 25

[Dovecot] Port variable in LMTP userdb lookups?
by Mark Zealey 17 Nov '11

17 Nov '11

Hi all, I'm currently changing some systems to use the redirector service, which means that to get local deliveries going I need to get lmtp set up so it can be redirected as well. This is working fine, however we have a number of different ports running on our servers depending on which brand a customer is using. When the time comes to do the user look up, we use (port, user, domain) to do a unique database lookup which works fine for everything (proxied pop, imap, lmtp & straight pop, imap) but not straight lmtp - perhaps because it doesn't have a 2-stage login process unlike the pop/imap protocols. Looking at the SQL query we are issuing, the %a port variable is set to 0 even though the connection is coming in from TCP. Is there a way to change this? We are running dovecot 2.0.12 however looking through the changelogs I can't see this would be fixed in the newest version. Thanks, Mark

3 4

Re: [Dovecot] Please advise on very fast search
by Alexander Chekalin 17 Nov '11

17 Nov '11

Thanks, Robert, will take a look at. What I'm afraid for is how database storage should be planned (storage, CPU, RAM, scaling when will be over-filled). When dealing with files (I'm using maildir), it is much easy to understand and to fix just about everything. Adding database involves tune it up too, and I'll have more points of 'tune it a bit' In fact work with Dovecot is pretty nice, but I think I can tune it to work faster. I now run it on FreeBSD (on UFS2), maybe I should change OS + FS, but need to test (really hope ZFS disks on SAS drives will help; still find no benchmarks on such a setup). Will also try to use full text search, but afraid of index size (and I need no search on body, just on headers). Anyway thank your for pointing me in right directions! Yours, Alexander

3 16

[Dovecot] Getting started with sieve and conversion from procmail
by Alex 17 Nov '11

17 Nov '11

Hi, I have a fedora15 system with dovecot-v2.0.15, dovecot-pigeonhole and and amavisd-new and would like to implement it on my system using postfix. I've read the basic wiki documentation, but I really can't figure out the proper starting point in my case. I've enabled "protocol lda" in 15-lda.conf and added "sieve" to the list of mail_plugins. I'm trying to adapt postfix to use deliver as its LDA for multiple virtual domains. I've added the following to master.cf: dovecot unix - n n - - pipe flags=DRhu user=dovecot:dovecot argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} -a "${RECIPIENT}" Is that the proper format? Is it okay to use the dovecot user here, or should I create a new user? What permissions does this user need to possess? I've added the following to main.cf: dovecot_destination_recipient_limit = 1 virtual_transport = dovecot I have a number of procmail scripts and I've converted them to sieve, but they didn't convert very well. Can someone show me how to convert the following: :0 { :0 fhW | /home/alex/bin/process-mail.pl } The script skipped right over that. I'm also trying to convert the following: :0 * (RCVD_IN_DNSWL_HI|RCVD_IN_DNSWL_LOW|RCVD_IN_HOSTKARMA_W) * !USER_IN_WHITELIST * !BAYES_00 * !URIBL_ * !KHOP_RCVD_UNTRUST * !RCVD_IN_DNSWL_MED * !SPF_SOFTFAIL * SPF_HELO_PASS * SPF_PASS { LOG="DNSWL: " :0: whitelist/dnswl } The script only produced the following: if true { if true { if true { if true { if true { if true { if true { if true { if true { if true { fileinto "{"; fileinto " LOG="DNSWL: ""; fileinto " :0:"; fileinto " whitelist/dnswl"; fileinto "}"; } Any ideas greatly appreciated. Thanks, Alex

4 22

[Dovecot] v2.0.16 released
by Timo Sirainen 17 Nov '11

17 Nov '11

http://dovecot.org/releases/2.0/dovecot-2.0.16.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.16.tar.gz.sig I only now noticed that the VSZ limits weren't being enforced with earlier v2.0.x releases (or they were set 1024 times too high). So if a Dovecot process was leaking memory, it wasn't being killed by kernel. Now that this enforcing is done, some installations will probably start seeing errors about reaching these limits in normal operation. The default_vsz_limit is 256 MB. You may want to increase it in larger installations to 1 GB just in case. Besides the changes listed below, a lot of smaller fixes were done. v2.0.16 2011-11-17 Timo Sirainen <tss(a)iki.fi> * VSZ limits weren't being enforced for any processes. On server with large mailboxes you may now see errors about it if the limits aren't high enough. To fix them, either increase individual service { vsz_limit } values or simply increase the default_vsz_limit setting. * Proxying: If using ssl=yes or starttls=yes with a hostname (not IP) as proxy destination, require that the certificate matches the given hostname. * LMTP: Changed default client_limit to 1. This should improve LMTP throughput with default settings. * dsync: Quota is no longer enforced (i.e. dsync can't fail because user is over quota). + Added "auto" mail storage driver, which can be used to autodetect mailbox location and format. This behavior is already the default for empty mail_location setting, so this change is mainly useful for shared namespace's location setting. + checkpassword: Export all auth %variables to AUTH_* environment.

1 0

[Dovecot] Bus factor of dovecot / GIT
by Thomas Koch 17 Nov '11

17 Nov '11

Hi, somebody from the kolab groupware project recently explained me that the Bus- Factor[1] of around 1 would be one of their primary reasons not to use Dovecot and stick with Cyrus. What do you think about that? Is the bus factor much higher then 1? [1] http://en.wikipedia.org/wiki/Bus_factor Somehow related: Since the free software world[2] slowly converges towards GIT as the "one and only" VCS, have you thought about a switch? It's much more likely that somebody checks out your code, looks into it and provides patches if the VCS is already installed. [2] Android, Debian, Drupal, Eclipse, Fedora, Gnome, KDE, Linux Kernel, Perl, PHP (ongoing), PostgreSQL, Qt, Ruby on Rails, X.org (freedesktop.org) Best regards, Thomas Koch, http://www.koch.ro

6 6

[Dovecot] submission_host problem
by Bambero 16 Nov '11

16 Nov '11

Hello, I configured dovecot to use submission smtp host becouse of chroot. submission_host = 127.0.0.1 Unfortunatelly: Nov 12 05:11:15 myhost exim[23366]: 2011-11-12 05:11:15 SMTP protocol synchronization error (next input sent too soon: pipelining was not advertised): rejected "EHLO myhost" H=localhost [127.0.0.1] next input="MAIL FROM:<root@myhost>\\r\\n" Nov 12 05:11:15 myhost exim[23366]: 2011-11-12 05:11:15 SMTP protocol synchronization error (next input sent too soon: pipelining was not advertised): rejected "EHLO myhost" H=localhost [127.0.0.1] next input="MAIL FROM:<root@myhost>\\r\\n" Nov 12 05:11:15 myhost dovecot: lda(alias(a)apisoft.pl): Error: smtp(127.0.0.1): RCPT TO failed: 554 SMTP synchronization error Nov 12 05:11:15 myhost dovecot: lda(alias(a)apisoft.pl): Error: sieve: msgid=<E1RP4uv-00043S-L7@myhost>: failed to redirect message to <bambero(a)gmail.com> (refer to server log for more information) Does anyone know how to fix it ? Regards, Bambero

4 10

[Dovecot] Glued-together private namespaces
by Mark Moseley 16 Nov '11

16 Nov '11

I've been goofing with this all day with 2.0.15 and I'm starting to realize that either a) I'm not that smart, b) it's been so long since I messed with namespaces that I'm going about it completely wrong, or c) it's just not possible. I haven't posted 'doveconf -n' and other details, because mainly I'm just looking for 'yes, this is possible' or 'no, you're smoking crack' before posting further details. At this point, it's all maildir and moving to mdbox, while highly desirable in the future, is not possible in the near- to medium-term. I'm trying to glue a namespace underneath INBOX: namespace INBOX { type = private separator = . prefix = INBOX. # Yes, this used to be on Courier inbox = yes list = yes hidden = no subscriptions = yes location = maildir:~/Maildir } namespace archive { type = private separator = . prefix = INBOX.Archives. inbox = no list = children subscriptions = yes location = maildir:~/Maildir-Archive } I've tried putting namespace archive's 'prefix' as just "Archives", but Tbird doesn't seem to see this namespace, regardless of how much I futz with the imap settings in tbird. With the above setup, it actually seems to work correctly (provided ~/Maildir-Archive exists), though I'm sure a big gotcha is waiting in the wings. I can move messages around, create subfolders, subscribe to folders in ~/Maildir-Archive). The only thing I can't seem to get working is quotas. With my password_query like: password_query = ... CONCAT( '*:bytes=', "1M" ) AS 'userdb_quota_rule', \ CONCAT( '*:messages=10' ) AS 'userdb_quota_rule2', \ CONCAT( 'INBOX.Archives:bytes=+4900M' ) AS 'userdb_quota_rule3', \ CONCAT( 'INBOX.Archives:messages=+3900' ) AS 'userdb_quota_rule4' ... only the default quota seems to be in place for any subfolder of INBOX.Archives and for INBOX.Archives itself, i.e. *:bytes still applies to INBOX.Archives. The debug log show that: Debug: Quota root: name=User quota backend=maildir args= Debug: Quota rule: root=User quota mailbox=* bytes=1048576 messages=0 Debug: Quota rule: root=User quota mailbox=* bytes=1048576 messages=10 Debug: Quota rule: root=User quota mailbox=INBOX.Archives bytes=+5138022400 messages=0 Debug: Quota rule: root=User quota mailbox=INBOX.Archives bytes=+5138022400 messages=+3900 These are wildly stupid quotas but they're just there to test. With INBOX already at capacity (byte-wise; only set to a meg), copying large messages inside INBOX.Archives fails (only copying a 800k message but the quota should be 5gig now). Again, before I post configs, I'm just curious if what I'm trying to do isn't remotely possible, or that I'm approaching this entirely wrongly. Thanks!

2 6

Re: [Dovecot] Seg fault in dovecot/auth 2.0.15
by Timo Sirainen 16 Nov '11

16 Nov '11

Your message was discarded by mailman, probably because it was html-only. Anyway: On Wed, 2011-11-16 at 13:15 -0500, Mark Goldey wrote: > (gdb) p *auth_request->userdb->userdb->iface > $2 = {name = 0x807023e "vpopmail", preinit = 0x8065d60 > <vpopmail_preinit>, init = 0, deinit = 0, > lookup = 0x8066010 <vpopmail_lookup>, iterate_init = 0, iterate_next > = 0, iterate_deinit = 0} OK, so "auth_request->userdb->userdb->iface->lookup" should call vpopmail_lookup(), it's not NULL as this says: > > (gdb) bt full > > #0 0x00000000 in ?? () So something's going strangely wrong. Maybe gcc optimizations cause this and the real problem happens later. Try compiling auth process with optimizations: - Remove -O2 from src/auth/Makefile - cd src/auth ; make clean ; make ; make install Is the backtrace different?

1 0

[Dovecot] Missing public folder
by komodo 16 Nov '11

16 Nov '11

Hi i am using dovecot 2.0.13 and i can't see public folder in my mail client. But what is strange, it was working after instalation, and i don't know when it dissapeared. Maybe after some upgrade ? When i enable debug, then i can see in my log that folder exists and no errors. Please where should i find the problem ? Thanks Martin Here is log Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: Namespace : type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: maildir++: root=/home/komodo/Maildir, index=, control=, inbox=/home/komodo/Maildir Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: Namespace : type=public, prefix=spam_learner., sep=., inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/shared/Maildir Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: maildir++: root=/home/shared/Maildir, index=, control=, inbox= Here is my conf # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab037.1 x86_64 CentOS release 5.5 (Final) default_client_limit = 1300 disable_plaintext_auth = no hostname = somehost.com mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace { location = maildir:/home/shared/Maildir prefix = spam_learner. separator = . subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.d/ sieve_dir = ~/sieve } protocols = imap pop3 sieve sendmail_path = /usr/sbin/sendmail.exim service imap-login { process_limit = 1000 process_min_avail = 30 } ssl_cert = </etc/pki/dovecot/certs/host.pem ssl_key = </etc/pki/dovecot/private/host.pem userdb { driver = prefetch } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 100 }

2 1

Re: [Dovecot] Please advise on very fast search
by Stan Hoeppner 16 Nov '11

16 Nov '11

On 11/16/2011 12:15 AM, Alexander Chekalin wrote: > Hello, Stan, > >> This is why I recommended mbox in the first place. If your only writes >> to these mailbox files are appends of new messages, mbox is the best >> format by far. It's faster at appending than any other format, and it's >> faster for searching than any other. > > I now seriously consider to use mdbox due to its nice self-regulation. > After all it I believe mdbox should do file compression on its own, no > cron scripts required. mbox and mdbox each has strengths and weaknesses. mbox will compress with a higher ratio than mdbox. You already have a nightly script that moves all mail from the day into a new file. Piping that through gzip or bzip2 is a no brainer. It'll add one line to your existing script, if that. Dovecot will decompress the file transparently when you access it via IMAP. And again since it's a single file searching it is much faster. With mbox you will have a single file for each day of emails. This seems ideal for archive purposes, one file per day. mdbox does fully transparent de/compression which is nice. The downside is that Dovecot does dbox compression on a per email basis, not a per file basis. So your compression ratio will be much less than with mbox, especially with bzip2 which works best on files over 900KB in size. Most emails are less than 8KB. Using mdbox will yield multiple files per day of emails instead of just one. Either format is much better than maildir for archiving. >> It's an archive. You're not going to use maildir so you don't need >> random IOPS performance. Thus RAID5/6 are a much better fit for an >> archive as you get better read performance, with more than adequate >> write performance, and you use less disks. And as this is an archive, >> you don't need real time automatic/transparent compression. Thus I >> recommend something like: >> >> 1. Debian 6 w/linux-image-2.6.39-bpo.2-amd64 or a custom rolled >> 2.6.39 or later kernel >> 2. hardware RAID5 w/large (2TB) SATA disks, 512B native sectors >> e.g. MegaRAID SAS 9261-8i, 4 Seagate Constellation ES ST2000NM0011 >> Specify a strip size of 256KB for the array >> Perma set /sys/block/sdX/read_ahead_kb to 512 so you're reading >> ahead 1024 sectors at a time instead of the default of 256. This >> will speed up your searches quite a bit. >> 3. XFS filesystem on the RAID device, created with mkfs.xfs defaults >> 4. mbox w/zlib plugin. Compress daily files each night with a script >> 5. You don't need LVM with a good RAID card (or with mdraid). This >> controller can expand the RAID5 up to 8 drives (up to 32 drives max >> using SAS expanders) > > We are considering to get HP DL180G6 server for 8 or 14 drives bays The P410 tops out at 8 drives, so get the 8 drive model. Start with 4 x 2TB drives in RAID5. Add 4 more drives when you need the capacity, and when drive prices are back down to normal (see below). http://h18004.www1.hp.com/products/quickspecs/13248_na/13248_na.html > (base model price is somewhat equal, but additional drives adds up cost) Especially right now in 2011. Flooding in Thailand, where 25% of the world's drives are produced, has doubled the cost of all hard drives worldwide. Now is a horrible time to buy spinning drives. I've read it may be 12 months before prices start coming back down... > with HP Smart Array P410 RAID controller (some servers are equipped with > this controller by default) with 256 Mb battery-backed cache, but I'll > check your suggestions! The P410 should be fine for a dedicated archive server. > What memory size should I plan in the server? You're talking about AMD64 > OS image, and 64-bit software are like to consume more memory that > 32-bit, so looks like your talking about pretty huge RAM, and I don't > believe it's necessary, or maybe I'm wrong? The memory footprint of 64bit binaries is nothing to worry about. The additional amount consumed is more than offset by the performance gained with direct access to RAM above 4GB compared to the performance of PAE. Keep in mind that 90% of your memory will be eaten by Linux buffer cache. Your binaries will account for less than 5% of your RAM consumption. If I understand correctly how you will use this archive server, then 8GB should be plenty. 8GB is standard on the 8 drive DL180 G6. http://h18004.www1.hp.com/products/quickspecs/13248_na/13248_na.html > Problem is I have no experience with XFS and not sure I can tune it in > the best way, so I'll go with mkfs.xfs defaults, I think. With only 4 drives and using a P410 w/cache and RAID5, doing manual XFS tuning isn't necessary for good performance, especially for an archive application which is data heavy, not metadata heavy. Setting sunit/swidth to match the RAID5 layout may increase performance slightly due to stripe aligned writes, but not enough that I'd worry about it. Just use the mkfs.xfs defaults. If you get the BBWC for the P410, enable the controller write cache, and mount XFS with 'nobarrier'. This will increase write performance quite a bit as fsyncs will complete instantly. > Hope we'll see Dovecot 2.1.x stable soon, as I'd like to use fts plugins > and 2.1 handle that much better, but I don't like the idea of use > unstable in production. Me neither. Speaking of archive/search, did you take look at Enkive yet? http://www.enkive.org/ > Thank you for taking your time on my case, You're welcome Alexander. -- Stan P.S. You may wish to implement dnswl.org ;)

1 0

[Dovecot] Chroot
by Bambero 16 Nov '11

16 Nov '11

Hello, I have successfully setup dovecot with chroot but there are two things yet 1. submission_host problem (I posted message 2 days ago) 2. Problem with acl's and sharing: all maildirs are located in: /var/mail/jdoe(a)example.com/Maildir so: mail_chroot=/var/mail I setup acls with: 10-mail.conf ... namespace { type = private separator = / prefix =. inbox = yes hidden = no list = yes subscriptions = yes } namespace { type = shared separator = / prefix = shared/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = yes list = yes } ... 90-acl.conf ... plugin { acl = vfile:cache_secs=5 } plugin { acl_shared_dict = file:/%i.db } ... Setting acl is no problem there are dovecot-acl dovecot-acl-list in Maildir. and dictionary /var/mail/xxx.db contains list od shares I can also see shared folder in my IMAP client but when trying to subscribe i got error: Error: userdb lookup: connect(/var/dovecot/auth-userdb) failed: No such file or directory Error: Namespace 'shared/': Could not lookup home for user jdoe(a)example.com /var/dovecot/auth-userdb is not accessible because chroot. But why userdb is necessary in this case ? I hope there is a solution without disabling chroot. Below my basic configuration. Regards, Bambero # 2.0.13: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.0 i386 auth_mechanisms = plain login digest-md5 cram-md5 apop default_internal_user = _dovecot default_login_user = _dovenull first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 10000 last_valid_uid = 10000 mail_chroot = /var/mail mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mbox_write_locks = fcntl mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_path = /etc/sieve/default.sieve } protocols = imap pop3 sieve sieve service auth { unix_listener auth-client { mode = 0660 user = _exim } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = /etc/ssl/ca-bundle.crt ssl_cert = </etc/ssl/mycert.crt ssl_key = </etc/ssl/private/mycert.key submission_host = 127.0.0.1 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } valid_chroot_dirs = /var/mail protocol lda { mail_plugins = sieve quota autocreate } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_plugins = quota imap_quota autocreate } protocol pop3 { mail_plugins = quota imap_quota autocreate pop3_client_workarounds = outlook-no-nuls oe-ns-eoh }

2 5

[Dovecot] How to do SEARCH with doveadm
by Alexander Chekalin 16 Nov '11

16 Nov '11

Hello, I'm still playing with search messages from/to specified email address. In fact I need to do that to take such messages and copy it to another mailbox (so that box will contain 'Search results' and will be available to examine by any IMAP client). I've put my mailings in mdbox storage format, and use latest 2.1 beta version of Dovecot to be sure I use the freshest approach in search (and plan to use Solr FTS as well). The setup is each, I use passdb { driver = passwd-file args = /etc/dovecot/auth/%Lu } and userdb { driver = static args = uid=dovecot gid=dovecot home=/MAIL/mail_storage/%Lu } and put user:password pair in file named after my mailbox in /etc/dovecot/auth/ (let's name it test(a)domain.com) and the messages are at /MAIL/mail_storage/test(a)domain.com/... While I use it from IMAP client it works nicely. Ok, I put somewhat 5800 messages in INBOX, and IMAP pretty fast in working with it. But as I try to use doveadm to search for messages I need I simple lost my way (doing it under root): # doveadm search ALL doveadm(root): Error: chdir(/root/) failed: Permission denied (euid=104(dovecot) egid=106(dovecot) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(root): Error: chdir(/root) failed: Permission denied Whatever cli command I try doveadv try to find messages in /root dispute it is at /MAIL/mail_storage/%Lu. How can I make doveadv use right mail path? In fact, I don't want to use system users to work with mail, it'll be simple virtual mail user, so it is pointless to set up special system user to do that search. I think I lost myself in general concept of how Dovecot handles users and credentials, so please please please push me in right direction! Thank you, Alexander

1 0

[Dovecot] Creating a password_scheme
by Jordi Llonch 16 Nov '11

16 Nov '11

Hello, I am trying to develop a password_scheme for the Django passwords. After building and installing the module in $module_dir/auth/password/djangopass.so, also tried libdjangopass.so and libdjangopass_plugin.so, Dovecot does not recognize the scheme: doveadm pw -l CRYPT MD5 MD5-CRYPT SHA SHA1 SHA256 SHA512 SMD5 SSHA SSHA256 SSHA512 PLAIN CLEARTEXT CRAM-MD5 HMAC-MD5 DIGEST-MD5 PLAIN-MD4 PLAIN-MD5 LDAP-MD5 LANMAN NTLM OTP SKEY RPA SHA256-CRYPT SHA512-CRYPT Please can you help me? Thanks -- Jordi Llonch # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.40.3-0.fc15.x86_64 x86_64 Fedora release 15 (Lovelock) ext4 ----------password-scheme-django.c-------------------------- #include <stdio.h> #include <ctype.h> #include <stdlib.h> #include <string.h> #include <dovecot/lib.h> #include <dovecot/hex-binary.h> #include <dovecot/password-scheme.h> #define uchar unsigned char static bool djangopass_verify(const char *plaintext, const char *user, const unsigned char *raw_password, size_t size) { return TRUE; } void djangopass_generate(const char *plaintext, const char *user, const unsigned char **raw_password_r, size_t *size_r) { } struct password_scheme djangopass_scheme = { "DJANGO", PW_ENCODING_BASE64, 0, djangopass_verify, djangopass_generate }; struct module; void djangopass_init(struct module *module) { password_scheme_register(&djangopass_scheme); } void djangopass_deinit(void) { password_scheme_unregister(&djangopass_scheme); } ---------------------------------------------------------------------------

2 1

[Dovecot] setting namespaces using script-login environment in 2.0
by Alexander 'Leo' Bergolth 16 Nov '11

16 Nov '11

Hi! With dovecot 1.x, I was using a post-login script to dynamically add shared mailboxes using NAMESPACE_X.. environment variables, based on filesystem permissions: After login, the post-login script was executed with user permissions (mail_drop_priv_before_exec=yes). It added all subdirectories of "/var/spool/mail/Shared" as namespaces for which the user had write permissions. E.g.: NAMESPACE_2='maildir:/var/mail/Shared/spamrep:INDEX=~/Maildir/index/Shared/spamrep' NAMESPACE_2_PREFIX=Shared/spamrep/ NAMESPACE_2_SEP=/ NAMESPACE_2_TYPE=public NAMESPACE_2_LIST=yes See the attached post-pogin-script for details. After switching to 2.0.14 (using executable script-login -d...), the script actually gets executed but the namespace settings do not seem to be honored. Besides, I don't see any pre-set NAMESPACE_ environment variables anymore. Have environment based namespace settings been abandoned in 2.0? Does Dovecot 2.0 maybe provide a better way to only display those folders, for which the user has at least read permissions? (Unix-permission based) Thanks in advance, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

3 5

[Dovecot] Usage of director without LMTP
by Oliver Eales 16 Nov '11

16 Nov '11

Hello, we want to migrate our dovecot 1.2 installation to verison 2.0 and want to use the director feature of version 2. Currently we have a two tier archtiecture, with dovecot proxys and a mailstore togehter with indexes on NFS. (With the common problems of this setup...) For the final setup we want to utilize the director for all protocols (IMAP,POP,LMTP,SIEVE). During the transition phase we will not be able to use LMTP for mail delivery, but we are still stuck with deliver as LDA. So for mail delivery we will not have the fixed user/server assignment, but rather a random assignment. What NFS- and locking settings should be used on the backend servers in this case. And should i use different settings for the host the deliver is executed than the IMAP/POP3 hosts which are accessed through a director proxy. Thanks in advance, Oliver Eales

2 1

[Dovecot] Invalid "doveadm search" queries not rejected
by Peter Williams 16 Nov '11

16 Nov '11

Hello, I think I've encountered a bug in Dovecot 2.0.9 (as provided on CentOS 6). According to the doveadm-search-query(7) manual page, a "mailbox" specification can only come at the beginning of a search query. However, if I put a mailbox specification in the middle of a query, not only do I not get an error message, I get surprising results: $ doveadm search mailbox A |wc -l 6979 $ doveadm search mailbox B |wc -l 206 $ doveadm search mailbox A OR mailbox B |wc -l 42492 If it became possible to do boolean logic on mailbox queries, that'd be cool. But barring that, these invalid queries should be rejected. Relatedly, if I can only do simple mailbox filtering, does anyone know of a clever way to efficiently emulate more complex boolean logic? Please CC me on any replies as I'm not subscribed to the list. Thanks, Peter -- Peter Williams / peter(a)newton.cx

2 2

[Dovecot] Deleting a mailbox and all its children
by Micah Anderson 16 Nov '11

16 Nov '11

I'm looking at scripting a mechanism to delete a mailbox, which is easy with 'doveadm mailbox delete' -- however it gets complicated when there are children of arbitrary depth, for example, I may have this: restored.daily1.INBOX restored.daily1.Sent restored.daily1.Mystuff restored.daily1.Mystuff.foo I would like to delete the 'restored' mailbox and all its children (and unsubscribe the folders), but the 'doveadm mailbox delete' command wont delete any children. I'm surprised that there isn't a -r (recursive) option to 'doveadm mailbox delete', but perhaps I am missing the easier way to handle this? thanks for any ideas or suggestions! micah --

3 2

[Dovecot] Excessive imap-logins, never die
by Nick Edwards 16 Nov '11

16 Nov '11

Hiya, Today I note there are 38 imap-logins that seem to be stale on our staff imap server, they do not seem to die off, new imap-logins are created with new logins and exit accordingly. Now, these are from our monitoring software that runs on another server on our LAN. Our corporate link was taken down for 2 hours for urgent relocation of fibre (demolishing old adjoining building, and just in case, they needed to move it which we were glad about), so, this begs the question, why would imap-logins be there I guess in some sort of wait state, even with a still working internal DNS (internal view as well) the only difference is no actual internet connection in this time. A week ago when they first started to working and we lost internet for 45 minutes I also saw a few extra stale imap-logins, but after todays events, I decided this is a bigger issue that needs to be looked into, as dovecot required a restart to clear it all (I wasnt going to sit there killing individual PIDs all evening). Dovecot version 1.2.17, built from source

2 2

Re: [Dovecot] default Dovecot-LDA CHGRP/CHMOD
by Chris Young 15 Nov '11

15 Nov '11

I am familiar with this article http://wiki.dovecot.org/LDA#multipleuids I want to disable setuid-root, but I don't know the default group and permissions. sudo chgrp root /usr/libexec/dovecot/dovecot-lda sudo chmod 00750 /usr/libexec/dovecot/dovecot-lda but my delivery is still failing Nov 9 18:22:39 vl42 postfix/pipe[23039]: DEC54700B1: to=<user(a)domain.com>, orig_to=<user(a)domain.com>, relay=dovecot, delay=0.05, delays=0.04/0/0/0.01, dsn=4.3.0, status=deferred (temporary failure. Command output: pipe: fatal: pipe_command: execvp /usr/libexec/dovecot/dovecot-lda: Permission denied ) Thoughts? Thanks Chris

2 2

[Dovecot] Seg fault in dovecot/auth 2.0.15
by Mark Goldey 15 Nov '11

15 Nov '11

Folks: I've been running Dovecot 2.0.7 on a Qmail / Vpopmail installation built on Debian Squeeze, with no problems for about a year. Dovecot is used for IMAP/S auth only. Dovecot is built from source. I just upgraded to 2.0.15 but it segfaults whenever an IMAP auth is attempted, regardless of the user who tries to login, whether by webmail (Roundmail) Android phone (K-9 Mail) or iPad (Roundmail) I downgraded to 2.0.13 but the segfault persisted. Re-installed 2.0.7 and that cleared it right up. Here's the pertinent details from 2.0.15. Anything else I can provide? root@XXX:/# uname -a Linux XXX 2.6.32-5-686 #1 SMP Wed Jan 12 04:01:41 UTC 2011 i686 GNU/Linux root@XXX:/# dovecot -n # 2.0.15: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.3 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no first_valid_uid = XXXX last_valid_uid = XXXX log_path = /var/log/dovecot.log mail_debug = yes passdb { driver = vpopmail } protocols = imap service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_limit = 128 vsz_limit = 64 M } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = vpopmail } verbose_ssl = yes Here's a failed login transaction from /var/log/dovecot [snip -- 10 lines or so. The SSL handshake completes OK] Nov 15 14:08:43 auth: Debug: client in: AUTH 1 PLAIN service=imap secured lip=192.xxx.xxx.xxx rip=174.79.xxx.xxxlport=143 rport=55437 resp=XYXYXYXYXYXXYXYXYXYXYXYXYXYX== Nov 15 14:08:43 auth-worker: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Nov 15 14:08:43 auth-worker: Debug: vpopmail(user(a)mydomain.net,174.79.xxx.xxx): lookup user=user domain=domain.net Nov 15 14:08:43 auth: Debug: client out: OK 1 user=user(a)mydomain.net Nov 15 14:08:43 auth: Debug: master in: REQUEST 2710831105 686 1 XYXYXYXYXYXXYYXYXYX Nov 15 14:08:43 auth-worker: Debug: vpopmail(user(a)domain.net,174.79.xxx.xxx): lookup user=user domain=domain.net Nov 15 14:08:43 auth: Error: auth worker: Aborted request: Worker process died unexpectedly Nov 15 14:08:43 master: Error: service(auth-worker): child 690 killed with signal 11 (core dumped) Nov 15 14:08:43 auth: Debug: master out: FAIL 2710831105 Nov 15 14:08:43 imap: Error: Internal auth failure (client-pid=686 client-id=1) Nov 15 14:08:43 imap-login: Info: Internal login failure (pid=686 id=1) (auth failed, 1 attempts): user=<user(a)domain.net>, method=PLAIN, rip=174.79.xxx.xxx, lip=192.xxx.xxx.xxx, mpid=691, TLS Nov 15 14:08:43 imap-login: Warning: SSL alert: where=0x4008, ret=256: warning close notify [174.79.xxx.xxx] Nov 15 14:08:43 auth-worker: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth I ought to mention that /usr/local/lib/dovecot/auth is empty. Here's the backtrace: root@XXX:/# gdb /usr/local/libexec/dovecot/auth /usr/local/var/run/dovecot/core GNU gdb (GDB) 7.0.1-debian [snip] Reading symbols from /usr/local/libexec/dovecot/auth...done. warning: Can't read pathname for load map: Input/output error. Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/i686/cmov/libcrypt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libcrypt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libcrypt.so.1 Reading symbols from /home/vpopmail/lib/libvpopmail.so...(no debugging symbols found)...done. Loaded symbols for /home/vpopmail/lib/libvpopmail.so Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/librt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/librt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/librt.so.1 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/i686/cmov/libpthread-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libpthread.so.0 Reading symbols from /home/vpopmail/etc/vpopmail.authmodule...(no debugging symbols found)...done. Loaded symbols for /home/vpopmail/etc/vpopmail.authmodule Core was generated by `dovecot/auth -w'. Program terminated with signal 11, Segmentation fault. #0 0x00000000 in ?? () (gdb) bt full #0 0x00000000 in ?? () No symbol table info available. #1 0x08059890 in auth_worker_handle_user (client=0x82b34d0) at auth-worker-client.c:405 auth_request = 0x82b56e8 userdb_id = 1 #2 auth_worker_handle_line (client=0x82b34d0) at auth-worker-client.c:534 id = 2 #3 auth_worker_input (client=0x82b34d0) at auth-worker-client.c:614 _data_stack_cur_id = 3 line = <value optimized out> ret = 232 #4 0xb785f021 in io_loop_call_io (io=0x82b3688) at ioloop.c:384 ioloop = 0x82a6398 t_id = 2 #5 0xb78600d3 in io_loop_handler_run (ioloop=0x82a6398) at ioloop-epoll.c:213 ctx = 0x82b1f38 event = 0x82b1f78 list = 0x82b36b0 io = 0x829e2b0 tv = {tv_sec = 2147483, tv_usec = 0} msecs = 1 ret = 1 i = 0 j = 0 call = 192 #6 0xb785efa0 in io_loop_run (ioloop=0x82a6398) at ioloop.c:405 No locals. #7 0xb784abaa in master_service_run (service=0x82a62e8, callback=0x805c470 <worker_connected>) at master-service.c:481 No locals. #8 0x0805c828 in main (argc=2, argv=0x82a61c0) at main.c:298 c = <value optimized out> (gdb) --mhg

2 1

[Dovecot] Dovecot SASL on another machine
by Tobias Hachmer 15 Nov '11

15 Nov '11

Hello list, is there a way to use Dovecot SASL Authentication for submission on a different machine dovecot runs? e.g.: Dovecot machine <-> postfix machine(for submission) How can I authenticate my senders on a different physical machine against Dovecot SASL? Thanks, Tobias

3 6

[Dovecot] indexes permissions problem
by Mark Hanford 15 Nov '11

15 Nov '11

Hey all, I did a search but didn't find the answer to my problem, so here goes. I've got a centos 6 server running Dovecot 2.0.beta6 (3156315704ef). For legacy reasons (I'm moving mail from a Dovecot 1.1.1 and FreeBSD box with user home directories NFS mounted), my index files are setup to be in /u/indexes/ On the Dovecot 1.1.1 installation, the perms on the indexes directory is 777 with root:mail ownership. The same thing on the Dovecot 2 / Centos server results in a 'permission denied' error when Dovecot tries to create files. So, I guess my main question is, what perms and ownership should /u/indexes be set to? I've tried several different things before this cry for help... Thanks. Mark

2 1

[Dovecot] Limit the number of pop/imap requests
by wwl 15 Nov '11

15 Nov '11

Hello Group, is it possible to Limit the number of pop/imap requests to Dovecot? I read the Wiki and found max_mail_processes = 512 is this the way to limit this ? dovecot --version 1.2.15 Thanx for help Christian

2 1

[Dovecot] Dovecot 2.0.15 quota configuration with mbox
by David Ocana 15 Nov '11

15 Nov '11

Hello, I've been trying to set up dovecot 2.0.15, everything seems to work pretty well except for the quota feature. I would like to set a quota limit only for the Inbox folder. I configured two namespaces, according to some posts from Timo Sirainen (http://dovecot.org/list/dovecot/2006-July/014530.html) & (http://www.dovecot.org/list/dovecot/2011-January/056131.html) but I can't configure the quota plugin to act the way I pretend. Here's my namespace configuration: namespace { separator = / prefix = INBOX/ location = mbox:/var/empty:INBOX=/mail/%d/%n:INDEX=/var/dovecot/%d/%n inbox = yes hidden = yes } namespace { separator = / prefix = inbox = no location = mbox:/mail/%d/MAILBOXES/%n:INDEX=/var/dovecot/%d/%n } Quota config: plugin { quota = dirsize:User quota # I've tried with: quota_rule = INBOX:storage=819200K quota_rule = INBOX/*:storage=819200K quota_rule = INBOX/Inbox:storage=819200K # Works with: quota_rule = *:storage=819200K quota_rule = ?:storage=819200K (Same behavior as '*') } Using '*' and '?', is the only way I get it to work, but obviously, quota is calculated summing up all the mailbox folders. I don't know what else to change, any ideas? Is the two namespace configuration correct? Thanks in advance. David

2 3

[Dovecot] Migration From Courier Imap.
by Rajeev Sharma 15 Nov '11

15 Nov '11

Sir, I am using vpopmail,qmail along with courier-imap 4.0 i want to migrate from courier to dovecot but i have 100 shared folder under /home/vpopmail/domains/domain.com/Malidir and user shared them on the basis of rights assign. I am very much clear how to migrate from courier to dovecot but i am unable how to migrate shared folder and assign rights. Rajeev Sharma. -- Rajeev Sharma

2 1

[Dovecot] getenv() in plugin not working
by Trutwin, Joshua 15 Nov '11

15 Nov '11

Hi - new to the list, can't find much on this using google. I'm trying to setup the dovecot DRAC plugin as described here: http://wiki.dovecot.org/HowTo/PopBSMTPAndDovecot#DRAC DRAC is installed and running using this startup command: /usr/local/sbin/rpc.dracd -i -e 5 /etc/postfix/dracd.db I downloaded the drac.c file linked on the above URL: http://www.dovecot.org/patches/1.1/drac.c and built it using this command: gcc -Wall -W -shared -fPIC -DHAVE_CONFIG_H drac.c -I/usr/include/dovecot -L/usr/lib64/dovecot -o drac.so -ldrac Then I copied drac.so to /usr/lib64/dovecot (this is an x86_64 SL 6.1 system - dovecot 2.0.9) and modified my /etc/dovecot/conf.d/20-imap.conf file: mail_plugin_dir = /usr/lib64/dovecot mail_plugins = drac Restart dovecot and try to login and getting these messages for ANY login attempts: dovecot: imap-login: Login: user=<snip>, method=PLAIN, rip=<snip>, lip=<snip>, mpid=4018, TLS server dovecot: imap(<snip>: Error: DRAC: IP environment not given I traced the "IP environment not given" to the drac.c plugin file, and the code is pretty simple: void drac_init(void) { const char *ip_str; struct ip_addr ip; ip_str = getenv("IP"); if (ip_str == NULL) i_error("DRAC: IP environment not given"); Is there anything special that needs to be done for getenv("IP") to report the login IP? I tried to put getenv("RIP") for remote ip and even getenv("USER") as well but always get NULL. Is this API only for dovecot 1.x? If so is there a 2.0 equivalent? The rest of the plugin is very basic... I think this is the last step in getting this setup running. I'd have to have this one last piece force me to run that icky perl program instead. Thank you, Let me know if anything else is needed. Josh

3 3

[Dovecot] Question about pop3_reuse_xuidl
by Urban Loesch 15 Nov '11

15 Nov '11

Hi, we are in migration progress from Communigate Pro 5.0.x to Dovecot 2.0.15 with mdbox. We still migrated about 25.000 IMAP accounts from CGP to Dovecot. Also there were still added about 2000 new POP3 Accounts on Dovecot. Now we must migrate about 10.000 POP3 accounts from CGP to Dovecot. At the beginning of our migration we didn't set the "pop3_reuse_xuidl" configuration option to yes. Do you know what happens when we activate the "pop3_reuse_xuidl" option on our running dovecot? Will Dovecot change the uidl value for all existing mails which have set "X-UIDL" in its mailheader, or does Dovecot only change the uidl value for new received and still not downloaded mails? Many thanks and regards Urban Loesch

2 1

[Dovecot] XUIDL Migration problems
by Steve H 15 Nov '11

15 Nov '11

Hello All, I am new to Dovecot and the Dovecot mailing list. I am trying to migrate an existing Exim + qpopper - mbox (pop3 only) installation over to Exim + Dovecot using mdir (pop3 and imap) And am running into problems with preserving the XUIDL headers. I am running Dovecot 2.0.14 I have used the mb2md.pl script : http://dovecot.org/tools/mb2md.pl from this page http://wiki2.dovecot.org/Migration/MailFormat to migrate and import the mboxes And have the following pop3 uidl settings in my configuration . pop3_reuse_xuidl = yes pop3_save_uidl = yes protocols = imap pop3 service imap-login { inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } protocol pop3 { pop3_reuse_xuidl = yes pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } The problem specifically is that when I test the migration and import a mailbox, I am able to connect via IMAP using Thunderbird and Outlook 2007 and the Read / Unread status is preserved. However when I connect via POP3 the Read/Unread status is not preserved. I am probably missing something simple, but have been unable to find anything that seems relevant on the Dovecot wiki or searching the mailing lists. Any suggestions would be appreciated. Regards, Steven Holloway IT Technical Consultant I.T. Basecamp P/L [http://www.itbasecamp.com.au/signature.gif]<http://www.itbasecamp.com.au/> Address: Office 1 Level 1/50 Owen St Huskisson NSW 2540 Phone: +61 2 44418555 ext 308 Fax: +61 2 44418551 Web: http://www.itbasecamp.com.au<http://www.itbasecamp.com.au/> Subscribe to our newsletter! Visit: IT Basecamp <http://www.itbasecamp.com.au/component/option,com_acajoom/Itemid,99999999/a…> to manage your subscription.

2 2

[Dovecot] patch for UID 0 problem
by Kai Arif 15 Nov '11

15 Nov '11

Hi all, attached you'll find a patch for cmd-thread.c which addresses a problem with certain clients in conjunction with the use of the UID THREAD REFS command: TAG5 UID THREAD REFS us-ascii SINCE 14-May-2011 * THREAD (0)(246)(247)(248)(249)(250)(252)(253)(254)(255)(256)(257)(258)(259)(260)(261)(262)(263)(264)(265)(266)(267)(268) TAG5 OK Thread completed. The first UID delivered (0) is invalid, some clients - @mail for instance - then try to fetch the invalid UID 0 subsequently and run into problems. The patch actually disables the return of (0) and seems to work for us. Please review and - if OK - incorporate it in the next version. Best Regards Kai -- Kai Arif - System Administrator Inter.net Germany GmbH Knesebeckstraße 59-61 10719 Berlin Germany Fon +49 30 25430 0 Fax +49 30 25430 499 arif(a)team.de.inter.net www.de.inter.net Legal-Information: Inter.net Germany GmbH, HRB #79136, Amtsgericht Berlin Charlottenburg, UST-IdNr:: DE 813 165 159 FA für Körperschaften I Berlin, Geschäftsführer: Jörn Lubkoll Zuständige Regulierungsbehörde: Bundesnetzagentur Chemnitz, Liselotte-Herrmann-Str. 20a, 09127 Chemnitz, Registriernummer: 06/164

2 1

[Dovecot] Managing public folder ACL files
by Keith Edmunds 14 Nov '11

14 Nov '11

We have a customer with a large public folder hierarchy. They occasionally make requests to have the public folder ACLs changed; for example: "please give user X access to all public folders" (that's nearly 1700 folders). Worse: "please give user Y access to all sales folders" (there are 1450 sales folders). The problem is that there are (naturally) spaces in the folder names, which makes command line manipulation challenging. We've ended up with some astonishingly hacky Python scripts that enter each folder starting with (for example) ".sales" and replacing the dovecot-acl file to try to fulfil the above requests. One day our script are going to get it wrong, or requests will become more complex ("give X access all sales/CustA folders, Y access to all sales/CustB folders, and Z access to all sales folders). There must be a Better Way. How do others manage divergent ACLs within large public folder hierarchies? Thanks, Keith

5 4

[Dovecot] [re] patching dovecot for managesieve/sieve
by Scott Lewis 14 Nov '11

14 Nov '11

My apologies for the repost yesterday; it was not intentional. I was attempting to post a followup from my mobile, when something went awry with the editing options on my phone. Anyway.. I have managed to download and compile my own patched dovecot/dovecot-sieve/dovecot-managesieve modules from scratch, with Thanks to this page hardc0l2e.wordpress.com/2010/02/26/managesieve-with-dovecot-on-centos-5-4/ But when I run http://mydomain.com/src/configtest.php , I am still getting the following rather non-descriptive error: "I could not determine the capabilities for Sieve Mail Filtering. Perhaps connectivity with ManageSieve server (if backend=ManageSieve) is bad?" Where else can I look to resolve this? should managesieve show up as its own /etc/init.d service? Or does dovecot simply control it? How can I confirm that deliver is being used as my LDA? Thanks again, Scott

2 1

[Dovecot] Restoring Mails from Backup Archive
by Andreas Cieslak 14 Nov '11

14 Nov '11

Hi List, i am trying to restore mails from an backup-archive which was made with rsnapshot. All the mails in the archive look similar like the following: -rw------- 2 1014 1015 3308 8. Aug 13:42 1312803768.V809I266a00aM505178.server:2,ST Now I copy the files from the archive into the Maildir/cur directory of the user. Then I set the permissions etc. and log in with the user account via Squirrelmail. The restored mails aren't in the INBOX, and when I go into the Maildir/cur dir of the user, the restored mails are gone. Possibly deleted after the login. Had anyone some similar experiences ? Any hints ? Kind regards Andreas

2 3

[Dovecot] metadata plugin problems
by Georg Martius 13 Nov '11

13 Nov '11

Hi, I have trouble with the metadata plugin. I compiled dovecot 2.0.15 from source and also the plugin [2] separately. I work on debian/lenny. I had some trouble compiling it (autoconf somehow didn't insert the DOVECOT_IMAP_INCLUDE variable, I have not idea why) Anyway, I did as described in [1]. Do I have to create: the file /var/lib/dovecot/shared-metadata ? The server starts without errors, but I get for instance the following error message: "Failed to write some annotations for 'Contacts' on the IMAP server. SetMetaData failed, server replied: A000076 NO Parsing entry failed" from my KMail. How can I test that the plugin is actually active and working? Any help would be appreciated. Regards, Georg [1]http://www.mail-archive.com/dovecot@dovecot.org/msg38887.html [2] http://hg.dovecot.org/dovecot-metadata-plugin

1 0

[Dovecot] Dovecot v2.0.13 unix_listeners
by Matthew Brown 13 Nov '11

13 Nov '11

Could somebody be able to explain to me what the various unix_listeners do in the Dovecot 2.x configuration (specifically in 10-master.conf). Currently, for postfix to use for local delivery, I have: service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } and for auth I have: service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { mode = 0666 user = vmail } } So what does each one specifically do? Also, does somebody know of a resource that can explain the mode setting? I couldn't seem to find anything on the wiki.. Sorry if these questions seem simple, Im still trying to get a grips with dovecots workings. MDA: Dovecot v2.0.13 MTA: SMTP User & Virtual Domain Management: MySQL Cheers, Matthew

2 1

[Dovecot] TLS Authentication Confusion
by Carlos Mennens 11 Nov '11

11 Nov '11

I asked a user today to make sure his incoming and outgoing email was using TLS. He told me it wasn't possible because my Dovecot / Postfix daemons were only listening on TCP 25 & 143 according to a port scan he did. He told me the only way I could enable encrypted secure sessions between the client & server is to enable port 993 (IMAPs). I told him that TLS is supported on my mail server over the default ports TCP 25 / 143 and that many consider IMAPs to be legacy. I sent him a telnet session of my PC communicating with my server & it shows TLS is available. I just wanted to be sure I was correct with the information above or am I completely wrong and I do indeed need TCP port 993? I know this is the Dovecot mailing list but since Dovecot and Postfix both use and support TLS in their configuration files, I figured I would ask here for your help! carloss@pc1:~$ telnet mail.holyghost.org 25 Trying 192.168.4.100... Connected to mail.holyghost.org. Escape character is '^]'. 220 mail.holyghost.org ESMTP Postfix EHLO pc1.holyghost.org 250-mail.holyghost.org 250-PIPELINING 250-SIZE 20480000 250-VRFY 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN Below is a snip from my mail logs showing TLS: Nov 9 10:26:39 mail dovecot: imap-login: Login: user=<carlos>, method=PLAIN, rip=::ffff:192.168.4.100, lip=::ffff:192.168.4.100, TLS The above snip from my log means that I'm connecting to Dovecot via TLS, correct?

8 7

[Dovecot] Restarting dovecot periodically fails with "Socket already exists: /var/run/dovecot/anvil"
by James Page 11 Nov '11

11 Nov '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hello restarting dovecot regularly fails with version 2.0.13 on Ubuntu 11.10 due to a running child process exiting after the main dovecot process. Oct 13 15:04:58 ubuntu dovecot: master: Error: service(anvil): Socket already exists: /var/run/dovecot/anvil Oct 13 15:04:58 ubuntu dovecot: master: Error: service(anvil): Socket already exists: /var/run/dovecot/anvil-auth-penalty Oct 13 15:04:58 ubuntu dovecot: master: Fatal: Failed to start listeners Oct 13 15:04:58 ubuntu kernel: [11132.825253] init: dovecot main process (8668) terminated with status 89 The dovecot/anvil process appears to be the cause of the problem (snapshot of running dovecot processes just after main dovecot process stops): root 8418 8080 0 15:02 pts/0 00:00:00 stop dovecot root 8419 1 0 15:02 ? 00:00:00 dovecot/anvil root 8422 8420 0 15:02 ? 00:00:00 grep dovecot This is an Ubuntu specific issue as we use upstart to manage dovecot which monitors the status of the main dovecot process; the Debian init script appears to make provision for this happening. I can work around this in the upstart configuration but it does look like a potential bug in the sub-process handling in dovecot. Any help much appreciated - please feel free to comment on https://bugs.launchpad.net/ubuntu/+source/dovecot/+bug/873390 as well. Regards - -- James Page Ubuntu Core Developer - ----------------------------------- dovecot -n # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 3.0.0-12-generic-pae i686 Ubuntu 11.10 mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQIcBAEBCAAGBQJOlwAJAAoJEL/srsug59jD1e4QAIB0/OhBhgr7HYqJNh3d1f69 8vGl6LSb2jjJb6bI+GX8QRHDDHXs6g3RadpHTEnDngJPLRPJxnnmr/mqcG+sAeYa 92shRyWnZQFEHJkl9hE1t1OS7skpLezWgSl6nOtzkRxm3yB0+w81PyQZVH2QArKf dATww3t0hMd3ybPEJnZwSlIQ/82i79qd8RZd1orERdIKN1wIyhb2uOi1XXBvGHZo hZKhO1sv3vz1RLpJXeWIVUNK8RQHJcvAOdqvTeT7kzx1gdxy3ycr7WOTUFY3Nc83 SYFyV9/miSNc45n+eDnsoknwggn0JWMkMA1jzRQz9OGCWFkJVFIuOE9jwJcFP6HY +8OnWwgdu5qNQ6nrn4+M1dB1MrFV5aFQmSuXsuAFXkCYywajdVhNyTkC8wERUBf1 NMv4PQRP0tA/UOOy9qNnNf9y3kQ1ItJ5ZhBTOO5WctnowYHDTWtnoxD7m0aEM1rA NH1TFolUgeiT6B9xFcreq42qEVYItKV60o2gv8fMDXwtkSjfDfJ2/88/45dcTOuK t+qUZnpI+AgCak7AfYShj1SjYN80BbpPpQ0WtG6MObXBZZl84paNpAUibUfN0tPy cEscYqUhkkptbfenJe3ldz0S2AhlrDTFk3cWGKwwlKY+29vBsoZtbgIamgrOKLX9 AbdvqFx8gnYe5af1k3eL =6Mfk -----END PGP SIGNATURE-----

2 2