May 2013 - dovecot - dovecot.org

[Dovecot] post-login script and original remote ip in proxy mode
by Ibrahim Harrani 13 Jun '13

13 Jun '13

Hi, I am running dovecot on 3 qmail-ldap server backend. dovecot configured to use auth_pop3 wrapper for authentication. Users logins to the qmail-ldap pop3&imap pools randomly. If a user is mailhost is not the connected server, dovecot proxies the connection to the user mailhost. In this case, I can not get the original client IP address via post-logins script on user host. I see only the first connected server IP as $IP environment. Any idea to get original client IP in this setup with postlogin scripts? Thanks

2 1

[Dovecot] Question about directory hash function.
by Evgeny Basov 13 Jun '13

13 Jun '13

Hello, Timo. I have a question about %H in http://wiki2.dovecot.org/Variables : what the hash function uses for calculations and how to get this value manually? This is need for bypass way getting home directory. With best regards, Evgeny Basov.

2 1

[Dovecot] v2.2.0 released
by Timo Sirainen 12 Jun '13

12 Jun '13

http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig Everything now seems to be stable and working in v2.2, so I can finally move onto developing great new interesting features for v2.3. :) My company has also launched a web shop where you can buy various products. One of them is cheap access to Dovecot enterprise edition repositories, which are basically same as regular Dovecot releases, except they are kept patched with the latest important bugfixes. We currently have releases for RHEL/CentOS 5 and 6, Debian Squeeze and Ubuntu 12.04 LTS. By buying Dovecot-EE you'll also get a 30 day demo license for object storages, if you want to try it out. http://shop.dovecot.fi/ * When creating home directories, the permissions are copied from the parent directory if it has setgid-bit set. For full details, see http://wiki2.dovecot.org/SharedMailboxes/Permissions * "doveadm auth" command was renamed to "doveadm auth test" * IMAP: ID command now advertises server name as Dovecot by default. It was already trivial to guess this from command replies. * dovecot.index.cache files can be safely accessed only by v2.1.11+. Older versions may think they're corrupted and delete them. * LDA/LMTP: If saving a mail brings user from under quota to over quota, allow it based on quota_grace setting (default: 10% above quota limit). * pop3_lock_session=yes now uses a POP3-only dovecot-pop3-session.lock file instead of actually locking the mailbox (and causing IMAP/LDA/LMTP to wait for the POP3 session to close). * mail_shared_explicit_inbox setting's default switched to "no". * ssl_client_ca_dir setting replaced imapc_ssl_ca_dir and pop3c_ssl_ca_dir settings. + Implemented IMAP MOVE and BINARY extensions + Implemented IMAP CATENATE, URLAUTH and URLAUTH=BINARY extensions (by Stephan Bosch). + Implemented IMAP NOTIFY extension. Requires mailbox_list_index=yes to be enabled. + Redesigned and rewritten dsync. The new design makes the syncing faster, more reliable and more featureful. The new dsync protocol isn't backwards compatible with old dsync versions (but is designed to be forwards compatible with future versions). + All mailbox formats now support per-user message flags for shared mailboxes by using a private index. It can be enabled by adding :INDEXPVT=<path> to mail location. This should be used instead of :INDEX also for Maildir/mbox to improve performance. + Improved mailbox list indexes. They should be usable now, although still disabled by default. + Added LAYOUT=index. The mailbox directories are created using their GUIDs in the filesystem, while the actual GUID <-> name mapping exists only in the index. + LMTP proxy: Implemented XCLIENT extension for passing remote IP address through proxy.

13 23

[Dovecot] Speed up mail retrieval by keyword
by Manfred Usselmann 09 Jun '13

09 Jun '13

Hi, I' m using a roundcube plugin for adding attributes to mails, which are stored as IMAP keywords (https://github.com/umount/message_label [1]). This plugin allows me to retrieve mails with a certain attribute across all my mail folders. Selecting mails this way is very convenient, but also very slow, probably because I've got a lot of mails and folders. Is there a way to speed this up somehow by changing any configuration options? Versions in use are Roundcube 0.9.0 and Dovecot 2.1.10 (Maildir). Thanks Manfred Links: ------ [1] https://github.com/umount/message_label

2 1

[Dovecot] search and UTF-8 normalization forms (NFD)
by Lutz Preßler 09 Jun '13

09 Jun '13

Hello, on a system with dovecot 2.2 I've got a mailbox containing multiple mails from a person called Krüger, but From: header encoded differently. Some are encoded in UTF-8 normalization form decomposed (as used by Mac OSX), that is u and umlaut accent as sperate combined codepoints instead of one ü: From: =?utf-8?Q?replaced_Kru=CC=88ger?= <krueger(a)some.domain> Searching within roundcube webmail for "krüger" as sender missis this mails. Roundcube sends (dovecot rawlog): A0003 UID THREAD REFS UTF-8 ALL HEADER FROM {7+}krüger Is this supposed to work? Haven't done any more debugging (other search variants) or read RFCs. As a user I would expect Unicode equivalence rules be applied (see http://en.wikipedia.org/wiki/Unicode_equivalence) Regards, Lutz

3 7

[Dovecot] Load Balancing and HA
by Romer Ventura 06 Jun '13

06 Jun '13

Hello, I've been thinking about the best way to achieve load balancing and making my mail servers highly available. So far I believe I have 2 scenarios: Scenario1: This should allow any to lose any of the servers and clients still have access to their emails (although I am not sure how the indexes would react to this and sudden disconnection) - 2 Dovecot Proxy servers, using a virtual IP to where the clients will connect to from the WAN and LAN - 2 Dovecot+Postfix servers with local cache - 2 NFS servers and synced with dsync (mirror, 1 server writes to its own NFS and changes synced to the other via dsync) Scenario2: Pretty much as above on the back end. However, with this there is no way to load balance users. - 2 Dovecot+Postfix server with local cache - 2 NFS servers synced with dsync - Make use of DNS MX record priority to provide access to secondary email server Anyone care to comment? Thanks. <BR CLEAR="ALL"> <hr style="border: 1px solid #CCC;"> <p style="font-style:italic; font-size:8pt; font-family:verdana; color:gray;">This document and attachments may contain technical data controlled under the U.S. International Traffic in Arms Regulations (ITAR) or the Export Administration Regulations (EAR) and may not be exported to a Foreign Person, either in the U.S. or abroad, without the proper authorization by the U.S. Department of State or Department of Commerce, whichever is applicable. CONFIDENTIALITY NOTE: This electronic transmission, including all attachments, is directed in confidence solely to the person(s) to whom it is addressed, or an authorized recipient, and may not otherwise be distributed, copied or disclosed. The contents of the transmission may also be subject to intellectual property rights and such rights are expressly claimed and are not waived. If you have received this transmission in error, please notify the sender immediately by return electronic transmission and then immediately delete this transmission, including all attachments, without copying, distributing or disclosing same. The recipient should check this e-mail and any attachments for the presence of viruses. Houston Sigma Technologies L.P. accepts no liability for any damage caused by any virus transmitted by this e-mail.</p>

6 8

[Dovecot] Dovecot mysql replication
by Edwardo Garcia 06 Jun '13

06 Jun '13

Halo, (First time posting, please forgive English is not native) Change from Courier to Dovecot 2.1.16 Having two server. Having mysql on thiz two server, one master, one slave. What we wish is slave Dovecot only ask slave mysql, unless slave mysql not work when then ask master, we have Postfix do thiz fallover good, but Dovecot talk to slave and master no mater what, we think thiz defeat fallover as we not want this aktion, but aktion like Postfix. The problemo is can not find Dovecot option for thiz in wiki2.dovecot.org, is possible?

9 26

[Dovecot] Make install error
by kengheng 05 Jun '13

05 Jun '13

Hi, I'm recompiling dovecot 2.2.0/2.2.1 with error below during make install: test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p "/usr/local/dovecot/lib/dovecot/auth" /usr/bin/mkdir: cannot create directory ‘/usr/local/dovecot/lib/dovecot/auth’: File exists make[3]: *** [install-auth_moduleLTLIBRARIES] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' make[2]: *** [install-am] Error 2 make[2]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-2.2.1/src' make: *** [install-recursive] Error 1 The target Svr OS: OpenSuse 12.2 x86 and installed success for qmail/vpopmail. The configuration for dovecot as below: ./configure \ --prefix=/usr/local/dovecot \ --with-vpopmail \ --with-docs \ --with-ssl \ --without-shadow \ --without-pam \ --without-ldap \ --without-pgsql \ --without-sql \ --without-mysql \ --without-sqlite Thanks, KH. Chan

4 11

[Dovecot] recursive mail_location?
by Eric Abrahamsen 04 Jun '13

04 Jun '13

Forgive what may be a newby question, but I'm trying to get a new setup working, and there are many different things confusing me. I'm trying for a gnus + dovecot + mbsync arrangement, with mbsync writing to maildirs, and gnus reading from those dirs with a dovecot invocation. Fairly standard, I think. I have multiple email accounts I'm trying to sync, all of them gmail. My problem is that mbsync creates one maildir structure for each mailbox in each account. So I end up with: ~/mail ├── acc1 │ ├── INBOX │ │ ├── cur │ │ ├── new │ │ └── tmp │ └── OTHERBOX │ ├── cur │ ├── new │ └── tmp └── acc2 ├── INBOX │ ├── cur │ ├── new │ └── tmp └── OTHERBOX ├── cur ├── new └── tmp And so on, for many accounts, and many mailboxes. I believe there's something I can configure in mbsync to collapse this a little, but there's still going to be quite a bit of nesting. Gnus, meanwhile, is meant to invoke dovecot with the "-o mail_location" switch, and as far as I can tell that needs to be pointed at a maildir structure, which means I would need a separate gnus server for each mailbox in each account. Does anyone have a recommended way of handling this? Is it possible to either "flatten" the structure further, or somehow tell dovecot to recurse into directories? I don't mind having a separate gnus server for each mail account, but I'd hate to have to do one per mailbox. I'm only just getting started and haven't invested myself in any particular setup, so if the answer is "you're doing it all wrong", I would love to hear that. Thanks! Eric

3 5

[Dovecot] Configuration advice needed.
by Olivier Girard 03 Jun '13

03 Jun '13

Hello, First, thanks for this great piece of software. I'm new to dovecot and i've just converted my old courier configuration on pop/imap server side, everithing is working just fine on this side and speed gain expected was found (not enough for our busy servers :). Setup is done with 3 dovecot virtual servers load balanced with a Hardware load balancer (this part is a big point of the question). Postfix and dovecot servers use an NFS share on a NetApp for mail, Postfix servers are writting directly to inbox maildirs. Load balanced is maintaining afinity betwen client and server so i've got no problem with this for the moment. Now, i want to setup postfix (3 HW load balanced) for local delivery with LMTP on deovecot servers, and here come my questions. Afinity can't be maintained between IMAP and LMTP for a user with my load balancer so mail can be delivered on dovecot01 and read on dovecot02, from what i've read this can be an issue with indexes. I think i need to setup a director to maintain LMTP and IMAP afinity between users and servers but on imap servers i'm identifying user with their UID, and LMTP need to see emails. Does dovecot see the same user or 2 users with the same homedir? So my question is: could you point me to the right direction with this setup, do you have any advice on this config. Actual configurations: (postlogin not in real use, just a touch on (imap/pop3)_last_login) POP/IMAP server: dovecot01# doveconf -n # 2.1.15: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-RELEASE-p3 amd64 auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_mechanisms = plain login auth_verbose = yes default_client_limit = 1500 default_process_limit = 500 default_vsz_limit = 1 G disable_plaintext_auth = no dotlock_use_excl = no lock_method = dotlock mail_fsync = always mail_gid = vmail mail_location = maildir:%h/Maildir:INDEX=/mail_index%h mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " stats" mail_uid = vmail mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } user = $default_internal_user } service imap-postlogin { executable = script-login /usr/local/bin/imap-postlogin.sh user = vmail } service imap { executable = imap imap-postlogin process_limit = 1024 } service pop3-postlogin { executable = script-login /usr/local/bin/pop3-postlogin.sh user = vmail } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = </etc/ssl/cert/mail.univ-angers.fr.pem ssl_key = </etc/ssl/cert/mail.univ-angers.fr.key userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_plugins = " stats imap_stats" } Postfix Test Server: %doveconf -n # 2.1.15: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-RELEASE-p3 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes default_client_limit = 1500 default_process_limit = 500 default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no lock_method = dotlock mail_fsync = always mail_gid = vmail mail_location = maildir:%h/Maildir:INDEX=/mail_index%h mail_nfs_index = yes mail_nfs_storage = yes mail_uid = vmail mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = vmail } user = $default_internal_user } service imap-postlogin { executable = script-login /usr/local/bin/imap-postlogin.sh user = vmail } service imap { executable = imap imap-postlogin process_limit = 1024 } service lmtp { inet_listener lmtp { address = * :: port = 24 } process_min_avail = 20 user = vmail } service pop3-postlogin { executable = script-login /usr/local/bin/pop3-postlogin.sh user = vmail } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 } ssl_cert = </etc/ssl/cert/mail.univ-angers.fr.pem ssl_key = </etc/ssl/cert/mail.univ-angers.fr.key userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } File dovecot-ldap.conf.ext uris = ldap://ldap.uang dn = cn=acces-smtp, ou=access, dc=univ-angers, dc=fr dnpass = ********** base = ou=people, dc=univ-angers, dc=fr user_attrs = homeDirectory=home user_filter = (&(|(uid=%u) (mail=%u) (auaAliasEmail=%u))(|(auaStatut=etu)(auaStatut=etu-sortant)(auaStatut=perso)(auaStatut=perso-sortant))) pass_attrs = uid=user,userPassword=password pass_filter = (&(|(uid=%u) (mail=%u) (auaAliasEmail=%u)) (|(auaStatut=etu)(auaStatut=etu-sortant)(auaStatut=perso) (auaStatut=perso-sortant))) iterate_attrs = uid=user iterate_filter = (|(auaStatut=etu)(auaStatut=etu-sortant)(auaStatut=perso)(auaStatut=perso-sortant)) default_pass_scheme = MD5-CRYPT

2 2