- dovecot - dovecot.org

[Dovecot] Converting from Maildir - sdbox
by Marc Perkel 04 Jan '11

04 Jan '11

OK - I thought this was going to be easy. Maybe it is. I'm just not that good at reading directions. Trying to use dsync. Getting this error: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) Currently using maildir. The setup is as follows: mail_uid = mail mail_gid = mail mail_location = maildir:/vhome/%d/home/%n:INDEX=/imap-cache/%d-%n I don't have any namespace setting. Not quite sure what a namespace is or why I need one. This is what I'm trying to run: dsync -u marc(a)perkel.com backup sdbox:/email/%d/home/%n What I'm hoping to do is do a mass conversion while running. Then shut it down - do a second quick pass - and bring it up in sdbox format. Thanks in advance.

2 1

[Dovecot] dovecotpw missing (2.0.8)
by Kristina Clair 04 Jan '11

04 Jan '11

Hello, I just installed dovecot version 2.0.8 from the source tarball. After doing ./configure, make, and make install, I don't have the dovecotpw binary anywhere. It is not in /usr/local/bin or /usr/local/sbin where the other binaries are; I also did a find / for it and don't see it. Is there some configuration flag I'm missing? I read the flags in ./configure --help and nothing seems obviously applicable to me. Is there a cryptography library I could be missing? I have the libs installed for crypt, md5, etc. Thanks, Kristina

2 3

[Dovecot] namespaces and noselect
by Kyle Wheeler 04 Jan '11

04 Jan '11

Hello, I am trying to use two namespaces to create an "archival" directory that is stored as mboxes (the rest of my tree is all stored as maildirs). However, when I add the second namespace, suddenly Dovecot starts emitting, in response to the LIST command, a second version of the INBOX that is marked as \NoSelect. Here are my namespac definitions... am I doing this wrong? namespace { list = yes hidden = no inbox = yes location = maildir:~/Maildir prefix = separator = / type = private } namespace { hidden = yes # do not list as a separate namespace list = no # inbox = no location = mbox:~/Maildir/Archive:LAYOUT=fs:INDEX=~/Maildir/ArchiveIndexes/ prefix = INBOX/Archive/ separator = / type = private } ~Kyle -- If you are going through hell, keep going. -- Winston Churchill

2 5

[Dovecot] Implications of zlib plugin on search operations
by Ralf Hildebrandt 04 Jan '11

04 Jan '11

Right now I'm compressing all mails older than 31 days and larger than 100k in size. But what implications does this compression have on search queries performed by users (user looking for an old mail containing a certain string). -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 2

[Dovecot] Finally upgrading from v1.0.15 to v1.2.16 -- advice please
by Jan-Frode Myklebust 04 Jan '11

04 Jan '11

It's long over due, but now I finally plan on upgrading from v1.0.15 to v1.2.16 on our servers. Would appreciate any comments! We have 7 servers, all running of the same GPFS filesystem. Both maildirs and indexes are stored here. We use dovecot for POP/IMAP and deliver. Currently we're using mysql as authentication source, but want to move to using ldap instead. Can we upgrade one server at a time, or do we need to upgrade all servers at the same time ? http://wiki2.dovecot.org/Upgrading/1.1 says "Index files have slightly changed as well. Upgrading to v1.1 should go transparently, but moving back to v1.0 might again cause some errors." which makes me think we can't have both versions running against the same users ? Also, if we upgrade only one server, should we switch to "mmap_disable=no" on this one, or keep running with "mmap_disable=yes" on all servers ? "NFS users should now set mail_nfs_storage=yes and mail_nfs_index=yes." Does this apply to any shared/networked filesystems, and is this relevant for GPFS ? The sql queries we're doing now is: password_query = select U.Account as user,S.Password as password from Users U, UserSession S where U.Account=S.Account and U.Account='%u' user_query = SELECT 3000 as uid, 3000 as gid, concat(concat('maildir:', MailDir), concat(':INDEX=', replace(MailDir, '/usr/local/atmail/users', '/usr/local/atmail/users/indexes'))) as mail, concat('maildir:storage=', UserQuota) as quota FROM Users WHERE Account = '%u' I plan on doing ldap bind() for authentication: hosts = maildb3.example.net:389 auth_bind = yes ldap_version = 3 base = ou=people,o=%d,o=ISP,o=example,c=net deref = never scope = onelevel user_filter = (&(objectClass=altiboxperson)(uid=%n)) default_pass_scheme = SSHA but the user_query is a challenge.. In LDAP we have: uid = janfrode, ou=people,o=domain1.net,o=ISP,o=example,c=net mail = janfrode(a)domain1.net mailMessageStore = /usr/local/atmail/users/j/a/janfrode(a)domain1.net mailQuota = 1000000 domain = domain1.net userPassword = SSHA-string So, outside of the user_attrs we need: mail_uid = 3000 mail_gid = 3000 But I'm having a hard time understanding how I can use the ldap value mail=/usr/local/atmail/users/j/a/janfrode(a)domain1.net to translate into dovecot's "mail" containing both "maildir:" and "INDEX=". Does the below look correct ? user_attrs = mailMessageStore=mail=maildir:%$:INDEX=/usr/local/atmail/users/indexes/%1u/%1.1u/%u, mailQuota=quota_rule=*:storage=%$ i.e. will it point dovecot at: mail = maildir:/usr/local/atmail/users/j/a/janfrode@domain1.net:INDEX=/usr/local/atmail/users/indexes/j/a/janfrode@domain1.net quota_rule=*:storage=1000000 -jf

2 6

[Dovecot] Vpopmail + Expire Plugin
by Oliver Lehmann 04 Jan '11

04 Jan '11

Hi, I've changed my running qmail/vpopmail/procmail/courier-imap/sqwebmail installation to qmail/vpopmail/siege/dovecot/horde imp. So far, I've got everything running. Authentification with vpopmail as passdb is working, Mail delivery with siege into different Mail folders is working as well. One of the reasons why I switched to dovecot was the expire plugin and right now I'm trying to set it up but I don't get it to run. - I created a MySQL User as advised - I created a database and a table and granted SELECT, INSERT, DELETE, UPDATE privileges for that table to user dovecot # mysql -udovecot -p dovecot Enter password: mysql> desc expires; +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ 3 rows in set (0.00 sec) mysql> select * from expires; Empty set (0.00 sec) - I added the following lines to my dovecot.conf: dict { expire = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } plugin { expire = Test expire_dict = proxy::expire } - I created the dovecot-dict-sql.conf.ext # cat /usr/local/etc/dovecot/dovecot-dict-sql.conf.ext connect = host=localhost dbname=dovecot user=dovecot password=XXXX map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } # - When restarting dovecot I had a dict error because the socket was owned by root. I changed that so the socket is owned by the user vpopmail. - Then I created a folder "Test" via IMAP for one of my accounts - Then I copied via Horde IMP (so via IMAP) a message to that new folder - I requeried dovecot.expires in my database and it is still empty - I enabled logging for my MySQL DB and with that I found out, that no connect with the "dovecot" user is made at all so of course the table is empty. - I created a siege rule to move a mail directly to that Test folder when a specific Subject is used. lda moves the mail on arrival but still no MySQL connection is made. I've read that doveadm -A must work to get the expire plugin workinj, but it does not: # doveadm search -A mailbox INBOX subject test doveadm(olivleh1): Error: User listing returned failure doveadm: Error: Failed to iterate through some users # The expire plugin is loaded on startup: Jan 04 11:35:50 imap: Debug: Loading modules from directory: /usr/local/lib/dovecot Jan 04 11:35:50 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib20_expire_plugin.so When using doveadm I'm getting a strange error: # doveadm -v expire -A mailbox INBOX subject test doveadm(olivleh1): Fatal: Unknown command 'expire', but plugin expire exists. Try to set mail_plugins=expire Exit 89 # I've no idea how to get it to work. I guess I need your help guys to get it working ;) # dovecot -n # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 7.3-STABLE i386 auth_debug = yes auth_verbose = yes debug_log_path = /var/log/dovecot/dovecot-debug.log dict { expire = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 89 info_log_path = /var/log/dovecot/dovecot-info.log last_valid_uid = 89 listen = 127.0.0.1 log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_plugins = " expire" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { driver = vpopmail } plugin { expire = Test 1 expire_dict = proxy::expire sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0600 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0600 user = vpopmail } } ssl_cert = </usr/local/etc/dovecot/ssl/certs/dovecot.pem ssl_key = </usr/local/etc/dovecot/ssl/private/dovecot.pem userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { debug_log_path = syslog info_log_path = syslog log_path = syslog mail_plugins = " sieve" } ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 7

[Dovecot] X-SAVEDATE & dync & doveadm expunge
by e-frog 04 Jan '11

04 Jan '11

Hello List, After moving the mail store via dsync backup to a different location the following command doveadm expunge -u user mailbox "Trash" savedbefore 10d deleted ALL mails in Trash instead of messages older than 10 days. It looks like X-SAVEDATE is somehow wrong... A fetch 1:* (internaldate x-savedate) * 1 FETCH (INTERNALDATE "28-Dec-2007 14:49:58 +0100" X-SAVEDATE "01-Jan-1970 01:00:00 +0100") A OK Fetch completed. ...while the ctime for this mail is as below: $ ls -lac -rw------- 1 vmail vmail 40851 2010-12-30 19:26 1198963359.P1256Q0M253583.ubuntu-test.localdomain,S=40851:2,S I was assuming that for the maildirs X-SAVEDATE is derived from the message ctime? "01-Jan-1970 01:00:00 +0100" seem to be definitely wrong. Thanks, e-frog $ doveconf -n # 2.0.8 (89936539e3b8): /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-24-generic-pae i686 Ubuntu 10.10 deliver_log_format = msgid=%m: from=%f: %$ dict { dictionary = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_gid = vmail mail_home = /home/vmail/%Ld/%Ln mail_location = maildir:~/maildir:INDEX=~/index:CONTROL=~/control mail_plugins = quota virtual mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { location = virtual:/etc/dovecot/virtual:INDEX=~/control/virtual prefix = virtual/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = spool2dir antispam_spam = Junk antispam_spool2dir_notspam = /home/vmail/learn-ham/%%020lu-%u-%%05luh antispam_spool2dir_spam = /home/vmail/learn-spam/%%020lu-%u-%%05lus antispam_trash = Trash fts = squat fts_squat = partial=4 full=10 quota = dict:user::proxy::dictionary sieve = ~/dovecot.sieve sieve_before = /etc/dovecot/sieve-global/ sieve_dir = ~/sieve } postmaster_address = postmaster(a)ubuntu-test.localdomain protocols = imap lmtp sieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 0 } process_min_avail = 2 service_count = 0 } service imap { executable = imap postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service postlogin { executable = script-login /opt/bin/dovecot-postlogin.sh } ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = quota virtual sieve } protocol imap { mail_plugins = quota virtual fts fts_squat imap_quota antispam }

2 2

[Dovecot] Automatic Debian Dovecot repository now also includes amd64 binary packages.
by Stephan Bosch 04 Jan '11

04 Jan '11

Hi, I've recently significantly improved the automated Dovecot Debian package builder. At the beginning it only produced i386 binaries for Debian testing. A few weeks back I added a slave builder that builds packages for Debian stable. Today I have extended the slave builder with support for multiple architectures and I've added amd64 binaries to the repository. The master builder still builds packages for testing/i386 every hour. The slaves check for new source packages about 20 minutes later. Read the following wiki page for more information and read it carefully when you are considering to use these packages: http://wiki.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages Also, every day at four 'o clock in the morning, the latest source packages are uploaded to the openSUSE build service, which builds i386/amd64 binaries for several Ubuntu versions (experimental): http://download.opensuse.org/repositories/home:/sbosch:/ Regards, Stephan.

2 2

[Dovecot] dovecot: auth: Fatal: sql_driver_register(mysql): Already registered
by kjhkg kjkjhgkhg 04 Jan '11

04 Jan '11

Hi, i've been using dovecot2 on our server for handling virtual mailboxes and postfix is also using it to examine if a mail has to be delivered locally or not. Recently i upgraded to 2.0.7 (freebsd ports), but it stopped working, says the error in the subject line. Details: [root@postfixjail /usr/local/etc/dovecot]# dovecot --version 2.0.7 [root@postfixjail /usr/local/etc/dovecot]# grep -hv '^ *$#.*$\?$' dovecot.conf conf.d/* protocols = imap pop3 lmtp sieve listen = * dict { quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext quota_rule2 = Trash:bytes=+100M } mail_location = maildir:~/Maildir passdb { driver = sql args = /usr/local/etc/dovecot/dovecot-sql.conf.ext } userdb { driver = prefetch } userdb { driver = sql args = /usr/local/etc/dovecot/dovecot-sql.conf.ext } ssl = yes ssl_cert = </etc/ssl/dovecot/dovecot.pem ssl_key = </etc/ssl/dovecot/dovecot.pem default_login_user = nobody auth_cache_size = 0 auth_cache_ttl = 0 auth_cache_negative_ttl = 0 mail_plugins = $mail_plugins quota plugin { quota = dict:User quota::proxy::quota } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota } log_path = syslog plugin { } service imap-login { service_count = 1 process_min_avail = 3 inet_listener imap { } inet_listener imaps { } } service pop3-login { service_count = 1 process_min_avail = 3 inet_listener pop3 { } inet_listener pop3s { } } service lmtp { unix_listener lmtp { } } service imap { } service pop3 { } service auth { unix_listener auth-userdb { mode = 0600 user = vmail group = vmail } unix_listener /var/spool/postfix/private/auth { mode = 0660 user = postfix group = postfix } } service auth-worker { } service dict { unix_listener dict { mode = 0600 user = vmail } } protocol lda { mail_plugins = $mail_plugins quota sieve } protocol lmtp { mail_plugins = $mail_plugins quota sieve } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 process_min_avail = 2 } service managesieve { process_limit = 1024 process_min_avail = 2 } protocol sieve { managesieve_max_line_length = 65536 } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } [root@postfixjail /usr/local/etc/dovecot]# grep -hv '^ *$#.*$\?$' dovecot-dict-sql.conf.ext connect = host=127.0.0.3 dbname=mailsql user=mailsql password=somepassword map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } [root@postfixjail /usr/local/etc/dovecot]# grep -hv '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.3 dbname=mailsql user=mailsql password=somepassword default_pass_scheme = PLAIN-MD5 user_query = \ SELECT maildir AS home, 'vmail' AS uid, 'vmail' AS gid, \ CONCAT('*:bytes=', quota) AS quota_rule \ FROM mailbox WHERE username = '%u' AND active = 1 password_query = \ SELECT username AS user, password, \ maildir AS userdb_home, \ 'vmail' AS userdb_uid, 'vmail' AS userdb_gid, \ CONCAT('*:bytes=', quota) AS userdb_quota_rule \ FROM mailbox WHERE username = '%u' AND active = 1 iterate_query = SELECT username AS user FROM mailbox [root@postfixjail /usr/local/etc/dovecot]# uname -a FreeBSD postfixjail.mymachine.com 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #4: Sat Jan 1 23:33:01 CET 2011 root@new.mymachine.com:/usr/obj/usr/src/sys/MYKERNEL amd64 The filesystem is ZFS (is that really needed?) Any help on that? I'm helpless, went to the irc channel, but people told that my configs are right. Cheers, Laszlo

2 3

[Dovecot] Problem with requiring client certificates for external connections
by Frank Crawford 04 Jan '11

04 Jan '11

Folks, I'm trying to configure my dovecot installation to require client certificates for external/Internet connections, while still allowing my local network to not need certificates. This configuration is for Dovecot 2 (2.0.8 in Fedora 14), and I've tried to use the "remote" block to give different definitions for my local network vs the defaults. While most options seem to be set fine, if I set "auth_ssl_require_client_cert" to yes as the default, and reset it to no for my local network, dovecot still requests a client certificate and fails as one is not supplied. Am I correct that it can be reset in a "remote" block, or is it treated differently to other options? In fact do I have the configuration correct, as there doesn't really seem to be anything documenting "remote" or "remote_ip" or related items for Dovecot 2. Related to this, much of the documentation states that the variable is "ssl_require_client_cert", seems to be accepted by ignored, vs "auth_ssl_require_client_cert" which does have some effects. Also, in the configuration dump, it duplicates the netmask. The configuration is below, as generated with "dovecot -n". Regards Frank # 2.0.8: /etc/dovecot/dovecot.conf # OS: Linux 2.6.36.1 x86_64 Fedora release 14 (Laughlin) ext4 auth_ssl_require_client_cert = yes mail_location = maildir:/var/spool/maildir/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)crawford.emu.id.au ssl = required ssl_ca = </etc/pki/CA/cacert.pem ssl_cert = </etc/pki/tls/certs/dovecot.crt ssl_key = </etc/pki/tls/private/dovecot.key ssl_verify_client_cert = yes userdb { driver = passwd } protocol pop3 { pop3_uidl_format = %v.%u } remote 203.16.204.0/24/24 { auth_ssl_require_client_cert = no disable_plaintext_auth = no ssl = no ssl_verify_client_cert = no } remote fdd2:7aad:d478:1::/64/64 { auth_ssl_require_client_cert = no disable_plaintext_auth = no ssl = no ssl_verify_client_cert = no } remote 2001:44b8:62:140::/64/64 { auth_ssl_require_client_cert = no disable_plaintext_auth = no ssl = no ssl_verify_client_cert = no }

3 5