January 2011 - dovecot

[Dovecot] Error copying >1 message to virtual mailbox
by Nicholas Riley 05 Jan '11

05 Jan '11

I created a virtual mailbox which maps to a single physical mailbox (in Dovecot 1.x I did this with a symlink but had intermittent problems with Dovecot 2.0 doing the same.) However, I can only copy one message at a time into the mailbox. If I try to copy more, I get: 7.16 UID COPY 48531:48532 !/Saved 7.16 NO [CANNOT] Can't save messages to this virtual mailbox whereas this works fine: 10.16 UID COPY 48531 !/Saved 10.16 OK Copy completed. The dovecot-virtual file in !/Saved is: !2011-01 all and dovecot.conf: # 2.0.8 (cde0d403c6ff): /etc/dovecot/dovecot.conf # OS: Linux 2.6.18.8-linode22 i686 Debian 5.0.7 mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX:CONTROL=~/.dovecot.cont rol:SUBSCRIPTIONS=.subscriptions mail_max_userip_connections = 20 namespace { inbox = yes location = prefix = separator = / } namespace { location = virtual:~/Maildir/! prefix = !/ separator = / } passdb { driver = pam } plugin { antispam_backend = dspam antispam_signature = X-DSPAM-Signature antispam_spam_pattern_ignorecase = *spam } protocols = imap ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = " virtual" } Thanks. -- Nicholas Riley <njriley(a)illinois.edu>

2 2

[Dovecot] DSync Namespace Frustration
by Marc Perkel 04 Jan '11

04 Jan '11

In order to get dsync to work I need to set something in namespace. Running maildir. Will this work? namespace private { separator = . prefix = inbox = yes } namespace private { separator = . prefix = INBOX. inbox = no hidden = yes list = no # for v1.1+ }

1 0

[Dovecot] dsync error: Unexpected finish reply
by Pavel Volkovitskiy 04 Jan '11

04 Jan '11

Hello! i'm trying to make mails backup with dsync on remote server dsync transfers data but then exits with error: $ dsync -f -u 'test123(a)domain.tld' backup ssh mailuser@backupserver dsync -u 'test123(a)domain.tld' >dsync-local(test123(a)domain.tld): Error: Unexpected finish reply: + >dsync-local(test123(a)domain.tld): Error: Unexpected reply from server: ok i'm using 2.0.8 (89f4e4cdbeac) (2.0.8-0~auto+24) on both sides -- Pavel

1 0

[Dovecot] Converting from Maildir - sdbox
by Marc Perkel 04 Jan '11

04 Jan '11

OK - I thought this was going to be easy. Maybe it is. I'm just not that good at reading directions. Trying to use dsync. Getting this error: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) Currently using maildir. The setup is as follows: mail_uid = mail mail_gid = mail mail_location = maildir:/vhome/%d/home/%n:INDEX=/imap-cache/%d-%n I don't have any namespace setting. Not quite sure what a namespace is or why I need one. This is what I'm trying to run: dsync -u marc(a)perkel.com backup sdbox:/email/%d/home/%n What I'm hoping to do is do a mass conversion while running. Then shut it down - do a second quick pass - and bring it up in sdbox format. Thanks in advance.

2 1

[Dovecot] dovecotpw missing (2.0.8)
by Kristina Clair 04 Jan '11

04 Jan '11

Hello, I just installed dovecot version 2.0.8 from the source tarball. After doing ./configure, make, and make install, I don't have the dovecotpw binary anywhere. It is not in /usr/local/bin or /usr/local/sbin where the other binaries are; I also did a find / for it and don't see it. Is there some configuration flag I'm missing? I read the flags in ./configure --help and nothing seems obviously applicable to me. Is there a cryptography library I could be missing? I have the libs installed for crypt, md5, etc. Thanks, Kristina

2 3

[Dovecot] namespaces and noselect
by Kyle Wheeler 04 Jan '11

04 Jan '11

Hello, I am trying to use two namespaces to create an "archival" directory that is stored as mboxes (the rest of my tree is all stored as maildirs). However, when I add the second namespace, suddenly Dovecot starts emitting, in response to the LIST command, a second version of the INBOX that is marked as \NoSelect. Here are my namespac definitions... am I doing this wrong? namespace { list = yes hidden = no inbox = yes location = maildir:~/Maildir prefix = separator = / type = private } namespace { hidden = yes # do not list as a separate namespace list = no # inbox = no location = mbox:~/Maildir/Archive:LAYOUT=fs:INDEX=~/Maildir/ArchiveIndexes/ prefix = INBOX/Archive/ separator = / type = private } ~Kyle -- If you are going through hell, keep going. -- Winston Churchill

2 5

[Dovecot] Implications of zlib plugin on search operations
by Ralf Hildebrandt 04 Jan '11

04 Jan '11

Right now I'm compressing all mails older than 31 days and larger than 100k in size. But what implications does this compression have on search queries performed by users (user looking for an old mail containing a certain string). -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 2

[Dovecot] Finally upgrading from v1.0.15 to v1.2.16 -- advice please
by Jan-Frode Myklebust 04 Jan '11

04 Jan '11

It's long over due, but now I finally plan on upgrading from v1.0.15 to v1.2.16 on our servers. Would appreciate any comments! We have 7 servers, all running of the same GPFS filesystem. Both maildirs and indexes are stored here. We use dovecot for POP/IMAP and deliver. Currently we're using mysql as authentication source, but want to move to using ldap instead. Can we upgrade one server at a time, or do we need to upgrade all servers at the same time ? http://wiki2.dovecot.org/Upgrading/1.1 says "Index files have slightly changed as well. Upgrading to v1.1 should go transparently, but moving back to v1.0 might again cause some errors." which makes me think we can't have both versions running against the same users ? Also, if we upgrade only one server, should we switch to "mmap_disable=no" on this one, or keep running with "mmap_disable=yes" on all servers ? "NFS users should now set mail_nfs_storage=yes and mail_nfs_index=yes." Does this apply to any shared/networked filesystems, and is this relevant for GPFS ? The sql queries we're doing now is: password_query = select U.Account as user,S.Password as password from Users U, UserSession S where U.Account=S.Account and U.Account='%u' user_query = SELECT 3000 as uid, 3000 as gid, concat(concat('maildir:', MailDir), concat(':INDEX=', replace(MailDir, '/usr/local/atmail/users', '/usr/local/atmail/users/indexes'))) as mail, concat('maildir:storage=', UserQuota) as quota FROM Users WHERE Account = '%u' I plan on doing ldap bind() for authentication: hosts = maildb3.example.net:389 auth_bind = yes ldap_version = 3 base = ou=people,o=%d,o=ISP,o=example,c=net deref = never scope = onelevel user_filter = (&(objectClass=altiboxperson)(uid=%n)) default_pass_scheme = SSHA but the user_query is a challenge.. In LDAP we have: uid = janfrode, ou=people,o=domain1.net,o=ISP,o=example,c=net mail = janfrode(a)domain1.net mailMessageStore = /usr/local/atmail/users/j/a/janfrode(a)domain1.net mailQuota = 1000000 domain = domain1.net userPassword = SSHA-string So, outside of the user_attrs we need: mail_uid = 3000 mail_gid = 3000 But I'm having a hard time understanding how I can use the ldap value mail=/usr/local/atmail/users/j/a/janfrode(a)domain1.net to translate into dovecot's "mail" containing both "maildir:" and "INDEX=". Does the below look correct ? user_attrs = mailMessageStore=mail=maildir:%$:INDEX=/usr/local/atmail/users/indexes/%1u/%1.1u/%u, mailQuota=quota_rule=*:storage=%$ i.e. will it point dovecot at: mail = maildir:/usr/local/atmail/users/j/a/janfrode@domain1.net:INDEX=/usr/local/atmail/users/indexes/j/a/janfrode@domain1.net quota_rule=*:storage=1000000 -jf

2 6

[Dovecot] Vpopmail + Expire Plugin
by Oliver Lehmann 04 Jan '11

04 Jan '11

Hi, I've changed my running qmail/vpopmail/procmail/courier-imap/sqwebmail installation to qmail/vpopmail/siege/dovecot/horde imp. So far, I've got everything running. Authentification with vpopmail as passdb is working, Mail delivery with siege into different Mail folders is working as well. One of the reasons why I switched to dovecot was the expire plugin and right now I'm trying to set it up but I don't get it to run. - I created a MySQL User as advised - I created a database and a table and granted SELECT, INSERT, DELETE, UPDATE privileges for that table to user dovecot # mysql -udovecot -p dovecot Enter password: mysql> desc expires; +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ 3 rows in set (0.00 sec) mysql> select * from expires; Empty set (0.00 sec) - I added the following lines to my dovecot.conf: dict { expire = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } plugin { expire = Test expire_dict = proxy::expire } - I created the dovecot-dict-sql.conf.ext # cat /usr/local/etc/dovecot/dovecot-dict-sql.conf.ext connect = host=localhost dbname=dovecot user=dovecot password=XXXX map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } # - When restarting dovecot I had a dict error because the socket was owned by root. I changed that so the socket is owned by the user vpopmail. - Then I created a folder "Test" via IMAP for one of my accounts - Then I copied via Horde IMP (so via IMAP) a message to that new folder - I requeried dovecot.expires in my database and it is still empty - I enabled logging for my MySQL DB and with that I found out, that no connect with the "dovecot" user is made at all so of course the table is empty. - I created a siege rule to move a mail directly to that Test folder when a specific Subject is used. lda moves the mail on arrival but still no MySQL connection is made. I've read that doveadm -A must work to get the expire plugin workinj, but it does not: # doveadm search -A mailbox INBOX subject test doveadm(olivleh1): Error: User listing returned failure doveadm: Error: Failed to iterate through some users # The expire plugin is loaded on startup: Jan 04 11:35:50 imap: Debug: Loading modules from directory: /usr/local/lib/dovecot Jan 04 11:35:50 imap: Debug: Module loaded: /usr/local/lib/dovecot/lib20_expire_plugin.so When using doveadm I'm getting a strange error: # doveadm -v expire -A mailbox INBOX subject test doveadm(olivleh1): Fatal: Unknown command 'expire', but plugin expire exists. Try to set mail_plugins=expire Exit 89 # I've no idea how to get it to work. I guess I need your help guys to get it working ;) # dovecot -n # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 7.3-STABLE i386 auth_debug = yes auth_verbose = yes debug_log_path = /var/log/dovecot/dovecot-debug.log dict { expire = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 89 info_log_path = /var/log/dovecot/dovecot-info.log last_valid_uid = 89 listen = 127.0.0.1 log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_plugins = " expire" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { driver = vpopmail } plugin { expire = Test 1 expire_dict = proxy::expire sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0600 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0600 user = vpopmail } } ssl_cert = </usr/local/etc/dovecot/ssl/certs/dovecot.pem ssl_key = </usr/local/etc/dovecot/ssl/private/dovecot.pem userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { debug_log_path = syslog info_log_path = syslog log_path = syslog mail_plugins = " sieve" } ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 7

[Dovecot] X-SAVEDATE & dync & doveadm expunge
by e-frog 04 Jan '11

04 Jan '11

Hello List, After moving the mail store via dsync backup to a different location the following command doveadm expunge -u user mailbox "Trash" savedbefore 10d deleted ALL mails in Trash instead of messages older than 10 days. It looks like X-SAVEDATE is somehow wrong... A fetch 1:* (internaldate x-savedate) * 1 FETCH (INTERNALDATE "28-Dec-2007 14:49:58 +0100" X-SAVEDATE "01-Jan-1970 01:00:00 +0100") A OK Fetch completed. ...while the ctime for this mail is as below: $ ls -lac -rw------- 1 vmail vmail 40851 2010-12-30 19:26 1198963359.P1256Q0M253583.ubuntu-test.localdomain,S=40851:2,S I was assuming that for the maildirs X-SAVEDATE is derived from the message ctime? "01-Jan-1970 01:00:00 +0100" seem to be definitely wrong. Thanks, e-frog $ doveconf -n # 2.0.8 (89936539e3b8): /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-24-generic-pae i686 Ubuntu 10.10 deliver_log_format = msgid=%m: from=%f: %$ dict { dictionary = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_gid = vmail mail_home = /home/vmail/%Ld/%Ln mail_location = maildir:~/maildir:INDEX=~/index:CONTROL=~/control mail_plugins = quota virtual mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { location = virtual:/etc/dovecot/virtual:INDEX=~/control/virtual prefix = virtual/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = spool2dir antispam_spam = Junk antispam_spool2dir_notspam = /home/vmail/learn-ham/%%020lu-%u-%%05luh antispam_spool2dir_spam = /home/vmail/learn-spam/%%020lu-%u-%%05lus antispam_trash = Trash fts = squat fts_squat = partial=4 full=10 quota = dict:user::proxy::dictionary sieve = ~/dovecot.sieve sieve_before = /etc/dovecot/sieve-global/ sieve_dir = ~/sieve } postmaster_address = postmaster(a)ubuntu-test.localdomain protocols = imap lmtp sieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 0 } process_min_avail = 2 service_count = 0 } service imap { executable = imap postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service postlogin { executable = script-login /opt/bin/dovecot-postlogin.sh } ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = quota virtual sieve } protocol imap { mail_plugins = quota virtual fts fts_squat imap_quota antispam }

2 2