August 2013 - dovecot

[Dovecot] rdiff-backup of Maildir?
by Thomas Harold 16 Aug '13

16 Aug '13

What's the best way to do long-term backups of the Maildir format these days? Traditionally we've just done a rdiff-backup or pointed Bacula at the Maildir. Both give us the option to reset a particular mailbox back to a previous day (any day within the last N months). Do we just need to snapshot the LVM volume that holds all the Maildir boxes, or is there some additional commands that we should run before doing the LVM snapshot?

1 0

[Dovecot] IMAP Proxying and SSL Certificates on OpenBSD
by dago＠quantentunnel.de 16 Aug '13

16 Aug '13

Hi list, I am currently trying to configure dovecot to act as a imap proxy in front of a Groupwise server. Because of a policy no services of the gw server may be directly served to the web. So currently this is only a security measure. Dovecot was previously used for providing sasl-auth capabilities to postfix. IMAP proxy features should be added now. Authentication backend is LDAP. OS is OpenBSD 5.2. Dovecot version is 2.1.8. Currently I am fighting with the following error in the logs: dovecot: master: Dovecot v2.1.8 starting up dovecot: auth: Warning: userdb passwd: Move templates args to override_fields setting dovecot: auth: Error: passwd(username,78.104.X.X,<e9YE/gDkOQBOaKfg>): getpwnam() failed: Operation not permitted dovecot: imap-login: Login: user=<username>, method=PLAIN, rip=78.104.X.X, lip=5.9.X.X, mpid=1765, session=<e9YE/gDkOQBOaKfg> dovecot: imap(username): Error: user username: Initialization failed: Initializing mail storage from mail_location setting failed: imapc: missing imapc_password dovecot: imap(username): Error: Invalid user settings. Refer to server log for more information. I hope to also see therein the cause for not providing STARTTLS: # openssl s_client -connect mail.example.com:143 -starttls imap CONNECTED(00000003) didn't found STARTTLS in server response, try anyway... 15096:error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol:/SourceCache/OpenSSL098/OpenSSL098-47/src/ssl/s23_clnt.c:607: As postfix is already using the certificates, they should be okay …. # dovecot -n # 2.1.8: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.2 i386 disable_plaintext_auth = no imapc_host = 10.0.0.2 mail_gid = vmail mail_home = /home/vmail/%u mail_location = imapc:~/imapc mail_uid = vmail passdb { args = scheme=plain-md5 username_format=%n /etc/dovecot/passwd driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap.conf default_fields = userdb_imapc_user=%u userdb_imapc_password=%w driver = ldap } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = _postfix mode = 0660 user = _postfix } user = root } service imap-login { chroot = login } service pop3-login { chroot = login } ssl = no ssl_ca = </etc/ssl/ca.crt ssl_cert = </etc/ssl/pf/mail.example.com.crt ssl_key = </etc/ssl/pf/mail.example.comkey userdb { args = username_format=%n /etc/dovecot/passwd driver = passwd } userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } # dovecot-ldap.conf hosts = 10.0.0.2:389 dn = cn=ldapaccess,o=servercontext dnpass = secretpass auth_bind = yes ldap_version = 3 base = o=usercontext user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(&(objectClass=Person)(cn=%u))(groupMembership=cn=SMTPsender,o=permissiongroups)) pass_attrs = cn=user,userPassword=password pass_filter = (&(&(objectClass=Person)(cn=%u))(groupMembership=cn=SMTPsender,o=permissiongroups)) Thanks in advance! Best regards

4 4

[Dovecot] Problems with openssl library path
by Christian Felsing 16 Aug '13

16 Aug '13

Hello, I tried to compile Dovecot 2.2.5 on Debian 6 with an alternate OpenSSL installation located at /usr/local/ssl A compilation with CPPFLAGS="-I/usr/local/ssl/include" \ LDFLAGS="-L/usr/local/ssl/lib -Wl,-rpath=/usr/local/ssl/lib" \ SSL_LIBS="-L/usr/local/ssl/lib -Wl,-rpath=/usr/local/ssl/lib" \ ./configure \ --prefix=/opt/dovecot-2.2.5 \ --enable-asserts \ --enable-largefile \ --with-ldap=yes \ --with-zlib \ --with-bzlib \ --with-libcap \ --with-ssl=openssl \ --with-gc \ --with-storages=maildir,mbox,mdbox,cydir \ create a working Dovecot, but it still uses the very old Debian 6 OpenSSL 0.9.8 instead my OpenSSL 1.0.1e LD_LIBRARY_PATH has also no effect, because Dovecot strips it out. Any hints? regards Christian

2 1

[Dovecot] Using dovecot in performance tests?
by Michal Zatloukal 16 Aug '13

16 Aug '13

Hello, please Cc me into replies, I'm not subscribed. My job as of late involves testing the performance of software that functions as IMAP/POP proxy. I have an account set up where a known collection of emails is delivered from postfix, and is then dowloaded by MUA on the test machine. The thing is, sending the emails (from a separate machine on LAN) actually takes more time than the download by MUA and is (probably?) an unnecessary load on the system that I could avoid. Ideally, I would like dovecot to treat all messages in a user's mail store as always-new, ie. they would be downloaded whenever the user connected (MUA settings and state permitting). Is something like that possible? Michal Zatloukal

1 0

[Dovecot] lda and home directory
by Bob Miller 16 Aug '13

16 Aug '13

Hello, I am using qmail and lda configured such that lda should not have to do a lookup for delivery. I set my defaultdelivery like so: |HOME=/home/mail/$USER /var/qmail/bin/preline -f /usr/local/libexec/dovecot/dovecot-lda Given that the email address being delivered to is bob.miller(a)computerisms.com, I expect $USER to be equal to bob.miller and $HOME to expand to /home/mail/bob.miller/. The problem is lda reports: Debug:_Home_dir_not_found:_/home/mail/bob.miller@computerisms.com/ The whole system up to here uses only the bob.miller part, and I can't find where it keeps adding the domain part from. I have tried changing all sorts of variables and config values to try and make it quit adding the domain part, but no matter what I change lda still tries to deliver the email address as username. The only measure of success I can report is that in some configurations mail delivers to /home/mail//. Where exactly is dovecot getting this value? Side question: I note in places throughout the wiki and internet variables such as $EXT, $USER, $DEST_USERNAME, and $FROM_ENVELOPE are used. I can find no documentation, beyond my own common sense anyway, to explain how/when these variables are expanded, and what I do find doesn't seem consistent to me. For example, on the CheckPassword page, $USER is implied to expand to Username, which could contain the domain or not. However on the lda/qmail page, the variable shown is $EXT@ $USER, which implies $USER will expand as only the domain part after the @ symbol and $EXT as everything before, yet changing the variable from $USER to $EXT in my defaultdelivery file has $HOME expand to /home/mail//. Where do I find the story on how these variables (as opposed to the % variables) work? (or more specifically, is there a $VAR I can use instead of $USER that will expand to just the part before the @?) -- Computerisms Bob Miller 867-334-7117 / 867-633-3760 http://computerisms.ca

2 2

[Dovecot] dovecot solr position index
by duonut 16 Aug '13

16 Aug '13

Hi I am currently running dovecot 2.2.5 and solr 4.4.0 I am using the pre supplied schema.xml with dovecot with a single change f field type from test to text_general to get it running. When I do a multi word search in a mailbox, solr complains that a position index has not been built, throws a 500 error and dovecot reverts back to searching each mail message. Does anyone know what change I need to make to the solr schema to build the position index? -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-solr-position-index-tp43897.ht… Sent from the Dovecot mailing list archive at Nabble.com.

1 0

[Dovecot] Couldn't drop privileges
by LuKreme 16 Aug '13

16 Aug '13

attempts to login result in: dovecot: imap-login: Login: user=<lists@*munged*>, method=PLAIN, rip=ip.xx.yy.zz, lip=75.148.117.91, mpid=75104, TLS, session=<cBjCqf/jdwAXGJaN> dovecot: imap(lists@*munged*): Error: user lists@*munged*: Couldn't drop privileges: User is missing UID (see mail_uid setting) dovecot: imap(lists@*munged*): Error: Internal error occurred. Refer to server log for more information. Local (shell) user authentication works fine. It looks to me like the authentication is working based on the first line, so I don't think the issue is in the dovecot-sql.conf.ext $ cat dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=dovecot password=dovecot default_pass_scheme = MD5-CRYPT password_query = select password from mailbox where username ='%u' user_query = select maildir from mailbox where username = '%u' # home is set in userdb static, kept for history #user_query = select concat('/usr/local/virtual/', maildir) from mailbox where username = '%u' #user_query = select concat('/usr/local/virtual/', maildir), 'vpopmail' as uid, 'postfix' as gid, from mailbox where username = '%u' #iterate_query = SELECT username AS user FROM users # 2.2.5: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.1-RELEASE i386 auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox NotJunk { auto = subscribe } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=vpopmail gid=postfix home=/usr/local/virtual/%u driver = static } I have also tried: userdb { args = uid=vpopmail gid=postfix driver = static } sql users all have their mail in /usr/local/virtual/lists@*munged* $ ls -lsd /usr/local/virtual/lists\@*munged* 8 drwxr-xr-x 12 vpopmail postfix 512 Aug 14 21:40 /usr/local/virtual/lists\@*munged* [New thread because the old one's original issue is solved] -- BUGS: There is no conversion specification for the phase of the moon." strftime(3) man page

2 7

[Dovecot] Error: dict client sent broken reply
by Chris Richards 15 Aug '13

15 Aug '13

I've been mucking about, experimenting with the expire plugin and using a dictionary. I've got the iteration query working when I do a normal expunge using: doveadm expunge -A mailbox "INBOX.Trash" savedbefore 1w and expunging works as expected. However, I've got over 12,000 accounts on this server, so I was hoping using the expire plugin to could help out. I've configured the plugin, and things kinda work, except that somewhere between 3700 and 3800 users, I abort with this: doveadm(someuseraccount@somedomain): Error: dict client (/var/run/dovecot/dict) sent broken reply doveadm(someuseraccount@somedomain): Error: Dictionary iteration failed doveadm: Error: Failed to iterate through some users It consistently fails at the same user. If I delete that user from the expire database, then it appears to fail on the next user. I also see this in the logs: dovecot: dict: Error: dict client: COMMIT: Can't commit while iterating I've absolutely no idea where to go from here to troubleshoot this. Any guidance would be appreciated. Thanks, Chris doveconf -n: # 2.1.12: /etc/dovecot/dovecot.conf # OS: Linux 3.7.5-hardened-r1 x86_64 Gentoo Base System release 2.1 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@& auth_verbose_passwords = plain default_process_limit = 200 dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no login_greeting = Awaiting command... mail_location = maildir:/home/vmail/%d/%n/Maildir mail_plugins = " quota" mail_privileged_group = 100 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash 7 expire2 = Trash/* 7 expire3 = Spam 7 quota = dict:User quota:%u:proxy::quota quota_rule = *:storage=200M quota_warning = storage=99%% quota-warning 99 %n %d quota_warning2 = storage=95%% quota-warning 95 %n %d quota_warning3 = storage=80%% quota-warning 80 %n %d quota_warning4 = -storage=95%% quota-warning 'less than 95' %n %d sieve = ~/.dovecot.sieve sieve_default = /home/vmail/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_global_dir = /home/vmail/dovecot/sieve } protocols = imap pop3 sieve lmtp service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = dovecot mode = 0666 user = dovecot } user = $default_internal_user } service dict { unix_listener dict { mode = 0600 user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/dovecot/server.pem ssl_key = </etc/ssl/dovecot/server.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = sieve quota postmaster_address = postmaster@domain } protocol lda { mail_plugins = " quota sieve quota" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " quota quota imap_quota" } protocol pop3 { mail_plugins = " quota quota" } >From dovecot-dict-sql.conf.ext: connect = host=localhost dbname=maildb user=dbuser password=dbpass # CREATE TABLE quota ( # username varchar(100) not null, # bytes bigint not null default 0, # messages integer not null default 0, # primary key (username) # ); map { pattern = priv/quota/storage table = quota_usage username_field = address value_field = quota_bytes } map { pattern = priv/quota/messages table = quota_usage username_field = address value_field = quota_messages } # CREATE TABLE expires ( # username varchar(100) not null, # mailbox varchar(255) not null, # expire_stamp integer not null, # primary key (username, mailbox) # ); map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { address = $user folder = $mailbox } } dovecot-sql.conf.ext driver = mysql connect = host=/var/run/mysqld/mysqld.sock dbname=maildb user=dbuser password=dbpass default_pass_scheme = PLAIN user_query = SELECT homedir AS home, maildir AS mail, uid AS uid, gid AS gid, quota_rule AS quota_rule FROM email WHERE address = CONVERT('%u' USING latin1) AND is_alias=0; password_query = SELECT address AS user, NULL as password, homedir AS userdb_home, maildir as userdb_mail, uid AS userdb_uid, gid AS userdb_gid, quota_rule AS userdb_quota_rule, 'Y' AS nopassword FROM email WHERE address = CASE WHEN ('%d' = '') THEN CONCAT (CONVERT('%n' USING latin1), '@bordernet.com.au') ELSE CONVERT('%u' USING latin1) END AND is_alias=0 AND CheckPasswordFunc(CONVERT('%n' USING latin1), '%d', CONVERT('%w' USING latin1), '%r'); iterate_query = SELECT address AS user FROM email WHERE is_alias=0 AND length(password) > 1

3 7

[Dovecot] Sieve-storage: couldn't find storage root directory
by Asai 15 Aug '13

15 Aug '13

Greetings, Using Dovecot 2.2.4. In my DSync logs, I'm getting the error message: Error: sieve-storage: couldn't find storage root directory; sieve_dir was left unconfigured and autodetection failed However, I have the following configuration set: plugin { sieve = /vmail/%d/%n/sievescript sieve_dir = /vmail/%d/%n/ } Please, if you have a moment, tell me what I'm doing wrong here. Thank you. -- --Asai

3 5

[Dovecot] Quota to use limits from LDAP and usage from FS
by Frank Steinberg 15 Aug '13

15 Aug '13

Hi, I'm new to Dovecot (switching from Cyrus). I'm using Dovecot 2.1.7 from Ubuntu 13.04. Maildir data is stored on a Linux ext4 filesystem with quotas. I would like to use mail quota in a way, so that the usage values are taken from the filesystem's quota system by the "fs" backend, while the per-user limits get read from LDAP. Due to debugging messages, it's my impression that reading the limits from LDAP works quite well when the user process starts, but when IMAP access actually takes place, the fs backend uses the filesystem's soft limits. Can anybody confirm this behavior or is there a way to achieve what I intend? -frank

1 0