November 2008 - dovecot

[Dovecot] Dovecot Proxy with MySQL auth
by Justin Krejci 05 Dec '08

05 Dec '08

We are looking at deploying several pop/imap servers to house the mail for 15,000 or more mailbox accounts. We are contemplating on the design and are looking at using MySQL auth (we already have a MySQL environment in place for our user auth to live) and proxy_maybe so each server can proxy for all the others and we just have a network load balancer distribute the incoming connections to all of the Dovecot servers. Each server would have its own local maildir storage for the users local to that server and all of the authentication and target backend pop/imap server data would be stored in the same MySQL database. The problem we are running into is the documentation is not very clear on this type of scenario. http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy At the bottom of this page it gives a query example of "SELECT NULL AS password, ." but that does not seem to allow for us to use the proxy_maybe if the destination server is localhost (and therefore do not proxy) it does not seem that the above query will actually send the real password for authentication. Is this a misunderstanding on our part or is the use of mysql auth + proxy_maybe not feasible? Assuming the latter we surmised using a separate instance of Dovecot on each machine to act solely as a proxy front end (use proxy instead of proxy_maybe) then on the second instance there is no proxy config and it listens on a separate TCP port like 80143 or whatever. Any input or suggestions would be appreciated. Justin Krejci

2 4

[Dovecot] Loginname - mapping
by Roald Amundsen 03 Dec '08

03 Dec '08

Hi! I have a server with a few thousand mailboxes (for a few hundred domains) on it. The usernames are following several naming conventions: username_domain domain_username username_domain.tld username-domain domain.username The reason for this chaos is that the accounts were set up on different mailservers, some imail, some linux, some with virtualmin and some manually and through aquisitons etc it has all ended up in one server. Now we are setting up atmail to replace imp. The loginprocess of atmail is a bit different in that you just type in your mail address and atmail tries a few combinations of loginnames to login. However, some of the combinations over atmail cant login to. Some of them works fine when using this line in dovecot.conf auth_username_translation = @_ Is there any facility to let dovecot do username mapping? If I eg have a file: usermapping that looks like this: user(a)domain1.com domain1_user user(a)domain2.com user_domain2 user(a)domain3.com domain3.user And yes, I know that the best way is to start again and use virtual domains and get all into one naming standard, but unfortunately, that is not going to happen. The other alternative is of course to hack into the source code of atmail, but I am not that confident in PHP. Any ideas? -- Regards Roald Amundsen

2 4

[Dovecot] Dovecot auth-worker permission denied.
by Romer Ventura 03 Dec '08

03 Dec '08

Hello, I am trying to get dovecot to use virtual users and authenticate using PAM+kerberos against Active Directory and I am running into some problems. I followed the tutorials from the wiki page from: http://www.linuxmail.info/active-directory-dovecot-pam-authentication/ And here is what I get from the /var/log/mail log: Nov 26 15:12:27 housigma20 dovecot: auth(default): client in: AUTH 1 PLAIN service=pop3 secured lip=127.0.0.1 rip=127.0.0.1 lport=110 rport=36327 resp=AGxpbnV4dABob3VzdG9u Nov 26 15:12:27 housigma20 dovecot: auth-worker(default): pam(linuxt,127.0.0.1): lookup service=dovecot Nov 26 15:12:27 housigma20 dovecot: auth-worker(default): pam(linuxt,127.0.0.1): pam_authenticate() failed: Permission denied Nov 26 15:12:29 housigma20 dovecot: auth(default): client out: FAIL 1 user=linuxt Nov 26 15:12:31 housigma20 dovecot: pop3-login: Aborted login (auth failed, 1 attempts): user=<linuxt>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Any ideas..? Other than this: http://www.dovecot.org/list/dovecot/2008-July/032455.html Thanks...! /etc/pam.d/dovecot: auth sufficient pam_krb5.so no_user_check validate account sufficient pam_permit.so Here is my dovecot n and version: # 1.1.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.16.60-0.21-xenpae i686 SUSE Linux Enterprise Server 10 (i586) protocols: pop3 pop3s imap imaps login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:~/Maildir/ mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login debug: yes debug_passwords: yes passdb: driver: pam userdb: driver: static args: uid=1004 gid=1002 home=/home/vmail/%d/%Lu socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 2

[Dovecot] Compilation of 1.1.6 fails on HP-UX 11.31
by Marc Beyer 03 Dec '08

03 Dec '08

Hi, $ uname -srv HP-UX B.11.31 U $ cc --version cc: HP C/aC++ B3910B A.06.20 [May 13 2008] Compilation fails, output of configure and make are given below. The cause of this is almost certainly that this version of HP-UX does define the QCMD macro in sys/quota.h (checked in the ifdef line 26 dovecot-1.1.6/src/plugins/quota/quota-fs.h) as well as the dqblk struct, but the latter with different fields than the Linux version. Older versions of HP-UX seem not to have contained this macro(? can't check this at the moment), which is probably why it was used to distinguish between HP-UX and Linux in quota-fs.h. Deleting lines 26-28 and 30 from dovecot-1.1.6/src/plugins/quota/quota-fs.h fixes the problem for HP-UX, but of course a real fix would need to add a more current method of distinguishing between Linux and HP-UX. If there's any more helfpul information you'd like let me know, cheers, Marc configure: ... Install prefix ...................... : /opt/dovecot-1.1.16 File offsets ........................ : 64bit I/O loop method ..................... : poll File change notification method ..... : none Building with SSL support ........... : yes (OpenSSL) Building with IPv6 support .......... : yes Building with pop3 server ........... : yes Building with mail delivery agent .. : yes Building with GSSAPI support ........ : no Building with user database modules . : static prefetch passwd passwd-file Building with password lookup modules : passwd passwd-file pam checkpassword Building with SQL drivers ............: make: ... source='quota-fs.c' object='quota-fs.lo' libtool=yes \ DEPDIR=.deps depmode=hp2 /bin/sh ../../../depcomp \ /bin/sh ../../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I/opt/openssl/include -g -D_XOPEN_SOURCE -D_XOPEN_SOURCE_EXTENDED -c -o quota-fs.lo quota-fs.c cc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I/opt/openssl/include -g -D_XOPEN_SOURCE -D_XOPEN_SOURCE_EXTENDED -c +Maked quota-fs.c -DPIC -o .libs/quota-fs.o "quota-fs.c", line 469: error #2136: struct "dqblk" has no field "dqb_curinodes" *value_r = dqblk.dqb_curinodes; ^ "quota-fs.c", line 470: error #2136: struct "dqblk" has no field "dqb_isoftlimit" *limit_r = dqblk.dqb_isoftlimit; ^ 2 errors detected in the compilation of "quota-fs.c". *** Error exit code 1

2 2

[Dovecot] Quota & expire problem
by Kari Suomela (DC) 02 Dec '08

02 Dec '08

I have managed to get the master quota working, but cannot get individual user quota to do anything. Here is a line from /etc/dovecot/passwd: _kari@karico.ca:XXXXXXXXX:502:502::/var/mail/vhosts/karico.ca/kari::userdb_quota_rule=*:bytes=600M_ Also, based on this, the expire cron job says: Unknown dict module: db # 1.1.6: /etc/dovecot.conf # OS: Linux 2.6.18-92.1.18.el5.centos.plusxen i686 CentOS release 5.2 (Final) log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot.log protocols: imap pop3 imaps pop3s listen: 209.222.57.19 ssl_listen: 209.222.57.19 verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: mail.karico.ca ready. login_greeting_capability: yes verbose_proctitle: yes mail_access_groups: virtual mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth external: verbose: yes debug: yes debug_passwords: yes socket: type: connect master: path: /var/run/dovecot/auth-master mode: 384 auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot/passwd userdb: driver: static args: uid=virtual gid=virtual home=/var/mail/vhosts/%d/%n socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: maildir:User quota quota_rule: *:storage=1G quota_rule2: Trash:storage=20%% quota_rule3: Spam:storage=30%% quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=70%% /usr/local/bin/quota-warning.sh 70 expire: Trash 7 Spam 30 expire_dict: db:/var/lib/dovecot/expire.db dict: expire: db:/var/lib/dovecot/expire.db

2 9

[Dovecot] Autocreate plugin for 1.1 - trying to patch under FreeBSD
by Proskurin Kirill 02 Dec '08

02 Dec '08

Hello all. I try to add Autocreate plugin patch to my FreeBSD host. I think I make all wrong. Could you tell me how to patch it? What I do: cd /usr/ports/mail/dovecot make extract cd cd work/dovecot-1.1.6/src/ fetch http://www.dovecot.org/patches/1.1/autocreate-plugin.c sh -x /tmp/patch.sh + export DOVECOT=~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src + gcc -fPIC -shared -g -Wall -I~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src -I~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src/src/lib -I~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src/src/lib-storage -I~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src/src/lib-mail -I~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src/src/lib-imap -DHAVE_CONFIG_H autocreate-plugin.c -o autocreate_plugin.so autocreate-plugin.c:22:17: error: lib.h: No such file or directory autocreate-plugin.c:23:26: error: mail-storage.h: No such file or directory autocreate-plugin.c:24:28: error: mail-namespace.h: No such file or directory autocreate-plugin.c:28: error: 'PACKAGE_VERSION' undeclared here (not in a function) autocreate-plugin.c:31: warning: 'struct mail_namespace' declared inside parameter list autocreate-plugin.c:31: warning: its scope is only this definition or declaration, which is probably not what you want autocreate-plugin.c:33: warning: 'struct mail_namespace' declared inside parameter list autocreate-plugin.c: In function 'autocreate_mailboxes': autocreate-plugin.c:43: warning: implicit declaration of function 'mail_namespace_find' autocreate-plugin.c:43: warning: assignment makes pointer from integer without a cast autocreate-plugin.c:45: warning: implicit declaration of function 'mail_storage_mailbox_create' autocreate-plugin.c:45: error: dereferencing pointer to incomplete type autocreate-plugin.c:46: error: 'FALSE' undeclared (first use in this function) autocreate-plugin.c:46: error: (Each undeclared identifier is reported only once autocreate-plugin.c:46: error: for each function it appears in.) autocreate-plugin.c:49: warning: implicit declaration of function 'i_snprintf' autocreate-plugin.c: At top level: autocreate-plugin.c:54: warning: 'struct mail_namespace' declared inside parameter list autocreate-plugin.c: In function 'autosubscribe_mailboxes': autocreate-plugin.c:64: warning: assignment makes pointer from integer without a cast autocreate-plugin.c:66: warning: implicit declaration of function 'mailbox_list_set_subscribed' autocreate-plugin.c:66: error: dereferencing pointer to incomplete type autocreate-plugin.c:66: error: 'TRUE' undeclared (first use in this function) autocreate-plugin.c: At top level: autocreate-plugin.c:74: warning: 'struct mail_namespace' declared inside parameter list autocreate-plugin.c: In function 'autocreate_mail_namespaces_created': autocreate-plugin.c:77: warning: passing argument 1 of 'autocreate_next_hook_mail_namespaces_created' from incompatible pointer type autocreate-plugin.c:79: warning: passing argument 1 of 'autocreate_mailboxes' from incompatible pointer type autocreate-plugin.c:80: warning: passing argument 1 of 'autosubscribe_mailboxes' from incompatible pointer type autocreate-plugin.c: In function 'autocreate_plugin_init': autocreate-plugin.c:89: error: 'hook_mail_namespaces_created' undeclared (first use in this function) autocreate-plugin.c: In function 'autocreate_plugin_deinit': autocreate-plugin.c:95: error: 'hook_mail_namespaces_created' undeclared (first use in this function) + cp autocreate_plugin.so /usr/local/lib/dovecot/imap/autocreate_plugin.so cp: autocreate_plugin.so: No such file or directory P.S. cat /tmp/patch.sh # replace * with the correct version: export DOVECOT=~/usr/ports/mail/dovecot/work/dovecot-1.1.6/src gcc -fPIC -shared -g -Wall -I$DOVECOT -I$DOVECOT/src/lib \ -I$DOVECOT/src/lib-storage -I$DOVECOT/src/lib-mail \ -I$DOVECOT/src/lib-imap -DHAVE_CONFIG_H \ autocreate-plugin.c -o autocreate_plugin.so # $PREFIX is the installation directory, e.g. /usr/local or /usr: cp autocreate_plugin.so /usr/local/lib/dovecot/imap/autocreate_plugin.so -- Best regards, Proskurin Kirill

2 3

[Dovecot] Panic in version 1.1.6
by Rob Mangiafico 01 Dec '08

01 Dec '08

Hello, We have seen a few of these panics in 1.1.6. It seems to happen when pine is being used and a POP3 check occurs at the same time (but not always), but I'm not positive this is always the case: --- Nov 22 11:10:32 lexiconn2 dovecot: Panic: POP3(techjm): file istream.c: line 76 (i_stream_read): assertion failed: (_stream-> skip != _stream->pos) Nov 22 11:10:32 lexiconn2 dovecot: POP3(techjm): Raw backtrace: pop3 [0x80c38f0] -> pop3 [0x80c394a] -> pop3 [0x80c324c] -> p op3(i_stream_read+0xda) [0x80c7dda] -> pop3 [0x80c9c6b] -> pop3(i_stream_read+0x2d) [0x80c7d2d] -> pop3 [0x80b9abe] -> pop3(i _stream_read+0x2d) [0x80c7d2d] -> pop3(i_stream_read_data+0x1d) [0x80c7e3d] -> pop3(message_get_body_size+0x5c) [0x80be85c] - > pop3(index_mail_init_stream+0x151) [0x8089571] -> pop3 [0x80717a2] -> pop3(index_mail_get_virtual_size+0x76) [0x80882b6] -> pop3(client_create+0x282) [0x8059c72] -> pop3(main+0x403) [0x805ba83] -> /lib/libc.so.6(__libc_start_main+0xdc) [0x492dec] - > pop3 [0x8059351] dovecot -n # 1.1.6: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-53.1.14.el5 i686 CentOS release 5.2 (Final) protocols: imap imaps pop3 pop3s ssl_cert_file: /usr/local/apache/conf/ssl.crt/lexiconn.com.cert ssl_key_file: /usr/local/apache/conf/ssl.key/lexiconn.com.key ssl_cipher_list: HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3 disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/:INBOX=/var/spool/mail/%u mail_full_filesystem_access: yes mmap_disable: yes fsync_disable: yes mbox_write_locks: fcntl mbox_very_dirty_syncs: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 512 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login username_format: %Lu verbose: yes passdb: driver: shadow userdb: driver: passwd --- We've enabled core dumps to try and get a gdb backtrace the next time this happens. Rob

1 1

[Dovecot] lda logging directive does'nt work...
by Jean-Claude Barbet 01 Dec '08

01 Dec '08

Hi all, I'm using Postfix + Dovecot with system users (/etc/passwd and NIS) + deliver + cmusieve; Here are some relevant lines in conf files : /etc/postfix/main.cf ... mailbox_command = /usr/lib/dovecot/deliver ... /etc/dovecot/dovecot.conf ... protocol lda { postmaster_address = postmaster(a)lri.fr mail_plugins = cmusieve deliver_log_format = msig=%m : Subject=%s : From=%f :%$ } ... I just want deliver to log more than default format...like procmail... but nothing happens...the line 'deliver_log_format' seems to be ignored. Any idea ?

2 3

[Dovecot] Dovecot POP3 problem: Authentication suddenly fails until dovecot gets restarted
by Carsten Buchenau 01 Dec '08

01 Dec '08

Hi, I am running dovecot with postfix and OTRS2 on a fresh Ubuntu 8.10 Server system. OTRS2 is configured to poll new email to otrs-incoming@localhost via POP3 every 5 minutes. It works, but after approximately 20 hours it suddenly stops working and only a restart of dovecot helps. The outage starts at different times during night (00:15 on Thursday, 1:15 on Friday, 3:20 on Saturday). I checked all cron-jobs, but couldn't find anything matching. Anyone any idea? Thanks, carsten Mail.log: Nov 29 07:10:13 wombat dovecot: auth-worker(default): pam(otrs-incoming,127.0.0.1): pam_start() failed: Critical error - immediate abort Nov 29 07:10:14 wombat dovecot: pop3-login: Aborted login (auth failed, 1 attempts): user=<otrs-incoming>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Dovecot.conf: protocols = pop3 pop3s log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail protocol imap { } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol managesieve { sieve=~/.dovecot.sieve sieve_storage=~/sieve } auth default { mechanisms = plain passdb pam { } userdb passwd { } user = root } dict { } plugin { } /etc/pam.d/dovecot: #%PAM-1.0 @include common-auth @include common-account @include common-session Manual test of POP3 Authentication: root@localhost:/etc/pam.d# telnet localhost 110 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user otrs-incoming +OK pass XXXXXX -ERR Temporary authentication failure.

2 3

[Dovecot] Relay-Ctrl, error message
by Wouter van der Schagt 30 Nov '08

30 Nov '08

Hi all, I'm trying to get Relay-Ctrl to work (as explained on http://wiki.dovecot.org/HowTo/PopBSMTPAndDovecot) however when i add: mail_executable: /usr/local/bin/envdir /etc/relay-ctrl /usr/local/bin/relay-ctrl-chdir /usr/local/bin/dovecot-settcpremoteip /usr/local/bin/relay-ctrl-allow /usr/local/libexec/dovecot/imap to /usr/local/etc/dovecot.conf I get the following error message when doing dovecot -n Error: Error in configuration file /usr/local/etc/dovecot.conf line 126: Expecting '=' Fatal: Invalid configuration in /usr/local/etc/dovecot.conf So I'm guessing i misplaced the line somewhere in the config file. Where should it be placed? Does it work for both pop3 and imap? Sincerely, - Wouter van der Schagt

2 1