- dovecot - dovecot.org

[Dovecot] PATCH: mysql authentication
by Matthew Reimer 30 Aug '03

30 Aug '03

Here's a patch that implements mysql authentication. I started with the pgsql files and tweaked them to use mysql instead. It works for me, but there might be a couple of memory leaks. I'm welcome to suggestions on how to clean it up so it can be committed. Enjoy! Matt diff -u -r --new-file work/dovecot-0.99.10/doc/dovecot-mysql.conf work.patched/dovecot-0.99.10/doc/dovecot-mysql.conf --- work/dovecot-0.99.10/doc/dovecot-mysql.conf Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/doc/dovecot-mysql.conf Fri Aug 15 13:43:05 2003 @@ -0,0 +1,70 @@ +# For the mysql passdb module, you'll need a database with a table that +# contains fields for at least the userid and password. If you want to +# use the user@domain syntax, you might want to have a separate domain +# field as well. +# +# If your users all have the same uig/gid, and have predictable home +# directories, you can use the static userdb module to generate the home +# dir based on the userid and domain. In this case, you won't need fields +# for home, uid, or gid in the database. +# +# If you prefer to use the mysql userdb module, you'll want to add fields +# for home, uid, and gid. Here is an example table: +# +# CREATE TABLE users ( +# userid VARCHAR(128) NOT NULL, +# password VARCHAR(64) NOT NULL, +# home VARCHAR(256) NOT NULL, +# uid INTEGER NOT NULL, +# gid INTEGER NOT NULL, +# active CHAR(1) DEFAULT 'Y' NOT NULL +# ); + +db_host = localhost +db_port = 3306 +#db_unix_socket = /var/tmp/mysql.sock +db = users +db_user = dovecot-db +db_passwd = opensesame +db_client_flags = 0 + +# Default password scheme. +# +# Currently supported schemes include PLAIN, PLAIN-MD5, DIGEST-MD5, and CRYPT. +# +#default_pass_scheme = PLAIN-MD5 + +# Query to retrieve the password. +# +# The query should return one row, one column. If more than one row or column +# is returned, authentication will automatically fail. +# +# Available substitutions: +# %u = entire userid +# %n = user part of user@domain +# %d = domain part of user@domain +# +# Example: +# password_query = SELECT password FROM users WHERE userid = '%n' AND domain = '%d' +# password_query = SELECT password FROM users WHERE userid = '%u' AND active = 'Y' +# +#password_query = SELECT password FROM users WHERE userid = '%u' + +# Query to retrieve the user information. +# +# The query must return only one row. The columns to return are: +# home - Home directory +# mail - MAIL environment +# system_user - System user name (for initgroups()) +# uid - System UID +# gid - System GID +# +# Either home or mail is required. uid and gid are required. If more than one +# row is returned or there's missing fields, login will automatically fail. +# +# Examples +# user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' +# user_query = SELECT dir AS home, user AS uid, group AS gid FROM users where userid = '%u' +# user_query = SELECT home, 501 AS uid, 501 AS gid FROM users WHERE userid = '%u' +# +#user_query = SELECT home, uid, gid FROM users WHERE userid = '%u' diff -u -r --new-file work/dovecot-0.99.10/src/auth/Makefile.am work.patched/dovecot-0.99.10/src/auth/Makefile.am --- work/dovecot-0.99.10/src/auth/Makefile.am Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/Makefile.am Fri Aug 15 16:47:21 2003 @@ -19,6 +19,7 @@ auth-module.c \ db-ldap.c \ db-pgsql.c \ + db-mysql.c \ db-passwd-file.c \ login-connection.c \ main.c \ @@ -38,6 +39,7 @@ passdb-shadow.c \ passdb-vpopmail.c \ passdb-pgsql.c \ + passdb-mysql.c \ password-scheme.c \ userdb.c \ userdb-ldap.c \ @@ -45,7 +47,8 @@ userdb-passwd-file.c \ userdb-static.c \ userdb-vpopmail.c \ - userdb-pgsql.c + userdb-pgsql.c \ + userdb-mysql.c noinst_HEADERS = \ auth-login-interface.h \ @@ -54,6 +57,7 @@ auth-module.h \ db-ldap.h \ db-pgsql.h \ + db-mysql.h \ db-passwd-file.h \ common.h \ login-connection.h \ diff -u -r --new-file work/dovecot-0.99.10/src/auth/db-mysql.c work.patched/dovecot-0.99.10/src/auth/db-mysql.c --- work/dovecot-0.99.10/src/auth/db-mysql.c Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/db-mysql.c Fri Aug 22 17:56:44 2003 @@ -0,0 +1,181 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#if defined(PASSDB_MYSQL) || defined(USERDB_MYSQL) + +#include "common.h" +#include "network.h" +#include "str.h" +#include "settings.h" +#include "db-mysql.h" + +#include <limits.h> +#include <stddef.h> +#include <stdlib.h> + +#define DEF(type, name) { type, #name, offsetof(struct mysql_settings, name) } + +static struct setting_def setting_defs[] = { + DEF(SET_STR, db_host), + DEF(SET_STR, db_port), + DEF(SET_STR, db_unix_socket), + DEF(SET_STR, db), + DEF(SET_STR, db_user), + DEF(SET_STR, db_passwd), + DEF(SET_STR, db_client_flags), + DEF(SET_STR, password_query), + DEF(SET_STR, user_query), + DEF(SET_STR, default_pass_scheme) +}; + +struct mysql_settings default_mysql_settings = { + MEMBER(db_host) "localhost", + MEMBER(db_port) "0", + MEMBER(db_unix_socket) "/var/tmp/mysql.sock", + MEMBER(db) "email_accounts", + MEMBER(db_user) "dovecot", + MEMBER(db_passwd) "changeme", + MEMBER(db_client_flags) "0", + MEMBER(password_query) "SELECT password FROM users WHERE userid = '%u'", + MEMBER(user_query) "SELECT home, uid, gid FROM users WHERE userid = '%u'", + MEMBER(default_pass_scheme) "PLAIN-MD5" +}; + +static struct mysql_connection *mysql_connections = NULL; + +static int mysql_conn_open(struct mysql_connection *conn); +static void mysql_conn_close(struct mysql_connection *conn); + +void db_mysql_query(struct mysql_connection *conn, const char *query, + struct mysql_request *request) +{ + MYSQL_RES *res; + int failed; + + if (!conn->connected) { + if (!mysql_conn_open(conn)) { + request->callback(conn, request, NULL); + return; + } + } + + if (verbose_debug) + i_info("MYSQL: Performing query: %s", query); + + if (mysql_query(conn->mysql, query)) + i_info("MYSQL: Error executing query \"%s\": %s", query, + mysql_error(conn->mysql)); + + if ((res = mysql_store_result(conn->mysql))) + failed = FALSE; + else { + i_info("MYSQL: Error retrieving results: %s", + mysql_error(conn->mysql)); + failed = TRUE; + } + + request->callback(conn, request, failed ? NULL : res); + mysql_free_result(res); + i_free(request); +} + +static int mysql_conn_open(struct mysql_connection *conn) +{ + if (conn->connected) + return TRUE; + + if (conn->mysql == NULL) { + conn->mysql = mysql_init(NULL); + if (conn->mysql == NULL) { + i_error("MYSQL: mysql_init failed"); + return FALSE; + } + + if (!mysql_real_connect(conn->mysql, conn->set.db_host, + conn->set.db_user, conn->set.db_passwd, + conn->set.db, + atoi(conn->set.db_port), + conn->set.db_unix_socket, + strtoul(conn->set.db_client_flags, + NULL, 10))) { + i_error("MYSQL: Can't connect to database %s: %s", + conn->set.db, mysql_error(conn->mysql)); + return FALSE; + } + } + + conn->connected = TRUE; + return TRUE; +} + +static void mysql_conn_close(struct mysql_connection *conn) +{ + conn->connected = FALSE; + + if (conn->mysql != NULL) { + mysql_close(conn->mysql); + conn->mysql = NULL; + } +} + +static struct mysql_connection *mysql_conn_find(const char *config_path) +{ + struct mysql_connection *conn; + + for (conn = mysql_connections; conn != NULL; conn = conn->next) { + if (strcmp(conn->config_path, config_path) == 0) + return conn; + } + + return NULL; +} + +static const char *parse_setting(const char *key, const char *value, + void *context) +{ + struct mysql_connection *conn = context; + + return parse_setting_from_defs(conn->pool, setting_defs, + &conn->set, key, value); +} + +struct mysql_connection *db_mysql_init(const char *config_path) +{ + struct mysql_connection *conn; + pool_t pool; + + conn = mysql_conn_find(config_path); + if (conn != NULL) { + conn->refcount++; + return conn; + } + + pool = pool_alloconly_create("mysql_connection", 1024); + conn = p_new(pool, struct mysql_connection, 1); + conn->pool = pool; + + conn->refcount = 1; + + conn->config_path = p_strdup(pool, config_path); + conn->set = default_mysql_settings; + settings_read(config_path, parse_setting, conn); + + (void)mysql_conn_open(conn); + + conn->next = mysql_connections; + mysql_connections = conn; + return conn; +} + +void db_mysql_unref(struct mysql_connection *conn) +{ + if (--conn->refcount > 0) + return; + + mysql_conn_close(conn); + pool_unref(conn->pool); +} + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/db-mysql.h work.patched/dovecot-0.99.10/src/auth/db-mysql.h --- work/dovecot-0.99.10/src/auth/db-mysql.h Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/db-mysql.h Fri Aug 15 13:40:56 2003 @@ -0,0 +1,51 @@ +#ifndef __DB_MYSQL_H +#define __DB_MYSQL_H + +#include <mysql.h> + +struct mysql_connection; +struct mysql_request; + +typedef void mysql_query_callback_t(struct mysql_connection *conn, + struct mysql_request *request, + MYSQL_RES *res); + +struct mysql_settings { + const char *db_host; + const char *db_port; + const char *db_unix_socket; + const char *db; + const char *db_user; + const char *db_passwd; + const char *db_client_flags; + const char *password_query; + const char *user_query; + const char *default_pass_scheme; +}; + +struct mysql_connection { + struct mysql_connection *next; + + pool_t pool; + int refcount; + + char *config_path; + struct mysql_settings set; + + MYSQL *mysql; + + unsigned int connected:1; +}; + +struct mysql_request { + mysql_query_callback_t *callback; + void *context; +}; + +void db_mysql_query(struct mysql_connection *conn, const char *query, + struct mysql_request *request); + +struct mysql_connection *db_mysql_init(const char *config_path); +void db_mysql_unref(struct mysql_connection *conn); + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/master-connection.c work.patched/dovecot-0.99.10/src/auth/master-connection.c --- work/dovecot-0.99.10/src/auth/master-connection.c Mon May 26 10:27:13 2003 +++ work.patched/dovecot-0.99.10/src/auth/master-connection.c Fri Aug 22 17:56:18 2003 @@ -55,7 +55,7 @@ reply.virtual_user_idx = reply_add(buf, user->virtual_user); reply.mail_idx = reply_add(buf, user->mail); - p = strstr(user->home, "/./"); + p = user->home ? strstr(user->home, "/./") : NULL; if (p == NULL) { reply.home_idx = reply_add(buf, user->home); reply.chroot_idx = reply_add(buf, NULL); diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb-mysql.c work.patched/dovecot-0.99.10/src/auth/passdb-mysql.c --- work/dovecot-0.99.10/src/auth/passdb-mysql.c Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/passdb-mysql.c Fri Aug 15 14:24:44 2003 @@ -0,0 +1,171 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#ifdef PASSDB_MYSQL + +#include "common.h" +#include "str.h" +#include "strescape.h" +#include "var-expand.h" +#include "password-scheme.h" +#include "db-mysql.h" +#include "passdb.h" + +#include <mysql.h> +#include <stdlib.h> +#include <string.h> + +struct passdb_mysql_connection { + struct mysql_connection *conn; +}; + +struct passdb_mysql_request { + struct mysql_request request; + + enum passdb_credentials credentials; + union { + verify_plain_callback_t *verify_plain; + lookup_credentials_callback_t *lookup_credentials; + } callback; + + char password[1]; +}; + +static struct passdb_mysql_connection *passdb_mysql_conn; + +static void mysql_handle_request(struct mysql_connection *conn, + struct mysql_request *request, MYSQL_RES *res) +{ + struct passdb_mysql_request *mysql_request = + (struct passdb_mysql_request *) request; + struct auth_request *auth_request = request->context; + const char *user, *password, *scheme; + int ret = 0; + + user = auth_request->user; + password = NULL; + + if (res != NULL) { + if (mysql_num_rows(res) == 0) { + if (verbose) + i_info("mysql(%s): Unknown user", user); + } else if (mysql_num_rows(res) > 1) { + i_error("mysql(%s): Multiple matches for user", user); + } else if (mysql_num_fields(res) != 1) { + i_error("mysql(%s): Password query returned " + "more than one field", user); + } else { + MYSQL_ROW row; + + row = mysql_fetch_row(res); + if (row) + password = t_strdup(row[0]); /* XXX binary? */ + } + } + + scheme = password_get_scheme(&password); + if (scheme == NULL) { + scheme = conn->set.default_pass_scheme; + i_assert(scheme != NULL); + } + + if (mysql_request->credentials != -1) { + passdb_handle_credentials(mysql_request->credentials, + user, password, scheme, + mysql_request->callback.lookup_credentials, + auth_request); + return; + } + + /* verify plain */ + if (password == NULL) { + mysql_request->callback.verify_plain(PASSDB_RESULT_USER_UNKNOWN, + auth_request); + return; + } + + ret = password_verify(mysql_request->password, password, + scheme, user); + if (ret < 0) + i_error("mysql(%s): Unknown password scheme %s", user, scheme); + else if (ret == 0) { + if (verbose) + i_info("mysql(%s): Password mismatch", user); + } + + mysql_request->callback.verify_plain(ret > 0 ? PASSDB_RESULT_OK : + PASSDB_RESULT_PASSWORD_MISMATCH, + auth_request); +} + +static void mysql_lookup_pass(struct auth_request *auth_request, + struct mysql_request *mysql_request) +{ + struct mysql_connection *conn = passdb_mysql_conn->conn; + const char *query; + string_t *str; + + str = t_str_new(512); + var_expand(str, conn->set.password_query, + str_escape(auth_request->user), NULL); + query = str_c(str); + + mysql_request->callback = mysql_handle_request; + mysql_request->context = auth_request; + + db_mysql_query(conn, query, mysql_request); +} + +static void +mysql_verify_plain(struct auth_request *request, const char *password, + verify_plain_callback_t *callback) +{ + struct passdb_mysql_request *mysql_request; + + mysql_request = i_malloc(sizeof(struct passdb_mysql_request) + + strlen(password)); + mysql_request->credentials = -1; + mysql_request->callback.verify_plain = callback; + strcpy(mysql_request->password, password); + + mysql_lookup_pass(request, &mysql_request->request); +} + +static void mysql_lookup_credentials(struct auth_request *request, + enum passdb_credentials credentials, + lookup_credentials_callback_t *callback) +{ + struct passdb_mysql_request *mysql_request; + + mysql_request = i_new(struct passdb_mysql_request, 1); + mysql_request->credentials = credentials; + mysql_request->callback.lookup_credentials = callback; + + mysql_lookup_pass(request, &mysql_request->request); +} + +static void passdb_mysql_init(const char *args) +{ + struct mysql_connection *conn; + + passdb_mysql_conn = i_new(struct passdb_mysql_connection, 1); + passdb_mysql_conn->conn = conn = db_mysql_init(args); +} + +static void passdb_mysql_deinit(void) +{ + db_mysql_unref(passdb_mysql_conn->conn); + i_free(passdb_mysql_conn); +} + +struct passdb_module passdb_mysql = { + passdb_mysql_init, + passdb_mysql_deinit, + + mysql_verify_plain, + mysql_lookup_credentials +}; + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb.c work.patched/dovecot-0.99.10/src/auth/passdb.c --- work/dovecot-0.99.10/src/auth/passdb.c Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/passdb.c Fri Aug 15 11:39:31 2003 @@ -110,6 +110,10 @@ if (strcasecmp(name, "pgsql") == 0) passdb = &passdb_pgsql; #endif +#ifdef PASSDB_MYSQL + if (strcasecmp(name, "mysql") == 0) + passdb = &passdb_mysql; +#endif #ifdef HAVE_MODULES passdb_module = passdb != NULL ? NULL : auth_module_open(name); if (passdb_module != NULL) { diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb.h work.patched/dovecot-0.99.10/src/auth/passdb.h --- work/dovecot-0.99.10/src/auth/passdb.h Thu Mar 20 09:46:33 2003 +++ work.patched/dovecot-0.99.10/src/auth/passdb.h Fri Aug 15 16:45:43 2003 @@ -58,6 +58,7 @@ extern struct passdb_module passdb_vpopmail; extern struct passdb_module passdb_ldap; extern struct passdb_module passdb_pgsql; +extern struct passdb_module passdb_mysql; void passdb_init(void); void passdb_deinit(void); diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb-mysql.c work.patched/dovecot-0.99.10/src/auth/userdb-mysql.c --- work/dovecot-0.99.10/src/auth/userdb-mysql.c Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/userdb-mysql.c Fri Aug 22 17:53:56 2003 @@ -0,0 +1,148 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#ifdef USERDB_MYSQL + +#include "common.h" +#include "str.h" +#include "strescape.h" +#include "var-expand.h" +#include "db-mysql.h" +#include "userdb.h" + +#include <mysql.h> +#include <stdlib.h> +#include <string.h> + +struct userdb_mysql_connection { + struct mysql_connection *conn; +}; + +struct userdb_mysql_request { + struct mysql_request request; + userdb_callback_t *userdb_callback; + + char username[1]; /* variable width */ +}; + +static struct userdb_mysql_connection *userdb_mysql_conn; + +static int is_result_valid(MYSQL_RES *res) +{ + + if (res == NULL) { + i_error("MYSQL: Query failed"); + return FALSE; + } + + if (mysql_num_rows(res) == 0) { + if (verbose) + i_error("MYSQL: Authenticated user not found"); + return FALSE; + } + + /* XXX */ + if (mysql_num_fields(res) < 3) { + i_error("MYSQL: Not enough fields returned"); + return FALSE; + } +/* XXX + if (PQfnumber(res, "uid") == -1) { + i_error("MYSQL: User query did not return 'uid' field"); + return FALSE; + } + + if (PQfnumber(res, "gid") == -1) { + i_error("MYSQL: User query did not return 'gid' field"); + return FALSE; + } +*/ + + return TRUE; +} + +static const char *my_get_str(MYSQL_RES *res, MYSQL_ROW row, const char *field) +{ + int i, n_fields; + unsigned long *lengths; + MYSQL_FIELD *fields; + + n_fields = mysql_num_fields(res); + lengths = mysql_fetch_lengths(res); + fields = mysql_fetch_fields(res); + for (i = 0; i < n_fields; i++) + if (strcmp(field, fields[i].name) == 0) + return (const char *) lengths[i] == 0 ? + NULL : t_strdup(row[i]); + + return NULL; +} + +static void mysql_handle_request(struct mysql_connection *conn __attr_unused__, + struct mysql_request *request, MYSQL_RES *res) +{ + struct userdb_mysql_request *urequest = + (struct userdb_mysql_request *) request; + struct user_data user; + MYSQL_ROW row; + + if (res != NULL && is_result_valid(res) && + (row = mysql_fetch_row(res))) { + memset(&user, 0, sizeof(user)); + user.virtual_user = urequest->username; + user.system_user = my_get_str(res, row, "system_user"); + user.home = my_get_str(res, row, "home"); + user.mail = my_get_str(res, row, "mail"); + user.uid = atoi(my_get_str(res, row, "uid")); /* XXX leak */ + user.gid = atoi(my_get_str(res, row, "gid")); /* XXX leak */ + urequest->userdb_callback(&user, request->context); + } else { + urequest->userdb_callback(NULL, request->context); + } +} + +static void userdb_mysql_lookup(const char *user, userdb_callback_t *callback, + void *context) +{ + struct mysql_connection *conn = userdb_mysql_conn->conn; + struct userdb_mysql_request *request; + const char *query; + string_t *str; + + str = t_str_new(512); + var_expand(str, conn->set.user_query, str_escape(user), NULL); + query = str_c(str); + + request = i_malloc(sizeof(struct userdb_mysql_request) + strlen(user)); + request->request.callback = mysql_handle_request; + request->request.context = context; + request->userdb_callback = callback; + strcpy(request->username, user); + + db_mysql_query(conn, query, &request->request); +} + +static void userdb_mysql_init(const char *args) +{ + struct mysql_connection *conn; + + userdb_mysql_conn = i_new(struct userdb_mysql_connection, 1); + userdb_mysql_conn->conn = conn = db_mysql_init(args); +} + +static void userdb_mysql_deinit(void) +{ + db_mysql_unref(userdb_mysql_conn->conn); + i_free(userdb_mysql_conn); +} + +struct userdb_module userdb_mysql = { + userdb_mysql_init, + userdb_mysql_deinit, + + userdb_mysql_lookup +}; + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb.c work.patched/dovecot-0.99.10/src/auth/userdb.c --- work/dovecot-0.99.10/src/auth/userdb.c Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/userdb.c Fri Aug 22 13:07:21 2003 @@ -49,6 +49,10 @@ if (strcasecmp(name, "pgsql") == 0) userdb = &userdb_pgsql; #endif +#ifdef USERDB_MYSQL + if (strcasecmp(name, "mysql") == 0) + userdb = &userdb_mysql; +#endif #ifdef HAVE_MODULES userdb_module = userdb != NULL ? NULL : auth_module_open(name); if (userdb_module != NULL) { diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb.h work.patched/dovecot-0.99.10/src/auth/userdb.h --- work/dovecot-0.99.10/src/auth/userdb.h Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/userdb.h Fri Aug 22 13:07:53 2003 @@ -29,6 +29,7 @@ extern struct userdb_module userdb_vpopmail; extern struct userdb_module userdb_ldap; extern struct userdb_module userdb_pgsql; +extern struct userdb_module userdb_mysql; void userdb_init(void); void userdb_deinit(void);

2 1

[Dovecot] converting from courier-imap
by Emily 30 Aug '03

30 Aug '03

Hello. I apologize if there is a simple answer to this question, but I haven't been able to figure it out. Our people use various clients (pine 4.50 with maildir patch, eudora, messenger, outlook, squirrelmail), and all of them work with courier-imap. But I've become very interested in dovecot after reading about it, so I'm trying it out on another server. The results are mixed. Strangely enough, squirrelmail 1.4.1 works wonderfully. For some reason, it duplicates Sent, Drafts, and Trash, but I deleted the duplicates and it was fine. Mozilla messenger is also fine, but with the same duplication of those special folders. Everything seems nice and fast. But some of our users still cling to pine, which works with courier-imap using these three lines in .pinerc: inbox-path={our.server.edu/ssl/novalidate-cert/user=emily}INBOX default-fcc={our.server.edu/ssl/novalidate-cert/user=emily}INBOX.Sent folder-collections="IMAP Folders" {our.server.edu/user=emily/ssl/novalidate-cert}INBOX.[] On the test server I'm using dovecot-0.99.10 compiled against openssl-0.9.7b in Redhat 9. This pine configuration worked in courier, but when I try pine with dovecot, I can't see any folders under "Folder Collection" other than those special three (Drafts, Sent, Trash). I'm sure there's just something I'm doing wrong, but I couldn't find anything in the dovecot list archives. I would appreciate any advice on what I'm doing wrong in getting pine to see the whole collection. Thanks, -- Emily

2 1

[Dovecot] No localhost after reboot
by Bob Hall 30 Aug '03

30 Aug '03

Rebooted the server box today. Now Dovecot doesn't listen at localhost. It does listen at the LAN interface, so it is perfectly usable, but... Does anyone have any idea why it has stopped listening at localhost? Bob Hall

4 15

[Dovecot] Postgresql and Dovecot
by Michael Ducy 29 Aug '03

29 Aug '03

I am having some issues getting dovecot to work with postgres. Dovecot starts up and runs fine without using postgres (ie passwd and pam). There is nothing in /var/log/messages other than: Aug 28 12:44:05 mail dovecot: dovecot startup succeeded Then ps -A shows no running dovecot processes (or the imap-login or pop-login). I have tried with both the RPMs that are on the download page and buidling it myself on 2 different boxes (yes I configured with --with-pgsql - Red Hat 7.3 and Red Hat 9.0). Any suggestions would be appreciated as this is the only imap/pop server with pgsql support and flatfile support I can find. Michael

3 7

[Dovecot] better body and text search?
by Mark Anderson 29 Aug '03

29 Aug '03

(this is a resend, sorry if duplicate but my first post didn't get through). I was wondering what plans dovecot has for text and body search? This is one of those issues that *no* imap implementation ever seems to document :(. Not cyrus, courier, bincimap, or dovecot.... i speed-read some of the sources and found src/lib-mail/message-body-search.c After a quick scan, it seems: - it uses no text index at all, but does a linear search over the folder. - it searches only messages with content-type starting with "text/" or "message/" - it does no special parsing of "text/html", so tags and attributes would match - it appears to exclude any mime messages, since it skips "multipart/mixed" for example. - it does deal with content encoding and charset. There is a lucene-based text indexing utility for IMAP stores here: http://www.tropo.com/techno/java/lucene/imap.html But ideally there would be pluggable text indexing builtin.... -mda

2 3

[Dovecot] Custom flags.
by Maheshkumar Sabhnani 29 Aug '03

29 Aug '03

How do I define custom flags? What are added features of IMAP apart from Online access and Hierarchy folders. I created a new folder and copied couple of messages from incoming file. Where is this new folder created? Also Microsoft Outlook still shows the messages in incoming as deleted. How do I refresh list to permanently delete the messages that I have already transferred to a different folder. Mahesh

2 1

[Dovecot] Conf problems ??
by maheshkumar sabhnani 29 Aug '03

29 Aug '03

Hello, I am having problems with configuring dovecit. The imap directory was correctly made in ~/mail/.imap But I can't see any mail headers. My mbox path is ~/mail/incoming Currently I am trying to use "mbox:~/mail/:INBOX=~/mail/incoming" for configuration but it complains about missing value. Can someone send me more information on configuration directives especially mbox and INBOX. Early reply shall be appreciated. Regards, Mahesh

2 1

[Dovecot] Squirrelmail & Dovecot
by Alex 29 Aug '03

29 Aug '03

What are the optimum IMAP settings for Squirelmail on dovecot? I am having good luck with the Cyrus settings, but I would prefer to know the real truth... Thanks -Alex

3 2

[Dovecot] better body and text search?
by Mark Anderson 28 Aug '03

28 Aug '03

I was wondering what plans dovecot has for text and body search? This is one of those issues that *no* imap implementation ever seems to document :(. Not cyrus, courier, bincimap, or dovecot.... i speed-read some of the sources and found src/lib-mail/message-body-search.c After a quick scan, it seems: - it uses no text index at all, but does a linear search over the folder. - it searches only messages with content-type starting with "text/" or "message/" - it does no special parsing of "text/html", so tags and attributes would match - it appears to exclude any mime messages, since it skips "multipart/mixed" for example. - it does deal with content encoding and charset. There is a lucene-based text indexing utility for IMAP stores here: http://www.tropo.com/techno/java/lucene/imap.html But ideally there would be pluggable text indexing builtin.... -mda

1 0

[Dovecot] mail accounts for users without home dirs
by Gunter Ohrner 28 Aug '03

28 Aug '03

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi! I use dovecot on a machine where users without an existing home directory (Not my idea...) need to access their mailboxes. Unfortunately dovecot tries to chdir to the users home directory before allowing IMAP access - is there anything I can do about that besides creating a dummy-homedirectory for these users? Greetings, Gunter - -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + PGP-verschlüsselte Mails bevorzugt! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Chain-mail isn't much defence against an arrow. It certainly isn't when the arrow is being aimed between your eyes. -- (Terry Pratchett, Lords and Ladies) +-+-+-+-+-+-+-+-+-+-+-+-+ http://www.lspace.org +-+-+-+-+-+-+-+-+-+-+-+-+ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQE/SpA/0ORHvREo8l8RAvFcAJ0ZsnnRTmBUzQEuon6QLDSOWMB2lgCfVFJw C/6nmMXb8cyvOWog0cfmi6E= =iO/e -----END PGP SIGNATURE-----

4 9

[Dovecot] 0.99.11-test6
by Timo Sirainen 28 Aug '03

28 Aug '03

http://dovecot.procontrol.fi/test/ I think I've fixed the problems that were corrupting indexes with the new code. It happened every time you had expunged some messages and new messages arrived. I think this release might actually work :) disable_plaintext_auth = yes will be default from now on. It allows plaintext authentication from localhost (127.*, ::1) however. I just figured out that the lockless cache file reading prevents me from fixing the mbox code to work the same way it used to. I'm not sure actually how this would be best fixed.. Problem is that headers in mails change and move the messages around in the mailbox, so I have to keep track of them. Previously I just updated the header size in index files.. but without read locks this can't be done safely. One possibility would be to parse the whole mbox file every time when the mailbox is opened (or when it needs to be read) and save the header sizes in memory. That'd make it slower than it is today though.. Or maybe it'd work if I just grabbed exclusive lock whenever reading header sizes. They could be then copied into memory to avoid locking more than once. But that still creates locking contention if lots of clients are reading the mailbox. Exactly in the situation where I'd mostly use mboxes.. I could also save it in .imap.index file which still currently uses read-locks. But I'd rather want to get rid of them in there too.

6 14

[Dovecot] IMAP error after login
by Nicolas STRANSKY 28 Aug '03

28 Aug '03

Hello, I'm having a slight problem with Dovecot (0.99.10-0.rc2, on Debian woody). When using mozilla 1.4, there is an error message from the mailer just after login, but nothing in dovecot logs. "Alert The current command did not succeed. The mail server responded: Error in IMAP command UID: Too long argument.." How could I fix this problem ? Thanks, -- Nico J'ai une panne de micro et les parasites me brouillent l'écoute

3 3

[Dovecot] Chrooting the Mail processes
by Bert Koelewijn 25 Aug '03

25 Aug '03

Hello! Could somebody give some feedback on this configuration: - OpenBSD box with local ssh users. - /home directory mounted with nosuid,noexec. - postfix dropping mail in /home/username/mail/INBOX, with the UID/GID of the user. - dovecot: valid_chroot_dirs = /home default_mail_env = mbox:/home/%u/mail/:INBOX=/home/%u/mail/INBOX Are there any obvious ways for a local user to help dovecot escape the chroot jail? How can I check that dovecot is REALLY using /home as chroot jail for the imap process? Thanks! Bert Koelewijn

2 5

[Dovecot] Docs on the wiki
by Bob Hall 25 Aug '03

25 Aug '03

I went to the Dove Wiki page and added a couple of docs. There's a DoveWikiMainPage link at the top of the first page now. Click on that and the next page has links to the two docs. Someone who knows more than I do about wiki formatting should make this look good. The two docs are for Dovecot/OpenLDAP installation. The first is detailed instructions and the second is a cheat sheet. You don't need to contact me if you find errors; just click "Edit this page" at the bottom. Anyone who wants to use parts of my docs to use in documenting other types of installation should feel free. There's no mention of copyright policy, but I assume everthing is GPL copyleft. Bob Hall

1 0

[Dovecot] Postfix and Maildirs
by Steve Sloan 24 Aug '03

24 Aug '03

Hope someone can help me with this as I am presently stuck I am setting up a new server with Dovecot 0.99.10, Redhat 9.0, Postfix, Amavisd-new and maildir's in the users home drive. I am using Netscape mail 7.1 as the main client to access the mail store via imap which works fine and various other imap clients can access the maildirs Ok as well. The problem is when Postfix delivers a message is insists on making a second Maildir directory in the user's home drive and put the message in there. The Maildir's are being created automatically ie. I didn't use maildirmake. Even if I delete one of the Maildir's it just gets recreated again. ie. this is the test user's home drive drwx------ 10 test2 test2 4096 Aug 23 20:53 Maildir drwx------ 6 test2 test2 4096 Aug 24 11:05 Maildir This is the Maildir that the clients are using and being accessed by Dovecot drwx------ 10 test2 test2 4096 Aug 23 20:53 . drwx------ 4 test2 test2 4096 Aug 24 11:05 .. drwx------ 2 test2 test2 4096 Aug 23 19:58 cur -rw------- 1 test2 test2 5 Aug 23 19:58 .customflags drwx------ 5 test2 test2 4096 Aug 23 19:59 .Drafts drwx------ 2 test2 test2 4096 Aug 23 19:58 .INBOX drwx------ 2 test2 test2 4096 Aug 23 19:58 new drwx------ 5 test2 test2 4096 Aug 23 20:15 .Sent -rw------- 1 test2 test2 29 Aug 23 20:13 .subscriptions drwx------ 5 test2 test2 4096 Aug 23 20:11 .test drwx------ 2 test2 test2 4096 Aug 23 19:58 tmp drwx------ 5 test2 test2 4096 Aug 23 20:11 .Trash and the other one which Postfix user's drwx------ 6 test2 test2 4096 Aug 24 11:05 . drwx------ 4 test2 test2 4096 Aug 24 11:05 .. drwx------ 2 test2 test2 4096 Aug 24 11:05 cur -rw------- 1 test2 test2 5 Aug 24 11:05 .customflags drwx------ 2 test2 test2 4096 Aug 24 11:05 .INBOX drwx------ 2 test2 test2 4096 Aug 24 11:05 new drwx------ 2 test2 test2 4096 Aug 24 11:05 tmp This one has no index files and looks just like a courier Maildir For Postfix main.cf I have set home_mailbox = Maildir/ and /etc/dovecot.conf default_mail_env = maildir:/home/%u/Maildir Hope this make sense to someone Steve -- _____________________________________________ LanSol Computers 283 Sir Donald Bradman Drv. Brooklyn Park SA 5032 Ph 618 8238 3406 Fax 618 83538479 Mobile 0414 398166 Email steve(a)lansol.com.au URL www.lansol.com.au _____________________________________________

3 3

[Dovecot] Three oddities
by Bob Hall 24 Aug '03

24 Aug '03

FBSD 4.8, Dovecot-0.99.10 1) I have mail accounts for people who use Macs and Windows, so their mail is stored on a Unix box where they don't have accounts. When their mail comes in, it is stored in /var/mail/<accountname>. When I was setting this up, I used my own Unix account for testing, and that works fine. But for the other mail accounts, which don't correspond to Unix accounts, I want to give ownership of the /var/mail/* files to another account that doesn't have my privileges. However, no one can access their mail unless I own their files. As long as I own all the /var/mail/* files, everything works fine. But if I shift ownership to another account, users can log on to Dovecot but attempts to access an IMAP folder return an error. >From maillog: Aug 18 16:39:46 kongemord imap(philrodrigues): mkdir_parents(/var/mail/philrodri gues/.imap/INBOX) failed: Permission denied All files and directories in /var/mail/* are in the mail group. I tried adding dovecot to that group, but that didn't help. Since everyone can log on to Dovecot, but can't access their mail unless I own their files, I'm assuming that there's some simple ownership setting that I'm overlooking. But I haven't a clue what it is. Can someone tell me what I need to change? 2) The Macs have Eudora 4.2 installed, and the Win boxes have Eudora 5.1. The Macs can delete mail, put it in the trash, and empty the trash. The Win clients can mark mail deleted, but they can't remove it. The mail stays in the IMAP folder until the same user accesses their mail from a Mac and deletes it. If a user drags a message to another folder, a copy is created in the new folder but the old copy remains in the original folder. I'm not having this problem with Mutt, so it the problem seems to be specific to the Windows verson of Eudora. Is there a fix? 3) We're pulling our e-mail off our ISP's POP server and loading it into Dovecot to allow people to work with their mail from different machines. I'm using getmail to make the transfer. Is anyone else doing POP to IMAP, and how are they doing it? Any suggestions? TIA, Bob Hall

3 24

Re: [Dovecot] please add MySQL Support!
by Matthew Reimer 24 Aug '03

24 Aug '03

Timo Sirainen wrote: > On Sun, 2003-08-24 at 02:57, eLgino wrote: > >>Hi, Developer(s) >> >>I will use this fantastic IMAP/POP -Server but i dislike, no a realy HATE >>PostgreSQL!, please make a hack or code a MySQL support. >> >>I know its a strange mail, and "question" but every one's first choice for >>SQL-DBs is MySQL! :) and i love it!. > > > And I really hate MySQL :) I'm still hoping someone else would write the > support for it. I might end up doing it eventually, but currently > there's more important things to do. Just yesterday I got this working, using the pgsql stuff as a guide. After I clean up the patch and make sure I'm not leaking memory, I'll send it to the list. Matt

1 0

[Dovecot] please add MySQL Support!
by eLgino 24 Aug '03

24 Aug '03

Hi, Developer(s) I will use this fantastic IMAP/POP -Server but i dislike, no a realy HATE PostgreSQL!, please make a hack or code a MySQL support. I know its a strange mail, and "question" but every one's first choice for SQL-DBs is MySQL! :) and i love it!. thanks in advance eLgino

2 1

[Dovecot] ssl failure !!
by thomas may 24 Aug '03

24 Aug '03

Hi, i havent yet any problems with dovecat but in my dovecot log i get the following warning, does anybody know what its wrong. imap-login: Aug 23 22:14:47 Warning: SSL_read() syscall failed: Connection reset by peer [192.168.1.139] imap-login: Aug 23 22:14:48 Info: Login: info(a)domain1.com [192.168.1.139] -th

3 2

[Dovecot] postfix+dovecot
by eLgino 22 Aug '03

22 Aug '03

Hi folks, I will setup an mailserver with postfix an dovecot, but i would like to add the users and domains to postfix is this possible? because postfix can handle mysql. and if this possible anyone can say me HOW?, i do not find anything about this. if not anyone can say me how i do configure it with postgresql (dovecot)? ( i have NO pgsql skills). i hope anyone can understand my poor english, and thx in advance bye

1 0

[Dovecot] user database clarification
by Jared 22 Aug '03

22 Aug '03

Hi, this question gets back to a thread I started back on July 8th. (gosh how time flies) I still am not clear on why PAM is not supported for the user database. I'm in an environment that has users both in local flat files (/etc/passwd and /etc/shadow) AND in an LDAP database. Is it possible for this set up to work with dovecot? (both local and ldap users have imap/pop?) I'd prefer to just have Dovecot use PAM for user db and the password database so that I can configure PAM to try both local users and LDAP users. Thanks a lot. -jared

3 4

[Dovecot] rawlog change suggestion
by Charlie Brady 21 Aug '03

21 Aug '03

I find the separate .in and .out files rather difficult to work with. I think it would be more useful if the in/out traffic were interleaved with a prefix to indicate direction, and suffix to indicate continuation, as recordio (http://cr.yp.to/ucspi-tcp/recordio.html) does: <a0002 LIST "" "" >* LIST (\Noselect) ";" "" >a0002 OK List completed. <a0003 SELECT "INBOX" >* FLAGS (\Answered \Flagged \Deleted \Seen \Draft) >* OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags + >permitted. >* 18 EXISTS >* 0 RECENT >* OK [UNSEEN 18] First unseen. >* OK [UIDVALIDITY 1055795174] UIDs valid >* OK [UIDNEXT 6741] Predicted next UID >a0003 OK [READ-WRITE] Select completed. <a0004 STATUS "incoming.foo" (RECENT) >* STATUS "incoming.foo" (RECENT 397) >a0004 OK Status completed. <a0005 NOOP >a0005 OK NOOP completed. Comments? -- Charlie

2 2

[Dovecot] Mozilla dovecot interaction
by Eric S. Johansson 21 Aug '03

21 Aug '03

I think this is more a Mozilla bug but just a heads up the case other people complain. periodically, the Mozilla e-mail client refuses to delete messages. It shows up either as absolutely no action when you press the delete key/button or it shows activity but refuses to perform any other action in that mailbox. Sometimes if you switch to another mailbox and then come back to the mailbox you're deleting e-mail message from, the messages deleted when you re-enter the mailbox. I looked with ethereal and it looks like Mozilla is not sending any imap commands. Hence my assertion that it's a Mozilla problem. The only reason I mention it here is because something about dovecot seems to trigger the problem more quickly. I was seeing this kind of problem before but only after a week or two of uptime in the browser. Now I'm seeing it in just under a week (I think) I've only seen at once but I will keep track for future reference. I got to get me a new client... ---eric

1 0

[Dovecot] transitional weirdnesses
by Eric S. Johansson 20 Aug '03

20 Aug '03

1) not reproducible but when it occurred, its stuck: in the early transition to dovecot I would notice occasionally that messages would come up, I would delete them and then something would hang causing a major delay in the (Mozilla) e-mail client's response. When the system responded, I would notice that occasionally there would be an off by one offset between the index of messages and the message displayed. This error would persist until I killed off the index and the dovecot process. 2) very reproducible: after fetching messages from my inbox, there will be a long (30 sec.) delay. Dovecot demon is clearly busy doing something. I do have a large set of filter rules (approximately 150) sorting messages into different boxes. Is this a reason to switch to maildir? 3) just ended up with a message that displayed the entire header. Will look into this more but it's very strange. ---eric

4 14

[Dovecot] Squirrelmail and Dovecot folder namespace
by Warren Togami 19 Aug '03

19 Aug '03

I am currently using Squirrelmail and Dovecot with this setting: default_mail_env = mbox:%h/mail/:INBOX=%h/mail/INBOX It works well, however folder subscriptions in Squirrelmail annoyingly end up with "./" prefixes because Squirrelmail refuses to work without overriding the folder namespace. All of my other IMAP clients work fine without setting that option. Squirrelmail's default setting is this: $default_folder_prefix = './mail'; This setting breaks Squirrelmail: $default_folder_prefix = ''; This setting becomes default if you attempt to blank that user's preference: $default_folder_prefix = './'; The end result of this is duplicate entries in .subscriptions, one with "./" prefix and one without. Most IMAP clients handle this by showing all the folders again in a folder named ".", or Mozilla displays all folders twice. =( When I asked one of the squirrelmail developers, he said that this might be a dovecot specific problem. Any ideas? Warren Togami warren(a)togami.com

2 1

[Dovecot] Re: CVS Note
by dovecot＠spam.turbolink.net 19 Aug '03

19 Aug '03

Is mbox support working again in CVS? - Mike

2 1

[Dovecot] Questions
by Alejandro Martinez 19 Aug '03

19 Aug '03

Hi, I'm still figthing with passwd-file, virtual users and permissions. I have created the directory /var/spool/virtual/test and inside I've done a "maildirmake Maildir". I have a couple of questions : I use the same passwd-file for auth_userdb and as auth_passdb. 1) What program can I use to create the userdb file ? What I do now is to use the htpasswd program and then I complete by hand the rest of the fields (uid:group:GECOS:home:shell) htpasswd userdb test password: xxx again: xxx And then vi userdb test@test.com:ssasZXc00P1H6:502:102::/var/spool/virtual/test/:/bin/false <--by hand. I think that if I want to offer virtual mail with imap is very tedious to complete user by user. (If this second question does not fall in this list, then don't answer it) 2) I know that postfix delivers in Maildir format, and when the user is a virtual user, I do the next Modify the virtual file ---> test(a)test.com test.test.com Modify the aliases file--> test.test.com: /var/spool/virtual/test/Maildir postmap hash:virtual postaliases hash:aliases postfix reload but when I do a "echo testing | sendmail test(a)test.com " I receive an error Aug 18 15:32:44 slk90 postfix/pickup[12208]: 95C3717D5C: uid=0 from=<root> Aug 18 15:32:44 slk90 postfix/cleanup[12252]: 95C3717D5C: message-id=<20030818183244.95C3717D5C(a)slk90.equital.lx> Aug 18 15:32:44 slk90 postfix/qmgr[12209]: 95C3717D5C: from=<root(a)slk90.equital.lx>, size=291, nrcpt=1 (queue active) Aug 18 15:32:44 slk90 postfix/local[12254]: 95C3717D5C: to=<test.prueba.com(a)slk90.equital.lx>, orig_to=<test(a)prueba.com>, relay=local, delay=0, status=bounced (cannot append message to destination file /var/spool/virtual/test/Maildir: cannot open file: Permission denied) I'm confused about permissions. I set the /var/spool/virtual to dovecot.postfix and the permissions are drwxrwx--- Thanks a lot. --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com) Version: 6.0.509 / Virus Database: 306 - Release Date: 12/08/2003

2 1

[Dovecot] CVS note
by Timo Sirainen 18 Aug '03

18 Aug '03

Another large update for header caching which breaks your old indexes. I think it's working pretty nicely now. Only some smaller tweaking left to do with caching in general.

1 0

[Dovecot] more transitional joys
by Eric S. Johansson 17 Aug '03

17 Aug '03

well, now that I have moved to dovecot, I'm not getting any spam... in fact, I'm not getting e-mail at all. default_mail_env =mbox:~/IMap2/:INBOX=/var/spool/mail/%u when I first tried to access my inbox, I was told I had permission problems: Aug 14 17:47:22 harvee imap(esj): open(/var/spool/mail/esj.lock) failed: Permission denied Aug 14 17:47:22 harvee imap(esj): file_lock_dotlock() failed with mbox file /var/spool/mail/esj: Permission denied so I changed permissions on /var/spool/mail to 777 as a temporary work around. no luck. It tells me that I have no e-mail in my inbox... fat chance [root@harvee mail]# ls -l /var/spool/mail/esj -rw------- 1 esj mail 167772 Aug 14 18:05 /var/spool/mail/esj what simply obvious thing I am I missing now? ---eric

4 6

[Dovecot] 0.9.10 and Cygwin
by Tim H. 17 Aug '03

17 Aug '03

Has anybody succeeded in compiling 0.9.10 with Cygwin? I'm getting the following error:- gcc -DHAVE_CONFIG_H -I. -I. -I../.. -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -c istream-file.c istream-file.c:57: conflicting types for `_close' /usr/include/sys/unistd.h:148: previous declaration of `_close' istream-file.c:129: conflicting types for `_read' /usr/include/sys/unistd.h:153: previous declaration of `_read' make: *** [istream-file.o] Error 1 Thanks Tim

2 1

[Dovecot] login w/ IMAP & LDAP
by Bob Hall 16 Aug '03

16 Aug '03

I'm getting imap-login: Internal login failure: bob whenever I try to check mail. I'm new to mail server setup, new to IMAP, and I don't know a heck of a lot about authentication schemes. I've set up Dovecot as an IMAP server on FreeBSD 4.8. I've got OpenLDAP running on the same system. Users will access mail via Eudora on Windows and Macs, so that's how I'm testing. If I try to test Dovecot using IMAP commands via telnet, Dovecot tells me LOGIN BAD Error in IMAP command received by server. I also can't telnet via localhost; I have to specify the host name, so I'm connecting via the host's external interface. I have no problem connecting to localhost on ports not used by Dovecot. So I have two questions: 1) How do I correct my configuration to make login successful? 2) How can I test Dovecot without using an MUA? If I have to use an MUA, I can't distinguish between errors in the MUA and errors in the IMAP server. Thanks for any help with these two. Configuration follows. Eudora: Server configuration: IMAP IMAP Mailbox Location Prefix: /var/mail/bob/Mail Authentication Style: passwords dovecot.conf ---------------- protocols = imap imaps imap_listen = *:143 login_user = dovecot default_mail_env = mbox:/var/mail/%u/Mail auth_userdb = ldap /usr/local/etc/dovecot-ldap.conf auth_passdb = ldap /usr/local/etc/dovecot-ldap.conf auth_user = dovecot dovecot-ldap.conf ------------------- hosts = localhost dn = cn=dovecot,dc=domain,dc=tld dnpass = ********** ldap_version = 3 base = ou=accounts,dc=domain,dc=tld deref = never scope = subtree user_attrs = uid user_filter = (&(objectClass=inetOrgPerson)(uid=%u)) pass_attrs = uid,userPassword pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)) default_pass_scheme = PLAIN slapd.conf ----------------- password-hash {CLEARTEXT} If I change this last to CRYPT (comment out the dovecot-ldap default_pass_scheme and change the slapd.conf password-hash to {CRYPT} and re-enter the password into LDAP), I get the same error. I have no problem accessing the LDAP data from the command line. If I comment out the dovecot-ldap.conf user_filter and pass_filter, I get dovecot-auth: ldap(bob): unknown user I interpret as meaning that the user_filter and pass_filter are necessary. Bob Hall

5 17

[Dovecot] Startup Problem
by Tobias Sasse 15 Aug '03

15 Aug '03

Hello, i don't like asking stupid questions in mailinglist, 'cause i guess you got something better to do than answer it. But well this is an exception, because i didn't find anything on google. Here comes my problem: I'm using a NetBSD 1.6.0 System with the latest dovecot build. i want to start dovecot imapd by: root@balin:[/etc]$ ./rc.d/dovecot start Starting dovecot. Fatal: Error in configuration file /usr/pkg/etc/dovecot.conf line 88: Missing value This is my error ;) This is the line 88 in my conf file. maildir:/home/%u/mail the maildir was created by 'makemaildir mail' and exists: root@balin:[/home/tobi]$ ls -all total 18 drwxr-xr-x 4 tobi users 512 Aug 15 09:11 . drwxr-xr-x 3 root wheel 512 Aug 13 01:18 .. drwx------ 5 tobi users 512 Aug 14 12:47 mail there it is. in default option of the maildir line dovecot starts without problems but i really want to have my mails in /home/%u/mail and not in /var/mail/%1u/%u/mail So could somebody please put some light on it? Thank you, Tobi

2 1

[Dovecot] joys of transition.
by Eric S. Johansson 15 Aug '03

15 Aug '03

Red Hat 8.0 stock dovecot 99.10 for a variety of reasons, I decided to cut over to dovecot this morning. I extracted all of my mailboxes from mbx purgatory back to mbox purgatory, set up dovecot and proceed to get authentication failures. (am using simple password based authentication either direct or through pam) I turned authentication verbosity on and got: Aug 14 11:51:38 harvee dovecot: Dovecot starting up Aug 14 11:51:46 harvee dovecot-auth: PAM: pam_authenticate(esj) failed: Authentication failure Aug 14 11:51:49 harvee dovecot-auth: PAM: pam_authenticate(esj) failed: Authentication failure Aug 14 11:51:52 harvee imap-login: Aborted login [192.168.0.10] not very informative. I already know that I can't login. So I fire up ethereal and capture the following transaction: * OK dovecot ready. 1 authenticate login 1 NO Unsupported authentication mechanism. 2 login "esj" "no peeking" 2 NO Authentication failed. 3 authenticate login 3 NO Unsupported authentication mechanism. 4 login "esj" "no peeking" 4 NO Authentication failed. 5 logout * BYE Logging out 5 OK Logout completed. hmm no unsupported authentication mechanism. So that means all authentication methods works right? ;-) looking a little further into the configuration, I see instructions to change auth_methods to add plain in front of digest-md5 (or is it digest_md5, both forms are present in the configuration file). No luck. Doing so gives me the following error message: Fatal: Error in configuration file /usr/local/etc/dovecot.conf line 430: Unknown setting: methods so, I'm not sure what to look for. It's probably something simple but googling didn't reveal anything pertinent although it turned up something amusing[1]and dovecot does apply. Suggestions or clues would be welcome. FYI, you probably could use a little bit more detail in the install instructions. For example instructing user to create a dovecot user and group name would be useful as would be a startup/shutdown script for init.d. I also find the SSL configuration lacking. On the other hand, I have enough scar tissue from certificates and mini-CA setups to hate them till the end of time. If I get them working better, I'll document and send it to the list. ---eric [1]http://www.oblomovka.com/eldritch/iag/ob1-5.htm

2 2

[Dovecot] error in config file?
by Robert S. Jagger 15 Aug '03

15 Aug '03

When I start dovecot I am getting an error about the ocnfig file. watson:~# /etc/init.d/dovecot start Starting mail server: dovecotFatal: Error in configuration file /etc/dovecot.conf line 185: Missing value So I look int /etc/dovecot.conf and line 185 is mbox:~/mail/:INBOX=/var/mail/%u/ Which seems like valid syntax according to the docs. I am using dovecot 0.99.10-2

2 1

[Dovecot] Mozilla
by Stefan Sels 14 Aug '03

14 Aug '03

Hi, I hope this problem is not answered before. Mozilla is making trouble with searching and subscribing folders. Do I have to change the "namespace" ? If I start a search (other than just in To & CC or subject) mozilla complains about a closed connection. A fresh mozilla installation just lists no folder beside "Inbox". Regards, Stefan Sels

3 4

[Dovecot] Hardlinks in copy
by Andreas Aardal Hanssen 12 Aug '03

12 Aug '03

Hi, Dovecotters. In the Maildir code, dovecot-0.99.10/src/lib-storage/index/maildir/maildir-copy.c, I see that hardlinks are used. It seems that (line 185) if MAILDIR_COPY_WITH_HARDLINKS is exported, then copying is attempted by using link. Having problems reading the source / flow of control, I resort to this list. When a file is linked, the mtime is naturally kept on the destination. This gives the destination message the same internaldate as the original. The destination mailbox would then be likely to get an arrival with an earlier internaldate than its newest message. The IMAP protocol says to bump UIDVALIDITY when this happens. Does Dovecot always bump UIDVALIDITY when messages are copied, or is not the mtime used for internaldate? Best regards, Andreas -- Andreas Aardal Hanssen

2 1

[Dovecot] 0.99.10-test5
by Timo Sirainen 12 Aug '03

12 Aug '03

Again at http://dovecot.procontrol.fi/test/ if someone wants to test it. - new index file code should work now - mbox support is completely broken - caching isn't very smart yet. it always caches only what client requested at the time - header caching might have some problems actually now that I think of it.. I was anyway going to change a bit how it worked.

2 1

[Dovecot] CVS/test version config/build failures on FreeBSD
by Mike Brown 11 Aug '03

11 Aug '03

While diagnosing a problem I was having with IMAP and SSL (which I ended up fixing by simply upgrading from 0.99.9.1 to 0.99.10, and possibly affected by upgrading openssl libs from 0.9.7a to 0.9.7.b), I attempted to try the CVS version of Dovecot. When using the CVS version, apparently I have to first generate 'configure' using autogen.sh (?). This was the result of that, on FreeBSD 4.8-STABLE (2003-08-06): # ./autogen.sh automake: configure.in: installing `./install-sh' automake: configure.in: installing `./mkinstalldirs' automake: configure.in: installing `./missing' configure.in: 3: required file `./config.h.in' not found automake: configure.in: installing `./depcomp' configure.in:3: warning: do not use m4_patsubst: use patsubst or m4_bpatsubst configure.in:13: warning: AC_ARG_PROGRAM invoked multiple times configure.in:1126: warning: do not use m4_regexp: use regexp or m4_bregexp autoheader: `config.h.in' is created And then... # ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... no checking for mawk... no checking for nawk... nawk checking whether make sets ${MAKE}... yes checking whether to enable maintainer-specific portions of Makefiles... no checking for style of include used by make... GNU checking for gcc... gcc checking for C compiler default output... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking dependency style of gcc... gcc checking for strerror in -lcposix... no checking for gcc... (cached) gcc checking whether we are using the GNU C compiler... (cached) yes checking whether gcc accepts -g... (cached) yes checking dependency style of gcc... (cached) gcc checking how to run the C preprocessor... gcc -E checking for ANSI C header files... yes checking for gcc option to accept ANSI C... none needed checking for inline... inline checking build system type... i386-unknown-freebsdelf4.8 checking host system type... i386-unknown-freebsdelf4.8 checking for ranlib... ranlib checking for ld used by GCC... /usr/libexec/elf/ld checking if the linker (/usr/libexec/elf/ld) is GNU ld... yes checking for BSD-compatible nm... /usr/bin/nm -B checking whether ln -s works... yes loading cache /dev/null within ltconfig ./ltconfig: .: /dev/null: not a regular file ltconfig: you must specify a host type if you use `--no-verify' Try `ltconfig --help' for more information. configure: error: libtool configure failed I also attempted to use 0.99.11-test4 from http://dovecot.procontrol.fi/test/, but this failed to build: [...] Making all in maildir gcc -DHAVE_CONFIG_H -I. -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-index/maildir -I../../../../src/lib-storage -I../../../../src/lib-storage/index -I/usr/local/include -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -c maildir-copy.c make: don't know how to make ../../../../src/lib-storage/index/index-expunge.h. Stop *** Error code 1 Stop in /usr/local/src/dovecot/dovecot-0.99.11-test4/src/lib-storage/index. Just thought you'd like to know :) -Mike

3 8

[Dovecot] Some benchmarking
by Timo Sirainen 11 Aug '03

11 Aug '03

So I finally got the new mail caching code fully working in normal conditions. Index rebuilding and some error correction still needs a bit work. mbox is also still broken. Anyway, I was mostly interested how fast Dovecot now works with my 367000 LKML mails, but thought I'd have to get something to compare the results against, so here's Dovecot vs. Courier. Results against older Dovecot would have been pretty boring, the older Dovecot could never perform threading without opening all the files and reading References-headers from them. Sorting would could have been done from cache if IMAP ENVELOPEs were cached, I'd estimate maybe 2-3x larger user CPU usage with it and a _lot_ larger cache file since it would have stored from, to, etc. fields in it. Results against Cyrus would be interesting. I'll probably do those sometimes later too.. Last I checked, Cyrus was very slow at inserting the mails into it's database, it took .. was it 1-3 hours to insert all those mails, while a simple copying took maybe 20 mins. Anyway, Cyrus's caching is pretty dummy as well so I'd expect Dovecot to be many times faster in threading and likely somewhat faster in sorting.

3 2

[Dovecot] Direct RADIUS support, not via PAM
by Jethro R Binks 08 Aug '03

08 Aug '03

Hi, I'm currently testing dovecot to authenticate user passwords against a radius server, via pam_radius_auth, and that seems to work fine. However, I am running other software (Exim MTA) that also authenticates via radius, using the radiusclient library from: http://www.mcs.de/~lf/radius/ Is there any chance that this library could be used by Dovecot as a further authentication option, and save me having two separate radius configurations for two different (but related) pieces of software, and the need to install pam_radius_auth, which I don't otherwise use? Jethro. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Jethro R Binks Computing Officer, IT Services University Of Strathclyde, Glasgow, UK

2 1

[Dovecot] Slow bulk deleting
by Leslie Viljoen 07 Aug '03

07 Aug '03

Hi! I am finding Dovecot very slow to delete large numbers of messages. IS this a known problem? Leslie

2 2

[Dovecot] compile with dietlibc
by Jens Gutzeit 07 Aug '03

07 Aug '03

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, I'm used to test the software which I use with dietlibc, just to see if it could run without the bloat of glibc. While compiling dovecot 0.99.10 I got these errors: In file included from lib.h:20, from alarm-hup.c:26: compat.h:30: conflicting types for `uint_fast32_t' /opt/diet/include/stdint.h:25: previous declaration of `uint_fast32_t' I've solved this in a dirty way, but is this something which could be fixed in the future? Thanks in advance, Jens Gutzeit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQE/L/etLPHiyaqJLscRAuNGAJ9jlOQzx86T+NS9h7FfjoDi86R4ygCgs6gb 1XyNB93ybwiG4gFatz797qo= =WZod -----END PGP SIGNATURE-----

3 3

[Dovecot] thinking seriously about converting
by Eric S. Johansson 06 Aug '03

06 Aug '03

to dovecot from UW imap. I think I will go all the way to maildir while I'm at it. I was having performance problems with mbox format files and converted to mbx but it's not really yielding a huge performance gain. Deletes and moves are still rather slow at times. my mailboxes are typically 2000 to 5000 messages. I've scanned the mailing lists a bit and picked up some hints on the conversion. Any bits of advice before I convert? Since it's only my own account I'm converting (my wife likes mutt), I'm torn between two different ways of converting the mailboxes. First is to convert all of the mbx format mailboxes back to mbox. Then convert from mbox to maildir. Second is running both imap server simultaneously (obviously one on a different port number) and running some form of a tool to read from one imap server and write to the other. any better ideas? many thanks ---eric

2 1

[Dovecot] corrupt mbox, mailboxes not found, and message read status
by Jared 04 Aug '03

04 Aug '03

I'm running dovecot 0.99.10-0.rc2 deb packages for Debian Woody from braincells.com. My old environment was a server running UW-IMAP for IMAP and POP services. We are still using mbox for all mailboxes. I use IMP for web based access. Forgive me if these issues have already been discussed or fixed in cvs. Any additional pointers to this info. would be appreciated. I have noticed a few issues. ---- I've seen a whole slew of entries like the following: pop3(username): Error indexing mbox file /home/username/mail/inbox: LF not found where expected According to this mailing list post from June 16, 2003: http://dovecot.procontrol.fi/list/dovecot/2003-June/001668.html it may be because of adjacent From mail headers in a message. I've had one user that this was not the case. They said they were deleting lots of messages in IMP and when he went back to his inbox, it was empty. When I looked at the mbox file, a message had been truncated. When I deleted the imap index and removed that truncated message, the mailbox became visible again. Has the adjacent From issue been fixed? Is there a way to find out more specifically what part of the mbox file dovecot is unhappy about? ie. a line number. ---- Inside IMP several users have set up a filter to send messages marked as spam by SpamAssassin into a spam folder. When they log-in or click the filter icon, the filter runs. However, now when the the filter runs, it reports: "Problem with filter rule 1: folder does not exist: mail/spam". However, the spam folder is still there, and when I open that folder in IMP, it opens just fine. I've already changed IMP's folder prefix from 'mail/' to ''. I've also tried deleting the imap index. The message still shows up and the filter fails to run. ---- With the old set-up, when I check mail with a pop3 client, the UW pop server modifies the Status and/or X-Keywords headers for the message. When the mailbox is viewed with an IMAP client such as IMP, messages that have already been downloaded via pop are marked as read. This doesn't seem to happen with dovecot. I found a Oct 19 2003 thread ( http://dovecot.procontrol.fi/list/dovecot/2002-October/000774.html ) on the mailing list where Timo said he was intending to use the X-Keywords trick. Did this ever get implemented? ---- Thanks, -jared

5 6

[Dovecot] why wont /usr/pkg/libexec/dovecot/imap see my Maildir
by Charlie Allom 04 Aug '03

04 Aug '03

When I invoke /usr/pkg/libexec/dovecot/imap from the command loine on the mail host, it logs me in, but won't see my emails: 13:22 yeled@lazy:~$ /usr/pkg/libexec/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND * UNSELECT LITERAL+ IDLE CHILDREN LISTEXT LIST-SUBSCRIBED] Logged in * as yeled 0 select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] * Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1059959635] UIDs valid * OK [UIDNEXT 1] Predicted next UID 0 OK [READ-WRITE] Select completed. I know I have many emails in there, and I can see them when I login via telnet localhost 443. Any tips? would be nice to use fetchmail with ssh here. C. -- charlie(a)rubberduck.com - Melbourne, Australia http://rubberduck.com/~yeled/ PGP: 0x14AA7941 || finger yeled(a)lazy.spodder.com

2 2

[Dovecot] Confusion
by Alejandro Martinez 02 Aug '03

02 Aug '03

Hi, I have a great confusion about mbox, maildir. I use a passwd-file to authenticate users, because I want to use non local users. I have a test user in that file that is this: test:VGRAafc3NHJwI:502:100:Usuario Virtual:/var/spool/mail/virtual/test:/no/shell I create inside /var/spool/mail/virtual/test a folder Maildir and inside Maildir /var/spool/mail/virtual/test/Maildir/cur/ /var/spool/mail/virtual/test/Maildir/new/ /var/spool/mail/virtual/test/Maildir/tmp/ I get an error when I login to the server admin@slk90 /$ telnet localhost 143 Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. * OK dovecot ready. . login test test . OK Logged in. Connection closed by foreign host. The /var/spool/mail/error is this "Aug 2 08:46:46 slk90 imap(test): Failed to create storage with data: /var/spool/mail/virtual/test/Maildir" I've tried setting default_mail_env = maildir:~/Maildir and mbox:~/Maildir, but nothing work. Any help ? Regards. --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com) Version: 6.0.506 / Virus Database: 303 - Release Date: 01/08/2003

2 1

RE: [Dovecot] corrupt mbox, mailboxes not found, and message rea d status
by Maikel Verheijen 31 Jul '03

31 Jul '03

[SNIP] > http://dovecot.procontrol.fi/list/dovecot/2002> -October/000774.html ) > > on the mailing list where Timo said he was intending to use the > > X-Keywords trick. Did this ever get implemented? > > X-Keywords have been used for a long time now. It's possible > to set \Seen flag for messages downloaded with POP3, but I > don't know if it's worth the trouble. Who uses POP3 and IMAP > mixed anyway? > A lot of our customers, since we only supported pop3 in the past, and our new webmail uses imap. :) And a lot of people don't click on "This is an imap server" when creating their account in for instance outlook-express. Kind regards, Maikel Verheijen.

3 2

[Dovecot] New index file code
by Timo Sirainen 31 Jul '03

31 Jul '03

I just had to write this even while it's not just yet in CVS, but it's only a few fixes away from being committed.. My year long dream has finally came true :) [Summary: Next release will have REALLY kickass indexes] Previously the biggest problem with caching message data in indexes was that we had to do it while syncing the mailbox, before client even saw those messages. This caused index rebuilds to be very slow since it had to go through all mails and cache all of them, even if client never would access them. Alternative was to not cache anything at all, but that wasn't really good idea either. Now Dovecot caches the data when client is actually requesting it. That way it will never do any extra work for caching something that client isn't currently interested in. There's still the anticipatory caching for data that client is likely to be interested in later, but that is done only when it doesn't cause extra disk I/O. The reason why it took this long was because it was previously too difficult with read/write locking that indexes required. I couldn't have relied on it working since changing from read lock -> write lock could deadlock and dropping the lock in the middle would have caused even more problems. So, what I did was to rewrite the cache file handling completely: - It doesn't require any locking to read from it. - It will be NFS-safe without being too costly. - The file format itself is now architecture-independent. - Uses less space than before - OpenBSD support is now worse than before, even worse than NFS-support. They should get that unified cache done. Cached data is also selected better: - Specifically requested message headers are cached (FETCH, SEARCH, SORT, THREAD, etc.) - IMAP ENVELOPE isn't treated in any special way anymore. It's treated just as if you had requested HEADER.FIELDS (Date Subject From ...etc.). - Maildir filenames aren't constantly updated in the cache file anymore. This takes more memory now, but should reduce disk I/O. There's a few more tweaks that I'll probably add later: - Maildir: When compressing cache file we update mail's filename to current one so if message's flags aren't changed often, it won't use any extra memory either. - A normal text/plain message doesn't need to have it's IMAP BODYSTRUCTURE cached. It only needs a single bit set in flags. Should reduce used space quite a lot. - Message with only one body part doesn't need to have it's body structure stored at all since it's mostly just useful for fetching body parts. Plus the body structure could be generated if message sizes were known. All this work was only for index cache file (ex. .data file). There's still the main .imap.index file and modify log files. Modify log should be easy to make NFS-safe - I'm currently using some stupid file locking to figure out when the file is safe to overwrite, but I should have simply replaced the old file with rename(). That will solve some other problems as well as make the code simpler. It should be possible to be made read-lockless as well. The main index file is more problematic though. It contains a lot of changing fields in the header, such as number of messages, number of seen messages, etc. I can't think of any way to make it safe to read these fields without locks (my previous ideas didn't actually work). Lockless reads are pretty much a must for scalable NFS-safety. I think it could be done by simply removing all the constantly changing headers. If you want to know how many seen messages there are, just read all the records in the file and count them. Expunging would be done by rewriting the file and rename()ing it over the old file. Appending new messages is a bit tricky to do safely, but I think I know how to do that too.. read/write locks allow the changing headers, but there's locking contention problems with shared mailboxes.. I think I'll make it optional how to do this. Oh, and I also thought how indexes would work with shared mailboxes. You could use one shared cache file, but each user would have their own main index and modify log. That would allow storing per-user flags in the index file and also expunge (hide) messages by removing them from user's index.

1 0

[Dovecot] Is dovecot NFS safe?
by Adam Shand 29 Jul '03

29 Jul '03

I'm migrating our mailserver from cyrus 2.0 to Postfix and Dovecot. We're using maildirs delivered to /var/maildir, which is mounted via NFS from a Netapp. My understanding was that maildir was completely happy in an NFS environment but I've seen a couple messages here recently which mention the dovecot index files not being NFS safe. Are their any caveats or gotcha's that I need to be aware of? Thanks, Adam.

4 5

[Dovecot] Namespaces
by Timo Sirainen 27 Jul '03

27 Jul '03

0.99.11-test4 release: http://dovecot.procontrol.fi/test/ Finally namespaces somewhat working. Example: namespace private { separator = / prefix = INBOX/ location = maildir:~/Maildir } namespace private { separator = / prefix = #mbox/ location = mbox:~/mail } Problems: - Mailbox listing lists only the first namespace unless you clearly ask mailboxes under some namespace. Not really a problem, but related to: - There should be only one common subscriptions file for all namespaces. This needs some thinking how to do it well. - Having multiple different mailbox formats in one namespace still isn't possible. Needs some more thinking as well.

1 0