- dovecot - dovecot.org

Re: [Dovecot] PATCH: mysql authentication
by Matthew Reimer 03 Oct '03

03 Oct '03

> On Fri, 2003-10-03 at 19:54, Matthew Reimer wrote: > >Here's another patch. This one isn't much different from the last patch, >except it tries a little harder to make sure that the required fields >are returned by the query (like the pgsql module does). BTW, the patch lacks configure magic to detect mysql includes and libs, and to define USERDB_MYSQL and PASSDB_MYSQL in config.h. Matt

1 0

Re: [Dovecot] PATCH: mysql authentication
by Matthew Reimer 03 Oct '03

03 Oct '03

Timo Sirainen wrote: > On Fri, 2003-10-03 at 19:54, Matthew Reimer wrote: >>One question about how t_strdup works. How and who should memory >>returned by t_strdup be freed? My patch has a function my_get_str() >>which returns the value of t_strdup, and then I do this: >> >> user.uid = atoi(my_get_str(res, row, "uid")); /* XXX leak */ >> user.gid = atoi(my_get_str(res, row, "gid")); /* XXX leak */ >> >>Will this result in a memory leak? > > > No. > > Memory allocated by t_*() functions are freed "later". There's first > t_push(), then you allocate memory, then t_pop() frees it all. So they > never leak memory, but they could allocate more memory than necessary if > called inside loop. That can be fixed by adding t_push/t_pop calls > there. Nice! Thanks for the answer Timo. Matt

1 0

Re: [Dovecot] PATCH: mysql authentication
by Matthew Reimer 03 Oct '03

03 Oct '03

Here's another patch. This one isn't much different from the last patch, except it tries a little harder to make sure that the required fields are returned by the query (like the pgsql module does). One question about how t_strdup works. How and who should memory returned by t_strdup be freed? My patch has a function my_get_str() which returns the value of t_strdup, and then I do this: user.uid = atoi(my_get_str(res, row, "uid")); /* XXX leak */ user.gid = atoi(my_get_str(res, row, "gid")); /* XXX leak */ Will this result in a memory leak? Matt diff -u -r --new-file work/dovecot-0.99.10/doc/dovecot-mysql.conf work.patched/dovecot-0.99.10/doc/dovecot-mysql.conf --- work/dovecot-0.99.10/doc/dovecot-mysql.conf Wed Dec 31 16:00:00 1969 +++ work.patched/dovecot-0.99.10/doc/dovecot-mysql.conf Tue Sep 30 12:24:00 2003 @@ -0,0 +1,70 @@ +# For the mysql passdb module, you'll need a database with a table that +# contains fields for at least the userid and password. If you want to +# use the user@domain syntax, you might want to have a separate domain +# field as well. +# +# If your users all have the same uig/gid, and have predictable home +# directories, you can use the static userdb module to generate the home +# dir based on the userid and domain. In this case, you won't need fields +# for home, uid, or gid in the database. +# +# If you prefer to use the mysql userdb module, you'll want to add fields +# for home, uid, and gid. Here is an example table: +# +# CREATE TABLE users ( +# userid VARCHAR(128) NOT NULL, +# password VARCHAR(64) NOT NULL, +# home VARCHAR(256) NOT NULL, +# uid INTEGER NOT NULL, +# gid INTEGER NOT NULL, +# active CHAR(1) DEFAULT 'Y' NOT NULL +# ); + +db_host = localhost +db_port = 3306 +#db_unix_socket = /var/tmp/mysql.sock +db = users +db_user = dovecot-db +db_passwd = opensesame +db_client_flags = 0 + +# Default password scheme. +# +# Currently supported schemes include PLAIN, PLAIN-MD5, DIGEST-MD5, and CRYPT. +# +#default_pass_scheme = PLAIN-MD5 + +# Query to retrieve the password. +# +# The query should return one row, one column. If more than one row or column +# is returned, authentication will automatically fail. +# +# Available substitutions: +# %u = entire userid +# %n = user part of user@domain +# %d = domain part of user@domain +# +# Example: +# password_query = SELECT password FROM users WHERE userid = '%n' AND domain = '%d' +# password_query = SELECT password FROM users WHERE userid = '%u' AND active = 'Y' +# +#password_query = SELECT password FROM users WHERE userid = '%u' + +# Query to retrieve the user information. +# +# The query must return only one row. The columns to return are: +# home - Home directory +# mail - MAIL environment +# system_user - System user name (for initgroups()) +# uid - System UID +# gid - System GID +# +# Either home or mail is required. uid and gid are required. If more than one +# row is returned or there's missing fields, login will automatically fail. +# +# Examples +# user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' +# user_query = SELECT dir AS home, user AS uid, group AS gid FROM users where userid = '%u' +# user_query = SELECT home, 501 AS uid, 501 AS gid FROM users WHERE userid = '%u' +# +#user_query = SELECT home, uid, gid FROM users WHERE userid = '%u' diff -u -r --new-file work/dovecot-0.99.10/src/auth/Makefile.in work.patched/dovecot-0.99.10/src/auth/Makefile.in --- work/dovecot-0.99.10/src/auth/Makefile.in Thu Jun 26 09:15:11 2003 +++ work.patched/dovecot-0.99.10/src/auth/Makefile.in Tue Sep 30 12:24:00 2003 @@ -99,10 +99,10 @@ dovecot_auth_LDADD = ../lib-settings/libsettings.a ../lib/liblib.a $(AUTH_LIBS) $(RAND_LIBS) $(MODULE_LIBS) -dovecot_auth_SOURCES = auth-module.c db-ldap.c db-pgsql.c db-passwd-file.c login-connection.c main.c master-connection.c md5crypt.c mech.c mech-anonymous.c mech-cyrus-sasl2.c mech-plain.c mech-digest-md5.c mycrypt.c passdb.c passdb-ldap.c passdb-passwd.c passdb-passwd-file.c passdb-pam.c passdb-shadow.c passdb-vpopmail.c passdb-pgsql.c password-scheme.c userdb.c userdb-ldap.c userdb-passwd.c userdb-passwd-file.c userdb-static.c userdb-vpopmail.c userdb-pgsql.c +dovecot_auth_SOURCES = auth-module.c db-ldap.c db-pgsql.c db-mysql.c db-passwd-file.c login-connection.c main.c master-connection.c md5crypt.c mech.c mech-anonymous.c mech-cyrus-sasl2.c mech-plain.c mech-digest-md5.c mycrypt.c passdb.c passdb-ldap.c passdb-passwd.c passdb-passwd-file.c passdb-pam.c passdb-shadow.c passdb-vpopmail.c passdb-pgsql.c passdb-mysql.c password-scheme.c userdb.c userdb-ldap.c userdb-passwd.c userdb-passwd-file.c userdb-static.c userdb-vpopmail.c userdb-pgsql.c userdb-mysql.c -noinst_HEADERS = auth-login-interface.h auth-master-interface.h auth-mech-desc.h auth-module.h db-ldap.h db-pgsql.h db-passwd-file.h common.h login-connection.h master-connection.h md5crypt.h mech.h mycrypt.h passdb.h password-scheme.h userdb.h userdb-vpopmail.h +noinst_HEADERS = auth-login-interface.h auth-master-interface.h auth-mech-desc.h auth-module.h db-ldap.h db-pgsql.h db-mysql.h db-passwd-file.h common.h login-connection.h master-connection.h md5crypt.h mech.h mycrypt.h passdb.h password-scheme.h userdb.h userdb-vpopmail.h mkinstalldirs = $(SHELL) $(top_srcdir)/mkinstalldirs CONFIG_HEADER = ../../config.h @@ -116,17 +116,17 @@ LDFLAGS = @LDFLAGS@ LIBS = @LIBS@ dovecot_auth_OBJECTS = auth-module.$(OBJEXT) db-ldap.$(OBJEXT) \ -db-pgsql.$(OBJEXT) db-passwd-file.$(OBJEXT) login-connection.$(OBJEXT) \ +db-pgsql.$(OBJEXT) db-mysql.$(OBJEXT) db-passwd-file.$(OBJEXT) login-connection.$(OBJEXT) \ main.$(OBJEXT) master-connection.$(OBJEXT) md5crypt.$(OBJEXT) \ mech.$(OBJEXT) mech-anonymous.$(OBJEXT) mech-cyrus-sasl2.$(OBJEXT) \ mech-plain.$(OBJEXT) mech-digest-md5.$(OBJEXT) mycrypt.$(OBJEXT) \ passdb.$(OBJEXT) passdb-ldap.$(OBJEXT) passdb-passwd.$(OBJEXT) \ passdb-passwd-file.$(OBJEXT) passdb-pam.$(OBJEXT) \ passdb-shadow.$(OBJEXT) passdb-vpopmail.$(OBJEXT) \ -passdb-pgsql.$(OBJEXT) password-scheme.$(OBJEXT) userdb.$(OBJEXT) \ +passdb-pgsql.$(OBJEXT) passdb-mysql.$(OBJEXT) password-scheme.$(OBJEXT) userdb.$(OBJEXT) \ userdb-ldap.$(OBJEXT) userdb-passwd.$(OBJEXT) \ userdb-passwd-file.$(OBJEXT) userdb-static.$(OBJEXT) \ -userdb-vpopmail.$(OBJEXT) userdb-pgsql.$(OBJEXT) +userdb-vpopmail.$(OBJEXT) userdb-pgsql.$(OBJEXT) userdb-mysql.$(OBJEXT) dovecot_auth_DEPENDENCIES = ../lib-settings/libsettings.a \ ../lib/liblib.a dovecot_auth_LDFLAGS = @@ -295,6 +295,13 @@ ../../src/lib/strfuncs.h ../../src/lib/network.h \ ../../src/lib/str.h ../../src/lib-settings/settings.h \ db-pgsql.h +db-mysql.o: db-mysql.c ../../config.h common.h ../../src/lib/lib.h \ + ../../src/lib/compat.h ../../src/lib/macros.h \ + ../../src/lib/failures.h ../../src/lib/data-stack.h \ + ../../src/lib/mempool.h ../../src/lib/imem.h \ + ../../src/lib/strfuncs.h ../../src/lib/network.h \ + ../../src/lib/str.h ../../src/lib-settings/settings.h \ + db-mysql.h login-connection.o: login-connection.c common.h ../../src/lib/lib.h \ ../../config.h ../../src/lib/compat.h ../../src/lib/macros.h \ ../../src/lib/failures.h ../../src/lib/data-stack.h \ @@ -388,6 +395,14 @@ ../../src/lib/str.h ../../src/lib/strescape.h \ ../../src/lib/var-expand.h password-scheme.h db-pgsql.h \ passdb.h mech.h auth-login-interface.h +passdb-mysql.o: passdb-mysql.c ../../config.h common.h \ + ../../src/lib/lib.h ../../src/lib/compat.h \ + ../../src/lib/macros.h ../../src/lib/failures.h \ + ../../src/lib/data-stack.h ../../src/lib/mempool.h \ + ../../src/lib/imem.h ../../src/lib/strfuncs.h \ + ../../src/lib/str.h ../../src/lib/strescape.h \ + ../../src/lib/var-expand.h password-scheme.h db-mysql.h \ + passdb.h mech.h auth-login-interface.h passdb-shadow.o: passdb-shadow.c ../../config.h common.h \ ../../src/lib/lib.h ../../src/lib/compat.h \ ../../src/lib/macros.h ../../src/lib/failures.h \ @@ -428,6 +443,13 @@ ../../src/lib/imem.h ../../src/lib/strfuncs.h \ ../../src/lib/str.h ../../src/lib/strescape.h \ ../../src/lib/var-expand.h db-pgsql.h userdb.h +userdb-mysql.o: userdb-mysql.c ../../config.h common.h \ + ../../src/lib/lib.h ../../src/lib/compat.h \ + ../../src/lib/macros.h ../../src/lib/failures.h \ + ../../src/lib/data-stack.h ../../src/lib/mempool.h \ + ../../src/lib/imem.h ../../src/lib/strfuncs.h \ + ../../src/lib/str.h ../../src/lib/strescape.h \ + ../../src/lib/var-expand.h db-mysql.h userdb.h userdb-static.o: userdb-static.c ../../config.h common.h \ ../../src/lib/lib.h ../../src/lib/compat.h \ ../../src/lib/macros.h ../../src/lib/failures.h \ diff -u -r --new-file work/dovecot-0.99.10/src/auth/db-mysql.c work.patched/dovecot-0.99.10/src/auth/db-mysql.c --- work/dovecot-0.99.10/src/auth/db-mysql.c Wed Dec 31 16:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/db-mysql.c Tue Sep 30 12:24:00 2003 @@ -0,0 +1,181 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#if defined(PASSDB_MYSQL) || defined(USERDB_MYSQL) + +#include "common.h" +#include "network.h" +#include "str.h" +#include "settings.h" +#include "db-mysql.h" + +#include <limits.h> +#include <stddef.h> +#include <stdlib.h> + +#define DEF(type, name) { type, #name, offsetof(struct mysql_settings, name) } + +static struct setting_def setting_defs[] = { + DEF(SET_STR, db_host), + DEF(SET_STR, db_port), + DEF(SET_STR, db_unix_socket), + DEF(SET_STR, db), + DEF(SET_STR, db_user), + DEF(SET_STR, db_passwd), + DEF(SET_STR, db_client_flags), + DEF(SET_STR, password_query), + DEF(SET_STR, user_query), + DEF(SET_STR, default_pass_scheme) +}; + +struct mysql_settings default_mysql_settings = { + MEMBER(db_host) "localhost", + MEMBER(db_port) "0", + MEMBER(db_unix_socket) "/var/tmp/mysql.sock", + MEMBER(db) "email_accounts", + MEMBER(db_user) "dovecot", + MEMBER(db_passwd) "changeme", + MEMBER(db_client_flags) "0", + MEMBER(password_query) "SELECT password FROM users WHERE userid = '%u'", + MEMBER(user_query) "SELECT home, uid, gid FROM users WHERE userid = '%u'", + MEMBER(default_pass_scheme) "PLAIN-MD5" +}; + +static struct mysql_connection *mysql_connections = NULL; + +static int mysql_conn_open(struct mysql_connection *conn); +static void mysql_conn_close(struct mysql_connection *conn); + +void db_mysql_query(struct mysql_connection *conn, const char *query, + struct mysql_request *request) +{ + MYSQL_RES *res; + int failed; + + if (!conn->connected) { + if (!mysql_conn_open(conn)) { + request->callback(conn, request, NULL); + return; + } + } + + if (verbose_debug) + i_info("MYSQL: Performing query: %s", query); + + if (mysql_query(conn->mysql, query)) + i_info("MYSQL: Error executing query \"%s\": %s", query, + mysql_error(conn->mysql)); + + if ((res = mysql_store_result(conn->mysql))) + failed = FALSE; + else { + i_info("MYSQL: Error retrieving results: %s", + mysql_error(conn->mysql)); + failed = TRUE; + } + + request->callback(conn, request, failed ? NULL : res); + mysql_free_result(res); + i_free(request); +} + +static int mysql_conn_open(struct mysql_connection *conn) +{ + if (conn->connected) + return TRUE; + + if (conn->mysql == NULL) { + conn->mysql = mysql_init(NULL); + if (conn->mysql == NULL) { + i_error("MYSQL: mysql_init failed"); + return FALSE; + } + + if (!mysql_real_connect(conn->mysql, conn->set.db_host, + conn->set.db_user, conn->set.db_passwd, + conn->set.db, + atoi(conn->set.db_port), + conn->set.db_unix_socket, + strtoul(conn->set.db_client_flags, + NULL, 10))) { + i_error("MYSQL: Can't connect to database %s: %s", + conn->set.db, mysql_error(conn->mysql)); + return FALSE; + } + } + + conn->connected = TRUE; + return TRUE; +} + +static void mysql_conn_close(struct mysql_connection *conn) +{ + conn->connected = FALSE; + + if (conn->mysql != NULL) { + mysql_close(conn->mysql); + conn->mysql = NULL; + } +} + +static struct mysql_connection *mysql_conn_find(const char *config_path) +{ + struct mysql_connection *conn; + + for (conn = mysql_connections; conn != NULL; conn = conn->next) { + if (strcmp(conn->config_path, config_path) == 0) + return conn; + } + + return NULL; +} + +static const char *parse_setting(const char *key, const char *value, + void *context) +{ + struct mysql_connection *conn = context; + + return parse_setting_from_defs(conn->pool, setting_defs, + &conn->set, key, value); +} + +struct mysql_connection *db_mysql_init(const char *config_path) +{ + struct mysql_connection *conn; + pool_t pool; + + conn = mysql_conn_find(config_path); + if (conn != NULL) { + conn->refcount++; + return conn; + } + + pool = pool_alloconly_create("mysql_connection", 1024); + conn = p_new(pool, struct mysql_connection, 1); + conn->pool = pool; + + conn->refcount = 1; + + conn->config_path = p_strdup(pool, config_path); + conn->set = default_mysql_settings; + settings_read(config_path, parse_setting, conn); + + (void)mysql_conn_open(conn); + + conn->next = mysql_connections; + mysql_connections = conn; + return conn; +} + +void db_mysql_unref(struct mysql_connection *conn) +{ + if (--conn->refcount > 0) + return; + + mysql_conn_close(conn); + pool_unref(conn->pool); +} + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/db-mysql.h work.patched/dovecot-0.99.10/src/auth/db-mysql.h --- work/dovecot-0.99.10/src/auth/db-mysql.h Wed Dec 31 16:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/db-mysql.h Tue Sep 30 12:24:00 2003 @@ -0,0 +1,51 @@ +#ifndef __DB_MYSQL_H +#define __DB_MYSQL_H + +#include <mysql.h> + +struct mysql_connection; +struct mysql_request; + +typedef void mysql_query_callback_t(struct mysql_connection *conn, + struct mysql_request *request, + MYSQL_RES *res); + +struct mysql_settings { + const char *db_host; + const char *db_port; + const char *db_unix_socket; + const char *db; + const char *db_user; + const char *db_passwd; + const char *db_client_flags; + const char *password_query; + const char *user_query; + const char *default_pass_scheme; +}; + +struct mysql_connection { + struct mysql_connection *next; + + pool_t pool; + int refcount; + + char *config_path; + struct mysql_settings set; + + MYSQL *mysql; + + unsigned int connected:1; +}; + +struct mysql_request { + mysql_query_callback_t *callback; + void *context; +}; + +void db_mysql_query(struct mysql_connection *conn, const char *query, + struct mysql_request *request); + +struct mysql_connection *db_mysql_init(const char *config_path); +void db_mysql_unref(struct mysql_connection *conn); + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/master-connection.c work.patched/dovecot-0.99.10/src/auth/master-connection.c --- work/dovecot-0.99.10/src/auth/master-connection.c Mon May 26 08:27:13 2003 +++ work.patched/dovecot-0.99.10/src/auth/master-connection.c Tue Sep 30 12:24:00 2003 @@ -55,7 +55,7 @@ reply.virtual_user_idx = reply_add(buf, user->virtual_user); reply.mail_idx = reply_add(buf, user->mail); - p = strstr(user->home, "/./"); + p = user->home ? strstr(user->home, "/./") : NULL; if (p == NULL) { reply.home_idx = reply_add(buf, user->home); reply.chroot_idx = reply_add(buf, NULL); diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb-mysql.c work.patched/dovecot-0.99.10/src/auth/passdb-mysql.c --- work/dovecot-0.99.10/src/auth/passdb-mysql.c Wed Dec 31 16:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/passdb-mysql.c Tue Sep 30 12:24:00 2003 @@ -0,0 +1,171 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#ifdef PASSDB_MYSQL + +#include "common.h" +#include "str.h" +#include "strescape.h" +#include "var-expand.h" +#include "password-scheme.h" +#include "db-mysql.h" +#include "passdb.h" + +#include <mysql.h> +#include <stdlib.h> +#include <string.h> + +struct passdb_mysql_connection { + struct mysql_connection *conn; +}; + +struct passdb_mysql_request { + struct mysql_request request; + + enum passdb_credentials credentials; + union { + verify_plain_callback_t *verify_plain; + lookup_credentials_callback_t *lookup_credentials; + } callback; + + char password[1]; +}; + +static struct passdb_mysql_connection *passdb_mysql_conn; + +static void mysql_handle_request(struct mysql_connection *conn, + struct mysql_request *request, MYSQL_RES *res) +{ + struct passdb_mysql_request *mysql_request = + (struct passdb_mysql_request *) request; + struct auth_request *auth_request = request->context; + const char *user, *password, *scheme; + int ret = 0; + + user = auth_request->user; + password = NULL; + + if (res != NULL) { + if (mysql_num_rows(res) == 0) { + if (verbose) + i_info("mysql(%s): Unknown user", user); + } else if (mysql_num_rows(res) > 1) { + i_error("mysql(%s): Multiple matches for user", user); + } else if (mysql_num_fields(res) != 1) { + i_error("mysql(%s): Password query returned " + "more than one field", user); + } else { + MYSQL_ROW row; + + row = mysql_fetch_row(res); + if (row) + password = t_strdup(row[0]); + } + } + + scheme = password_get_scheme(&password); + if (scheme == NULL) { + scheme = conn->set.default_pass_scheme; + i_assert(scheme != NULL); + } + + if (mysql_request->credentials != -1) { + passdb_handle_credentials(mysql_request->credentials, + user, password, scheme, + mysql_request->callback.lookup_credentials, + auth_request); + return; + } + + /* verify plain */ + if (password == NULL) { + mysql_request->callback.verify_plain(PASSDB_RESULT_USER_UNKNOWN, + auth_request); + return; + } + + ret = password_verify(mysql_request->password, password, + scheme, user); + if (ret < 0) + i_error("mysql(%s): Unknown password scheme %s", user, scheme); + else if (ret == 0) { + if (verbose) + i_info("mysql(%s): Password mismatch", user); + } + + mysql_request->callback.verify_plain(ret > 0 ? PASSDB_RESULT_OK : + PASSDB_RESULT_PASSWORD_MISMATCH, + auth_request); +} + +static void mysql_lookup_pass(struct auth_request *auth_request, + struct mysql_request *mysql_request) +{ + struct mysql_connection *conn = passdb_mysql_conn->conn; + const char *query; + string_t *str; + + str = t_str_new(512); + var_expand(str, conn->set.password_query, + str_escape(auth_request->user), NULL); + query = str_c(str); + + mysql_request->callback = mysql_handle_request; + mysql_request->context = auth_request; + + db_mysql_query(conn, query, mysql_request); +} + +static void +mysql_verify_plain(struct auth_request *request, const char *password, + verify_plain_callback_t *callback) +{ + struct passdb_mysql_request *mysql_request; + + mysql_request = i_malloc(sizeof(struct passdb_mysql_request) + + strlen(password)); + mysql_request->credentials = -1; + mysql_request->callback.verify_plain = callback; + strcpy(mysql_request->password, password); + + mysql_lookup_pass(request, &mysql_request->request); +} + +static void mysql_lookup_credentials(struct auth_request *request, + enum passdb_credentials credentials, + lookup_credentials_callback_t *callback) +{ + struct passdb_mysql_request *mysql_request; + + mysql_request = i_new(struct passdb_mysql_request, 1); + mysql_request->credentials = credentials; + mysql_request->callback.lookup_credentials = callback; + + mysql_lookup_pass(request, &mysql_request->request); +} + +static void passdb_mysql_init(const char *args) +{ + struct mysql_connection *conn; + + passdb_mysql_conn = i_new(struct passdb_mysql_connection, 1); + passdb_mysql_conn->conn = conn = db_mysql_init(args); +} + +static void passdb_mysql_deinit(void) +{ + db_mysql_unref(passdb_mysql_conn->conn); + i_free(passdb_mysql_conn); +} + +struct passdb_module passdb_mysql = { + passdb_mysql_init, + passdb_mysql_deinit, + + mysql_verify_plain, + mysql_lookup_credentials +}; + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb.c work.patched/dovecot-0.99.10/src/auth/passdb.c --- work/dovecot-0.99.10/src/auth/passdb.c Sun May 18 05:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/passdb.c Tue Sep 30 12:24:00 2003 @@ -110,6 +110,10 @@ if (strcasecmp(name, "pgsql") == 0) passdb = &passdb_pgsql; #endif +#ifdef PASSDB_MYSQL + if (strcasecmp(name, "mysql") == 0) + passdb = &passdb_mysql; +#endif #ifdef HAVE_MODULES passdb_module = passdb != NULL ? NULL : auth_module_open(name); if (passdb_module != NULL) { diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb.h work.patched/dovecot-0.99.10/src/auth/passdb.h --- work/dovecot-0.99.10/src/auth/passdb.h Thu Mar 20 07:46:33 2003 +++ work.patched/dovecot-0.99.10/src/auth/passdb.h Tue Sep 30 12:24:00 2003 @@ -58,6 +58,7 @@ extern struct passdb_module passdb_vpopmail; extern struct passdb_module passdb_ldap; extern struct passdb_module passdb_pgsql; +extern struct passdb_module passdb_mysql; void passdb_init(void); void passdb_deinit(void); diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb-mysql.c work.patched/dovecot-0.99.10/src/auth/userdb-mysql.c --- work/dovecot-0.99.10/src/auth/userdb-mysql.c Wed Dec 31 16:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/userdb-mysql.c Tue Sep 30 12:24:00 2003 @@ -0,0 +1,160 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#ifdef USERDB_MYSQL + +#include "common.h" +#include "str.h" +#include "strescape.h" +#include "var-expand.h" +#include "db-mysql.h" +#include "userdb.h" + +#include <mysql.h> +#include <stdlib.h> +#include <string.h> + +struct userdb_mysql_connection { + struct mysql_connection *conn; +}; + +struct userdb_mysql_request { + struct mysql_request request; + userdb_callback_t *userdb_callback; + + char username[1]; /* variable width */ +}; + +static struct userdb_mysql_connection *userdb_mysql_conn; + +static int is_result_valid(MYSQL_RES *res) +{ + int i, n_fields, found; + MYSQL_FIELD *fields; + + if (res == NULL) { + i_error("MYSQL: Query failed"); + return FALSE; + } + + if (mysql_num_rows(res) == 0) { + if (verbose) + i_error("MYSQL: Authenticated user not found"); + return FALSE; + } + + n_fields = mysql_num_fields(res); + fields = mysql_fetch_fields(res); + + /* Make sure the 'uid' field exists. */ + for (found = 0, i = 0; i < n_fields; i++) + if (strcmp("uid", fields[i].name) == 0) { + found = 1; + break; + } + + if (!found) { + i_error("MYSQL: User query did not return 'uid' field"); + return FALSE; + } + + /* Make sure the 'gid' field exists. */ + for (found = 0, i = 0; i < n_fields; i++) + if (strcmp("gid", fields[i].name) == 0) { + found = 1; + break; + } + + if (!found) { + i_error("MYSQL: User query did not return 'gid' field"); + return FALSE; + } + + return TRUE; +} + +static const char *my_get_str(MYSQL_RES *res, MYSQL_ROW row, const char *field) +{ + int i, n_fields; + unsigned long *lengths; + MYSQL_FIELD *fields; + + n_fields = mysql_num_fields(res); + lengths = mysql_fetch_lengths(res); + fields = mysql_fetch_fields(res); + for (i = 0; i < n_fields; i++) + if (strcmp(field, fields[i].name) == 0) + return (const char *) lengths[i] == 0 ? + NULL : t_strdup(row[i]); + + return NULL; +} + +static void mysql_handle_request(struct mysql_connection *conn __attr_unused__, + struct mysql_request *request, MYSQL_RES *res) +{ + struct userdb_mysql_request *urequest = + (struct userdb_mysql_request *) request; + struct user_data user; + MYSQL_ROW row; + + if (res != NULL && is_result_valid(res) && + (row = mysql_fetch_row(res))) { + memset(&user, 0, sizeof(user)); + user.virtual_user = urequest->username; + user.system_user = my_get_str(res, row, "system_user"); + user.home = my_get_str(res, row, "home"); + user.mail = my_get_str(res, row, "mail"); + user.uid = atoi(my_get_str(res, row, "uid")); /* XXX leak */ + user.gid = atoi(my_get_str(res, row, "gid")); /* XXX leak */ + urequest->userdb_callback(&user, request->context); + } else { + urequest->userdb_callback(NULL, request->context); + } +} + +static void userdb_mysql_lookup(const char *user, userdb_callback_t *callback, + void *context) +{ + struct mysql_connection *conn = userdb_mysql_conn->conn; + struct userdb_mysql_request *request; + const char *query; + string_t *str; + + str = t_str_new(512); + var_expand(str, conn->set.user_query, str_escape(user), NULL); + query = str_c(str); + + request = i_malloc(sizeof(struct userdb_mysql_request) + strlen(user)); + request->request.callback = mysql_handle_request; + request->request.context = context; + request->userdb_callback = callback; + strcpy(request->username, user); + + db_mysql_query(conn, query, &request->request); +} + +static void userdb_mysql_init(const char *args) +{ + struct mysql_connection *conn; + + userdb_mysql_conn = i_new(struct userdb_mysql_connection, 1); + userdb_mysql_conn->conn = conn = db_mysql_init(args); +} + +static void userdb_mysql_deinit(void) +{ + db_mysql_unref(userdb_mysql_conn->conn); + i_free(userdb_mysql_conn); +} + +struct userdb_module userdb_mysql = { + userdb_mysql_init, + userdb_mysql_deinit, + + userdb_mysql_lookup +}; + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb.c work.patched/dovecot-0.99.10/src/auth/userdb.c --- work/dovecot-0.99.10/src/auth/userdb.c Sun May 18 05:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/userdb.c Tue Sep 30 12:24:00 2003 @@ -49,6 +49,10 @@ if (strcasecmp(name, "pgsql") == 0) userdb = &userdb_pgsql; #endif +#ifdef USERDB_MYSQL + if (strcasecmp(name, "mysql") == 0) + userdb = &userdb_mysql; +#endif #ifdef HAVE_MODULES userdb_module = userdb != NULL ? NULL : auth_module_open(name); if (userdb_module != NULL) { diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb.h work.patched/dovecot-0.99.10/src/auth/userdb.h --- work/dovecot-0.99.10/src/auth/userdb.h Sun May 18 05:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/userdb.h Tue Sep 30 12:24:00 2003 @@ -29,6 +29,7 @@ extern struct userdb_module userdb_vpopmail; extern struct userdb_module userdb_ldap; extern struct userdb_module userdb_pgsql; +extern struct userdb_module userdb_mysql; void userdb_init(void); void userdb_deinit(void);

2 1

Re: [Dovecot] PATCH: mysql authentication
by Matthew Reimer 03 Oct '03

03 Oct '03

Timo Sirainen wrote: > > On Saturday, Aug 30, 2003, at 02:16 Europe/Helsinki, Matthew Reimer > wrote: > >> Here's a patch that implements mysql authentication. I started with >> the pgsql files and tweaked them to use mysql instead. It works for >> me, but there might be a couple of memory leaks. I'm welcome to >> suggestions on how to clean it up so it can be committed. > > Thank you. I'll look at it more closely later, but it looked fine with > a quick look. > > It would be nice to be able to use asynchronous database lookups. I'm > not sure how easy that is with MySQL, of if it's possible at all. With > PostgreSQL it looked annoyingly difficult so I haven't done it yet. > > Synchronous calls anyway mean that there's only one SQL statement > executing at a time and that may slow down the authentication if > there's a _lot_ of users logging in constantly. If that's a problem, > growing auth_count should help at least some. It specifies the number > of auth processes that respond to the authentication queries. > > And some day I'll probably move the sql stuff into separate lib-sql > and have only a single sql authenticator.. I'm not sure what you mean by asynchronous database lookups. Do you mean you'd like to be able to fire off a db lookup and then come back later to get the results? Like blocking vs non-blocking? I've pasted what may be relevant mysql documentation below in case it might help answer the question. N db handles could be allocated, giving us N simultaneous lookups. Matt --- From http://www.mysql.com/doc/en/C_API_function_overview.html: There are two ways for a client to process result sets. One way is to retrieve the entire result set all at once by calling mysql_store_result(). This function acquires from the server all the rows returned by the query and stores them in the client. The second way is for the client to initiate a row-by-row result set retrieval by calling mysql_use_result(). This function initialises the retrieval, but does not actually get any rows from the server. In both cases, you access rows by calling mysql_fetch_row(). With mysql_store_result(), mysql_fetch_row() accesses rows that have already been fetched from the server. With mysql_use_result(), mysql_fetch_row() actually retrieves the row from the server. Information about the size of the data in each row is available by calling mysql_fetch_lengths(). After you are done with a result set, call mysql_free_result() to free the memory used for it. The two retrieval mechanisms are complementary. Client programs should choose the approach that is most appropriate for their requirements. In practice, clients tend to use mysql_store_result() more commonly. An advantage of mysql_store_result() is that because the rows have all been fetched to the client, you not only can access rows sequentially, you can move back and forth in the result set using mysql_data_seek() or mysql_row_seek() to change the current row position within the result set. You can also find out how many rows there are by calling mysql_num_rows(). On the other hand, the memory requirements for mysql_store_result() may be very high for large result sets and you are more likely to encounter out-of-memory conditions. An advantage of mysql_use_result() is that the client requires less memory for the result set because it maintains only one row at a time (and because there is less allocation overhead, mysql_use_result() can be faster). Disadvantages are that you must process each row quickly to avoid tying up the server, you don't have random access to rows within the result set (you can only access rows sequentially), and you don't know how many rows are in the result set until you have retrieved them all. Furthermore, you must retrieve all the rows even if you determine in mid-retrieval that you've found the information you were looking for. --- end

1 0

[Dovecot] can't read attachments using javamail with dovecot
by Jonas Bosson 03 Oct '03

03 Oct '03

Dear folks, this might be a java-bug, but it seems to occur only when connecting to dovecot-IMAP. UW and Cyrus-ditto works, while when I try to read attachments (base64), I get slapped in the face with this: java.lang.NullPointerException at com.sun.mail.iap.Response.parse(Response.java:99) at com.sun.mail.iap.Response.<init>(Response.java:68) at com.sun.mail.imap.protocol.IMAPResponse.<init>(IMAPResponse.java:31) at com.sun.mail.imap.protocol.IMAPResponse.readResponse(IMAPResponse.java:105) at com.sun.mail.imap.protocol.IMAPProtocol.readResponse(IMAPProtocol.java:153) at com.sun.mail.iap.Protocol.command(Protocol.java:215) at com.sun.mail.imap.protocol.IMAPProtocol.fetch(IMAPProtocol.java:882) at com.sun.mail.imap.protocol.IMAPProtocol.fetch(IMAPProtocol.java:874) at com.sun.mail.imap.protocol.IMAPProtocol.fetchBody(IMAPProtocol.java:677) at com.sun.mail.imap.IMAPInputStream.fill(IMAPInputStream.java:74) at com.sun.mail.imap.IMAPInputStream.read(IMAPInputStream.java:105) at com.sun.mail.util.BASE64DecoderStream.decode(BASE64DecoderStream.java:143) at com.sun.mail.util.BASE64DecoderStream.read(BASE64DecoderStream.java:54) at se.illuminet.httpd.mail.MailXMLService.serviceXml(MailXMLService.java:361) This occurs in booth javamail 1.2 and 1.3(.1) using dovecot. Of course this unfriendly/unhandled response is a problem with javamail while biting the dust. Further analysis points to that the reading works OK up until 2^16 bytes, so it fails either in reading the tail of the attachment or resuming after the first buffered data is consumed. I tried the BODYSTRCUTURE-patch (booth #1 and then #2), but it didn't help. Now I am fresh out of ideas. The java-bug has a three week delay to surface on "bug-parade". But I still have to explain why it works in UW/Cyrus and not with dovecot. Next step would be to add trace-lines in dovecot. Any ideas? /Jonas

2 6

[Dovecot] pop3s in Outlook
by Antonin Karasek 03 Oct '03

03 Oct '03

Hi, I'm using Dovecot for pop3-ssl. Unofortunatelly, most of my users are using MS Outlook. I want them to be able to remove standard mesage: "The certificat is not signed by...", but I don't know how :-( In the dialog isn't a button "Trust this certificate forever"... Is there anybody, who know, how to solve this? Many thanks.

2 1

[Dovecot] Handling of X-Status flags
by Bernard Blackham 29 Sep '03

29 Sep '03

Hi all, I've done a bit of searching and haven't seen anybody else coming across this problem yet: I noticed that Dovecot uses the opposite flags for marking messages as deleted and draft to most other MUAs I've seen or used: With PINE, mutt and uw-imapd at least, messages are marked with X-Status 'D' for Deleted, and 'T' for drafT. Dovecot reverses this behaviour, using 'D' for Draft, and 'T' for Trashed. Was there any reason behind this? Or have I gone loopy? At our site, we have users reading mail with a mix of PINE locally, and through dovecot via WebMail and there seems to arise a bit of confusion between the two flags. Attached is a patch that reverses this behaviour (prepared against 0.99.10 but applies with a little fuzz to cvs). I'd like to hear people's comments on the issue... is it just me? :) Thanks, Bernard. -- Bernard Blackham bernard at blackham dot com dot au

2 2

[Dovecot] UIDPLUS?
by Keith Edmunds 29 Sep '03

29 Sep '03

Any plans to implement UIDPLUS in Dovecot? Keith

2 1

[Dovecot] Odd problem with dovecot segfaulting
by Tim Miller 29 Sep '03

29 Sep '03

Hi All, I installed dovecot on one of my servers the other day, and I want to use it in a vhosting environment. To this end, I have set it up to use password file authentication with a passwd file specified by me. This file will contain both system users and virtual accounts. To test it, I set up two accounts in the dovecot passwd file. One is a system user, I give his home dir in the correct field, along with the MD5 hash of his password in its field, and everything seems to work OK (he can login, read mail out of /var/spool/mail/user etc.). The seconmd account is a vhosted account, and I set the uid and gid to that under which the vhosting account exists. I did not set a home dir, but I set a mail dir in /var/spool/vmail/imap/vhost/user, and made this dir group writeable by dovecot. The user can login, but immediately upon authentication, dovecot segfaults (the log reports an "Internal login failure" and the authentication process is killed with signal 11, i.e. a segfault). Has anyone encountered this before? Is this even the right way to set up vhosting (I don't want to go with LDAP or SQL authentication right at the moment, but I may move to that later on)? Are there any things I should look for (this is probably due to something I've done wrong) or make dovecot be a bit more verbose in reporting errors to its log? Thanks in advance for any help. From what I've seen so far, dovecot looks like an excellent product. Best, Tim Miller

2 1

[Dovecot] pine and mozilla at the same time
by Gasha 26 Sep '03

26 Sep '03

Hi all, what is the best way to read e-mail from server using "pine" ?? I would like to use graphical IMAP client, mozilla for example. And sometimes run pine from shell. mbox or Maildir? Or maybe setup pine to use IMAP server on "localhost" ?? Gasha

2 1

[Dovecot] can't read attachments using javamail with dovecot
by Jonas Bosson 25 Sep '03

25 Sep '03

Dear folks, this might be a javamail-bug, but it seems to occur only when connecting to dovecot-IMAP. UW and Cyrus-ditto works, while when I try to read attachments (base64), I get slapped in the face with this: java.lang.NullPointerException at com.sun.mail.iap.Response.parse(Response.java:99) at com.sun.mail.iap.Response.<init>(Response.java:68) at com.sun.mail.imap.protocol.IMAPResponse.<init>(IMAPResponse.java:31) at com.sun.mail.imap.protocol.IMAPResponse.readResponse(IMAPResponse.java:105) at com.sun.mail.imap.protocol.IMAPProtocol.readResponse(IMAPProtocol.java:153) at com.sun.mail.iap.Protocol.command(Protocol.java:215) at com.sun.mail.imap.protocol.IMAPProtocol.fetch(IMAPProtocol.java:882) at com.sun.mail.imap.protocol.IMAPProtocol.fetch(IMAPProtocol.java:874) at com.sun.mail.imap.protocol.IMAPProtocol.fetchBody(IMAPProtocol.java:677) at com.sun.mail.imap.IMAPInputStream.fill(IMAPInputStream.java:74) at com.sun.mail.imap.IMAPInputStream.read(IMAPInputStream.java:105) at com.sun.mail.util.BASE64DecoderStream.decode(BASE64DecoderStream.java:143) at com.sun.mail.util.BASE64DecoderStream.read(BASE64DecoderStream.java:54) at se.illuminet.httpd.mail.MailXMLService.serviceXml(MailXMLService.java:361) This occurs in booth javamail 1.2 and 1.3(.1) using dovecot. Of course this unfriendly/unhandled response is a problem with javamail while it bites the dust. Further analysis points to that the reading works OK up until 2^16 bytes, so it fails either in reading the tail of the attachment or resuming after the first buffered data is consumed. I tried the BODYSTRCUTURE-patch (booth #1 and then #2), but it didn't help. Now I am fresh out of ideas. The java-bug has a three week delay to surface on "bug-parade". But I still have to explain why it works in UW/Cyrus and not with dovecot. Next step would be to add trace-lines in dovecot. Any ideas? /Jonas

1 0

[Dovecot] Multiple instances of .customflags staying open
by Ron 25 Sep '03

25 Sep '03

# cat /proc/version Linux version 2.4.20-18.9 (bhcompile(a)daffy.perf.redhat.com) (gcc version 3.2.2 20030222 (Red Hat Linux 3.2.2-5)) #1 Thu May 29 07:09:43 EDT 2003 # dovecot --version 0.99.10 I've just recently noticed a serious problem with my system. After about an hour or so I get errors in /var/log/maillog such as this; Sep 21 06:40:16 the-system imap(ray): opendir() failed with file \ \/home/ray/Maildir//new: Too many open files I investigated with 'lsof' and found that many copies of '.customflags' were open for each and every folder. ie; Each folder's '.customflags' file was open 15 times! I suspect that postfix is not able to store newly collected email while this is occuring, therefore I am likely losing messages. I've tried with multiple mail clients (Sylpheed & Evolution) and multiple users, always with the same result. Further investigation indicates that each time the client scans for new mail another instance of each and every '.customflags' is opened. As I have the client set for checking at five minute intervals then it was probably 75 minutes until the client barfed. Less, if I manualy scan for new mail a few times. If I shutdown the client and restart it then everything is fine for about an hour. Running 'lsof /home/ray/Maildir/.customflags' on the server I can see the list of files increasing each time the client checks for new mail. Any help would be appreciated!

4 14

[Dovecot] Re: Bug: Message time gets changed during move/copy
by Timo Sirainen 25 Sep '03

25 Sep '03

On Sat, 2003-09-13 at 13:10, Akhilesh Agarwal wrote: > SERVER > > * Redhat 9.0 stable (with all up2date updates installed) > * Sendmail-8.12.8-6.90 > * Dovecot 0.99.10 release > * On the workstation running Outlook Express, there should be > some existing messages in Local Folders. (example: message > downloaded from a POP3 server) > * Change the time zone of the workstation machine to non-GMT > time zone. In my case GMT +0530 (Indian Standard Time) > * Create a test IMAP account on the server > * Configure Outlook Express to connect to the IMAP account. > * Now select a message in the Local Folders and copy it to a > folder on the IMAP server. > * If you check the message time on the IMAP account, you will > find that +0530 hrs was added to the message time. (+0530 is > apparently the time zone of my workstation as configure above) Sorry for taking this long to reply, it always takes so much effort to turn on my Windows computer :) I cannot reproduce this. I have my server and workstation set to GMT+3 and copying message from Dovecot to OE6 local folder and back keeps the message date the same. Or actually it looks like IMAP -> local folder copies using the message's Date field rather than IMAP's INTERNALDATE which Received-field shows. I'm not sure if this could be Dovecot's or OE6's fault .. Has anyone else seen timestamps going wrong when copying? > Can anyone please confirm this and let me know, as I am not subscribed > to the list. It actually never made it to list because it was decided to be spam (mostly due to being HTML).

1 0

[Dovecot] status of maildir and mbox
by Eric S. Johansson 25 Sep '03

25 Sep '03

what is the status of mixed support of maildir and mbox at the same time? Has any progress been made? --- eric

3 7

Re: [Dovecot] PC-Pine "Junk in end of group" (fwd)
by Paul 25 Sep '03

25 Sep '03

Also, this line is popping up in my syslog. It wasn't there before the recompile: imap(paul): Error indexing mbox file /home/paul/mail/postponed-msgs: LF not found where expected Paul ---------- Forwarded message ---------- Date: Wed, 24 Sep 2003 14:17:20 -0400 (Eastern Daylight Time) From: Paul <lists(a)pote.com> To: dovecot(a)procontrol.fi Subject: Re: [Dovecot] PC-Pine "Junk in end of group" Timo, thanks - I applied the patch and recompiled, but I am still getting the same error, under the same circumstances. Paul

2 1

[Dovecot] PC-Pine "Junk in end of group"
by Paul Adams 25 Sep '03

25 Sep '03

I am running PC-Pine under Windows XP, connecting via SSL to a Dovecot IMAP server (0.99.10-2 under Debian woody). When I open a mail folder (mbox format) in Pine I get the following non-fatal error: [Junk in end of group: pn=undisclosed-recipients al= dn=] A similar error was reported to comp.mail.pine as happening with a Lotus Domino server. Mark Crispin explained it as a server-side bug: http://groups.google.com/groups?hl=en&lr=lang_en&ie=UTF-8&safe=off&threadm=… Is this something that can be easily fixed? Paul

3 3

[Dovecot] debian installation
by Ewald Geschwinde 23 Sep '03

23 Sep '03

apt-get install postfix-tls postfix-pgsql sasl2-bin libsasl2-modules postgresql libpam-pgsql Reading Package Lists... Done Building Dependency Tree... Done Some packages could not be installed. This may mean that you have requested an impossible situation or if you are using the unstable distribution that some required packages have not yet been created or been moved out of Incoming. The following information may help to resolve the situation: Sorry, but the following packages have unmet dependencies: sasl2-bin: Depends: libcomerr1-kerberos4kth (>= 1.2.2-2) but it is not installable E: Sorry, broken packages I think the new users should know this Maybe it takes some time before the sasl2-bin is update Regards Ewald Geschwinde

3 3

[Dovecot] shared folders?
by Samuel Verner 23 Sep '03

23 Sep '03

hello, does dovecot support shared folders (a very nice feature in cyrus-imapd)? sam

2 1

[Dovecot] dovecot IMAP misserving problem?
by Warren Togami 23 Sep '03

23 Sep '03

http://togami.com/~warren/archive/2003/evolution-1.4.4-crash.mbox I suspect that dovecot-0.99.10 is misserving this message in some way that is confusing some IMAP clients. This behavior causes evolution-1.4.4 to segfault, and squirrelmail-1.4.1 to be unable to read the message. The same message served by uw-imapd works works fine in both evolution and squirrelmail. https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=104288 Red Hat Bugzilla dovecot report https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=104289 Red Hat Bugzilla evolution segfault report http://bugzilla.ximian.com/show_bug.cgi?id=48418 Ximian evolution segfault report

2 6

[Dovecot] problem with auth
by Ewald Geschwinde 22 Sep '03

22 Sep '03

I'm new to dovecot (it's a cool piece of software!!!) I'm using Debian woody I'm trying to start the server but then there is this mail Do I have to set an environment variable or waht does this mean. I'm trying to use a pgsql backend for authentification and I have compiled it from source /usr/local/libexec/dovecot/dovecot-auth start dovecot-auth: Fatal: MECHANISMS environment is unset Regards Ewald Geschwinde

2 1

[Dovecot] feature request: maildirquota
by Eero Volotinen 21 Sep '03

21 Sep '03

Hope maildirquota++ is soon supported, without it, dovecot is useless in my use (mail hosting with maildirquotas). Also QUOTA cabability in dovecot is needed to get to use my webmail plugins that use a001 CAPABILITY to get quota support. Courier imapd supports this. --snippet from quota usage plugin to squirrelmail-- function sqimap_get_quota ($imap_stream, $mailbox) { if (check_quota_capability($imap_stream, "QUOTA")) { fputs ($imap_stream, "a001 GETQUOTAROOT \"$mailbox\"\r\n"); $read_ary = sqimap_read_data ($imap_stream, 'a001', true, $result, $message); for ($i = 0; $i < count($read_ary); $i++) { if (ereg("STORAGE", $read_ary[$i])) { $tempusage = ereg_replace("^.*[(]STORAGE +(.*)[)].*$", "\\1", $read_ary[$i]); $usagearray = explode(" ", $tempusage); return $usagearray[0].":".$usagearray[1]; } } } return "NOQUOTA"; } function check_quota_capability($imap_stream, $capability) { global $imap_general_debug; fputs ($imap_stream, "a001 CAPABILITY\r\n"); $read_ary = sqimap_read_data($imap_stream, 'a001', true, $a, $b); for($i = 0; $i < count($read_ary); $i++) { if (ereg("QUOTA", $read_ary[$i])) return TRUE; } return false; } -- end snippet-- -- Eero

3 2

[Dovecot] Secure coding guide
by Timo Sirainen 21 Sep '03

21 Sep '03

I thought I'd write a small guide to what Dovecot's "secure coding techniques" are and how you'd use them: http://dovecot.fi/doc/securecoding.txt

1 0

[Dovecot] convert wu-imap Maildir format to dovecot
by Alin Osan 21 Sep '03

21 Sep '03

Hello, I intend to migrate a mail server with Maildir from wu-imap to dovecot imap. Using horde/IMP, users can not access their imap forders, as wu-imap created Mail directory that holds all created folders. Dovecot could not detect the mail directory so I had to put default_mail_env = ~/Maildir in dovecot.conf. Before I begin to read the source-code of dovecot or try to migrate the the mailboxes using a shell script, is there any way I can make dovecot read the wu-imap folders format? Please suggest any solution that you find viable. Thank you. -- -- We are what we repeatedly do. Excellence, then, is not an act, but a habit. -- Alin Osan

3 7

[Dovecot] namespaces
by Brian Marcotte 21 Sep '03

21 Sep '03

I'm trying to use the namespaces feature to set up dovecot to look just like our existing Courier IMAP server, and our previous Cyrus server. That is, all folders are subfolders of INBOX, and the hierachy separator is ".". I put this in the configuration file: namespace private { separator = . prefix = INBOX. location = maildir:~/.maildir } This makes subfolders work correctly, but it can't find the INBOX: x1 select INBOX x1 NO Unknown namespace. Also, I don't really want to specify the location here. I want to use the userdb settings (I'm using password-file). Is there a way to make it use my setting in the userdb/password-file? Also, I'm not sure if it actually matters, but when selecting a folder, the number of RECENT messages is always the same as the number of messages which EXISTS: x2 select INBOX.Tech * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 70 EXISTS * 70 RECENT * OK [UNSEEN 69] First unseen. * OK [UIDVALIDITY 1057356619] UIDs valid * OK [UIDNEXT 181] Predicted next UID x2 OK [READ-WRITE] Select completed. I'm afraid some clients may use this information for something, and display incorrect information to the user. Thanks! -- - Brian

2 6

[Dovecot] Feature question/request
by Dan Sully 20 Sep '03

20 Sep '03

So I have a bunch of users who are roaming - IE no static IP address from all over the internet. Some of them are able to use SMTP-AUTH which is great, but for those that can't, a pop before smtp solution is in place using relay-ctrl-age & cdb files via qmail. Would it be desirable to have this feature in dovecot? I'd really like to ditch qmail-pop3d, etc. vpopmail has a open_smtp_relay() when using vchkpw directly. -D -- <iNoah> I won't be satisfied until I have a rectally-insertable laptop

5 8

[Dovecot] Multiple auth checkers
by Dan Sully 18 Sep '03

18 Sep '03

I noticed this is in the TODO: - support for multiple auth checkers. passdb+userdb should be tied together. auth process configurations really should be used for this.. and is functionality that I really would like, as I have local users (passwd+shadow) and vpopmail users. In -test7's dovecot-example.conf, there is a different format for "blocking" multiple auth types, and I created a conf as such: auth default { mechanisms = plain userdb = passwd passdb = shadow user = root count = 2 } auth vpopmail { mechanisms = plain userdb = vpopmail passdb = vpopmail user = vpopmail count = 2 } Password authentication still works fine, but I can't find a way to get it to fallback to using the vpopmail auth. Is this simply not working yet? Timo - what part of the code needs this update? Thanks. -D -- Change? We fear change.

2 6

[Dovecot] Dovecot + PostgreSQL + Postfix with SMTP AUTH HOWTO
by Timo Sirainen 17 Sep '03

17 Sep '03

Just built one and figured I'd write down what I did :) Still needing some web thingy to configure it. At least a password changer plugin for Squirrelmail. http://wiki.dovecot.fi/moin.cgi/DovecotPostgresql

3 3

[Dovecot] Unable to access the mailbox or folders !!
by nasir nasir 17 Sep '03

17 Sep '03

Hi, Thanx a lot for your reply. But my log file(its /var/log/dovecot) doesnt have any information other than the following line for example, imap-login: Sep 16 10:31:50 Info: Login: usr1 [127.0.0.1] After this when I give select command or anything like that, its not logged(I dont know also, how to enable maximum debug information, I checked the docs and all) Again, let me tell you that I suspect there is something wrong with the mail environment setting. its as follows default_mail_env = maildir:/var/spool/mail/%u/Maildir and when i give some nonexisting location ( eg; /var/blah/blah) also, I get the SAME ERROR. Here is a sample telnet session Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK dovecot ready. a01 login usr1 XXXXXXXXX a01 OK Logged in. a02 select inbox a02 NO Please tell me if you would like to have any other info. Thanx again and regards, Nasirudheen --- Timo Sirainen <tss(a)iki.fi> wrote: > On Tue, 2003-09-16 at 01:35, nasir nasir wrote: > > Hi all, > > I have installed dovecot on redhat linux > with > > ldap backend. I can login using ldap account in to > my > > webmail (squirrelmail) .But when I login to the > > webmail , I cant see any inbox or anything . Just > some > > error messages like this , > > Check the log file. /var/log/mail.log usually. It > should give more > specific error message on what happened. > > > I tried to telnet to port 143. Its also similar > case. > > It allows me to login but when I give "select" > command > > , it gives error(in fact, "NO" and nothing else). > > "x select inbox" too? > > __________________________________ Do you Yahoo!? Yahoo! SiteBuilder - Free, easy-to-use web site design software http://sitebuilder.yahoo.com

2 1

[Dovecot] Locking foolishness
by Ian Marlier 16 Sep '03

16 Sep '03

I'm working on getting Dovecot set up on my school's mailserver, as an IMAP and POP server. Everything is going well, move over to maildir went well, and all that... The catch: When I coverted from mbox to maildir (as part of this whole process), I put the Maildir folders under user home dirs -- and the home dirs are mounted via NFS from a server. This is for reasons of space as well as simply seeming to make sense. Now I get errors in my mail.log which read: imap-login: Sep 16 00:16:24 dovecot:Info: Login: marlier [209.6.159.188] imap(marlier): Sep 16 00:16:28 dovecot:Error: file_wait_lock() failed with index file /Network/Servers/network.uphamscornercs.net/Users/marlier/Maildir/.INBOX/.im ap.index: Invalid argument It looks to me like it's a file locking problem...any thoughts on how to get around it? I've already tried the dotlock mechanism alone...without success... More information available upon request... - Ian

2 1

[Dovecot] Locking foolishness - Better info
by Ian Marlier 16 Sep '03

16 Sep '03

I realized that my last message about locking gave bad information -- or rather, very little information. Here's my setup: - Home directories and user login information are located on an Xserve running Mac OS X 10.2.6. Home directories are split between 2 different directories -- /Users and /Students. Home dirs are exported via NFS to the mail server. User login info is shared via LDAP to the mail server and to Windows machines in classrooms. - The mail server is an old beige G3 running Debian Woody (linux 2.4.20) kernel. It's completely up-to-date. Homedirs are mounted at /Network/Servers/network.uphamscornercs.net/Users and /Network/Servers/network.uphamscornercs.net/Students, in keeping with the OS X Server userdir name scheme. The only user with a shell on the server is root, other than that all user information is pulled from LDAP using PAM. Postfix is setup to deliver mail to maildir:~/Maildir, and dovecot is set to read mail from the same directory. This is working without any problem. - Clients Entourage works fine to access mailboxes -- it reads mail without a problem. However, it pops up an error message intermittently that reads "Mail could not be read: Internal Error [<datestamp>]". This message doesn't seem to interfere with reading mail, it's just an annoyance. Squirrelmail doesn't work to access mailboxes. It logs in fine, but gives the following error message in all windows that require mailbox access: "ERROR : Could not complete request. Query: <imap query string> Reason Given: Internal error [<datestamp>]" In both cases (Entourage and Squirrelmail), the Internal Error is accompanied by the following error message in the /var/log/mail.log file: "imap(marlier): Sep 16 08:40:45 dovecot:Error: /Network/Servers/network.uphamscornercs.net/Users/marlier/Maildir/.subscript ions failed with subscription file file_wait_lock(): Invalid argument" So, it looks to me like something isn't working with locking. I'm not sure whether the problem is with the NFS mount, or with dovecot, or with permissions, or something else, but I'd like to get it fixed. I love the server, and if I can get this licked I think I've got a long-term setup. Relevant sections of /usr/local/etc/dovecot.conf: -------- # Use mmap() instead of read() to read mail files. read() seems to be a bit # faster with my Linux/x86 and it's better with NFS, so that's the default. mail_read_mmaped = no # Copy mail to another folders using hard links. This is much faster than # actually copying the file. This is problematic only if something modifies # the mail in one folder but doesn't want it modified in the others. I don't # know any MUA which would modify mail files directly. IMAP protocol also # requires that the mails don't change, so it would be problematic in any case. # If you care about performance, enable it. maildir_copy_with_hardlinks = no # Check if mails' content has been changed by external programs. This slows # down things as extra stat() needs to be called for each file. If changes are # noticed, the message is treated as a new message, since IMAP protocol # specifies that existing message are immutable. maildir_check_content_changes = yes # Which locking methods to use for locking mbox. There's three available: # dotlock: Create <mailbox>.lock file. This is the oldest and most NFS-safe # solution. If you want to use /var/mail/ like directory, the users # will need write access to that directory. # fcntl : Use this if possible. Works with NFS too if lockd is used. # flock : May not exist in all systems. Doesn't work with NFS. # # You can use both fcntl and flock too; if you do the order they're declared # with is important to avoid deadlocks if other MTAs/MUAs are using both fcntl # and flock. Some operating systems don't allow using both of them # simultaneously, eg. BSDs. If dotlock is used, it's always created first. mbox_locks = dotlock # Should we create dotlock file even when we want only a read-lock? Setting # this to yes hurts the performance when the mailbox is accessed simultaneously # by multiple processes, but it's needed for reliable reading if no other # locking methods are available. mbox_read_dotlock = yes # Maximum time in seconds to wait for lock (all of them) before aborting. mbox_lock_timeout = 300 # If dotlock exists but the mailbox isn't modified in any way, override the # lock file after this many seconds. mbox_dotlock_change_timeout = 30 # umask to use for mail files and directories umask = 0077 # Drop all privileges before exec()ing the mail process. This is mostly # meant for debugging, otherwise you don't get core dumps. Note that setting # this to yes means that log file is opened as the logged in user, which # might not work. It could also be a small security risk if you use single UID # for multiple users, as the users could ptrace() each others processes then. mail_drop_priv_before_exec = no --------- Thanks in advance for any help you can give. - Ian

1 0

[Dovecot] Unable to access the mailbox or folders !!
by nasir nasir 16 Sep '03

16 Sep '03

Hi all, I have installed dovecot on redhat linux with ldap backend. I can login using ldap account in to my webmail (squirrelmail) .But when I login to the webmail , I cant see any inbox or anything . Just some error messages like this , ERROR: ERROR : Connection dropped by imap-server. Query: LIST "" "Sent" ERROR : Could not complete request. Query: SELECT "INBOX" Reason Given: I tried to telnet to port 143. Its also similar case. It allows me to login but when I give "select" command , it gives error(in fact, "NO" and nothing else). Required info, OS - Redhat 8.0 dovecot - dovecot-0.99.10-2.dag.src.rpm ( --with-ldap --with-rawlog additionally) MTA - Exim 4.14 Webmail - Squirrelmail 1.4.1-2 Location of Maildir - /var/spool/mail/USERNAME/Maildir dovecot configuration has the following line, default_mail_env = maildir:/var/spool/mail/%u/Maildir Is there anything I am missing or doing wrong ? I am sorry if this is a silly question. But I am a newbie to dovecot and did a lot of google search for this error or even additional documentation for dovecot without any success. Any suggestion or advice would be highly appreciated. Regards, Nasirudheen __________________________________ Do you Yahoo!? Yahoo! SiteBuilder - Free, easy-to-use web site design software http://sitebuilder.yahoo.com

2 1

[Dovecot] child 9436 (pop3) killed with signal 11
by Gunter Ohrner 15 Sep '03

15 Sep '03

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi! Suddenly since this afternoon the following happens: Sep 14 18:16:55 UnseenUniversity pop3-login: Login: gunter [127.0.0.1] Sep 14 18:16:55 UnseenUniversity pop3(gunter): Corrupted index data file / home/gunter/Mail/.imap/INBOX/.imap.index.data: Field 1 size points outside file (205408 / 205376) for record 4662 Sep 14 18:16:55 UnseenUniversity pop3(gunter): Corrupted index data file / home/gunter/Mail/.imap/INBOX/.imap.index.data: Missing location field for record 4662 Sep 14 18:16:55 UnseenUniversity dovecot: child 9436 (pop3) killed with signal 11 I thought dovecot would delete damaged index files but I get this always when checking mail for the first time, cheking mail for the second time tells me: Sep 14 18:18:43 UnseenUniversity pop3-login: Login: gunter [127.0.0.1] Sep 14 18:18:43 UnseenUniversity pop3(gunter): Corrupted binary tree file / home/gunter/Mail/.imap/INBOX/.imap.index.tree: Invalid used_file_size in header (0) but actually fetches the mail after that. So what can/should I do? Simply delete the offending index file? The dovecot version I'm using here is Debian's ii dovecot-pop3d 0.99.10-7 A secure POP3 server that supports mbox and and only it's pop3 part. Greetings, Gunter - -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + PGP-verschlüsselte Mails bevorzugt! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ 3) I don't sign parts of the body, even if they're still attached. -- From Terry's Rules of Book Signing (Terry Pratchett, alt.fan.pratchett) +-+-+-+-+-+-+-+-+-+-+-+-+ http://www.lspace.org +-+-+-+-+-+-+-+-+-+-+-+-+ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (GNU/Linux) iD8DBQE/ZKEX0ORHvREo8l8RAnKoAJoDpKu3OprNQ0W7ZWXpj5/RcYmZFgCfWU2c s5uLQS9yQpe7LQlVDRbnlvk= =ngZu -----END PGP SIGNATURE-----

2 1

[Dovecot] Dovecot Wiki
by Timo Sirainen 14 Sep '03

14 Sep '03

I finally got around to cleaning up the MoinMoin pages out of it and added a link to it from main page. I also got dovecot.fi domain, so Dovecot pages can be accessed from http://www.dovecot.fi/ and Wiki is at http://wiki.dovecot.fi/

2 2

[Dovecot] Setting up a local shared mailbox
by Peter Clark 14 Sep '03

14 Sep '03

One: I have never set up an IMAP server before, so I thought I would ask first before blindly stumbling around. The problem I am want to solve is this: my wife and I have a "joint" email account that we both want to access (we also have our own personal accounts, but that's beside the point.) I posed the question to my local LUG, and several suggested setting up a local IMAP server so that we can both access it through KMail. Would you concur? If so, is there a tutorial or something similar that gives instructions for setting up dovecot locally? As I said, I've never set up an IMAP server before, and I'm not really sure how to go about it. (I'm running Debian Sid, so the packages are already installed, but I don't know what additional steps need to be taken.) Thanks for your help, :Peter

4 8

[Dovecot] Patch for auto-creating home directories
by David S Madole 13 Sep '03

13 Sep '03

I've created a patch that adds a feature that is helpful to my setup. If 'parent_dir_umask' is set in the configuration file, any missing directories in the home directory path are created. The home directory itself is created according to the 'umask' setting, 'parent_dir_umask' is only used for intermediate directories that might need creating. This is useful to me, as I pull user information from a PostgreSQL database. This allows a new account to be created just by populating the database. The directory gets created the first time the user logs in (by Dovecot) or mail is received (by the MTA). As the patch is of modest length, I have included it below. I hope my meager skills are not an insult to the beatiful Dovecot code base! Thanks, David *** ./src/master/mail-process.c.orig Wed Sep 10 10:14:04 2003 --- ./src/master/mail-process.c Wed Sep 10 12:16:06 2003 *************** *** 95,100 **** --- 95,136 ---- return str_c(str); } + static int create_directories(const char *directory, mode_t mask) + { + char *chunk, *slash, *path; + mode_t oldmask; + int result; + + if (mkdir(directory, 0777) == 0 || errno == EEXIST) + return TRUE; + + if (errno != ENOENT) + return FALSE; + + path = t_strdup_noconst(directory); + + oldmask = umask(mask); + + for (chunk = path; (slash = strchr(chunk, '/')); chunk = slash + 1) { + + if (slash > chunk) { + + *slash = '\0'; + result = mkdir(path, 0777); + *slash = '/'; + + if (result != 0 && errno != EEXIST) { + umask(oldmask); + return FALSE; + } + } + } + + umask(oldmask); + + return (mkdir(path, 0777) == 0 || errno == EEXIST); + } + int create_mail_process(int socket, struct ip_addr *ip, const char *executable, const char *module_dir, unsigned int process_size, int process_type, *************** *** 156,164 **** --- 192,205 ---- restrict_process_size(process_size, (unsigned int)-1); + (void)umask(set->umask); + if (*home_dir != '\0') { full_home_dir = *chroot_dir == '\0' ? home_dir : t_strconcat(chroot_dir, "/", home_dir, NULL); + if (set->parent_dir_umask != 0777 && + !create_directories(full_home_dir, set->parent_dir_umask)) + i_fatal("mkdir(%s) failed: %m", full_home_dir); if (chdir(full_home_dir) < 0) i_fatal("chdir(%s) failed: %m", full_home_dir); } *************** *** 188,194 **** env_put("MAILDIR_CHECK_CONTENT_CHANGES=1"); if (set->mail_full_filesystem_access) env_put("FULL_FILESYSTEM_ACCESS=1"); - (void)umask(set->umask); env_put(t_strconcat("MBOX_LOCKS=", set->mbox_locks, NULL)); env_put(t_strdup_printf("MBOX_LOCK_TIMEOUT=%u", --- 229,234 ---- *** ./src/master/master-settings.h.orig Wed Sep 10 12:13:45 2003 --- ./src/master/master-settings.h Wed Sep 10 12:13:47 2003 *************** *** 51,56 **** --- 51,57 ---- int mbox_read_dotlock; unsigned int mbox_lock_timeout; unsigned int mbox_dotlock_change_timeout; + unsigned int parent_dir_umask; unsigned int umask; int mail_drop_priv_before_exec; *** ./src/master/master-settings.c.orig Wed Sep 10 12:13:59 2003 --- ./src/master/master-settings.c Wed Sep 10 12:14:40 2003 *************** *** 67,72 **** --- 67,73 ---- DEF(SET_BOOL, mbox_read_dotlock), DEF(SET_INT, mbox_lock_timeout), DEF(SET_INT, mbox_dotlock_change_timeout), + DEF(SET_INT, parent_dir_umask), DEF(SET_INT, umask), DEF(SET_BOOL, mail_drop_priv_before_exec), *************** *** 180,185 **** --- 181,187 ---- MEMBER(mbox_read_dotlock) FALSE, MEMBER(mbox_lock_timeout) 300, MEMBER(mbox_dotlock_change_timeout) 30, + MEMBER(parent_dir_umask) 0777, MEMBER(umask) 0077, MEMBER(mail_drop_priv_before_exec) FALSE,

2 1

[Dovecot] Dovecot on Linux 2.6.0-test1-ac1
by Kyler Laird 12 Sep '03

12 Sep '03

I've been using Dovecot on 2.6.0-test1 for quite awhile but today I jumped ahead to test5 and it broke in the way you described. http://dovecot.procontrol.fi/list/dovecot/2003-July/001943.html I used your workaround and now everyone is back in business. Thank you for the help! (I was sweating there for a bit.) --kyler

1 0

[Dovecot] Web administration tool
by Timo Sirainen 10 Sep '03

10 Sep '03

Any suggestions for a small web based tool to manage virtual domains/users? I tried to look but didn't really find anything that didn't seem to be tightly integrated with Courier or Cyrus, and I'd rather not spend time writing yet another one of those. I would be using Postfix and Squirrelmail with LDAP or PostgreSQL. On a somewhat related thought, I've been thinking about writing some kind of performance and statistics tool which would at least show the users who are logged in and how much CPU, memory and disk I/O they're eating so that you could see what's happening when load is too high. From Dovecot side that'd be done using a plugin. I'm not sure what the client side would be.. HTML might not be enough. Java maybe. Would Flash be too evil? :)

3 2

[Dovecot] Problem with mbox files.
by David Röhr 09 Sep '03

09 Sep '03

I have trouble to get my INBOX-mbox to work properly. I have set the default_mail_env, to this.. "default_mail_env = mbox:~/mail/:INBOX=/var/mail/%u" Since my users are using thier home-dirs to store folders and old mails, and recieving them in /var/mail/username. But when logging in i get this.. Sep 9 12:25:23 angelica imap-login: Login: username [217.151.192.103] Sep 9 12:25:23 angelica imap(username): stat() failed with mbox file /var/mail/username : No such file or directory Just like the file wasn't there?! But checking.. .~ > ls -l /var/mail/username 1200 -rw-rw---- 1 username mail 1222055 Sep 9 12:16 /var/mail/username I can see that it is there, and containing mails.. It's not corrupt or anything like that. And its not a link of any kind. Why am I getting this error? And how do I solve it? I've tested to disable chroots, but get the same error... /d -- ... david röhr | o_ .. unix systems consultant | o/ /\ Solaris, AIX, HP-UX . qbranch system management | /|_, \\ and GNU/Linux Certified. www.qbranch.se / `

2 2

[Dovecot] what is the current state
by Farkas Levente 09 Sep '03

09 Sep '03

hi, what is the current state of dovecot? is it worth to upgrade now or wait for some release in the near future? -- Levente "Si vis pacem para bellum!"

4 10

[Dovecot] squirrelmail + dovecot + qmail + vpopmail error
by Warren Togami 09 Sep '03

09 Sep '03

ERROR : Could not complete request. Query: COPY 99:99 "INBOX.SPAM" Reason Given: [TRYCREATE] Mailbox doesn't exist: INBOX.SPAM Running latest stable version of squirrelmail, dovecot, qmail and vpopmail with Maildir storage in virtual users. One of my users reports seeing this yesterday, then it went away for a few hours, then early in the next day it happened again on the same account, but went away a little while after that. Any idea what could be happening here? Warren Togami warren(a)togami.com

1 0

[Dovecot] Dovecot not starting
by Antonin Karasek 07 Sep '03

07 Sep '03

Hello everybody, sorry for stupid qustion, but I have following problem: I succesfully installed Dovecot on Debian (from source). Now I want to run it. I tryed: # /usr/local/dovecot/sbin/dovecot # but nothing happened: # ps -Af | grep dove ....... ps -Af | grep dove # What is wrong? I want Dovecot to serve POP3 over SSL. Many thanks and sorry again :o)

3 4

[Dovecot] Re: Dovecot not starting
by Antonin Karasek 06 Sep '03

06 Sep '03

Thanks for fast response :) This is copy of syslog: Sep 5 17:58:40 cernunnos dovecot: Dovecot starting up Sep 5 17:58:41 cernunnos dovecot: Auth process died too early - shutting down Sep 5 17:58:41 cernunnos dovecot: child 4327 (auth) returned error 11 Sep 5 17:58:41 cernunnos pop3-login: fd_send(-1) failed: Broken pipe Alejandro Martinez writes: > Did you see the logs ? > > -----Mensaje original----- > De: Antonin Karasek [mailto:lists@ceskyserver.cz] > Enviado el: viernes, 05 de septiembre de 2003 12:46 > Para: dovecot(a)procontrol.fi > Asunto: [Dovecot] Dovecot not starting > > > Hello everybody, > sorry for stupid qustion, but I have following problem: > I succesfully installed Dovecot on Debian (from source). Now I want to > run > it. I tryed: > # /usr/local/dovecot/sbin/dovecot > # > but nothing happened: > # ps -Af | grep dove > ....... ps -Af | grep dove > # > > What is wrong? > > I want Dovecot to serve POP3 over SSL. > > Many thanks and sorry again :o)

2 1

[Dovecot] still getting weird .{inbox} folder creations with latest -test7
by Charlie Allom 06 Sep '03

06 Sep '03

Hi, I am still getting strange creation and mailbox lookups from 0.99.11-test7. dovecot creates in ~/Maildir/ .INBOX/ .imap.index .imap.index.cache .imap.index.log .customflags dovecot-uidlist .INBOX seems to be a reference to ~/Maildir/{cur,new,tmp} yet I cannot get an IMAP client uo pick up my other maildir, located at ~/Maildir/mi/{cur,new,tmp}. In Apple's Mail.app, it picks up a file called ~/Maildir/.procmaillog as if it were a maildir directory! This is with the Mail.app preference for "IMAP Path Prefix" set to null. mutt just seems plain confused. I have these settings: # imap styleee set folder=imap://yeled@lazy.spodder.com/ set mbox=imap://yeled@lazy.spodder.com/mbox set record=imap://yeled@lazy.spodder.com/sent set postponed=imap://yeled@lazy.spodder.com/postponed set spoolfile=imap://yeled@lazy.spodder.com/ set certificate_file=~/.mutt/certificates set mail_check=10 set timeout=10 set imap_home_namespace="" set imap_pass="foo" I have included the tcpflow files to show what the clients are doing.. Is it normal to search for folders starting with "." ? Why won't it just pick up my normally nested maildir folders? C. -- charlie(a)rubberduck.com - http://rubberduck.com/~yeled/

4 4

[Dovecot] dovecot, vpopmail and djb's tcpserver
by Lasse Danielsen 06 Sep '03

06 Sep '03

Hello! I've tried to set up dovecot in conjuction with vpopmail, and running it under djb's tcpserver instead of (x)inetd. Btw - there was no reference to setting dovecot up using (x)inetd either in the manuals/faqs i read, though I didn't search all that hard. Anyway, back to my Q: vpopmail uses vchkpw as an authentication mechanism, and with tcpserver I can do relaycontrol (based on vchkpw) with roaming users. Is there anyone who have tried this, and succeeded? Right now I use two imap services to accomplish this (bincimap has support for vchkpw). Thank you for any response. - Lasse Danielsen Never argue with an idiot. He'll drag you down to his level, then beat you with experience.

4 5

[Dovecot] pine, INBOX, and dovecot
by Jethro R Binks 04 Sep '03

04 Sep '03

Hi all, I've been experimenting with Dovecot; tests with Maildir seemed to work fine. However, now I'm trying with mbox folders, and I'm having a problem where I do not get an INBOX listed using pine. Outlook Express and IMP show it fine. I snooped part of the session, which appears to go like this (it is slightly garbled, sorry -- I couldn't get rawlog to work by creating dovecot.rawlog in the mail home directory): 00000002 CAPABILITY\r\n * CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND UN 00000003 LIST "" %\r\n" * LIST (\NoInferiors) "/" INBOX * LIST (\NoInferiors \UnMarked) "/" "test" * LIST (\NoInferiors \UnMarked) ""/" "Sent Items" * LIST (\NoInferiors \UnMarked) "/" "Drafts" 0000000a OK List .completed.. Pine just displays "test", "Sent Items", and "Drafts". OE happily downloads mail from the inbox I put there, and IMP can see it and read it. Perhaps there is something there that IMAP protocol people might see. Or else, perhaps there is a known reason why pine does this? Any clues would be appreciated - I browsed the list archives but couldn't spot anything very relevant. Pine version is very recent - I updated today to 4.56. Incidentally, is mbox support still broken in the CVS version? Is there an expected timescale for the next release, preferably with mbox fixed again?! Thanks for any advice. Jethro. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Jethro R Binks Computing Officer, IT Services University Of Strathclyde, Glasgow, UK

2 2

Re: [Dovecot] How do i load a configfile ?
by Tweek 01 Sep '03

01 Sep '03

>which does everything itself without loading the config file it dosen't do anything - i can connect to the server but thats all. how should the server know where i store my mboxes etc. i must load the config file - but how ? ----- Original Message ----- From: "Timo Sirainen" <tss(a)iki.fi> To: <dovecot(a)procontrol.fi> Sent: Monday, September 01, 2003 8:07 PM Subject: Re: [Dovecot] How do i load a configfile ? > On Mon, 2003-09-01 at 20:57, Tweek wrote: > > hello, > > > > this may be a very stupid question but how do i load a config file? > > i didn't find the docs part which explains how to start the imapserver at > > all. > > There's two possibilities: Run the "dovecot" binary which does > everything itself, or start imap-login from inetd. > > > server = /usr/local/dovecot/imap > > So imap-login here :) > > -- E-Mail by http://www.jesus.ch/ and http://www.livenet.ch/ News, Magazin, Events, Forum, Chat, Free E-Mail, Dialin, Jobs, Top-Newsletter

2 2

[Dovecot] How do i load a configfile ?
by Tweek 01 Sep '03

01 Sep '03

hello, this may be a very stupid question but how do i load a config file? i didn't find the docs part which explains how to start the imapserver at all. i have put this in my xinetd.conf: service imap { disable = no socket_type = stream protocol = tcp wait = no user = root server = /usr/local/dovecot/imap flags = IPv4 } and the server is running, but thats all. as u can see i have installed the server in /usr/local/dovecot and i have put the config file in /etc, /usr/local/etc and the programmdir itself - nothing worked. what commands must i write in the xinetd.conf to get the server running ? thanks -- E-Mail by http://www.jesus.ch/ and http://www.livenet.ch/ News, Magazin, Events, Forum, Chat, Free E-Mail, Dialin, Jobs, Top-Newsletter

2 1

[Dovecot] observations about delays
by Eric S. Johansson 01 Sep '03

01 Sep '03

I've tried two imap clients (mahogany and Mozilla) and they both have strange delays and weird failures. As a reminder, I am using mbox format mailboxes on the server and client side filtering of messages from the inbox. In both cases when the client fetches messages from the inbox and starts redistributing them, CPU utilization on the imap server goes to around 40 percent for Mozilla and around 90 percent for mahogany. There are long delays on the order of two minutes when filtering messages. or 30 to 50 seconds when opening a mailbox. Other than the performance problems, Mozilla is relatively well-behaved. Mahogany on the other hand is a bit more rough and (not) ready. It uses c-client for its imap code and during the filter driven message redistribution process, it all of a sudden started started complaining about unexpected EOF and I found one corrupted message: on 31/8/03 7:36 pm, Morten Christensen at ipcop-d(a)indbakke.dk wrote: >> These bugs might keep many people from trying a new alpha with >> interesting improvements. >> >> A more detailed help for fixing them after install is needed. OK, I'll have a From esj(a)harvee.org Sun Aug 31 16:01:21 2003 Return-Path: <ipcop-devel-admin(a)lists.sourceforge.net> Received: from red.harvee.home (red [192.168.25.1] (may be forged)) by harvee.org (8.12.8/8.12.8) with ESMTP id h7VK1KiE029762 for <esj(a)harvee.billerica.ma.us>; Sun, 31 Aug 2003 16:01:20 -0400 Received: from sc8-sf-list2.sourceforge.net (lists.sourceforge.net [66.35.250.206]) by red.harvee.home (8.11.6/8.11.6) with ESMTP id h7VK1I111902 for <esj(a)harvee.billerica.ma.us>; Sun, 31 Aug 2003 16:01:19 -0400 Received: from sc8-sf-list1-b.sourceforge.net ([10.3.1.13] helo=sc8-sf-list1.sourceforge.net) I had read this message before it was filtered and moved to the right mailbox. It was complete then. Now it's not so happy. How can I gather more data to make it possible to debug these problems. ---eric

2 2

[Dovecot] Crash when searching messages
by Nicolas STRANSKY 01 Sep '03

01 Sep '03

Hi, I've been encountering a crash when trying to use the "Search messages" function with mozilla on a newly indexed/subscribed mailbox. I tryed to search something in "To or CC" and got the following : Sep 1 09:07:13 aster imap(nico): file message-address.c: line 255 (message_address_write): assertion failed: (addr->domain != NULL) Sep 1 09:07:13 aster dovecot: child 15674 (imap) killed with signal 6 In addition, mozilla gives the following message : "Server mail.neo-lan.net has disconnected. The server may have gone down or there may be a network problem" and the search fails. But there was no problem when doing other searches. After trying several different types of searches, the initial one (on TO or CC) worked fine, but the crash is reproducible on an other newly subscribed mbox. -- Nico Si cela fonctionne, c'est obsolète. Marshall McLuhan

2 1

[Dovecot] conversion to maildir
by Eric S. Johansson 30 Aug '03

30 Aug '03

is really a royal pain in the butt. most of the conversion tools only do a partial job. mb2md seems to be the best but it does not convert the from line correctly unless you are using exim for an MTA. It also does not get the file status right so everything is written to the new maildir directory. something else that makes the process painful is when you have folders containing mailboxes. And the process is *slow* when you have 2 GB of mail (yes, I will be deleting some soon). looks like I will be debugging and rewrapping this package real soon now.. to relate this to dovecot: this is probably not the job of the imap server but it would be real nice to be able to fit in some sort of a plug-in that could automatically do the conversion on a mailbox as it is opened. it would make migrations trivial easy. give me the ability to use python for plug-ins and I will write such a tool. ---eric

11 15

[Dovecot] PATCH: mysql authentication
by Matthew Reimer 30 Aug '03

30 Aug '03

Here's a patch that implements mysql authentication. I started with the pgsql files and tweaked them to use mysql instead. It works for me, but there might be a couple of memory leaks. I'm welcome to suggestions on how to clean it up so it can be committed. Enjoy! Matt diff -u -r --new-file work/dovecot-0.99.10/doc/dovecot-mysql.conf work.patched/dovecot-0.99.10/doc/dovecot-mysql.conf --- work/dovecot-0.99.10/doc/dovecot-mysql.conf Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/doc/dovecot-mysql.conf Fri Aug 15 13:43:05 2003 @@ -0,0 +1,70 @@ +# For the mysql passdb module, you'll need a database with a table that +# contains fields for at least the userid and password. If you want to +# use the user@domain syntax, you might want to have a separate domain +# field as well. +# +# If your users all have the same uig/gid, and have predictable home +# directories, you can use the static userdb module to generate the home +# dir based on the userid and domain. In this case, you won't need fields +# for home, uid, or gid in the database. +# +# If you prefer to use the mysql userdb module, you'll want to add fields +# for home, uid, and gid. Here is an example table: +# +# CREATE TABLE users ( +# userid VARCHAR(128) NOT NULL, +# password VARCHAR(64) NOT NULL, +# home VARCHAR(256) NOT NULL, +# uid INTEGER NOT NULL, +# gid INTEGER NOT NULL, +# active CHAR(1) DEFAULT 'Y' NOT NULL +# ); + +db_host = localhost +db_port = 3306 +#db_unix_socket = /var/tmp/mysql.sock +db = users +db_user = dovecot-db +db_passwd = opensesame +db_client_flags = 0 + +# Default password scheme. +# +# Currently supported schemes include PLAIN, PLAIN-MD5, DIGEST-MD5, and CRYPT. +# +#default_pass_scheme = PLAIN-MD5 + +# Query to retrieve the password. +# +# The query should return one row, one column. If more than one row or column +# is returned, authentication will automatically fail. +# +# Available substitutions: +# %u = entire userid +# %n = user part of user@domain +# %d = domain part of user@domain +# +# Example: +# password_query = SELECT password FROM users WHERE userid = '%n' AND domain = '%d' +# password_query = SELECT password FROM users WHERE userid = '%u' AND active = 'Y' +# +#password_query = SELECT password FROM users WHERE userid = '%u' + +# Query to retrieve the user information. +# +# The query must return only one row. The columns to return are: +# home - Home directory +# mail - MAIL environment +# system_user - System user name (for initgroups()) +# uid - System UID +# gid - System GID +# +# Either home or mail is required. uid and gid are required. If more than one +# row is returned or there's missing fields, login will automatically fail. +# +# Examples +# user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' +# user_query = SELECT dir AS home, user AS uid, group AS gid FROM users where userid = '%u' +# user_query = SELECT home, 501 AS uid, 501 AS gid FROM users WHERE userid = '%u' +# +#user_query = SELECT home, uid, gid FROM users WHERE userid = '%u' diff -u -r --new-file work/dovecot-0.99.10/src/auth/Makefile.am work.patched/dovecot-0.99.10/src/auth/Makefile.am --- work/dovecot-0.99.10/src/auth/Makefile.am Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/Makefile.am Fri Aug 15 16:47:21 2003 @@ -19,6 +19,7 @@ auth-module.c \ db-ldap.c \ db-pgsql.c \ + db-mysql.c \ db-passwd-file.c \ login-connection.c \ main.c \ @@ -38,6 +39,7 @@ passdb-shadow.c \ passdb-vpopmail.c \ passdb-pgsql.c \ + passdb-mysql.c \ password-scheme.c \ userdb.c \ userdb-ldap.c \ @@ -45,7 +47,8 @@ userdb-passwd-file.c \ userdb-static.c \ userdb-vpopmail.c \ - userdb-pgsql.c + userdb-pgsql.c \ + userdb-mysql.c noinst_HEADERS = \ auth-login-interface.h \ @@ -54,6 +57,7 @@ auth-module.h \ db-ldap.h \ db-pgsql.h \ + db-mysql.h \ db-passwd-file.h \ common.h \ login-connection.h \ diff -u -r --new-file work/dovecot-0.99.10/src/auth/db-mysql.c work.patched/dovecot-0.99.10/src/auth/db-mysql.c --- work/dovecot-0.99.10/src/auth/db-mysql.c Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/db-mysql.c Fri Aug 22 17:56:44 2003 @@ -0,0 +1,181 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#if defined(PASSDB_MYSQL) || defined(USERDB_MYSQL) + +#include "common.h" +#include "network.h" +#include "str.h" +#include "settings.h" +#include "db-mysql.h" + +#include <limits.h> +#include <stddef.h> +#include <stdlib.h> + +#define DEF(type, name) { type, #name, offsetof(struct mysql_settings, name) } + +static struct setting_def setting_defs[] = { + DEF(SET_STR, db_host), + DEF(SET_STR, db_port), + DEF(SET_STR, db_unix_socket), + DEF(SET_STR, db), + DEF(SET_STR, db_user), + DEF(SET_STR, db_passwd), + DEF(SET_STR, db_client_flags), + DEF(SET_STR, password_query), + DEF(SET_STR, user_query), + DEF(SET_STR, default_pass_scheme) +}; + +struct mysql_settings default_mysql_settings = { + MEMBER(db_host) "localhost", + MEMBER(db_port) "0", + MEMBER(db_unix_socket) "/var/tmp/mysql.sock", + MEMBER(db) "email_accounts", + MEMBER(db_user) "dovecot", + MEMBER(db_passwd) "changeme", + MEMBER(db_client_flags) "0", + MEMBER(password_query) "SELECT password FROM users WHERE userid = '%u'", + MEMBER(user_query) "SELECT home, uid, gid FROM users WHERE userid = '%u'", + MEMBER(default_pass_scheme) "PLAIN-MD5" +}; + +static struct mysql_connection *mysql_connections = NULL; + +static int mysql_conn_open(struct mysql_connection *conn); +static void mysql_conn_close(struct mysql_connection *conn); + +void db_mysql_query(struct mysql_connection *conn, const char *query, + struct mysql_request *request) +{ + MYSQL_RES *res; + int failed; + + if (!conn->connected) { + if (!mysql_conn_open(conn)) { + request->callback(conn, request, NULL); + return; + } + } + + if (verbose_debug) + i_info("MYSQL: Performing query: %s", query); + + if (mysql_query(conn->mysql, query)) + i_info("MYSQL: Error executing query \"%s\": %s", query, + mysql_error(conn->mysql)); + + if ((res = mysql_store_result(conn->mysql))) + failed = FALSE; + else { + i_info("MYSQL: Error retrieving results: %s", + mysql_error(conn->mysql)); + failed = TRUE; + } + + request->callback(conn, request, failed ? NULL : res); + mysql_free_result(res); + i_free(request); +} + +static int mysql_conn_open(struct mysql_connection *conn) +{ + if (conn->connected) + return TRUE; + + if (conn->mysql == NULL) { + conn->mysql = mysql_init(NULL); + if (conn->mysql == NULL) { + i_error("MYSQL: mysql_init failed"); + return FALSE; + } + + if (!mysql_real_connect(conn->mysql, conn->set.db_host, + conn->set.db_user, conn->set.db_passwd, + conn->set.db, + atoi(conn->set.db_port), + conn->set.db_unix_socket, + strtoul(conn->set.db_client_flags, + NULL, 10))) { + i_error("MYSQL: Can't connect to database %s: %s", + conn->set.db, mysql_error(conn->mysql)); + return FALSE; + } + } + + conn->connected = TRUE; + return TRUE; +} + +static void mysql_conn_close(struct mysql_connection *conn) +{ + conn->connected = FALSE; + + if (conn->mysql != NULL) { + mysql_close(conn->mysql); + conn->mysql = NULL; + } +} + +static struct mysql_connection *mysql_conn_find(const char *config_path) +{ + struct mysql_connection *conn; + + for (conn = mysql_connections; conn != NULL; conn = conn->next) { + if (strcmp(conn->config_path, config_path) == 0) + return conn; + } + + return NULL; +} + +static const char *parse_setting(const char *key, const char *value, + void *context) +{ + struct mysql_connection *conn = context; + + return parse_setting_from_defs(conn->pool, setting_defs, + &conn->set, key, value); +} + +struct mysql_connection *db_mysql_init(const char *config_path) +{ + struct mysql_connection *conn; + pool_t pool; + + conn = mysql_conn_find(config_path); + if (conn != NULL) { + conn->refcount++; + return conn; + } + + pool = pool_alloconly_create("mysql_connection", 1024); + conn = p_new(pool, struct mysql_connection, 1); + conn->pool = pool; + + conn->refcount = 1; + + conn->config_path = p_strdup(pool, config_path); + conn->set = default_mysql_settings; + settings_read(config_path, parse_setting, conn); + + (void)mysql_conn_open(conn); + + conn->next = mysql_connections; + mysql_connections = conn; + return conn; +} + +void db_mysql_unref(struct mysql_connection *conn) +{ + if (--conn->refcount > 0) + return; + + mysql_conn_close(conn); + pool_unref(conn->pool); +} + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/db-mysql.h work.patched/dovecot-0.99.10/src/auth/db-mysql.h --- work/dovecot-0.99.10/src/auth/db-mysql.h Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/db-mysql.h Fri Aug 15 13:40:56 2003 @@ -0,0 +1,51 @@ +#ifndef __DB_MYSQL_H +#define __DB_MYSQL_H + +#include <mysql.h> + +struct mysql_connection; +struct mysql_request; + +typedef void mysql_query_callback_t(struct mysql_connection *conn, + struct mysql_request *request, + MYSQL_RES *res); + +struct mysql_settings { + const char *db_host; + const char *db_port; + const char *db_unix_socket; + const char *db; + const char *db_user; + const char *db_passwd; + const char *db_client_flags; + const char *password_query; + const char *user_query; + const char *default_pass_scheme; +}; + +struct mysql_connection { + struct mysql_connection *next; + + pool_t pool; + int refcount; + + char *config_path; + struct mysql_settings set; + + MYSQL *mysql; + + unsigned int connected:1; +}; + +struct mysql_request { + mysql_query_callback_t *callback; + void *context; +}; + +void db_mysql_query(struct mysql_connection *conn, const char *query, + struct mysql_request *request); + +struct mysql_connection *db_mysql_init(const char *config_path); +void db_mysql_unref(struct mysql_connection *conn); + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/master-connection.c work.patched/dovecot-0.99.10/src/auth/master-connection.c --- work/dovecot-0.99.10/src/auth/master-connection.c Mon May 26 10:27:13 2003 +++ work.patched/dovecot-0.99.10/src/auth/master-connection.c Fri Aug 22 17:56:18 2003 @@ -55,7 +55,7 @@ reply.virtual_user_idx = reply_add(buf, user->virtual_user); reply.mail_idx = reply_add(buf, user->mail); - p = strstr(user->home, "/./"); + p = user->home ? strstr(user->home, "/./") : NULL; if (p == NULL) { reply.home_idx = reply_add(buf, user->home); reply.chroot_idx = reply_add(buf, NULL); diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb-mysql.c work.patched/dovecot-0.99.10/src/auth/passdb-mysql.c --- work/dovecot-0.99.10/src/auth/passdb-mysql.c Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/passdb-mysql.c Fri Aug 15 14:24:44 2003 @@ -0,0 +1,171 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#ifdef PASSDB_MYSQL + +#include "common.h" +#include "str.h" +#include "strescape.h" +#include "var-expand.h" +#include "password-scheme.h" +#include "db-mysql.h" +#include "passdb.h" + +#include <mysql.h> +#include <stdlib.h> +#include <string.h> + +struct passdb_mysql_connection { + struct mysql_connection *conn; +}; + +struct passdb_mysql_request { + struct mysql_request request; + + enum passdb_credentials credentials; + union { + verify_plain_callback_t *verify_plain; + lookup_credentials_callback_t *lookup_credentials; + } callback; + + char password[1]; +}; + +static struct passdb_mysql_connection *passdb_mysql_conn; + +static void mysql_handle_request(struct mysql_connection *conn, + struct mysql_request *request, MYSQL_RES *res) +{ + struct passdb_mysql_request *mysql_request = + (struct passdb_mysql_request *) request; + struct auth_request *auth_request = request->context; + const char *user, *password, *scheme; + int ret = 0; + + user = auth_request->user; + password = NULL; + + if (res != NULL) { + if (mysql_num_rows(res) == 0) { + if (verbose) + i_info("mysql(%s): Unknown user", user); + } else if (mysql_num_rows(res) > 1) { + i_error("mysql(%s): Multiple matches for user", user); + } else if (mysql_num_fields(res) != 1) { + i_error("mysql(%s): Password query returned " + "more than one field", user); + } else { + MYSQL_ROW row; + + row = mysql_fetch_row(res); + if (row) + password = t_strdup(row[0]); /* XXX binary? */ + } + } + + scheme = password_get_scheme(&password); + if (scheme == NULL) { + scheme = conn->set.default_pass_scheme; + i_assert(scheme != NULL); + } + + if (mysql_request->credentials != -1) { + passdb_handle_credentials(mysql_request->credentials, + user, password, scheme, + mysql_request->callback.lookup_credentials, + auth_request); + return; + } + + /* verify plain */ + if (password == NULL) { + mysql_request->callback.verify_plain(PASSDB_RESULT_USER_UNKNOWN, + auth_request); + return; + } + + ret = password_verify(mysql_request->password, password, + scheme, user); + if (ret < 0) + i_error("mysql(%s): Unknown password scheme %s", user, scheme); + else if (ret == 0) { + if (verbose) + i_info("mysql(%s): Password mismatch", user); + } + + mysql_request->callback.verify_plain(ret > 0 ? PASSDB_RESULT_OK : + PASSDB_RESULT_PASSWORD_MISMATCH, + auth_request); +} + +static void mysql_lookup_pass(struct auth_request *auth_request, + struct mysql_request *mysql_request) +{ + struct mysql_connection *conn = passdb_mysql_conn->conn; + const char *query; + string_t *str; + + str = t_str_new(512); + var_expand(str, conn->set.password_query, + str_escape(auth_request->user), NULL); + query = str_c(str); + + mysql_request->callback = mysql_handle_request; + mysql_request->context = auth_request; + + db_mysql_query(conn, query, mysql_request); +} + +static void +mysql_verify_plain(struct auth_request *request, const char *password, + verify_plain_callback_t *callback) +{ + struct passdb_mysql_request *mysql_request; + + mysql_request = i_malloc(sizeof(struct passdb_mysql_request) + + strlen(password)); + mysql_request->credentials = -1; + mysql_request->callback.verify_plain = callback; + strcpy(mysql_request->password, password); + + mysql_lookup_pass(request, &mysql_request->request); +} + +static void mysql_lookup_credentials(struct auth_request *request, + enum passdb_credentials credentials, + lookup_credentials_callback_t *callback) +{ + struct passdb_mysql_request *mysql_request; + + mysql_request = i_new(struct passdb_mysql_request, 1); + mysql_request->credentials = credentials; + mysql_request->callback.lookup_credentials = callback; + + mysql_lookup_pass(request, &mysql_request->request); +} + +static void passdb_mysql_init(const char *args) +{ + struct mysql_connection *conn; + + passdb_mysql_conn = i_new(struct passdb_mysql_connection, 1); + passdb_mysql_conn->conn = conn = db_mysql_init(args); +} + +static void passdb_mysql_deinit(void) +{ + db_mysql_unref(passdb_mysql_conn->conn); + i_free(passdb_mysql_conn); +} + +struct passdb_module passdb_mysql = { + passdb_mysql_init, + passdb_mysql_deinit, + + mysql_verify_plain, + mysql_lookup_credentials +}; + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb.c work.patched/dovecot-0.99.10/src/auth/passdb.c --- work/dovecot-0.99.10/src/auth/passdb.c Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/passdb.c Fri Aug 15 11:39:31 2003 @@ -110,6 +110,10 @@ if (strcasecmp(name, "pgsql") == 0) passdb = &passdb_pgsql; #endif +#ifdef PASSDB_MYSQL + if (strcasecmp(name, "mysql") == 0) + passdb = &passdb_mysql; +#endif #ifdef HAVE_MODULES passdb_module = passdb != NULL ? NULL : auth_module_open(name); if (passdb_module != NULL) { diff -u -r --new-file work/dovecot-0.99.10/src/auth/passdb.h work.patched/dovecot-0.99.10/src/auth/passdb.h --- work/dovecot-0.99.10/src/auth/passdb.h Thu Mar 20 09:46:33 2003 +++ work.patched/dovecot-0.99.10/src/auth/passdb.h Fri Aug 15 16:45:43 2003 @@ -58,6 +58,7 @@ extern struct passdb_module passdb_vpopmail; extern struct passdb_module passdb_ldap; extern struct passdb_module passdb_pgsql; +extern struct passdb_module passdb_mysql; void passdb_init(void); void passdb_deinit(void); diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb-mysql.c work.patched/dovecot-0.99.10/src/auth/userdb-mysql.c --- work/dovecot-0.99.10/src/auth/userdb-mysql.c Wed Dec 31 18:00:00 1969 +++ work.patched/dovecot-0.99.10/src/auth/userdb-mysql.c Fri Aug 22 17:53:56 2003 @@ -0,0 +1,148 @@ +/* Copyright (C) 2003 Alex Howansky, Timo Sirainen */ + +#include "config.h" +#undef HAVE_CONFIG_H + +#ifdef USERDB_MYSQL + +#include "common.h" +#include "str.h" +#include "strescape.h" +#include "var-expand.h" +#include "db-mysql.h" +#include "userdb.h" + +#include <mysql.h> +#include <stdlib.h> +#include <string.h> + +struct userdb_mysql_connection { + struct mysql_connection *conn; +}; + +struct userdb_mysql_request { + struct mysql_request request; + userdb_callback_t *userdb_callback; + + char username[1]; /* variable width */ +}; + +static struct userdb_mysql_connection *userdb_mysql_conn; + +static int is_result_valid(MYSQL_RES *res) +{ + + if (res == NULL) { + i_error("MYSQL: Query failed"); + return FALSE; + } + + if (mysql_num_rows(res) == 0) { + if (verbose) + i_error("MYSQL: Authenticated user not found"); + return FALSE; + } + + /* XXX */ + if (mysql_num_fields(res) < 3) { + i_error("MYSQL: Not enough fields returned"); + return FALSE; + } +/* XXX + if (PQfnumber(res, "uid") == -1) { + i_error("MYSQL: User query did not return 'uid' field"); + return FALSE; + } + + if (PQfnumber(res, "gid") == -1) { + i_error("MYSQL: User query did not return 'gid' field"); + return FALSE; + } +*/ + + return TRUE; +} + +static const char *my_get_str(MYSQL_RES *res, MYSQL_ROW row, const char *field) +{ + int i, n_fields; + unsigned long *lengths; + MYSQL_FIELD *fields; + + n_fields = mysql_num_fields(res); + lengths = mysql_fetch_lengths(res); + fields = mysql_fetch_fields(res); + for (i = 0; i < n_fields; i++) + if (strcmp(field, fields[i].name) == 0) + return (const char *) lengths[i] == 0 ? + NULL : t_strdup(row[i]); + + return NULL; +} + +static void mysql_handle_request(struct mysql_connection *conn __attr_unused__, + struct mysql_request *request, MYSQL_RES *res) +{ + struct userdb_mysql_request *urequest = + (struct userdb_mysql_request *) request; + struct user_data user; + MYSQL_ROW row; + + if (res != NULL && is_result_valid(res) && + (row = mysql_fetch_row(res))) { + memset(&user, 0, sizeof(user)); + user.virtual_user = urequest->username; + user.system_user = my_get_str(res, row, "system_user"); + user.home = my_get_str(res, row, "home"); + user.mail = my_get_str(res, row, "mail"); + user.uid = atoi(my_get_str(res, row, "uid")); /* XXX leak */ + user.gid = atoi(my_get_str(res, row, "gid")); /* XXX leak */ + urequest->userdb_callback(&user, request->context); + } else { + urequest->userdb_callback(NULL, request->context); + } +} + +static void userdb_mysql_lookup(const char *user, userdb_callback_t *callback, + void *context) +{ + struct mysql_connection *conn = userdb_mysql_conn->conn; + struct userdb_mysql_request *request; + const char *query; + string_t *str; + + str = t_str_new(512); + var_expand(str, conn->set.user_query, str_escape(user), NULL); + query = str_c(str); + + request = i_malloc(sizeof(struct userdb_mysql_request) + strlen(user)); + request->request.callback = mysql_handle_request; + request->request.context = context; + request->userdb_callback = callback; + strcpy(request->username, user); + + db_mysql_query(conn, query, &request->request); +} + +static void userdb_mysql_init(const char *args) +{ + struct mysql_connection *conn; + + userdb_mysql_conn = i_new(struct userdb_mysql_connection, 1); + userdb_mysql_conn->conn = conn = db_mysql_init(args); +} + +static void userdb_mysql_deinit(void) +{ + db_mysql_unref(userdb_mysql_conn->conn); + i_free(userdb_mysql_conn); +} + +struct userdb_module userdb_mysql = { + userdb_mysql_init, + userdb_mysql_deinit, + + userdb_mysql_lookup +}; + +#endif diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb.c work.patched/dovecot-0.99.10/src/auth/userdb.c --- work/dovecot-0.99.10/src/auth/userdb.c Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/userdb.c Fri Aug 22 13:07:21 2003 @@ -49,6 +49,10 @@ if (strcasecmp(name, "pgsql") == 0) userdb = &userdb_pgsql; #endif +#ifdef USERDB_MYSQL + if (strcasecmp(name, "mysql") == 0) + userdb = &userdb_mysql; +#endif #ifdef HAVE_MODULES userdb_module = userdb != NULL ? NULL : auth_module_open(name); if (userdb_module != NULL) { diff -u -r --new-file work/dovecot-0.99.10/src/auth/userdb.h work.patched/dovecot-0.99.10/src/auth/userdb.h --- work/dovecot-0.99.10/src/auth/userdb.h Sun May 18 07:26:28 2003 +++ work.patched/dovecot-0.99.10/src/auth/userdb.h Fri Aug 22 13:07:53 2003 @@ -29,6 +29,7 @@ extern struct userdb_module userdb_vpopmail; extern struct userdb_module userdb_ldap; extern struct userdb_module userdb_pgsql; +extern struct userdb_module userdb_mysql; void userdb_init(void); void userdb_deinit(void);

2 1

[Dovecot] converting from courier-imap
by Emily 30 Aug '03

30 Aug '03

Hello. I apologize if there is a simple answer to this question, but I haven't been able to figure it out. Our people use various clients (pine 4.50 with maildir patch, eudora, messenger, outlook, squirrelmail), and all of them work with courier-imap. But I've become very interested in dovecot after reading about it, so I'm trying it out on another server. The results are mixed. Strangely enough, squirrelmail 1.4.1 works wonderfully. For some reason, it duplicates Sent, Drafts, and Trash, but I deleted the duplicates and it was fine. Mozilla messenger is also fine, but with the same duplication of those special folders. Everything seems nice and fast. But some of our users still cling to pine, which works with courier-imap using these three lines in .pinerc: inbox-path={our.server.edu/ssl/novalidate-cert/user=emily}INBOX default-fcc={our.server.edu/ssl/novalidate-cert/user=emily}INBOX.Sent folder-collections="IMAP Folders" {our.server.edu/user=emily/ssl/novalidate-cert}INBOX.[] On the test server I'm using dovecot-0.99.10 compiled against openssl-0.9.7b in Redhat 9. This pine configuration worked in courier, but when I try pine with dovecot, I can't see any folders under "Folder Collection" other than those special three (Drafts, Sent, Trash). I'm sure there's just something I'm doing wrong, but I couldn't find anything in the dovecot list archives. I would appreciate any advice on what I'm doing wrong in getting pine to see the whole collection. Thanks, -- Emily

2 1

[Dovecot] No localhost after reboot
by Bob Hall 30 Aug '03

30 Aug '03

Rebooted the server box today. Now Dovecot doesn't listen at localhost. It does listen at the LAN interface, so it is perfectly usable, but... Does anyone have any idea why it has stopped listening at localhost? Bob Hall

4 15

[Dovecot] Postgresql and Dovecot
by Michael Ducy 29 Aug '03

29 Aug '03

I am having some issues getting dovecot to work with postgres. Dovecot starts up and runs fine without using postgres (ie passwd and pam). There is nothing in /var/log/messages other than: Aug 28 12:44:05 mail dovecot: dovecot startup succeeded Then ps -A shows no running dovecot processes (or the imap-login or pop-login). I have tried with both the RPMs that are on the download page and buidling it myself on 2 different boxes (yes I configured with --with-pgsql - Red Hat 7.3 and Red Hat 9.0). Any suggestions would be appreciated as this is the only imap/pop server with pgsql support and flatfile support I can find. Michael

3 7

[Dovecot] better body and text search?
by Mark Anderson 29 Aug '03

29 Aug '03

(this is a resend, sorry if duplicate but my first post didn't get through). I was wondering what plans dovecot has for text and body search? This is one of those issues that *no* imap implementation ever seems to document :(. Not cyrus, courier, bincimap, or dovecot.... i speed-read some of the sources and found src/lib-mail/message-body-search.c After a quick scan, it seems: - it uses no text index at all, but does a linear search over the folder. - it searches only messages with content-type starting with "text/" or "message/" - it does no special parsing of "text/html", so tags and attributes would match - it appears to exclude any mime messages, since it skips "multipart/mixed" for example. - it does deal with content encoding and charset. There is a lucene-based text indexing utility for IMAP stores here: http://www.tropo.com/techno/java/lucene/imap.html But ideally there would be pluggable text indexing builtin.... -mda

2 3

[Dovecot] Custom flags.
by Maheshkumar Sabhnani 29 Aug '03

29 Aug '03

How do I define custom flags? What are added features of IMAP apart from Online access and Hierarchy folders. I created a new folder and copied couple of messages from incoming file. Where is this new folder created? Also Microsoft Outlook still shows the messages in incoming as deleted. How do I refresh list to permanently delete the messages that I have already transferred to a different folder. Mahesh

2 1

[Dovecot] Conf problems ??
by maheshkumar sabhnani 29 Aug '03

29 Aug '03

Hello, I am having problems with configuring dovecit. The imap directory was correctly made in ~/mail/.imap But I can't see any mail headers. My mbox path is ~/mail/incoming Currently I am trying to use "mbox:~/mail/:INBOX=~/mail/incoming" for configuration but it complains about missing value. Can someone send me more information on configuration directives especially mbox and INBOX. Early reply shall be appreciated. Regards, Mahesh

2 1

[Dovecot] Squirrelmail & Dovecot
by Alex 29 Aug '03

29 Aug '03

What are the optimum IMAP settings for Squirelmail on dovecot? I am having good luck with the Cyrus settings, but I would prefer to know the real truth... Thanks -Alex

3 2

[Dovecot] better body and text search?
by Mark Anderson 28 Aug '03

28 Aug '03

I was wondering what plans dovecot has for text and body search? This is one of those issues that *no* imap implementation ever seems to document :(. Not cyrus, courier, bincimap, or dovecot.... i speed-read some of the sources and found src/lib-mail/message-body-search.c After a quick scan, it seems: - it uses no text index at all, but does a linear search over the folder. - it searches only messages with content-type starting with "text/" or "message/" - it does no special parsing of "text/html", so tags and attributes would match - it appears to exclude any mime messages, since it skips "multipart/mixed" for example. - it does deal with content encoding and charset. There is a lucene-based text indexing utility for IMAP stores here: http://www.tropo.com/techno/java/lucene/imap.html But ideally there would be pluggable text indexing builtin.... -mda

1 0

[Dovecot] mail accounts for users without home dirs
by Gunter Ohrner 28 Aug '03

28 Aug '03

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi! I use dovecot on a machine where users without an existing home directory (Not my idea...) need to access their mailboxes. Unfortunately dovecot tries to chdir to the users home directory before allowing IMAP access - is there anything I can do about that besides creating a dummy-homedirectory for these users? Greetings, Gunter - -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + PGP-verschlüsselte Mails bevorzugt! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Chain-mail isn't much defence against an arrow. It certainly isn't when the arrow is being aimed between your eyes. -- (Terry Pratchett, Lords and Ladies) +-+-+-+-+-+-+-+-+-+-+-+-+ http://www.lspace.org +-+-+-+-+-+-+-+-+-+-+-+-+ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQE/SpA/0ORHvREo8l8RAvFcAJ0ZsnnRTmBUzQEuon6QLDSOWMB2lgCfVFJw C/6nmMXb8cyvOWog0cfmi6E= =iO/e -----END PGP SIGNATURE-----

4 9

[Dovecot] 0.99.11-test6
by Timo Sirainen 28 Aug '03

28 Aug '03

http://dovecot.procontrol.fi/test/ I think I've fixed the problems that were corrupting indexes with the new code. It happened every time you had expunged some messages and new messages arrived. I think this release might actually work :) disable_plaintext_auth = yes will be default from now on. It allows plaintext authentication from localhost (127.*, ::1) however. I just figured out that the lockless cache file reading prevents me from fixing the mbox code to work the same way it used to. I'm not sure actually how this would be best fixed.. Problem is that headers in mails change and move the messages around in the mailbox, so I have to keep track of them. Previously I just updated the header size in index files.. but without read locks this can't be done safely. One possibility would be to parse the whole mbox file every time when the mailbox is opened (or when it needs to be read) and save the header sizes in memory. That'd make it slower than it is today though.. Or maybe it'd work if I just grabbed exclusive lock whenever reading header sizes. They could be then copied into memory to avoid locking more than once. But that still creates locking contention if lots of clients are reading the mailbox. Exactly in the situation where I'd mostly use mboxes.. I could also save it in .imap.index file which still currently uses read-locks. But I'd rather want to get rid of them in there too.

6 14

[Dovecot] IMAP error after login
by Nicolas STRANSKY 28 Aug '03

28 Aug '03

Hello, I'm having a slight problem with Dovecot (0.99.10-0.rc2, on Debian woody). When using mozilla 1.4, there is an error message from the mailer just after login, but nothing in dovecot logs. "Alert The current command did not succeed. The mail server responded: Error in IMAP command UID: Too long argument.." How could I fix this problem ? Thanks, -- Nico J'ai une panne de micro et les parasites me brouillent l'écoute

3 3

[Dovecot] Chrooting the Mail processes
by Bert Koelewijn 25 Aug '03

25 Aug '03

Hello! Could somebody give some feedback on this configuration: - OpenBSD box with local ssh users. - /home directory mounted with nosuid,noexec. - postfix dropping mail in /home/username/mail/INBOX, with the UID/GID of the user. - dovecot: valid_chroot_dirs = /home default_mail_env = mbox:/home/%u/mail/:INBOX=/home/%u/mail/INBOX Are there any obvious ways for a local user to help dovecot escape the chroot jail? How can I check that dovecot is REALLY using /home as chroot jail for the imap process? Thanks! Bert Koelewijn

2 5

[Dovecot] Docs on the wiki
by Bob Hall 25 Aug '03

25 Aug '03

I went to the Dove Wiki page and added a couple of docs. There's a DoveWikiMainPage link at the top of the first page now. Click on that and the next page has links to the two docs. Someone who knows more than I do about wiki formatting should make this look good. The two docs are for Dovecot/OpenLDAP installation. The first is detailed instructions and the second is a cheat sheet. You don't need to contact me if you find errors; just click "Edit this page" at the bottom. Anyone who wants to use parts of my docs to use in documenting other types of installation should feel free. There's no mention of copyright policy, but I assume everthing is GPL copyleft. Bob Hall

1 0

[Dovecot] Postfix and Maildirs
by Steve Sloan 24 Aug '03

24 Aug '03

Hope someone can help me with this as I am presently stuck I am setting up a new server with Dovecot 0.99.10, Redhat 9.0, Postfix, Amavisd-new and maildir's in the users home drive. I am using Netscape mail 7.1 as the main client to access the mail store via imap which works fine and various other imap clients can access the maildirs Ok as well. The problem is when Postfix delivers a message is insists on making a second Maildir directory in the user's home drive and put the message in there. The Maildir's are being created automatically ie. I didn't use maildirmake. Even if I delete one of the Maildir's it just gets recreated again. ie. this is the test user's home drive drwx------ 10 test2 test2 4096 Aug 23 20:53 Maildir drwx------ 6 test2 test2 4096 Aug 24 11:05 Maildir This is the Maildir that the clients are using and being accessed by Dovecot drwx------ 10 test2 test2 4096 Aug 23 20:53 . drwx------ 4 test2 test2 4096 Aug 24 11:05 .. drwx------ 2 test2 test2 4096 Aug 23 19:58 cur -rw------- 1 test2 test2 5 Aug 23 19:58 .customflags drwx------ 5 test2 test2 4096 Aug 23 19:59 .Drafts drwx------ 2 test2 test2 4096 Aug 23 19:58 .INBOX drwx------ 2 test2 test2 4096 Aug 23 19:58 new drwx------ 5 test2 test2 4096 Aug 23 20:15 .Sent -rw------- 1 test2 test2 29 Aug 23 20:13 .subscriptions drwx------ 5 test2 test2 4096 Aug 23 20:11 .test drwx------ 2 test2 test2 4096 Aug 23 19:58 tmp drwx------ 5 test2 test2 4096 Aug 23 20:11 .Trash and the other one which Postfix user's drwx------ 6 test2 test2 4096 Aug 24 11:05 . drwx------ 4 test2 test2 4096 Aug 24 11:05 .. drwx------ 2 test2 test2 4096 Aug 24 11:05 cur -rw------- 1 test2 test2 5 Aug 24 11:05 .customflags drwx------ 2 test2 test2 4096 Aug 24 11:05 .INBOX drwx------ 2 test2 test2 4096 Aug 24 11:05 new drwx------ 2 test2 test2 4096 Aug 24 11:05 tmp This one has no index files and looks just like a courier Maildir For Postfix main.cf I have set home_mailbox = Maildir/ and /etc/dovecot.conf default_mail_env = maildir:/home/%u/Maildir Hope this make sense to someone Steve -- _____________________________________________ LanSol Computers 283 Sir Donald Bradman Drv. Brooklyn Park SA 5032 Ph 618 8238 3406 Fax 618 83538479 Mobile 0414 398166 Email steve(a)lansol.com.au URL www.lansol.com.au _____________________________________________

3 3

[Dovecot] Three oddities
by Bob Hall 24 Aug '03

24 Aug '03

FBSD 4.8, Dovecot-0.99.10 1) I have mail accounts for people who use Macs and Windows, so their mail is stored on a Unix box where they don't have accounts. When their mail comes in, it is stored in /var/mail/<accountname>. When I was setting this up, I used my own Unix account for testing, and that works fine. But for the other mail accounts, which don't correspond to Unix accounts, I want to give ownership of the /var/mail/* files to another account that doesn't have my privileges. However, no one can access their mail unless I own their files. As long as I own all the /var/mail/* files, everything works fine. But if I shift ownership to another account, users can log on to Dovecot but attempts to access an IMAP folder return an error. >From maillog: Aug 18 16:39:46 kongemord imap(philrodrigues): mkdir_parents(/var/mail/philrodri gues/.imap/INBOX) failed: Permission denied All files and directories in /var/mail/* are in the mail group. I tried adding dovecot to that group, but that didn't help. Since everyone can log on to Dovecot, but can't access their mail unless I own their files, I'm assuming that there's some simple ownership setting that I'm overlooking. But I haven't a clue what it is. Can someone tell me what I need to change? 2) The Macs have Eudora 4.2 installed, and the Win boxes have Eudora 5.1. The Macs can delete mail, put it in the trash, and empty the trash. The Win clients can mark mail deleted, but they can't remove it. The mail stays in the IMAP folder until the same user accesses their mail from a Mac and deletes it. If a user drags a message to another folder, a copy is created in the new folder but the old copy remains in the original folder. I'm not having this problem with Mutt, so it the problem seems to be specific to the Windows verson of Eudora. Is there a fix? 3) We're pulling our e-mail off our ISP's POP server and loading it into Dovecot to allow people to work with their mail from different machines. I'm using getmail to make the transfer. Is anyone else doing POP to IMAP, and how are they doing it? Any suggestions? TIA, Bob Hall

3 24

Re: [Dovecot] please add MySQL Support!
by Matthew Reimer 24 Aug '03

24 Aug '03

Timo Sirainen wrote: > On Sun, 2003-08-24 at 02:57, eLgino wrote: > >>Hi, Developer(s) >> >>I will use this fantastic IMAP/POP -Server but i dislike, no a realy HATE >>PostgreSQL!, please make a hack or code a MySQL support. >> >>I know its a strange mail, and "question" but every one's first choice for >>SQL-DBs is MySQL! :) and i love it!. > > > And I really hate MySQL :) I'm still hoping someone else would write the > support for it. I might end up doing it eventually, but currently > there's more important things to do. Just yesterday I got this working, using the pgsql stuff as a guide. After I clean up the patch and make sure I'm not leaking memory, I'll send it to the list. Matt

1 0

[Dovecot] please add MySQL Support!
by eLgino 24 Aug '03

24 Aug '03

Hi, Developer(s) I will use this fantastic IMAP/POP -Server but i dislike, no a realy HATE PostgreSQL!, please make a hack or code a MySQL support. I know its a strange mail, and "question" but every one's first choice for SQL-DBs is MySQL! :) and i love it!. thanks in advance eLgino

2 1

[Dovecot] ssl failure !!
by thomas may 24 Aug '03

24 Aug '03

Hi, i havent yet any problems with dovecat but in my dovecot log i get the following warning, does anybody know what its wrong. imap-login: Aug 23 22:14:47 Warning: SSL_read() syscall failed: Connection reset by peer [192.168.1.139] imap-login: Aug 23 22:14:48 Info: Login: info(a)domain1.com [192.168.1.139] -th

3 2

[Dovecot] postfix+dovecot
by eLgino 22 Aug '03

22 Aug '03

Hi folks, I will setup an mailserver with postfix an dovecot, but i would like to add the users and domains to postfix is this possible? because postfix can handle mysql. and if this possible anyone can say me HOW?, i do not find anything about this. if not anyone can say me how i do configure it with postgresql (dovecot)? ( i have NO pgsql skills). i hope anyone can understand my poor english, and thx in advance bye

1 0

[Dovecot] user database clarification
by Jared 22 Aug '03

22 Aug '03

Hi, this question gets back to a thread I started back on July 8th. (gosh how time flies) I still am not clear on why PAM is not supported for the user database. I'm in an environment that has users both in local flat files (/etc/passwd and /etc/shadow) AND in an LDAP database. Is it possible for this set up to work with dovecot? (both local and ldap users have imap/pop?) I'd prefer to just have Dovecot use PAM for user db and the password database so that I can configure PAM to try both local users and LDAP users. Thanks a lot. -jared

3 4

[Dovecot] rawlog change suggestion
by Charlie Brady 21 Aug '03

21 Aug '03

I find the separate .in and .out files rather difficult to work with. I think it would be more useful if the in/out traffic were interleaved with a prefix to indicate direction, and suffix to indicate continuation, as recordio (http://cr.yp.to/ucspi-tcp/recordio.html) does: <a0002 LIST "" "" >* LIST (\Noselect) ";" "" >a0002 OK List completed. <a0003 SELECT "INBOX" >* FLAGS (\Answered \Flagged \Deleted \Seen \Draft) >* OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags + >permitted. >* 18 EXISTS >* 0 RECENT >* OK [UNSEEN 18] First unseen. >* OK [UIDVALIDITY 1055795174] UIDs valid >* OK [UIDNEXT 6741] Predicted next UID >a0003 OK [READ-WRITE] Select completed. <a0004 STATUS "incoming.foo" (RECENT) >* STATUS "incoming.foo" (RECENT 397) >a0004 OK Status completed. <a0005 NOOP >a0005 OK NOOP completed. Comments? -- Charlie

2 2

[Dovecot] Mozilla dovecot interaction
by Eric S. Johansson 21 Aug '03

21 Aug '03

I think this is more a Mozilla bug but just a heads up the case other people complain. periodically, the Mozilla e-mail client refuses to delete messages. It shows up either as absolutely no action when you press the delete key/button or it shows activity but refuses to perform any other action in that mailbox. Sometimes if you switch to another mailbox and then come back to the mailbox you're deleting e-mail message from, the messages deleted when you re-enter the mailbox. I looked with ethereal and it looks like Mozilla is not sending any imap commands. Hence my assertion that it's a Mozilla problem. The only reason I mention it here is because something about dovecot seems to trigger the problem more quickly. I was seeing this kind of problem before but only after a week or two of uptime in the browser. Now I'm seeing it in just under a week (I think) I've only seen at once but I will keep track for future reference. I got to get me a new client... ---eric

1 0

[Dovecot] transitional weirdnesses
by Eric S. Johansson 20 Aug '03

20 Aug '03

1) not reproducible but when it occurred, its stuck: in the early transition to dovecot I would notice occasionally that messages would come up, I would delete them and then something would hang causing a major delay in the (Mozilla) e-mail client's response. When the system responded, I would notice that occasionally there would be an off by one offset between the index of messages and the message displayed. This error would persist until I killed off the index and the dovecot process. 2) very reproducible: after fetching messages from my inbox, there will be a long (30 sec.) delay. Dovecot demon is clearly busy doing something. I do have a large set of filter rules (approximately 150) sorting messages into different boxes. Is this a reason to switch to maildir? 3) just ended up with a message that displayed the entire header. Will look into this more but it's very strange. ---eric

4 14

[Dovecot] Squirrelmail and Dovecot folder namespace
by Warren Togami 19 Aug '03

19 Aug '03

I am currently using Squirrelmail and Dovecot with this setting: default_mail_env = mbox:%h/mail/:INBOX=%h/mail/INBOX It works well, however folder subscriptions in Squirrelmail annoyingly end up with "./" prefixes because Squirrelmail refuses to work without overriding the folder namespace. All of my other IMAP clients work fine without setting that option. Squirrelmail's default setting is this: $default_folder_prefix = './mail'; This setting breaks Squirrelmail: $default_folder_prefix = ''; This setting becomes default if you attempt to blank that user's preference: $default_folder_prefix = './'; The end result of this is duplicate entries in .subscriptions, one with "./" prefix and one without. Most IMAP clients handle this by showing all the folders again in a folder named ".", or Mozilla displays all folders twice. =( When I asked one of the squirrelmail developers, he said that this might be a dovecot specific problem. Any ideas? Warren Togami warren(a)togami.com

2 1

[Dovecot] Re: CVS Note
by dovecot＠spam.turbolink.net 19 Aug '03

19 Aug '03

Is mbox support working again in CVS? - Mike

2 1

[Dovecot] Questions
by Alejandro Martinez 19 Aug '03

19 Aug '03

Hi, I'm still figthing with passwd-file, virtual users and permissions. I have created the directory /var/spool/virtual/test and inside I've done a "maildirmake Maildir". I have a couple of questions : I use the same passwd-file for auth_userdb and as auth_passdb. 1) What program can I use to create the userdb file ? What I do now is to use the htpasswd program and then I complete by hand the rest of the fields (uid:group:GECOS:home:shell) htpasswd userdb test password: xxx again: xxx And then vi userdb test@test.com:ssasZXc00P1H6:502:102::/var/spool/virtual/test/:/bin/false <--by hand. I think that if I want to offer virtual mail with imap is very tedious to complete user by user. (If this second question does not fall in this list, then don't answer it) 2) I know that postfix delivers in Maildir format, and when the user is a virtual user, I do the next Modify the virtual file ---> test(a)test.com test.test.com Modify the aliases file--> test.test.com: /var/spool/virtual/test/Maildir postmap hash:virtual postaliases hash:aliases postfix reload but when I do a "echo testing | sendmail test(a)test.com " I receive an error Aug 18 15:32:44 slk90 postfix/pickup[12208]: 95C3717D5C: uid=0 from=<root> Aug 18 15:32:44 slk90 postfix/cleanup[12252]: 95C3717D5C: message-id=<20030818183244.95C3717D5C(a)slk90.equital.lx> Aug 18 15:32:44 slk90 postfix/qmgr[12209]: 95C3717D5C: from=<root(a)slk90.equital.lx>, size=291, nrcpt=1 (queue active) Aug 18 15:32:44 slk90 postfix/local[12254]: 95C3717D5C: to=<test.prueba.com(a)slk90.equital.lx>, orig_to=<test(a)prueba.com>, relay=local, delay=0, status=bounced (cannot append message to destination file /var/spool/virtual/test/Maildir: cannot open file: Permission denied) I'm confused about permissions. I set the /var/spool/virtual to dovecot.postfix and the permissions are drwxrwx--- Thanks a lot. --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com) Version: 6.0.509 / Virus Database: 306 - Release Date: 12/08/2003

2 1

[Dovecot] CVS note
by Timo Sirainen 18 Aug '03

18 Aug '03

Another large update for header caching which breaks your old indexes. I think it's working pretty nicely now. Only some smaller tweaking left to do with caching in general.

1 0

[Dovecot] more transitional joys
by Eric S. Johansson 17 Aug '03

17 Aug '03

well, now that I have moved to dovecot, I'm not getting any spam... in fact, I'm not getting e-mail at all. default_mail_env =mbox:~/IMap2/:INBOX=/var/spool/mail/%u when I first tried to access my inbox, I was told I had permission problems: Aug 14 17:47:22 harvee imap(esj): open(/var/spool/mail/esj.lock) failed: Permission denied Aug 14 17:47:22 harvee imap(esj): file_lock_dotlock() failed with mbox file /var/spool/mail/esj: Permission denied so I changed permissions on /var/spool/mail to 777 as a temporary work around. no luck. It tells me that I have no e-mail in my inbox... fat chance [root@harvee mail]# ls -l /var/spool/mail/esj -rw------- 1 esj mail 167772 Aug 14 18:05 /var/spool/mail/esj what simply obvious thing I am I missing now? ---eric

4 6

[Dovecot] 0.9.10 and Cygwin
by Tim H. 17 Aug '03

17 Aug '03

Has anybody succeeded in compiling 0.9.10 with Cygwin? I'm getting the following error:- gcc -DHAVE_CONFIG_H -I. -I. -I../.. -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -c istream-file.c istream-file.c:57: conflicting types for `_close' /usr/include/sys/unistd.h:148: previous declaration of `_close' istream-file.c:129: conflicting types for `_read' /usr/include/sys/unistd.h:153: previous declaration of `_read' make: *** [istream-file.o] Error 1 Thanks Tim

2 1

[Dovecot] login w/ IMAP & LDAP
by Bob Hall 16 Aug '03

16 Aug '03

I'm getting imap-login: Internal login failure: bob whenever I try to check mail. I'm new to mail server setup, new to IMAP, and I don't know a heck of a lot about authentication schemes. I've set up Dovecot as an IMAP server on FreeBSD 4.8. I've got OpenLDAP running on the same system. Users will access mail via Eudora on Windows and Macs, so that's how I'm testing. If I try to test Dovecot using IMAP commands via telnet, Dovecot tells me LOGIN BAD Error in IMAP command received by server. I also can't telnet via localhost; I have to specify the host name, so I'm connecting via the host's external interface. I have no problem connecting to localhost on ports not used by Dovecot. So I have two questions: 1) How do I correct my configuration to make login successful? 2) How can I test Dovecot without using an MUA? If I have to use an MUA, I can't distinguish between errors in the MUA and errors in the IMAP server. Thanks for any help with these two. Configuration follows. Eudora: Server configuration: IMAP IMAP Mailbox Location Prefix: /var/mail/bob/Mail Authentication Style: passwords dovecot.conf ---------------- protocols = imap imaps imap_listen = *:143 login_user = dovecot default_mail_env = mbox:/var/mail/%u/Mail auth_userdb = ldap /usr/local/etc/dovecot-ldap.conf auth_passdb = ldap /usr/local/etc/dovecot-ldap.conf auth_user = dovecot dovecot-ldap.conf ------------------- hosts = localhost dn = cn=dovecot,dc=domain,dc=tld dnpass = ********** ldap_version = 3 base = ou=accounts,dc=domain,dc=tld deref = never scope = subtree user_attrs = uid user_filter = (&(objectClass=inetOrgPerson)(uid=%u)) pass_attrs = uid,userPassword pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)) default_pass_scheme = PLAIN slapd.conf ----------------- password-hash {CLEARTEXT} If I change this last to CRYPT (comment out the dovecot-ldap default_pass_scheme and change the slapd.conf password-hash to {CRYPT} and re-enter the password into LDAP), I get the same error. I have no problem accessing the LDAP data from the command line. If I comment out the dovecot-ldap.conf user_filter and pass_filter, I get dovecot-auth: ldap(bob): unknown user I interpret as meaning that the user_filter and pass_filter are necessary. Bob Hall

5 17

[Dovecot] Startup Problem
by Tobias Sasse 15 Aug '03

15 Aug '03

Hello, i don't like asking stupid questions in mailinglist, 'cause i guess you got something better to do than answer it. But well this is an exception, because i didn't find anything on google. Here comes my problem: I'm using a NetBSD 1.6.0 System with the latest dovecot build. i want to start dovecot imapd by: root@balin:[/etc]$ ./rc.d/dovecot start Starting dovecot. Fatal: Error in configuration file /usr/pkg/etc/dovecot.conf line 88: Missing value This is my error ;) This is the line 88 in my conf file. maildir:/home/%u/mail the maildir was created by 'makemaildir mail' and exists: root@balin:[/home/tobi]$ ls -all total 18 drwxr-xr-x 4 tobi users 512 Aug 15 09:11 . drwxr-xr-x 3 root wheel 512 Aug 13 01:18 .. drwx------ 5 tobi users 512 Aug 14 12:47 mail there it is. in default option of the maildir line dovecot starts without problems but i really want to have my mails in /home/%u/mail and not in /var/mail/%1u/%u/mail So could somebody please put some light on it? Thank you, Tobi

2 1

[Dovecot] joys of transition.
by Eric S. Johansson 15 Aug '03

15 Aug '03

Red Hat 8.0 stock dovecot 99.10 for a variety of reasons, I decided to cut over to dovecot this morning. I extracted all of my mailboxes from mbx purgatory back to mbox purgatory, set up dovecot and proceed to get authentication failures. (am using simple password based authentication either direct or through pam) I turned authentication verbosity on and got: Aug 14 11:51:38 harvee dovecot: Dovecot starting up Aug 14 11:51:46 harvee dovecot-auth: PAM: pam_authenticate(esj) failed: Authentication failure Aug 14 11:51:49 harvee dovecot-auth: PAM: pam_authenticate(esj) failed: Authentication failure Aug 14 11:51:52 harvee imap-login: Aborted login [192.168.0.10] not very informative. I already know that I can't login. So I fire up ethereal and capture the following transaction: * OK dovecot ready. 1 authenticate login 1 NO Unsupported authentication mechanism. 2 login "esj" "no peeking" 2 NO Authentication failed. 3 authenticate login 3 NO Unsupported authentication mechanism. 4 login "esj" "no peeking" 4 NO Authentication failed. 5 logout * BYE Logging out 5 OK Logout completed. hmm no unsupported authentication mechanism. So that means all authentication methods works right? ;-) looking a little further into the configuration, I see instructions to change auth_methods to add plain in front of digest-md5 (or is it digest_md5, both forms are present in the configuration file). No luck. Doing so gives me the following error message: Fatal: Error in configuration file /usr/local/etc/dovecot.conf line 430: Unknown setting: methods so, I'm not sure what to look for. It's probably something simple but googling didn't reveal anything pertinent although it turned up something amusing[1]and dovecot does apply. Suggestions or clues would be welcome. FYI, you probably could use a little bit more detail in the install instructions. For example instructing user to create a dovecot user and group name would be useful as would be a startup/shutdown script for init.d. I also find the SSL configuration lacking. On the other hand, I have enough scar tissue from certificates and mini-CA setups to hate them till the end of time. If I get them working better, I'll document and send it to the list. ---eric [1]http://www.oblomovka.com/eldritch/iag/ob1-5.htm

2 2

[Dovecot] error in config file?
by Robert S. Jagger 15 Aug '03

15 Aug '03

When I start dovecot I am getting an error about the ocnfig file. watson:~# /etc/init.d/dovecot start Starting mail server: dovecotFatal: Error in configuration file /etc/dovecot.conf line 185: Missing value So I look int /etc/dovecot.conf and line 185 is mbox:~/mail/:INBOX=/var/mail/%u/ Which seems like valid syntax according to the docs. I am using dovecot 0.99.10-2

2 1

[Dovecot] Mozilla
by Stefan Sels 14 Aug '03

14 Aug '03

Hi, I hope this problem is not answered before. Mozilla is making trouble with searching and subscribing folders. Do I have to change the "namespace" ? If I start a search (other than just in To & CC or subject) mozilla complains about a closed connection. A fresh mozilla installation just lists no folder beside "Inbox". Regards, Stefan Sels

3 4

[Dovecot] Hardlinks in copy
by Andreas Aardal Hanssen 12 Aug '03

12 Aug '03

Hi, Dovecotters. In the Maildir code, dovecot-0.99.10/src/lib-storage/index/maildir/maildir-copy.c, I see that hardlinks are used. It seems that (line 185) if MAILDIR_COPY_WITH_HARDLINKS is exported, then copying is attempted by using link. Having problems reading the source / flow of control, I resort to this list. When a file is linked, the mtime is naturally kept on the destination. This gives the destination message the same internaldate as the original. The destination mailbox would then be likely to get an arrival with an earlier internaldate than its newest message. The IMAP protocol says to bump UIDVALIDITY when this happens. Does Dovecot always bump UIDVALIDITY when messages are copied, or is not the mtime used for internaldate? Best regards, Andreas -- Andreas Aardal Hanssen

2 1

[Dovecot] 0.99.10-test5
by Timo Sirainen 12 Aug '03

12 Aug '03

Again at http://dovecot.procontrol.fi/test/ if someone wants to test it. - new index file code should work now - mbox support is completely broken - caching isn't very smart yet. it always caches only what client requested at the time - header caching might have some problems actually now that I think of it.. I was anyway going to change a bit how it worked.

2 1

[Dovecot] CVS/test version config/build failures on FreeBSD
by Mike Brown 11 Aug '03

11 Aug '03

While diagnosing a problem I was having with IMAP and SSL (which I ended up fixing by simply upgrading from 0.99.9.1 to 0.99.10, and possibly affected by upgrading openssl libs from 0.9.7a to 0.9.7.b), I attempted to try the CVS version of Dovecot. When using the CVS version, apparently I have to first generate 'configure' using autogen.sh (?). This was the result of that, on FreeBSD 4.8-STABLE (2003-08-06): # ./autogen.sh automake: configure.in: installing `./install-sh' automake: configure.in: installing `./mkinstalldirs' automake: configure.in: installing `./missing' configure.in: 3: required file `./config.h.in' not found automake: configure.in: installing `./depcomp' configure.in:3: warning: do not use m4_patsubst: use patsubst or m4_bpatsubst configure.in:13: warning: AC_ARG_PROGRAM invoked multiple times configure.in:1126: warning: do not use m4_regexp: use regexp or m4_bregexp autoheader: `config.h.in' is created And then... # ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... no checking for mawk... no checking for nawk... nawk checking whether make sets ${MAKE}... yes checking whether to enable maintainer-specific portions of Makefiles... no checking for style of include used by make... GNU checking for gcc... gcc checking for C compiler default output... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking dependency style of gcc... gcc checking for strerror in -lcposix... no checking for gcc... (cached) gcc checking whether we are using the GNU C compiler... (cached) yes checking whether gcc accepts -g... (cached) yes checking dependency style of gcc... (cached) gcc checking how to run the C preprocessor... gcc -E checking for ANSI C header files... yes checking for gcc option to accept ANSI C... none needed checking for inline... inline checking build system type... i386-unknown-freebsdelf4.8 checking host system type... i386-unknown-freebsdelf4.8 checking for ranlib... ranlib checking for ld used by GCC... /usr/libexec/elf/ld checking if the linker (/usr/libexec/elf/ld) is GNU ld... yes checking for BSD-compatible nm... /usr/bin/nm -B checking whether ln -s works... yes loading cache /dev/null within ltconfig ./ltconfig: .: /dev/null: not a regular file ltconfig: you must specify a host type if you use `--no-verify' Try `ltconfig --help' for more information. configure: error: libtool configure failed I also attempted to use 0.99.11-test4 from http://dovecot.procontrol.fi/test/, but this failed to build: [...] Making all in maildir gcc -DHAVE_CONFIG_H -I. -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-index/maildir -I../../../../src/lib-storage -I../../../../src/lib-storage/index -I/usr/local/include -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -c maildir-copy.c make: don't know how to make ../../../../src/lib-storage/index/index-expunge.h. Stop *** Error code 1 Stop in /usr/local/src/dovecot/dovecot-0.99.11-test4/src/lib-storage/index. Just thought you'd like to know :) -Mike

3 8

[Dovecot] Some benchmarking
by Timo Sirainen 11 Aug '03

11 Aug '03

So I finally got the new mail caching code fully working in normal conditions. Index rebuilding and some error correction still needs a bit work. mbox is also still broken. Anyway, I was mostly interested how fast Dovecot now works with my 367000 LKML mails, but thought I'd have to get something to compare the results against, so here's Dovecot vs. Courier. Results against older Dovecot would have been pretty boring, the older Dovecot could never perform threading without opening all the files and reading References-headers from them. Sorting would could have been done from cache if IMAP ENVELOPEs were cached, I'd estimate maybe 2-3x larger user CPU usage with it and a _lot_ larger cache file since it would have stored from, to, etc. fields in it. Results against Cyrus would be interesting. I'll probably do those sometimes later too.. Last I checked, Cyrus was very slow at inserting the mails into it's database, it took .. was it 1-3 hours to insert all those mails, while a simple copying took maybe 20 mins. Anyway, Cyrus's caching is pretty dummy as well so I'd expect Dovecot to be many times faster in threading and likely somewhat faster in sorting.

3 2

[Dovecot] Direct RADIUS support, not via PAM
by Jethro R Binks 08 Aug '03

08 Aug '03

Hi, I'm currently testing dovecot to authenticate user passwords against a radius server, via pam_radius_auth, and that seems to work fine. However, I am running other software (Exim MTA) that also authenticates via radius, using the radiusclient library from: http://www.mcs.de/~lf/radius/ Is there any chance that this library could be used by Dovecot as a further authentication option, and save me having two separate radius configurations for two different (but related) pieces of software, and the need to install pam_radius_auth, which I don't otherwise use? Jethro. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Jethro R Binks Computing Officer, IT Services University Of Strathclyde, Glasgow, UK

2 1

[Dovecot] Slow bulk deleting
by Leslie Viljoen 07 Aug '03

07 Aug '03

Hi! I am finding Dovecot very slow to delete large numbers of messages. IS this a known problem? Leslie

2 2

[Dovecot] compile with dietlibc
by Jens Gutzeit 07 Aug '03

07 Aug '03

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, I'm used to test the software which I use with dietlibc, just to see if it could run without the bloat of glibc. While compiling dovecot 0.99.10 I got these errors: In file included from lib.h:20, from alarm-hup.c:26: compat.h:30: conflicting types for `uint_fast32_t' /opt/diet/include/stdint.h:25: previous declaration of `uint_fast32_t' I've solved this in a dirty way, but is this something which could be fixed in the future? Thanks in advance, Jens Gutzeit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQE/L/etLPHiyaqJLscRAuNGAJ9jlOQzx86T+NS9h7FfjoDi86R4ygCgs6gb 1XyNB93ybwiG4gFatz797qo= =WZod -----END PGP SIGNATURE-----

3 3

[Dovecot] thinking seriously about converting
by Eric S. Johansson 06 Aug '03

06 Aug '03

to dovecot from UW imap. I think I will go all the way to maildir while I'm at it. I was having performance problems with mbox format files and converted to mbx but it's not really yielding a huge performance gain. Deletes and moves are still rather slow at times. my mailboxes are typically 2000 to 5000 messages. I've scanned the mailing lists a bit and picked up some hints on the conversion. Any bits of advice before I convert? Since it's only my own account I'm converting (my wife likes mutt), I'm torn between two different ways of converting the mailboxes. First is to convert all of the mbx format mailboxes back to mbox. Then convert from mbox to maildir. Second is running both imap server simultaneously (obviously one on a different port number) and running some form of a tool to read from one imap server and write to the other. any better ideas? many thanks ---eric

2 1

[Dovecot] corrupt mbox, mailboxes not found, and message read status
by Jared 04 Aug '03

04 Aug '03

I'm running dovecot 0.99.10-0.rc2 deb packages for Debian Woody from braincells.com. My old environment was a server running UW-IMAP for IMAP and POP services. We are still using mbox for all mailboxes. I use IMP for web based access. Forgive me if these issues have already been discussed or fixed in cvs. Any additional pointers to this info. would be appreciated. I have noticed a few issues. ---- I've seen a whole slew of entries like the following: pop3(username): Error indexing mbox file /home/username/mail/inbox: LF not found where expected According to this mailing list post from June 16, 2003: http://dovecot.procontrol.fi/list/dovecot/2003-June/001668.html it may be because of adjacent From mail headers in a message. I've had one user that this was not the case. They said they were deleting lots of messages in IMP and when he went back to his inbox, it was empty. When I looked at the mbox file, a message had been truncated. When I deleted the imap index and removed that truncated message, the mailbox became visible again. Has the adjacent From issue been fixed? Is there a way to find out more specifically what part of the mbox file dovecot is unhappy about? ie. a line number. ---- Inside IMP several users have set up a filter to send messages marked as spam by SpamAssassin into a spam folder. When they log-in or click the filter icon, the filter runs. However, now when the the filter runs, it reports: "Problem with filter rule 1: folder does not exist: mail/spam". However, the spam folder is still there, and when I open that folder in IMP, it opens just fine. I've already changed IMP's folder prefix from 'mail/' to ''. I've also tried deleting the imap index. The message still shows up and the filter fails to run. ---- With the old set-up, when I check mail with a pop3 client, the UW pop server modifies the Status and/or X-Keywords headers for the message. When the mailbox is viewed with an IMAP client such as IMP, messages that have already been downloaded via pop are marked as read. This doesn't seem to happen with dovecot. I found a Oct 19 2003 thread ( http://dovecot.procontrol.fi/list/dovecot/2002-October/000774.html ) on the mailing list where Timo said he was intending to use the X-Keywords trick. Did this ever get implemented? ---- Thanks, -jared

5 6

[Dovecot] why wont /usr/pkg/libexec/dovecot/imap see my Maildir
by Charlie Allom 04 Aug '03

04 Aug '03

When I invoke /usr/pkg/libexec/dovecot/imap from the command loine on the mail host, it logs me in, but won't see my emails: 13:22 yeled@lazy:~$ /usr/pkg/libexec/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND * UNSELECT LITERAL+ IDLE CHILDREN LISTEXT LIST-SUBSCRIBED] Logged in * as yeled 0 select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] * Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1059959635] UIDs valid * OK [UIDNEXT 1] Predicted next UID 0 OK [READ-WRITE] Select completed. I know I have many emails in there, and I can see them when I login via telnet localhost 443. Any tips? would be nice to use fetchmail with ssh here. C. -- charlie(a)rubberduck.com - Melbourne, Australia http://rubberduck.com/~yeled/ PGP: 0x14AA7941 || finger yeled(a)lazy.spodder.com

2 2

[Dovecot] Confusion
by Alejandro Martinez 02 Aug '03

02 Aug '03

Hi, I have a great confusion about mbox, maildir. I use a passwd-file to authenticate users, because I want to use non local users. I have a test user in that file that is this: test:VGRAafc3NHJwI:502:100:Usuario Virtual:/var/spool/mail/virtual/test:/no/shell I create inside /var/spool/mail/virtual/test a folder Maildir and inside Maildir /var/spool/mail/virtual/test/Maildir/cur/ /var/spool/mail/virtual/test/Maildir/new/ /var/spool/mail/virtual/test/Maildir/tmp/ I get an error when I login to the server admin@slk90 /$ telnet localhost 143 Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. * OK dovecot ready. . login test test . OK Logged in. Connection closed by foreign host. The /var/spool/mail/error is this "Aug 2 08:46:46 slk90 imap(test): Failed to create storage with data: /var/spool/mail/virtual/test/Maildir" I've tried setting default_mail_env = maildir:~/Maildir and mbox:~/Maildir, but nothing work. Any help ? Regards. --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com) Version: 6.0.506 / Virus Database: 303 - Release Date: 01/08/2003

2 1

RE: [Dovecot] corrupt mbox, mailboxes not found, and message rea d status
by Maikel Verheijen 31 Jul '03

31 Jul '03

[SNIP] > http://dovecot.procontrol.fi/list/dovecot/2002> -October/000774.html ) > > on the mailing list where Timo said he was intending to use the > > X-Keywords trick. Did this ever get implemented? > > X-Keywords have been used for a long time now. It's possible > to set \Seen flag for messages downloaded with POP3, but I > don't know if it's worth the trouble. Who uses POP3 and IMAP > mixed anyway? > A lot of our customers, since we only supported pop3 in the past, and our new webmail uses imap. :) And a lot of people don't click on "This is an imap server" when creating their account in for instance outlook-express. Kind regards, Maikel Verheijen.

3 2

[Dovecot] New index file code
by Timo Sirainen 31 Jul '03

31 Jul '03

I just had to write this even while it's not just yet in CVS, but it's only a few fixes away from being committed.. My year long dream has finally came true :) [Summary: Next release will have REALLY kickass indexes] Previously the biggest problem with caching message data in indexes was that we had to do it while syncing the mailbox, before client even saw those messages. This caused index rebuilds to be very slow since it had to go through all mails and cache all of them, even if client never would access them. Alternative was to not cache anything at all, but that wasn't really good idea either. Now Dovecot caches the data when client is actually requesting it. That way it will never do any extra work for caching something that client isn't currently interested in. There's still the anticipatory caching for data that client is likely to be interested in later, but that is done only when it doesn't cause extra disk I/O. The reason why it took this long was because it was previously too difficult with read/write locking that indexes required. I couldn't have relied on it working since changing from read lock -> write lock could deadlock and dropping the lock in the middle would have caused even more problems. So, what I did was to rewrite the cache file handling completely: - It doesn't require any locking to read from it. - It will be NFS-safe without being too costly. - The file format itself is now architecture-independent. - Uses less space than before - OpenBSD support is now worse than before, even worse than NFS-support. They should get that unified cache done. Cached data is also selected better: - Specifically requested message headers are cached (FETCH, SEARCH, SORT, THREAD, etc.) - IMAP ENVELOPE isn't treated in any special way anymore. It's treated just as if you had requested HEADER.FIELDS (Date Subject From ...etc.). - Maildir filenames aren't constantly updated in the cache file anymore. This takes more memory now, but should reduce disk I/O. There's a few more tweaks that I'll probably add later: - Maildir: When compressing cache file we update mail's filename to current one so if message's flags aren't changed often, it won't use any extra memory either. - A normal text/plain message doesn't need to have it's IMAP BODYSTRUCTURE cached. It only needs a single bit set in flags. Should reduce used space quite a lot. - Message with only one body part doesn't need to have it's body structure stored at all since it's mostly just useful for fetching body parts. Plus the body structure could be generated if message sizes were known. All this work was only for index cache file (ex. .data file). There's still the main .imap.index file and modify log files. Modify log should be easy to make NFS-safe - I'm currently using some stupid file locking to figure out when the file is safe to overwrite, but I should have simply replaced the old file with rename(). That will solve some other problems as well as make the code simpler. It should be possible to be made read-lockless as well. The main index file is more problematic though. It contains a lot of changing fields in the header, such as number of messages, number of seen messages, etc. I can't think of any way to make it safe to read these fields without locks (my previous ideas didn't actually work). Lockless reads are pretty much a must for scalable NFS-safety. I think it could be done by simply removing all the constantly changing headers. If you want to know how many seen messages there are, just read all the records in the file and count them. Expunging would be done by rewriting the file and rename()ing it over the old file. Appending new messages is a bit tricky to do safely, but I think I know how to do that too.. read/write locks allow the changing headers, but there's locking contention problems with shared mailboxes.. I think I'll make it optional how to do this. Oh, and I also thought how indexes would work with shared mailboxes. You could use one shared cache file, but each user would have their own main index and modify log. That would allow storing per-user flags in the index file and also expunge (hide) messages by removing them from user's index.

1 0

[Dovecot] Is dovecot NFS safe?
by Adam Shand 29 Jul '03

29 Jul '03

I'm migrating our mailserver from cyrus 2.0 to Postfix and Dovecot. We're using maildirs delivered to /var/maildir, which is mounted via NFS from a Netapp. My understanding was that maildir was completely happy in an NFS environment but I've seen a couple messages here recently which mention the dovecot index files not being NFS safe. Are their any caveats or gotcha's that I need to be aware of? Thanks, Adam.

4 5

[Dovecot] Namespaces
by Timo Sirainen 27 Jul '03

27 Jul '03

0.99.11-test4 release: http://dovecot.procontrol.fi/test/ Finally namespaces somewhat working. Example: namespace private { separator = / prefix = INBOX/ location = maildir:~/Maildir } namespace private { separator = / prefix = #mbox/ location = mbox:~/mail } Problems: - Mailbox listing lists only the first namespace unless you clearly ask mailboxes under some namespace. Not really a problem, but related to: - There should be only one common subscriptions file for all namespaces. This needs some thinking how to do it well. - Having multiple different mailbox formats in one namespace still isn't possible. Needs some more thinking as well.

1 0