- dovecot - dovecot.org

[Dovecot] Panic: key not found from hash
by Hans-Jürgen Mehnert 06 Feb '06

06 Feb '06

Hello, we have about 120 servers doing some million mails per day. Most of them use dovecot for pop and imap. In version 1.0.alpha4 we have dovecot-crashes on one or two of the machines in a week where dovecot log says "Panic: key not found from hash" and dovecot dies. We tried version 1.0.beta2 on some machines but with that we have another problem where log says "Error: auth-worker(default): sql((USER),(IP)): Password query failed: MySQL client run out of memory" and the auth process dies. Couldn't find anything usefull on that on the net so i'll ask the list bevor i'll post a bug report. ==================== /etc/dovecot.conf ==================== # dovecot pop3 + imap config (rpm) # SG PN HJM 2005-09-09 ## Main protocols = imap imaps pop3 pop3s # protocols = pop3 pop3s ssl_disable = no ssl_cert_file = /etc/ssl/cert ssl_key_file = /etc/ssl/key disable_plaintext_auth = no log_path = /var/log/dovecot ## Login processes login_processes_count = 2 login_max_processes_count = 128 login_max_logging_users = 256 # Greeting message for clients. login_greeting = Dovecot ready. ## Mail processes max_mail_processes = 1024 verbose_proctitle = yes verbose_ssl = no first_valid_uid = 500 last_valid_uid = 0 first_valid_gid = 0 last_valid_gid = 0 mail_extra_groups = mail_debug = no #default_mail_env = #mail_save_crlf = no #mmap_disable = no #lock_method = fcntl #maildir_stat_dirs = no #maildir_copy_with_hardlinks = no #mbox_read_locks = fcntl #mbox_write_locks = dotlock fcntl #mbox_lock_timeout = 300 #mbox_dotlock_change_timeout = 30 #mbox_dirty_syncs = yes #mbox_very_dirty_syncs = no #mbox_lazy_writes = yes #umask = 0077 #mail_drop_priv_before_exec = no #mail_process_size = 256 #mail_log_prefix = "%Us(%u): " ## IMAP specific settings protocol imap { imap_max_line_length = 65536 login_greeting_capability = no imap_client_workarounds = outlook-idle mail_use_modules = yes mail_modules = /usr/lib/dovecot/imap } ## POP3 specific settings protocol pop3 { pop3_no_flag_updates = no pop3_enable_last = yes pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh mail_use_modules = yes mail_modules = /usr/lib/dovecot/pop3 } ## Authentication processes auth_verbose = no auth_debug = no auth_worker_max_count = 30 auth default { mechanisms = plain # SQL database - normal passdb sql { args = /etc/dovecot-sql.conf } # SQL database - normal userdb sql { args = /etc/dovecot-sql.conf } user = root count = 1 } ==================== /etc/dovecot-sql.conf ==================== driver = mysql connect = host=/var/lib/mysql/mysql.sock dbname=(DB) user=(DBUSER) password=(DBPWD) default_pass_scheme = CRYPT password_query = SELECT pwhash AS password, user FROM mail_mailboxes WHERE (user = '%n' AND active = 'Y' AND (type != 'smtp') AND (type = 'imap' OR '%s' = 'pop3')) OR (mainuser = '%n' AND user = CONCAT('%n','mail0') AND (type != 'smtp') AND (type = 'imap' OR '%s' = 'pop3')) user_query = SELECT location AS home, uid, gid, user AS system_user FROM mail_mailboxes WHERE (user = '%n') OR (mainuser = '%n' AND user = CONCAT('%n','mail0')) ==================== table structure ==================== CREATE TABLE mail_mailboxes ( mainuser varchar(128) NOT NULL default '', domain varchar(128) NOT NULL default '', user varchar(128) NOT NULL default '', addr varchar(128) NOT NULL default '', type set('pop3','imap','smtp') NOT NULL default 'pop3', active set('Y','N') NOT NULL default 'Y', pwhash varchar(255) NOT NULL default 'unset', quota int(11) NOT NULL default '0', location varchar(255) NOT NULL default 'unset', uid int(11) NOT NULL default '0', gid int(11) NOT NULL default '0', PRIMARY KEY (user) ) TYPE=MyISAM;

2 1

[Dovecot] Mixed IMAP/POP3 environment and message status flags
by Denis Sbragion 06 Feb '06

06 Feb '06

Hello All, I'm trying to migrate from UW Imap to Dovecot (latest 1.0 beta 2). The target is to go from the actual environment (Eudora + POP3) to a web based IMAP environment (IMAP + SquirrelMail). While migrating we will need to keep both environments for some time, with users having both the ability to use Eudora through POP3 while in the office and also the ability to check e-mail using the web based interface from time to time when they are out of office. Everything seems to work pretty well except for one little quirk. Whenever new mail messages are checked on-line through IMAP they are marked with "Status: O" or "Status: RO" in the main INBOX file (which is kept in the old mbox format now, and is one of the many reasons for the Dovecort choice). This is correct following the RFC standards but after that the POP3 server seems to completely ignore any message marked as "O" or "RO", making it impossible to download previously seen/read messages through Eudora. I've checked any available Eudora and Dovecot setting, including the pop3_no_flag_updates flag, but so far nothing worked. Looking at mailing list archives it looks like this behaviour is intentional and has been introduced to work around some problems with Eudora when the "Leave mail on server" option is enabled. Nevertheless it seems there's still something wrong. UW Imap seems to get this right, it lets Eudora download the already read message, which are correctly downloaded already marked as read. I haven't been able to identify the source of the problem, i.e. if it is either an Eudora problem which UW circumvent in some way or a real Dovecot problem. I'd really like to move to Dovecot, which provides many feature which are really useful for our situation, expecially maildir folders, which are fast and much more "differential backup" friendly than single file mailboxes. Unfortunately this IMAP/POP3 interaction problem would be a major showstopper because it will prevent a smooth migration from the old environment to the new one. Any hint about this issue? Anybody faced a similar problem so far? Thanks in advance for any help, and my compliments for the excellent job performed so far. Dovecot seems to be the right tool to fill the gap between the simpler UW and the Cyrus monster. Keep on going! :) Bye, -- Denis Sbragion InfoTecna Tel: +39 0362 805396, Fax: +39 0362 805404 URL: http://www.infotecna.it

1 0

[Dovecot] dovecot-cvs/mysql-5.0.18 OLD/PASSWORD problem
by John Wong 06 Feb '06

06 Feb '06

i use openbsd/i386, dovecot-cvs(today), mysql-5.0.18 today, i change the mysql_dbuser_password form OLD_PASSWORD to PASSWORD then dovecot can't connect to mysql-server shell$> mysql -u root -p mysql$> SET PASSWORD FOR 'db_user'@'localhost' = PASSWORD('db_pw'); now, dovecot CAN NOT connect to mysql-server shell$> mysql -u root -p mysql$> SET PASSWORD FOR 'db_user'@'localhost' = OLD_PASSWORD('db_pw'); now, dovecot CAN connect to mysql-server and everything work fine i patched src/lib-sql/driver-mysql.c to test, use something like: i_error("host(%s), db->user(%s), db->password(%s), db->dbname(%s) ....); before mysql_real_connect(), then see the maillog, the db->user/password/dbname is correct maillog: auth-worker(default): conn->mysql is NOT NULL auth-worker(default): host((null)), db->user(db_user), db->password(db_pw), db->dbname(dbname), db->port(0), unix_socket(/mysql.sock), db->client_flags(0) auth-worker(default): failed: (1) auth-worker(default): mysql: Connect failed to (null) (dbname): Access denied for user 'db_user'@'localhost' (using password: YES) - waiting for 1 seconds before retry i wrote a small c program to test, it can success connect to mysql, use same user/password/dbname, with both OLD_PASSWORD/PASSWORD why dovecot can't to connect to mysql-server with PASSWORD? help please, thank you base_dir = /var/dovecot/ ssl_cert_file = /etc/ssl/certs/mail.crt ssl_key_file = /etc/ssl/private/mail.key disable_plaintext_auth = no login_dir = /var/dovecot/login login_user = _dovecot valid_chroot_dirs = /var/spool/postfix/var default_mail_env = maildir:%h/%u mmap_no_write = yes protocol imap { imap_client_workarounds = delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep } protocol pop3 { pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } auth default { mechanisms = plain passdb sql { args = /etc/dovecot-sql.conf } userdb static { args = uid=32765 gid=32765 home=/var/spool/postfix/var/./mail } user = _dovecot-auth chroot = /var/dovecot/auth socket listen { client { path = /var/spool/postfix/private/dovecot-auth mode = 0600 user = _postfix } } } driver = mysql connect = host=/mysql.sock dbname=dbname user=db_user password=db_pw default_pass_scheme = PLAIN-MD5 password_query = SELECT password FROM users WHERE userid = '%n' AND %Ls = '1' AND active = '1' --- src/lib-sql/driver-mysql.c.orig Mon Feb 6 23:07:42 2006 +++ src/lib-sql/driver-mysql.c Mon Feb 6 23:39:36 2006 @@ -112,11 +112,17 @@ } alarm(MYSQL_CONNECT_FAILURE_TIMEOUT); + i_error("conn->mysql is %s NULL", conn->mysql == NULL ? "" : "NOT"); + i_error("host(%s), db->user(%s), db->password(%s), db->dbname(%s), " + "db->port(%u), unix_socket(%s), db->client_flags(%u)", + host, db->user, db->password, db->dbname, db->port, unix_socket, + db->client_flags); failed = mysql_real_connect(conn->mysql, host, db->user, db->password, db->dbname, db->port, unix_socket, db->client_flags) == NULL; alarm(0); if (failed) { + i_error("failed: (%i)", (int)failed); if (conn->connect_failure_count > 0) { /* increase delay between reconnections to this server */

1 0

[Dovecot] nearly there
by ohp＠pyrenet.fr 05 Feb '06

05 Feb '06

Hi Timo et all. At last I found with unix socket wouldn't connect and it works now. However after auth, imap crashes with signal 6. This happens on 1 machine, the other (unixware too) work fine. The stack trace doesn't make much sense here it is anway... Core image of imap (process p1) created CORE FILE [makedev in cmd-status.c(a)sys/mkdev.h] SIGNALED 8 (fpe code[FPE_INTDIV] address[0x804e38b]) in p1 76: return __makedev(ver, maj, min); debug> Stack Trace for p1, Program imap *[0] makedev(maj=16, min=1, presumed: 0x8094258) [cmd-status.c@sys/mkdev.h@76] [1] cmd_store(cmd=0x0, presumed: 0x1, 0x80947a0) [cmd-store.c@139] [2] _cmd_select_full(cmd=0x8072498, readonly=false) [cmd-select.c@84] [3] cmd_store(cmd=0x10, presumed: 0x807d184, 0x8047cac) [cmd-store.c@74] [4] minor(dev=134511756, presumed: 0x8055266, 0x8047cac) [cmd-subscribe.c@sys/mkdev.h@112] [5] imap_search_args_build(pool=0x8047cac, box=0x8047cb4, args=0x8047ca0, error_r=0x804ebc1) [imap-search.c@416] [6] imap_search_get_uidset_arg(pool=0x1, box=0x8047cac, uidset="\215}\004\b\235}\004\b\245}\004\b\020\220\b\b\313}\004\b\335}\004\b\357}\004\b", arg_r=0x0, error_r=0x0, 0x1) [imap-search.c@447] [7] cmd_append_cancel(ctx=0x8047cb4, nonsync=true, presumed: 0) [cmd-append.c@158] [8] ?() [0] debug> The log says Trying to allocate 0 bytes and imap gets killed. Does it ring any bells? -- Olivier PRENANT Tel: +33-5-61-50-97-00 (Work) 15, Chemin des Monges +33-5-61-50-97-01 (Fax) 31190 AUTERIVE +33-6-07-63-80-64 (GSM) FRANCE Email: ohp(a)pyrenet.fr ------------------------------------------------------------------------------ Make your life a dream, make your dream a reality. (St Exupery)

2 2

[Dovecot] vpopmail authentification broken in dovecot 1.0beta
by daniel petre 05 Feb '06

05 Feb '06

hello, i got * net-mail/dovecot Latest version available: 1.0_beta2 Latest version installed: 1.0_beta2 Size of files: 1,309 kB Homepage: http://dovecot.org/ Description: An IMAP and POP3 server written with security primarily in mind License: LGPL-2.1 and since dovecot-0.99.14-r1 authentification doesnt work no more. i posted something similar with dovecot-1.0_alpha5 but all the answers i got were like "it isnt dovecot's fault, its vpopmails". bummer, my vpopmail did not changed , but dovecot versions yes. so i think dovecot is broken with vpopmail auth. i edited dovecot.conf and enabled all the parts related to vpopmail correctly like in old dovecot.conf here's what i receive in the log: dovecot: Jan 31 14:51:28 Info: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=81.18.x.x rip=81.18.x.x resp= dovecot: Jan 31 14:51:28 Info: auth(default): client out: CONT 1 dovecot: Jan 31 14:51:28 Info: auth(default): client in: CONT 1 AGRhbmlAbGlgudXhzb2x1fdGlvbnMucmh8AcG9jcG9j dovecot: Jan 31 14:51:28 Error: auth(default): vmysql: sql error[3]: MySQL server has gone away dovecot: Jan 31 14:51:28 Info: auth(default): vpopmail(dani(a)domain.ro,81.18.x.x): unknown user dovecot: Jan 31 14:51:29 Info: auth(default): client out: FAIL 1 user=dani(a)domain.ro dovecot: Jan 31 14:51:29 Info: auth(default): client in: AUTH 2 PLAIN service=POP3 lip=81.18.x.x rip=81.18.x.x resp=AGRhbmlAbGlgudXhzb2x1fdGlvbnMucmh8AcG9jcG9j dovecot: Jan 31 14:51:29 Error: auth(default): vmysql: sql error[3]: MySQL server has gone away dovecot: Jan 31 14:51:29 Info: auth(default): vpopmail(dani(a)domain.ro,81.18.x.x): unknown user dovecot: Jan 31 14:51:31 Info: auth(default): client out: FAIL 2 user=dani(a)domain.ro i tried compiling dovecot with and without mysql support and the log is the same. vpopmail support is compiled in. so i use only vpopmail auth, no passdb, no mysql, no ssl. anyone can help with this error? coz dovecot seems such a nice imap/pop3 daemon but so much broken since last 0.9 version which is a shame.. thank you. -- Daniel Petre System Administrator Tech Support Coordinator ............................................................................. RCS & RDS Pitesti Tel.: +40348.400.401 Fax: +40348.400.441 http://www.rcs-rds.ro ............................................................................. Privileged/Confidential Information may be contained in this message. If you are not in the addresses indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such a case, you should destroy this message and kindly notify the sender by reply e-mail.

2 1

[Dovecot] default_mail_env auto-detect woes for maildir users
by David Friedlander 05 Feb '06

05 Feb '06

Hello-- I am a fairly new dovecot user and have run into a problem. I am running dovecot 1.0alpha5 (built from source) on a Fedora Core 1 machine. The system has about 400 users with over 80 IMAP users, and we have just transitioned from UW-IMAP. Thus all users are currently still mbox users. I would like to transition them to maildir users (this was the main point for me switching servers), and I chose dovecot because it could simultaneously support both formats. My dovecot.conf uses auto_detect (no default_mail_env defined, by choice). Auto-detect is working fine for mbox users, as shown by this (edited) log snippet: dovecot: imap(janeuser): maildir: couldn't find root dir dovecot: imap(janeuser): mbox: root exists (/Home/janeuser/mail) dovecot: imap(janeuser): mbox: INBOX exists (/var/mail/janeuser) dovecot: imap(janeuser): mbox: root=/Home/janeuser/mail, index=/Home/janeuser/mail, inbox=/var/mail/janeuser However, for another user who already has ~/Maildir and a proper maildir-format spool location ( /var/mail/joeuser/{cur|new|tmp} ) the log shows: dovecot: imap(joeuser): maildir: root exists (/Home/joeuser/Maildir) dovecot: imap(joeuser): maildir: root=/Home/joeuser/Maildir, index=/Home/joeuser/Maildir, control=, inbox= (Mail clients show no messages, but one can see them from the UNIX shell and with mutt on the server.) If I set default_mail_env = maildir:~/Maildir:INBOX=/var/spool/mail/%u then everything works fine for 'joeuser'. However, I need auto-detect during this transition phase. My questions, please: * How do I get INBOX ("inbox=") to be properly defined/detected? * Must I do this with namespaces, and how does that affect the fact that there will be a transition period where some users use mbox and others use maildir? * Other advice? I have been unable to track this down so far, between reading the Dovecot documentation and Googling the dovecot mailing list archives. Thanks in advance, David

2 2

[Dovecot] Support for Kmail maildir format
by Graham Cobb 04 Feb '06

04 Feb '06

Has anyone looked into providing support in dovecot for Kmail folders? I would like to make my Kmail folders (on my main desktop system) available to my other systems (including over a VPN when I am travelling). Kmail is my main mail program and I have a lot of mail in a lot of folders, so I don't want to set up a separate IMAP service and move all the mail and folders. Kmail's use of maildir seems to folow the basic maildir approach except that sub-folders are handled differently. If you create a folder (say it is called ABC) in Kmail and start putting mail in it, Kmail creates a directory on the disk called ABC (not .ABC) and creates the cur, new and tmp folders within it to contain the email. If you then create a subfolder of ABC (say it is called DEF, contained within the ABC folder), Kmail creates a directory on the disk called .ABC.directory and creates the DEF directory within that. In other words, maildir directories are given the same name as the mail folder (with no leading dot) but sub-folders are contained in disk directories called .<folder-name>.directory. I have taken a quick look at the dovecot code and am fairly sure this could be handled by a variant on the existing maildir code (e.g. by changes to maildir_fill_readdir and other routines). Has anyone tried this? Graham

5 12

[Dovecot] rquotad (NFS) quota plugin
by Thomas Wouters 03 Feb '06

03 Feb '06

The attached patch is an updated version of my quota-rquotad patch for the quota plugin. Like quota-fs, it only does quota reporting, not enforcing or changing. It also only works on FreeBSD, and possibly other *BSD's. It lacks any and all configure-time tests to see if RPC is even supported, and hardcodes the (Free)BSD way of getting at the NFS server of an NFS mount. I'm mostly mailing it around to avoid duplicate work, in case anyone is looking for it. I do intend to generalize the plugin-patch, and add proper configure checks, I just haven't gotten around to testing it on other BSD systems. Linux support would be nice, but getting at the NFS server of an NFS mount is apparently quite a hassle, as it means reading /etc/mtab or /proc/self/mounts. Yuck. -- Thomas Wouters <thomas(a)xs4all.net> Hi! I'm a .signature virus! copy me into your .signature file to help me spread!

1 0

[Dovecot] mbox to maildir conversion on a user-by-user basis!
by Tony Kay 03 Feb '06

03 Feb '06

In the midst of evaluating Dovecot for use in solving some mbox locking issues (while also waiting for our eventual migration to maildir), I had an epiphany. It looks like Dovecot's auto-detection of mail formats would allow us to migrate from mbox to maildir on a user-by-user basis! I was thinking: 1. Let dovecot autodetect mail storage 2. Use some procmail trickery to detect which format to deliver into (I am researching how to do the detection on a user-by-user basis) 3. Manually convert users as you want by: - Temporarily disable mail delivery for that user (at least make it look like the inbox is locked) - Run conversion on mbox files -> maildir format - Put in the procmail hack for them - Re-enable delivery Way cool. I am still working out the details, but I was wondering if anyone sees a problem with this??? -- Anthony Kay University Computing Center (541) 346-1719 GPG Fingerprint: B0DB D46A 60AF FAE7 A94A 5075 0CB4 4D88 9F4F 7F09 Sanity is a cozy lie. Susan Sontag

2 1

[Dovecot] not creating homedirs when using maildir format
by Ben Halicki 03 Feb '06

03 Feb '06

Hi all, I'm in the process of setting up dovecot, but for some reason, it's not creating home directories if they don't already exist. I have the following line in dovecot.conf: default_mail_env = maildir:~/mail:INBOX=/var/mail/%u I have set permissions on /home to allow everyone full access, so creating directories in /home by dovecot non-root processes shouldn't be a problem. If I instruct dovecot to use mbox format, directories are created without a problem. The problem only seems to exist with maildir. Any help would be greatly appreciated! Thanks and regards, Ben Halicki Information Technology Officer Macquarie Textiles Group Limited Phone: +61 2 6043 0235 Fax: +61 2 6041 1321

4 3