- dovecot - dovecot.org

[Dovecot] Index cache file problems in Dovecot 1.2.0
by Chris Wakelin 11 Aug '09

11 Aug '09

I've been seeing lots of index cache file errors (using mbox on Solaris 8 sparc 64-bit, but with 32-bit Dovecot) since I switched my account to Dovecot 1.2.0 (we're still on 1.0.15 mostly, but I'm hoping to upgrade to 1.1.17+ this summer, or 1.2.x if it's stable enough). e.g. Error: Corrupted index cache file <path>/.imap/INBOX/dovecot.index.cache: field index too large (47 >= 25) I've tried renaming/removing the .imap/INBOX directory, but the "Corrupted index cache file" errors return within a day or so. This morning, Thunderbird got itself in a mess retrying something that caused multiple core dumps: > Jul 14 08:52:53 dovecot: Error: child 17694 (imap) killed with signal 10 (core dumped) > Jul 14 08:52:54 dovecot: Error: child 17697 (imap) killed with signal 10 (core dumped) > Jul 14 08:52:55 dovecot: Error: child 17700 (imap) killed with signal 10 (core dumped) Here's a backtrace > #0 mail_cache_get_record (cache=0x124e28, offset=289, rec_r=0xffbeeb6c) > at mail-cache-lookup.c:30 > 30 if (rec->size < sizeof(*rec)) { > (gdb) bt > #0 mail_cache_get_record (cache=0x124e28, offset=289, rec_r=0xffbeeb6c) > at mail-cache-lookup.c:30 > #1 0x84e2c in mail_cache_lookup_iter_next_record (ctx=0xffbeeb60) > at mail-cache-lookup.c:186 > #2 0x84f14 in mail_cache_lookup_iter_next (ctx=0xffbeeb60, field_r=0xffbeeb50) > at mail-cache-lookup.c:219 > #3 0x85650 in mail_cache_lookup_headers_real (view=0x128510, dest=0x129728, > seq=11416, field_idxs=0xffbeec74, fields_count=2) > at mail-cache-lookup.c:500 > #4 0x85848 in mail_cache_lookup_headers (view=0x128510, dest=0x129728, > seq=11416, field_idxs=0xffbeec74, fields_count=2) > at mail-cache-lookup.c:555 > #5 0x6ba94 in index_mail_get_raw_headers (mail=0x128f20, > field=0xff142ee8 "Message-ID", value_r=0xffbeecfc) > at index-mail-headers.c:614 > #6 0x6c084 in index_mail_get_first_header (_mail=0x128f20, > field=0xff142ee8 "Message-ID", decode_to_utf8=false, value_r=0xffbeede4) > at index-mail-headers.c:771 > #7 0x7893c in mail_get_first_header (mail=0x128f20, > field=0xff142ee8 "Message-ID", value_r=0xffbeede4) at mail.c:118 > #8 0xff1419a0 in mail_log_add_hdr (mail=0x128f20, str=0x10edc8, > name=0xff142d68 "msgid", header=0xff142ee8 "Message-ID") > at mail-log-plugin.c:277 > #9 0xff141c5c in mail_log_action (dest_trans=0x128f20, mail=0x128f20, > event=MAIL_LOG_EVENT_DELETE, data=0x0) at mail-log-plugin.c:318 > #10 0xff141e5c in mail_log_mail_update_flags (_mail=0x128f20, > modify_type=MODIFY_ADD, flags=12) at mail-log-plugin.c:376 > #11 0x78af8 in mail_update_flags (mail=0x128f20, modify_type=MODIFY_ADD, > flags=12) at mail.c:184 > #12 0x2ab3c in cmd_store (cmd=0x11bec8) at cmd-store.c:192 > #13 0x2b5f8 in cmd_uid (cmd=0x11bec8) at cmd-uid.c:27 > #14 0x2ccc4 in client_command_input (cmd=0x11bec8) at client.c:611 > #15 0x2cb68 in client_command_input (cmd=0x11bec8) at client.c:660 > #16 0x2cd4c in client_handle_next_command (client=0x11bc40, > remove_io_r=0xffbef23f) at client.c:701 > #17 0x2ce40 in client_handle_input (client=0x11bc40) at client.c:713 > #18 0x2cf78 in client_input (client=0x11bc40) at client.c:752 > #19 0xc6c04 in io_loop_handler_run (ioloop=0x1186d8) at ioloop-poll.c:203 > #20 0xc63f4 in io_loop_run (ioloop=0x1186d8) at ioloop.c:338 > #21 0x369f4 in main (argc=1107968, argv=0xffbef484, envp=0xffbef494) > at main.c:323 I didn't have these problems with 1.1.x. I guess I ought to get out the imaptest tool and see if I can reproduce this reliably ... Best Wishes, Chris -- --+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+- Christopher Wakelin, c.d.wakelin(a)reading.ac.uk IT Services Centre, The University of Reading, Tel: +44 (0)118 378 8439 Whiteknights, Reading, RG6 2AF, UK Fax: +44 (0)118 975 3094

2 3

[Dovecot] % in Usernames (dovecot 1.1.18)
by Michal Hlavinka 11 Aug '09

11 Aug '09

Hi, I'm forwarding feature request from one Fedora user: <snip> Shortly before suicide after migration to dbmail/postfix from Eudora Mailserver because we use % in Usernames as fallback and Apple-Mail does no Plaintext- Auth if CRAM-MD% was used before i installed dovecot as proxy BUT it allows no % in Username Please could be the following patch included? --- dovecot-1.1.18/src/master/master-settings.c 2009-07-27 03:56:32.000000000 +0200 +++ dovecot-1.1.18-patched/src/master/master-settings.c 2009-08-10 22:57:09.728065279 +0200 @@ -310,7 +310,7 @@ MEMBER(executable) PKG_LIBEXECDIR"/dovecot-auth", MEMBER(user) "root", MEMBER(chroot) "", - MEMBER(username_chars) "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@", + MEMBER(username_chars) "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@%", MEMBER(username_translation) "", MEMBER(username_format) "", MEMBER(master_user_separator) "", </snip> Would it be possible or is there any reason why this is a wrong idea? Regards, Michal Hlavinka

2 1

[Dovecot] dovecot-1.2.3 (managesieve) crash with backtrace
by Ralf Hildebrandt 11 Aug '09

11 Aug '09

>From the log: Aug 11 09:07:23 postamt dovecot: IMAP(zensy): Panic: file mail-index-transaction-view.c: line 106 (tview_apply_flag_updates): assertion failed: (map->hdr.record_size <= tview->record_size) Aug 11 09:07:23 postamt dovecot: IMAP(zensy): Raw backtrace: imap [0x80f0411] -> imap [0x80f0482] -> imap [0x80efe29] -> imap [0x80c839b] -> imap [0x80cea95] -> imap [0x80c85cf] -> imap(mail_index_lookup_ext_full+0x36) [0x80cda46] -> imap(mail_cache_lookup_cur_offset+0x49) [0x80bbad9] -> imap [0x80bbb5d] -> imap(mail_cache_lookup_iter_init+0x55) [0x80bbc05] -> imap(mail_cache_field_exists+0xaf) [0x80bc51f] -> imap(mail_cache_field_want_add+0x48) [0x80bcd98] -> imap(index_mail_parse_header_init+0x1c3) [0x80a4a33] -> imap(index_mail_parse_headers+0x60) [0x80a4c40] -> imap [0x80a500f] -> imap(index_mail_get_first_header+0x22) [0x80a5372] -> imap(mail_get_first_header+0x25) [0x80b0a85] -> /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7e72bfb] -> /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7e72f95] -> /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7e73494] -> imap(cmd_store+0x475) [0x8065e95] -> imap [0x806769c] -> imap [0x8067743] -> imap(client_handle_input+0x2d) [0x806789d] -> im Aug 11 09:07:23 postamt dovecot: IMAP(zensy): io_loop_handler_run+0xe0) [0x80f9000] -> imap(io_loop_run+0x20) [0x80f8470] -> imap(main+0x5d2) [0x8070b52] Aug 11 09:07:23 postamt dovecot: dovecot: child 16960 (imap) killed with signal 6 (core dumped) Backtrace: GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/librt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/librt-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/librt.so.1 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/i686/cmov/libpthread-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libpthread.so.0 Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_trash_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_trash_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_autocreate_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_autocreate_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_zlib_plugin.so Reading symbols from /usr/lib/libz.so.1...done. Loaded symbols for /usr/lib/libz.so.1 Reading symbols from /lib/libbz2.so.1.0...done. Loaded symbols for /lib/libbz2.so.1.0 Reading symbols from /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `imap [zensy 141.42.4.251]'. Program terminated with signal 6, Aborted. [New process 16960] #0 0xb801d424 in __kernel_vsyscall () #0 0xb801d424 in __kernel_vsyscall () No symbol table info available. #1 0xb7ecf3d0 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1207963660 selftid = 16960 #2 0xb7ed2a85 in *__GI_abort () at abort.c:88 act = {__sigaction_handler = {sa_handler = 0x940d238, sa_sigaction = 0x940d238}, sa_mask = {__val = {3214463400, 135192458, 3087001312, 0, 3214463520, 3214463508, 512, 0, 0, 3214463584, 3087251056, 134566650, 1131, 0, 0, 0, 1, 135265534, 512, 1, 3214463508, 155243032, 69, 3214463636, 3214463480, 135194054, 155244195, 3214463508, 3214463512, 1132, 155243064, 3086442259}}, sa_flags = 1132, sa_restorer = 0x81059a9 <write_full+57>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0x080f0425 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x940ca08 "imap [0x80f0411] -> imap [0x80f0482] -> imap [0x80efe29] -> imap [0x80c839b] -> imap [0x80cea95] -> imap [0x80c85cf] -> imap(mail_index_lookup_ext_full+0x36) [0x80cda46] -> imap(mail_cache_lookup_cur_"... #4 0x080f0482 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x81084ec "file %s: line %d (%s): assertion failed: (%s)", args=0xbf98d2f4 "�X\021\bj") at failures.c:440 No locals. #5 0x080efe29 in i_panic ( format=0x81084ec "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0x080c839b in tview_lookup_full (view=0x9425230, seq=1, map_r=0xbf98d3f8, expunged_r=0xbf98d3c7) at mail-index-transaction-view.c:106 rec = (const struct mail_index_record *) 0x9434838 #7 0x080cea95 in view_lookup_ext_full (view=0x9425230, seq=1, ext_id=4, map_r=0xbf98d3f8, data_r=0xbf98d3f4, expunged_r=0xbf98d3c7) at mail-index-view.c:414 rec = <value optimized out> #8 0x080c85cf in tview_lookup_ext_full (view=0x9425230, seq=1, ext_id=4, map_r=0xbf98d3f8, data_r=0xbf98d3f4, expunged_r=0xbf98d3c7) at mail-index-transaction-view.c:408 ext_buf = (const union array__seq_array *) 0x0 data = <value optimized out> idx = <value optimized out> __PRETTY_FUNCTION__ = "tview_lookup_ext_full" #9 0x080cda46 in mail_index_lookup_ext_full (view=0x6, seq=1, ext_id=4, map_r=0xbf98d3f8, data_r=0xbf98d3f4, expunged_r=0x0) at mail-index-view.c:596 expunged = false #10 0x080bbad9 in mail_cache_lookup_cur_offset (view=0x9425230, seq=1, reset_id_r=0xbf98d42c) at mail-cache-lookup.c:65 cache = (struct mail_cache *) 0x94233b8 map = <value optimized out> data = (const void *) 0x4 offset = <value optimized out> #11 0x080bbb5d in mail_cache_lookup_offset (cache=0x94233b8, view=0x6, seq=16960, offset_r=0xbf98d498) at mail-cache-lookup.c:87 offset = <value optimized out> reset_id = 155333560 ret = <value optimized out> #12 0x080bbc05 in mail_cache_lookup_iter_init (view=0x9425410, seq=1, ctx_r=0xbf98d480) at mail-cache-lookup.c:154 ret = <value optimized out> #13 0x080bc51f in mail_cache_field_exists (view=0x9425410, seq=1, field=12) at mail-cache-lookup.c:292 __PRETTY_FUNCTION__ = "mail_cache_field_exists" #14 0x080bcd98 in mail_cache_field_want_add (ctx=0x9427af0, seq=1, field_idx=12) at mail-cache-transaction.c:1009 decision = MAIL_CACHE_DECISION_NO #15 0x080a4a33 in index_mail_parse_header_init (mail=0x94264b8, _headers=0x94319b0) at index-mail-headers.c:189 _data_stack_cur_id = 5 i = <value optimized out> field_idx = <value optimized out> __PRETTY_FUNCTION__ = "index_mail_parse_header_init" #16 0x080a4c40 in index_mail_parse_headers (mail=0x94264b8, headers=0x94319b0) at index-mail-headers.c:431 input = (struct istream *) 0x9423900 old_offset = 0 #17 0x080a500f in index_mail_get_raw_headers (mail=0x94264b8, field=0xb7e736f4 "Message-ID", value_r=0xbf98d608) at index-mail-headers.c:625 headers = {0xb7e736f4 "Message-ID", 0x0} value = <value optimized out> headers_ctx = (struct mailbox_header_lookup_ctx *) 0x0 data = <value optimized out> field_idx = 12 dest = (string_t *) 0x942cbf8 i = <value optimized out> len = <value optimized out> ret = <value optimized out> __PRETTY_FUNCTION__ = "index_mail_get_raw_headers" #18 0x080a5372 in index_mail_get_first_header (_mail=0x94264b8, field=0xb7e736f4 "Message-ID", decode_to_utf8=false, value_r=0xbf98d65c) at index-mail-headers.c:771 list = (const char * const *) 0x108 ret = 155239272 i = 0 #19 0x080b0a85 in mail_get_first_header (mail=0x94264b8, field=0xb7e736f4 "Message-ID", value_r=0xbf98d65c) at mail.c:118 No locals. #20 0xb7e72bfb in mail_log_add_hdr (mail=0x0, str=0x940c368, name=0xb7e736ff "msgid", header=0xb7e736f4 "Message-ID") at mail-log-plugin.c:277 value = 0xb7e72bdc "\201ô\035" #21 0xb7e72f95 in mail_log_action (dest_trans=<value optimized out>, mail=0x94264b8, event=MAIL_LOG_EVENT_DELETE, data=0x0) at mail-log-plugin.c:318 size = <value optimized out> str = (string_t *) 0x940c368 #22 0xb7e73494 in mail_log_mail_update_flags (_mail=0x94264b8, modify_type=MODIFY_ADD, flags=MAIL_DELETED) at mail-log-plugin.c:376 _data_stack_cur_id = 16960 lmail = <value optimized out> old_flags = <value optimized out> new_flags = <value optimized out> #23 0x08065e95 in cmd_store (cmd=0x9419688) at cmd-store.c:192 client = (struct client *) 0x94193f8 args = (const struct imap_arg *) 0x941e718 search_args = (struct mail_search_args *) 0x0 search_ctx = (struct mail_search_context *) 0x9427890 t = (struct mailbox_transaction_context *) 0x9427a50 mail = (struct mail *) 0x94264b8 ctx = {cmd = 0x9419688, max_modseq = 18446744073709551615, flags = MAIL_DELETED, keywords = 0x0, modify_type = MODIFY_ADD, silent = false} modified_set = {arr = {buffer = 0x9427b90, element_size = 8}, v = 0x9427b90, v_modifiable = 0x9427b90} uids = {arr = {buffer = 0x941e788, element_size = 3214464872}, v = 0x941e788, v_modifiable = 0x941e788} flags = <value optimized out> imap_sync_flags = <value optimized out> reply = <value optimized out> tagged_reply = <value optimized out> str = <value optimized out> ret = <value optimized out> #24 0x0806769c in client_command_input (cmd=0x9419688) at client.c:611 client = (struct client *) 0x94193f8 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #25 0x08067743 in client_command_input (cmd=0x9419688) at client.c:660 client = (struct client *) 0x94193f8 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #26 0x0806789d in client_handle_input (client=0x94193f8) at client.c:701 _data_stack_cur_id = 3 ret = false remove_io = <value optimized out> handled_commands = false __PRETTY_FUNCTION__ = "client_handle_input" #27 0x080681df in client_input (client=0x94193f8) at client.c:752 cmd = <value optimized out> output = (struct ostream *) 0x94195ac bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #28 0x080f9000 in io_loop_handler_run (ioloop=0x94149b0) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x9414ab8 event = (const struct epoll_event *) 0x9414af8 list = (struct io_list *) 0x9419630 io = (struct io_file *) 0x9419608 tv = {tv_sec = 1, tv_usec = 575794} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #29 0x080f8470 in io_loop_run (ioloop=0x94149b0) at ioloop.c:338 No locals. #30 0x08070b52 in main (argc=) at main.c:327 No locals. $1 = {prev = 0x0, next = 0x0, client = 0x94193f8, pool = 0x9419670, tag = 0x9419700 "A004", name = 0x9419710 "UID STORE", args = 0x9419720 "1:* +FLAGS (\\Deleted)", cmd_flags = COMMAND_FLAG_BREAKS_SEQS, func = 0x8065a20 <cmd_store>, context = 0x0, module_contexts = {arr = {buffer = 0x94196c8, element_size = 4}, v = 0x94196c8, v_modifiable = 0x94196c8}, parser = 0x941e678, state = CLIENT_COMMAND_STATE_WAIT_INPUT, sync = 0x0, uid = 1, cancel = 0, param_error = 0, search_save_result = 0, temp_executed = 0} (gdb) quit -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

1 0

[Dovecot] Problems with Dovecot 1.2.3 + IMAP (SSL) + iPhone OS 3.0
by Sascha Scandella 11 Aug '09

11 Aug '09

Hello Has anyone else problems with Dovecot 1.2.3? For clients such as Thunderbird, Outlook 2007 everything works perfect. When I use an iPhone the child process is killed: Aug 11 08:08:44 imap-login: Info: Login: user=<username>, method=PLAIN,rip=1.2.3.4, lip=4.3.2.1, TLS Aug 11 08:08:44 dovecot: Error: child 5382 (imap) killed with signal 11 (core dumps disabled) Currently I have downgraded again to the working 1.2. I wonder if this problem is known or anyone is looking for it.

2 1

[Dovecot] RFC: Storing indexes in a (remote) database to increase dovecot scalability
by Mark Zealey 10 Aug '09

10 Aug '09

Hi all, This is just an idea I had over the weekend; I was wondering if instead of storing the indexes/caches on disk, it would be possible to have an option to store them in a remote database (eg mysql). There are several issues that we currently have with scaling dovecot, and I think that if it could store indexes in an external database we could alleviate most of these issues. In no particular order: 1) One major issue we have with dovecot is the number of iops it requires to keep its files in sync on our big disk arrays. If this were a mysql database, we'd have better ways of keeping these in sync, for example switching the speed at which it flushes the updates to disk, growth using partitioning/sharding, read-only slave instances etc, specific ssd storage for indexes/caches. I know that we could create a separate ssd disk array and export that over nfs too, but see issue (2) below. If indexes were stored in a mysql database we could choose to have a different reliability for the indexes (ie if the database server crashes we have 1 second of index changes lost, whereas for the email itself we can ensure it is always kept in sync on our other disk arrays). 2) nfs locking issues. No matter how hard we try, we always find there are some issues with concurrency over nfs. It really doesn't seem designed to handle these issues very well. I've not tried with nfsv4 and I believe there are some improvements there, but at the same time nfs wasn't really designed to store databases and have heavy concurrency. A proper database server (eg mysql, postgres) on the other hand thrives in this type of environment, especially when coupled with a transactional storage backend such as innodb which includes support for deadlock handling etc. 3) As we store all of our mail systems over nfs, effectively each export is a single-threaded connection to the server. No matter how fast the central nfs server you can realistically not go above 10k nfs ops/sec on the fastest of local networks due to latency issues. With mysql you could have multiple parallel connections to the central database store (1 per process?) which would mean more nfs ops available for actually serving the files. 4) Caching. Much more tuneable on a database server than in a filesystem. Eg in mysql there are loads of options to tune the various innodb/query/key caches, on nfs there are very few even on advanced netapps etc I know some of you store all your indexes on a single server locally & then store the emails on a remote central filestore. Whilst this is a good idea, it doesn't scale very well in that if the one server fails then everything has to be reindexed as clients login which causes incredible load as dovecot has to re-read most of the messages (in pop3 mode at least) in order to work out size counts etc. In my experience this reindexing would take out our email system for the best part of a day. I'm sure we could set something up with drbd mirroring or a central san array with ssd's for the index data, but this intrinsically does not scale with as much ease as a replicating database cluster could. There are also failover issues which can be very easily solved with a database system (eg mysql with an active/passive dual-master setup). Also, I know that most of these points refer to nfs; and I know that there are alternative methods (eg san + gfs or some other scalable filesystem) however most of these are relatively new technologies whereas nfs is pretty much the standard for remote file storage; certainly I'd consider it a lot more reliable when compared to the likes of gfs or lustre. Your typical large scale mail setup would be over nfs and this is the sort of environment that I've run into these scaling issues in. I've heard that gfs also doesn't work very well with 'hot spots' which indexes tend to be, although I've no first hand experience of this. So, although this post only really mentions nfs & mysql (the two technologies that I'm most familiar with) I think this is a much more general problem so I'm not advocating the use of either technology apart from them being most people's first choices for ease of use. What I'm really proposing is a way to separate the two different types of data that dovecot uses. Indexes&caches contain small frequent transactions; and whilst these are relatively important, dropping the past few seconds of these transactions doesn't seriously matter. On the other hand emails are larger, infrequently changed & it's important they are kept fully in sync - if we accept a message it should be guaranteed that we don't loose it. At the end of the day it seems to me that a filesystem is the ideal place to store emails, whereas a database server would be the ideal place to store indexes/caches. Obviously for speed of setup, simply storing everything on a filesystem is easy so I'm not suggesting that we abandon this route, but for truly large infrastructures I think being able to use a database system would have significant advantages in each of these four areas. Any thoughts? Mark -- Mark Zealey -- Platform Architect Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer

2 1

[Dovecot] Dovecot-1.1.15 panics
by Mike Abbott 10 Aug '09

10 Aug '09

Dovecot-1.1.15 assert-fails frequently. Attached are some errors from the logs, and a stack trace from the common panic. Hope you can fix these soon. Thanks. 0 libSystem.B.dylib 0x00007fff8825e606 __kill + 10 1 libSystem.B.dylib 0x00007fff882e1c92 abort + 83 2 imap 0x0000000100069e1b default_fatal_finish + 70 3 imap 0x0000000100069e69 i_syslog_fatal_handler + 0 4 imap 0x00000001000695c8 i_info + 0 5 imap 0x000000010001913f maildir_uidlist_iter_next_rec + 210 6 imap 0x0000000100019177 maildir_uidlist_iter_next + 38 7 imap 0x0000000100018abb maildir_sync_index + 2019 8 imap 0x0000000100017788 maildir_sync_context + 662 9 imap 0x000000010001797c maildir_storage_sync_init + 104 10 imap 0x000000010000bbe3 imap_sync_init + 132 11 imap 0x000000010000be35 cmd_sync_delayed + 477 12 imap 0x0000000100006692 client_handle_input + 419 13 imap 0x000000010000676c client_input + 148 14 imap 0x0000000100070e60 io_loop_handler_run + 272 15 imap 0x0000000100070225 io_loop_run + 55 16 imap 0x000000010000d746 main + 1640 17 imap 0x0000000100000b84 start + 52

3 8

Re: [Dovecot] Mail archive
by fernando＠dfcom.com.br 10 Aug '09

10 Aug '09

I would like 'some process' to store old mails at a cheap storage. I know how to do it with symlinks, but I don´t know if it is the best option. So, I´m asking if dovecot improves it somehow. Fernando fernando at dfcom.com.br schrieb: > Hi, > > I´m using dovecot at our storages, accounts is distributed among many > storages (not entire domain), all of them with compression (when message > > 30Kb), nightly crontab script. > > Even though compression and many storages, we always have problems with > disk space and need to migrate accounts. > > Have you ever implemented any archive solution working with dovecot ? > > Regards, > Fernando > you might give more info what kind of "archive" you exactly mean meanwhile study http://wiki.dovecot.org/HowTo/ReadOnlyArchive http://wiki.dovecot.org/Plugins/Zlib http://wiki.dovecot.org/Plugins/Expire Alternative dbox directory expiration -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] Mail archive
by fernando＠dfcom.com.br 10 Aug '09

10 Aug '09

Hi, I´m using dovecot at our storages, accounts is distributed among many storages (not entire domain), all of them with compression (when message > 30Kb), nightly crontab script. Even though compression and many storages, we always have problems with disk space and need to migrate accounts. Have you ever implemented any archive solution working with dovecot ? Regards, Fernando

2 1

[Dovecot] inconsistency with expire-tool and expire dict
by LEVAI Daniel 10 Aug '09

10 Aug '09

Hi! Here is the problem: passdb: daniell:*::::::user=daniell2 userdb: daniell2::uid:gid:gecos:home:: dovecot.conf: plugin { expire = SA.* 1 # (There are SA.HAM and SA.SPAM directories) } When copying a message to eg. the SA.HAM directory, then dovecot inserts this into my expires table: dovecot=# select * from expires ; username | mailbox | expire_stamp ---------------------+---------+-------------- daniell | SA.HAM | 1249976454 ^^^^^^^ wrong username This causes an error when running expire-tool (after changing expire_stamp): # /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire- tool --test Info: User lookup failed: daniell Info: daniell/SA.HAM: no messages left If I change the username field in the expires table... : # UPDATE expires SET username = 'daniell2'; UPDATE 1 ... expire-tool is fine: # /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire- tool --test Info: daniell2/SA.HAM: timestamp 1249880093 (Mon Aug 10 06:54:53 2009) -> 1249976454 (Tue Aug 11 09:40:54 2009) Daniel -- LÉVAI Dániel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

1 1

[Dovecot] Mail not begin proccessed
by Andre Labuschagne 10 Aug '09

10 Aug '09

Good day all, [Dovecot version 1.2.1] I've set up postfix and dovecot on Centos. I have a problem with the mail, it is begin received but not "processed" by dovecot. I've looked in the maillog file and found two problems; the first is that private/dovecot directory (I think it should be a directory) did not exist and the second problem is "mail transport unavailable". I've create a directory called /var/spool/postfix/private/dovecot but I get the following error in the log file: Connection refused (Is this an ownership issue? I've made the owner postfix) As for the second problem, I've spend the most of the past 3 days googling the error and found very little "useful" information. Do I need to supply more info? Best regards, Andre

3 4

[Dovecot] Released Sieve v0.1.11 and ManageSieve v0.11.8 for Dovecot v1.2.3
by Stephan Bosch 10 Aug '09

10 Aug '09

Hello Dovecot users, Apart from unfinished development of the date extension, this is a set of bug-fix releases. A few portability issues were found, a few stupidities were fixed and the ManageSieve proxy now also works with TLS. Most notably, the include extension had an issue regarding the expansion of $HOME in the personal include path. I've built a project site at: http://pigeonhole.dovecot.org Changelog Sieve v0.1.11: + Built skeleton implementation for the date extension (RFC5260). It compiles, but it does not do anything useful yet. Therefore, it is not part of the default compilation. - Fixed ARM portability issues caused by char type not being signed on that platform. Reading optional operands from a binary would fail for action side effects. Also, an accidental mixup of an int return type with bool caused the interpreter to continue on ARM even though an error occured. - Removed direct stdint.h includes to prevent portability issues. - Fixed segfault bug in the handling of script open failures. - Include: improved user error messages and system log messages. - Fixed copy-paste mixup between sieve_after and sieve_before settings in the LDA Sieve plugin. If only a sieve_after script was active, nothing would have been executed. Patch by Mike Abbott. - Include: fixed a bug in HOME substitution in the sieve_dir path. Surfaced in ManageSieve. Changelog ManageSieve v0.11.8: - Fixed TLS support for proxying ManageSieve. The protocol state machine was incorrect. Also added a check that disables ssl when 'starttls' is not enabled for the user. This produces a proper warning in the log file. There is no such thing as a managesieveS protocol which has SSL from the start. The releases are available as follows: Sieve: http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.11.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.11.tar.gz.sig ManageSieve (package + patch): http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.8.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.8.tar.gz.s… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2.3-managesieve-0.11.8.diff.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2.3-managesieve-0.11.8.diff.g… Have fun testing the new releases and don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

3 3

[Dovecot] virtual plugin and ACL
by Nikita Koshikov 10 Aug '09

10 Aug '09

Hello list, We are using virtual plugin for to provide users two additional folders: Company/all - it contains all messages in user's mailbox Company/favorites - here is flagged messages. Here is namespace part of config file: namespace private { prefix = Company/ separator = / location = virtual:/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ subscriptions = no } Everything works fine, but problem arises when someone rename or delete virtual mailbox. With above config, 1 user make changes to his mailbox, but changes distribute for entire domain. First, I have tried to add :CONTROL=/data/mail/%d/%n/data/virtual to location part of virtual namespace, but I have no luck with such settings. Directory /data/mail/%d/%n/data/virtual not even been created. Then I tried to setup ACL for virtual mailbox. Adding "acl" to mail_plugins in imap and lda section and acl=vfile to plugins config. Under /var/mail/virtual in each mailbox I create dovecot-acl file contaning: user=koshikov.n lrwstiekxa authenticated lrwstipe But this didn't work. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN] Server ready. a login test qwe a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in a list "" * * LIST (\HasNoChildren) "/" "Sent" * LIST (\HasNoChildren) "/" "Drafts" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "Company" * LIST (\HasNoChildren) "/" "Company/all" * LIST (\HasNoChildren) "/" "Company/favorites" a OK List completed. a select Company/all * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1249459221] UIDs valid * OK [UIDNEXT 14] Predicted next UID * OK [NOMODSEQ] No permanent modsequences a OK [READ-WRITE] Select completed. a getacl a BAD Error in IMAP command GETACL: Unknown command. a rename Company/all Company/test a OK Rename completed. After "rename completed" in /var/mail/virtual new file dovecot-acl-list is appear with content: 1249457074 test How can I get workaround for this situation ? I just need to restrict my users renaming and deleting virtualboxes.

2 2

[Dovecot] how secure is Dovecot when exposed to the Internet?
by Florin Andrei 10 Aug '09

10 Aug '09

$ dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-11-server x86_64 Ubuntu 9.04 protocols: imap imaps managesieve I need to make an IMAP (actually imaps) server available over the Internet. Unfortunately, VPN is not available (not all clients support VPN), so I will have to expose the imaps port to the Internet. My question is: how reliable is Dovecot in such a setup? I am not talking about encryption (protecting the traffic between server and client). I am talking about having the daemon exposed to anything coming in from the Internet, buffer overflows and stuff like that. What's the security history of this software in situations like this? -- Florin Andrei http://florin.myip.org/

2 2

[Dovecot] http://wiki.dovecot.org/LDA typo
by LEVAI Daniel 09 Aug '09

09 Aug '09

-Note that dovecot.conf file must be world readable to enable deliver process read it, while running with user priviledges. +Note that dovecot.conf file must be world readable to enable deliver process read it, while running with user privileges. -- LÉVAI Dániel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

2 2

[Dovecot] Wiki entry for expire plugin, PostgreSQL trigger needs update
by Stefan Förster 09 Aug '09

09 Aug '09

The wiki entry at http://wiki.dovecot.org/Plugins/Expire needs an update for Dovecot 1.2 and PostgreSQL: -- v1.2+: CREATE OR REPLACE FUNCTION merge_expires() RETURNS TRIGGER AS $$ BEGIN IF exists(SELECT 1 FROM expires WHERE username = NEW.username AND mailbox = NEW.mailbox) THEN UPDATE expires SET expire_stamp = NEW.expire_stamp WHERE username = NEW.username AND mailbox = NEW.mailbox; RETURN NULL; ELSE RETURN NEW; END IF; END; $$ LANGUAGE plpgsql; CREATE TRIGGER mergeexpires BEFORE INSERT ON expires FOR EACH ROW EXECUTE PROCEDURE merge_expires(); At least that's what I think after looking at the code: iter = dict_iterate_init(dict, DICT_EXPIRE_PREFIX, DICT_ITERATE_FLAG_RECURSE | DICT_ITERATE_FLAG_SORT_BY_VALUE); /* We'll get the oldest values (timestamps) first */ while (dict_iterate(iter, &key, &value) > 0) { /* key = DICT_EXPIRE_PREFIX<user>/<mailbox> */ userp = key + strlen(DICT_EXPIRE_PREFIX); [...] T_BEGIN { username = t_strdup_until(userp, p); If this code does somehow iterate usernames which are not present in the dict, I apologize. Cheers Stefan

1 1

[Dovecot] User Auth
by Richard Harwood 09 Aug '09

09 Aug '09

Hello all, I am new to the mailing list and I'm in the process of setting up a LAMP + mail server. I have configured my MTA (Postfix) to deliver messages to: /var/spool/mail/vhosts/domain.tld/name I have configured Dovecot as follows: -- # 1.2.2: /usr/local/etc/dovecot.conf protocols: imap imaps pop3 ssl: no disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:/var/spool/mail/vhosts/%d:INBOX=/var/spool/mail/vhosts/%d/%n mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)example.com auth default: debug: yes passdb: driver: passwd-file args: /etc/passwd.dovecot userdb: driver: passwd -- Password excepted, my passwd.dovecot file containing a single virtual user looks like: richard:{plain}password:504:505::/home/vmail The uid/gid is the same as used by Postfix (a dedicated vmail user/group). That user/group owns the mbox I am trying to manipulate in this example. When I attempt to login via telnet on port 110 I get the error: +OK Dovecot ready. user richard(a)richardaharwood.com +OK pass password -ERR Authentication failed. It seems to dislike the fact I specify the domain as part of the login username. If I repeat and login as: user richard - I am authenticated, however I get the error: -ERR [IN-USE] Couldn't open INBOX: Internal error occurred. Refer to server log for more information. Tailing the maillog, I see the following: Aug 8 17:19:01 richardaharwood dovecot: auth(default): client in: AUTH 1 PLAIN service=pop3 secured lip=83.170.110.193 rip=83.170.110.193 lport=110 rport=58115 resp=<hidden> Aug 8 17:19:01 richardaharwood dovecot: auth(default): passwd-file(richard,83.170.110.193): lookup: user=richard file=/etc/passwd.dovecot Aug 8 17:19:01 richardaharwood dovecot: auth(default): client out: OK 1 user=richard Aug 8 17:19:01 richardaharwood dovecot: auth(default): master in: REQUEST 4 3603 1 Aug 8 17:19:01 richardaharwood dovecot: auth(default): passwd(richard,83.170.110.193): lookup Aug 8 17:19:01 richardaharwood dovecot: auth(default): master out: USER 4 richard system_groups_user=richard uid=500 gid=500 home=/home/richard Aug 8 17:19:01 richardaharwood dovecot: POP3(richard): Effective uid=500, gid=500, home=/home/richard Aug 8 17:19:01 richardaharwood dovecot: POP3(richard): mbox: data=/var/spool/mail/vhosts/:INBOX=/var/spool/mail/vhosts//richard Aug 8 17:19:01 richardaharwood dovecot: POP3(richard): fs: root=/var/spool/mail/vhosts, index=, control=, inbox=/var/spool/mail/vhosts//richard Aug 8 17:19:01 richardaharwood dovecot: POP3(richard): open(/var/spool/mail/vhosts//richard) failed: Permission denied (euid=500(richard) egid=500(richard) missing +x perm: /var/spool/mail/vhosts/) Aug 8 17:19:01 richardaharwood dovecot: POP3(richard): Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2009-08-08 17:19:01] Aug 8 17:19:01 richardaharwood dovecot: POP3(richard): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 Aug 8 17:19:01 richardaharwood dovecot: pop3-login: Login: user=<richard>, method=PLAIN, rip=83.170.110.193, lip=83.170.110.193, secured Assuming I could login with richard(a)richardaharwood.com, I should imagine Dovecot will successfully find the inbox, which is located at /var/spool/mail/vhosts/richardaharwood.com/richard in this example. I also notice the effective uid/gid is not that specified in the passwd file? The uid/gid appears to be that of my own ssh account which is not connected to the mail account that I wish to simply access as a virtual user. Would anyone be kind enough to point me in the right direction? In a nutshell, where am I going wrong with my authentication? This is a basic setup for the time being, until I get my head around it, but any pointers would be really appreciated. Have spent quite a few hours but I don't feel much closer to getting to the bottom of it! :) Many thanks, Richard

2 1

[Dovecot] multiple auth-client sockets
by LEVAI Daniel 09 Aug '09

09 Aug '09

Hi! I'm gonna need to use dovecot's auth-client socket in an authentication program. Now the auth-client socket is only used by my MTA, which is postfix. Because postfix's smtpd process (which uses the auth-client socket) runs chrooted under postfix's spool directory, I must create the auth-client socket under that spool directory. However, to reach that socket from another chrooted program is impossible. Can I create multiple instances of auth-client sockets? I tried to define another client {} stanza in socket listen {} in dovecot.conf, but only the last client socket got created. I need only a true or false response from dovecot regarding the authentication, and I thought that this is exactly what auth-client socket will do. However, if I can not reach it, is there any alternative to this? What's up with the auth-master or auth-worker sockets? Are they capable of respond to an auth request too? btw, I'm running dovecot-1.2.3 Thanks! Daniel -- LÉVAI Dániel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

3 3

[Dovecot] autocreate plugin fails to subscribe mailbox in public namespace
by Stefan Förster 09 Aug '09

09 Aug '09

Hi, I'm one step away from replacing a 7 years old qmail/uw-imapd setup with some state of the art soft- and hardware. We got migration scripts and test almost done - just one thing that keeps failing: The autocreate plugin is supposed to subscribe new users to different mailboxes, one of them being in namespace "Public." - this subscription to "Public.announcements" fails. Below is a dovecot -n - and no, there are no error messages in the logs. # 1.2.2: /etc/dovecot/dovecot.conf # OS: Linux 2.6.30-bpo.1-amd64 x86_64 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve listen(default): *:143 listen(imap): *:143 listen(managesieve): * ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(managesieve): ssl_cert_file: /etc/ssl/owncerts/snakeoil.crt ssl_key_file: /etc/ssl/private/snakeoil.key login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login verbose_proctitle: yes mail_privileged_group: vmail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_process_size: 384 mail_plugins(default): quota imap_quota fts fts_squat acl autocreate expire trash mail_plugins(imap): quota imap_quota fts fts_squat acl autocreate expire trash mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: . inbox: yes list: yes subscriptions: yes namespace: type: public separator: . prefix: Public. location: maildir:/export/vmailboxes/public:INDEX=~/Maildir/public list: yes lda: postmaster_address: postmaster(a)test.cite.lan hostname: testvm06.test.cite.lan mail_plugins: quota sieve expire trash auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login cram-md5 passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: sasl master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_warning: storage=90%% /usr/local/bin/quota-warning.sh 90 quota_warning2: storage=95%% /usr/local/bin/quota-warning.sh 95 sieve: ~/.dovecot.sieve sieve_storage: ~/sieve sieve_extensions: +imapflags fts: squat fts_squat: partial=4 full=10 acl: vfile autocreate: Trash autocreate2: Drafts autocreate3: Sent autocreate4: learn-spam autosubscribe: Trash autosubscribe2: Drafts autosubscribe3: Sent autosubscribe4: learn-spam autosubscribe5: Public.announcements autosubscribe6: INBOX expire: Trash 60 Trash/* 60 expire_dict: proxy::expire trash: /etc/dovecot/dovecot-trash.conf dict: expire: pgsql:/etc/dovecot/dovecot-dict-expire.conf Any hints are really appreciated. Cheers Stefan BTW: If anybody is interested, I could provide load and usage statistics of our old and new software once step 1 of our migration (new hardware is step 2) is done. Only ~1000 users, but still...

2 1

[Dovecot] fatal: no SASL authentication mechanisms
by Ebbe Hjorth 09 Aug '09

09 Aug '09

Hi, I have setup freebsd, postfix, dovecot and maia, but all the time i get the following error in /var/log/maillog - and i cant google me to the solution, please advice. Aug 9 12:18:49 mail02 dovecot: auth(default): Authentication client trying to connect to master socket Aug 9 12:18:49 mail02 postfix/smtpd[1356]: fatal: no SASL authentication mechanisms Aug 9 12:18:50 mail02 postfix/master[777]: warning: process /usr/local/libexec/postfix/smtpd pid 1355 exit status 1 Aug 9 12:18:50 mail02 postfix/master[777]: warning: /usr/local/libexec/postfix/smtpd: bad command startup -- throttling Aug 9 12:18:50 mail02 amavis[834]: (00834-04) mail_via_smtp: 450 4.4.1 Can't connect to 127.0.0.1 port 10025, Bad file descriptor at /usr/local/sbin/amavisd-maia line 6599, <GEN12> line 229., id=00834-04 mail02# dovecot -n # 1.1.16: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p2 i386 ufs protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecot/cert.pem ssl_key_file: /etc/ssl/dovecot/key.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: Apz.dk mail server ready. login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 125 last_valid_uid: 125 first_valid_gid: 125 last_valid_gid: 125 mail_privileged_group: mail mail_location: maildir:/usr/local/virtual/%d/%n mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login username_format: %Lu passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 2

[Dovecot] Creating a "default" domain
by Charles Sprickman 09 Aug '09

09 Aug '09

Hello, I'm setting up a test server to work through the issues involved in bringing a bunch of vpopmail/qmail/courier users into a postfix/dovecot server. So far I'm seeing lots of info to aid in the transition. One thing I'm lost on is that since Dovecot is providing all the auth mechanisms rather than vpopmail, I'm not sure how to emulate a particular vpopmail behavior we rely on. Vpopmail allows for the concept of a "default" domain for authentication. So if I have a bunch of domains, and one is "example.com", users in that domain can login with only the username part of their id (ie: "john") rather than supplying the domain (ie: "john(a)example.com"). I need to continue to offer this unless I want to walk a few hundred users through reconfiguring their mail clients. :) Any pointers? Thanks, Charles ___ Charles Sprickman NetEng/SysAdmin Bway.net - New York's Best Internet - www.bway.net spork(a)bway.net - 212.655.9344

2 2

[Dovecot] convert config from 1.1.2_1 to 1.1.16
by Ebbe Hjorth 09 Aug '09

09 Aug '09

Hi, Im tryin to follow a guide, telling me howto setup freebsd with postfix and dovecot. The text in bold (first section), is what the guide says, and the text that follows is what the /usr/local/etc/dovecot.conf files says. Can you please help me on how to convert from the 1.1.2_1 setup to the correct configuration for the 1.1.16? / Thank you very much. *socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } * socket listen { master { # Master socket provides access to userdb information. It's typically # used to give Dovecot's local delivery agent access to userdb so it # can find mailbox locations. path = /var/spool/postfix/private/auth mode = 0600 # Default user/group is the one who started dovecot-auth (root) #user = #group = } client { # The client socket is generally safe to export to everyone. Typical use # is to export it to your SMTP server so it can do SMTP AUTH lookups # using it. path = /var/run/dovecot/auth-client mode = 0660 }

3 5

[Dovecot] v1.2.3 released
by Timo Sirainen 08 Aug '09

08 Aug '09

http://dovecot.org/releases/1.2/dovecot-1.2.3.tar.gz http://dovecot.org/releases/1.2/dovecot-1.2.3.tar.gz.sig A few days later than I wanted, but here it is. * Mailbox names with control characters can't be created anymore. Existing mailboxes can still be accessed though. + Allow namespace prefix to be opened as mailbox, if a mailbox already exists in the root dir. - Maildir: dovecot-uidlist was being recreated every time a mailbox was accessed, even if nothing changed. - listescape plugin was somewhat broken - Compiling fixes for non-Linux/BSDs - imap: tb-extra-mailbox-sep workaround was broken. - ldap: Fixed hang when >128 requests were sent at once. - fts_squat: Fixed crashing when searching virtual mailbox. - imap: Fixed THREAD .. INTHREAD crashing.

2 1

[Dovecot] All mail in mbox disappears when using Outlook
by Frank Leonhardt 08 Aug '09

08 Aug '09

I thought I was imaging it but... I have a friend (honestly) that likes to clear his inbox every month by copying older into a folder (e.g. June-2009). Every month he complains that all the mail in the new folder has disappeared. This has happened three times now, and he's sort-of-right. I now believe it's a bug rather than him. The setup is Dovecot 1.1.3 on FreeBSD 7.0 and the client is Outlook 2003 SP3 (using IMAP). What you end up with is a folder called June-2009 with no messages visible. Outlook reckons it's completely empty - size 0. I don't know how he gets to this point, but it can't be anything that bizarre - just copying messages. It's happened three months in a row. However, he can't see the contents and I can't see the contents using Outlook. Strangely, Eudora and Squirrel have no problem. Corrupt mbox file? Probably not. If you copy the problem one, the copy works fine. The really weird thing is that if you rename the problem file (using mv) it STILL DOESN'T work. I've considered the possibility that it's got a bad lock on it, but if so, how come Squirrel and Eudora have no problem? I've searched as far as I can for any known problems using Outlook. What next? Thanks, Frank. ====================================================== # 1.1.3: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/mail/certs/dovecot-cert.pem ssl_key_file: /etc/mail/certs/dovecot-private.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: mbox:~/mail/:INBOX=/var/mail/%u maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 512 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login username_format: %Ln process_size: 512 passdb: driver: pam args: session=yes dovecot userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384

4 10

[Dovecot] v1.2.2 / rev 0ec0b1f1ac6a+: imap crash
by Pascal Volk 08 Aug '09

08 Aug '09

Hi Timo, the preconditions was: a dbox converted (convert-tool) from Maildir contents of dbox/mailboxes/INBOX/dbox-Mails was: - dovecot.index.log [64876 bytes] - dovecot-uidlist [167280 bytes] - 3237 mails I've started mutt to see the mails. Mutt lost the connection immediately. The log shows nothing strange except for: dovecot: Error: child 12136 (imap) killed with signal 11 (core dumped) Each time i try to connect to dovecot imap crashes. The first backtrace is attached. Regards, Pascal -- The trapper recommends today: face1e55.0921116(a)localdomain.org GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu"... warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/libdl.so.2...Reading symbols from /usr/lib/debug/lib/libdl-2.9.so...done. done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/librt.so.1...Reading symbols from /usr/lib/debug/lib/librt-2.9.so...done. done. Loaded symbols for /lib/librt.so.1 Reading symbols from /usr/lib/libgc.so.1...done. Loaded symbols for /usr/lib/libgc.so.1 Reading symbols from /lib/libc.so.6...Reading symbols from /usr/lib/debug/lib/libc-2.9.so...done. done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux-x86-64.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/libpthread-2.9.so...done. done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Reading symbols from /usr/local/dovecot12/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/dovecot12/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/dovecot12/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/dovecot12/lib/dovecot/imap/lib11_imap_quota_plugin.so Core was generated by `imap [j.roe(a)example.com 2a01:198:37a:1::1]'. Program terminated with signal 11, Segmentation fault. [New process 12136] #0 0x000000000047ac5f in index_storage_lock_notify_reset (ibox=0x0) at index-storage.c:379 379 ibox->next_lock_notify = time(NULL) + LOCK_NOTIFY_INTERVAL; (gdb) bt full #0 0x000000000047ac5f in index_storage_lock_notify_reset (ibox=0x0) at index-storage.c:379 No locals. #1 0x000000000044f6b1 in maildir_uidlist_lock_timeout (uidlist=0x22ee9a0, nonblock=false, refresh=true, refresh_when_locked=false) at maildir-uidlist.c:149 box = (struct mailbox *) 0x22ea890 control_dir = 0x70 <Address 0x70 out of bounds> path = 0x2301b20 "" old_mask = 3656138848 dotlock_flags = 0 i = 5133251 ret = 0 #2 0x000000000044f882 in maildir_uidlist_lock (uidlist=0x22ee9a0) at maildir-uidlist.c:203 No locals. #3 0x0000000000452527 in maildir_uidlist_update (uidlist=0x22ee9a0) at maildir-uidlist.c:1308 ret = 0 #4 0x000000000044fda0 in maildir_uidlist_deinit (_uidlist=0x7fffd9ec4128) at maildir-uidlist.c:325 uidlist = (struct maildir_uidlist *) 0x22ee9a0 __PRETTY_FUNCTION__ = "maildir_uidlist_deinit" #5 0x000000000044792a in dbox_sync_index_rebuild (mbox=0x22ea890) at dbox-sync-rebuild.c:446 ctx = {mbox = 0x22ea890, append_ctx = 0x0, view = 0x0, trans = 0x0, cache_ext_id = 6, cache_reset_id = 0, maildir_uidlist = 0x0, mk = 0x0, maildir_new_files = {arr = {buffer = 0x0, element_size = 8}, v = 0x0, v_modifiable = 0x0}, maildir_new_uid = 0, cache_used = 0} seq = 3 offset = 64876 fnames = (char **) 0x22d3cf0 i = 0 count = 0 ret = 0 #6 0x00000000004457b6 in dbox_sync_begin (mbox=0x22ea890, ctx_r=0x7fffd9ec41d8, close_flush_dirty_flags=false, force=false) at dbox-sync.c:357 storage = (struct mail_storage *) 0x2292a20 ctx = (struct dbox_sync_context *) 0x22d4e00 sync_flags = 6 i = 0 ret = 0 rebuild = false #7 0x0000000000445900 in dbox_sync (mbox=0x22ea890, close_flush_dirty_flags=false) at dbox-sync.c:396 sync_ctx = (struct dbox_sync_context *) 0x22ea890 #8 0x000000000044598c in dbox_storage_sync_init (box=0x22ea890, flags=65) at dbox-sync.c:415 mbox = (struct dbox_mailbox *) 0x22ea890 ret = 0 #9 0x0000000000488778 in mailbox_sync_init (box=0x22ea890, flags=65) at mail-storage.c:562 No locals. #10 0x000000000048881e in mailbox_sync (box=0x22ea890, flags=65, status_items=239, status_r=0x7fffd9ec42a0) at mail-storage.c:593 ctx = (struct mailbox_sync_context *) 0x22ea890 #11 0x0000000000422be3 in select_open (ctx=0x22dc1e8, mailbox=0x50498b "INBOX", readonly=false) at cmd-select.c:273 client = (struct client *) 0x22daf00 status = {messages = 3656139488, recent = 32767, unseen = 4354815, uidvalidity = 0, uidnext = 36552744, first_unseen_seq = 0, highest_modseq = 36252192, keywords = 0x7fffd9ec4318, sync_delayed_expunges = 0, nonpermanent_modseqs = 0} open_flags = 0 #12 0x0000000000422ff6 in cmd_select_full (cmd=0x22dc090, readonly=false) at cmd-select.c:381 client = (struct client *) 0x22daf00 box = (struct mailbox *) 0x22cf228 ctx = (struct imap_select_context *) 0x22dc1e8 args = (const struct imap_arg *) 0x22e50d8 mailbox = 0x50498b "INBOX" ret = 32767 __PRETTY_FUNCTION__ = "cmd_select_full" #13 0x0000000000423029 in cmd_select (cmd=0x22dc090) at cmd-select.c:388 No locals. #14 0x00000000004262b6 in client_command_input (cmd=0x22dc090) at client.c:611 client = (struct client *) 0x22daf00 command = (struct command *) 0x7022dc1b8 __PRETTY_FUNCTION__ = "client_command_input" #15 0x00000000004264e1 in client_command_input (cmd=0x22dc090) at client.c:660 client = (struct client *) 0x22daf00 command = (struct command *) 0x22cf228 __PRETTY_FUNCTION__ = "client_command_input" #16 0x0000000000426603 in client_handle_next_command (client=0x22daf00, remove_io_r=0x7fffd9ec445d) at client.c:701 size = 22 #17 0x0000000000426684 in client_handle_input (client=0x22daf00) at client.c:713 _data_stack_cur_id = 3 ret = true remove_io = false handled_commands = true __PRETTY_FUNCTION__ = "client_handle_input" #18 0x00000000004267e0 in client_input (client=0x22daf00) at client.c:752 cmd = (struct client_command_context *) 0xd9ec44cc output = (struct ostream *) 0x22dae68 bytes = 56 __PRETTY_FUNCTION__ = "client_input" #19 0x00000000004e2843 in io_loop_handler_run (ioloop=0x2295f80) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x229cfc0 events = (struct epoll_event *) 0x22cf800 event = (const struct epoll_event *) 0x22cf800 list = (struct io_list *) 0x229af80 io = (struct io_file *) 0x2295c00 tv = {tv_sec = 1799, tv_usec = 999469} events_count = 3 t_id = 2 msecs = 1800000 ret = 1 i = 0 j = 0 call = true #20 0x00000000004e1a3c in io_loop_run (ioloop=0x2295f80) at ioloop.c:338 No locals. #21 0x000000000043192c in main (argc=3, argv=0x7fffd9ec4648, envp=0x7fffd9ec4668) at main.c:327 No locals. (gdb)

2 2

[Dovecot] hoping someone has a suggestion
by P.A 07 Aug '09

07 Aug '09

Hi using dovecot 1.0.10 with pop/imap, using maildir, with 2000+ users mostly using pop but many using imap. Once in a great while I have problems with dovecot pop timing out. If I telnet to port 110 it just takes forever to come up or it doesn't at all, the samething happens on the imap port although 110 is always worst. At 1st when troubleshooting I was not sure what was causing the situation and when I ran out of options I stopped postfix. When I did this dovecot immediately started working again, that is port 110/143 came up fast and all the user logins were fast again. When I restarted postfix after a minute or so dovecot became slow again. While observing this situation I notice that postfix had most of the connections about 300+ in established state, while dovecot was using around 150 connections. After adjusting some of the parameters on postfix and shutting it down multiple times, suddenly everything worked but this time postfix was reporting over 3000 connections mostly in TIME_WAIT state which is normal for us. My question is what do you guys think is happening here, what is the relationship between dovecot/postfix that would cause this to happen. I'm just looking for some suggestions in case this happens again. # 1.0.10: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: D-V1 NP09 ready. login_process_size: 384 login_processes_count: 55 login_max_processes_count: 450 mail_location: maildir:/home/%1u/%u/Maildir maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: count: 4 passdb: driver: shadow userdb: driver: passwd

2 2

[Dovecot] virtual plugin - segfault body search
by Manuel Oetiker 07 Aug '09

07 Aug '09

Hello list, During full text search in a virtal folder ( virtual plugin ) the imap crashes with segfault Version: 1.2.2 OS: Ubuntu 8.04.3 LTS x86_64 Coredump: GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu"... warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux-x86-64.so.2...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib/libpthread.so.0...done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib20_autocreate_plugin.so...done. Loaded symbols for /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib20_autocreate_plugin.so Reading symbols from /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib20_virtual_plugin.so...done. Loaded symbols for /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib20_virtual_plugin.so Reading symbols from /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/pack/dovecot-1.2.2-mo/amd64-linux-ubuntu8.04/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/libnss_files.so.2...done. Loaded symbols for /lib/libnss_files.so.2 Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. [New process 10317] #0 0x0000000000000000 in ?? () No symbol table info available. #1 0x00007faa60c55bc8 in fts_backend_get_all_last_uids (backend=0x12a0be0, pool=0x1925800, last_uids=0x18c5628) at fts-api.c:86 No locals. #2 0x00007faa60c57b73 in fts_build_init_virtual (fctx=0x18c5580) at fts-storage.c:416 vctx = (struct fts_search_virtual_context *) 0x18c5608 last_uids = (struct fts_backend_uid_map *) 0x7fff69c06db0 mailboxes = {arr = {buffer = 0x74e350, element_size = 8}, v = 0x74e350, v_modifiable = 0x74e350} boxes = (struct mailbox * const *) 0x74e388 orig_boxes = (struct fts_orig_mailboxes *) 0x1925860 orig_box = {name = 0x13d0678 "INBOX", ns = 0x75b320, box = 0x13d0388} i = 7 box_count = 7 last_uid_count = 5 ret = 8 #3 0x00007faa60c57d76 in fts_build_init (fctx=0x18c5580) at fts-storage.c:445 status = {messages = 182, recent = 0, unseen = 106, uidvalidity = 1248796777, uidnext = 190, first_unseen_seq = 0, highest_modseq = 0, keywords = 0x0, sync_delayed_expunges = 0, nonpermanent_modseqs = 0} ret = 0 #4 0x00007faa60c584fa in fts_try_build_init (ctx=0x1a5bad0, fctx=0x18c5580) at fts-storage.c:580 No locals. #5 0x00007faa60c58683 in fts_mailbox_search_init (t=0xea2830, args=0x1dbc518, sort_program=0x0) at fts-storage.c:620 ft = (struct fts_transaction_context *) 0x1d96ef0 fbox = (struct fts_mailbox *) 0x13e38b0 ctx = (struct mail_search_context *) 0x1a5bad0 fctx = (struct fts_search_context *) 0x18c5580 #6 0x00000000004892ff in mailbox_search_init (t=0xea2830, args=0x1dbc518, sort_program=0x0) at mail-storage.c:735 No locals. #7 0x000000000042e8f5 in imap_search_start (ctx=0x75c7e0, sargs=0x1dbc518, sort_program=0x0) at imap-search.c:546 cmd = (struct client_command_context *) 0x75c6d8 wanted_fields = 0 wanted_headers = (struct mailbox_header_lookup_ctx *) 0x0 #8 0x000000000042207f in cmd_search (cmd=0x75c6d8) at cmd-search.c:50 ctx = (struct imap_search_context *) 0x75c7e0 sargs = (struct mail_search_args *) 0x1dbc518 args = (const struct imap_arg *) 0x7617d0 charset = 0x4f7bbc "UTF-8" ret = 1 #9 0x0000000000426519 in client_command_input (cmd=0x75c6d8) at client.c:611 client = (struct client *) 0x75c280 command = (struct command *) 0x75c6d8 __PRETTY_FUNCTION__ = "client_command_input" #10 0x0000000000426756 in client_command_input (cmd=0x75c6d8) at client.c:660 client = (struct client *) 0x75c280 command = (struct command *) 0x75aa20 __PRETTY_FUNCTION__ = "client_command_input" #11 0x0000000000426889 in client_handle_next_command (client=0x75c280, remove_io_r=0x7fff69c0702e) at client.c:701 size = 29 #12 0x000000000042690c in client_handle_input (client=0x75c280) at client.c:713 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __PRETTY_FUNCTION__ = "client_handle_input" #13 0x0000000000426a6d in client_input (client=0x75c280) at client.c:752 cmd = (struct client_command_context *) 0x757248 output = (struct ostream *) 0x75c558 bytes = 29 __PRETTY_FUNCTION__ = "client_input" #14 0x00000000004e2f52 in io_loop_handler_run (ioloop=0x756580) at ioloop-epoll.c:208 #15 0x00000000004e206e in io_loop_run (ioloop=0x756580) at ioloop.c:338 No locals. #16 0x0000000000431c63 in main (argc=1, argv=0x7fff69c07228, envp=0x7fff69c07238) at main.c:327 -- Manuel

3 3

[Dovecot] Bug - dovecot-auth hangs in ldap query. 1.1.16 (also in 1.2.2)
by Marek Miska 07 Aug '09

07 Aug '09

dovecot-auth hangs when many (>128) LDAP queries are submited simultaneously. (for example via pop3 benchmarking tool). Bug is in src/auth/db-ldap.c:db_ldap_request_queue_next if (queue_size > DB_LDAP_MAX_PENDING_REQUESTS) { /* wait until server has replied to some requests */ return FALSE; } (queue_size is total queue size, not only queries sent to LDAP server.) I think this condition should be: if (conn->pending_count >= DB_LDAP_MAX_PENDING_REQUESTS) {

2 1

[Dovecot] Trying to get dovecot and squirrelmail talking
by Neil Bird 07 Aug '09

07 Aug '09

I have been using dovecot+squirrelmail with no problems on my Fedora box (currently at F10). I've been using a simple mail location string along the lines of 'mbox:~/usr/mail/%u:INBOX=mbox:/var/spool/mail/%u' (sorry, that's off the top of my head, I can't get into my box from here at the moment). Essentially: standard mbox inbox in /var/spool/mail/[user], plus mbox files under ~/usr/mail. These latter are for remote access to archived Thunderbird files, which are [currently] mbox format. This works fine. However, I've had some slight issues elsewhere which I feel would be eased or solved by making my INBOX use maildir format, and keeping mails I want to remote-access more often in the top level maildir there (instead of always having to dip into the TB mboxes). To that end, I tried setting up: # want to be able to add sibling and child folders here namespace private { separator = / prefix = location = /var/spool/mail/%u inbox = yes hidden = no list = yes } # And the legacy mbox files go here under 'local' namespace private { separator = / prefix = local/ location = mbox:~/usr/mail hidden = no list = yes } (with appropriate an procmail change for maildir delivery) Now, this pretty much worked the way I wanted. However, afterwards, trying to connect from squirrelmail I had it say that there were no [IMAP] folders to subscribe to, including the INBOX. I couldn't se any errors, either in /var/log/maillog or http's logs. Have I got something wrong? Am I trying to do something that's doomed to failure? -- [neil@fnx ~]# rm -f .signature [neil@fnx ~]# ls -l .signature ls: .signature: No such file or directory [neil@fnx ~]# exit

2 1

[Dovecot] ACL plugin, public namespace, erroneous \HasNoChildren
by Stefan Förster 07 Aug '09

07 Aug '09

Hi, dovecot 1.2.2 with a second namespace called "Public", mapped to "/export/vmailboxes/public", LIST returning \HasNoChildren: root@testvm06:~# cat /export/vmailboxes/public/dovecot-acl user=cite lrwstiekxa authenticated lrs anyone lrs root@testvm06:~# ls -l /export/vmailboxes/public/.announcements/dovecot-acl lrwxrwxrwx 1 root root 14 Aug 6 03:50 /export/vmailboxes/public/.announcements/dovecot-acl -> ../dovecot-acl With ACL plugin enabled (notice the \HasNoChildren): root@testvm06:~# telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot ready. . login cite secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH ACL RIGHTS=texk QUOTA] Logged in . list "" Public * LIST (\Noselect \HasNoChildren) "." "Public" . OK List completed. . select Public.announcements * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1249522417] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [HIGHESTMODSEQ 1] . OK [READ-WRITE] Select completed. I included the select to show that filesystem permissions are OK. Without ACL plugin (notice the \HasChildren here): root@testvm06:~# telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot ready. . login cite secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in . list "" Public * LIST (\Noselect \HasChildren) "." "Public" . OK List completed. Is this intended behaviour, am I just too stupid for ACLs or something completely different? I wonder how clients are supposed to get a listing of a public namespace... dovecot -n: # 1.2.2: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve listen(default): *:143 listen(imap): *:143 listen(managesieve): * ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(managesieve): ssl_cert_file: /etc/ssl/owncerts/snakeoil.crt ssl_key_file: /etc/ssl/private/snakeoil.key login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login verbose_proctitle: yes mail_privileged_group: vmail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_process_size: 1024 mail_plugins(default): quota imap_quota fts fts_squat acl mail_plugins(imap): quota imap_quota fts fts_squat acl mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: . inbox: yes list: yes subscriptions: yes namespace: type: public separator: . prefix: Public. location: maildir:/export/vmailboxes/public list: yes lda: postmaster_address: postmaster(a)test.cite.lan hostname: testvm06.test.cite.lan mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: sasl master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 sieve: ~/.dovecot.sieve sieve_storage: ~/sieve sieve_extensions: +imapflags fts: squat fts_squat: partial=4 full=10 acl: vfile Cheers Stefan

2 4

[Dovecot] AutoCreate per Domain
by Darvin Denmian 07 Aug '09

07 Aug '09

Hello, is there a way to configure plugin "autocreate" per domain? Like: For domain xwz.com i want to autocreate folders: Models and Clients For domain yxw.com i want to autocreate folders: Adm and Tech Thanks.

3 10

[Dovecot] Dovecot deliver uidlist issues
by Mark Zealey 07 Aug '09

07 Aug '09

Hi all, Lets say I have a maildir which doesn't contain any dovecot files but has some emails lying around in it. If I add a message to this mailbox using deliver, dovecot creates the uidlist file with a single entry (the message that was just delivered). When I then log in to the mailbox, all the other messages are added into the uidlist file in the normal order (directory list order I believe). Then, the mailbox is in a situation where anything that was delivered into the mailbox before the user logs in is at the very top of a uidlist. Unfortunately many webmail clients seem to order the mailbox by reverse uidl, so we get the situation where people log into webmail (we use @mail) after their mailboxes have been migrated to dovecot and any messages delivered between the time of migration and the time of login are put to the very end of the list. This could presumably be fixed by ordering the mailbox according to date but certainly @mail doesn't really do this very well. I've only tested this on v1.1 (1.1.17 from atrpms), but I didn't see anything in the changelog to indicate that this deliver behaviour has changed in v1.2. Perhaps there should be a deliver option to recreate the uidlist file by doing a full scan if it doesn't exist (as a login via pop/imap would do), although I'm not sure why this shouldn't be the default? (apart from deliever potentially causing a high amount of io). My current work-around is to use postlogin to remove the uidlist file when someone logs in to the mailbox for the first time which then forces it to be created in the correct order; but this is a very messy solution. Thanks, Mark -- Mark Zealey -- Platform Architect Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer

2 1

[Dovecot] cross compile dovecot for armv5t fails
by Stephen Feyrer 07 Aug '09

07 Aug '09

Hi anyone. When I run make trying to compile Dovecot for a network attached storage box and it fails. I have used two variants of configuration: The first ./configure i_cv_epoll_works=no i_cv_inotify_works=no i_cv_posix_fallocate_works=no i_cv_signed_size_t=no i_cv_gmtime_max_time_t=32 i_cv_signed_time_t=yes i_cv_mmap_plays_with_write=yes i_cv_fd_passing=yes i_cv_c99_vsnprintf=yes lib_cv_va_copy=yes lib_cv___va_copy=yes lib_cv_va_val_copy=yes SSL_LIBS='/usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/aes.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/asn1.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/asn1_mac.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/asn1t.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/bio.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/blowfish.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/bn.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/buffer.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/camellia.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/cast.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/comp.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/conf_api.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/conf.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/crypto.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/des.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dh.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dsa.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dso.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dtls1.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ebcdic.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/engine.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/e_os2.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/err.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/evp.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/hmac.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/kssl.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/lhash.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/md2.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/md4.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/md5.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/mdc2.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/objects.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/obj_mac.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ocsp.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/opensslconf.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/opensslv.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ossl_typ.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/pem2.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/pem.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/pkcs12.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/pkcs7.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/pq_compat.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/rand.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/rsa.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/safestack.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/sha.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl23.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl2.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl3.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/stack.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/store.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/symhacks.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/tls1.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/tmdiff.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/txt_db.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ui_compat.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ui.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/x509.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/x509v3.h /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/x509_vfy.h' SSL_CFLAGS=' ' ./configure --prefix=/opt --sysconfdir=/opt/etc --sysconfdir=/opt/etc/dovecot --with-linux-quota=no --target=armv5tel-softfloat-linux-gnueabi --host=armv5tel-softfloat-linux-gnueabi --build=x86_64-pc-linux-gnu Make then fails... /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dtls1.h:203: error: expected specifier-qualifier-list before 'SSL3_BUFFER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:84: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:98: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:114: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:137: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:158: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:172: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:186: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:208: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:234: warning: return type defaults to 'int' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:233: warning: no previous prototype for 'DECLARE_ASN1_FUNCTIONS' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h: In function 'DECLARE_ASN1_FUNCTIONS': /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:234: error: expected declaration specifiers before 'DECLARE_ASN1_FUNCTIONS' /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/krb5_asn.h:233: error: parameter name omitted In file included from /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl.h:1051, from /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl3.h:125: /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dtls1.h:203: error: expected specifier-qualifier-list before 'SSL3_BUFFER' make[3]: *** [ssl-build-param] Error 1 make[3]: Leaving directory `/root/dovecot/dovecot-1-2-6c0fb914e03e/src/master' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/dovecot/dovecot-1-2-6c0fb914e03e/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/dovecot/dovecot-1-2-6c0fb914e03e' make: *** [all] Error 2 Otherwise I ./configure against my native OpenSSL install. i_cv_epoll_works=no i_cv_inotify_works=no i_cv_posix_fallocate_works=no i_cv_signed_size_t=no i_cv_gmtime_max_time_t=32 i_cv_signed_time_t=yes i_cv_mmap_plays_with_write=yes i_cv_fd_passing=yes i_cv_c99_vsnprintf=yes lib_cv_va_copy=yes lib_cv___va_copy=yes lib_cv_va_val_copy=yes SSL_LIBS='/usr/include/openssl/aes.h /usr/include/openssl/asn1.h /usr/include/openssl/asn1_mac.h /usr/include/openssl/asn1t.h /usr/include/openssl/bio.h /usr/include/openssl/blowfish.h /usr/include/openssl/bn.h /usr/include/openssl/buffer.h /usr/include/openssl/camellia.h /usr/include/openssl/cast.h /usr/include/openssl/comp.h /usr/include/openssl/conf_api.h /usr/include/openssl/conf.h /usr/include/openssl/crypto.h /usr/include/openssl/des.h /usr/include/openssl/dh.h /usr/include/openssl/dsa.h /usr/include/openssl/dso.h /usr/include/openssl/dtls1.h /usr/include/openssl/ebcdic.h /usr/include/openssl/engine.h /usr/include/openssl/e_os2.h /usr/include/openssl/err.h /usr/include/openssl/evp.h /usr/include/openssl/hmac.h /usr/include/openssl/krb5_asn.h /usr/include/openssl/kssl.h /usr/include/openssl/lhash.h /usr/include/openssl/md2.h /usr/include/openssl/md4.h /usr/include/openssl/md5.h /usr/include/openssl/mdc2.h /usr/include/openssl/objects.h /usr/include/openssl/obj_mac.h /usr/include/openssl/ocsp.h /usr/include/openssl/opensslconf.h /usr/include/openssl/opensslv.h /usr/include/openssl/ossl_typ.h /usr/include/openssl/pem2.h /usr/include/openssl/pem.h /usr/include/openssl/pkcs12.h /usr/include/openssl/pkcs7.h /usr/include/openssl/pq_compat.h /usr/include/openssl/rand.h /usr/include/openssl/rsa.h /usr/include/openssl/safestack.h /usr/include/openssl/sha.h /usr/include/openssl/ssl23.h /usr/include/openssl/ssl2.h /usr/include/openssl/ssl3.h /usr/include/openssl/ssl.h /usr/include/openssl/stack.h /usr/include/openssl/store.h /usr/include/openssl/symhacks.h /usr/include/openssl/tls1.h /usr/include/openssl/tmdiff.h /usr/include/openssl/txt_db.h /usr/include/openssl/ui_compat.h /usr/include/openssl/ui.h /usr/include/openssl/x509.h /usr/include/openssl/x509v3.h /usr/include/openssl/x509_vfy.h' SSL_CFLAGS=' ' ./configure --prefix=/opt --sysconfdir=/opt/etc --sysconfdir=/opt/etc/dovecot --with-linux-quota=no --target=armv5tel-softfloat-linux-gnueabi --host=armv5tel-softfloat-linux-gnueabi --build=x86_64-pc-linux-gnu /usr/include/openssl/dtls1.h:203: error: expected specifier-qualifier-list before 'SSL3_BUFFER' /usr/include/openssl/krb5_asn.h:84: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:98: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:114: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:137: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:158: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:172: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:186: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:208: error: expected specifier-qualifier-list before 'ASN1_INTEGER' /usr/include/openssl/krb5_asn.h:234: warning: return type defaults to 'int' /usr/include/openssl/krb5_asn.h:233: warning: no previous prototype for 'DECLARE_ASN1_FUNCTIONS' /usr/include/openssl/krb5_asn.h: In function 'DECLARE_ASN1_FUNCTIONS': /usr/include/openssl/krb5_asn.h:234: error: expected declaration specifiers before 'DECLARE_ASN1_FUNCTIONS' /usr/include/openssl/krb5_asn.h:233: error: parameter name omitted In file included from /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/ssl.h:1051, from /usr/include/openssl/ssl3.h:125: /usr/armv5tel-softfloat-linux-gnueabi/usr/include/openssl/dtls1.h:203: error: expected specifier-qualifier-list before 'SSL3_BUFFER' make[3]: *** [ssl-build-param] Error 1 make[3]: Leaving directory `/root/dovecot/dovecot-1-2-6c0fb914e03e/src/master' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/dovecot/dovecot-1-2-6c0fb914e03e/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/dovecot/dovecot-1-2-6c0fb914e03e' make: *** [all] Error 2 As you can see though separate sets of libraries are used (native Dovecot compiles without any problems) both attempts to build Arm Dovecot fail in the same way. Please help! All guidance is welcome. -- In gratitude, thanks. Stephen Feyrer

2 1

[Dovecot] connect to IMAP
by jolan D 07 Aug '09

07 Aug '09

hi, I am trying to get a webbased IMAP mail module to work. http://nocc.sourceforge.net/ But it seems it doesn't connect to it. When i try to login it says: "login is not allowed for connection" i guess it has to do with the settings of the conf file. I have dovecot installed on Centos and installed it with yum. All (basic)settings are usually set correctly during install. After trying hard still no login. So i am hoping you guys can help me out. Cheerz jolan _________________________________________________________________ Express yourself instantly with MSN Messenger! Download today it's FREE! http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/

4 4

[Dovecot] HA/Master-Slave Functionality
by savagephp 07 Aug '09

07 Aug '09

What would it take to move the HA/Cluster/Master-Slave functionality to a higher priority level? How far off is it right now in time? Tom

2 1

[Dovecot] sieve rules processing
by Nikita Koshikov 06 Aug '09

06 Aug '09

Hello list, My question: is sieve support some kind of "continue" action, to explicit tell server processing rules below current one(if current has triged)? Situation: I have few rules, which fileinto's to different directories. All is working fine, but if I want redirect all my mail for some period of time to another mailbox, I'm adding rule like this, to be processing first. if anyof (true) { redirect "koshikov(a)gmail.com"; keep; } Mail redirecting, but keep state store messages to INBOX. All I want - to process other rules, which will move message to the right imap directory. This situation also happens with vacation sieve-action. In sieve rfc I didn't find any workaround to that actions. Maybe someone know how to make sieve working in described way?

4 8

[Dovecot] 1.2.3 - fchown failed messages
by Rob Mangiafico 06 Aug '09

06 Aug '09

Hello, I installed 1.2.3 and we are seeing a few messages in the log files such as: --- Aug 4 16:40:24 xyz dovecot: IMAP(john): fchown() failed with file /home/john/.imap/INBOX/dovecot.index.log.newlock: Operation not permitted Aug 4 16:40:24 xyz dovecot: IMAP(john): fchown() failed with file /home/john/.imap/INBOX/dovecot.index.tmp: Operation not permitted --- dovecot -n: # 1.2.3: /usr/local/etc/dovecot.conf # OS: Linux 2.6.20.1 i686 CentOS release 4.7 (Final) protocols: imap imaps pop3 pop3s ssl_ca_file: /usr/local/apache/conf/ssl.crt/gd_intermediate_bundle.crt ssl_cert_file: /usr/local/apache/conf/ssl.crt/xyz.com.cert ssl_key_file: /usr/local/apache/conf/ssl.key/xyz.com.key ssl_cipher_list: HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3:!ADH:!LOW disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_max_userip_connections(default): 25 mail_max_userip_connections(imap): 25 mail_max_userip_connections(pop3): 10 mail_privileged_group: mail mail_location: mbox:~/:INBOX=/var/spool/mail/%u mail_full_filesystem_access: yes mmap_disable: yes fsync_disable: yes mbox_read_locks: fcntl flock mbox_write_locks: fcntl flock mbox_very_dirty_syncs: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 512 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster(a)example.com auth default: mechanisms: plain login username_format: %Lu verbose: yes passdb: driver: shadow userdb: driver: passwd --- Permissions look fine in the home directory john, including all sub-directories. Thanks for letting me know of anything to check/change. Rob

3 8

[Dovecot] deliver is curious
by Sven Strickroth 06 Aug '09

06 Aug '09

Hi, Im' using deliver with postfix (mailbox_command = /usr/lib/dovecot/deliver -n -m "$EXTENSION"). In dovecot.conf I've set mail_location to maildir:/var/spool/imap/users/%u/Maildir It works, but not for ONE "special" email. If I send mail to e.g. th(a)trg-oha.de it gets correctly delivered (see noerror.txt), but I have one mail with an attachment (i cannot provide it because of privacy reasons) where i get the attached error. How comes that deliver doesn't use the mail_location but the real home-directory (from ldap, it doesn't exist on the mailserver) of that user in this case? -- Best regards, Sven mailto:sven@clamav.net ClamAV, a GPL anti-virus toolkit http://www.clamav.net Aug 3 00:57:40 mailsrv postfix/qmgr[15624]: 4C8582024C: from=<kt(a)gmx.de>, size=1436493, nrcpt=1 (queue active) Aug 3 00:57:40 mailsrv dovecot: deliver(th): Home dir not found: /home/daten/user/lehrer/th Aug 3 00:57:40 mailsrv dovecot: deliver(th): Namespace: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes Aug 3 00:57:40 mailsrv dovecot: deliver(th): maildir: data=/var/spool/imap/users/th/Maildir Aug 3 00:57:40 mailsrv dovecot: deliver(th): maildir++: root=/var/spool/imap/users/th/Maildir, index=, control=, inbox=/var/spool/imap/users/th/Maildir Aug 3 00:57:40 mailsrv dovecot: deliver(th): Namespace: type=shared, prefix=users.%n., sep=., inbox=no, hidden=no, list=(null), subscriptions=no Aug 3 00:57:40 mailsrv dovecot: deliver(th): shared: root=, index=, control=, inbox= Aug 3 00:57:40 mailsrv dovecot: deliver(th): Namespace: type=public, prefix=shared., sep=., inbox=no, hidden=no, list=(null), subscriptions=no Aug 3 00:57:40 mailsrv dovecot: deliver(th): maildir: data=/var/spool/imap/shared Aug 3 00:57:40 mailsrv dovecot: deliver(th): maildir++: root=/var/spool/imap/shared, index=, control=, inbox= Aug 3 00:57:40 mailsrv dovecot: deliver(th): Namespace : Using permissions from /var/spool/imap/users/th/Maildir: mode=0700 gid=-1 Aug 3 00:57:40 mailsrv dovecot: deliver(th): mkdir_parents_chown(/home/daten/user/lehrer/th) failed: Permission denied (euid=2684(th) egid=12(mail) missing +w perm: /home) Aug 3 00:57:40 mailsrv dovecot: deliver(th): copy: i_stream_read() failed: Permission denied Aug 3 00:57:40 mailsrv dovecot: deliver(th): msgid=<F915DEB780CD459A93FA6A3E9B4564BA@EeeTh>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-08-03 00:57:40] Aug 3 00:57:40 mailsrv postfix/local[16289]: 4C8582024C: to=<th(a)trg-oha.de>, relay=local, delay=45169, delays=45169/0.05/0/0.13, dsn=4.3.0, status=deferred (temporary failure) Aug 3 00:59:44 mailsrv dovecot: deliver(th): Home dir not found: /home/daten/user/lehrer/th Aug 3 00:59:44 mailsrv dovecot: deliver(th): Namespace: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes Aug 3 00:59:44 mailsrv dovecot: deliver(th): maildir: data=/var/spool/imap/users/th/Maildir Aug 3 00:59:44 mailsrv dovecot: deliver(th): maildir++: root=/var/spool/imap/users/th/Maildir, index=, control=, inbox=/var/spool/imap/users/th/Maildir Aug 3 00:59:44 mailsrv dovecot: deliver(th): Namespace: type=shared, prefix=users.%n., sep=., inbox=no, hidden=no, list=(null), subscriptions=no Aug 3 00:59:44 mailsrv dovecot: deliver(th): shared: root=, index=, control=, inbox= Aug 3 00:59:44 mailsrv dovecot: deliver(th): Namespace: type=public, prefix=shared., sep=., inbox=no, hidden=no, list=(null), subscriptions=no Aug 3 00:59:44 mailsrv dovecot: deliver(th): maildir: data=/var/spool/imap/shared Aug 3 00:59:44 mailsrv dovecot: deliver(th): maildir++: root=/var/spool/imap/shared, index=, control=, inbox= Aug 3 00:59:44 mailsrv dovecot: deliver(th): Namespace : Using permissions from /var/spool/imap/users/th/Maildir: mode=0700 gid=-1 Aug 3 00:59:44 mailsrv dovecot: deliver(th): msgid=<4A761B5F.1450503(a)tu-clausthal.de>: saved mail to INBOX Aug 3 00:59:44 mailsrv postfix/local[16374]: 78E2D20250: to=<th(a)trg-oha.de>, relay=local, delay=0.07, delays=0.01/0.01/0/0.05, dsn=2.0.0, status=sent (delivered to command: /usr/lib/dovecot/deliver -n -m "$EXTENSION") Aug 3 00:59:44 mailsrv postfix/qmgr[15624]: 78E2D20250: removed

3 6

[Dovecot] Deliver LDA versus vdelivermail
by Wouter van der Schagt 05 Aug '09

05 Aug '09

Good morning all, I have a question. Due to my interest in the Sieve plug-in. I'm considering to change the LDA on my production servers from 'vdelivermail' from vpopmail to 'deliver' from Dovecot. However I'm not sure how to go about doing this or whether there are any conversion issues that I should be aware of. Currently my /var/qmail/control/defaultdelivery is set to "./Maildir/". I am assuming I have to set that to: "|/var/qmail/bin/preline -f /usr/local/libexec/dovecot/deliver -d $EXT@$USER" Does it also mean I have to recreate all .qmail and .qmail-default files? Am I missing anything else? Does anybody have any experience in changing LDA on production servers? Sincerely, - Wouter van der Schagt

1 0

[Dovecot] %u variable to expand kerberos realm
by Nikolay Shopik 04 Aug '09

04 Aug '09

Hi Timo, Does this intended %u isn't expanding REALM name, so I've only see user names.

2 4

[Dovecot] Sending log messages too fast
by Luigi Rosa 04 Aug '09

04 Aug '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 What does this error message means? IMAP(xxxxx(a)yyyyy.com): Sending log messages too fast, throttling.. It appeared twiche on the same user during a period when the server was very high on CPU load I don't know if it is related, but the user later told me that Thunderbird forced a reload of all the messages. Ciao, luigi - -- / +--[Luigi Rosa]-- \ It is not the strongest of the species that survives, nor the most intelligent, but the one most responsive to change. --Charles Darwin -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkp4HOwACgkQ3kWu7Tfl6ZSIeACgrzXidrLIh783fr7DVFblfwc5 s/kAnAy5rztbmeqFt11uPGF0LVp6UBga =ZgWV -----END PGP SIGNATURE-----

3 2

[Dovecot] sieve not working with Postfix and maildir
by Florin Andrei 03 Aug '09

03 Aug '09

I am moving away from Cyrus, I'm trying to migrate to Dovecot. I am trying to get Sieve working with Dovecot and Postfix and it just won't work. Postfix is able to delived new messages to the "new" subfolder of the inbox structure. After I run Thunderbird, the new message gets moved to "cur" and it shows up in my inbox. So far so good. But now I'm trying to add Sieve. I turned on managesieve, installed Avelsieve in Squirrelmail, and did some tests. No matter what, the message stays in the inbox, it does not move to the designated folder: Postfix throws it in "new", it gets moved to "cur" after accessing my email with Thunderbird, and that's it. Detailed report: ########################### $ dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-11-server x86_64 Ubuntu 9.04 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): ~/sieve sieve(default): sieve(imap): sieve(managesieve): ~/.dovecot.sieve auth default: passdb: driver: pam userdb: driver: passwd ########################### Postfix is configured to deliver to Maildir: home_mailbox = Maildir/ I am testing the delivery: ######################## $ telnet localhost 25 Trying ::1... Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 andrei.myip.org ESMTP Postfix (Ubuntu) helo joblo 250 andrei.myip.org mail from: joe(a)blow.com 250 2.1.0 Ok rcpt to: florin(a)andrei.myip.org 250 2.1.5 Ok data 354 End data with <CR><LF>.<CR><LF> testing . 250 2.0.0 Ok: queued as 512FE480C8 ######################## And the message is delivered: $ ls ~/Maildir/new/ 1249331187.V801Ia16012M874274.weiqi I fire up Thunderbird, look in the inbox, and the message is there - and it gets moved from "new" to "cur" after Thunderbird connects to the server: $ ls ~/Maildir/cur/1249331187.V801Ia16012M874274.weiqi* /home/XXXX/Maildir/cur/1249331187.V801Ia16012M874274.weiqi:2,S Okay, now I go to Squirrelmail / Avelsieve and make a rule for this >From address: ################################# $ ls -l sieve/ total 8 -rw------- 1 XXXX XXXX 1050 2009-08-03 13:30 phpscript.sieve drwx------ 2 XXXX XXXX 4096 2009-08-03 13:30 tmp florin@weiqi:~$ ls -l .dovecot.sieve lrwxrwxrwx 1 XXXX XXXX 21 2009-08-03 13:30 .dovecot.sieve -> sieve/phpscript.sieve $ cat .dovecot.sieve # I removed some commented out lines, they were too many require ["fileinto","envelope","reject","vacation","imapflags","relational","comparator-i;ascii-numeric","regex","notify","body"]; if address :contains "From" "joe(a)blow.com" { fileinto "personal.joeblow"; stop; } ################################# I do the telnet thing again, fire up Thunderbird, but this new message is still in the Inbox (it's in the "new" subfolder before running Thunderbird, then it gets moved to "cur") instead of the designated folder. Am I missing something? What is the magic I need to do to get it to move? I googled, but nothing came up. With Cyrus and Postfix, the filters worked like a charm, no problems at all, but it had its own issues (too complicated to manage for a small site). Dovecot seems more reasonable, but I can't get Sieve to work. :-( -- Florin Andrei http://florin.myip.org/

2 1

[Dovecot] Linefeeds in mailbox names
by Timo Sirainen 03 Aug '09

03 Aug '09

Wonder if I should just disallow creating mailboxes whose name contains CR or LF characters? Wonder how many peoples' scripts/tools already would break if a user created such mailbox names.. :)

2 1

[Dovecot] Dovecot with SSL Client Certification
by Evaggelos Balaskas 03 Aug '09

03 Aug '09

Hi, i am trying to setup dovecot over ssl in the last couple days unsuccessfully My notes are from here: http://wiki.dovecot.org/SSL My OpenSSL commands are: mkdir -pv /opt/certificates/dovecot/ cd !$ (just to prevent questions about Common Name) [ebal@myhome:~]€ hostname myhome openssl req -new -x509 -nodes -out dovecot.crt -keyout dovecot.key -days 1825 # Country Name (2 letter code) [AU]:GR # State or Province Name (full name) [Some-State]:Athens # Locality Name (eg, city) []:Aigaleo # Organization Name (eg, company) [Internet Widgits Pty Ltd]:Ebalaskas.Gr # Organizational Unit Name (eg, section) []:Mail Apps # Common Name (eg, YOUR name) []:myhome # Email Address []:ebalaskas@ebalaskas.gr openssl pkcs12 -export -in dovecot.crt -inkey dovecot.key \ -name "dovecot Certificate Client" -out dovecot.p12 openssl ca -gencrl -keyfile dovecot.key -cert dovecot.crt -out dovecot.crl -selfsign I've imported the dovecot.p12 to thunderbird certificates and dovecot.crt to thunderbird authorities (i've tried claws mail too - same errors) My dovecot.conf is this: [root@myhome dovecot]# dovecot -n # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30-ARCH i686 ext4 info_log_path: /var/log/dovecot.log protocols: imaps ssl: required ssl_ca_file: /opt/certificates/dovecot/dovecot.crl ssl_cert_file: /opt/certificates/dovecot/dovecot.crt ssl_key_file: /opt/certificates/dovecot/dovecot.key ssl_cipher_list: ALL:!LOW:!SSLv2 ssl_verify_client_cert: yes verbose_ssl: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login first_valid_uid: 300 mail_location: maildir:/var/spool/mail/%u:INBOX=/var/spool/mail/%u/.INBOX mail_debug: yes lda: postmaster_address: ebalaskas(a)ebalaskas.gr auth default: verbose: yes debug: yes debug_passwords: yes ssl_require_client_cert: yes passdb: driver: pam userdb: driver: passwd My /var/log/dovecot.log: Jul 30 20:14:52 Info: Dovecot v1.2.2 starting up (core dumps disabled) Jul 30 20:14:52 Info: Generating Diffie-Hellman parameters for the first time. This may take a while.. Jul 30 20:14:53 auth(default): Info: new auth connection: pid=5872 Jul 30 20:14:53 auth(default): Info: new auth connection: pid=5873 Jul 30 20:14:53 auth(default): Info: new auth connection: pid=5874 Jul 30 20:15:16 ssl-build-param: Info: SSL parameters regeneration completed Jul 30 20:15:17 auth(default): Info: new auth connection: pid=5898 Jul 30 20:15:18 imap-login: Info: Disconnected (client didn't send a cert): rip=127.0.0.1, lip=127.0.0.1, TLS handshaking: SSL_accept() failed: error:14094419:SSL routines:SSL3_READ_BYTES:tlsv1 alert access denied Any ideas? Evaggelos Balaskas Unix System Engineer - http://ebalaskas.gr/wiki Informatics Engineer Technological Education

2 2

Re: [Dovecot] Stuck with dovecot-sieve and horde-ingo ...
by Robert Schetterer 03 Aug '09

03 Aug '09

Stefan G. Weichinger schrieb: > Robert Schetterer schrieb: >> Stefan G. Weichinger schrieb: >>> Robert Schetterer schrieb: >>> >>>> if you get problems with sieve dovecot >>>> try http://www.woozle.org/~neale/src/pysieved/ >>> exactly the same behavior: ingo complains "driver not in transaction >>> state" ... >>> >>> Seems as if ingo fails to even contact port 2000 ... any idea on how to >>> debug ingo itself? >>> >>> Stefan >> there is somewhere in the horde doku >> how to setup verbose php debug logging >> sorry i couldnt remember where , but i used it allready >> during testing >> > > done already, see my last mail to horde-ml ... > > danke ;-) i will retest tonight horde ingo sieve with latest dovecot perhaps i will see equal problems so i will report to you -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] v1.2.3 release candidate
by Timo Sirainen 03 Aug '09

03 Aug '09

http://dovecot.org/tmp/dovecot-1.2.3.rc.tar.gz I thought about doing v1.2.3 release immediately, but I think I'll wait about 10-24h first. So until then, testing this RC is appreciated and hopefully we'll have a good release this time. :) + Allow namespace prefix to be opened as mailbox, if a mailbox already exists in the root dir. - Maildir: dovecot-uidlist was being recreated every time a mailbox was accessed, even if nothing changed. - listescape plugin was somewhat broken - Compiling fixes for non-Linux/BSDs

2 1

[Dovecot] Performance problem with STATUS after upgrade (1.0.15 -> 1.2.2)
by Stefan Förster 03 Aug '09

03 Aug '09

Hello list, after upgrading dovecot from 1.0.15 to 1.2.2 (and carefully reading through the upgrading notes in the wiki), I got sieve, quota and fts up and running, but I'm now suffering some kind of performance problem with the STATUS command. Symptoms: Reading mail on the IMAP server itself with "mutt", no TLS/SSL, connected through loopback interface. Whenever I idle a bit and then hit any key thereafter, for example to change into another mailbox, mutt will send a number of "STATUS" commands: # T 127.0.0.1:53604 -> 127.0.0.1:143 [AP] DONE..a0070 STATUS "postfix-buch" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0071 STATUS "postfix-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0072 STATUS "Trash" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0073 STATUS "Sent" (UIDNEXT UIDVALID ITY UNSEEN RECENT)..a0074 STATUS "mailman-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0075 STATUS "mailman-developers" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0076 STATUS "de-postfix-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0077 STATUS "amavis-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0078 STATUS "spam" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0079 STATUS "localreports" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0080 STATUS "Drafts" (UIDNEXT UIDVALIDITY UNSEEN R ECENT)..a0081 STATUS "exim-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT).. # (The whole conversation is available as: http://www.incertum.net/~cite/dovecot-snoop.log) Those commands take almost one(!) second to complete. I've used strace to capture what happens and made the results available at http://www.incertum.net/~cite/imap.log. With 1.0.15, I never noticed this kind of delay, and reading mail feels really sluggish at the moment. Is there any way to improve performance? Configuration data: Filesystem mounted to /export/vmailboxes is an ext3: # tune2fs -l /dev/rootvg/mailhome_lv | grep "^Filesystem features" Filesystem features: has_journal resize_inode dir_index filetype needs_recovery sparse_super large_file (needs_recovery is set because the filesystem is mounted, I umounted it, did fsck -Dfy and it didn't display that "feature" when unmounted). dovecot -n (also available as: http://www.incertum.net/~cite/dovecot-n.log) # 1.2.2: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve listen(default): *:143 listen(imap): *:143 listen(managesieve): * ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(managesieve): ssl_cert_file: /etc/ssl/owncerts/mail_incertum_net.crt ssl_key_file: /etc/ssl/private/mail_incertum_net.key login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login verbose_proctitle: yes mail_privileged_group: vmail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_process_size: 1024 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve lda: postmaster_address: postmaster(a)incertum.net hostname: mail.incertum.net mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: sasl master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 sieve: ~/.dovecot.sieve sieve_storage: ~/sieve sieve_extensions: +imapflags fts: squat fts_squat: partial=4 full=10 SQL-Configuration: # grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = pgsql connect = hostaddr=333.33.33.3 port=5432 dbname=secret user=secret password=secret sslmode=require default_pass_scheme = PLAIN password_query = SELECT login AS user, password FROM virtual_user_maps WHERE login IN ('%u', '%n') user_query = SELECT vum.uid, vum.gid, ('*:storage=' || vum.quota_kbytes || 'k') AS quota_rule, ('/export/vmailboxes/' || SUBSTR(vum.login, 1, 1) || '/' || vum.login) AS home FROM virtual_mailbox_domains AS vmd LEFT JOIN virtual_mailbox_maps AS vmm ON (vmd.id = vmm.domain) LEFT JOIN virtual_user_maps AS vum ON (vmm.login = vum.id) WHERE ((vmm.localpart = '%n' AND vmd.name='%d') OR (vum.login = '%u')) AND vum.active Memory: # free -m total used free shared buffers cached Mem: 3952 3003 949 0 226 1036 -/+ buffers/cache: 1740 2211 Swap: 7812 5 7807 The version is Debian/unstable's 1.2.2, available at http://packages.debian.org/sid/dovecot-common, I've made a backport to Debian/stable. Any help/insights are really appreciated. Cheers Stefan

2 3

[Dovecot] Spaces in user or group-names
by Sven Strickroth 03 Aug '09

03 Aug '09

Hi, how it is possible to use group names with spaces (like "Domain Admins") in dovecot-acl files? -- Best regards, Sven mailto:sven@clamav.net ClamAV, a GPL anti-virus toolkit http://www.clamav.net

2 4

[Dovecot] Panic: file mbox-sync-rewrite.c: line 590
by Kostik 03 Aug '09

03 Aug '09

Hello! We start migrate to dovecot (v1.2.2). # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30 i686 Slackware 11.0.0 We have FS user quota and NFS mailboxs(mbox only). While user not overquota, all works fine. But if is, we get error at log: --- Aug 3 16:45:17 chest004 dovecot: pop3-login: Login: user=<boggart(a)xxxx.xx>, method=PLAIN Aug 3 16:45:17 chest004 dovecot: POP3(boggart(a)xxxx.xx): close(/var/virtual/mail/boggart.lock) failed: Disk quota exceeded Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): close(/var/virtual/mail/boggart.lock) failed: Disk quota exceeded Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): Panic: file mbox-sync-rewrite.c: line 590 (mbox_sync_rewrite): assertion failed: (mails[idx].from_offset == start_offset) Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): Raw backtrace: pop3 [0x80c949c] -> pop3 [0x80c9c3e] -> pop3 [0x80c9638] -> pop3(mbox_sync_rewrite+0x6ff) [0x807c9af] -> pop3 [0x8078038] -> pop3 [0x807a30a] -> pop3(mbox_sync+0x399) [0x807b279] -> pop3(mbox_storage_sync_init+0x53) [0x807b773] -> pop3(mailbox_sync+0x2d) [0x809331d] -> pop3(client_command_execute+0x2e6) [0x805d066] -> pop3(client_handle_input+0x75) [0x805be35] -> pop3(io_loop_handler_run+0x101) [0x80d2221] -> pop3(io_loop_run+0x29) [0x80d15a9] -> pop3(main+0x779) [0x805dd49] -> /lib/tls/libc.so.6(__libc_start_main+0xd4) [0xb7e46e14] -> pop3 [0x805b161] --- What does that mean? /usr/local/sbin/dovecot -n --- # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30 i686 Slackware 11.0.0 base_dir: /var/run/dovecot/ protocols: imap pop3 listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: dotlock_try fcntl mbox_lock_timeout: 150 mbox_dotlock_change_timeout: 60 mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_log mail_plugins(imap): quota imap_quota mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql userdb: driver: prefetch plugin: quota: fs:Quota:user =koc

1 0

[Dovecot] Subfolders not listed in Dovecot-1.2.2 with listescape
by Petter Urkedal 03 Aug '09

03 Aug '09

After upgrading to Dovecot-1.2.2 from 1.1* subfolders disappeared, though it was possible to access them directly, e.g. with "mutt -f =lists/dovecot". The problem only occurs if the listescape plugin is enabled. Some relevant bits from the configuration: namespace private { # The only namespace. separator = / prefix = inbox = yes } protocol imap { mail_plugins = fts fts_squat listescape }

2 2

[Dovecot] Best way to get login protocol (pop3/imap) in post-login script
by Zhang Huangbin 03 Aug '09

03 Aug '09

Hi, all. I found doc here: http://wiki.dovecot.org/PostLoginScripting and use ${USER}, ${IP} to track last-login username and remote ip address, but how can i track the mail protocol it used? like pop3, pop3s, imap, imaps? Currently, i wrote shell script as post-login script, and use below command to get protocol: ---- $(basename ${MAIL_PLUGIN_DIR}) ---- But is it the best way to get it? Thanks very much. :) -- Best Regards. Zhang Huangbin - Open Source Mail Server Solution for Red Hat(R) Enterprise Linux, CentOS, Debian, Ubuntu: + http://code.google.com/p/iredmail/ + http://www.iredmail.org/forum/

2 2