- dovecot - dovecot.org

[Dovecot] Very long establishment time for secondary connections
by Jeff Mitchell 14 Aug '09

14 Aug '09

Hello, I'm currently on Dovecot 1.1.17 and I have a user that runs into a problem quite a lot. She's using Thunderbird on a Mac. When she sends mail, Thunderbird is set up to save sent mail to her Sent folder. Often (usually when she has not sent another mail for a long while) when she sends mail, Thunderbird sits there saying "Copying message to Sent folder" for about thirty seconds. My best guess, after looking at dovecot messages in syslog related to her login, is that Thunderbird is using a secondary imap process to do this copying and this connection times out due to inactivity, so that when she sends mail it has to reestablish itself. For some reason this reestablishment seems to take a very long time, even though her initial login/connection when she opens Thunderbird is very fast. I looked for a way to increase the inactivity time in dovecot.conf but didn't see one. I don't know of any other user that has this problem, which makes me suspicious of her client rather than Dovecot. Pretty much everyone is using Thunderbird, although she's the only one using it on a Mac. Is it possible/likely that it takes so long because for some reason Thunderbird on a Mac doesn't notice that the second connection has died and is taking a long time trying to use the first invalid connection before reestablishment? Or is it likely that this is a Dovecot problem and I simply haven't figured out what's going on, yet? All help very much appreciated. Thanks, Jeff

2 1

Re: [Dovecot] Upgrade question from 1.1 to 1.2
by Johan Hendriks 14 Aug '09

14 Aug '09

Wouter van der Schagt schreef: >> Did you read this page ? >> http://wiki.dovecot.org/Upgrading/1.2 > > Actually I did. Twice even. Somehow I thought those settings did not > apply to me since currently we only use the pop3 protocol. Pretty > stupid eh? > > My apologies. > > Sincerely, > - Wouter van der Schagt No need to apologize, we all have our moments! I do for sure ;-) -- _______________________ *Johan Hendriks* *Schavemaker Transport* Tel: +31 (0)251 229098 Fax: +31 (0)251 212016 email: j.hendriks(a)schavemaker.com <mailto:j.hendriks@schavemaker.com> web: http://www.schavemaker.com _______________________

1 0

[Dovecot] Upgrade question from 1.1 to 1.2
by Wouter van der Schagt 14 Aug '09

14 Aug '09

Good afternoon, I am considering to upgrade from Dovecot 1.1.18 to 1.2.x and was reading your Wiki regarding any changes and found: "If you were using e.g. mail_location = maildir:/var/mail/%h, just change it to mail_location = maildir:%h and add /var/mail/ prefix to home dirs." I am currently using: "mail_location = maildir:~/Maildir" in combination with vpopmail. Does this need to be changed? or is ~/Maildir considered an absolute directory? Is there anything else I should be aware of ? Sincerely, - Wouter van der Schagt

3 4

[Dovecot] Dovecot Proxy
by Michel Bulgado 14 Aug '09

14 Aug '09

Hello I have installed Dovecot as a POP3 server, IMAP on my internal network, the authentication against Windows Active Directory. I would like to know how to setup a second server dovecot as my proxy server for external users outside the network, in another segment of different IP addresses, or at least define which mailboxes will be stored on another server to be accessible to both servers. I have reviewed the document on the wiki site, but I said that is only possible with mysql authentication, but as I said the road where the messages are stored, it is possible for NFS? Thanks Michel

2 1

[Dovecot] Migrating Emails from 1.0.15 to 1.2.2
by Mario Antonio 14 Aug '09

14 Aug '09

I need to copy some email storage from a Dovecot Server running 1.0.15 into another Dovecot Server running 1.2.2. I know that I can use imapsync (perhaps this is the proper way) But I was just wondering, if I can just run Rsync to do that transfer: Will I run against some incompatibility formats between these two versions? M.A.

2 1

[Dovecot] map->hdr.record_size <= tview->record_size
by Edgar Fuß 14 Aug '09

14 Aug '09

This is 1.2.3, but there are also two older dovecots (with different machine architecture) sharing the mail store: dovecot: IMAP(xxx): Panic: file mail-index-transaction-view.c: line 106 (tview_apply_flag_updates): assertion failed: (map->hdr.record_size <= tview->record_size)

2 1

[Dovecot] QUOTA not appearing in CAPA
by Tim Traver 14 Aug '09

14 Aug '09

Hi, ok, I've compiled it a few times, and made sure all of my settings are correct, but the QUOTA is not appearing in the opening CAPA that comes with the greeting. I have it configured in the dovecot.conf like so: protocol imap { mail_plugins = quota imap_quota } and I can see when turning debugging on that the following is spit out when starting : Starting DovecotILoading modules from directory: /usr/local/lib/dovecot/imap IModule loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so IModule loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so IEffective uid=65534, gid=65534, home=/tmp IQuota root: name= backend=maildir args= IEffective uid=65534, gid=65534, home=/tmp and then I see the following in the dovecot logs : Aug 10 17:35:10 IMAP(xxxxx(a)simplenet.com): Info: Module loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Aug 10 17:35:10 IMAP(xxxxx(a)simplenet.com): Info: Module loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so when I log into the IMAP port, I get the following greeting : * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. So it seems there is no QUOTA support for the IMAP server to query for the quota file... can someone help me as to a direction to go here??? The reason I need it is because I believe the web client relies on the QUOTA being in the CAPA in order to show it... Thanks, Tim.

2 12

[Dovecot] Proxying external IMAP servers
by Daniel L. Miller 14 Aug '09

14 Aug '09

For those admins who, for whatever ill-advised reason, need to allow users access to external IMAP servers - like AOL - is there a benefit to using Dovecot as a proxy instead of simply having the clients access the external servers directly? -- Daniel

2 1

[Dovecot] dovecot-1.2.3 (managesieve) crash with backtrace
by Ralf Hildebrandt 13 Aug '09

13 Aug '09

Backtrace: ========== GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/librt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/librt-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/librt.so.1 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/i686/cmov/libpthread-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libpthread.so.0 Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_trash_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_trash_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_autocreate_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_autocreate_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_zlib_plugin.so Reading symbols from /usr/lib/libz.so.1...done. Loaded symbols for /usr/lib/libz.so.1 Reading symbols from /lib/libbz2.so.1.0...done. Loaded symbols for /lib/libbz2.so.1.0 Reading symbols from /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `imap [theiden 141.42.4.251]'. Program terminated with signal 6, Aborted. [New process 25008] #0 0xb7f14424 in __kernel_vsyscall () #0 0xb7f14424 in __kernel_vsyscall () No symbol table info available. #1 0xb7dc63d0 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1209049100 selftid = 25008 #2 0xb7dc9a85 in *__GI_abort () at abort.c:88 act = {__sigaction_handler = {sa_handler = 0x83a13e0, sa_sigaction = 0x83a13e0}, sa_mask = {__val = {3215023752, 135192458, 3085915872, 0, 3215023872, 3215023860, 512, 0, 0, 3215023936, 3086165616, 134566650, 1131, 0, 0, 0, 1, 135265534, 512, 1, 3215023860, 138023872, 69, 3215023988, 3215023832, 135194054, 138025035, 3215023860, 3215023864, 1132, 138023904, 3085356819}}, sa_flags = 1132, sa_restorer = 0x81059a9 <write_full+57>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0x080f0425 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x83a0bb0 "imap [0x80f0411] -> imap [0x80f0482] -> imap [0x80efe29] -> imap [0x80c839b] -> imap [0x80cea95] -> imap [0x80c85cf] -> imap(mail_index_lookup_ext_full+0x36) [0x80cda46] -> imap(mail_cache_lookup_cur_"... #4 0x080f0482 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x81084ec "file %s: line %d (%s): assertion failed: (%s)", args=0xbfa15fd4 "�X\021\bj") at failures.c:440 No locals. #5 0x080efe29 in i_panic ( format=0x81084ec "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0x080c839b in tview_lookup_full (view=0x83b7ad8, seq=1, map_r=0xbfa160d8, expunged_r=0xbfa160a7) at mail-index-transaction-view.c:106 rec = (const struct mail_index_record *) 0x83bc898 #7 0x080cea95 in view_lookup_ext_full (view=0x83b7ad8, seq=1, ext_id=4, map_r=0xbfa160d8, data_r=0xbfa160d4, expunged_r=0xbfa160a7) at mail-index-view.c:414 rec = <value optimized out> #8 0x080c85cf in tview_lookup_ext_full (view=0x83b7ad8, seq=1, ext_id=4, map_r=0xbfa160d8, data_r=0xbfa160d4, expunged_r=0xbfa160a7) at mail-index-transaction-view.c:408 ext_buf = (const union array__seq_array *) 0x0 data = <value optimized out> idx = <value optimized out> __PRETTY_FUNCTION__ = "tview_lookup_ext_full" #9 0x080cda46 in mail_index_lookup_ext_full (view=0x6, seq=1, ext_id=4, map_r=0xbfa160d8, data_r=0xbfa160d4, expunged_r=0x0) at mail-index-view.c:596 expunged = false #10 0x080bbad9 in mail_cache_lookup_cur_offset (view=0x83b7ad8, seq=1, reset_id_r=0xbfa1610c) at mail-cache-lookup.c:65 cache = (struct mail_cache *) 0x83b5cb0 map = <value optimized out> data = (const void *) 0x4 offset = <value optimized out> #11 0x080bbb5d in mail_cache_lookup_offset (cache=0x83b5cb0, view=0x6, seq=25008, offset_r=0xbfa16178) at mail-cache-lookup.c:87 offset = <value optimized out> reset_id = 138108080 ret = <value optimized out> #12 0x080bbc05 in mail_cache_lookup_iter_init (view=0x83bdae0, seq=1, ctx_r=0xbfa16160) at mail-cache-lookup.c:154 ret = <value optimized out> #13 0x080bc51f in mail_cache_field_exists (view=0x83bdae0, seq=1, field=12) at mail-cache-lookup.c:292 __PRETTY_FUNCTION__ = "mail_cache_field_exists" #14 0x080bcd98 in mail_cache_field_want_add (ctx=0x83bdb40, seq=1, field_idx=12) at mail-cache-transaction.c:1009 decision = MAIL_CACHE_DECISION_NO #15 0x080a4a33 in index_mail_parse_header_init (mail=0x83b7cb8, _headers=0x83b90c8) at index-mail-headers.c:189 _data_stack_cur_id = 5 i = <value optimized out> field_idx = <value optimized out> __PRETTY_FUNCTION__ = "index_mail_parse_header_init" #16 0x080a4c40 in index_mail_parse_headers (mail=0x83b7cb8, headers=0x83b90c8) at index-mail-headers.c:431 input = (struct istream *) 0x83f2260 old_offset = 0 #17 0x080a500f in index_mail_get_raw_headers (mail=0x83b7cb8, field=0xb7d6a6f4 "Message-ID", value_r=0xbfa162e8) at index-mail-headers.c:625 headers = {0xb7d6a6f4 "Message-ID", 0x0} value = <value optimized out> headers_ctx = (struct mailbox_header_lookup_ctx *) 0x0 data = <value optimized out> field_idx = 12 dest = (string_t *) 0x83ecef0 i = <value optimized out> len = <value optimized out> ret = <value optimized out> __PRETTY_FUNCTION__ = "index_mail_get_raw_headers" #18 0x080a5372 in index_mail_get_first_header (_mail=0x83b7cb8, field=0xb7d6a6f4 "Message-ID", decode_to_utf8=false, value_r=0xbfa1633c) at index-mail-headers.c:771 list = (const char * const *) 0x108 ret = 138019688 i = 0 #19 0x080b0a85 in mail_get_first_header (mail=0x83b7cb8, field=0xb7d6a6f4 "Message-ID", value_r=0xbfa1633c) at mail.c:118 No locals. #20 0xb7d69bfb in mail_log_add_hdr (mail=0x0, str=0x83a0368, name=0xb7d6a6ff "msgid", header=0xb7d6a6f4 "Message-ID") at mail-log-plugin.c:277 value = 0xb7d69bdc "\201ô\035" #21 0xb7d69f95 in mail_log_action (dest_trans=<value optimized out>, mail=0x83b7cb8, event=MAIL_LOG_EVENT_DELETE, data=0x0) at mail-log-plugin.c:318 size = <value optimized out> str = (string_t *) 0x83a0368 #22 0xb7d6a494 in mail_log_mail_update_flags (_mail=0x83b7cb8, modify_type=MODIFY_ADD, flags=MAIL_DELETED) at mail-log-plugin.c:376 _data_stack_cur_id = 25008 lmail = <value optimized out> old_flags = <value optimized out> new_flags = <value optimized out> #23 0x08065e95 in cmd_store (cmd=0x83ad688) at cmd-store.c:192 client = (struct client *) 0x83ad3f8 args = (const struct imap_arg *) 0x83b2718 search_args = (struct mail_search_args *) 0x0 search_ctx = (struct mail_search_context *) 0x83f3e48 t = (struct mailbox_transaction_context *) 0x83bd220 mail = (struct mail *) 0x83b7cb8 ctx = {cmd = 0x83ad688, max_modseq = 18446744073709551615, flags = MAIL_DELETED, keywords = 0x0, modify_type = MODIFY_ADD, silent = false} modified_set = {arr = {buffer = 0x83b6fe8, element_size = 8}, v = 0x83b6fe8, v_modifiable = 0x83b6fe8} uids = {arr = {buffer = 0x83b2788, element_size = 3215025224}, v = 0x83b2788, v_modifiable = 0x83b2788} flags = <value optimized out> imap_sync_flags = <value optimized out> reply = <value optimized out> tagged_reply = <value optimized out> str = <value optimized out> ret = <value optimized out> #24 0x0806769c in client_command_input (cmd=0x83ad688) at client.c:611 client = (struct client *) 0x83ad3f8 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #25 0x08067743 in client_command_input (cmd=0x83ad688) at client.c:660 client = (struct client *) 0x83ad3f8 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #26 0x0806789d in client_handle_input (client=0x83ad3f8) at client.c:701 _data_stack_cur_id = 3 ret = false remove_io = <value optimized out> handled_commands = false __PRETTY_FUNCTION__ = "client_handle_input" #27 0x080681df in client_input (client=0x83ad3f8) at client.c:752 cmd = <value optimized out> output = (struct ostream *) 0x83ad5ac bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #28 0x080f9000 in io_loop_handler_run (ioloop=0x83a89b0) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x83a8ab8 event = (const struct epoll_event *) 0x83a8af8 list = (struct io_list *) 0x83ad630 io = (struct io_file *) 0x83b7c68 tv = {tv_sec = 1799, tv_usec = 999920} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #29 0x080f8470 in io_loop_run (ioloop=0x83a89b0) at ioloop.c:338 No locals. #30 0x08070b52 in main (argc=) at main.c:327 No locals. $1 = {prev = 0x0, next = 0x0, client = 0x83ad3f8, pool = 0x83ad670, tag = 0x83ad700 "A004", name = 0x83ad710 "UID STORE", args = 0x83ad720 "1:* +FLAGS (\\Deleted)", cmd_flags = COMMAND_FLAG_BREAKS_SEQS, func = 0x8065a20 <cmd_store>, context = 0x0, module_contexts = {arr = {buffer = 0x83ad6c8, element_size = 4}, v = 0x83ad6c8, v_modifiable = 0x83ad6c8}, parser = 0x83b2678, state = CLIENT_COMMAND_STATE_WAIT_INPUT, sync = 0x0, uid = 1, cancel = 0, param_error = 0, search_save_result = 0, temp_executed = 0} (gdb) quit from the log: ============= Aug 13 14:20:43 postamt dovecot: IMAP(theiden): Panic: file mail-index-transaction-view.c: line 106 (tview_apply_flag_updates): assertion failed: (map->hdr.record_size <= tview->record_size) Aug 13 14:20:43 postamt dovecot: IMAP(theiden): Raw backtrace: imap [0x80f0411] -> imap [0x80f0482] -> imap [0x80efe29] -> imap [0x80c839b] -> imap [0x80cea95] -> imap [0x80c85cf] -> imap(mail_index_lookup_ext_full+0x36) [0x80cda46] -> imap(mail_cache_lookup_cur_offset+0x49) [0x80bbad9] -> imap [0x80bbb5d] -> imap(mail_cache_lookup_iter_init+0x55) [0x80bbc05] -> imap(mail_cache_field_exists+0xaf) [0x80bc51f] -> imap(mail_cache_field_want_add+0x48) [0x80bcd98] -> imap(index_mail_parse_header_init+0x1c3) [0x80a4a33] -> imap(index_mail_parse_headers+0x60) [0x80a4c40] -> imap [0x80a500f] -> imap(index_mail_get_first_header+0x22) [0x80a5372] -> imap(mail_get_first_header+0x25) [0x80b0a85] -> /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7d69bfb] -> /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7d69f95] -> /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7d6a494] -> imap(cmd_store+0x475) [0x8065e95] -> imap [0x806769c] -> imap [0x8067743] -> imap(client_handle_input+0x2d) [0x806789d] -> Aug 13 14:20:43 postamt dovecot: IMAP(theiden): io_loop_handler_run+0xe0) [0x80f9000] -> imap(io_loop_run+0x20) [0x80f8470] -> imap(main+0x5d2) [0x8070b52] Aug 13 14:20:43 postamt dovecot: dovecot: child 25008 (imap) killed with signal 6 (core dumped) -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 1

[Dovecot] More effective mailbox fetching over high RTT link
by Andrzej Adam Filip 13 Aug '09

13 Aug '09

Could you offer some suggestion how to fetch mailbox content over high RTT link (with negligible packet loss)? Currently I use IMAP+IDLE *but* it fails to use full available bandwidth due to high RTT and "send command wait for response" nature of POP3 and IMAP4 protocols. -- [pl>en: Andrew] Andrzej Adam Filip : anfi(a)onet.eu Learning without thought is labor lost; thought without learning is perilous. -- Confucius

4 6