- dovecot - dovecot.org

[Dovecot] panic with search
by Kazuo Moriwaka 20 Dec '04

20 Dec '04

Hello, My imap daemon get SIGABRT with following message. "pool_data_stack_realloc(): stack frame changed" This is caused with cvs head sources.(and or not with my last 2 patches.) This causes while doing search command. This is IMAP command log: --------------------------------------------------------------------------- * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS] Logged in as mailtest * select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 135 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1102574212] UIDs valid * OK [UIDNEXT 139] Predicted next UID * OK [READ-WRITE] Select completed. * search body "hoge" imap(mailtest): Panic: pool_data_stack_realloc(): stack frame changed Aborted --------------------------------------------------------------------------- I'll attach backtrace just before print panic messages. If maildir and messages are need for debug, please request to me. thanks, -- Kazuo Moriwaka moriwaka(a)valinux.co.jp (gdb) bt #0 printf_string_upper_bound (format_p=0xbffff848, args=0xbffff884 "`$B}?(x??(Bq\n\b$B8y(B\f\b\210w\f\b$B8x(B?\017e\n\b\210w\f\b$BPw(B\f\b") at printf-upper-bound.c:78 #1 0x080a7640 in default_handler (prefix=0x80c226a "Panic: ", f=0x41149fe0, format=0x80c3300 "pool_data_stack_realloc(): stack frame changed", args=0xbffff884 "`$B}?(x??(Bq\n\b$B8y(B\f\b\210w\f\b$B8x(B?\017e\n\b\210w\f\b$BPw(B\f\b") at failures.c:99 #2 0x080a76b8 in default_panic_handler (format=0x80c3300 "pool_data_stack_realloc(): stack frame changed", args=0xbffff884 "`$B}?(x??(Bq\n\b$B8y(B\f\b\210w\f\b$B8x(B?\017e\n\b\210w\f\b$BPw(B\f\b") at failures.c:115 #3 0x080a786a in i_panic (format=0x80c3300 "pool_data_stack_realloc(): stack frame changed") at failures.c:173 #4 0x080afd33 in pool_data_stack_realloc (pool=0x80c7788, mem=0x80c77d0, old_size=256, new_size=8192) at mempool-datastack.c:110 #5 0x080a650f in buffer_alloc (buf=0x80c77b0, size=8192) at buffer.c:32 #6 0x080a6c74 in buffer_check_limits (buf=0x80c77b0, pos=1, data_size=4096) at buffer.c:57 #7 0x080a6a49 in buffer_copy (_dest=0x80c77b0, dest_pos=1, _src=0x80c7950, src_pos=0, copy_size=4096) at buffer.c:227 #8 0x080a6acd in buffer_append_buf (dest=0x80c77b0, src=0x80c7950, src_pos=0, copy_size=4096) at buffer.c:240 #9 0x080a0a71 in message_search_body_block (ctx=0xbffffa00, block=0x80c7950) at message-body-search.c:229 #10 0x080a0e4e in message_search_body (ctx=0xbffffa00, input=0x80de170, part=0x80dede0) at message-body-search.c:336 #11 0x080a1135 in message_body_search_ctx (ctx=0xbffffa60, input=0x80ddf08, part=0x80dede0) at message-body-search.c:408 #12 0x080a11ff in message_body_search (key=0x80d4f60 "hoge", charset=0x0, unknown_charset=0xbffffabc, input=0x80ddf08, part=0x80dede0, search_header=0) at message-body-search.c:433 #13 0x0807f58a in search_body (arg=0x80d4f38, context=0xbffffb40) at index-search.c:467 #14 0x08098278 in search_arg_foreach (arg=0x80d4f38, callback=0x807f4f0 <search_body>, context=0xbffffb40) at mail-search.c:81 #15 0x080982a8 in mail_search_args_foreach (args=0x80d4f38, callback=0x807f4f0 <search_body>, context=0xbffffb40) at mail-search.c:93 #16 0x0807f82b in search_arg_match_text (args=0x80d4f38, ctx=0x80dec88) at index-search.c:545 #17 0x08080011 in search_match_next (ctx=0x80dec88) at index-search.c:813 #18 0x080800bf in index_storage_search_next (_ctx=0x80dec88) at index-search.c:837 #19 0x08098e38 in mailbox_search_next (ctx=0x80dec88) at mail-storage.c:397 #20 0x0805787c in imap_search (client=0x80d0cf8, charset=0x0, sargs=0x80d4f38) at cmd-search.c:32 #21 0x08057baf in cmd_search (client=0x80d0cf8) at cmd-search.c:97 #22 0x08059c2e in client_handle_input (client=0x80d0cf8) at client.c:324 #23 0x08059d2e in _client_input (context=0x80d0cf8) at client.c:368 #24 0x080ae2f8 in io_loop_handler_run (ioloop=0x80cfa58) at ioloop-poll.c:184 #25 0x080ad4c1 in io_loop_run (ioloop=0x80cfa58) at ioloop.c:218 #26 0x080637d0 in main (argc=1, argv=0xbffffdd4, envp=0xbffffddc) at main.c:224 (gdb) up #1 0x080a7640 in default_handler (prefix=0x80c226a "Panic: ", f=0x41149fe0, format=0x80c3300 "pool_data_stack_realloc(): stack frame changed", args=0xbffff884 "`$B}?(x??(Bq\n\b$B8y(B\f\b\210w\f\b$B8x(B?\017e\n\b\210w\f\b$BPw(B\f\b") at failures.c:99 99 (void)printf_string_upper_bound(&format, args); (gdb) up #2 0x080a76b8 in default_panic_handler (format=0x80c3300 "pool_data_stack_realloc(): stack frame changed", args=0xbffff884 "`$B}?(x??(Bq\n\b$B8y(B\f\b\210w\f\b$B8x(B?\017e\n\b\210w\f\b$BPw(B\f\b") at failures.c:115 115 (void)default_handler("Panic: ", log_fd, format, args); (gdb) up #3 0x080a786a in i_panic (format=0x80c3300 "pool_data_stack_realloc(): stack frame changed") at failures.c:173 173 panic_handler(format, args); (gdb) up #4 0x080afd33 in pool_data_stack_realloc (pool=0x80c7788, mem=0x80c77d0, old_size=256, new_size=8192) at mempool-datastack.c:110 110 i_panic("pool_data_stack_realloc(): stack frame changed"); (gdb) list 105 /* @UNSAFE */ 106 if (new_size == 0 || new_size > SSIZE_T_MAX) 107 i_panic("Trying to allocate %"PRIuSIZE_T" bytes", new_size); 108 109 if (dpool->data_stack_frame != data_stack_frame) 110 i_panic("pool_data_stack_realloc(): stack frame changed"); 111 112 if (mem == NULL) 113 return pool_data_stack_malloc(pool, new_size); 114 (gdb) p dpool $18 = (struct datastack_pool *) 0x80c7788 (gdb) p *dpool $19 = {pool = {get_name = 0x80afbd5 <pool_data_stack_get_name>, ref = 0x80afbdf <pool_data_stack_ref>, unref = 0x80afc0d <pool_data_stack_unref>, malloc = 0x80afc70 <pool_data_stack_malloc>, free = 0x80afcc4 <pool_data_stack_free>, realloc = 0x80afcec <pool_data_stack_realloc>, clear = 0x80afdd0 <pool_data_stack_clear>, alloconly_pool = 1, datastack_pool = 1}, refcount = 1, data_stack_frame = 5} (gdb) p *dpool->data_stack_frame Cannot access memory at address 0x5 (gdb) p dpool->data_stack_frame $20 = 5 (gdb) p data_stack_frame $21 = 7

2 1

[Dovecot] Error indexing mbox file /var/mail/seb: LF not found where expected
by Sebastian 19 Dec '04

19 Dec '04

Howdy all, Dec 19 14:24:53 dev imap(seb): Error indexing mbox file /var/mail/seb: LF not found where expected I just installed version dovecot-0.99.12.1 for the first time on FreeBSD 4.10 stable. This error occurs when I try to check my mail from a remote client and I have new messages. Here is my configuration: http://unf.be/dovecot.conf It's very close to the default install. In attempts to remedy the problem, I set "mail_read_mmaped = no", but the problem persists. I'm not sure if it's relevent, but I'm receiving mail with postfix and my mail file has lines that end with \r\n Thanks in advance for any help Sebastian -- ------------- buddhahead(a)gmail.com

1 1

[Dovecot] Auth Mechanism
by Tom Allison 19 Dec '04

19 Dec '04

Uh... I'm trying to debug an application and keep running into this: DEBUG: Sending: 1 AUTHENTICATE CRAM-MD5 DEBUG: Sent 25 bytes DEBUG: Read: 1 NO Authentication failed: Unsupported authentication mechanism DEBUG: Read: * BYE Disconnected for inactivity. So is this really asking for "digest-md5" or am I S.O.L? IIRC these are different protocols, but it's a bit early for my head to get this together.

2 2

[Dovecot] Authentication problems
by Rory Campbell-Lange 19 Dec '04

19 Dec '04

Hi. I aim to provide pop3 and imap services to a few users. At the moment I only offer imap for squirrelmail users. However, I can't login successfully for pop3. It appears to be trying to auth against PAM, rather than directly using the passwd-file. Thoughts? Thanks, Rory Config: uthenticatprotocols = pop3 imap ssl_disable = yes login = imap login = pop3 mail_extra_groups = mail auth = default auth_mechanisms = plain auth_userdb = passwd-file /etc/dovecot.passwd.conf auth_user = root auth_verbose = yes Password file: # squirrelmail imap users user1:xe9l8sIMpcTsg:1008:1008::::chroot:Maildir:/home/cmp/Maildir/user1 user2:m7VKCgWVmZYMY:1008:1008::::chroot:Maildir:/home/cmp/Maildir/user2 user3:ELh9mthLVjEG2:1008:1008::::chroot:Maildir:/home/cmp/Maildir/user3 # normal users xyz1:QtR.iN1DbL/UM:1004:1004::::chroot:mbox:/var/mail/xyz1 xyz2:y38.qLIgrvYic:1002:1002::::~/Mail:mbox:/var/mail/xyz2:INDEX=/home/xyz2 ... Problem shown in log: Dec 19 16:45:30 localhost dovecot-auth: PAM: pam_authenticate(xyz2) failed: User not known to the underlying authentication module Dec 19 16:45:30 localhost pop3-login: Aborted login [ipaddress] -- Rory Campbell-Lange <rory(a)campbell-lange.net> <www.campbell-lange.net>

2 1

[Dovecot] 1.0-test59
by Timo Sirainen 19 Dec '04

19 Dec '04

http://dovecot.org/test/ No-one had been testing 1.0-tests with Evolution? It was pretty much completely broken with messages having attachments. - test58's output stream code change were entirely wrong and caused bad breakages with mbox. - Named pipes are now treated as write-only mboxes (blocks if no-one is reading, perhaps it should timeout in a few seconds?) - FETCH BODY[n.xxx] replies were all wrong - LDAP authentication was crashing - pop3_uidl_format=%f from Andrey test60 will probably have keyword support. Its index file code is already working, with ability to set over 500k different keywords per mailbox (because message record size is limited to 65535 bytes - should be enough for everyone :). Code is still missing to notify other session about keyword changes, and storing the keywords into mbox/maildir. For mbox I can use X-Keywords header. There should probably be some configurable limit to how many keywords to set per mailbox.. Dovecot shouldn't mind if the X-Keywords header is huge, but other programs might. For maildir then.. I think I'll just implement it backwards compatible with 0.99.x, ie. store in maildir filename with a-z letters. That would make max. 26 keywords per mailbox. Except maybe I shouldn't limit it to that. The rest could be stored only in indexes. That however would make it necessary to keep indexes backwards compatible forever so data is not lost.

3 2

[Dovecot] 0.99.13-rc1
by Timo Sirainen 19 Dec '04

19 Dec '04

http://dovecot.org/rc/ I guess the RCing in 0.99.12 didn't help that much. SQL/LDAP authentication crashed because memory was freed wrong. Please test so it would actually work in 0.99.13. Also fixed SEARCH UNKEYWORD which wasn't working. Also added 1.0-test's oe-ns-eoh POP3 workaround built-in.

2 1

[Dovecot] Cygwin and index code
by Johannes Berg 19 Dec '04

19 Dec '04

As I can currently only work with windows (eek) I thought I'd try dovecot there. I already sent a patch to make dovecot compile under cygwin, but it still doesn't really work, here's part of a session that I started while my maildir was totally empty (only cur/new/tmp in ~/Maildir) $ ./imap.exe * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS] Logged in as jmberg A01 SELECT INBOX imap(jmberg): Warning: Compressing cache file /home/jmberg/Maildir/dovecot.index.cache imap(jmberg): Error: open() failed with file /home/jmberg/Maildir/dovecot.index.tmp: Permission denied A01 NO Internal error occured. Refer to server log for more information. [2004-12-17 15:51:06] A02 LOGOUT * BYE Logging out A02 OK Logout completed. A second session (some files were created by the first) yields this: $ ./imap.exe * PREAUTH [CAPABILITY IMAP4rev1 SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS] Logged in as jmberg A01 SELECT INBOX imap(jmberg): Error: open() failed with file /home/jmberg/Maildir/dovecot.index.tmp: Permission denied imap(jmberg): Error: rename(/home/jmberg/Maildir/dovecot.index.tmp, /home/jmberg/Maildir/dovecot.index) failed: Permission denied A01 NO Internal error occured. Refer to server log for more information. [2004-12-17 15:52:25] A02 LOGOUT * BYE Logging out A02 OK Logout completed. I think this is probably due to the indexing code opening the .tmp file and then unlinking it and trying to re-create it while the first is still open. Or something, I really am not sure. *Maybe* the index code might be made work if it creates a new temporary file-name every time it re-creates the file, but I don't understand the code well enough (yet) to give a better analysis of the problem. However, I do not think that this is really important. I certainly don't want to run dovecot on windows (I only saw cygwin compile in the todo and since I have a cygwin setup anyway I thought I'd try). The whole thing doesn't work anyway: [after correcting users, making directories, make install...] $ /usr/local/sbin/dovecot.exe dovecot: Dec 17 16:03:17 Info: Dovecot v1.0-test58 starting up dovecot: Dec 17 16:03:18 Error: login: fd_read() failed: Function not implemented dovecot: Dec 17 16:03:18 Error: close(mail client) failed: Bad file descriptor dovecot: Dec 17 16:03:18 Error: Login process died too early - shutting down dovecot: Dec 17 16:03:18 Error: imap-login: dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 32): Invalid argument dovecot: Dec 17 16:03:18 Error: login: fd_read() failed: Function not implemented dovecot: Dec 17 16:03:18 Error: close(mail client) failed: Bad file descriptor dovecot: Dec 17 16:03:18 Error: imap-login: dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 32): Invalid argument dovecot: Dec 17 16:03:18 Error: login: fd_read() failed: Function not implemented dovecot: Dec 17 16:03:18 Error: close(mail client) failed: Bad file descriptor dovecot: Dec 17 16:03:18 Error: imap-login: dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 32): Invalid argument dovecot: Dec 17 16:03:18 Error: auth(default): dovecot: Dec 17 16:03:18 Fatal: setrlimit(RLIMIT_DATA, 256): Invalid argument dovecot: Dec 17 16:03:18 Error: child 2176 (auth) returned error 89 dovecot: Dec 17 16:03:18 Error: child 2192 (login) returned error 89 dovecot: Dec 17 16:03:18 Error: child 2212 (login) returned error 89 dovecot: Dec 17 16:03:18 Error: child 2232 (login) returned error 89 Maybe someone cares. If not, well, I had a less boring train ride ;) johannes

2 1

[Dovecot] building on cygwin
by Johannes Berg 19 Dec '04

19 Dec '04

Hi, attached patch makes dovecot build on cygwin (only have a windows computer at the moment :-/ ) It spews a lot of warnings, for example "unsigned int format but uint32_t argument". johannes Only in dovecot-1.0-test58.mod/: Makefile Only in dovecot-1.0-test58.mod/: config.h Only in dovecot-1.0-test58.mod/: config.log Only in dovecot-1.0-test58.mod/: config.status Only in dovecot-1.0-test58.mod/doc: Makefile Only in dovecot-1.0-test58.mod/: libtool Only in dovecot-1.0-test58.mod/src: Makefile Only in dovecot-1.0-test58.mod/src/auth: .deps Only in dovecot-1.0-test58.mod/src/auth: Makefile Only in dovecot-1.0-test58.mod/src/imap: .deps Only in dovecot-1.0-test58.mod/src/imap: Makefile Only in dovecot-1.0-test58.mod/src/imap-login: .deps Only in dovecot-1.0-test58.mod/src/imap-login: Makefile Only in dovecot-1.0-test58.mod/src/lib: .deps Only in dovecot-1.0-test58.mod/src/lib: Makefile Only in dovecot-1.0-test58.mod/src/lib-auth: .deps Only in dovecot-1.0-test58.mod/src/lib-auth: Makefile Only in dovecot-1.0-test58.mod/src/lib-charset: .deps Only in dovecot-1.0-test58.mod/src/lib-charset: Makefile Only in dovecot-1.0-test58.mod/src/lib-imap: .deps Only in dovecot-1.0-test58.mod/src/lib-imap: Makefile Only in dovecot-1.0-test58.mod/src/lib-index: .deps Only in dovecot-1.0-test58.mod/src/lib-index: Makefile diff -ur --strip-trailing-cr dovecot-1.0-test58/src/lib-index/mail-cache-decisions.c dovecot-1.0-test58.mod/src/lib-index/mail-cache-decisions.c --- dovecot-1.0-test58/src/lib-index/mail-cache-decisions.c 2004-11-24 19:40:17.000000000 +0100 +++ dovecot-1.0-test58.mod/src/lib-index/mail-cache-decisions.c 2004-12-16 15:31:24.659497600 +0100 @@ -71,7 +71,7 @@ #include "mail-cache-private.h" void mail_cache_decision_lookup(struct mail_cache_view *view, uint32_t seq, - unsigned int field) + uint32_t field) { struct mail_cache *cache = view->cache; const struct mail_index_header *hdr; @@ -115,7 +115,7 @@ } void mail_cache_decision_add(struct mail_cache_view *view, uint32_t seq, - unsigned int field) + uint32_t field) { struct mail_cache *cache = view->cache; uint32_t uid; Only in dovecot-1.0-test58.mod/src/lib-mail: .deps Only in dovecot-1.0-test58.mod/src/lib-mail: Makefile Only in dovecot-1.0-test58.mod/src/lib-ntlm: .deps Only in dovecot-1.0-test58.mod/src/lib-ntlm: Makefile Only in dovecot-1.0-test58.mod/src/lib-settings: .deps Only in dovecot-1.0-test58.mod/src/lib-settings: Makefile Only in dovecot-1.0-test58.mod/src/lib-sql: .deps Only in dovecot-1.0-test58.mod/src/lib-sql: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage: .deps Only in dovecot-1.0-test58.mod/src/lib-storage: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/index: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/index: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/index/maildir: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/index/maildir: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/index/mbox: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/index/mbox: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/register: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/register: Makefile Only in dovecot-1.0-test58.mod/src/lib-storage/register: mail-storage-register.c Only in dovecot-1.0-test58.mod/src/lib-storage/subscription-file: .deps Only in dovecot-1.0-test58.mod/src/lib-storage/subscription-file: Makefile Only in dovecot-1.0-test58.mod/src/login-common: .deps Only in dovecot-1.0-test58.mod/src/login-common: Makefile Only in dovecot-1.0-test58.mod/src/master: .deps Only in dovecot-1.0-test58.mod/src/master: Makefile Only in dovecot-1.0-test58.mod/src/pop3: .deps Only in dovecot-1.0-test58.mod/src/pop3: Makefile Only in dovecot-1.0-test58.mod/src/pop3-login: .deps Only in dovecot-1.0-test58.mod/src/pop3-login: Makefile Only in dovecot-1.0-test58.mod/src/util: .deps Only in dovecot-1.0-test58.mod/src/util: Makefile diff -ur --strip-trailing-cr dovecot-1.0-test58/src/util/dovecotpw.c dovecot-1.0-test58.mod/src/util/dovecotpw.c --- dovecot-1.0-test58/src/util/dovecotpw.c 2004-07-30 05:16:23.000000000 +0200 +++ dovecot-1.0-test58.mod/src/util/dovecotpw.c 2004-12-16 15:34:03.818356800 +0100 @@ -7,7 +7,6 @@ #include <ctype.h> #include <fcntl.h> -#include <libgen.h> #include <stdio.h> #include <stdlib.h> #include <unistd.h> Only in dovecot-1.0-test58.mod/: stamp-h1 Only in dovecot-1.0-test58.mod/: stamp.h

2 2

[Dovecot] spam plugin
by Johannes Berg 18 Dec '04

18 Dec '04

Here's a new version, it compiles (and appears to work) except the part in "copy_reclassified". Can anyone help me (probably only Timo knows how) with that? http://johannes.sipsolutions.net/edit/Projects/dovecot-dspam-integration/ps… johannes

2 1

[Dovecot] 1.0-test58
by Timo Sirainen 18 Dec '04

18 Dec '04

http://dovecot.org/test/ - Fixed APPEND hanging in some situations. Didn't happen with mail_save_crlf=yes. - Added pop3_uidl_format setting. No need to patch sources anymore if you don't want the default. Does anyone want pop3_uidl_xuidl_header yes/no setting, with fallbacking to pop3_uidl_format if X-UIDL header isn't found? Shouldn't be difficult to do.. - Added mbox_very_dirty_syncs setting which tries to avoid re-reading mbox as long as possible. - CREATE dir/ wasn't working - If login_process_per_connection=no and auth process count > 1, each auth process listens in different socket. Login processes then connect to all these sockets and send requests to them in round robin. - Multiple auth sections in config file work now a bit better. dovecot-auth might still complain about timeouts though.

6 9