November 2008 - dovecot

[Dovecot] Panic 1.1.4
by Andre Hübner 14 Jan '09

14 Jan '09

Hi List, try 1.1.4 and have new Panics in Log. Hoped that 1.1.3 finishes this errors... Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Loading modules from directory: /usr/lib/dovecot/imap Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Module loaded: /usr/lib/dovecot/imap/lib20_mail_log_plugin.so Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Effective uid=857, gid=628, home=/home/popuser/username Oct 8 21:56:28 dd10636 dovecot: IMAP(username): mbox: data=~/mail:INBOX=/var/spool/mail/username Oct 8 21:56:28 dd10636 dovecot: IMAP(username): fs: root=/home/popuser/username/mail, index=, control=, inbox=/var/spool/mail/username Oct 8 21:56:28 dd10636 dovecot: imap-login: Login: user=<username>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Oct 8 21:56:28 dd10636 dovecot: Panic: IMAP(username): file istream-limit.c: line 84 (i_stream_limit_read): assertion failed: (ret != -1 || stream->istream.e of || stream->istream.stream_errno != 0) Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Raw backtrace: imap [0x80c3a30] -> imap [0x80c3a8a] -> imap [0x80c338c] -> imap [0x80c9d04] -> imap(i_stream_ read+0x28) [0x80c7e28] -> imap(i_stream_read_data+0x1d) [0x80c7edd] -> imap(message_parse_header_next+0x7c) [0x80bbcdc] -> imap [0x80b9385] -> imap [0x80b9aa7 ] -> imap [0x80b9bb4] -> imap [0x80b9c95] -> imap(i_stream_seek+0x69) [0x80c7db9] -> imap [0x8071763] -> /usr/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7f a3aec] -> /usr/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7fa3d56] -> imap(cmd_copy+0x1d2) [0x805a142] -> imap [0x805edfc] -> imap [0x805eea5] -> imap [0x8 05f665] -> imap(client_input+0x5e) [0x805f87e] -> imap(io_loop_handler_run+0x100) [0x80cb590] -> imap(io_loop_run+0x28) [0x80ca6a8] -> imap(main+0x4ac) [0x806 73bc] -> /lib/libc.so.6(__libc_start_main+0xdc) [0xb7e8d87c] -> imap [0x8059191] Oct 8 21:56:28 dd10636 dovecot: child 9120 (imap) killed with signal 6 dovecot -n # 1.1.4: /etc/dovecot.conf protocols: imap imaps pop3 pop3s ssl_ca_file: /path/to/*hostname.com.bundle.crt ssl_cert_file: /path/to/*.hostname.com.crt ssl_key_file: /path/to/*.hostname.com.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: hostname.com mailserver ready. login_process_per_connection: no login_processes_count: 1 max_mail_processes: 100 verbose_proctitle: yes mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u mail_cache_min_mail_count: 30 mail_debug: yes lock_method: flock mbox_read_locks: dotlock mbox_very_dirty_syncs: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): mail_log mail_plugins(imap): mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail imap_client_workarounds(imap): outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): oe-ns-eoh outlook-no-nuls auth default: verbose: yes passdb: driver: shadow userdb: driver: passwd gdb /usr/libexec/dovecot/imap /home/popuser/username/core GNU gdb 6.4 Copyright 2005 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i586-suse-linux"...Using host libthread_db library "/lib/libthread_db.so.1". Core was generated by `imap [username 127.0.0.1]'. Program terminated with signal 6, Aborted. warning: Can't read pathname for load map: Eingabe-/Ausgabefehler. Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /usr/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /lib/libnss_files.so.2...done. Loaded symbols for /lib/libnss_files.so.2 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 #0 0xffffe410 in __kernel_vsyscall () (gdb) bt full #0 0xffffe410 in __kernel_vsyscall () No symbol table info available. #1 0xb7ea07d0 in raise () from /lib/libc.so.6 No symbol table info available. #2 0xb7ea1ea3 in abort () from /lib/libc.so.6 No symbol table info available. #3 0x080c3a3d in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:150 backtrace = 0x80f1ae8 "imap [0x80c3a30] -> imap [0x80c3a8a] -> imap [0x80c338c] -> imap [0x80c9d04] -> imap(i_stream_read+0x28) [0x80c7e28] -> imap(i_stream_read_data+0x1d) [0x80c7edd] -> imap(message_parse_header_next+0x7c"... #4 0x080c3a8a in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x80d71ac "file %s: line %d (%s): assertion failed: (%s)", args=0xbf941da4 "Sj\016\bT") at failures.c:430 No locals. #5 0x080c338c in i_panic (format=0x80d71ac "file %s: line %d (%s): assertion failed: (%s)") at failures.c:197 args = 0xbf941da4 "Sj\016\bT" #6 0x080c9d04 in i_stream_limit_read (stream=0x8118cc8) at istream-limit.c:83 left = <value optimized out> ret = -1 pos = 65 __PRETTY_FUNCTION__ = "i_stream_limit_read" #7 0x080c7e28 in i_stream_read (stream=0x8118cf0) at istream.c:73 _stream = (struct istream_private *) 0x0 ret = <value optimized out> __PRETTY_FUNCTION__ = "i_stream_read" #8 0x080c7edd in i_stream_read_data (stream=0x8118cf0, data_r=0xbf941e68, size_r=0xbf941e64, threshold=65) at istream.c:299 ret = -1080811928 read_more = false __PRETTY_FUNCTION__ = "i_stream_read_data" #9 0x080bbcdc in message_parse_header_next (ctx=0x81118f0, hdr_r=0xbf941ec0) at message-header-parser.c:89 msg = ( const unsigned char *) 0x811292f "qan4iKSQ1jgszBF7yO1N1FgdflELgOSeaEzr+P+aEXdIbk/ooMFh+wew7C5rzd2W+AfY+P7e\n3el1/64bLf+hadyHUxkt3auVaT3Y6zcoxZaSmY1gEydp4JcyEVNapSNbsWFKYUTSJiju10VF\nkBLd+JYm8PvXkDSplAEe9MRASmX2Jzt/zG6b39O5byfU5IA6JiBj/5"... i = 6 size = 65 startpos = 64 colon_pos = 4294967295 parse_size = 64 value_pos = <value optimized out> ret = 6 continued = false continues = <value optimized out> crlf_newline = false #10 0x080b9385 in read_header (mstream=0x8118da8) at istream-header-filter.c:163 hdr = (struct message_header_line *) 0x0 highwater_offset = <value optimized out> pos = <value optimized out> ret = <value optimized out> matched = false hdr_ret = <value optimized out> __PRETTY_FUNCTION__ = "read_header" #11 0x080b9aa7 in i_stream_header_filter_read (stream=0x8118da8) at istream-header-filter.c:293 mstream = (struct header_filter_istream *) 0x0 ret = <value optimized out> pos = <value optimized out> #12 0x080b9bb4 in parse_header (mstream=0x8118da8) at istream-header-filter.c:333 pos = 73 #13 0x080b9c95 in i_stream_header_filter_seek (stream=0x8118da8, v_offset=1904, mark=false) at istream-header-filter.c:347 mstream = (struct header_filter_istream *) 0x0 #14 0x080c7db9 in i_stream_seek (stream=0x8118dd0, v_offset=1904) at istream.c:144 _stream = (struct istream_private *) 0x8118da8 ---Type <return> to continue, or q <return> to quit--- #15 0x08071763 in mbox_mail_get_physical_size (_mail=0x81142b8, size_r=0xbf942058) at mbox-mail.c:255 mail = <value optimized out> data = (struct index_mail_data *) 0x8114334 input = (struct istream *) 0x8118dd0 hdr_size = {physical_size = 1738, virtual_size = 1771, lines = 33} old_offset = 1904 body_offset = 151200709 body_size = <value optimized out> next_offset = 148393877 #16 0xb7fa3aec in mail_log_action (dest_trans=<value optimized out>, mail=0x81142b8, event=<value optimized out>, data=0x810f4f8 "Trash") at mail-log-plugin.c:305 lt = (struct mail_log_transaction_context *) 0x811c708 msgid = 0x8114bb4 "<20081008182128.D148E68E1BECD(a)relay1.senderdomain.net>" size = <value optimized out> str = (string_t *) 0x80f1858 pool = <value optimized out> #17 0xb7fa3d56 in mail_log_copy (t=0x810ff00, mail=0x81142b8, flags=MAIL_SEEN, keywords=0x0, dest_mail=0x0) at mail-log-plugin.c:400 _data_stack_cur_id = 4 name = <value optimized out> #18 0x0805a142 in cmd_copy (cmd=0x80fb9c8) at cmd-copy.c:66 client = (struct client *) 0x80fa548 storage = (struct mail_storage *) 0x80fb108 destbox = (struct mailbox *) 0x810f358 t = (struct mailbox_transaction_context *) 0x810ff00 search_arg = <value optimized out> messageset = 0x80ffac0 "737" mailbox = 0x80ffac8 "Trash" src_uidset = <value optimized out> msg = <value optimized out> sync_flags = <value optimized out> imap_flags = <value optimized out> copy_count = 1 uid_validity = <value optimized out> uid1 = <value optimized out> uid2 = <value optimized out> ret = 1 __PRETTY_FUNCTION__ = "cmd_copy" #19 0x0805edfc in client_command_input (cmd=0x80fb9c8) at client.c:580 client = (struct client *) 0x80fa548 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #20 0x0805eea5 in client_command_input (cmd=0x80fb9c8) at client.c:629 client = (struct client *) 0x80fa548 command = (struct command *) 0x23a0 __PRETTY_FUNCTION__ = "client_command_input" #21 0x0805f665 in client_handle_input (client=0x80fa548) at client.c:670 _data_stack_cur_id = 3 ret = <value optimized out> remove_io = <value optimized out> handled_commands = false #22 0x0805f87e in client_input (client=0x80fa548) at client.c:725 cmd = <value optimized out> output = (struct ostream *) 0x80fb904 bytes = 23 __PRETTY_FUNCTION__ = "client_input" #23 0x080cb590 in io_loop_handler_run (ioloop=0x80f99b0) at ioloop-epoll.c:203 ctx = <value optimized out> event = (const struct epoll_event *) 0x80f9ae8 list = (struct io_list *) 0x80fa5b8 ---Type <return> to continue, or q <return> to quit--- io = (struct io_file *) 0x80fb960 tv = {tv_sec = 1799, tv_usec = 999127} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #24 0x080ca6a8 in io_loop_run (ioloop=0x80f99b0) at ioloop.c:320 No locals. #25 0x080673bc in main (argc=Cannot access memory at address 0x23a0 ) at main.c:293 No locals. Thanks Andre

2 2

[Dovecot] Master user with "user="?
by Alan Ferrency 09 Jan '09

09 Jan '09

Hello, In our configuration, we are using a "passdb passwd-file", with "user=" directives in each username, and a separate "userdb passwd-file" which contains the target usernames for the "user=" directives. This works fine, for normal logins via POP and IMAP. For customer support testing purposes, we also set up a temporary "master=yes" passwd-file. This works fine, for any passdb username that does not have a "user=" field. However, it seems that if we use the master user to log into a username that is in the passdb with a "user=" field, dovecot looks in the userdb for the original username, and not for the "user=" username specified in the passdb passwd-file. Is this a known bug? Maybe I'm doing something wrong? Thanks! Alan Ferrency pair Networks, Inc. alan(a)pair.com

2 4

[Dovecot] allow_nets overridden by cache
by Guy 08 Jan '09

08 Jan '09

Hi, I've just started trying allow_nets on one of my servers. I have auth_debug and auth_verbose both enabled and the output is as follows: Oct 28 13:05:48 mink dovecot: auth-worker(default): auth(user(a)domain.net,x.x.x.x): allow_nets: Matching for network 127.0.0.1/8 Oct 28 13:05:48 mink dovecot: auth-worker(default): auth(user(a)domain.net,x.x.x.x): allow_nets: Matching for network 10.0.7.176/28 Oct 28 13:05:48 mink dovecot: auth-worker(default): passdb(user(a)domain.net,x.x.x.x): allow_nets check failed: IP not in allowed networks Oct 28 13:05:50 mink dovecot: auth(default): client out: FAIL 1265 user=username(a)aluminati.net Oct 28 13:05:50 mink dovecot: auth(default): cache(user(a)domain.net,x.x.x.x): hit: <hidden> user=user(a)domain.net Oct 28 13:05:50 mink dovecot: auth(default): client out: OK 1266 user=user(a)domain.net auth_cache_ttl is set to 300. If I set it to 1 then the allow_nets successfully rejects. Once I set it back up to 300 the cache overrides the result from the allow_nets check and let's the account log in even though the allow_nets check fails. I've tried waiting for longer than the 300 seconds and then logged in again, but I still get the same result as above. Is there a gotcha that I'm unaware of or have I done something stupid (which seems the most likely :P)? Thanks Guy -- Don't just do something...sit there!

2 4

[Dovecot] More info from mail_log plugin
by Bardur Haskor 19 Dec '08

19 Dec '08

HiWe need to track exactly when our users read messages. Unfortunately, I haven't been able to figure out how we can achieve this with Dovecot. Then I saw the mail_log plugin.Is it possible to extend the plugin to also log system flag changes? This would be great, because then we could see in the log files when the Seen flag has been set. Changes in user defined flags would also be interesting to track.I know this would create a lot of log entries, but for us this wouldn't be a problem. Maybe the plugin would default to not tracking flag changes, but could be configured to do so.RegardsBardur Ha Skor _________________________________________________________________ Connect to the next generation of MSN Messenger http://imagine-msn.com/messenger/launch80/default.aspx?locale=en-us&source=…

2 3

[Dovecot] [PATCH] drop root privileges on solaris, request for testing
by Andrey Panin 18 Dec '08

18 Dec '08

Hello all, this patch allows master process to drop more root priveleges under Solaris. My limited testing shows that code works, but I'm not sure that defined privilege set is permissive enough for dovecot. Unfortunately I have no root access to our Solaris servers to really test it. So if someone is ready to test this patch please do it :) Best regards.

3 6

[Dovecot] v1.1.6 released
by Timo Sirainen 17 Dec '08

17 Dec '08

http://dovecot.org/releases/1.1/dovecot-1.1.6.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.6.tar.gz.sig The invalid message address parsing bug is pretty important since it allows a remote user to send broken mail headers and prevent the recipient from accessing the mailbox afterwards, because the process will always just crash trying to parse the header. This is assuming that the IMAP client uses FETCH ENVELOPE command, not all do. Note that it doesn't affect versions older than v1.1.4. + dovecot -n and -a now prints some system information at the top. + More error/debug message logging improvements. - pop3-login: Fixed assert-crash if a client sent USER+PASS+USER+PASS commands in the same IP packet. - Parsing an invalid message address like "From: (" caused an assert-crash in v1.1.4 and v1.1.5. - Folding whitespace wasn't handled correctly inside quoted-strings, causing some messages to be parsed incorrectly. - mbox: Fixed saving messages that begin with a valid From_-line.

10 25

[Dovecot] v1.2Autocreate
by Robert Schetterer 17 Dec '08

17 Dec '08

Hi Timo, a setup like http://wiki.dovecot.org/Plugins/Autocreate seems not to work the module is loaded but no subfolder creation at login happens, sorry no log about failures with it simply Module loaded: /usr/lib/dovecot/modules/imap/lib20_autocreate_plugin.so should i try i.e autocreate = ".Trash/" or is there more info around -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 12

[Dovecot] dovecot >1.1.3 + antispam plugin issues
by Marcin Rzepecki 16 Dec '08

16 Dec '08

Hello, i have following problems using dovecot-antispam plugin (Dovecot >1.1.3, FreeBSD 8.0-Current, dovecot-antispam 1.0/1.1) dovecot-antispam compiled using dspam-exec/mailtrain, with/wo debugging (i've tried all possibilities) When i try to move message to SPAM folder (using dspam-exec backend) i'm getting IMAP error: antispam signature not found and in dovecot logs: Nov 23 23:44:24 freebsd dovecot: IMAP(mr): Next message unexpectedly lost from 2708619 Using mail backend gives this error too(only IMAP error changes: failed to read mail beggining). Commenting out following code in mbox_read_from_line function (in src/lib-storage/index/mbox/istream-raw-mbox.c) helped and plugin was working correctly, but only with Dovecot <=1.1.3. if (stream->istream.v_offset - rstream->hdr_offset + new_pos > rstream->mail_size) { /* istream_raw_mbox_set_next_offset() used invalid cached next_offset? */ i_error("Next message unexpectedly lost from %"PRIuUOFF_T, rstream->hdr_offset + rstream->mail_size); rstream->eof = TRUE; rstream->corrupted = TRUE; rstream->istream.istream.stream_errno = EINVAL; stream->pos = 0; return -1; } Now, with versions >1.1.3 this won't helps and plugin fails. Anyone knows how to get it working? I would like to upgrade to newest dovecot release Best regards, mr

6 9

[Dovecot] Panic in 1.1.6 file ioloop.c: line 206
by Laurent Blume 14 Dec '08

14 Dec '08

Hi all, I just had a panic with dovecot 1.1.6, two days after replacing 1.0.15 with it in production. Here are the logs immediately preceding the panic, I think they're related. It seems the user connected simultaneously from two different clients, from his own computer and a webmail running on the server, then manipulated mail folders on one side, and logged out. The panic occurred 3 seconds after the logout. Is there a setting I might have missed that could avoid that? TIA, Laurent Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): stat() failed with mbox file /home/user/r&AOk-union-DA: No such file or directory Nov 27 19:25:59 balif last message repeated 1 time Nov 27 19:25:59 balif dovecot: [ID 107833 local2.info] IMAP(user): Disconnected: Logged out bytes=436/4810193 Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): file_dotlock_open() failed with file /var/dovecot/index/user/.imap/R&AOk-union-DAFC-DCBE-DMCT/dovecot.index.log: No such file or directory Nov 27 19:25:59 balif last message repeated 1 time Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): stat() failed with mbox file /home/user/R&AOk-union-DAFC-DCBE-DMCT: No such file or directory Nov 27 19:25:59 balif dovecot: [ID 107833 local2.info] IMAP(user): Disconnected: Logged out bytes=494/314696 Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): file_dotlock_open() failed with file /var/dovecot/index/user/.imap/r&AOk-union-directeurs/dovecot.index.log: No such file or directory Nov 27 19:25:59 balif last message repeated 1 time Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): stat() failed with mbox file /home/user/r&AOk-union-directeurs: No such file or directory Nov 27 19:25:59 balif dovecot: [ID 107833 local2.info] IMAP(user): Disconnected: Logged out bytes=470/1138733 Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): file_dotlock_open() failed with file /var/dovecot/index/user/.imap/NACRE/dovecot.index.log: No such file or directory Nov 27 19:25:59 balif last message repeated 1 time Nov 27 19:25:59 balif dovecot: [ID 107833 local2.error] IMAP(user): stat() failed with mbox file /home/user/NACRE: No such file or directory Nov 27 19:25:59 balif last message repeated 1 time Nov 27 19:25:59 balif dovecot: [ID 107833 local2.info] IMAP(user): Disconnected: Logged out bytes=2429/174842484 Nov 27 19:25:59 balif dovecot: [ID 107833 local2.info] IMAP(user): Disconnected: Logged out bytes=467/10178 Nov 27 19:26:02 balif dovecot: [ID 107833 local2.crit] Panic: file ioloop.c: line 206: assertion failed: (tv_r->tv_sec >= 0 && tv_r->tv_usec >= 0) Nov 27 19:26:02 balif dovecot: [ID 398108 local2.error] Raw backtrace: 0x24d90 -> 0x2851c -> 0x286ac -> 0x28728 -> 0x28de0 -> 0x2877c -> 0x1f56c -> 0x15c40 -- / Leader de Projet & Communauté | I'm working, but not speaking for \ G11N http://fr.opensolaris.org | Bull Services http://www.bull.com / FOSUG http://guses.org |

2 3

[Dovecot] Dovecot Proxy with MySQL auth
by Justin Krejci 04 Dec '08

04 Dec '08

We are looking at deploying several pop/imap servers to house the mail for 15,000 or more mailbox accounts. We are contemplating on the design and are looking at using MySQL auth (we already have a MySQL environment in place for our user auth to live) and proxy_maybe so each server can proxy for all the others and we just have a network load balancer distribute the incoming connections to all of the Dovecot servers. Each server would have its own local maildir storage for the users local to that server and all of the authentication and target backend pop/imap server data would be stored in the same MySQL database. The problem we are running into is the documentation is not very clear on this type of scenario. http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy At the bottom of this page it gives a query example of "SELECT NULL AS password, ." but that does not seem to allow for us to use the proxy_maybe if the destination server is localhost (and therefore do not proxy) it does not seem that the above query will actually send the real password for authentication. Is this a misunderstanding on our part or is the use of mysql auth + proxy_maybe not feasible? Assuming the latter we surmised using a separate instance of Dovecot on each machine to act solely as a proxy front end (use proxy instead of proxy_maybe) then on the second instance there is no proxy config and it listens on a separate TCP port like 80143 or whatever. Any input or suggestions would be appreciated. Justin Krejci

2 4